Product sales data processing system, mobile terminal device, and computer
The product sales data processing system uses a mobile terminal with imaging and detection to address incomplete barcode reading, preventing fraud and ensuring accurate product registration by displaying captured images to correct registration failures.
Patent Information
- Application Number
- JP2023174309
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-10-06
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2040-02-10
AI Technical Summary
Customers using mobile devices to register products may fail to read barcodes intentionally or unintentionally, leading to incomplete registration and potential fraud.
A product sales data processing system that includes a mobile terminal with imaging and detection capabilities to capture registration situations, detect incomplete registration, and display captured images to address failures, enabling proper product registration and fraud prevention.
The system effectively prevents registration failures and fraud by displaying captured images to identify and correct incomplete registrations, ensuring accurate product registration and payment processing.
Smart Images

Figure 0007595375000001 
Figure 0007595375000002 
Figure 0007595375000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a product sales data processing system, a mobile terminal device, and a computer. [Background technology]
[0002] 2. Description of the Related Art A system is known in which a customer registers an item by himself / herself using a mobile terminal equipped with a camera (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-147252 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, because customers themselves register products using a mobile terminal, there is the possibility of problems occurring, such as customers thinking they have scanned the barcode of a product but actually not being able to do so, or maliciously putting a product into the shopping cart without having the barcode scanned.
[0005] The present invention has been made in view of the above circumstances, and has an object to make it possible to appropriately deal with problems that arise when customers themselves register products. [Means for solving the problem]
[0006] One aspect of the present invention that solves the above-mentioned problems is a product sales data processing system in which products are registered by a mobile terminal device and a settlement device performs settlement processing corresponding to the products registered by the mobile terminal device, the product sales data processing system comprising: an imaging means arranged to be able to capture images of a situation related to the registration of a product by a customer; a detection means for detecting a predetermined registration failure situation in which the registration of a product is deemed to be failed while the product is being registered in accordance with a transaction; and a display control means for displaying an image corresponding to the registration failure situation detected by the detection means based on the image obtained by the imaging means when settlement is performed at the settlement device for the products registered in accordance with the transaction. [Brief description of the drawings]
[0007] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of a product sales data processing system according to an embodiment of the present invention. [Diagram 2] 1 is a diagram showing an example of the state near the entrance of a store in which a product sales data processing system according to an embodiment of the present invention has been introduced. [Diagram 3] 1A to 1C are diagrams illustrating examples of how a mobile terminal is set in a shopping cart according to an embodiment of the present invention. [Figure 4] FIG. 2 is a diagram illustrating a settlement device according to the present embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of the configuration of a mobile terminal according to the present embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of the configuration of a transaction management device according to the present embodiment. [Figure 7] 4A to 4C are diagrams illustrating an example of customer information, store information, and cart information according to the embodiment. [Figure 8] FIG. 13 is a diagram showing an example of a definition of a reserved product according to the embodiment; [Figure 9] A sequence diagram showing an example of processing procedures executed by a mobile terminal, a settlement device, and a transaction management device according to this embodiment in response to the accounting of one transaction in self-service operation. [Figure 10] 11A to 11C are diagrams showing examples of a start-up screen, a product registration initial screen, a product registration update screen, and a code display screen according to the present embodiment. [Figure 11] 11A to 11C are diagrams illustrating an example of a registered product presentation screen, a product registration screen, and a guide image according to the embodiment. [Figure 12] 11 is a flowchart illustrating an example of a processing procedure executed by a mobile terminal and a transaction management device according to the present embodiment in relation to product registration, including processing for dealing with a registration failure situation. [Figure 13] FIG. 13 is a diagram showing an example of a settlement screen according to the embodiment. [Figure 14] FIG. 13 is a diagram showing an example of a reserved product processing screen according to the embodiment; [Figure 15] FIG. 13 is a diagram showing an example of a reserved product processing screen according to the embodiment; [Figure 16] 1 is a diagram showing an example of an enlarged captured image area according to the embodiment; [Figure 17] FIG. 13 is a diagram showing an example of a reserved product processing screen according to the embodiment; [Figure 18] 1 is a diagram showing an example of an enlarged captured image area according to the embodiment; [Figure 19] 13 is a flowchart showing an example of a processing procedure executed by the settlement device according to the embodiment in relation to displaying a reserved product processing screen. [Figure 20] FIG. 11 is a diagram showing an example of a captured image area according to a first modified example of the present embodiment. [Figure 21] FIG. 11 is a diagram showing an example of a settlement screen according to a second modified example of the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] <Embodiment> [Example of overall configuration of product sales data processing system] FIG. 1 shows an example of the overall configuration of a product sales data processing system 1 according to this embodiment. The product sales data processing system 1 in the figure includes a management device 10 (e.g., a store controller), a transaction management device 20 (cloud server), a registration settlement device 30, a settlement device 40, a monitoring device 50 (e.g., a personal computer, etc.), and a mobile terminal 60. Although a registered settlement device 30 is illustrated, the number of registered settlement devices 30 installed in one store may be two or more. Although two settlement devices 40 are illustrated in the figure, the number of settlement devices 40 in one store may be one or three or more. Although one monitoring device 50 is illustrated in FIG. 1, the number of monitoring devices 50 in one store may be two or more. Furthermore, there may be two or more management devices 10 in one store. The product sales data processing system 1 in the figure can be introduced into various stores (supermarkets, convenience stores, drug stores, home centers, home appliance retailers, etc.).
[0009] The product sales data processing system 1 in the figure is capable of handling a store clerk-assisted operation in which a store clerk registers products using a registration and settlement device 30. The store clerk-assisted operation includes an operation in which the store clerk subsequently uses the registration and settlement device 30 to settle the payment for the registered products, and an operation in which a customer uses the settlement device 40 to settle the payment for the registered products. The sales system in the figure is also capable of supporting self-service operation in which a customer registers an item using a mobile terminal 60 and also performs payment using a payment device 40. In the following explanation, a case in which self-service operation is performed will be taken as an example.
[0010] The management device 10, the registration and settlement device 30, the settlement device 40, and the monitoring device 50 are installed in a store. The management device 10, the registration and settlement device 30, the settlement device 40, and the monitoring device 50 are communicatively connected via a LAN 19 (which may be wired or wireless). The management device 10 is communicable with the transaction management device 20.
[0011] The management device 10 is a device that manages various devices mainly installed in a store. For example, the management device 10 has a communication function with an external device, and receives a product file (product master) from an external device (e.g., a head office server not shown, which may be the transaction management device 20) and supplies it to the registration settlement device 30, etc., or receives transaction information from the settlement device 40, etc. and transmits it to the external device (e.g., the transaction management device 20, etc.).
[0012] The transaction management device 20 is a server that provides various services. For example, the transaction management device 20 manages various information (e.g., transaction information (cart information), etc.) corresponding to self-service operation.
[0013] The registration and settlement device 30 is a device that executes registration processing and settlement processing. The registration and settlement device 30 is used by a store clerk (the registration and settlement processing are executed by the operation of the store clerk).
[0014] The settlement device 40 is a device that executes settlement processing. The settlement device 40 is used by customers. In other words, the settlement device 40 executes settlement processing in response to operations by the customer. Note that, if the registered items at the time of settlement include items that require the assistance of a store clerk (hereinafter, referred to as "reserved items"), a store clerk is called, and the store clerk operates the settlement device 40 to cause the settlement device 40 to execute processing such as cancellation or registration of the reserved items.
[0015] The monitoring device 50 is a device that mainly monitors various devices within the LAN 19. The monitoring device 50 monitors the operating status of other devices (for example, the registration settlement device 30, the settlement device 40, etc.), displays various information on the other devices, and outputs various commands to the other devices.
[0016] The mobile terminal 60 is a terminal used by a customer in a self-service environment. In this embodiment, the mobile terminal 60 is used in a state where it is attached to a shopping cart 70 in a self-service environment.
[0017] The portable terminal 60 has a recognition function for recognizing various codes (barcodes, two-dimensional codes, etc.) in addition to a communication function and an imaging function (camera). For example, the portable terminal 60 recognizes a barcode attached to a product. In other words, the portable terminal 60 reads product identification information (product code). The portable terminal 60 also recognizes a barcode (marker 73 described later) in which predetermined information is encoded. In other words, the portable terminal 60 reads the predetermined information. The portable terminal 60 may extract feature points in an image captured by the imaging function (an image acquired as a through image) and recognize an object (various codes).
[0018] The mobile terminal 60 is a smartphone or the like owned by the customer. The mobile terminal 60 may be owned by the store and lent to the customer when shopping. Although two mobile terminals 60 are shown in the figure, the number of mobile terminals 60 used for product registration in the store varies depending on the number of customers.
[0019] A shopping application having a function for registering products in accordance with the self-service operation of this embodiment is installed on the mobile terminal 60.
[0020] Fig. 2 shows an example of the state near the entrance of a store in which the product sales data processing system 1 of this embodiment has been installed. As shown in Fig. 2, near the entrance (or the entrance if the entrance and exit are separate), rental shopping carts 70, rental shopping baskets 80, and sales shopping bags 90 are prepared. When a customer visits the store, he or she places the shopping basket 80 in the shopping cart 70, places the shopping bag 90 in the shopping basket 80, etc., and proceeds into the store. At this time, if the customer wishes to do the shopping by himself or herself, he or she places the mobile terminal 60 in the shopping cart 70.
[0021] The customer may bring the shopping bag 90 that he or she has purchased this time as his or her own bag the next time he or she visits the store or may bring a bag other than the shopping bag 90 as his or her own bag. Also, the customer may purchase a plastic bag.
[0022] Although not shown in the figure, a bag for reserved items (described later) is attached to the shopping cart 70 in addition to the shopping basket 80 for storing reserved items.
[0023] [Example of how a mobile device is placed in a shopping cart] An example of how the mobile terminal 60 is set in the shopping cart 70 will be described with reference to Fig. 3. Fig. 3(A) is a side view of the part of the shopping cart 70 where the mobile terminal 60 is set. Fig. 3(B) is a top view of the shopping cart 70.
[0024] As shown in Fig. 3(A), a holder 71 for setting a mobile terminal 60 is attached to a shopping cart 70. A customer sets the mobile terminal 60 in the holder 71. When the mobile terminal 60 is set in the holder 71, it is in a state where an image of the entire shopping bag 90 or a personal bag can be captured by the imaging unit 606, as shown in Fig. 3(B).
[0025] [About the payment device] FIG. 4 is a diagram for explaining the settlement device 40. FIG. 4(A) is a diagram showing an example of the appearance of the settlement device 40 (front view seen from the customer side). FIG. 4(B) is a diagram showing an example of the configuration of the settlement device 40. In FIG. 4(A) and FIG. 4(B), the same parts are given the same reference numerals.
[0026] An example of the configuration of settlement device 40 shown in Fig. 4(B) will be described below with reference to Fig. 4(A). Settlement device 40 includes a CPU 401, a ROM 402, a RAM 403, a hard disk 404, a display unit 405, a scanner unit 406, a card settlement unit 408, a change dispenser 409, a printing unit 413, an audio output unit 414, a communication unit 415, and an imaging unit 416 (camera). These can communicate with each other via a bus. Settlement device 40 may further include a key operation unit and an alarm unit (for example, a lamp on a sign pole, etc.).
[0027] The CPU 401 is a central processing unit, and controls the operation of the settlement device 40 by reading and executing programs stored in the ROM 402 . The ROM 402 is a read-only memory, and stores various types of information used by the CPU 401, including programs.
[0028] The RAM 403 is a read / write memory, and stores various information as a main storage device. For example, the RAM 403 stores information read from the ROM 402 or the hard disk 404, information acquired from the outside, information generated during processing, and the like.
[0029] The hard disk 404 stores various information as an auxiliary storage device. For example, the hard disk 404 may store programs executed by the CPU 401 instead of the ROM 402. Also, instead of the RAM 403, the hard disk 404 may store information read from the ROM 402, information acquired from the outside, information generated in processing, etc. Note that instead of the hard disk 404, a storage device such as an SSD (Solid State Drive) may be provided.
[0030] The display unit 405 is a touch display that displays various information and accepts various inputs.
[0031] The scanner unit 406 optically reads various information. For example, the scanner unit 406 scans a code (barcode, two-dimensional code, etc.) displayed on the display unit of the mobile terminal 60 and reads information necessary for the settlement process. The scanner unit 406 may also scan a code printed on a receipt (registered trademark) emitted by another device (for example, the registered settlement device 30) and read information necessary for the settlement process. The scanner unit 406 may also scan a code attached to a product and read the product code. The scanner unit 406 may also scan a code attached to a store clerk's name tag and read the store clerk code.
[0032] The card payment unit 408 is a payment mechanism that uses various cards (credit cards, prepaid cards such as transportation cards, cash cards for debit payments, point cards for point payments, etc.). The card payment unit 408 includes a card recognition unit (reading unit), a display unit, and an operation unit, but it is sufficient that the card payment unit 408 includes at least the card recognition unit. The card recognition unit may recognize various cards (e.g., point cards, membership cards, stockholder cards, etc.) for the purpose of providing benefits, discounts, etc.
[0033] The change machine 409 (cash settlement unit) is a mechanism for settlement with cash, and has an input port for banknotes and coins, and an output port for banknotes and coins, calculates the amount of money inserted into the input port, calculates the amount of change, which is the difference between the input amount and the purchase amount, and outputs the change from the output port. When banknotes or coins are inserted into the input port, they are detected by a sensor (detection of the fact that they have been inserted, detection of the number of coins by denomination, etc.).
[0034] The printing unit 413 prints and issues various media (receipts, bills, etc.). The audio output unit 414 outputs audio. For example, the audio output unit 414 outputs audio guidance and the like. The communication unit 415 transmits and receives information to and from other devices (the management device 10, the registered settlement device 30, the other settlement devices 40, the monitoring device 50, etc.).
[0035] The imaging unit 416 is provided to capture an image of, for example, the hands of a customer operating the change machine.
[0036] [Registered payment device] The registration and settlement device 30 may be configured to have a display unit and a scanner unit on each side (clerk side, customer side) and a settlement unit (card settlement unit, cash settlement unit) on one side (customer side). The registration and settlement device 30 configured in this way may be a device that can be switched to any of a plurality of operation modes (a mode in which the registration process is executed by the operation of the clerk and the settlement process is executed by the operation of the customer, a mode in which the registration process is executed by the operation of the clerk and the customer and the settlement process is executed by the operation of the customer, etc.) depending on, for example, the operating status. Also, if the registration and settlement device 30 is configured to execute the settlement process by the operation of the customer, it can be used for self-operation. That is, the customer can make a transaction by having the mobile terminal 60 execute the registration process and have the registration and settlement device 30 execute the settlement process. However, in the following description, an example will be given in which the settlement device 40 is used for self-service operation.
[0037] [Example of mobile device configuration] 5 shows an example of the configuration of a mobile terminal 60. The mobile terminal 60 in the figure includes a CPU 601, a storage unit 602, a RAM 603, a display unit 604, an operation unit 605, an imaging unit 606, and a network-compatible communication unit 607.
[0038] The CPU 601 is a central processing unit, and controls the operation of the mobile terminal 60 by reading and executing programs stored in the storage unit 602 . The storage unit 602 is an auxiliary storage device for the CPU 601, and stores various types of information used by the CPU 601, including programs. The RAM 603 is a main storage device for the CPU 601 .
[0039] The display unit 604 displays images according to display control by the CPU 601. The display unit 604 may be configured as a touch panel that allows operations to be performed on the screen. The operation unit 605 collectively indicates various operators provided on the mobile terminal 60 and various input devices connected to the mobile terminal 60.
[0040] The imaging unit 606 captures images under the control of the CPU 401. The imaging unit 606 of this embodiment can also function as a part that reads two-dimensional codes in a code reader that processes the two-dimensional codes.
[0041] The network-compatible communication unit 607 is a unit that wirelessly communicates via a network. The network-compatible communication unit 607 enables the mobile terminal 60 to communicate with the transaction management device 20.
[0042] [Example of transaction management device configuration] 6 shows an example of the configuration of transaction management device 20. Transaction management device 20 in the figure includes a CPU 201, a storage unit 202, a RAM 203, and a network-compatible communication unit 204. CPU 201 is a central processing unit that controls the operation of transaction management device 20 by reading and executing programs stored in memory unit 202 . The storage unit 202 is an auxiliary storage device for the CPU 201, and stores various types of information used by the CPU 201, including programs. The RAM 203 is a main storage device for the CPU 201 . The network compatible communication unit 204 is a part that performs communication via a network.
[0043] The memory unit 202 of the transaction management device 20 stores customer information, store information, product information, and cart information.
[0044] [Information stored in the transaction management device] The customer information stored in the memory unit 202 is information for managing individual customers. The transaction management device 20 generates customer information when a customer is registered (a customer's registration may be considered to have been completed when the customer information of that customer is stored). The transaction management device 20 also updates the customer information as appropriate based on cart information, etc. The transaction management device 20 may update the customer information, for example, by referring to the cart information at a specified time every day.
[0045] 7(A) shows an example of customer information stored in memory unit 602 of transaction management device 20. The customer information in this figure includes customer identification information, customer name, customer registration date, cancellation information, customer rank, number of points, etc. The customer identification information is identification information that uniquely identifies a customer. The customer identification information may be application identification information that is uniquely assigned to each installed shopping application when the shopping application of this embodiment is installed. The application identification information may be, for example, a number that is uniquely (for example, sequentially) assigned to each installed shopping application. Alternatively, the application identification information may be terminal identification information that is unique to the mobile terminal 60 in which the shopping application is installed. The terminal identification information may be, for example, a telephone number assigned to a customer who is the user of the mobile terminal 60, or hardware identification information that is uniquely assigned to the hardware of the mobile terminal 60, such as a MAC (Media Access Control) address. The customer name is the customer's name or nickname, etc. The customer registration date is the date and time when the customer was registered. Cancellation information is information regarding the cancellation of registered products after registration. The customer rank is a rank according to the customer's purchasing history. When generating customer information for a new customer, the customer identification information, customer name, and customer registration date are generated, but since this is before the start of actual trading (product registration), other information (cancellation information, etc.) is not generated.
[0046] The transaction management device 20 generates and stores customer identification information, for example, when registering a customer (for example, when the mobile terminal 60 downloads or installs a shopping application to use a shopping service provided by the transaction management device 20 from an external device (for example, a predetermined server that provides all applications, the transaction management device 20 itself)). In addition, for example, when registering a customer, the transaction management device 20 acquires information entered into the name field of a registration form (input form) using the mobile terminal 60, and stores it as the customer name. In addition, the transaction management device 20 acquires, for example, the current date and time when registering the customer, and stores it as the customer registration date.
[0047] In addition, instead of or in addition to storing the customer information in its own memory unit, the transaction management device 20 may store some or all of the customer information in another device (such as a file server accessible by the transaction management device 20).
[0048] 7(B) shows an example of store information stored in the memory unit 602 of the transaction management device 20. The store information in the figure includes store identification information, store name (branch name), store identification information 1, and store identification information 2. The store identification information is identification information that uniquely identifies a store. The store identification information shown in Fig. 7(B) is composed of a store (trade name) or company code and a branch code. The store name is the name of the store. The store name shown in FIG. 7B is composed of the store (trade name) or company and the branch name. The store identification information 1 is information on a two-dimensional code (QR code (registered trademark) or the like) for identifying a store where a transaction takes place (a store where a product is bought and sold). The store identification information 2 is store location information (GPS information) for identifying the store where the transaction is to be carried out. In the example shown in FIG. 7(B), the store identification information and the store specifying information 1 are different, but the store identification information and the store specifying information 1 may be the same.
[0049] The transaction management device 20 may obtain and store store information from an external source (such as a server (not shown) at a headquarters that manages each store). The transaction management device 20 may store some or all of the store information in another device (such as a file server accessible by the transaction management device 20) instead of or in addition to storing the store information in its own memory.
[0050] The product information is, for example, information acquired from the store management device 10, and is information about products sold in the store. The product information for one product includes information such as a product code (product identifier), product name, and price.
[0051] Cart information is information for managing individual transactions. The transaction management device 20 generates the cart information at the start of a transaction. In addition, the transaction management device 20 updates the cart information as the transaction progresses (each time a product is registered) (the storage of a product in the cart information may be interpreted as the registration of that product).
[0052] FIG. 7(C) is an example of cart information stored in the memory unit 602 of the transaction management device 20. The cart information in the figure includes cart identification information, transaction start date and time, transaction end date and time, customer identification information, registered product information, reserved product information, cancellation information, and the like.
[0053] The transaction status information corresponds to the second embodiment, which will be described later, and therefore a description thereof will be omitted here.
[0054] The cart identification information is identification information that uniquely identifies the cart information. For example, the cart identification information includes store identification information, a date, and a serial number (for example, a serial number for each store and each date). The transaction start date and time is the date and time when the transaction starts. The transaction start date and time may be, for example, the date and time when the cart information is generated. The transaction start date and time may be the date and time when the first item of product is registered (the date and time when the registered product information (registered product 1) in FIG. 7(C) is stored). The date and time when the cart information is generated and the date and time when the first item of product is registered may both be stored separately.
[0055] The transaction end date and time is the end date and time of the transaction. For example, the transaction start date and time may be the settlement date and time. The customer identification information is customer identification information that identifies the customer of the transaction. When the cart information is generated, the cart identification information, transaction start date and time, and customer identification information are generated, but since this is before the start of the actual transaction (product registration), other information (transaction end date and time, etc.) is not generated. The settlement date and time may be the settlement start date and time or the settlement end date and time. Both the settlement start date and time and the settlement end date and time may be stored separately as the transaction end date and time.
[0056] Registered product information (total) is information that is updated each time a product is registered. Registered product information (total) includes the number of products (number of products), estimated subtotal amount (e.g., the subtotal amount before discounts, etc. are reflected), subtotal amount, etc. Registered product information (registered product 1) is the registration information for one product item. Registered product information (registered product 2) is the registration information for two products. In the example shown in Figure 7 (C), registered product information (registered product 3) to registered product information (registered product 5) are omitted from the illustration. Registered product information (N; N is an integer) includes the product code, product name (product name), price, etc.
[0057] The registered product information (N) may include the registration date and time of the Nth item of product. In other words, the transaction management device 20 may store the registration date and time of the registered product as the registered product information. The registration date and time of each product may also be used as a basis for determining whether or not a service such as a time service should be applied and the effect of the application.
[0058] The reserved product information (total) is information that is updated each time a reserved product (described later) is registered. The reserved product information (total) includes the number of reserved products (number of products), the number of reserved products that are NO-FILE, the number of reserved products that cannot be read (check for unauthorized operation), etc.
[0059] NO-FILE refers to a product whose barcode or product code was successfully scanned (the product code was successfully read) at the store, but whose product code is not stored in the product information (a product whose product information is not registered).
[0060] A read NG refers to a failure to scan the product code at the store (the product code could not be read), or a product whose product code has not been scanned at the store. In other words, a read NG refers to a timeout process when it is possible to determine that a product has been imaged for a certain period of time using image recognition technology but has not been able to be recognized as a barcode, or a product that has been timed out. For example, if the barcode cannot be correctly acquired (recognized) despite the customer performing an operation to have the barcode read due to wrinkles in the package, smudges or dirt on the barcode print, or the barcode being printed on a transparent film, it will be determined that the barcode cannot be read.
[0061] Reserved Product Information (Reserved Product 1) is information on reserved product 1. Reserved Product Information (Reserved Product 2) is information on reserved product 2. Reserved Product Information (Reserved Product 3) is information on reserved product 3.
[0062] The reserved product information (reserved product N; N is an integer) includes the reserved product type (information indicating whether the reserved product is NO-FILE or cannot be read) and image data (image data captured when reading was NG). For example, if the Nth item is a reserved product due to NO-FILE, the reserved product information (reserved product N) includes the reserved product type "1 (NO-FILE)" and image data. Also, if the Nth item is a reserved product due to reading being NG, the reserved product information (reserved product N) includes the reserved product type "2 (cannot be read)" and image data.
[0063] 8 shows an example of reserved product definition corresponding to cart information in this embodiment. In the figure, an example is shown in which reserved products are classified into eight categories. Classification numbers "1" to "8" are assigned to each of the eight reserved product classifications. The classification of the reserved product with classification number 1 is "NO-FILE" as explained in FIG. The classification of the reserved product with classification number 2 is “reading not allowed” as explained in FIG.
[0064] The classification of the reserved product with classification number 3 is "pseudo-scan." A "pseudo-scan" reserved product is a product for which the customer attempted to have the mobile terminal 60 read the product's code, but the mobile terminal 60 was unable to read the code properly.
[0065] As a specific example, a "pseudo scan" corresponds to a situation in which the product is brought within the imaging range of the imaging unit 606, but the product code is not brought within the imaging range of the imaging unit 606. Additionally, a "pseudo scan" corresponds to a situation in which, although the product is brought within the imaging range of the imaging unit 606, an image of a portion that does not have a code is captured. Additionally, a "pseudo scan" corresponds to a situation in which the product is brought into the imaging range of the imaging unit 606 while the code portion is covered by a finger or the like. Additionally, a "pseudo scan" refers to a situation in which the image capture unit 606 captures an image of the code on a product, but the product is passed through the imaging range of the imaging unit 606 at a speed that the mobile terminal 60 cannot read the code.
[0066] The classification of the reserved product with classification number 4 is “non-scan-inserted.” A reserved product with the “non-scan-inserted” classification is a product that has been added to the shopping cart 80 without performing an operation to position the product within the imaging range of the imaging unit 606.
[0067] The classification of reserved items with classification number 5 is "age verification items." "Age verification items" are items such as alcohol and tobacco that require a store clerk to verify the customer's age before selling them.
[0068] The classification of reserved goods with classification number 6 is "pharmaceuticals." "Pharmaceuticals" are goods that require a qualified person, such as a pharmacist, to confirm with the purchaser.
[0069] The classification of reserved items with classification number 7 is "anti-theft tag items." "Anti-theft tag items" are items that have anti-theft tags attached and require a store clerk to remove the anti-theft tag from the item when it is sold.
[0070] The classification of the reserved product with classification number 8 is a "cancelled product." A "cancelled product" is a product that was once registered but was cancelled by a customer's cancellation operation on the mobile terminal 60. A "cancelled product" is taken from the customer by a store clerk at the time of payment, for example.
[0071] Of the classification numbers 1 to 7, the three categories "NG to read," "pseudo scan," and "inserted without scanning" correspond to products whose code was not read when the customer was registering the product on the mobile terminal 60. Hereinafter, such a situation in which the product is registered as a reserved product in the cart information without the code being read during registration will be referred to as a registration failure situation. Products that fall into any of the three categories of "NG to read," "pseudo scan," and "inserted without scanning" may also be referred to as registration failure products.
[0072] In addition, instead of or in addition to storing the cart information in its own memory, the transaction management device 20 may store some or all of the cart information in another device (such as a file server accessible by the transaction management device 20).
[0073] [Example of basic processing procedure for self-operation] The sequence diagram in Fig. 9 shows an example of a processing procedure executed by the mobile terminal 60, the settlement device 40, and the transaction management device 20 in response to the accounting of one transaction in self-service operation. Specifically, the processing in Fig. 9 shows an example of the processing of the mobile terminal 60, the settlement device 40, and the transaction management device 20 from when a customer registers a product to be purchased from among products displayed in the store, to when the settlement for the registered product is completed.
[0074] Step S1: The mobile terminal 60 acquires information for identifying a store (store identification information). For example, a two-dimensional code for identifying the store may be displayed near the entrance of the store (the two-dimensional code may be output on a display screen, a medium on which the two-dimensional code is printed may be attached, etc.), and a customer who visits the store may scan (read) the two-dimensional code with the mobile terminal 60, thereby allowing the mobile terminal 60 to acquire the store identification information. When a customer who visits the store starts a shopping application, a screen instructing the customer to scan the two-dimensional code may be displayed as a start-up screen, or when a customer who visits the store scans the two-dimensional code with the mobile terminal 60, the shopping application may be started, and a screen informing the customer that the transaction management device 20 is currently connected may be displayed as a start-up screen.
[0075] Also, for example, since a store is identified by its location, a customer who visits the store may obtain location information (GPS information) on mobile terminal 60 at the store (i.e., the store's location information may be obtained as store identification information). When a customer who visits the store starts a shopping application, location information may be obtained and a screen may be displayed as a start-up screen informing the customer that the application is currently connected to transaction management device 20. If multiple stores are detected from the location information and one cannot be identified, a selection screen may be displayed to allow the customer to select. Alternatively, a mode may be switched to forcefully obtain a two-dimensional code.
[0076] 10(A) shows an example of a start-up screen of a shopping application displayed on the display unit 604 of the mobile terminal 60. The start-up screen in the figure displays the name of the store. This store name is displayed based on the store-specific information acquired in step S1. When a customer wishes to start registering a product for shopping, the customer operates a transaction start button BT10 arranged on the start-up screen. In response to the operation of the transaction start instruction button BT10, the mobile terminal 60 transmits a transaction start request including the acquired store specific information and customer identification information to the transaction management device 20. The transaction start request may be transmitted in response to the customer's operation on the mobile terminal 60 as described above, or may be transmitted in response to the acquisition of store specific information without receiving any particular operation. Regarding the customer identification information, the information entered in the name field of the registration form using the mobile terminal 60 during customer registration (when downloading or installing a shopping application on the mobile terminal 60) may be stored in the customer information of the transaction management device 20, but may also be stored in the memory of the mobile terminal 60 in addition to the transaction management device 20. When a store is identified (when the product registration initial screen described below is acquired), the store name, the services being offered (flyer information distributed on that day), and available coupon information of the store may be displayed on a screen (the product registration initial screen or a screen other than the product registration initial screen). The service and coupon information may be acquired from the transaction management device 20 as screen information, for example.
[0077] The destination information (address of transaction management device 20) may also be obtained when registering the customer (when downloading or installing a shopping application to mobile terminal 60) and stored in the memory of mobile terminal 60. When scanning a two-dimensional code, the destination information may be converted into a two-dimensional code in addition to the store-specific information, and by scanning the two-dimensional code with mobile terminal 60, mobile terminal 60 may obtain the destination information along with the store-specific information.
[0078] Step S2: The transaction management device 20, which has received the customer identification information and store identification information as a transaction start request from the mobile terminal 60, generates cart information for the transaction. Note that in the initial state in which the cart information is generated, the cart identification information, transaction start date and time, and customer identification information are stored, but since this is before the start of the actual transaction (product registration), other information (transaction end date and time, product information (registered product information, pending product information), etc.) is not stored.
[0079] As described above, the transaction management device 20 stores store information such as that shown in Fig. 7(B), so when it receives store identification information (although it also receives customer identification information) as a transaction start request from the mobile terminal 60, if the received store identification information is a two-dimensional code, it acquires the store identification information by referring to store identification information 1, and if the received store identification information is location information (GPS information), it acquires the store identification information by referring to store identification information 2. Note that if the store identification information received from the mobile terminal 60 is store identification information converted into a two-dimensional code, the transaction management device 20 need only acquire it as is.
[0080] That is, when transaction management device 20 receives customer identification information and store identification information from mobile terminal 60 as a transaction start request, it acquires store identification information from the store identification information received from mobile terminal 60, and further acquires the current date, issues (assigns) a serial number, combines the store identification information with the current date and serial number, and stores the combined information as cart identification information in the cart information. Also, transaction management device 20 receives store identification information and customer identification information from mobile terminal 60 as a transaction start request, acquires the current date and time, and stores the current date and time as the transaction start date and time (generation date and time) in the cart information. Also, transaction management device 20 receives store identification information and customer identification information from mobile terminal 60 as a transaction start request, and stores the customer identification information received from mobile terminal 60 as customer identification information in the cart information.
[0081] Step S3: The transaction management device 20, which has generated the cart information for the transaction, generates product registration initial screen information (screen information of the product registration screen, which is the initial screen), and transmits it to the mobile terminal 60. Specifically, the transaction management device 20 generates, for example, the product registration initial screen information, and transmits the generated product registration initial screen information to the mobile terminal 60 together with the cart identification information.
[0082] Step S4: The mobile terminal 60 receives the cart identification information and the product registration initial screen information from the transaction management device 20, stores the cart identification information, and displays the registration screen on the display unit. Specifically, the mobile terminal 60 displays the product registration initial screen as shown in FIG. 10(B), for example.
[0083] Step S5: The customer operates the mobile terminal 60 to scan the barcode attached to the product and read the product code. In the figure, it is assumed that the barcode has been successfully scanned. Steps S5 to S9 are repeatedly executed every time the barcode attached to the product is scanned.
[0084] The mobile terminal 60 that has acquired the barcode transmits to the transaction management device 20 the cart identification information and product registration information including the product code obtained by scanning.
[0085] Step S6: Upon receiving the product registration information (cart identification information and product code) from mobile terminal 60, transaction management device 20 identifies the cart information of the transaction from the cart identification information included in the received product registration information.
[0086] Step S7: The transaction management device 20 updates the product data in the identified cart information. Specifically, if the received product registration information contains a product code for the Nth item, the transaction management device 20 stores the product code as the product code of the registered product information (registered product N) in the identified cart information, obtains the product name and price corresponding to the product code from the product information, and stores them as the product and price of the registered product information (registered product N). The transaction management device 20 also updates the registered product information (total) in the identified cart information.
[0087] Step S8: After updating the product data in the cart information, transaction management device 20 generates product registration update screen information (screen information of the product registration screen, which is an update screen to which the registered product has been added) and transmits it to mobile terminal 60. Specifically, transaction management device 20 generates product registration update screen information such that a product registration update screen is displayed on mobile terminal 60, in which a list item of the currently registered product has been added to the registered product list, as shown in Fig. 10(C), for example, and transmits the generated product registration update screen information to mobile terminal 60 together with the cart identification information.
[0088] The product registration screen (product registration update screen) shown in Fig. 10(C) is displayed on the mobile terminal 60 after "XX bread" is registered as the third product. That is, when "XX yogurt" is stored in the cart information as the first product, the transaction management device 20 generates product registration update screen information such that "XX yogurt" is displayed on the mobile terminal 60 and transmits the generated product registration update screen information to the mobile terminal 60 together with the cart identification information, when "XX chocolate" is stored in the cart as the second product, the transaction management device 20 generates product registration update screen information such that "XX yogurt" and "XX chocolate" are displayed on the mobile terminal 60 and transmits the generated product registration update screen information to the mobile terminal 60 together with the cart identification information, and when "XX bread" is stored in the cart information as the third product, the transaction management device 20 generates product registration update screen information such that "XX yogurt", "XX chocolate", and "XX bread" are displayed on the mobile terminal 60 as shown in Fig. 10(C) and transmits the generated product registration update screen information to the mobile terminal 60 together with the cart identification information.
[0089] In response to the registration of one product, for example, as shown in Fig. 11(A), a registered product display screen WD1 may be displayed to display the currently registered product. In addition, in the registered product display screen WD1 shown in the same figure, a "Yes" button BT1 and a "No" button BT2 are arranged to confirm with the customer whether or not they would like to eat in the product, in response to the fact that the product is compatible with eat-in. In this case, the price of the product is calculated so that the consumption tax rate for the product is different when the "Yes" button BT1 is operated and when the "No" button BT2 is operated.
[0090] Step S9: Having received the cart identification information and product registration update screen information from the transaction management device 20, the mobile terminal 60 adds the product to the registration screen. Specifically, the mobile terminal 60 displays a product registration update screen such as that shown in Fig. 10(C). As described above, the product registration screen (product registration update screen) shown in Fig. 10(C) is displayed on the mobile terminal 60 after "XX bread" is registered as the third product item.
[0091] Step S10: The mobile terminal 60 accepts a payment instruction operation as an operation by the customer, for example, a touch of the "Proceed to Checkout" button shown in FIG.
[0092] Step S11: The mobile terminal 60 that has accepted the settlement transition instruction operation generates a two-dimensional code. That is, the mobile terminal 60 converts information (e.g., cart identification information) required to execute the settlement process for the products purchased by the mobile terminal 60 into a two-dimensional code. The mobile terminal 60 that has generated the two-dimensional code displays the generated two-dimensional code on the display unit. For example, a code display screen with a two-dimensional code arranged as shown in FIG. 10(D) is displayed on the display unit.
[0093] Step S12: The settlement device 40 scans (reads) the two-dimensional code displayed on the display unit of the mobile terminal 60. For example, the settlement device 40 scans the two-dimensional code displayed on the display unit of the mobile terminal 60 that is pointed by the customer within the recognition range of the scanner unit 406.
[0094] Step S13: The settlement device 40 reads the two-dimensional code displayed on the display of the mobile terminal 60 and requests the calculation of the subtotal amount from the transaction management device 20. For example, the settlement device 40 transmits a calculation request (subtotal amount calculation request information) to the transaction management device 20, together with the cart identification information obtained from the two-dimensional code, to request the calculation of the subtotal amount.
[0095] Step S14: The transaction management device 20, which has received the cart identification information and the sub-calculation output request information from the mobile terminal 60, identifies the cart information of the transaction from the cart identification information.
[0096] Step S15: After identifying the cart, the transaction management device 20 calculates the subtotal amount using information such as the price in the registered product information included in the cart information corresponding to the identified cart information.
[0097] Step S16: After calculating the subtotal, the transaction management device 20 updates the cart information (storing the subtotal (calculated subtotal)), and transmits the subtotal information indicating the calculated subtotal to the settlement device 40 together with the cart identification information.
[0098] Step S17: The settlement device 40, which has received the cart identification information and the subtotal information from the transaction management device 20, displays the subtotal amount on the display unit 405 (a settlement screen including the subtotal amount).
[0099] Step S18: The settlement device 40, which has displayed the subtotal on the display unit 405, executes the payment (settlement). Specifically, the settlement device 40 accepts the selection of the payment type. In the case of cash, it accepts the deposit, calculates the amount of change, and, if there is change, dispenses the change and issues a receipt. In addition, when the settlement is completed, the settlement device 40 sends settlement completion information together with the cart information to the transaction management device 20, and the transaction management device 20 stores the transaction end date and time (settlement date and time) for that cart.
[0100] [Configuration for dealing with registration failure situations] Here, Fig. 9 shows a process corresponding to a case where the reading of the product code is successful in step S5. However, at the stage of the product code reading process corresponding to step S5, the mobile terminal 60 may determine that a situation (a registration failure situation) corresponding to any of the registration failures of classification numbers 2 to 4 in Fig. 8 has occurred.
[0101] 11(B) shows, as a specific example, an example corresponding to a case where the mobile terminal 60 determines that a registration failure situation has occurred as a pseudo scan of classification number 3, by using a captured image of a product registration screen. The figure shows the product registration screen displayed on the mobile terminal 60. The product registration screen in the figure shows a state in which a captured image is displayed of a customer attempting to have the mobile terminal 60 read the barcode of a product with the barcode portion covered by a finger.
[0102] In such a case, the mobile terminal 60 obtains a processing result indicating that the presence of a barcode was recognized from the captured image, but the code could not be extracted from the barcode. Since such a processing result is included in one type of processing result in a pseudo scan, the mobile terminal 60 detects that a registration failure situation as a pseudo scan has occurred. In this case, the mobile terminal 60 transmits to the transaction management device 20 product registration information indicating that the product is a product for which a pseudo scan of classification number 3 has been performed.
[0103] When transmitting product registration information in response to the occurrence of a registration failure situation, the mobile terminal 60 transmits captured images corresponding to the occurrence of the registration failure situation. The captured images to be transmitted may be extracted from the buffered captured images, for example, by buffering the captured images captured by the imaging unit 606 for a certain period of time in order to read the product code. The captured images to be transmitted may be, for example, a predetermined number of still images, or may be a moving image for a predetermined period of time in response to the occurrence of the registration failure situation.
[0104] Furthermore, when a registration failure situation including a pseudo scan occurs as described above, the mobile terminal 60 treats the product that has become registration failure corresponding to the registration failure situation (registered failure product) as a reserved product. In this case, the mobile terminal 60 may display a guide image WD2 that urges the user to place the registered failure product in a bag for reserved products as shown in FIG. 11(C) at the timing when it is determined that a registration failure situation has occurred, by treating the registered failure product as a reserved product. Specifically, the guide image WD2 in the same figure displays a message saying "If you cannot scan, please place the product in a dedicated bag." Note that the form of the guide image WD2 is not particularly limited. The message displayed in the guide image WD2 may be, for example, "Scanning has failed" or "The product has been determined to be registered failure." The guide image WD2 in the figure is displayed so as to be superimposed on the product registration screen. A confirmation button BT3 is arranged in the guide image WD2 in the figure. In this case, the guide image WD2 is erased in response to an operation on the confirmation button BT3. Alternatively, the guide image WD2 may be erased in response to a certain time having elapsed since the start of display. After the guide image WD2 is erased, the display may return to the product registration screen of FIG. 10(B) or FIG. 10(C), for example.
[0105] Registered defective products are treated as reserved products as described above. On the product registration screen, a registered product list is displayed as shown in FIG. 10(C), but for reserved products classified as registered defective products, list items do not need to be displayed in the registered product list. Reserved products that are not classified as registered defective products are displayed as list items in the registered product list. Registered defective products may also have list items displayed in the registered product list to indicate that they are registered defective products.
[0106] An example of a processing procedure executed by the mobile terminal 60 and the transaction management device 20 of this embodiment in relation to product registration, including processing for handling a registration failure situation, will be described with reference to the flowchart of Fig. 12. The processing in this figure corresponds to Fig. 9, and more specifically shows the process of steps S5 to S11 as including processing for handling a registration failure situation.
[0107] First, an example of a process procedure executed by the mobile terminal 60 will be described. Step S101: With the product registration screen displayed, the mobile terminal 60 determines whether or not the reading of the product code has been completed normally.
[0108] Step S102: When the reading of the product code is completed normally, the mobile terminal 60 transmits the product registration information including the read product code and the cart identification information to the transaction management device 20. Step S103: In response to receiving the registration completion notification sent from transaction management device 20 in response to the sending of the product registration information in step S102, mobile terminal 60 updates the product registration screen, for example, as shown in FIG. 10(C).
[0109] Step S104: The mobile terminal 60 detects a registration failure situation based on a captured image obtained by having the imaging unit 606 capture an image to read the product code. If it is determined in step S101 that the reading of the product code has not been completed normally, or after the processing of step S103, the mobile terminal 60 determines whether or not a registration failure situation has occurred based on the detection result regarding the registration failure situation.
[0110] The mobile terminal 60 may be adapted to detect a failed registration situation as follows. First, when the mobile terminal 60 recognizes that the entire barcode of the product is captured in the captured image, but the reading of the barcode is not completed successfully (successful) after a certain period of time has elapsed, it determines that a registration failure situation classified as reading NG has occurred.
[0111] In addition, if the mobile terminal 60 recognizes a product in a captured image but is unable to recognize the barcode at all and therefore is unable to successfully read the barcode, it determines that a registration failure situation classified as a pseudo scan has occurred. Alternatively, as illustrated in FIG. 11(B), when the barcode reading is not completed successfully because only a portion of the product's barcode can be recognized in the captured image, the mobile terminal 60 determines that a registration failure situation classified as a pseudo scan has occurred. Alternatively, if the mobile terminal 60 is able to recognize the barcode of a product in the captured image, but the barcode reading is not completed successfully because the product is moving too quickly, it will determine that a registration failure situation classified as a pseudo scan has occurred. Such a registration failure situation, classified as a pseudo scan, may indicate fraudulent activity in which a customer places an item in the shopping cart 80 simply by pretending to perform an operation to have the barcode of the item read.
[0112] 3 can capture an image of the contents of a shopping basket 80 placed in a shopping cart 70. When a state in which a new product has been added to the shopping basket 80 is detected in the captured image, even if no attempt to read the barcode of the product is recognized, the mobile terminal 60 determines that a registration failure situation classified as a non-scan input has occurred. For example, a customer may move an already registered product within the shopping basket 80 in order to organize the contents of the shopping basket 80. The mobile terminal 60 may be configured to distinguish between such a movement of a product and the additional insertion of a new product corresponding to a registration failure situation as a non-scan insertion, based on the captured image. The occurrence of such an incomplete registration situation, classified as a non-scan insertion, may indicate fraud, such as a customer placing an item in shopping cart 80 without having the mobile terminal 60 read the product's barcode.
[0113] Step S105: If it is determined in step S104 that a registration failure situation has occurred, the mobile terminal 60 assigns a classification number to the pending product corresponding to the current registration failure situation, according to the classification as the registration failure situation detected in step S104. As an example, if it is determined in step S104 that a registration failure situation classified as a reading NG has occurred, the mobile terminal 60 assigns classification number 2 (see FIG. 8) to the corresponding pending product.
[0114] Step S106: The mobile terminal 60 acquires (extracts) an image corresponding to the currently occurring registration failure situation from among the images captured by the imaging unit 606. The captured images acquired by the mobile terminal 60 are intended to allow the store clerk to visually recognize the currently occurring registration failure situation. For this reason, the format (video, still image) of the captured images acquired by the mobile terminal 60, the number of captured images, the time and period for which the captured images are to be acquired, etc. may be varied depending on the classification of the detected registration failure situation.
[0115] In addition, the image captured by the imaging unit 606 may be transmitted to the transaction management device 20, and the transaction management device 20 may acquire an image corresponding to the registration failure situation depending on the time when the registration failure situation occurred, the classification result, the image analysis result, etc.
[0116] Step S107: The mobile terminal 60 transmits the registration failure information to the transaction management device 20. The registration failure information includes the classification number of the reserved product assigned in step S105 and the captured image acquired in step S106.
[0117] Step S108: In response to receiving the registration completion notification transmitted from the transaction management device 20 in response to the transmission of the product registration information in step S102, the mobile terminal 60 updates the product registration screen. For example, the mobile terminal 60 may display a guide image WD2 as illustrated in FIG. 11(C) at a timing corresponding to the update of the product registration screen in step S103.
[0118] Step S109: If it is determined in step S104 that the registration failure state has not occurred, or after the process of step S108, the mobile terminal 60 determines whether or not a settlement transition instruction operation has been accepted. If the settlement transition instruction operation has not been accepted, the process returns to step S101.
[0119] Step S110: When the payment transition instruction operation is accepted, the mobile terminal 60 converts, for example, the cart identification information into a two-dimensional code, and displays the generated two-dimensional code on the display unit 604, for example, using a code display screen as shown in FIG. 10(D).
[0120] Next, an example of a processing procedure executed by the transaction management device 20 will be described. Step S201: The transaction management device 20 determines whether or not the product registration information transmitted from the mobile terminal 60 in step S102 has been received.
[0121] Step S202: When the transaction management device 20 receives the product registration information, the transaction management device 20 identifies the cart information indicated by the cart identification information included in the received product registration information. Step S203: The transaction management device 20 updates the cart information identified in step S202. That is, the transaction management device 20 adds the registered product information based on the product code included in the product registration information received in response to step S201 to the identified cart information. As a result, one product is registered in the cart information.
[0122] Note that the update of the cart information in step S202 includes the registration of products among the reserved products that do not correspond to the registration failure status. In other words, the update of the cart information in step S202 includes the registration of products among the reserved products whose product codes have been read successfully. Among the reserved products, the products whose product codes have been read successfully are NO-FILE, age verification products, medicines, and security tag products. In addition, although canceled products are not reflected in the process in the same figure, in response to a cancellation operation being performed on the mobile terminal 60, the transaction management device 20 updates the registered product information of the corresponding product in the cart information so that the corresponding product is managed as a canceled product.
[0123] Step S204: After the process of step S203, the transaction management device 20 transmits a registration completion notification to the mobile terminal 60.
[0124] Step S205: After the process of step S204, or if it is determined in step S201 that the product registration information has not been received, transaction management device 20 determines whether or not registration failure information transmitted from mobile terminal 60 in step S107 has been received. If registration failure information has not been received, the process returns to step S201.
[0125] Step S206: When the transaction management device 20 receives the registration failure information, it identifies the cart information indicated by the cart identification information included in the received product registration information. Step S207: The transaction management device 20 updates the cart information identified in step S206. In this case, the transaction management device 20 adds the registered product information including the classification number included in the registration failure information received in response to step S205 to the identified cart information. As a result, one reserved product (registered failure product) corresponding to the occurrence of the registration failure situation is registered in the cart information.
[0126] Step S208: After the process of step S207, the transaction management device 20 transmits a registration completion notification to the mobile terminal 60.
[0127] When the customer has finished registering all the products to be purchased, he or she performs a settlement instruction operation and has the settlement device 40 read the two-dimensional code displayed on the mobile terminal 60. After reading the two-dimensional code, the settlement device 40 requests the transaction management device 20 to calculate the subtotal amount, as shown as step S13 in Fig. 9. Here, when requesting calculation of the subtotal amount, the settlement device 40 of this embodiment requests settlement information to be used in the settlement process using the settlement screen.
[0128] In response to a request for settlement information, the transaction management device 20 identifies the corresponding cart information and generates settlement information based on the identified cart information. The settlement information includes registered product information in the cart information and information such as a subtotal amount according to the registered products. In addition, among the registered product information included in the settlement information, the registered product information corresponding to the insufficient registration product includes a captured image corresponding to the insufficient registration situation. The transaction management device 20 transmits the generated settlement information to the settlement device 40. When the settlement device 40 receives the settlement information, it causes the display unit 405 to display a settlement screen reflecting the contents of the received settlement information.
[0129] FIG. 13 shows an example of a settlement screen displayed on the display unit 405 of the settlement device 40. The checkout screen in the figure includes a registered product list area AR3. The registered product list area AR3 is an area that presents a list of products registered by the mobile terminal 60.
[0130] If the registered products include reserved products, the list items of the reserved products are given priority and arranged from the top of the left column. In the example shown in the figure, since the registered products include six reserved products, a reserved product list area AR31 including list items of the six reserved products from the top left is formed in the registered product list area AR3. The list items in the reserved product list area AR31 are arranged to differ from the list items of other products, for example in terms of background color, etc.
[0131] The list items in the registered product list area AR3 show the product name of the corresponding product, the number of registered items, the price according to the number of registered items, etc. In addition, for example, the list items corresponding to reserved products may show the classification number, classification name, etc. of the reserved product.
[0132] A call button BT31 is arranged in each list item of the reserved product in the reserved product list area AR31. Each call button BT31 shows the name of the reserved product category to which the corresponding product falls.
[0133] Furthermore, a customer monitor area AR32 is arranged on the settlement screen. The customer monitor area AR32 is an area in which an image captured by the imaging unit 416 is displayed as a monitor image in real time. In the customer monitor area AR32, the state of the customer's hands as he or she operates the settlement device 40 for settlement is displayed in real time. By the settlement device 40 displaying such an image in the customer monitor area AR32, the customer becomes aware that his or her state is being imaged, which has the effect of preventing fraudulent acts by the customer when making a payment. The settlement device 40 may be configured to store (save) the image used for display in the customer monitor area AR32.
[0134] Here, as shown in the figure, when the pending item list area AR31 is formed in the registered item list area AR3 on the checkout screen, the store clerk needs to perform an operation to process the pending items. When the checkout screen with the pending item list area AR31 formed in this way is displayed, the checkout device 40 executes a store clerk call to have the store clerk perform an operation to process the pending items. To call a store clerk, the checkout device 40 may, for example, cause a display such as a sign pole to be displayed in a predetermined manner, or send a notice of a store clerk call to a terminal device carried or monitored by the store clerk. The store clerk who responds to the call to the settlement device 40 performs an operation to process the reserved products in accordance with each list item shown in the reserved product list area AR31 on the displayed settlement screen.
[0135] To process the first reserved item, the store clerk operates the call button BT31 in the list item of the reserved item to be processed. In this case, the store clerk operates the call button BT31 of the list item in the first row corresponding to canned beer in the reserved item list area AR31. In response to the operation of the call button BT31, a reserved item processing screen for processing the reserved item corresponding to the list item including the operated call button BT31 is displayed on the checkout screen. In addition, the entire list item of the reserved product to be processed may be made touch-operable.
[0136] For example, when the store clerk operates the call button BT31 of the list item in the first row corresponding to a can of beer which is an age verification product, a reserved product processing screen for the can of beer is displayed on the checkout screen.
[0137] FIG. 14 is an example of the reserved product processing screen AR4 for a can of beer, which is an age verification product. The reserved product processing screen AR4 has a product information area AR41, an input operation area AR42, a register button BT41, and a cancel button BT42 arranged thereon.
[0138] The product information area AR41 is an area that shows information about the corresponding reserved product. The product information area AR41 in the figure shows the product name, product code, price, registered quantity, etc. In the case of an age verification product, the content displayed in the product information area AR41 reflects the content of the registered product information of the corresponding product included in the payment information.
[0139] The input operation area AR42 is an area where a software keyboard for inputting information about a product in the product information area AR41 is arranged. The input operation area AR42 is capable of switching between a keyboard with a key arrangement corresponding to numeric input and a keyboard with a key arrangement corresponding to character input, depending on the operation. In addition, a preset call key, for example, labeled "preset", is arranged in the input operation area AR42. By operating the preset call key, a preset key screen is displayed on which preset keys corresponding to each product are arranged. By operating a preset key arranged on the preset key screen, the store clerk can input information about the product corresponding to the operated preset key into the product information area AR41.
[0140] The registration button BT41 is a button for canceling the pending registration of the corresponding product and registering it as a product to be purchased by the customer. The cancel button BT42 is a button that is operated to instruct the cancellation of registration of a product whose registration is in a pending state.
[0141] For example, the store clerk checks the customer's age, and if there are no problems, presses the registration button BT41 to confirm the registration of the canned beer. This causes the settlement device 40 to cancel the pending registration state of the canned beer and process it to include it in the registered products. Alternatively, if the store clerk determines that the canned beer should not be registered, he or she presses the cancel button BT42 to cancel the registration of the canned beer and collects the canned beer product.
[0142] In addition, in the case of a registered defective product, for example, "unscanned" is displayed on the call button BT31 in the list item of the reserved product list area AR31. When the store clerk processes the registered defective product, he or she operates the call button BT31 that displays "unscanned" in the list item of the registered defective product.
[0143] For example, in the case of a reserved item classified as "NO-FILE," in the initial display state of the reserved item processing screen AR4, no item information is shown in the item information area AR41. In this case, the store clerk can register the item by inputting a numeric string as the item code or a character string as the item name in the item information area AR41 by performing a numeric input operation or a character input operation in the input operation area AR42. The product information registered in this manner is transmitted to transaction management device 20. Transaction management device 20 synchronizes the cart information by updating the registered product information of the corresponding product in the cart information from the "NO-FILE" state so that the information entered in product information area AR41 is reflected.
[0144] In addition, the reserved product processing screen may display the classification number, classification name, etc. of the corresponding reserved product.
[0145] FIG. 15 shows an example of a reserved product processing screen AR4 for processing a non-registered product, which is displayed in response to operating the call button BT31 displaying "UNSCANNED". In the initial display state of the pending product processing screen AR4 corresponding to a non-registered product, information about the product has not yet been acquired, so no information about the product is presented in the product information area AR41 as shown in the figure.
[0146] Further, the reserved product processing screen AR4 corresponding to the unregistered product has a captured image area AR43 arranged in addition to a product information area AR41, an input operation area AR42, a registration button BT41, and a cancel button BT42.
[0147] A captured image corresponding to the occurrence of the corresponding registration failure situation is displayed in the captured image area AR43. This captured image is acquired by the mobile terminal 60 in step S106 of FIG.
[0148] Specifically, the captured image in the captured image area AR43 in the figure shows a registration failure state classified as a non-scan input. Two captured images G1 and G2 are arranged in the captured image area AR43 in the figure. The captured image G1 is a captured image showing the state before an additional product is added to the shopping basket 80. The captured image G2 is an image showing the state after the captured image G1 when an additional product is added to the shopping basket 80.
[0149] By looking at the captured image in captured image area AR43 in the figure, the store clerk can see that the unregistered product to be processed was added to the shopping cart 80 without having its barcode read. Also, in captured image G2, a frame FL is placed in the area of the added product, allowing the store clerk to easily identify what the added product is without being registered. The additionally inserted product may be identified and the frame FL may be arranged by either the mobile terminal 60 or the settlement device 40.
[0150] Furthermore, if the store clerk wishes to check the captured image in the captured image area AR43 in more detail, the store clerk can perform a captured image enlargement operation, for example, by tapping on an arbitrary position in the captured image area AR43. In response to the captured image enlargement operation, the settlement device 40 places an enlarged captured image area AR431 on the reserved product processing screen AR4 as shown in Fig. 16. The enlarged captured image area AR431 can be erased (closed) in response to a predetermined operation.
[0151] Returning to Fig. 15 for explanation, the store clerk confirms with the customer whether or not they wish to purchase the registered defective product. If the customer does not wish to purchase the product, the store clerk operates the cancel button BT42 and collects the registered defective product. If the customer wishes to purchase the product, the store clerk operates the input operation area AR42 to input product information into the product information area AR41, and then operates the register button BT41 to register the product.
[0152] Moreover, the reserved product processing screen AR4 in FIG. 17 shows an example of a case where the registered defective product is classified as a "pseudo scan". In the captured image area AR43 of the figure, one captured image is displayed. The captured image displayed in the captured image area AR43 shows that when the registration failure occurred, the barcode was captured with a part of it covered by a finger. By looking at the captured image in the captured image area AR43, the store clerk can understand that the registration failure product to be processed is classified as a pseudo scan.
[0153] Also in this case, by performing an operation on the captured image area AR43, as shown in FIG. 18, it is possible to display an enlarged captured image area AR431 on the reserved product processing screen AR4.
[0154] In this case, the store clerk will also confirm with the customer whether or not he / she wishes to purchase the registered defective product, and will register or cancel the product depending on whether or not the customer wishes to purchase the product.
[0155] The pseudo scan also includes a situation where the barcode is not included in the imaging range (barcode readable range) of the imaging unit 606 even when the product is held over the imaging range (barcode readable range) of the imaging unit 606. In this case, the captured image area AR43 may display a captured image in which part of the product is included in the imaging range but the barcode is not included in the imaging range.
[0156] The pseudo scan also includes a situation where a product passes through the imaging range of the imaging unit 606 at a speed that makes it impossible to read the product code. In this case, the captured image area AR43 may display a still image captured when the product passes through the imaging range, or a moving image captured when the product passes through the imaging range.
[0157] An example of a process performed by the settlement device 40 in relation to displaying the reserved product processing screen will be described with reference to the flowchart of FIG.
[0158] Step S301: While the settlement screen is displayed, the settlement device 40 waits for an operation to specify a reserved product to be processed (reserved product specification operation).
[0159] Step S302: When a reserved product designation operation is performed, the settlement device 40 determines whether or not the product designated by the reserved product designation operation is a registered insufficient product. In this embodiment, the reserved goods whose registered goods information, which is included in the settlement information transmitted from the transaction management device 20, includes a captured image are limited to the unregistered goods. Therefore, as the process of step S302, the settlement device 40 may determine whether or not the registered goods information of the goods specified by the reserved goods specification operation includes a captured image.
[0160] Step S303: If it is determined in step S302 that the product is a registered defective product, the settlement device 40 generates a reserved product processing screen including the captured image area AR43 for the registered defective product designated as the processing target. The settlement device 40 may obtain the captured image of the captured image area AR43 from the registered product information of the corresponding product in the settlement information. The settlement device 40 displays the generated reserved product processing screen.
[0161] Step S304: On the other hand, if it is determined in step S302 that the reserved product is not a registered defective product, the settlement device 40 generates a reserved product processing screen for the reserved product specified as the processing target, which does not include the captured image area AR43. The settlement device 40 displays the generated reserved product processing screen.
[0162] <Modification> A modification of this embodiment will now be described.
[0163] [First Modification] In the above embodiment, one or two captured images (FIGS. 15 and 17) are displayed in the captured image area AR43 when the reserved product is a non-registered product. However, the number of captured images displayed in the captured image area AR43 may be three or more.
[0164] 20 shows an example in which three captured images G11, G12, and G13 are arranged in the captured image area AR43 of the reserved product processing screen AR4. The reserved product processing screen AR4 in the same figure shows an example in which a registered defective product to be processed is classified as a non-scan input.
[0165] The captured images G11, G12, and G13 in the figure show the following. In the captured image area AR43, the captured images G11, G12, and G13 are arranged in this order from left to right. The arrangement order of the captured images G11, G12, and G13 corresponds to the time lapse in which the images were captured. The first captured image G11 is an image of the inside of the shopping cart 80 before the target non-registered product is added. The second captured image G12 is an image of the process in which the captured image G11 changes to the next, third captured image G13. The third captured image G13 is an image of the state in which the target non-registered product has been added to the shopping cart 80. The second captured image G12 may be extracted, for example, from among the captured images including the product to be inserted, or may be an image captured at a specified time, such as the exact midpoint between the times at which the captured images G11 and G13 were captured. Also in the captured image G13, a frame FL is placed on the part of the product that has been added to the shopping cart 80.
[0166] [Second modified example] In the above embodiment, the display surface of the display unit 405 of the settlement device 40 is horizontally long. However, the display surface of the display unit 405 of the settlement device 40 may be vertically long. Fig. 21(A) shows an example of a settlement screen displayed on display unit 405 with a vertically long display surface corresponding to this modified example. In this figure, the same parts as in Fig. 13 are given the same reference numerals. As can be seen by comparing this figure with Fig. 13, the information presented as the settlement screen is similar, but the layout of the information presented on the settlement screen is different in accordance with the fact that the size of the display surface is vertically long. However, in the checkout screen of Figure 21 (A), a pending product list area AR31 containing list items of pending products is formed in the upper left corner of the registered product list area AR3, and the background color, etc. is different from the list items other than pending products, similar to the checkout screen of Figure 13.
[0167] In this modified example, for example, the reserved item list area AR31 in Fig. 21(A) can be enlarged to be displayed as an enlarged reserved item list area AR311 as shown in Fig. 21(B). The operation to display the enlarged reserved item list area AR311 may be an operation of touching any position within the reserved item list area AR31. Alternatively, it may be an operation of touching the reserved item count area AR33 arranged on the checkout screen in Fig. 21(A).
[0168] By displaying the enlarged pending item list area AR311 in this manner, the store clerk can easily see the pending item list items and easily understand what pending items are available. Also, for example, depending on the arrangement position of the display unit 405 in the settlement device 40, the position of the display unit 405 may be high, and particularly when the display surface of the display unit 405 is vertically long, it may be difficult to operate the upper side of the display surface of the display unit 405. Therefore, in the example of Fig. 21(B), the enlarged pending product list area AR311 is arranged on the lower side of the display surface. This makes it easier for the store clerk to operate the enlarged pending product list area AR311.
[0169] When a store clerk performs a process corresponding to a pending item, the clerk operates the call button BT31 located on the list item of the pending item to be processed among the list items in the expanded pending item list area AR311 displayed as in Figure 21 (B). In response to the operation of the call button BT31, as shown in Fig. 21(C), a reserved item processing screen AR4 is displayed in place of the expanded reserved item list area AR311. The reserved item processing screen AR4 displayed in this way targets the reserved items shown by the list items of the operated call button BT31.
[0170] In addition, if the reserved product to be processed is a non-registered product, the settlement device 40 displays the captured image area AR43 on the same screen as the reserved product processing screen AR4, as shown in the same Figure 21 (C). In addition, in the figure, an example is given in which one image is displayed in the captured image area AR43. However, even in the case of such a vertically long screen, a predetermined number of captured images may be displayed in the captured image area AR43 according to the classification of the registered insufficient product (registered insufficient situation) as shown in Figs. 15 and 20.
[0171] For example, in the example of Fig. 15, the captured image area AR43 is arranged in the reserved product processing screen AR4. In contrast, in Fig. 21(C), since the display surface of the display unit 405 is vertically long, the captured image area AR43 is not included in the reserved product processing screen AR4. This allows the captured image area AR43 to be enlarged and arranged to a larger size than when it is arranged in the reserved item processing screen AR4, making it easier to see the captured image. Also, as shown in Fig. 21(C) , on a vertically long display surface, the captured image area AR43 is arranged on the upper side, and the reserved item processing screen AR4 is arranged on the lower side. This makes it easier for the store clerk to operate the reserved item processing screen AR4.
[0172] [Third Modification] In the above embodiment, an example was given in which the captured image area AR43 is placed on the pending product processing screen for processing pending products that are not registered defective products, and the captured image area AR43 is not placed on the pending product processing screen for pending products that are not registered defective products. However, in this modified example, the captured image area AR43 may be arranged on the reserved product processing screen of the reserved product that is not a registration failure product. In this case, the mobile terminal 60 may transmit the product registration information including the captured image of the registered product whose barcode has been successfully read.
[0173] [Fourth Modification] The captured image area AR43 may be displayed as an independent screen different from the reserved item processing screen, for example, in response to an operation of the settlement device 40 by a store clerk.
[0174] [Fifth Modification] In addition, when the transaction start instruction button BT10 arranged on the start screen of FIG. 10(A) is operated to start product registration, the mobile terminal 60 may display a warning screen informing the customer in advance that "images at the time of product registration may be displayed on the settlement device". By displaying such a warning screen, for example, fraudulent product registration can be deterred. Alternatively, instead of the warning screen, the mobile terminal may display a consent screen to confirm the customer's consent to "images at the time of product registration may be displayed on the settlement device". In the consent screen, buttons for accepting an operation to confirm intention, such as a "Yes" button and a "No" button, are arranged. If the "Yes" button is operated, the customer may be treated as a customer who does not commit fraud, and the cancellation may be confirmed as it is without registering the canceled product as a reserved product.
[0175] [Sixth Modification] In the above embodiment, a registration failure situation where the barcode is not read can be treated as a product registration error. In this modified example, in addition to the registration failure situation, for example, a situation where the barcode is successfully read but the target product cannot be added to the shopping cart 80 may also be determined as a product registration error. Note that, for example, rice over a certain weight or canned drinks in units of six are often placed at the bottom of the cart. Therefore, for such products, even if it is detected that they cannot be added to the shopping cart 80, it may be determined that there is no product registration error.
[0176] [Seventh Variation] For example, due to a communication error or a communication speed limit set on the mobile terminal 60, it may be impossible to transmit the captured image to the transaction management device 20 when, for example, the registration failure information is transmitted in step S107 of Fig. 12. In such a case, the transaction management device 20 can receive the registration failure information indicating the classification of the registration failure situation, even though it does not include the captured image, and therefore can register the registered product information indicating the classification of the registration failure situation in the cart information. As a result, the settlement device 40, by using settlement information based on the cart information, can display a pending product processing screen for the non-registered product as shown in Fig. 15, for example, although no captured image is displayed in the captured image area AR43. In this case, in the blank area on the pending product processing screen where the captured image area AR43 is not displayed, a message that can inform the store clerk that the product is a non-registered product, such as "Are there any products that you forgot to scan?", may be displayed.
[0177] [Eighth Modification] The occurrence of a registration failure situation may be displayed on a terminal (store operating terminal) other than the settlement device 40, such as the monitoring device 50, that operates in the store. For example, the monitoring device 50, which is one of the store operating terminals, can monitor the status of each transaction in the store by communicating with, for example, the transaction management device 20. Thus, when a pending product is registered, the monitoring device 50 may obtain information identifying the customer to whom the pending product corresponds, and product information and price information of the target product at the time of the registration of the pending product, and display the obtained information. Then, for example, when a store clerk performing monitoring duties using the monitoring device 50 confirms that there is no problem with the displayed product, the monitoring device 50 may be able to perform an operation such as canceling the registration of the product as a pending product and re-registering it as a normal product.
[0178] [Ninth Variation] The imaging device used for product registration is not particularly limited as long as it is capable of reading the barcode of the product, is capable of capturing an image of the contents of the shopping basket 80 or the like, and is capable of outputting the captured image to the mobile terminal 60 or the like. For example, such an imaging device may be capable of capturing an image of the inside of a customer's own bag, instead of the shopping basket 80 provided by the store.
[0179] [Tenth Modification] The configuration of this embodiment may be applied to the extent possible even when a customer registers a product by holding the mobile terminal 60 in his / her hand without setting it in the shopping cart 70. In such a case, for example, the mobile terminal 60 can detect a read NG or a pseudo scan as a registration failure situation, and output a captured image corresponding to the detected registration failure situation.
[0180] [Eleventh Modification] In the above embodiment, a part of the processing executed by the mobile terminal 60 may be executed by a higher-level device such as the transaction management device 20 connected to the mobile terminal 60 via communication. In the above embodiment, a part of the processing executed by the settlement device 40 may be executed by a higher-level device such as the transaction management device 20 connected to the settlement device 40 via communication.
[0181] <Overview of the embodiment> [Technical field] The present invention relates to a product sales data processing system. [Background technology] 2. Description of the Related Art A system is known in which a customer registers an item by himself / herself using a mobile terminal equipped with a camera (see, for example, Patent Document 1). [Prior art document] [Patent documents] [Patent Document 1] JP 2018-147252 A [Summary of the Invention] [Problem to be solved by the invention] However, because customers themselves register products using a mobile terminal, there is the possibility of problems occurring, such as customers thinking they have scanned the barcode of a product but actually not being able to do so, or customers intentionally putting products into their shopping cart without having the barcode scanned. The present invention has been made in view of the above circumstances, and has an object to make it possible to appropriately deal with problems that arise when customers themselves register products.
[0182] [Means for solving the problem] (1) One aspect of this embodiment that solves the above-mentioned problems is a product sales data processing system (1) in which a product is registered by a mobile terminal device (e.g., mobile terminal 60) and a settlement device (40) performs settlement processing corresponding to the product registered by the mobile terminal device, the product sales data processing system including: imaging means (e.g., imaging unit 606) that is configured to be able to capture an image of a situation related to the registration of a product by a customer; detection means that detects a predetermined registration failure situation in which the registration of a product is deemed to be incomplete while the product is being registered in accordance with a transaction; and display control means that, when settlement is performed for the product registered in accordance with the transaction at the settlement device, displays an image corresponding to the registration failure situation detected by the detection means (e.g., an image in an image capture area AR43) based on the image obtained by the imaging means.
[0183] According to the above configuration, if a registration failure occurs while a customer is registering a product using the mobile terminal 60, an image of the registration failure can be displayed. This makes it possible to, for example, prevent the registration failure (for example, prevent fraudulent acts regarding product registration) and appropriately deal with the product corresponding to the registration failure, and appropriately deal with problems that arise when a customer registers a product by himself / herself.
[0184] (2) One aspect of this embodiment is the product sales data processing system described in (1), wherein the display control means, as a classification of a registration failure situation, displays a plurality of captured images corresponding to a predetermined period before and after the product is inserted into the product insertion section (e.g., shopping cart 80) without the product information being read.
[0185] According to the above configuration, when the classification of the registration failure state is non-scan input, it is possible to display a captured image of the contents of the shopping basket 80 from before the target product is input until it is input. This allows the state transition of the contents of the shopping basket 80 when the product is input without being scanned to be accurately understood.
[0186] (3) One aspect of this embodiment is the product sales data processing system according to (2), which displays a portion of a specific captured image of the plurality of captured images that differs from other captured images.
[0187] According to the above configuration, in the captured image of the additionally inserted product among the multiple captured images displayed when the classification of the registration failure state is non-scan-input, a frame FL showing the portion of the additionally inserted product can be arranged, which allows the additionally inserted product to be immediately recognized.
[0188] (4) One aspect of this embodiment is a product sales data processing system described in any one of (1) to (3), wherein the display control means displays captured images having different imaging subjects depending on the classification of the registration failure situation detected by the detection means.
[0189] According to the above configuration, by displaying a captured image of an imaging target corresponding to the classification of the registration failure situation, it is possible to display an appropriate captured image as evidence according to the registration failure situation.
[0190] (5) One aspect of this embodiment is a product sales data processing system as described in any one of (1) to (4), wherein the display control means displays an image captured when an operation to read the product information was being performed when the registration failure status is classified as an unsuccessful reading of the product information.
[0191] According to the above configuration, for example, when the classification of the registration failure situation is a reading NG or a pseudo scan, it is possible to display a captured image of a product that was within the imaging range of the imaging unit 606 when the registration failure situation was determined. This makes it possible to identify a product whose barcode should have been read in a registration failure situation such as a reading NG or a pseudo scan.
[0192] (6) One aspect of this embodiment is a product sales data processing system described in any one of (1) to (5), wherein the display control means displays an image captured corresponding to the registered defective product together with a screen (e.g., a pending product processing screen AR4) for processing the pending product as a registered defective product at the settlement device.
[0193] According to the above configuration, when the reserved product is a registered defective product, the captured image area AR43 can be displayed together with the reserved product processing screen AR4 that is displayed for the store clerk to operate to process the reserved product. This allows the store clerk to properly process the reserved product as a registered defective product.
[0194] (6) One aspect of this embodiment is a mobile terminal device (e.g., mobile terminal 60) capable of registering products, comprising: imaging means capable of capturing images of a situation related to a product registration by a customer; detection means for detecting a predetermined registration failure situation in which the registration of the product is deemed to be unsuccessful while the product is being registered in accordance with a transaction; and display control means for displaying product information of the registered product and an image captured by the imaging means (e.g., a product registration screen) and, in response to detection of the registration failure situation by the detection means, displaying information related to the detected registration failure situation (e.g., guidance image WD2).
[0195] According to the above configuration, when a registration failure occurs, a display related to the registration failure is displayed on the mobile terminal 60. This allows the customer to understand that a registration failure has occurred. Furthermore, this has the effect of deterring customers who try to commit fraud.
[0196] In addition, the programs for implementing the functions of the transaction management device 20, the mobile terminal 60, the settlement device 40, the management device 10, the registration settlement device 30, etc. may be recorded in a computer-readable recording medium, and the programs recorded in the recording medium may be read into a computer system and executed to perform the processing of each of the above-mentioned devices. Here, "reading the programs recorded in the recording medium into a computer system and executing them" includes installing the programs in a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. In addition, the "computer system" may include multiple computer devices connected via a network including the Internet, a WAN, a LAN, a dedicated line, and other communication lines. In addition, the "computer-readable recording medium" refers to portable media such as a flexible disk, an optical magnetic disk, a ROM, a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the programs may be a non-transient recording medium such as a CD-ROM. In addition, the recording medium also includes a recording medium provided inside or outside the computer system that can be accessed from a distribution server in order to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format executable by the terminal device. That is, the format in which the program is stored in the distribution server does not matter as long as the program can be downloaded from the distribution server and installed in a form executable by the terminal device. The program may be divided into multiple parts, each of which may be downloaded at a different time and then combined on the terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" includes a storage medium that holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that is a server or client when a program is transmitted over a network. The program may also be one that realizes part of the above-mentioned functions.Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program). [Explanation of symbols]
[0197] 1 Product sales data processing system, 10 Management device, 20 Transaction management device, 40 Settlement device, 60 Mobile terminal, 70 Shopping cart, 80 Shopping basket
Claims
1. A payment device in a product sales data processing system, which registers products using a registration terminal and performs a payment process corresponding to the products registered by the registration terminal, a display control means for displaying an image corresponding to a registration failure situation detected by a detection means for detecting a predetermined registration failure situation in which the registration of the product is deemed to be unsuccessful during the registration of the product in accordance with one transaction, the image being obtained by an imaging means provided in the registration terminal so as to be able to image a situation related to the registration of the product by a customer when settling a payment for the product registered by the registration terminal in accordance with one transaction; The display control means displays captured images with different imaging targets according to the classification of the registration failure state detected by the detection means. Payment device.
2. A settlement device in a product sales data processing system in which a product is registered by a registration terminal and a settlement process corresponding to the product registered by the registration terminal is performed by the settlement device, a display control means for displaying an image corresponding to a registration failure situation detected by a detection means for detecting a predetermined registration failure situation in which the registration of the product is deemed to be unsuccessful during the registration of the product in accordance with one transaction, the image being obtained by an imaging means provided in the registration terminal so as to be able to image a situation related to the registration of the product by a customer when settling a payment for the product registered by the registration terminal in accordance with one transaction; The display control means displays a captured image when an operation for reading the product information is being performed, when the registration failure state is classified as an unsuccessful reading of the product information. Payment device.
3. The display control means displays a plurality of captured images corresponding to a predetermined period before and after the product is inserted into the product insertion section when the product is classified as being in a registration failure state, that is, the product is inserted into the product insertion section without information of the product being read. The settlement device according to claim 1 or 2.
4. The display control means displays a portion of a predetermined captured image of the plurality of captured images that differs from other captured images. The settlement device according to claim 3.
5. The display control means displays a screen for processing the reserved product as a registered defective product at the settlement device, together with a captured image corresponding to the registered defective product. The settlement device according to any one of claims 1 to 4.
6. A computer as a settlement device in a product sales data processing system in which a product is registered by a registration terminal and a settlement device performs a settlement process corresponding to the product registered by the registration terminal, A display control means for displaying captured images obtained by an imaging means provided in the registration terminal so as to be able to image a situation related to the registration of a commodity by a customer when settling a payment for a commodity registered by the registration terminal in accordance with one transaction, the display control means for displaying captured images corresponding to a registration failure situation detected by a detection means for detecting a predetermined registration failure situation in which the registration of a commodity is deemed to be unsuccessful while the commodity is being registered in accordance with one transaction, and the display control means for displaying captured images with different imaging targets according to the classification of the registration failure situation detected by the detection means A program to function as a
7. A computer as a settlement device in a product sales data processing system in which a product is registered by a registration terminal and a settlement device performs a settlement process corresponding to the product registered by the registration terminal, A display control means for displaying an image corresponding to a registration failure situation detected by a detection means for detecting a predetermined registration failure situation in which the registration of the product is deemed unsuccessful while the product is being registered in accordance with a transaction, the image being obtained by an imaging means provided in the registration terminal so as to be able to image a situation related to the registration of the product by a customer when settling the payment for the product registered by the registration terminal in accordance with a transaction, the display control means for displaying an image corresponding to a registration failure situation detected by a detection means for detecting a predetermined registration failure situation in which the registration of the product is deemed unsuccessful, the display control means displaying an image captured when an operation for reading the product information was being performed in the case where the registration failure situation is classified as a failure to read the product information A program to function as a
Citation Information
Patent Citations
Pos(point of sales) system
JP2010039545A
Check apparatus and check program
JP2018147252A
