Commodity sales data processing system, terminal device, and program

Abstract

To provide a commodity sales data processing system for a customer to register a commodity using a terminal device, in which a procedure for cancelling registration of the commodity can be appropriately performed by the customer.SOLUTION: Provided is a commodity sales data processing system for a customer to register a commodity using a mobile terminal device, the commodity sales data processing system including: detection means for detecting taking out of the commodity from a commodity input part through which the commodity secured by the customer is input; and notification means for based on a result of detection obtained by the detection means, performing notification related to cancellation of registration of the registered commodity to the customer.SELECTED DRAWING: Figure 14

Description

[Technical Field]

[0001] The present invention relates to a product sales data processing system, a terminal device, and a program. [Background technology]

[0002] BACKGROUND ART A system is known in which a customer registers a product using a mobile terminal device (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-204551 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-described product sales data processing system, a customer may register a certain product and reserve it by adding it to a shopping cart, but then wish to cancel the registration, for example, because they have selected the wrong product or have decided not to purchase it. In such cases, the customer can cancel the registration of the product by operating their mobile terminal, and return the deregistered product to its original display location, such as a display shelf. However, there are cases in which the customer fails to properly follow the procedure for canceling the product registration. If the procedure for canceling the product registration is not properly followed, the product registration results will not match the details of the product reserved by the customer, which will hinder smooth checkout.

[0005] The present invention has been made in consideration of the above circumstances, and aims to enable customers to properly carry out procedures for canceling product registration in a product sales data processing system in which customers register products using a terminal device. [Means for solving the problem]

[0006] One aspect of the present invention for solving the above-mentioned problems is a product sales data processing system in which a customer registers products using a mobile terminal device, the product sales data processing system comprising: a detection means for detecting the removal of a product from a product insertion section into which products secured by the customer are inserted; and a notification means for notifying the customer regarding the cancellation of the registration of a registered product based on the detection result by the detection means.

[0007] Another aspect of the present invention is a portable terminal device used by a customer to register a product, the portable terminal device comprising: a detection means for detecting the removal of a product from a product insertion section into which products secured by the customer are inserted; and a notification means for notifying the customer of information regarding a registration cancellation operation for a registered product based on the detection result by the detection means. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of the configuration of a shopping system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of installation of a settlement device according to the present embodiment. [Figure 3] 1 is a diagram showing an example of the appearance of a settlement device according to an embodiment of the present invention; [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of a settlement device according to the present embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of the configuration of a customer terminal device according to the present embodiment. [Figure 6] 1 is a diagram illustrating an example of the configuration of a transaction management device according to an embodiment of the present invention. [Figure 7] 1 is a diagram illustrating an example of the configuration of a transaction status management device according to an embodiment of the present invention. [Figure 8] 3A to 3C are diagrams illustrating examples of customer information, store information, and cart information according to the present embodiment. [Figure 9] FIG. 10 is a diagram illustrating an example of a definition of a reserved product in the present embodiment. [Figure 10]A sequence diagram showing an example of processing procedures executed by the customer terminal device, settlement device, and transaction management device in this embodiment in response to the accounting of one transaction in self-service operation. [Figure 11] FIG. 10 is a diagram showing an example of a screen of a shopping application in the present embodiment. [Figure 12] 10A and 10B are diagrams showing an example of a registered product presentation screen and a screen displayed on the settlement device in this embodiment. [Figure 13] 10A and 10B are diagrams illustrating an example of a product registration change screen and a cancellation confirmation screen according to the present embodiment. [Figure 14] 10A and 10B are diagrams illustrating a specific example of a situation in which a non-allocated re-guidance screen is displayed in the present embodiment. [Figure 15] 10A and 10B are diagrams illustrating a specific example of a situation in which a registration cancellation operation guide screen is displayed in the present embodiment. [Figure 16] 10 is a flowchart illustrating an example of a processing procedure executed by the customer terminal device and the transaction management device in this embodiment in relation to canceling the registration of a product. DETAILED DESCRIPTION OF THE INVENTION

[0009] <Embodiment> [Example of shopping system configuration] Fig. 1 shows an example of the configuration of a shopping system (an example of a product sales data processing system) according to this embodiment. The shopping system shown in Fig. 1 corresponds to a transaction (customer terminal-enabled transaction) in which, for example, a customer registers the product they are purchasing while removing it from a display shelf, and the same customer also uses a payment device 40 to pay for the registered product. The transaction here refers to the procedure performed for one transaction, including product registration and payment for the registered product. The shopping system of this embodiment includes a store controller 10, a transaction management device 60, a payment device 40, a customer terminal device 50, a transaction status management device 80, and a credit card payment server 70.

[0010] The store controller 10, the settlement device 40, and the transaction status management device 80 are installed in the store and are communicably connected via a LAN 19 (which may be wired or wireless). The store controller 10 is a business terminal used by store staff for store management, etc., and is capable of communicating with the transaction management device 60.

[0011] The transaction status management device 80 is a business terminal that manages the status of transactions (including monitoring the status of transactions) performed by customers using the customer terminal device 50 in the store, and is capable of communicating with the transaction management device 60. Although four payment terminals 40 are shown in FIG. 1, the number of payment terminals 40 within one store is not particularly limited.

[0012] The customer terminal device 50 is operated by a customer (such as a shopper who is a member of the store, hereinafter simply referred to as a customer). In addition to typical communication and imaging functions (camera), the customer terminal device 50 has a recognition function that scans barcodes attached to products to read product codes, i.e., recognizes barcodes attached to products. Note that the recognition function of the customer terminal device 50 is only required to be able to read product codes, and does not necessarily have to be able to recognize which product the read product code belongs to. In other words, the customer terminal device 50 is only required to be able to read a product code from a barcode when the barcode exists as an object in an image captured by the imaging function (an image acquired as a through image).

[0013] Such customer terminal device 50 may be a smartphone, tablet terminal, etc. owned by the customer. A shopping application having a function of registering products in accordance with the shopping system of this embodiment is installed on the smartphone, tablet terminal, etc. serving as customer terminal device 50.

[0014] Furthermore, customer terminal device 50 may be, for example, a terminal loaned to a customer by a store. An application having a function of registering products in accordance with the shopping system of this embodiment is also installed in customer terminal device 50 loaned to a customer by a store. Customer terminal device 50 loaned to a customer by a store may be one that is held by the customer or may be one that is attached to a shopping cart and used by the customer.

[0015] Furthermore, the customer terminal device 50 captures an image (e.g., releases the shutter) of the product (e.g., the surrounding area with the barcode attached) and generates the captured image (image data). The customer terminal device 50 may release the shutter in response to an operation by the customer who is the operator, but in this embodiment, it is preferable that the customer terminal device 50 releases the shutter at its own discretion.

[0016] Furthermore, the customer terminal device 50 may be equipped with an image recognition technology that extracts feature points from an image (through image, captured image) and recognizes the imaged subject (object, etc.). For example, the customer terminal device 50 may use the image recognition technology to identify (estimate) the captured product.

[0017] The settlement device 40 is a settlement device that can at least accept cash payments as a settlement method. The settlement device 40 is configured to be able to communicate with the transaction management device 60. Note that the settlement device 40 may be able to communicate with the transaction management device 60, for example, via a relay via the store controller 10.

[0018] The transaction management device 60 manages transactions carried out in accordance with the shopping system of this embodiment.

[0019] The credit card payment server 70 executes payment processing corresponding to the credit card in response to a credit card payment request transmitted from the settlement device 40, the customer terminal device 50, etc.

[0020] [About the payment device] Figure 2 shows an example of the installation of the payment device 40. Figure 2(A) is a perspective view of the payment device 40 and other components as seen from the customer side. Figure 2(B) is a perspective view of the payment device 40 and other components as seen from the store clerk side. As shown in Figure 2(A), a counter is placed on the right side of the payment device 40 as seen from the customer side.

[0021] Figure 3 shows an example of the appearance of the settlement device 40. Figure 3(A) is a perspective view of the settlement device 40 as seen from the customer side. Figure 3(B) is a perspective view of the settlement device 40 as seen from the store clerk side. Fig. 4 is a diagram showing an example of the configuration of the settlement device 40. In Fig. 3 and Fig. 4, the same parts are given the same reference numerals.

[0022] An example configuration of settlement device 40 shown in Fig. 4 will be described below with reference to Fig. 3. Settlement device 40 includes a CPU 401, a ROM 402, a RAM 403, a hard disk 404, a customer display unit 405, a customer scanner unit 406, a card payment unit 408, a change dispenser 409, a store clerk display unit 410, a key operation unit 411, a store clerk scanner unit 412, a printing unit 413, an audio output unit 414, and a communication unit 415. These can communicate with each other via a bus.

[0023] The CPU 401 is a central processing unit that controls the operation of the settlement device 40 by reading and executing programs stored in the ROM 402 . The ROM 402 is a read-only memory that stores various types of information used by the CPU 401, including programs.

[0024] The RAM 403 is a read / write memory that stores various types of information, such as information read from the ROM 402 or the hard disk 404, information acquired from the outside, and information generated during processing.

[0025] The hard disk 404 stores various types of information. For example, the hard disk 404 may store programs executed by the CPU 401 instead of the ROM 402. Furthermore, instead of the RAM 403, the hard disk 404 may store information read from the ROM 402, information obtained from the outside, information generated during processing, and the like.

[0026] The customer-side display unit 405 is a touch display for customers, which displays various information to customers and accepts various inputs from customers. Customer-side scanner unit 406 is a scanner unit for customers, and for example, scans a code attached to a product (it may be a code other than a barcode, such as a barcode or a two-dimensional code) to read the product code. Customer-side scanner unit 406 may also scan a code (a barcode, a two-dimensional code, etc.) printed on a receipt (registered trademark) to read information necessary for payment. Customer-side scanner unit 406 may also scan a code (a two-dimensional code, a barcode, etc.) displayed on the display unit of customer terminal device 50 to read information necessary for payment.

[0027] Although customer-side scanner unit 406 is used when a customer registers a product, the customer may register the product by other methods. For example, if a preset key (a button for ordering the product) corresponding to the product is displayed on customer-side display unit 405, the customer may operate (press) the preset key to register the product.

[0028] The card payment unit 408 is a payment mechanism that accepts various cards (credit cards, prepaid cards such as transportation cards, etc.). The card payment unit 408 of this embodiment includes a card recognition unit (reading unit), a display unit, and an operation unit, but it is sufficient if it includes at least the card recognition unit. Note that the card recognition unit may also recognize various cards that are not directly used for payment (settlement) (for example, membership cards, point cards, etc.).

[0029] The change dispenser 409 (cash settlement unit) is a cash settlement mechanism that has an input port for banknotes and coins and an output port for banknotes and coins, calculates the amount of money inserted into the input port, calculates the change amount, which is the difference between the input amount and the purchase amount, and dispenses the change from the output port. The change dispenser 409 faces the customer and is operated by the customer. When banknotes or coins are inserted into the input port, they are detected by a sensor (detecting that they have been inserted, the number of coins by denomination, etc.).

[0030] That is, the change dispenser 409 is used when settling the price of registered products in cash (currency) in the settlement device 40. The change dispenser 409 has a banknote insertion slot for inserting banknotes, a coin insertion slot for inserting coins, a banknote discharge slot for discharging banknotes, a coin discharge slot for discharging coins, a counting unit for counting the inserted or discharged currency, a currency transport mechanism between the insertion slot or discharge slot and the storage unit, the above-mentioned sensor, etc. The banknote insertion slot and coin insertion slot are also referred to as deposit insertion slots. The banknote discharge slot and coin discharge slot are also referred to as change discharge slots. The banknote insertion slot and banknote discharge slot may be a common unit, and the coin insertion slot and coin discharge slot may be a common unit.

[0031] The change dispenser 409 also counts the coins replenished during the closing process and stores them in the storage unit. The change dispenser 409 also counts the coins to be dispensed during the closing process and discharges them from the change discharge port. The closing process is a process of adjusting the amount of money stored in the change dispenser 409 (cash on hand / cash on hand) to a reference amount after the store has closed or before it has opened.

[0032] The store clerk's display unit 410 is a touch display for the store clerk, and displays various information to the store clerk and receives various inputs from the store clerk. The key operation unit 411 is made up of various keys (buttons) and receives various inputs from the store clerk. The store clerk scanner unit 412 is a scanner unit for store clerks, and for example, scans barcodes attached to products to read product codes. The store clerk scanner unit 412 also scans barcodes attached to store clerk name tags to read store clerk codes.

[0033] Although the clerk-side scanner unit 412 is used when the clerk registers a product, the clerk may register the product by other methods. For example, if a key corresponding to a product (such as a key corresponding to a sports newspaper) is arranged on the key operation unit 411, the clerk may operate (press) that key to register the product. Also, if a preset key corresponding to a product is displayed on the clerk-side display unit 410, the clerk may operate that preset key to register the product.

[0034] The printing unit 413 prints and issues various media (receipts, bills, etc.). The printing unit 413 can be rotated to face from the store clerk side to the customer side, or from the customer side to the store clerk side (the direction of the media issuing port). The orientation of the printing unit 413 may be changed manually, or may be changed automatically (mechanically controlled, etc.) in response to, for example, a transition (switching) of the operating mode described below. The correct orientation of the printing unit 413 may be detected by a sensor or the like.

[0035] The audio output unit 414 outputs audio. For example, the audio output unit 414 outputs audio guidance and the like. The communication unit 415 communicates with other devices (other settlement devices 40 and the store controller 10).

[0036] In addition, the settlement device 40 of this embodiment can be switched between a total of four operating modes: a customer terminal-compatible settlement mode, which is set to process settlement based on customer terminal-compatible accounting, and three accounting modes (first to third accounting modes) corresponding to three different patterns of accounting (product registration, settlement). The first payment mode is an operating mode in which the store clerk performs operations on the payment device 40 corresponding to product registration and operations corresponding to payment. The second payment mode is an operating mode in which the store clerk performs operations on the payment device 40 corresponding to product registration, and the customer performs operations on the same payment device 40 corresponding to payment. The third payment mode is an operating mode in which the customer performs operations on the payment device 40 corresponding to product registration and operations corresponding to payment. As a result, in a store that has introduced the shopping system of this embodiment, some of the multiple payment devices 40 can be set to customer terminal-compatible payment mode to enable customer terminal-compatible payment, and other payment devices 40 can be set to, for example, first or second payment mode so that a store clerk can handle the payment with the customer. Note that some of the other payment devices 40 may be set to third payment mode.

[0037] [Customer terminal device configuration example] 5 shows an example of the configuration of customer terminal device 50. Customer terminal device 50 in the figure includes a CPU 501, a storage unit 502, a RAM 503, a display unit 504, an operation unit 505, an imaging unit 506, and a network-compatible communication unit 507. The CPU 501 is a central processing unit that controls the operation of the customer terminal device 50 by reading and executing programs stored in the storage unit 502 . The storage unit 502 is an auxiliary storage device for the CPU 501, and stores various types of information used by the CPU 501, including programs. The RAM 503 is the main storage device of the CPU 501 . The display unit 504 displays images according to the display control of the CPU 501. The display unit 504 may be configured as a touch panel that allows operations to be performed on the screen. The operation unit 505 collectively indicates various operators provided on the customer terminal device 50 and various input devices connected to the customer terminal device 50 . The imaging unit 506 captures images under the control of the CPU 401. The imaging unit 506 of this embodiment can also function as a part that reads two-dimensional codes in a code reader that processes the two-dimensional codes. The network-compatible communication unit 507 is a unit that performs communication wirelessly via a network. The network-compatible communication unit 507 enables the customer terminal device 50 to communicate with the transaction management device 60.

[0038] [Example of transaction management device configuration] 6 shows an example of the configuration of transaction management device 60. Transaction management device 60 in the figure comprises a CPU 601, a storage unit 602, a RAM 603, and a network-compatible communication unit 604. The CPU 601 is a central processing unit that controls the operation of the transaction management device 60 by reading and executing programs stored in the storage unit 602 . The storage unit 602 is an auxiliary storage device for the CPU 601, and stores various types of information used by the CPU 601, including programs. The RAM 603 is the main storage device of the CPU 601 . The network-compatible communication unit 604 is a part that performs communication via a network.

[0039] The memory unit 602 of the transaction management device 60 stores customer information, store information, product master (product information), and cart information.

[0040] [Example of configuration of transaction status management device] 7 shows an example of the configuration of a transaction status management device 80. The transaction status management device 80 in the figure includes a CPU 801, a storage unit 802, a RAM 803, an in-store communication unit 804, a network-compatible communication unit 805, a display unit 806, and an operation unit 807. The CPU 801 is a central processing unit that controls the operation of the transaction status management device 80 by reading and executing programs stored in the storage unit 802 . The storage unit 602 is an auxiliary storage device for the CPU 801, and stores various types of information used by the CPU 801, including programs. The RAM 803 is the main storage device of the CPU 801 . The in-store communication unit 804 communicates with terminals such as the checkout device 40 and the store controller 10 within the store via the LAN 19. The network-compatible communication unit 805 is a component that communicates with the outside via a network. In the case of the transaction status management device 80, the network-compatible communication unit 805 can communicate with the transaction management device 60 on the cloud. The display unit 806 displays an image under the control of the CPU 801. The display unit 806 may be configured as a touch panel. The operation unit 807 collectively indicates the operation keys provided in the transaction status management device 80 and the input devices connected to the transaction status management device 80 .

[0041] [Information stored in the transaction management device] The customer information stored in the memory unit 602 is information for managing individual customers. The transaction management device 60 generates customer information when a customer is registered (it may be considered that a customer has been registered when their customer information is stored). The transaction management device 60 also updates the customer information as appropriate based on cart information, etc. The transaction management device 60 may, for example, refer to the cart information at a predetermined time every day and update the customer information.

[0042] 8(A) shows an example of customer information stored in the memory unit 602 of the transaction management device 60. The customer information in this figure includes customer identification information, customer name, customer registration date, cancellation information, customer rank, number of points, etc. The customer identification information is identification information that uniquely identifies a customer. The customer identification information may be application identification information that is uniquely assigned to each installed shopping application when the shopping application of this embodiment is installed. The application identification information may be, for example, a number that is uniquely (e.g., sequentially) assigned to each installed shopping application. Alternatively, the application identification information may be terminal identification information that is unique to the customer terminal device 50 on which the shopping application is installed. The terminal identification information may be, for example, a telephone number assigned to a customer who is the user of the customer terminal device 50, or hardware identification information that is uniquely assigned to the hardware of the customer terminal device 50, such as a MAC (Media Access Control) address. The customer name is the customer's name or nickname, etc. The customer registration date is the date and time the customer was registered. The cancellation information is information regarding the cancellation of registered products after registration. The customer rank is a rank based on the customer's purchase history. When generating customer information for a new customer, the customer identification information, customer name, and customer registration date are generated, but since this is before the start of the actual transaction (product registration), other information (cancellation information, etc.) is not generated.

[0043] The transaction management device 60 generates and stores customer identification information, for example, when registering a customer (for example, when the customer terminal device 50 downloads or installs a shopping application from an external device (for example, a predetermined server that provides all applications, the transaction management device 60) to use the shopping service provided by the transaction management device 60).In addition, for example, when registering a customer, the transaction management device 60 acquires information entered in the name field of the registration form (input form) using the customer terminal device 50 and stores it as the customer name.In addition, for example, the transaction management device 60 acquires the current date and time when registering the customer and stores it as the customer registration date.

[0044] In addition, instead of or in addition to storing customer information in its own memory, the transaction management device 60 may store some or all of the customer information in another device (such as a file server accessible to the transaction management device 60).

[0045] 8(B) shows an example of store information stored in the memory unit 602 of the transaction management device 60. The store information in the figure includes store identification information, store name (branch name), store identification information 1, and store identification information 2. The store identification information is identification information that uniquely identifies a store. The store identification information shown in Fig. 8(B) is composed of a store (trade name) or company code and a branch code. The store name is the name of the store. The store name shown in Fig. 8(B) is composed of the store (trade name) or company and the branch name. The store identification information 1 is information on a two-dimensional code (QR code (registered trademark) or the like) for identifying a store where a transaction takes place (a store where a product is bought and sold). The store identification information 2 is store location information (GPS information) for identifying the store where the transaction is to be made. In the example shown in FIG. 8(B), the store identification information and the store specifying information 1 are different, but the store identification information and the store specifying information 1 may be the same.

[0046] The transaction management device 60 may acquire and store store information from an external source (such as a server (not shown) at a headquarters that oversees each store). The transaction management device 60 may also store some or all of the store information in another device (such as a file server accessible to the transaction management device 60) instead of or in addition to storing the store information in its own memory.

[0047] Cart information is information used to manage individual transactions. The transaction management device 60 generates cart information at the start of a transaction. The transaction management device 60 also updates the cart information as the transaction progresses (each time a product is registered) (it may be considered that a product has been registered when it is stored in the cart information).

[0048] FIG. 8(C) is an example of cart information stored in the memory unit 602 of the transaction management device 60. The cart information in the figure includes cart identification information, transaction start date and time, transaction end date and time, customer identification information, product information in the cart (registered product information, reserved product information), cancellation information, and the like.

[0049] The cart identification information is identification information that uniquely identifies the cart information. For example, the cart identification information includes store identification information, a date, and a serial number (for example, a serial number for each store and date). The transaction start date and time is the date and time when the transaction started. The transaction start date and time may be, for example, the date and time when the cart information was created. The transaction start date and time may also be the date and time when the first item was registered (the date and time when the registered item information (registered item 1) in FIG. 8(C) was stored). The date and time when the cart information was created and the date and time when the first item was registered may both be stored separately.

[0050] The transaction end date and time is the end date and time of the transaction. For example, the transaction end date and time may be the settlement date and time. The customer identification information is customer identification information that identifies the customer of the transaction. When cart information is generated, cart identification information, transaction start date and time, and customer identification information are generated, but since this is before the start of the actual transaction (product registration), other information (transaction end date and time, etc.) is not generated. The settlement date and time may be the settlement start date and time or the settlement end date and time. The settlement start date and time and the settlement end date and time may both be stored separately as the transaction end date and time.

[0051] Registered product information (total) is information that is updated each time a product is registered. Registered product information (total) includes the number of products (number of products), estimated subtotal amount (for example, the subtotal amount before discounts, etc. are reflected), subtotal amount, etc. Registered product information (registered product 1) is the registration information for one product item. Registered product information (registered product 2) is the registration information for two products. In the example shown in Figure 8 (C), registered product information (registered product 3) to registered product information (registered product 5) are omitted from the illustration. Registered product information (N; N is an integer) includes the product code, product name (product name), price, etc.

[0052] The registered product information (N) may include the registration date and time of the Nth item of product. In other words, the transaction management device 60 may store the registration date and time of the registered product as the registered product information. The registration date and time of each product may also be used as information to determine whether or not to apply a special offer such as a limited time offer and the effect of applying the special offer.

[0053] The reserved product information (total) is information that is updated every time a reserved product is registered. A reserved product is a product that was not registered properly due to a specific reason and is registered in a temporarily reserved state. The reserved product information (total) includes the number of reserved products (number of products), the number of non-file reserved products, the number of unreadable reserved products (requiring confirmation of unauthorized operation), and the like.

[0054] NON-FILE refers to a product whose barcode or product code was successfully scanned in the store (the product code was read), but the product code is not stored as product information in the product master (a product whose product information is not registered).

[0055] A read NG refers to a failure to scan the product code at the store (the product code could not be read), or a product whose product code failed to be scanned at the store. In other words, a read NG refers to a timeout process when it is possible to determine that the barcode has not been recognized even after the product has been imaged for a certain period of time using image recognition technology, or a product that has been timed out. For example, if the barcode cannot be correctly acquired (recognized) even though the customer has performed the operation to read it due to wrinkles in the package, blurred or dirty barcode printing, or the barcode being printed on a transparent film, it will be determined that the barcode cannot be read.

[0056] Reserved Product Information (Reserved Product 1) is information on reserved product 1. Reserved Product Information (Reserved Product 2) is information on reserved product 2. Reserved Product Information (Reserved Product 3) is information on reserved product 3.

[0057] The reserved product information (reserved product N; N is an integer) includes the reserved product type (information indicating whether the reserved product is NON-FILE or cannot be read) and image data (image data captured when reading was NG). For example, if the Nth item is a reserved product due to NON-FILE, the reserved product information (reserved product N) includes the reserved product type "1 (NON-FILE)", the product code, and the image data. Also, if the Nth item is a reserved product due to reading being NG, the reserved product information (reserved product N) includes the reserved product type "2 (Cannot be read)" and the image data.

[0058] 9 shows an example of definition of reserved items corresponding to cart information in this embodiment. In this figure, an example is shown in which reserved items are classified into eight categories. Classification numbers "1" to "8" are assigned to each of the eight reserved item classifications. The classification of the reserved product with classification number 1 is "NON-FILE" as explained in FIG. The classification of the reserved product with classification number 2 is "reading not allowed" as explained in FIG.

[0059] The classification of the reserved product with classification number 3 is "pseudo scan input." A reserved product with "pseudo scan input" is a product for which the customer attempted to have the customer terminal device 50 read the product code, but the customer terminal device 50 was unable to read the code properly.

[0060] As a specific example, a "pseudo scan input" situation occurs when the product is brought into the imaging range of the imaging unit 506, but the product code is not brought into the imaging range of the imaging unit 506. Furthermore, "pseudo scan insertion" corresponds to a situation in which the product is brought into the imaging range of the imaging unit 506, but an image of a part without a code is captured. Furthermore, "pseudo scan insertion" refers to a situation in which a product is placed within the imaging range of the imaging unit 506 with the code portion hidden by a finger or the like. In addition, a "pseudo scan input" situation occurs when the product code is captured by the imaging unit 506, but the product is passed through the imaging range of the imaging unit 506 at a speed that the customer terminal device 50 cannot read the code.

[0061] The classification of reserved items with classification number 4 is "non-scanned entry." Reserved items with "non-scanned entry" are items that were added to the shopping cart without performing an operation to position the item within the imaging range of imaging unit 506. This non-scanning insertion can occur, for example, when the customer terminal device 50 is fixedly attached to a shopping cart and is capable of capturing an image of the inside of a shopping basket placed in the shopping cart. For example, when the customer terminal device 50 determines, based on the captured image, that a product has been placed in the shopping cart even though the product code has not been scanned, it can determine that a non-scanning insertion has occurred.

[0062] The classification of reserved items with classification number 5 is "age verification items." "Age verification items" are items such as alcohol and tobacco that require a store clerk to verify the customer's age before selling them.

[0063] The classification of reserved goods with classification number 6 is "pharmaceuticals." "Pharmaceuticals" are goods that require a qualified person, such as a pharmacist, to ask the purchaser for confirmation.

[0064] The classification of reserved items with classification number 7 is "items with security tags." "items with security tags" are items that have security tags attached and therefore require a store clerk to remove the security tags from the items when they are sold.

[0065] The classification of reserved products with classification number 8 is "cancelled products." "Cancelled products" are products that were once registered but were canceled by a customer's cancellation operation on the customer terminal device 50. "Cancelled products" are taken from the customer by a store clerk, for example, at the time of payment.

[0066] In this embodiment, pending products that fall into any of the four categories of "NON-FILE," "Read NG," "Pseudo-scanned input," and "Non-scanned input" of classification numbers 1 to 4 among classification numbers 1 to 7 are unspecified products. Unspecified products are products whose registration results are incomplete, for example, because it was not possible to identify which of the products registered in the product master it is.

[0067] The product master is stored, for example, by the store controller 10. The product master stores product information for each product sold in the store. The product information for one product includes a predetermined number of information items, including a product code and a product name. The transaction management device 60 stores the product master data acquired from the store controller 10. The transaction management device 60 uses the stored product master data for processes related to product registration, etc.

[0068] For a reserved item corresponding to classification number 1 "NON-FILE," the item code is acquired by code scanning in response to a product registration operation, but the product information associated with the acquired product code is not registered in the product master. Therefore, it is not possible to identify which of the items registered in the product master the reserved item corresponding to classification number 1 "NON-FILE" corresponds to. Specifically, customer terminal device 50 may transmit the product code acquired by code scanning to transaction management device 60, and transaction management device 60 may compare the transmitted product code with the product code of the item registered in the product master stored in itself. If, as a result of the comparison, it is determined that the same product code as the transmitted product code does not exist in the product master, transaction management device 60 may treat the item as a reserved item corresponding to classification number 1 "NON-FILE" and notify customer terminal device 50 of this fact. For pending products that fall into one of the three categories of classification numbers 2 to 4, "Read NG," "Pseudo scan input," and "Non-scan input," the product code failed to be acquired as a result of the code scan in response to the product registration operation. For this reason, it is not possible to identify which of the products registered in the product master the pending products that fall into one of the three categories of classification numbers 2 to 4, "Read NG," "Pseudo scan input," and "Non-scan input" are. Such unspecified products are products that can be released from their status as reserved products (reserved status) and registered normally by a store clerk operating the transaction status management device 80 as described below.

[0069] In addition, instead of or in addition to storing the cart information in its own memory, the transaction management device 60 may store some or all of the cart information in another device (such as a file server accessible to the transaction management device 60).

[0070] [Example of basic processing procedure for self-operation] The sequence diagram in Figure 10 shows an example of the processing procedure executed by customer terminal device 50, settlement device 40, and transaction management device 60 in response to the accounting of one transaction in self-service operation. Specifically, the processing in Figure 10 shows an example of the processing of customer terminal device 50, settlement device 40, and transaction management device 60 from when a customer registers a product to be purchased from products displayed in the store until the payment for the registered product is completed.

[0071] Step S1: Customer terminal device 50 acquires information identifying the store (store identification information). For example, a two-dimensional code for identifying the store may be displayed near the entrance of the store (for example, by outputting the two-dimensional code on a display screen or attaching a medium with the two-dimensional code printed on it), and a customer visiting the store may scan (read) the two-dimensional code with customer terminal device 50, thereby allowing customer terminal device 50 to acquire the store identification information. When a customer visiting the store launches a shopping application, a start-up screen may be displayed instructing the customer to scan the two-dimensional code. Alternatively, when a customer visiting the store scans the two-dimensional code with customer terminal device 50, the shopping application may be launched, and a start-up screen may be displayed informing the customer that the transaction management device 60 is currently connected.

[0072] Also, for example, since a store is identified by its location, a customer who visits the store may obtain location information (GPS information) at the store using the customer terminal device 50 (i.e., the store's location information may be obtained as store identification information). When a customer who visits the store starts a shopping application, the location information may be obtained, and a screen may be displayed as a startup screen informing the customer that the application is currently connected to the transaction management device 60. If multiple stores are detected from the location information and it is not possible to identify one, a selection screen may be displayed to allow the customer to make a selection. Alternatively, the application may be switched to a mode in which a two-dimensional code is forcibly obtained.

[0073] 11(A) shows an example of the start-up screen of the shopping application displayed on the display unit 504 of the customer terminal device 50. The start-up screen in the figure displays the store name. This store name is displayed based on the store-specific information acquired in step S1. When a customer wants to start registering a product for shopping, the customer operates a transaction start instruction button BT10 arranged on the start-up screen. In response to operation of the transaction start instruction button BT10, the customer terminal device 50 transmits a transaction start request including the acquired store identification information and customer identification information to the transaction management device 60. The transaction start request may be transmitted in response to a customer operation on the customer terminal device 50 as described above, or may be transmitted in response to the acquisition of store identification information without receiving any particular operation. Regarding customer identification information, the information entered in the name field of the registration form using the customer terminal device 50 during customer registration (when downloading or installing the shopping application on the customer terminal device 50) may be stored in the customer information of the transaction management device 60, but it may also be stored in the memory of the customer terminal device 50 in addition to the transaction management device 60. Note that when a store is identified (when the product registration initial screen described below is acquired), the store name, currently offered services (information on flyers being distributed that day), and available coupon information of the store may be displayed on a screen (the product registration initial screen or a screen separate from the product registration initial screen). Note that service and coupon information may be acquired from the transaction management device 60, for example, as screen information.

[0074] In addition, the destination information (address of the transaction management device 60) may also be obtained when registering the customer (when downloading or installing the shopping application to the customer terminal device 50) and stored in the memory of the customer terminal device 50. In addition, when scanning a two-dimensional code, the destination information may also be converted into a two-dimensional code in addition to the store identification information, and by scanning the two-dimensional code with the customer terminal device 50, the customer terminal device 50 may obtain the destination information along with the store identification information.

[0075] Step S2: The transaction management device 60, which has received the customer identification information and store identification information as a transaction start request from the customer terminal device 50, generates cart information for the transaction. Note that, in the initial state of the generated cart information, the cart identification information, transaction start date and time, and customer identification information are stored, but since the actual transaction (product registration) has not yet begun, other information (transaction end date and time, product information (registered product information, pending product information), etc.) is not stored.

[0076] As described above, the transaction management device 60 stores store information such as that shown in Figure 8(B), and therefore when it receives store identification information (although it also receives customer identification information) as a transaction start request from the customer terminal device 50, if the received store identification information is a two-dimensional code, it acquires the store identification information by referring to store identification information 1, and if the received store identification information is location information (GPS information), it acquires the store identification information by referring to store identification information 2. Note that if the store identification information received from the customer terminal device 50 is a two-dimensional code of the store identification information, the transaction management device 60 can simply acquire it as is.

[0077] In other words, when the transaction management device 60 receives customer identification information and store identification information from the customer terminal device 50 as a transaction start request, it acquires the store identification information from the store identification information received from the customer terminal device 50, acquires the current date, issues (assigns) a serial number, combines the store identification information with the current date and serial number, and stores the combined information as cart identification information in the cart information. Furthermore, when the transaction management device 60 receives store identification information and customer identification information from the customer terminal device 50 as a transaction start request, it acquires the current date and time and stores the current date and time as the transaction start date and time (generation date and time) in the cart information. Furthermore, when the transaction management device 60 receives store identification information and customer identification information from the customer terminal device 50 as a transaction start request, it stores the customer identification information received from the customer terminal device 50 as customer identification information in the cart information.

[0078] Step S3: The transaction management device 60, which has generated the cart information for the transaction, generates product registration initial screen information (screen information for the product registration screen, which is the initial screen) and transmits it to the customer terminal device 50. Specifically, the transaction management device 60, for example, generates product registration initial screen information and transmits the generated product registration initial screen information to the customer terminal device 50 together with cart identification information.

[0079] Step S4: The customer terminal device 50, which has received the cart identification information and the product registration initial screen information from the transaction management device 60, stores the cart identification information and displays the registration screen on the display unit. Specifically, the customer terminal device 50 displays the product registration initial screen, for example, as shown in Figure 11(B).

[0080] The initial product registration screen is a product registration screen that is displayed first when product registration is started. The product registration screen has a captured image area AR1 and a product registration result area AR2. The captured image area AR1 is an area where a captured image obtained by capturing an image using the imaging unit 506 is displayed. A product code (e.g., a barcode) captured so that it fits within the range of the captured image displayed in the captured image area AR1 is the target for reading. The product registration result area AR2 shows the number of registered products (number of registered products) and the total price for the products registered so far, and is an area where list items corresponding to each registered product are placed. In the case of the product registration initial screen shown in the same figure, since no products have been registered yet, the product registration result area AR2 is blank with no list items placed therein.

[0081] Step S5: In response to a customer's operation, the customer terminal device 50 scans the barcode attached to the product and reads the product code. In the figure, it is assumed that the barcode scan was successful. Steps S5 to S9 are repeatedly executed each time the barcode attached to the product is scanned.

[0082] The customer terminal device 50 that has acquired the barcode transmits to the transaction management device 60 the cart identification information and the product registration information including the product code obtained by scanning.

[0083] Step S6: Upon receiving product registration information (cart identification information and product code) from the customer terminal device 50, the transaction management device 60 identifies the cart information for the transaction from the cart identification information contained in the received product registration information.

[0084] Step S7: The transaction management device 60 updates the product data in the identified cart information. Specifically, if the received product registration information includes a product code for item N, the transaction management device 60 stores the product code as the product code of the registered product information (registered product N) in the identified cart information, obtains the product name and price corresponding to the product code from the product information, and stores them as the product and price of the registered product information (registered product N). The transaction management device 60 also updates the registered product information (total) in the identified cart information.

[0085] Step S8: After updating the product data in the cart information, the transaction management device 60 generates product registration update screen information (screen information of the product registration screen, which is the update screen to which the registered product has been added) and transmits it to the customer terminal device 50. Specifically, the transaction management device 60 generates product registration update screen information such that the customer terminal device 50 displays a product registration update screen to which the list item Itm of the currently registered product has been added in the product registration result area AR2, as shown in Figure 11 (C), and transmits the generated product registration update screen information to the customer terminal device 50 together with the cart identification information.

[0086] The product registration screen (product registration update screen) shown in FIG. 11(C) is displayed on the customer terminal device 50 after "XX bread" has been registered as the third product item. In other words, when "○○ yogurt" is stored in the cart information as the first item, the transaction management device 60 generates product registration update screen information such that "○○ yogurt" is displayed as the list item Itm on the customer terminal device 50, and transmits the generated product registration update screen information to the customer terminal device 50 together with the cart identification information; when "○○ chocolate" is stored in the cart as the second item, the transaction management device 60 generates product registration update screen information such that "○○ yogurt" and "○○ chocolate" are displayed as list items Itm on the customer terminal device 50, and transmits the generated product registration update screen information to the customer terminal device 50 together with the cart identification information; and when "○○ bread" is stored in the cart information as the third item, the transaction management device 60 generates product registration update screen information such that "○○ yogurt", "○○ chocolate", and "○○ bread" are displayed as list items Itm on the customer terminal device 50, as shown in Figure 11 (C), and transmits the generated product registration update screen information to the customer terminal device 50 together with the cart identification information.

[0087] In response to the registration of one product, a registered product presentation screen WD1 may be displayed, presenting the currently registered product, as shown in Fig. 12(A), for example. Furthermore, the registered product presentation screen WD1 in the same figure shows an example in which, in response to the product being available for eating in, a "Yes" button BT1 and a "No" button BT2 are displayed to confirm with the customer whether or not they wish to eat in. In this case, the price of the product will be calculated so that the consumption tax rate for the product is different when the "Yes" button BT1 is operated and when the "No" button BT2 is operated.

[0088] Step S9: The customer terminal device 50, which has received the cart identification information and product registration update screen information from the transaction management device 60, adds the product to the registration screen. Specifically, the customer terminal device 50 displays a product registration update screen such as that shown in FIG. 11(C). As described above, the product registration screen (product registration update screen) shown in FIG. 11(C) is displayed on the customer terminal device 50 after "XX bread" has been registered as the third product item.

[0089] Step S10: The customer terminal device 50 accepts a payment instruction operation as an operation by the customer, for example, by touching the "Proceed to Checkout" button shown in FIG.

[0090] Step S11: The customer terminal device 50 that has accepted the payment transition instruction operation generates a two-dimensional code. That is, the customer terminal device 50 converts information (e.g., cart identification information) required to execute the payment process for the items purchased by the customer terminal device 50 into a two-dimensional code. The customer terminal device 50 that has generated the two-dimensional code displays the generated two-dimensional code on the display unit. For example, a code display screen with a two-dimensional code arranged as shown in FIG. 11(D) is displayed on the display unit.

[0091] Step S12: The settlement device 40 scans (reads) the two-dimensional code displayed on the display unit of the customer terminal device 50. For example, the settlement device 40 scans the two-dimensional code displayed on the display unit of the customer terminal device 50 that is pointed by the customer within the recognition range of the customer-side scanner unit 406.

[0092] Step S13: The settlement device 40 reads the two-dimensional code displayed on the display unit of the customer terminal device 50 and requests the transaction management device 60 to calculate the subtotal. For example, the settlement device 40 sends a calculation request (subtotal calculation request information) to the transaction management device 60 requesting the calculation of the subtotal, together with the cart identification information obtained from the two-dimensional code.

[0093] Step S14: The transaction management device 60 receives the cart identification information and the sub-calculation request information from the customer terminal device 50 and identifies the cart information of the transaction from the cart identification information.

[0094] Step S15: After identifying the cart, transaction management device 60 calculates the subtotal amount using information such as prices in the registered product information included in the cart information corresponding to the identified cart information.

[0095] Step S16: After calculating the subtotal, the transaction management device 60 updates the cart information (storing the subtotal (calculated subtotal)) and sends the subtotal information indicating the calculated subtotal to the settlement device 40 together with the cart identification information.

[0096] Step S17: Upon receiving the cart identification information and subtotal information from the transaction management device 60, the settlement device 40 displays the subtotal amount on the customer side display unit 405, for example, as shown in FIG. 12(B).

[0097] Step S18: The settlement device 40, which has displayed the subtotal on the customer-side display unit 405, executes the payment (settlement). Specifically, the settlement device 40 accepts the selection of the payment type. In the case of cash, it accepts the deposit, calculates the amount of change, and, if there is change, dispenses the change and issues a receipt. Furthermore, when the settlement is complete, the settlement device 40 sends settlement completion information along with the cart information to the transaction management device 60, and the transaction management device 60 stores the transaction completion date and time (settlement date and time) for that cart.

[0098] After scanning a product, the customer terminal device 50 transmits the product code to the transaction management device 60 (S5). However, the customer terminal device 50 may be configured not to transmit product codes for products (e.g., products scanned at another store) other than those scanned within the store (the store where the customer visited and displayed the product registration initial screen). For example, the customer terminal device 50 acquires and stores location information (GPS information) when the customer visits the store (or when the product registration initial screen is displayed). The customer terminal device 50 also acquires location information when scanning each product and compares the location information acquired when the customer scanned the product with the location information acquired when the customer visited the store (or when the product registration initial screen is displayed). If the two information match (or approximately match), the customer terminal device 50 may permit the product code of the product to be transmitted to the transaction management device 60. If the two information do not match (or approximately match), the customer terminal device 50 may prohibit the product code of the product from being transmitted to the transaction management device 60. This makes it possible to prevent inappropriate product registration (for example, product registration to a cart created at another store, etc.).

[0099] When the payment terminal 40 prohibits the transmission of the product code as described above, after scanning the product, the payment terminal 40 may display an error message (e.g., "Registration is not possible because the item is not in the XX store") on the customer display unit 405. The payment terminal 40 may also display the above message on the clerk display unit 410 instead of or in addition to the message on the customer display unit 405.

[0100] Furthermore, after reading the two-dimensional code displayed on the display of the customer terminal device 50, the settlement device 40 requests the transaction management device 60 to calculate a subtotal (S13). However, the settlement device 40 may not request calculation of a subtotal for products other than those scanned in the store (e.g., products scanned at other stores). For example, the settlement device 40 references the store identification information of the store (it may store and reference the store identification information of the store in its own settlement device 40, or it may reference store identification information stored in another accessible device), and when it reads the two-dimensional code displayed on the display of the customer terminal device 50, it compares the cart identification information obtained from the two-dimensional code with the store identification information of the store. The settlement device 40 may then permit the request for calculation of a subtotal if the store identification information included in the cart identification information is configured to include the store identification information of the store, but may prohibit the request for calculation of a subtotal if it is not configured to include the store identification information of the store. This makes it possible to prevent inappropriate payments (for example, payments for products registered at other stores, etc.).

[0101] When the payment device 40 prohibits the request for the subtotal amount as described above, after reading the two-dimensional code, the payment device 40 may display an error message (e.g., "Payment cannot be made because the transaction includes products not from the XX store") on the customer-side display unit 405. The payment device 40 may also display the above message on the clerk-side display unit 410 instead of or in addition to the message on the customer-side display unit 405.

[0102] 10, the transaction management device 60 calculates the subtotal. However, for example, the settlement device 40 may acquire cart information from the transaction management device 60 and calculate the subtotal based on the acquired cart information. Alternatively, the transaction management device 60 may transmit cart information to the store controller 10 and request calculation of the subtotal, and the store controller 10 may calculate the subtotal using the received cart information and transmit the calculated subtotal to the settlement device 40 via the transaction management device 60.

[0103] During the settlement process, the transaction management device 60 may check the cancellation status of the customer's products based on the customer information and cart information of the customer, and determine whether or not to issue a warning against fraud. If it is determined that a warning should be issued, the transaction management device 60 may, for example, cause the settlement device 40 to issue a warning notification.

[0104] Furthermore, during the checkout process, the transaction management device 60 may determine whether the product information included in the cart information includes any reserved items, and if so, may request the checkout device 40 to issue an instruction to correct the reserved items. Upon receiving the request to issue an instruction to correct the reserved items, the checkout device 40 displays a message indicating that there are reserved items, as shown in FIG. 12(C). Upon confirming the message, the store clerk may cancel (correct) the reserved items by entering the price corresponding to the reserved items or canceling the reserved items.

[0105] [Example of procedure for canceling registration of registered products] There are cases where a customer has registered a product but wishes to cancel the registration, for example, because they registered the wrong product or because they have decided not to purchase the product. Therefore, in the shopping system of this embodiment, while the customer terminal device 50 is in the process of registering the product, the customer can cancel the registration of the registered product by operating the customer terminal device 50. An example of the procedure a customer follows to cancel the registration of a product is described below. In the following explanation, we will use as an example a case where the customer terminal device 50 is attached to a shopping cart so as to capture an image of the inside of the shopping cart. In this case, an image of the inside of the shopping cart is displayed in the captured image area AR1 of the product registration screen.

[0106] When the customer terminal device 50 is in the process of registering a product and it becomes necessary to cancel a certain product among the products that have already been registered, the customer performs an operation to select the list item Itm of the product to be canceled from the list items Itm in the product registration result area AR2 on the product registration screen. The operation to select the list item Itm may be an operation to tap the list item Itm. In response to the operation to select the list item Itm, a product registration change screen is displayed.

[0107] The product registration change screen is a screen on which the user can change the registered details (change the quantity or cancel the registration) of the product corresponding to the selected list item Itm. 13(A) shows an example of the product registration change screen P30. The product registration change screen P30 in the figure shows an example in the form of a pop-up screen that is displayed superimposed on the product registration screen. The product registration change screen P30 in the figure is displayed in response to selecting the list item Itm for the product "XX Chocolate" from the three list items Itm in the product registration result area AR2 in the figure. In this case, in the product registration result area AR2, the two list items Itm for products other than "XX Chocolate" are grayed out, indicating that they are not available for selection, and the list item Itm for "XX Chocolate" is not grayed out, indicating that it is available for selection.

[0108] The product registration change screen P30 has arranged thereon a cancel button BT31, a quantity price area AR30, a plus button BT32-1, and a minus button BT32-2. The cancel button BT31 is a button that is operated to cancel the registration of the target product. When the cancel button is operated, if the registered quantity of the target product is two or more, the entire registered quantity is canceled. The quantity price area AR30 indicates the registered quantity of the target product corresponding to the current time and the price according to the registered quantity. The plus button BT32-1 is a button that is operated when making a change to increase the registered quantity of the target product. Each time the plus button BT32-1 is operated, the registered quantity is increased by one. The minus button BT32-2 is a button that is operated when making a change to decrease the registered quantity of the target product. Each time the minus button BT32-2 is operated, the registered quantity is changed to decrease by one. In response to the operation of the plus button BT32-1 or the minus button BT32-2 to change the registered quantity, the registered quantity and price in the quantity price area AR30 are changed.

[0109] In this embodiment, decreasing the registered quantity in response to the operation of the minus button BT32-2 may also be treated as canceling the product. In other words, when the registered quantity of a registered product is decreased, the product corresponding to the decreased quantity may be treated as being canceled.

[0110] When the product registration change screen P30 is displayed, for example, if the list item Itm corresponding to the target product is operated, the product registration change screen P30 is cleared and the product registration screen is returned to being displayed.

[0111] To cancel the entire quantity of the target product, the customer operates the cancel button BT31. When the cancel button BT31 is operated, the product registration change screen P30 is cleared and a cancellation confirmation screen is subsequently displayed.

[0112] 13(B) shows an example of a cancellation confirmation screen WD40. The cancellation confirmation screen WD40 in the drawing shows an example in the form of a pop-up screen that is displayed superimposed on the product registration screen. When a customer is performing an operation to cancel a target product, the target product is in a state in which the customer has reserved the product, for example, by adding the product to the customer's shopping cart. The cancellation confirmation screen WD40 is a screen that notifies the customer that the registration cancellation has been successfully completed in response to the operation to cancel the product. The cancellation confirmation screen WD40 in the same figure also guides the customer to return the target product to the location where the target product was displayed, such as a display shelf (to return it to an unreserved state). The cancellation confirmation screen WD40 displays a message informing the user that the product has been cancelled and guiding the user to return the product to an unsecured state, and also includes a confirmation button BT40.

[0113] Furthermore, in response to the cancellation of the registration, the list item Itm of the canceled product in the product registration result area AR2 is, as shown in the figure, for example, with the quantity erased and the product name and price crossed out to indicate that the product has been canceled. Furthermore, such canceled products are managed in the cart information as "cancelled products," which are reserved products with classification number 8. The crossed out product name and price of the list item Itm also indicates that the corresponding product is a reserved product classified as a "cancelled product." Also, in the figure, although it is hidden by the cancellation confirmation screen WD40, the display of the number of registered items and the total price in the product registration result area AR2 has been changed to reflect the cancellation of the product registration.

[0114] In response to the cancellation of registration, the list item Itm of the product in question may be deleted.

[0115] When the customer looks at the cancellation confirmation screen WD40 and has not yet returned the canceled product to its non-reserved state, he or she can, for example, return the product to the display shelf to return it to its non-reserved state, and then operate the cancel button BT31. When the cancel button BT31 is operated, the cancellation confirmation screen WD40 is cleared, and the display returns to the product registration screen. Even when the display returns to the product registration screen, the list item Itm of the canceled product still indicates that it has been canceled.

[0116] [Notification of non-secured status when canceling the registration of a registered product] As described above, when a customer wishes to cancel the registration of a product that has already been registered, they must display the cancellation confirmation screen WD40, perform the registration cancellation operation (operate the cancel button BT31), and return the previously reserved product to its unreserved state, for example by returning it to the display shelf. However, there are cases where a customer cancels a registration but forgets to return the item to its non-reserved state. In this case, the number of items actually in the shopping cart may be greater than the number of items registered in the cart information, resulting in a discrepancy between the breakdown of registered items and the breakdown of items actually reserved by the customer. Alternatively, a malicious customer may cancel the registration but intentionally leave the item in the shopping cart without restoring it to a non-reserved state, and then proceed with the checkout, attempting to complete the purchase without paying for the item.

[0117] Therefore, the customer terminal device 50 determines whether the target product has been returned to a non-secured state in response to the registration cancellation operation, and if it is determined that the target product has not been returned to a non-secured state, it provides guidance to the customer to return the target product to a non-secured state.

[0118] When determining whether the target product has been returned to an unsecured state, the customer terminal device 50 is configured to detect the removal of a product from the shopping cart by using a captured image obtained by capturing an image of the inside of the shopping cart. For example, this detection is performed by configuring the customer terminal device 50 to be able to recognize product objects from the captured image. Furthermore, the customer terminal device 50 may be configured to detect that a product has been removed from the shopping cart when any of the product objects that were present in the captured image transition to a state where they are no longer recognized in the captured image. In this case, the customer terminal device 50 may be configured to recognize a human hand from the captured image and may use the recognition result of the human hand to detect the removal of a product from the shopping cart. For example, after a human hand is recognized in the captured image, the customer terminal device 50 may detect that a product has been removed from the shopping cart when the human hand is no longer recognized in the captured image and the product that was recognized in the captured image transitions to an unrecognized state from the captured image. In this case, the mobile terminal 300 may be configured to execute a process of identifying the product type for each product object. Such detection of an item being removed from a shopping cart may be achieved by a learning model that uses images of a person removing an item from a cart as learning data. For example, the customer terminal device 50 may transmit an image to the transaction management device 60, and the transaction management device 60 may use the transmitted image to detect the removal of an item from the shopping cart using the processing described above.

[0119] The customer terminal device 50 is then configured to detect whether or not a product has been removed from the shopping cart during a determination period, for example, from the time the cancellation confirmation screen WD40 is deleted until a certain amount of time has elapsed. If it is detected that an item has been removed from the shopping cart within a certain period of time since the cancellation confirmation screen WD40 was deleted, the customer terminal device 50 determines that the target item has been returned to an unsecured state in response to the current registration cancellation operation. If no removal of an item from the shopping cart is detected within a certain period of time from the time the cancellation confirmation screen WD40 is deleted, the customer terminal device 50 determines that the target item has not been returned to an unsecured state in response to the current registration cancellation operation.

[0120] It should be noted that the customer may return the target product to the non-reserved state while the product registration change screen P30 is being displayed or before the product registration change screen is displayed. Therefore, the customer terminal device 50 may be configured to determine whether or not a product has been detected being removed from the shopping cart during a determination period that begins when the product registration change screen P30 begins to be displayed and ends when a certain amount of time has passed since the cancellation confirmation screen WD40 was deleted. Alternatively, the customer terminal device 50 may be configured to determine whether or not a product has been removed from the shopping cart during a determination period that begins a predetermined time prior to the start of displaying the product registration change screen P30 and ends a predetermined time after the cancellation confirmation screen WD40 is deleted. In this case, if the customer terminal device 50 stores captured images taken up to the predetermined time prior to the deletion of the cancellation confirmation screen WD40, the captured images taken up to the predetermined time prior to the deletion of the cancellation confirmation screen WD40 can be used for detection.

[0121] If the customer terminal device 50 determines that the product has not been returned to a non-reserved state in response to the registration cancellation operation, the customer terminal device 50 displays a non-reserved re-guidance screen. The non-reserved re-guidance screen is a screen that again guides the customer to return the product corresponding to the registration cancellation operation to a non-reserved state.

[0122] A specific example of a situation in which the non-reserved re-guidance screen is displayed will be described with reference to Fig. 14. Fig. 14(A) to Fig. 14(D) show examples of screen transitions on the display unit 504 of the customer terminal device 50 in response to actions taken by a customer in relation to the cancellation of the registration of a registered product. As shown in the product registration result area AR2 of the product registration screen in Figure 14(A), after the customer has registered three products, "XX Potatoes," "XX Tea," and "XX Chocolate," he operates the list item Itm for "XX Chocolate" to display the product registration change screen P30 in order to cancel the registration of the product "XX Chocolate." The customer operates the cancel button BT31 on the displayed product registration change screen P30 to cancel the registration of the product "XX Chocolate."

[0123] In response to the operation of the cancel button BT31, the customer terminal device 50 erases the product registration change screen P30 and displays the cancellation confirmation screen WD40, as shown in Fig. 14(B). The customer operates the confirmation button BT40 arranged on the cancellation confirmation screen WD40.

[0124] In response to the operation of the confirmation button BT40, the cancellation confirmation screen WD40 is cleared, and the product registration screen is displayed as shown in Fig. 14(C). In the product registration result area AR2 on the product registration screen in Fig. 14(C), the quantity display is cleared in the list item Itm for the product "XX Chocolate", and a strikethrough is applied to the product name and price to indicate that the registration has been cancelled.

[0125] Furthermore, the captured image area AR1 of the product registration screen in the same figure shows that the "XX Chocolate" product that was the subject of cancellation remains in the shopping cart without being removed. In other words, at this stage, the customer still has the "XX Chocolate" product that was the subject of cancellation. For example, in this case, the customer performed the operation to cancel the registration of the "XX Chocolate" product, but forgot to return the "XX Chocolate" product to the display shelf and return it to its unreserved state.

[0126] The customer left the "XX Chocolate" product in the shopping cart, forgetting to return it to the unsecured state even after a certain amount of time had passed since the cancellation confirmation screen WD40 was deleted. Therefore, the customer terminal device 50 determined that the product had not been returned to the unsecured state in response to the registration cancellation operation, even after a certain amount of time had passed since the cancellation confirmation screen WD40 was deleted.

[0127] Therefore, the customer terminal device 50 displays the non-reserved re-guidance screen WD50 as shown in Fig. 14(D). The non-reserved re-guidance screen WD50 in the figure shows an example in the form of a pop-up screen that is displayed superimposed on the product registration screen. The non-reserved re-guidance screen WD50 in the figure displays a message to prompt the customer to confirm that although there are products whose registration has been cancelled, the products have not yet been returned to a non-reserved state, and displays a confirmation button BT50.

[0128] By looking at the displayed non-reserved item re-guidance screen WD50, the customer realizes that although he or she performed the registration cancellation operation, he or she has not returned the target item to a non-reserved state. Therefore, the customer returns the "XX Chocolate" item to the display shelf to make it non-reserved, and operates the confirmation button BT50. It does not matter which comes first: returning the "XX Chocolate" item to the display shelf to make it non-reserved, or operating the confirmation button BT50. In response to the operation of the confirmation button BT50, the non-reserved item re-guidance screen WD50 is cleared, and the item registration screen is displayed.

[0129] In this manner, in this embodiment, if the target product has not been returned to the non-reserved state even after a certain time has passed since the cancellation confirmation screen WD40 was deleted, the non-reserved re-guidance screen WD50 is displayed. This allows the customer to realize that the target product has not yet been returned to the non-reserved state, and to return the target product to, for example, a display shelf. In other words, the customer can properly carry out the procedure for canceling the product registration. Furthermore, even if a malicious customer cancels registration but intentionally leaves the item in the shopping cart without restoring it to an unsecured state, the unsecured re-guidance screen WD50 is displayed, increasing the likelihood that the customer will restore the item to an unsecured state, thereby deterring fraudulent behavior.

[0130] If a certain period of time has passed since the non-reserved re-guidance screen WD50 was deleted without the target product being returned to the non-reserved state, the customer terminal device 50 may display the non-reserved re-guidance screen WD50 again. This more effectively prevents and deters fraudulent acts such as customers forgetting to return the target product to the non-reserved state or customers not returning a product that they have canceled registration of to the non-reserved state.

[0131] [Regarding the cancellation procedure for registered products] Conversely to the above example, there may be cases where a customer who wants to cancel the registration of a registered product returns the product to the shelf or other means to return it to an unsecured state, but forgets to perform the cancellation operation. In such cases, the number of products registered in the cart information may be greater than the number of products actually in the shopping cart, resulting in a discrepancy between the breakdown of products actually reserved by the customer and the breakdown of registered products.

[0132] Therefore, when the customer terminal device 50 determines that a product that has been reserved by a customer has been returned to a non-reserved state, it determines whether or not a registration cancellation operation has been performed to cancel the registration of the product that has been returned to a non-reserved state, and if it determines that a registration cancellation operation has not been performed, it guides the customer to perform a registration cancellation operation for the product in question.

[0133] In this case, the customer terminal device 50 is configured to constantly detect the removal of an item from the shopping cart during product registration using captured images obtained by capturing images of the inside of the shopping cart. The customer terminal device 50 then determines whether a registration cancellation operation has been performed within a predetermined determination period that includes the time when it is detected that the item has been removed. Specifically, the customer terminal device 50 may determine whether a registration cancellation operation has been performed within a certain period of time since it was detected that the item has been removed. Furthermore, the customer terminal device 50 may also include a certain period of time from the time when it was detected that the item has been removed in the period for determining whether a registration cancellation operation has been performed.

[0134] If the customer terminal device 50 determines that the registration cancellation operation has not been performed during the above-mentioned determination period, the customer terminal device 50 displays a registration cancellation operation guide screen. The registration cancellation operation guide screen is a screen that guides the customer to perform a registration cancellation operation corresponding to the product that has been set to the non-reserved state.

[0135] A specific example of a situation in which the registration cancellation operation guide screen is displayed will be described with reference to Fig. 15. Fig. 15(A) to Fig. 15(C) show examples of screen transitions on the display unit 504 of the customer terminal device 50 in response to actions taken by a customer in relation to canceling the registration of a registered product.

[0136] The product registration screen in Fig. 15(A) corresponds to the stage where three products, "XX Potatoes," "XX Tea," and "XX Chocolate," have been registered. In this case, the captured image area AR1 displays a captured image of the three products, "XX Potatoes," "XX Tea," and "XX Chocolate," in a shopping cart. The product registration result area AR2 displays list items Itm corresponding to each of the products, "XX Potatoes," "XX Tea," and "XX Chocolate."

[0137] In this state, the customer decides to cancel the registration of the "XX Chocolate" product. To do this, the customer first removes the "XX Chocolate" product from the shopping cart and returns it to an unsecured state (for example, by returning it to the display shelf). In this way, when the customer removes the "XX Chocolate" product from the shopping cart and returns it to an unsecured state, the "XX Chocolate" product is no longer present in the captured image displayed in the captured image area AR1, as shown in Figure 15(B).

[0138] Furthermore, the customer terminal device 50 detects that a product in the shopping cart has been removed based on the change in the captured image from when the "XX Chocolate" product was present to when it is no longer present, as described above. Upon detecting the removal of a product in this manner, the customer terminal device 50 sets a determination period and determines whether a registration cancellation operation has been performed between the start and end of the determination period. During the determination period, the customer terminal device 50 may not accept new product registrations. In this case, the customer returned the "XX Chocolate" product to the shelf, but forgot to perform the corresponding registration cancellation operation. As a result, a certain amount of time passed after the customer terminal device 50 detected the product's removal, and the judgment period ended without the registration cancellation operation being performed. In this case, the customer terminal device 50 determines that the registration cancellation operation was not performed within the judgment period.

[0139] In response to determining that the registration cancellation operation has not been performed within the determination period, the customer terminal device 50 displays a registration cancellation operation guide screen. Figure 15(C) shows an example of the registration cancellation operation guide screen WD60. The registration cancellation operation guide screen WD60 in the figure shows an example in the form of a pop-up screen superimposed on the product registration screen. The registration cancellation operation guidance screen WD60 displays a message guiding the user to perform a registration cancellation operation for the product that has just been returned to the non-reserved state, and a confirmation button BT60.

[0140] By looking at the displayed registration cancellation operation guide screen WD60, the customer realizes that although he or she has returned the product to be cancelled to an unsecured state, he or she has not performed the corresponding registration cancellation operation.The customer then operates the confirmation button BT60 to close the registration cancellation operation guide screen WD60 and display the product registration screen.The customer operates the displayed product registration screen to perform the registration cancellation operation for the "XX Chocolate" product, thereby canceling the registration of the "XX Chocolate" product.

[0141] In this manner, in this embodiment, if it is determined that the customer has not performed the deregistration operation within a certain period of time since returning the product to the non-reserved state, the deregistration operation guide screen WD60 is displayed. This allows the customer to realize that the deregistration operation has not yet been performed, and to perform the deregistration operation. In other words, even in this case, the customer can properly perform the procedure for deregistration of the product.

[0142] The customer terminal device 50 may set a judgment period until a certain time has elapsed in response to the cancellation of registration operation screen WD60 being erased once, and may display the cancellation of registration operation screen WD60 again if the judgment period has elapsed without the cancellation of registration operation being performed.

[0143] [Example of processing procedure] Referring to the flowchart of FIG. 16, an example of a processing procedure executed by the customer terminal device 50 and the transaction management device 60 in relation to canceling the registration of a product is shown. Step S101: With the product registration screen displayed on the display unit 504, the customer terminal device 50 determines whether or not the product code has been read (the product code has been acquired) by code scanning in response to the product registration operation.

[0144] Step S102: In response to reading the product code, customer terminal device 50 transmits product registration information to transaction management device 60. The product registration information includes the product code read in step S101 and cart identification information.

[0145] Step S103: The customer terminal device 50 receives the registration completion notification sent from the transaction management device 60 in response to the transmission of the product registration information in step S102. The customer terminal device 50 uses the information on the product registration update screen included in the received registration completion notification to update the product registration screen, for example, as illustrated in FIG. 11(C).

[0146] Step S104: After the processing of step S103, or if it is determined in step S101 that the product code has not been read, the customer terminal device 50 determines whether a registration cancellation operation has been performed. The registration cancellation operation here is a series of operations in which the customer taps the list item Itm of the product to be cancelled on the product registration screen to display the product registration change screen P30 (FIG. 13(A)), and then taps the cancel button BT31 on the displayed product registration change screen P30.

[0147] Step S105: If it is determined that a registration cancellation operation has been performed, the customer terminal device 50 sends registration cancellation information to the transaction management device 60. The registration cancellation information is information that notifies the transaction management device 60 that a registration cancellation operation has been performed on the customer terminal device 50. The registration cancellation information includes a product code indicating the product designated as the target for registration cancellation and cart identification information.

[0148] Step S106: The customer terminal device 50 receives the cancellation completion notice sent from the transaction management device 60 in response to the sending of the product registration information in step S105. The customer terminal device 50 uses the information on the product registration update screen included in the received cancellation completion notice to update the product registration screen so that it reflects that the target product has been canceled in the product registration result area AR2, as shown in Figure 12(B), for example. Step S107: The customer terminal device 50 also displays a cancellation confirmation screen WD40 as shown in FIG. 13(B) and other figures. Step S108: In response to an operation on the confirmation button BT40 on the cancellation confirmation screen WD40, the customer terminal device 50 erases the cancellation confirmation screen WD40. As a result, the product registration screen in which the cancellation of the target product is reflected in the product registration result area AR2 as a result of the update in step S106 is displayed as the top screen.

[0149] Step S109: When the cancellation confirmation screen is cleared, the customer terminal device 50 sets a determination period, and determines whether or not a product has been detected being removed from the shopping cart based on the captured image during the set determination period. If removal of a product is detected, steps S110 to S112, which will be described later, are skipped and the process proceeds to step S113. In this case, the non-reservation re-guidance screen WD50 is not displayed.

[0150] Step S110: If it is determined in step S109 that no product removal is detected, the customer terminal device 50 determines whether the determination period set in response to the detection of product removal in step S109 has elapsed (ended). If it is determined that the determination period has not elapsed, the process returns to step S109. When returning the process from step S110 to step S109 in this way, the cancellation confirmation screen may be cleared and the reading of a product code for new product registration or a registration cancellation operation for other registered products may not be accepted until the determination period has elapsed.

[0151] Step S111: If it is determined in step S110 that the determination period has elapsed without the removal of a product being detected in step S109, the customer terminal device 50 displays the non-reserved re-guidance screen WD50 (Figure 14 (D)). Step S112: In response to an operation on the confirmation button BT50 on the non-reserved re-guidance screen WD50, the customer terminal device 50 erases the non-reserved re-guidance screen WD50 and displays the product registration screen as the top screen.

[0152] Step S113: If it is determined in step S104 that a registration cancellation operation has not been performed, or if the removal of a product within the determination period is detected in step S109, or after processing in step S112, the customer terminal device 50 determines whether the removal of a product from the shopping cart has been detected based on the captured image while in a state in which product registration can be accepted. The determination of whether removal has been detected in step S109 corresponds to the determination of whether the target product has been returned to a non-reserved state in response to the deregistration operation being performed. In contrast, the determination of whether removal has been detected in step S113 is a process for determining whether the target product has been returned to a non-reserved state prior to the deregistration operation when deregistering the product.

[0153] Step S114: If removal of a product from the shopping cart is detected in step S113, the customer terminal device 50 sets a determination period and determines whether or not a registration cancellation operation has been performed during the set determination period. Step S115: If a registration cancellation operation is not detected in step S114, the customer terminal device 50 determines whether the determination period set in step S114 has elapsed. If the determination period has not elapsed, the process returns to step S114. When the process returns from step S115 to step S114 in this way, it may be configured so that reading of a product code for new product registration and registration cancellation operations for other registered products cannot be accepted until the determination period has elapsed.

[0154] Step S116: If it is determined in step S114 that a registration cancellation operation has been performed during the determination period, registration cancellation information is sent to the transaction management device 60. The registration cancellation information includes the product code indicating the product designated as the target for registration cancellation and cart identification information. Step S117: The customer terminal device 50 receives the cancellation completion notice sent from the transaction management device 60 in response to the sending of the product registration information in step S116. The customer terminal device 50 uses the information on the product registration update screen included in the received cancellation completion notice to update the product registration screen so that the product registration result area AR2 reflects that the target product has been canceled. In this case, since the target product has already been returned to the non-reserved state, the customer terminal device 50 does not need to execute the process related to displaying the cancellation confirmation screen WD40 as in steps S107 and S108.

[0155] Step S118: If the determination period has elapsed without the registration cancellation operation being performed in step S115, the customer terminal device 50 displays the registration cancellation operation guide screen WD60 (FIG. 15(C)). Step S119: In response to an operation on the confirmation button BT60 on the registration cancellation operation guide screen WD60, the customer terminal device 50 erases the registration cancellation operation guide screen WD60 and displays the product registration screen as the top screen.

[0156] Step S120: If no product removal is detected in step S113, or after the processing of step S117 or S119, the customer terminal device 50 determines whether or not a payment instruction operation has been performed while the product registration screen is displayed. If a payment instruction operation has not been performed, the process returns to step S101.

[0157] Step S121: When the payment transition instruction operation is performed, the customer terminal device 50 converts the cart identification information into a two-dimensional code and displays a code display screen (Figure 11 (D)) on the display unit 504, on which the generated two-dimensional code is displayed.

[0158] Next, an example of a processing procedure executed by the transaction management device 60 will be described. Step S201: The transaction management device 60 determines whether or not the product registration information transmitted from the customer terminal device 50 in step S102 has been received.

[0159] Step S202: When the transaction management device 60 receives the product registration information, it identifies the cart information indicated by the cart identification information included in the received product registration information. Step S203: The transaction management device 60 updates the cart information identified in step S202 by registering a new product. That is, the transaction management device 60 adds product information based on the product code included in the product registration information received in step S201 to the identified cart information. This registers the product in the cart information. Step S204: Upon completing the processing of step S203, the transaction management device 60 generates a product registration update screen that reflects the results of updating the cart information in step S203 (addition of the newly registered product). The transaction management device 60 transmits a registration completion notice including the generated product registration update screen to the customer terminal device 50.

[0160] Step S205: After processing step S204, or if it is determined in step S201 that product registration information has not been received, the transaction management device 60 determines whether registration cancellation information sent from the customer terminal device 50 in step S105 or step S116 has been received.

[0161] Step S206: When the transaction management device 60 receives the registration cancellation information, it identifies the cart information indicated by the cart identification information included in the received registration cancellation information. Step S207: The transaction management device 60 updates the cart information identified in step S206 so that the product indicated by the product code included in the received registration cancellation information is managed as a canceled product (a pending product classified as "cancelled product" under classification number 8). Step S208: Upon completing the processing of step S207, the transaction management device 60 generates a product registration update screen that reflects the updated cart information in response to the product registration cancellation in step S207. The transaction management device 60 transmits a cancellation completion notice including the generated product registration update screen to the customer terminal device 50.

[0162] <Modification> Modifications of this embodiment will be described below. The modifications described below may be combined with the above embodiment and other modifications as appropriate.

[0163] [First Modification] Examples of ways to "return a product that is subject to deregistration to a non-secured state" include returning the product to its original display location, such as the display shelf where it was displayed, as well as handing over the product to the nearest store clerk or bringing the product to a predetermined storage location for cancelled products in the store.

[0164] [Second Modification] In the above embodiment, the removal of an item from the shopping cart is detected using a captured image. However, the removal of an item from the shopping cart may be detected, for example, by providing a weighing scale capable of measuring the weight of the shopping cart placed in the shopping cart, and detecting the removal of an item from the shopping cart based on the change in weight measured by the weighing scale. Alternatively, instead of a shopping cart, a weighing scale may be provided on the bottom of the shopping cart. Furthermore, removal of an item from the shopping cart may be detected based on the detection output of an optical sensor, a vibration sensor, or the like.

[0165] [Third Modification] In the above embodiment, an example was given in which the customer terminal device 50 is attached to a shopping cart so as to be able to capture images of the inside of the shopping cart and executes processing in response to product registration and the like. However, for example, there may be cases where a customer removes customer terminal device 50 from the shopping cart and holds it in their hand to read the product code of the product to be registered. In this case, there is a possibility that a registration cancellation operation will be performed on the product that was registered by reading the product code while the customer is holding customer terminal device 50 in their hand. As described above, if a customer holds customer terminal device 50 in his / her hand, registers a product, and then immediately performs a registration cancellation operation, there is a high possibility that the customer will not place the product in the shopping cart, but will simply return the product to the display shelf, leaving it in a non-reserved state. Therefore, customer terminal device 50 does not need to display the non-reserved re-guidance screen WD50 if the registration cancellation operation is performed within a predetermined time (for example, about several tens of seconds) after the customer holds customer terminal device 50 in his / her hand and registers the product. In other words, in this case, customer side display unit 405 does not need to determine whether or not a product has been removed from the shopping cart within the determination period. In this modified example, it is necessary to determine whether or not the customer is holding the customer terminal device 50. This determination may be made, for example, by the customer terminal device 50 based on the detection output of a gyro sensor provided therein.

[0166] [Fourth Modification] Furthermore, if the customer returns the target product to an unsecured state before canceling the registration, and the item of the target product detected as being removed from the shopping cart can be identified based on the captured image, the registration of the identified product may be cancelled. The product registration cancellation process according to this modification may be performed, for example, by customer terminal device 50 and transaction management device 60 working together, without involving any operation by the customer on customer terminal device 50. Specifically, for example, the transaction management device 60 may identify the item of the product removed from the shopping cart based on the captured image sent from the customer terminal device 50, and manage the product as a pending product classified as a ``cancelled product.'' With this configuration of the present modified example, if the target product is returned to the non-reserved state before the registration cancellation operation is performed, the registration of the target product can be treated as having been properly cancelled without the need to perform the registration cancellation operation after the product is returned to the non-reserved state. In this case, for example, the registration cancellation operation guide screen WD60 does not need to be displayed.

[0167] Furthermore, if the customer returns the target product to a non-reserved state before performing the registration cancellation procedure, and the item of the target product detected as being removed from the shopping cart cannot be identified, the registration cancellation operation can be made unnecessary and the registration cancellation operation guide screen WD60 can be prevented from being displayed as follows. In other words, in this case, when a product is detected being removed from the shopping cart, at least one of the currently registered products may be treated as a reserved product. Alternatively, a virtual (dummy) reserved product may be added to the cart information. By including the reserved product in the cart information in this way, a store clerk will be called in to release the reserved product before checkout. When the store clerk attends, they will notice that the contents of the cart information do not match the breakdown of products in the shopping cart, and they can then correct the cart information appropriately and proceed with checkout.

[0168] In addition, if the customer returns the target product to a non-reserved state before canceling the registration as a procedure for canceling the registration, the list item Itm of the reserved product may be added to the product registration result area AR2 on the product registration screen in response to detection of the product being removed from the shopping cart. In addition, if the registration cancellation operation is not performed within a certain period of time after the removal of an item from the shopping cart is detected, the registration cancellation operation guide screen WD60 may be displayed. Alternatively, instead of displaying the registration cancellation operation guidance screen WD60, a message, icon, etc. guiding the user to perform the registration cancellation operation may be displayed in the list item Itm of the added pending item, for example, immediately after the pending item is added to the list item Itm, or when a certain amount of time has passed since the removal of the item from the shopping cart is detected and no registration cancellation operation has been performed.

[0169] [Fifth Modification] In the above embodiment, a product whose registration has been cancelled by a registration cancellation operation is managed as a "cancelled product" which is a reserved product with classification number 8. Also, on the product registration screen, the list item Itm of a product whose registration has been cancelled by a registration cancellation operation has a strikethrough drawn through the product name and price, thereby indicating that the corresponding product is a reserved product classified as a "cancelled product." When a product treated as a reserved product is included in the cart information, for example, a store clerk performs an operation to cancel the reserved product status (reserved state) before checkout. In other words, when a reserved product is included in the products managed in the cart information, the reserved state must be canceled by the intervention of a store clerk. Considering that the shopping system of this embodiment is originally intended to allow customers to perform the entire process from product registration to checkout themselves, it is preferable that reserved products not be included in the cart information. Therefore, for example, the transaction management device 60 may be configured not to manage products (properly canceled products) as reserved products in the cart information for which it has been confirmed that both the registration cancellation operation and the return to a non-reserved state have been performed. In this case, in response to the registration cancellation operation being performed, the list item Itm of the product whose registration has been cancelled may be deleted from the product registration screen of the customer terminal device 50. The transaction management device 60 may delete the product information corresponding to the properly canceled product from the cart information, but may also add information (a flag) indicating that the product information corresponding to the properly canceled product has been canceled to the cart information so that a store clerk can check the cancellation status of the registration later, or may store the information as part of the registered transaction history.

[0170] [Sixth Modification] In the above embodiment, some of the processes executed by the customer terminal device 50 may be executed by, for example, the transaction management device 60, the transaction status management device 80, the settlement device 40, the store controller 10, other higher-level devices in the store, or server devices on the cloud. Similarly, some of the processes executed by the transaction management device 60, the transaction status management device 80, the settlement device 40, the store controller 10, etc. may also be executed by other devices. As one of the above-mentioned aspects, the shopping system of this embodiment may be provided with a thin client system configuration. As an example, the transaction management device 60 or another server may be configured as a thin client-compatible server device (e.g., a cloud server), and the customer terminal device 50, transaction status management device 80, etc. may function as thin clients. In this case, for example, the cloud server may acquire as detection information the captured image sent from the customer terminal device 50, and the detection output of the weighing scale, optical sensor, vibration sensor, etc. described in the second variant, and use the acquired detection information to determine whether a product has been removed from the shopping cart or whether a registration cancellation operation has been performed within the determination period. Furthermore, the transaction management device 60, transaction status management device 80, store controller 10, etc. may be configured to be distributed across multiple computer devices or servers.

[0171] <Summary of the embodiment> [Technical field] The present invention relates to a product sales data processing system and a mobile terminal device. [Background technology] BACKGROUND ART A system is known in which a customer registers a product using a mobile terminal device (see, for example, Patent Document 1). [Prior art document] [Patent Documents] [Patent Document 1] JP 2019-204551 A [Summary of the Invention] [Problem to be solved by the invention] In the above-described product sales data processing system, a customer may register a certain product and reserve it by adding it to a shopping cart, but then wish to cancel the registration, for example, because they have selected the wrong product or have decided not to purchase it. In such cases, the customer can cancel the registration of the product by operating their mobile terminal, and return the deregistered product to its original display location, such as a display shelf. However, there are cases in which the customer fails to properly follow the procedure for canceling the product registration. If the procedure for canceling the product registration is not properly followed, the product registration results will not match the details of the product reserved by the customer, which will hinder smooth checkout. The present invention has been made in consideration of the above circumstances, and aims to enable customers to properly carry out procedures for canceling product registration in a product sales data processing system in which customers register products using a terminal device.

[0172] [Means for solving the problem] (1) As described above, one aspect of this embodiment is a product sales data processing system (e.g., a shopping system) in which a customer registers a product using a mobile terminal device (e.g., customer terminal device 50), and is equipped with a detection means for detecting the removal of a product from a product insertion section (e.g., a shopping cart) into which the product reserved by the customer is inserted, and a notification means for notifying the customer of the cancellation of the registration of a registered product (e.g., a non-reservation re-guidance screen WD50, a registration cancellation operation guidance screen WD60) based on the detection result by the detection means.

[0173] According to the above configuration, a notification is issued depending on whether or not it is detected that a product has been removed from the shopping cart, and the customer can be guided to take appropriate action to cancel the registration of a registered product. This allows the customer to properly perform the procedure for canceling the registration of a product in a shopping system in which the customer registers products using the customer terminal device 50.

[0174] (2) One aspect of this embodiment is the product sales data processing system described in (1), in which the notification means issues a notification to guide the customer to return the deregistered product to a non-secured state when a certain period of time has passed since the customer canceled the registration of the registered product through a registration cancellation operation without the detection means detecting the product being removed.

[0175] According to the above configuration, if the customer does not return the target product to a non-secured state even after a certain time has passed since the registration cancellation operation was performed, the customer is guided to return the target product to a non-secured state, and the customer can properly carry out the procedure for canceling the product registration.

[0176] (3) One aspect of this embodiment is a product sales data processing system as described in (1) or (2), wherein the notification means issues a notification to guide the user to perform a registration cancellation operation corresponding to the product detected as having been removed from the product insertion section if a registration cancellation operation is not performed within a certain period of time after the detection means detects that the product has been removed.

[0177] According to the above configuration, if the customer does not perform the registration cancellation operation even after a certain time has passed since the product in question was returned to the non-secured state, the customer is guided to perform the registration cancellation operation, and the customer can appropriately perform the procedure for canceling the product registration.

[0178] (4) One aspect of this embodiment is a product sales data processing system described in any one of (1) to (3), which includes a server device equipped with the detection means, and the detection means acquires predetermined detection information indicating a change in response to the removal of a product from the product insertion section, and detects the removal of a product from the product insertion section based on the acquired detection information.

[0179] According to the above configuration, the server device in the shopping system detects when an item is removed from a shopping cart, enabling highly accurate detection results to be obtained through advanced processing. Also, since the customer terminal device 50 does not need to perform processing to detect when an item is removed, the processing load on the customer terminal device 50 is reduced, enabling the operation of the customer terminal device 50 during product registration to be made smoother.

[0180] (5) One aspect of this embodiment is a mobile terminal device used by a customer to register a product, which is equipped with a detection means for detecting the removal of a product from a product insertion section where the product secured by the customer is inserted, and a notification means for notifying the customer regarding the cancellation of the registration of a registered product based on the detection result by the detection means.

[0181] In addition, programs for implementing the functions of the store controller 10, checkout device 40, customer terminal device 50, transaction management device 60, transaction status management device 80, etc. described in each of the above embodiments may be recorded on a computer-readable recording medium, and the programs may be loaded into a computer system and executed to perform the functions of the store controller 10, checkout device 40, customer terminal device 50, transaction management device 60, transaction status management device 80, etc. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" herein includes hardware such as an operating system and peripheral devices. Furthermore, the term "computer system" may include multiple computer devices connected via a network, including communication lines such as the Internet, a WAN, a LAN, or a dedicated line. Furthermore, the term "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, as well as storage devices such as a hard disk built into a computer system. In this way, the recording medium storing the program may also be a non-transitory recording medium such as a CD-ROM. The term "recording medium" also includes internal or external recording media accessible from a distribution server for distributing the program. The program code stored on the distribution server's recording medium may be different from the program code in a format executable by a terminal device. In other words, the format in which the program is stored on the distribution server is not important as long as it can be downloaded from the distribution server and installed in a format executable by a terminal device. The program may be divided into multiple parts, downloaded at different times, and then combined on a terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be for implementing part of the functions described above.Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program). [Explanation of symbols]

[0182] 10 store controller, 40 settlement device, 50 customer terminal device, 60 transaction management device, 70 credit card settlement server, 80 transaction status management device

Claims

1. a registration unit that registers products based on product information acquired in response to customer operations on a terminal device that moves around the store with the customer; a cancellation unit that cancels the registration of the target product among the registered products in response to a registration cancellation operation being performed on the terminal device; a display control unit that controls the display content of a display unit of the terminal device; Equipped with The display control unit Displaying a list of the products registered by the registration unit; In response to the cancellation of a product by the cancellation unit, the product whose registration has been cancelled is displayed in the list display in a manner that allows it to be distinguished from products whose registration has not been cancelled, and a first guide image that guides the user to return the cancelled product to a non-secured state is displayed in a position in the list display where the cancelled product can be distinguished. A product sales data processing system.

2. The registration unit registering the product based on the product information captured by the imaging unit of the terminal device; The display control unit a first display area for displaying the list and a second display area for displaying the captured image captured by the imaging unit; The first guide image is displayed superimposed on the captured image at a position that overlaps at least the second display area.

2. The product sales data processing system according to claim 1.

3. The terminal device or the server device has a detection unit that detects the removal of a product from a product insertion unit into which the product secured by the customer is inserted, The display control unit When the detection unit detects that a product has been removed and the product has not been canceled by the cancellation unit, a second guide image that guides the user to perform the registration cancellation operation for the removed product is displayed superimposed on the captured image at a position that overlaps at least the second display area.

3. The product sales data processing system according to claim 2.

4. A terminal device that moves around the store together with a customer, a registration unit that registers products based on product information acquired in response to customer operations; a cancellation unit that cancels the registration of the target product among the registered products in response to a registration cancellation operation being performed on the terminal device; a display control unit that controls the display content of a display unit of the terminal device; Equipped with The display control unit Displaying a list of the products registered by the registration unit; In response to the cancellation of a product by the cancellation unit, the product whose registration has been cancelled is displayed in the list display in a manner that allows it to be distinguished from products whose registration has not been cancelled, and a first guide image that guides the user to return the cancelled product to a non-secured state is displayed in a position in the list display where the cancelled product can be distinguished. A terminal device characterized by:

5. A computer as a terminal device that moves around the store with customers. a registration unit that registers products based on product information acquired in response to customer operations; a cancellation unit that cancels the registration of the relevant product among the registered products in response to a registration cancellation operation being performed on the terminal device; a display control unit that controls the display content of a display unit of the terminal device; A program for functioning as The display control unit Displaying a list of the products registered by the registration unit; In response to the cancellation of a product by the cancellation unit, the product whose registration has been cancelled is displayed in the list display in a manner that allows it to be distinguished from products whose registration has not been cancelled, and a first guide image that guides the user to return the cancelled product to a non-secured state is displayed in a position in the list display where the cancelled product can be distinguished. program.

Images