Information processing system

Abstract

Reduce inappropriate product registrations by customers. [Solution] The information processing system comprises a comparison unit and a notification processing unit. The comparison unit acquires comparison information between registered products based on product registration and detected products detected based on images captured by a camera, based on an instruction to terminate product registration or an instruction regarding accounting after product registration. The notification processing unit executes processing to output a notification based on the comparison information.

Description

Technical Field

[0001] Embodiments of the present invention relate to an information processing system.

Background Art

[0002] Recently, due to labor shortages and soaring labor costs, self-checkout systems in which customers themselves perform product registration and accounting have become widespread.

[0003] On the other hand, since a self-checkout system is a system in which customers themselves perform product registration and accounting, many inappropriate product registrations such as scanning omissions or fraudulent acts occur. Among them, in particular, when a scanning omission or a fraudulent act occurs with high-value products, the impact on the profit and loss of the store is significant.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the embodiments of the present invention is to provide a technique for reducing inappropriate product registration by customers.

Means for Solving the Problems

[0006] In one embodiment, an information processing system includes a comparison unit and a notification processing unit. The comparison unit obtains comparison information between registered products based on the product registration and detected products detected based on a captured image acquired by a camera, based on an instruction for ending the product registration or an instruction regarding accounting after the product registration. The notification processing unit executes a process for outputting a notification based on the comparison information.

Brief Description of the Drawings

[0007] [Figure 1] Figure 1 is a block diagram illustrating an information processing system according to an embodiment. [Figure 2] Figure 2 is a diagram illustrating the shooting range of the camera according to the embodiment. [Figure 3] Figure 3 is a block diagram illustrating a POS terminal according to the embodiment. [Figure 4] Figure 4 shows an example of the configuration of a product master according to the embodiment. [Figure 5] Figure 5 shows an example of the configuration of registration information according to the embodiment. [Figure 6] Figure 6 is a block diagram illustrating a detection terminal according to the embodiment. [Figure 7] Figure 7 shows an example of the configuration of specific product information according to the embodiment. [Figure 8] Figure 8 shows an example of the configuration of detection information according to the embodiment. [Figure 9] Figure 9 is a block diagram illustrating an attendant terminal according to an embodiment. [Figure 10] Figure 10 is an example of a product registration screen displayed on the display device of a POS terminal according to the embodiment. [Figure 11] Figure 11 is a diagram illustrating an alert screen displayed on the display device of a POS terminal according to the embodiment. [Figure 12] Figure 12 is a sequence diagram showing an example of processing in the information processing system according to the embodiment. [Modes for carrying out the invention]

[0008] Several embodiments will be described below with reference to the drawings. Note that the scale of the parts in the drawings used in the following description of embodiments may have been changed as appropriate. Also, for illustrative purposes, some components may be omitted from the drawings used in the following description of embodiments.

[0009] <Embodiment> (Example configuration) Figure 1 is a block diagram illustrating an information processing system S. Information processing system S is a system that communicates between multiple devices and processes information about transactions at a store. For example, the store is a mass retailer such as a supermarket, but is not limited to this. A transaction is the transfer of fees from the customer to the store in connection with the sale of goods by the store. From the store's perspective, a transaction includes the meaning of selling goods. From the customer's perspective, a transaction includes the meaning of purchasing goods. Goods include not only physical objects but also non-tangible objects such as services or tickets. Unless otherwise specified, the term "transaction" refers to a single transaction. Customer includes the meaning of user.

[0010] The information processing system S includes multiple POS (Point of Sales) terminals 1, multiple cameras 2, multiple display terminals 3, one detection terminal 4, one attendant terminal 5, and one storage device 6. The multiple POS terminals 1, multiple cameras 2, multiple display terminals 3, one detection terminal 4, one attendant terminal 5, and one storage device 6 are installed in the store.

[0011] Each device included in the information processing system S is connected to each other via a network NW, enabling communication. The network NW is a Local Area Network (LAN), etc. The LAN may be a wireless LAN or a wired LAN. Alternatively, devices may be connected to each other via USB (Universal Serial Bus) instead of a network NW.

[0012] Each store is equipped with a set consisting of one POS terminal (1), one camera (2), and one display terminal (3). Alternatively, each store may be equipped with a set consisting of one POS terminal (1), multiple cameras (2), and one display terminal (3).

[0013] The information processing system S may include one POS terminal 1 instead of a plurality of them. In this case, the information processing system S may include one camera 2 and one display terminal 3 instead of a plurality of them. The information processing system S may include a plurality of detection terminals 4 instead of one. The information processing system S may include a plurality of attendant terminals 5 instead of one. The information processing system S may include a plurality of storage devices 6 instead of one. The information processing system S is an example of an information processing system including at least two devices.

[0014] The POS terminal 1 is a device that processes transactions in a store. Here, it is assumed that the POS terminal 1 has a product registration function and a settlement function, and is a POS terminal that constitutes a self-checkout system that enables a customer to perform product registration operations and settlement operations. The POS terminal 1 is an example of a transaction processing device. The transaction processing device is an example of an information processing device that processes information for transactions.

[0015] Product registration is the registration of products before the settlement of a transaction. The registered products are also referred to as registered goods. Settlement is the payment for a transaction after product registration. Settlement includes the meaning of payment. Settlement methods for transactions in accounting include offline settlement and online settlement.

[0016] Offline settlement is an accounting method that does not require the POS terminal 1 to cooperate with other devices via a network such as the Internet. For example, offline settlement is an accounting method using cash and vouchers. A voucher is a ticket that circulates in a form similar to cash currency. For example, vouchers include various types of vouchers such as gift certificates, gift vouchers, rice vouchers, beer vouchers, shareholder privilege vouchers, regional revitalization vouchers, and coupons, but are not limited to these. Note that vouchers include physical vouchers and digitized vouchers.

[0017] Online settlement is an accounting method that is executed in cooperation with other devices via a network such as the Internet by the POS terminal 1. For example, online settlement includes credit card settlement, electronic money settlement, debit card settlement, and code settlement.

[0018] Camera 2 is a device installed for a specific POS terminal 1 that acquires images of the shooting range based on the image being captured. Hereafter, images acquired based on the image being captured will also be referred to as captured images. The shooting range is the range associated with a specific POS terminal 1 that can be photographed for each product brought to the specific POS terminal 1 for transaction. Therefore, the products included in the captured images are the products that are subject to product registration. The shooting range is the area in the vicinity of the specific POS terminal 1. The term "neighborhood" includes the meaning of the surrounding area. For example, the area in the vicinity of a specific POS terminal 1 is the area that a customer operates on that specific POS terminal 1. For example, Camera 2 is an AI (Artificial Intelligence) camera. Camera 2 is an example of a shooting device that acquires captured images.

[0019] Display terminal 3 is a device that includes a display device and displays images for the customer. For example, the display device may be a liquid crystal display or an EL (electroluminescence) display. The display device of display terminal 3 is an example of a display unit for the customer.

[0020] The detection terminal 4 is a device that detects products based on images captured by one or more cameras 2. For example, the detection terminal 4 is an edge PC (Personal Computer). The detection terminal 4 is an example of an information processing device that processes information for transactions. Hereafter, products detected based on captured images will also be referred to as detected products. In this case, the detection terminal 4 is assumed to detect specific products from captured images.

[0021] A "specified product" is a specific product that has been designated as such. A specified product is one that, if removed from the store without being paid for due to improper registration such as a scanning error or fraudulent activity, would have a significant impact on the store's profit and loss. For example, a specified product might be a high-priced item.

[0022] A "specific product" can be a concrete product or a product category. Hereafter, a concrete product will also be referred to as the "first specific product," and a product category will also be referred to as the "second specific product."

[0023] The first type of specific product is one that can be identified by a single product code. A product code is a code that uniquely identifies a product. For example, a product code is a JAN (Japan Article Number) code. A product code is an example of product identification information that uniquely identifies a product.

[0024] The second specified product is a product that represents a product category encompassing multiple products that can be identified by multiple product codes. For example, a product category is a category that encompasses multiple products that are similar in appearance or characteristics. Examples of second specified products and product categories include, but are not limited to, melons, high-grade Wagyu beef, 6-pack alcoholic beverages, and large-sized products. A 6-pack alcoholic beverage may not distinguish between a 6-pack of low-malt beer and a 6-pack of regular beer. If the second specified product is melons, it may include not only melons from XX but also melons from another XX. If the second specified product is high-grade Wagyu beef, it may include not only Wagyu beef from XX but also Wagyu beef from another XX. If the second specified product is a 6-pack alcoholic beverage, it may include not only 6-pack alcoholic beverages from company XX but also 6-pack alcoholic beverages from another XX company. If the second specified product is a large-sized product, it may include not only one large-sized product but also other large-sized products.

[0025] Attendant terminal 5 is a device used by attendants. Attendant terminal 5 may be a dedicated device, or it may be a smartphone, tablet, or PC. Attendant terminal 5 is an example of an information processing device that processes information for transactions. The term "attendant" includes the meaning of a store employee.

[0026] Storage device 6 is a device that stores information. For example, storage device 6 is a NAS (Network Attached Storage), but is not limited to this. Storage device 6 may also be a device in a data center outside the store.

[0027] Figure 2 is a diagram illustrating the shooting range of camera 2 according to this embodiment. Camera 2 is positioned to photograph the vicinity of POS terminal 1. Camera 2 photographs product PA and product PB that customer C brings to POS terminal 1 for transaction. In this example, one camera 2 is positioned to photograph the vicinity of one POS terminal 1, but one or more cameras 2 may be positioned to photograph the vicinity of one POS terminal 1. The display terminal 3 is positioned in a location easily visible to customer C.

[0028] For example, suppose product PA is a specific product, and product PB is a product that is not a specific product. In this case, the detection terminal 4 will detect product PA based on images captured by one or more cameras 2, but will not detect product PB.

[0029] Figure 3 is a block diagram illustrating POS terminal 1. POS terminal 1 includes a processing circuit 10, main memory 11, storage 12, communication circuit 13, reading device 14, input device 15, display device 16, printing device 17, and change dispenser 18. The processing circuit 10, main memory 11, storage 12, communication circuit 13, reading device 14, input device 15, display device 16, printing device 17, and change dispenser 18 are connected to each other so that signals can be input and output.

[0030] The processing circuit 10 corresponds to the central part of the POS terminal 1. The processing circuit 10 is an element that constitutes the computer of the POS terminal 1. The processing circuit 10 includes one or more circuits that perform multiple processes with multiple functions. For example, the circuit is a processor, ASIC (Application Specific Integrated Circuit), or FPGA (Field-Programmable Gate Array), but is not limited to these. For example, the processor is a CPU (Central Processing Unit) or GPU (Graphics Processing Unit), but is not limited to these. The processing circuit 10 loads programs stored in the main memory 11 or storage 12 into the main memory 11. By executing the programs loaded into the main memory 11, the processing circuit 10 makes various processes executable.

[0031] The main memory 11 includes elements corresponding to the main memory portion of the POS terminal 1. The main memory 11 is an element that constitutes the computer of the POS terminal 1. The main memory 11 includes a non-volatile memory area and a volatile memory area. In the non-volatile memory area of ​​the main memory 11, the operating system or programs are stored. The main memory 11 uses the volatile memory area as a work area where data is rewritten as appropriate by the processing circuit 10. For example, the main memory 11 includes ROM (Read Only Memory) as a non-volatile memory area. For example, the main memory 11 includes RAM (Random Access Memory) as a volatile memory area. The main memory 11 is an example of the storage unit of the POS terminal 1.

[0032] Storage 12 corresponds to the auxiliary storage portion of POS terminal 1. Storage 12 includes one or more storage devices. For example, the storage device may be an HDD (Hard Disk Drive) or a semiconductor storage medium such as an SSD (Solid State Drive), and is not limited to these. Storage 12 stores the above-mentioned program, data used by the processing circuit 10 in performing various processes, and data generated by the processing in the processing circuit 10. Storage 12 is an example of the storage unit of POS terminal 1.

[0033] Storage 12 may include a product master storage area 121. The product master storage area 121 stores the product master. The product master includes information about each product sold in the store. The product information may include all or part of the identification information, product name, and price.

[0034] Product identification information may include product identification information about the product. Product identification information may also include category identification information about the product category to which the product belongs. Category identification information is identification information that uniquely identifies the product category. For example, category identification information may be a category code that uniquely identifies the product category. Category identification information may also be a flag that uniquely identifies the product category. Product name is the name of the product. Price is the unit price of the product. Unit price is the amount per item. Product information may include information other than this.

[0035] Storage 12 may include a registration information storage area 122. The registration information storage area 122 stores registration information. Registration information is information based on product registration in a transaction. Registration information is information organized based on a product master. For each registered product, registration information includes information about the registered product. Information about the registered product may include all or part of the identification information, product name, price, quantity, and product value.

[0036] Identification information for registered products may include product identification information for the registered products. Identification information for registered products may include category identification information for the product category to which the registered products belong. The product name for registered products is the name of the registered products. The price for registered products is the unit price for the registered products. The product value for registered products is the amount calculated based on the product of the price and the quantity. Information about registered products may include information other than this. Note that the registration information storage area 122 may be included in the main memory 11 instead of the storage 12.

[0037] The communication circuit 13 is a circuit that includes various interfaces for transmitting or receiving signals. The communication circuit 13 connects the POS terminal 1 to other devices via a network NW so that it can communicate with them.

[0038] The reading device 14 is a device that reads various code symbols. The reading device 14 may be a scanner that reads by sensing, or a camera that reads by taking a picture. For example, the code symbol may be a barcode symbol or a two-dimensional code symbol. The code symbol may also be a code symbol for a product that records product identification information. The product code symbol is an image attached to the product. The code symbol may also be a code symbol that records member identification information that can uniquely identify a customer as a member of the store. The code symbol that records member identification information may be an image attached to a membership card, or an image that can be displayed on a terminal. The code symbol may also be a code symbol for code payment. The code symbol may also be a code symbol that records attendant identification information that can uniquely identify an attendant. The code symbol that records attendant identification information may be an image attached to a card, or an image that can be displayed on a terminal. The reading device 14 is an example of the reading unit of the POS terminal 1.

[0039] The input device 15 is a device that can input instructions or information into the POS terminal 1. The input device 15 may include a keyboard. The input device 15 may also form a touchscreen together with the display device 16. The input device 15 is an example of the input section of the POS terminal 1.

[0040] The display device 16 is a device capable of displaying various images under the control of the processing circuit 10. For example, the display device 16 is a liquid crystal display or an EL display. The display device 16 is an example of the display unit of the POS terminal 1. The display unit of the POS terminal 1 is an example of a display unit for customers.

[0041] The printing device 17 is a device for issuing printed materials by printing on a medium. For example, the medium is paper. For example, the printing device 17 is a thermal printer or an inkjet printer, etc., but is not limited to these. The printing device 17 is an example of the printing unit of the POS terminal 1.

[0042] The change dispenser 18 is a device capable of inserting and dispensing cash used in accounting transactions.

[0043] The hardware configuration of POS terminal 1 is not limited to the configuration described above. POS terminal 1 allows for the omission and modification of the above-described components, as well as the addition of new components, as appropriate.

[0044] The various parts implemented by the processing circuit 10 will now be described. The processing circuit 10 implements a registration processing unit 101, an accounting processing unit 102, a communication processing unit 103, a reception unit 104, a comparison unit 105, and a notification processing unit 106. Each part implemented by the processing circuit 10 can also be described as a function.

[0045] The registration processing unit 101 processes product registration in a transaction. For example, processing product registration involves updating registration information. Updating registration information includes adding information about registered products, increasing the quantity included in the information about registered products, decreasing the quantity included in the information about registered products, and deleting information about registered products.

[0046] The accounting processing unit 102 processes the accounting for a transaction to settle the accounting amount. The accounting amount is the amount necessary to complete the transaction. For example, the accounting amount is the total amount of the transaction after the completion of product registration. The total amount of the transaction is the amount determined based on the sum of the product amounts for each registered product. Processing the accounting includes completing the accounting. Completion of accounting includes the meaning of completing the transaction.

[0047] The communication processing unit 103 processes the reception and transmission of signals via the communication circuit 13.

[0048] The reception unit 104 receives instructions or information entered by the customer into the POS terminal 1 using the input device 15. Receiving instructions or information includes obtaining instructions or information.

[0049] The comparison unit 105 acquires comparison information between all registered products in a transaction and all detected products in a transaction, based on instructions entered by the customer. All registered products in a transaction are one or more registered products based on product registration in the transaction. All detected products in a transaction are one or more detected products in a transaction detected based on images captured by one or more cameras 2. The comparison information is information of the comparison result based on the comparison between all registered products in a transaction and all detected products in a transaction. Hereinafter, the comparison between all registered products in a transaction and all detected products in a transaction will also be referred to as the comparison between registered products and detected products. The comparison result is either the first case or the second case. The first case is that at least one of the detected products in the transaction is not included in all registered products in the transaction. The second case is that all detected products in the transaction are included in all registered products in the transaction.

[0050] The instructions entered by the customer are either registration completion instructions or accounting instructions. A registration completion instruction is an instruction to end product registration. A registration completion instruction includes the meaning of an instruction to end product registration and start the accounting operation. Accounting instructions are instructions regarding accounting after product registration. Accounting instructions may also be instructions for selecting an accounting method. Accounting instructions may also be instructions for settling the accounting amount using the selected accounting method. Accounting instructions may also be other instructions. If POS terminal 1 is a type that requires a registration completion instruction, accounting instructions are instructions entered after product registration and after the registration completion instruction. If POS terminal 1 is a type that does not require a registration completion instruction, accounting instructions are instructions entered after product registration.

[0051] The notification processing unit 106 executes processing to output a notification based on the comparison information. The notification output is described as a display of the notification, but it may also be an audio output of the notification.

[0052] The notification is an alert regarding unregistered goods. Unregistered goods are goods that are not registered at the time of entering a registration termination instruction or accounting instruction. For example, unregistered goods are detected goods that are not included in all registered goods in the transaction. The notification may include information about the presence of unregistered goods. Information about the presence of unregistered goods is information that makes it possible to recognize the presence of unregistered goods. Information that makes it possible to recognize the presence of unregistered goods may be information indicating the presence of unregistered goods, or information indicating a check for the absence of unregistered goods. Information about the presence of unregistered goods may be text, an image, or other types of information. The notification may include information indicating unregistered goods. Information indicating unregistered goods is information that makes it possible to recognize unregistered goods. Information that makes it possible to recognize unregistered goods may be information indicating the product name of the unregistered goods. Information indicating unregistered goods may be text, an image, or other types of information.

[0053] Figure 4 shows an example of the configuration of the product master stored in the product master storage area 121. The product master contains information about each product sold in the store. As described above, this product information may include all or part of the identification information, product name, and price.

[0054] Figure 5 shows an example of the configuration of registered information stored in the registered information storage area 122. The registration information includes information about each registered product. As described above, the information about the registered product may include all or part of the identification information, product name, price, quantity, and product value.

[0055] Figure 6 is a block diagram illustrating a detection terminal 4. The detection terminal 4 includes a processing circuit 40, a main memory 41, a storage 42, and a communication circuit 43. The processing circuit 40, the main memory 41, the storage 42, and the communication circuit 43 are connected to each other so that signals can be input and output.

[0056] The processing circuit 40 corresponds to the central part of the detection terminal 4. The processing circuit 40 is an element that constitutes the computer of the detection terminal 4. The processing circuit 40 includes one or more circuits that perform multiple processes with multiple functions. The processing circuit 40 loads programs stored in the main memory 41 or storage 42 into the main memory 41. By executing the programs loaded into the main memory 41, the processing circuit 40 makes various processes executable.

[0057] The main memory 41 includes elements corresponding to the main memory portion of the detection terminal 4. The main memory 41 is an element that constitutes the computer of the detection terminal 4. The main memory 41 may be configured in the same way as the main memory 11 described above. The main memory 41 is an example of the storage unit of the detection terminal 4.

[0058] Storage 42 corresponds to the auxiliary storage portion of the detection terminal 4. Storage 42 includes one or more storage devices. Storage 42 stores the above-mentioned program, data used by the processing circuit 40 in performing various processes, and data generated by the processing in the processing circuit 40. Storage 42 is an example of the storage unit of the detection terminal 4.

[0059] The storage 42 may include a specific product information storage area 421. The specific product information storage area 421 stores specific product information. The specific product information includes information about each specific product. The information about the specific product may include the product name, image information, and identification information.

[0060] The product name for a specific product is the name of that specific product. If the specific product is the first specific product, the product name for that specific product is the name of the first specific product. If the specific product is the second specific product, the product name for that specific product is the name of the product category that represents the second specific product.

[0061] Image information relating to a specific product is information about images used to detect that specific product. The images used to detect a specific product are images that show the characteristics of that specific product. If the specific product is the first specific product, the identification information relating to the specific product may include product identification information for the first specific product. If the specific product is the second specific product, the identification information relating to the specific product may include category identification information for the product category that represents the second specific product. Information relating to a specific product may also include information other than this.

[0062] The storage 42 may include a detection information storage area 422. The detection information storage area 422 stores detection information. The detection information is information based on images captured by one or more cameras 2. The detection information is information composed of specific product information. For each detection ID, the detection information includes information about the detected product. The detection ID is an ID assigned to each detected product. Even if multiple detected products represent the same specific product, different detection IDs are assigned to them. The information about the detected product may include the product name and identification information.

[0063] The product name for a detected product is the name of the specific product that corresponds to the detected product. If the detected product is the first specific product, the product name for the detected product is the name of the first specific product. If the detected product is the second specific product, the product name for the specific product is the name of the product category that represents the second specific product.

[0064] The identification information for the detected product is the identification information for the specific product corresponding to the detected product. If the detected product is a first specific product, the identification information for the detected product may include product identification information for the first specific product. If the detected product is a second specific product, the identification information for the detected product may include category identification information for the product category representing the second specific product. The information regarding the detected product may also include information other than this. Note that the detection information storage area 422 may be located in the main memory 41 instead of the storage 42.

[0065] The communication circuit 43 is a circuit that includes various interfaces for transmitting or receiving signals. The communication circuit 43 connects the detection terminal 4 to other devices via a network NW so that it can communicate with them.

[0066] The hardware configuration of the detection terminal 4 is not limited to the configuration described above. The detection terminal 4 may be modified or have its components omitted or changed as needed, and new components added as appropriate.

[0067] The various parts realized by the processing circuit 40 will now be described. The processing circuit 40 implements the communication processing unit 401 and the detection processing unit 402. Each part implemented by the processing circuit 40 can also be described as a function. The communication processing unit 401 processes the reception and transmission of signals via the communication circuit 43. The detection processing unit 402 detects products based on images captured by one or more cameras 2.

[0068] Figure 7 shows an example of the configuration of specific product information stored in the specific product information storage area 421. Product information includes information about each specific product. As mentioned above, product information may include product name, image information, and identification information.

[0069] Figure 8 shows an example of the configuration of detection information stored in the detection information storage area 422. The detection information includes information about the detected product for each detection ID. As mentioned above, the information about the detected product may include the product name and identification information.

[0070] Figure 9 is a block diagram illustrating attendant terminal 5. The attendant terminal 5 includes a processing circuit 50, main memory 51, storage 52, communication circuit 53, input device 54, and display device 55. The processing circuit 50, main memory 51, storage 52, communication circuit 53, input device 54, and display device 55 are connected to each other so that signals can be input and output.

[0071] The processing circuit 50 corresponds to the central part of the attendant terminal 5. The processing circuit 50 is an element that constitutes the computer of the attendant terminal 5. The processing circuit 50 includes one or more circuits that perform multiple processes with multiple functions. The processing circuit 50 loads programs stored in the main memory 51 or storage 52 into the main memory 51. By executing the programs loaded into the main memory 51, the processing circuit 50 makes various processes executable.

[0072] The main memory 51 includes elements corresponding to the main memory portion of the attendant terminal 5. The main memory 51 is an element that constitutes the computer of the attendant terminal 5. The main memory 51 may be configured in the same way as the main memory 11 described above. The main memory 51 is an example of the storage unit of the attendant terminal 5.

[0073] Storage 52 corresponds to the auxiliary storage portion of the attendant terminal 5. Storage 52 includes one or more storage devices. Storage 52 stores the above-mentioned program, data used by the processing circuit 50 in performing various processes, and data generated by the processing in the processing circuit 50. Storage 52 is an example of the storage unit of the attendant terminal 5.

[0074] The communication circuit 53 is a circuit that includes various interfaces for transmitting or receiving signals. The communication circuit 53 connects the attendant terminal 5 to other devices via a network NW so that it can communicate with them.

[0075] The input device 54 is a device that can input instructions or information to the attendant terminal 5. The input device 54 may include a keyboard. The input device 54 may also form a touchscreen together with the display device 55. The input device 54 is an example of the input section of the attendant terminal 5.

[0076] The display device 55 is a device capable of displaying various images under the control of the processing circuit 50. For example, the display device 55 is a liquid crystal display or an EL display. The display device 55 is an example of the display unit of the attendant terminal 5. The display unit of the attendant terminal 5 is an example of a display unit for attendants.

[0077] The hardware configuration of the attendant terminal 5 is not limited to the configuration described above. The attendant terminal 5 may be modified or have its components omitted or changed as appropriate, and new components added as needed.

[0078] The various parts realized by the processing circuit 50 will now be described. The processing circuit 50 implements the communication processing unit 501 and the output processing unit 502. Each part implemented by the processing circuit 50 can also be described as a function. The communication processing unit 501 processes the reception and transmission of signals via the communication circuit 53. The output processing unit 502 executes processing to output information. While this explanation assumes the information is displayed, it may also be output as audio.

[0079] (Example display) Figure 10 is an example of the product registration screen IA displayed on the display device 16 of the POS terminal 1. The product registration screen (IA) is an image that displays information based on product registration.

[0080] The product registration screen IA includes the registered product display area AAA. The registered product display area AAA is the area that displays the product name, quantity, and price for each registered product. The product registration screen IA also includes the total amount display area AAB. The total amount display area AAB is the area that displays the total amount of the transaction.

[0081] The product registration screen IA displays a "Subtotal" button BA that can be selected using the input device 15. The "Subtotal" button BA is a button that allows the user to input a registration completion instruction.

[0082] Figure 11 is an example of the alert screen IB displayed on the display device 16 of the POS terminal 1. The alert screen IB is an image that displays a notification. The alert screen IB can also be a pop-up.

[0083] The alert screen IB includes a notification display area A and B. The notification display area A and B is the area where notifications are displayed. The notification includes the string "Do you have any unregistered products?" as information about the presence of unregistered products. The notification may include information indicating the unregistered products, either in lieu of or along with the information about the presence of unregistered products.

[0084] The alert screen IB displays a "Close" button BB that can be selected using the input device 15. The "Close" button BB is a button that allows input of instructions to dismiss the alert screen IB.

[0085] Furthermore, the alert screen IB does not need to display the "Close" button BB. In this case, the alert screen IB cannot be dismissed by the customer, but can only be dismissed based on an action taken by the attendant.

[0086] (Example of processing) This section describes the processing in the information processing system S. The processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, depending on the embodiment, steps in the processing procedure described below may be omitted, replaced, or added as appropriate.

[0087] Figure 12 is a sequence diagram showing an example of processing in the information processing system S. Here, the customer will operate POS terminal 1 for the transaction.

[0088] The processing circuit 10 of the POS terminal 1 transmits information indicating the start of product registration in a transaction (ACT1). ACT1 may also be processed by the communication processing unit 103. The product registration start information is information indicating the start of product registration by the customer. In ACT1, for example, the processing circuit 10 detects the start of product registration based on instructions or information entered by the customer through an arbitrary operation. The processing circuit 10 may also detect the start of product registration based on a product registration start instruction entered by the customer using the input device 15. The processing circuit 10 may also detect the start of product registration based on product identification information entered by the customer using the reading device 14. The processing circuit 10 may also detect the start of product registration based on member identification information entered by the customer using the reading device 14. Based on the detection of the start of product registration, the processing circuit 10 transmits the product registration start information to the detection terminal 4 via the network NW.

[0089] The product registration start information is an example of a trigger that initiates product detection by the detection terminal 4 after the customer has started product registration. The trigger for initiating detection can be any signal sent from the POS terminal 1 to the detection terminal 4 after the customer has started product registration.

[0090] The processing circuit 40 of the detection terminal 4 receives product registration start information (ACT11). ACT11 may also be processed by the communication processing unit 401. The processing circuit 10 receives product registration start information from the POS terminal 1 via the network NW.

[0091] The processing circuit 40 of the detection terminal 4 starts detecting products based on images captured by one or more cameras 2 (ACT12). ACT12 may also be processed by the detection processing unit 402. In ACT12, for example, the processing circuit 40 starts detecting products based on product registration start information. The timing at which the processing circuit 40 starts detecting products based on product registration start information is the first timing based on the customer's start of product registration.

[0092] The processing circuit 40 of the detection terminal 4 detects products based on images captured by one or more cameras 2 (ACT12). ACT12 may also be processed by the detection processing unit 402. In ACT12, for example, the processing circuit 40 refers to the image information for each specific product included in the specific product information and detects products from the captured images. The processing circuit 40 may detect products before registration or products that have been registered. Based on product detection, the processing circuit 10 assigns a detection ID to the detected product. The processing circuit 10 refers to the specific product information and stores information about the detected product in the detection information storage area 422, associating it with the detection ID.

[0093] Here, the processing circuit 40 detects a specific product from the captured image. Therefore, the detected product is a specific product. As a result, the processing circuit 40 does not need to detect all products included in the captured image, thus reducing the processing load.

[0094] The processing circuit 40 can transmit information about the detected product to the attendant terminal 5 via the network NW each time a product is detected. This processing may also be performed by the communication processing unit 401. As a result, the detection terminal 4 can notify the attendant terminal 4 that a specific product has been detected each time that product is detected.

[0095] The processing circuit 50 of the attendant terminal 5 receives information about the detected product (ACT21). ACT21 may also be processed by the communication processing unit 501. In ACT21, for example, the processing circuit 50 receives information about the detected product from the detection terminal 4 via the network NW.

[0096] The processing circuit 50 of the attendant terminal 5 performs processing to display the detected product based on the information regarding the detected product (ACT22). ACT22 may also be performed by the output processing unit 502. In ACT22, for example, the processing circuit 50 displays the name of the specific product corresponding to the detected product on the display device 55, based on the product name included in the information regarding the detected product. This allows the attendant terminal 5 to notify that a specific product has been detected each time that product is detected.

[0097] The processing circuit 10 of the POS terminal 1 processes product registration in a transaction (ACT2). ACT2 may also be processed by the registration processing unit 101. In ACT2, for example, the processing circuit 10 obtains product identification information about a product based on product identification information entered using the reading device 14. The processing circuit 10 may also obtain product identification information about a product based on a product selection instruction entered using the input device 15. The processing circuit 10 can refer to the product master stored in the product master storage area 121 and process product registration based on the obtained product identification information.

[0098] The processing circuit 10 of the POS terminal 1 receives a registration completion instruction entered by the customer using the input device 15 (ACT3). ACT3 may also be processed by the reception unit 104. In ACT3, for example, the processing circuit 10 receives a registration completion instruction entered based on the customer's selection of the "Subtotal" button BA.

[0099] The processing circuit 10 of POS terminal 1 transmits product registration completion information (ACT4). ACT4 may also be processed by the communication processing unit 103. Product registration completion information is information indicating that the customer has completed product registration. In ACT4, for example, the processing circuit 10 detects the completion of product registration based on a registration completion instruction entered by the customer using the input device 15. Based on the detection of product registration completion, the processing circuit 10 transmits product registration completion information to the detection terminal 4 via the network NW.

[0100] The product registration completion information is an example of a trigger for the detection terminal 4 to terminate product detection after the customer has finished registering the product. The trigger for terminating detection can be any signal sent from the POS terminal 1 to the detection terminal 4 after the customer has finished registering the product.

[0101] The processing circuit 40 of the detection terminal 4 receives product registration completion information (ACT14). ACT14 may also be processed by the communication processing unit 401. The processing circuit 40 receives product registration completion information from the POS terminal 1 via the network NW.

[0102] The processing circuit 40 of the detection terminal 4 terminates product detection based on images captured by one or more cameras 2 (ACT 15). ACT 15 may also be processed by the detection processing unit 402. In ACT 15, for example, the processing circuit 40 terminates product detection based on product registration completion information. The timing at which the processing circuit 40 terminates product detection based on product registration completion information is the second timing based on the registration completion instruction.

[0103] In this way, the processing circuit 40 detects products based on multiple captured images that make up a video acquired by one or more cameras 2 between the first timing and the second timing. Therefore, all detected products in a transaction are products detected between the first timing and the second timing. As a result, the detection terminal 4 can continuously detect products for a certain period of time, thereby improving the accuracy of product detection.

[0104] The processing circuit 40 of the detection terminal 4 transmits comparison detection information (ACT16). ACT16 may also be processed by the communication processing unit 401. The comparison detection information is detection information for all detected products in the transaction. The comparison detection information includes information about all detected products in the transaction. In ACT16, the processing circuit 40 transmits the comparison detection information to the POS terminal 1 via the network NW.

[0105] The processing circuit 10 of POS terminal 1 receives comparison detection information (ACT5). ACT5 may also be processed by the communication processing unit 103. In ACT5, for example, the processing circuit 10 receives comparison detection information from the detection terminal 4 via the network NW.

[0106] The processing circuit 10 of the POS terminal 1 acquires comparison information (ACT6) based on the registration completion instruction. ACT6 may also be processed by the comparison unit 105. In ACT6, for example, the processing circuit 10 acquires comparison registration information from the registration information storage area 122. The comparison registration information is registration information for all registered products in the transaction. The comparison registration information includes information about registered products for all registered products in the transaction. The processing circuit 10 compares the comparison registration information with the comparison detection information. Here, the processing circuit 10 compares the identification information for each registered product included in the comparison registration information with the identification information for each detected product included in the comparison detection information. By comparing the comparison registration information with the comparison detection information, the processing circuit 10 can compare registered products with detected products. The processing circuit 10 acquires comparison information based on the comparison between registered products and detected products.

[0107] The processing circuit 10 of the POS terminal 1 determines whether there are any unregistered products based on the comparison information (ACT7). ACT7 may also be processed by the comparison unit 105. In ACT7, for example, if the comparison result indicated by the comparison information is the first case, the processing circuit 10 determines that there are unregistered products. The first case, from the perspective of identification information, means that at least one of the identification pieces of each detected product included in the comparison detection information is not included in the comparison registration information. From the perspective of identification information, an unregistered product can also be defined as a detected product identified by an identification piece of each detected product included in the comparison detection information that is not included in the comparison registration information.

[0108] If the comparison result shown in the comparison information is the second case, the processing circuit 10 determines that there are no unregistered products. In the second case, from the perspective of identification information, the identification information for each detected product included in the comparison detection information is included in the comparison registration information.

[0109] This section explains an example of how to determine if there are unregistered products. In the first example, we will explain that all detected products in a transaction are one detected product corresponding to the second specific product, "Melon." In this example, the comparative detection information includes information about the detected product for one detected product corresponding to the second specific product, "Melon." The information about the detected product includes category identification information for the product category "Melon."

[0110] First, all registered products in a transaction are assumed to include registered products belonging to the product category "Melon". The comparison registration information includes information about registered products belonging to the product category "Melon". The information about registered products includes category identification information for the product category "Melon". In this case, the category identification information for the product category "Melon" included in the comparison detection information is included in the comparison registration information. Therefore, the one detection product corresponding to the second specific product "Melon" is included in all registered products in the transaction. Consequently, the processing circuit 10 determines that there are no unregistered products.

[0111] Next, assume that none of the registered products in the transaction belong to the product category "Melon". The information about any of the registered products does not include category identification information for the product category "Melon". In this case, the category identification information for the product category "Melon" included in the comparative detection information is not included in the comparative registration information. Therefore, the one detected product corresponding to the second specific product "Melon" is not included in all of the registered products in the transaction. Consequently, the processing circuit 10 determines that there is an unregistered product. The unregistered product is the one detected product corresponding to the second specific product "Melon".

[0112] In the second example, we will explain that all detected products in a transaction are two detected products corresponding to the second specific product, "Melon." In this example, the comparative detection information includes information about each of the two detected products corresponding to the second specific product, "Melon." The information about the detected product includes category identification information for the product category "Melon."

[0113] First, assume that all registered products in a transaction include two registered products belonging to the product category "Melon". The comparison registration information includes category identification information for the product category "Melon" for the two registered products belonging to the product category "Melon". In this case, the category identification information for the product category "Melon" included in the comparison detection information is also included in the comparison registration information for the two registered products. Therefore, the two detection products corresponding to the second specific product "Melon" are included in all registered products in the transaction. Consequently, the processing circuit 10 determines that there are no unregistered products.

[0114] Next, assume that all registered products in a transaction include one registered product belonging to the product category "Melon". The comparison registration information includes category identification information for the product category "Melon" for the one registered product belonging to the product category "Melon". In this case, the category identification information for the product category "Melon" included in the comparison detection information is included in the comparison registration information for only one registered product. Therefore, one of the two detection products corresponding to the second specific product "Melon" is not included in all registered products in the transaction. Accordingly, the processing circuit 10 determines that there is an unregistered product. The unregistered product is the one detection product corresponding to the second specific product "Melon".

[0115] If there are unregistered products (ACT7, YES), the process transitions from ACT7 to ACT8. If there are no unregistered products (ACT7, NO), the process transitions from ACT7 to ACT10.

[0116] The processing circuit 10 of the POS terminal 1 executes a process to display a notification based on the comparison information (ACT8). ACT8 may also be the processing performed by the notification processing unit 106. In ACT8, for example, if the comparison result indicated by the comparison information is the first case, the processing circuit 10 executes a process to display a notification.

[0117] The processing circuit 10 can perform processing to display a notification on the display device 16. In this example, the processing circuit 10 displays the notification on the display device 16, as shown in the alert screen IB. This allows the POS terminal 1 to alert the customer about unregistered products. The POS terminal 1 can prevent unregistered products from being taken out of the store without being paid for by issuing this alert.

[0118] The processing circuit 10 may, instead of displaying the notification on the display device 16, perform processing to display the notification on the display device of the display terminal 3. In this example, the processing circuit 10 sends notification information to the display terminal 3 to display the notification on the display device of the display terminal 3. The notification information may include instructions to display the notification. The notification information may also include information indicating the content of the notification. This allows the POS terminal 1 to alert the customer to unregistered products. The display terminal 3 displays the notification on its display device based on the notification information.

[0119] The processing circuit 10 can perform processing to display a notification on the display device 55 of the attendant terminal 5. In this example, the processing circuit 10 sends notification information to the attendant terminal 5 via the network NW to display the notification on the display device 55 of the attendant terminal 5. This allows the POS terminal 1 to notify the attendant in real time that there are unregistered items. The attendant can then take action to prevent unregistered items from being taken out of the store without being paid for.

[0120] The processing circuit 50 of the attendant terminal 5 receives notification information (ACT23). ACT23 may also be processed by the communication processing unit 501. In ACT23, for example, the processing circuit 50 receives notification information from the POS terminal 1 via the network NW.

[0121] The processing circuit 50 of the attendant terminal 5 performs processing to display the notification based on the notification information (ACT24). ACT24 may also be performed by the output processing unit 502. In ACT24, for example, the processing circuit 50 displays the notification on the display device 55 based on the notification information.

[0122] The processing circuit 10 of the POS terminal 1 can transmit log information to the storage device 6 via the network NW. The log information may include registration information for comparison. The log information may also include detection information for comparison. The storage device 6 stores the log information (ACT 31). This allows the attendant to check the status of product registration performed by the customer by reviewing the log information later.

[0123] The processing circuit 10 of the POS terminal 1 determines whether to return to product registration after executing the processing for displaying the notification (ACT9). In ACT9, for example, the processing circuit 10 may determine to return to product registration based on the instruction to return to product registration entered by the customer using the input device 15. If the system returns to product registration (ACT9, YES), the process transitions from ACT9 to ACT1. If the system does not return to product registration (ACT9, NO), the process transitions from ACT9 to ACT10.

[0124] The processing circuit 10 of the POS terminal 1 processes the accounting for the transaction (ACT10). ACT10 may also be processed by the accounting processing unit 102.

[0125] In ACT8, the processing circuit 10 of the POS terminal 1 may change whether or not it performs processing to display a notification on the display device 16 based on the number of unregistered products. In this example, if the number of unregistered products is one or more and less than the threshold, the processing circuit 10 does not perform processing to display a notification on the display device 16. If the number of unregistered products is equal to or greater than the threshold, the processing circuit 10 performs processing to display a notification on the display device 16. The threshold is a number of two or more that can be set as appropriate. Similarly, the processing circuit 10 may change whether or not it performs processing to display a notification on the display device of the display terminal 3 based on the number of unregistered products. This allows the POS terminal 1 to control whether or not to display a notification, taking into account the risk of false detection of unregistered products.

[0126] In ACT6, the processing circuit 10 of the POS terminal 1 may acquire comparison information based on a checkout instruction instead of a registration completion instruction. In this example, in ACT3, the processing circuit 10 receives a checkout instruction entered by the customer using the input device 15. In ACT4, the processing circuit 10 transmits product registration completion information to the detection terminal 4 based on the detection of the checkout instruction entered by the customer using the input device 15. Here, since the checkout instruction is entered after product registration, it can be said that product registration by the customer is completed at the time the checkout instruction is entered. In ACT15, the timing at which the processing circuit 40 ends product detection based on the product registration completion information is the second timing based on the checkout instruction.

[0127] In this example, the processing circuit 10 of POS terminal 1 executes a process to display a notification after an accounting instruction is entered. Therefore, the notification may be displayed on the display device 16 or the display device of the display terminal 3 after the accounting process by the processing circuit 10. In this case, after confirming the notification, the customer can voluntarily start registering the unregistered product as a new transaction. The attendant may also start registering the unregistered product as a new transaction on behalf of the customer.

[0128] In the example described above, the processing circuit 10 starts comparing registered products and detected products based on a registration completion instruction or accounting instruction, and acquires comparison information based on the comparison, but is not limited to this. The processing circuit 10 may start comparing registered products and detected products before a registration completion instruction or accounting instruction, and acquire comparison information based on a registration completion instruction or accounting instruction. In this example, the processing circuit 10 receives information about detected products from the detection terminal 4 each time a product is detected by the detection terminal 4. The processing circuit 10 starts comparing registered products and detected products after product registration has started and performs the comparison between registered products and detected products in real time during product registration. The processing circuit 10 stores the comparison results for each comparison in the main memory 11 or storage 12. The processing circuit 10 finishes comparing registered products and detected products based on a registration completion instruction or accounting instruction. The processing circuit 10 acquires comparison information based on the comparison.

[0129] As described above, POS terminal 1 can acquire comparison information based on a registration completion instruction or an accounting instruction. Based on the comparison information, POS terminal 1 can execute processing to output a notification. Unregistered items at the time of inputting a registration completion instruction or payment instruction are highly likely to be taken from the store without being paid for. POS terminal 1 can appropriately determine whether there are unregistered items by acquiring comparison information based on the registration completion instruction or payment instruction. This allows POS terminal 1 to reduce inappropriate product registration by customers. Furthermore, POS terminal 1 only needs to use detected items based on captured images, eliminating the need for complex systems such as detecting customer behavior. Moreover, POS terminal 1 only executes the process to output notifications after a registration completion instruction or payment instruction has been input. Therefore, customers do not receive multiple notifications during a single transaction, thus not compromising customer convenience.

[0130] (modified version) The comparison unit 105 and notification processing unit 106, which are implemented by the processing circuit 10 of the POS terminal 1, may also be implemented by the processing circuit 40 of the detection terminal 4.

[0131] The comparison unit implemented by the processing circuit 40 acquires comparison information based on instructions entered by the customer, similar to the comparison unit 105. For example, the processing circuit 40 receives product registration completion information from the POS terminal 1. The processing circuit 40 acquires comparison information based on the product registration completion information. The product registration completion information is information transmitted from the POS terminal 1 to the detection terminal 4 based on a registration completion instruction or accounting instruction entered by the customer using the input device 15. Therefore, processing based on product registration completion information can be said to be processing based on a registration completion instruction or accounting instruction.

[0132] The processing circuit 40 may start comparing the registered product with the detected product based on the product registration completion information and acquire comparison information based on the comparison. In this example, the processing circuit 40 receives the comparison registration information from the POS terminal 1 via the network NW. The processing circuit 40 may also receive the comparison registration information from the POS terminal 1 at the same time as receiving the product registration completion information from the POS terminal 1.

[0133] The processing circuit 40 may start comparing the registered product with the detected product before receiving the product registration completion information, and acquire comparison information based on the product registration completion information. In this example, the processing circuit 40 receives information about the registered product from the POS terminal 1 each time a product is registered by the POS terminal 1. The processing circuit 40 starts comparing the registered product with the detected product after the start of product registration and performs the comparison between the registered product and the detected product in real time during product registration. The processing circuit 40 stores the comparison results for each comparison in the main memory 41 or storage 42. The processing circuit 40 finishes comparing the registered product with the detected product based on the product registration completion information. The processing circuit 40 acquires comparison information based on the comparison.

[0134] The notification processing unit implemented by the processing circuit 40, like the notification processing unit 106, performs processing to output a notification based on comparison information. The processing circuit 40 can perform processing to display the notification on the display device 16 of the POS terminal 1. In this example, the processing circuit 40 sends notification information to the POS terminal 1 for display on the display device 16 of the POS terminal 1. The processing circuit 10 of the POS terminal 1 displays the notification on the display device 16 based on the notification information. The processing circuit 40 can perform processing to display the notification on the display device of the display terminal 3. In this example, the processing circuit 40 sends notification information to the display terminal 3 for display on the display device of the display terminal 3. The display terminal 3 displays the notification on the display device based on the notification information. The processing circuit 40 can perform processing to display the notification on the display device 55 of the attendant terminal 5. In this example, the processing circuit 40 sends notification information to the attendant terminal 5 via the network NW for display on the display device 55 of the attendant terminal 5. The processing circuit 50 of the attendant terminal 5 displays the notification on the display device 55 based on the notification information.

[0135] The comparison unit 105 and notification processing unit 106, which are implemented by the processing circuit 10 of the POS terminal 1, may also be implemented by the processing circuit 50 of the attendant terminal 5.

[0136] The comparison unit implemented by the processing circuit 50 acquires comparison information based on instructions entered by the customer, similar to the comparison unit 105. For example, the processing circuit 50 receives product registration completion information from the POS terminal 1. The processing circuit 50 acquires comparison information based on the product registration completion information. The processing based on the product registration completion information can be described as processing based on a registration completion instruction or an accounting instruction, as described above.

[0137] The processing circuit 50 may start comparing the registered product and the detected product based on the product registration completion information, and acquire comparison information based on the comparison. In this example, the processing circuit 50 receives the comparison registration information from the POS terminal 1 via the network NW. The processing circuit 50 may also receive information about the registered product from the POS terminal 1 each time a product is registered by the POS terminal 1. The processing circuit 50 may also receive the comparison registration information from the POS terminal 1 at the same time as receiving the product registration completion information from the POS terminal 1. The processing circuit 50 receives the comparison detection information from the detection terminal 4 via the network NW. The processing circuit 50 may also receive information about the detected product from the detection terminal 4 each time a product is detected by the detection terminal 4. The processing circuit 50 may also receive the comparison detection information that the detection terminal 4 transmits based on the product registration completion information from the detection terminal 4.

[0138] The processing circuit 50 may start comparing the registered product with the detected product before receiving the product registration completion information, and may acquire comparison information based on the product registration completion information. In this example, the processing circuit 50 receives information about the registered product from the POS terminal 1 each time a product is registered by the POS terminal 1. The processing circuit 50 may also receive information about the detected product from the detection terminal 4 each time a product is detected by the detection terminal 4. The processing circuit 50 starts comparing the registered product with the detected product after the start of product registration, and performs the comparison between the registered product and the detected product in real time during product registration. The processing circuit 50 stores the comparison results for each comparison in the main memory 51 or storage 52. The processing circuit 50 finishes comparing the registered product with the detected product based on the product registration completion information. The processing circuit 50 acquires comparison information based on the comparison.

[0139] The notification processing unit implemented by the processing circuit 50, like the notification processing unit 106, executes processing to output a notification based on comparison information. The processing circuit 50 can execute processing to display the notification on the display device 16 of the POS terminal 1. In this example, the processing circuit 50 sends notification information to the POS terminal 1 for display on the display device 16 of the POS terminal 1. The processing circuit 10 of the POS terminal 1 displays the notification on the display device 16 based on the notification information. The processing circuit 50 can execute processing to display the notification on the display device of the display terminal 3. In this example, the processing circuit 50 sends notification information to the display terminal 3 for display on the display device of the display terminal 3. The display terminal 3 displays the notification on the display device based on the notification information. The processing circuit 50 can execute processing to display the notification on the display device 55 of the attendant terminal 5. In this example, the processing circuit 50 displays the notification on the display device 55.

[0140] <Other Embodiments> In the above-described embodiment, an example was given in which the detection terminal 4 detects a specific product from a captured image, but the invention is not limited to this. The detection terminal 4 may also be configured to detect all products included in the captured image, rather than being limited to a specific product.

[0141] In the above-described embodiment, a POS terminal 1 capable of performing product registration and payment operations was explained as an example of a transaction processing device, but it is not limited to this. The transaction processing device may be separate from the device on which the customer can perform payment operations, and may be a device on which the customer can perform product registration operations. In this example, the device on which the customer can perform product registration operations may be a portable device that constitutes a self-checkout system. The portable device may be a dedicated terminal mounted on a shopping cart, a portable terminal prepared in advance by the store, etc., or a portable terminal owned by the customer themselves.

[0142] Each component implemented by the processing circuit 10 described in the above-described embodiment may be implemented by a server capable of communicating with the POS terminal 1. In this case, the server is an example of a transaction processing device.

[0143] The multiple devices included in the information processing system S described in the above-described embodiment may be configured as a single unit.

[0144] Each component implemented by the processing circuit 10 described in the above-described embodiment is not limited to being implemented in a single device such as the POS terminal 1. Each component may be implemented in an information processing system distributed across multiple devices.

[0145] The embodiments described above may be applied to a single device. The embodiments described above may be applied to a method performed by one or more devices. The embodiments described above may be applied to a program that can cause computers in one or more devices to perform each function. The embodiments described above may be applied to a recording medium that stores the program.

[0146] Each of the one or more circuits that make up a processing circuit performs one or more of the multiple processes. If the processing circuit consists of a single circuit, the single circuit performs all of the multiple processes. If the processing circuit consists of multiple circuits, each of the multiple circuits performs some of the multiple processes. Some of the multiple processes may be one of the multiple processes, or two or more of the multiple processes. If the processing circuit consists of multiple circuits, the multiple circuits may be contained in a single device, or they may be distributed across multiple devices.

[0147] The program may be transferred while stored in the device according to the embodiment, or it may be transferred without being stored in the device. In the latter case, the program may be transferred via a network, or it may be transferred while recorded on a recording medium. The recording medium is a non-temporary tangible medium. The recording medium is a computer-readable medium. The recording medium may be any medium that is capable of storing a program and is readable by a computer, such as a CD-ROM or memory card, and its form is not limited.

[0148] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents.

[0149] Some of the embodiments described above may be expressed as follows: (1) A comparison unit that acquires comparative information between registered products based on the product registration and detected products detected based on images captured by a camera, based on instructions to terminate product registration or instructions regarding accounting after the product registration. A notification processing unit that performs processing to output a notification based on the aforementioned comparison information, An information processing system equipped with the following features. (2) The information processing system described in (1), wherein the detected product is a specific product that has been set. (3) If at least one of the detected products is not included in the registered products, the notification processing unit performs processing to output a notification, as described in (1) or (2). (4) The notification processing unit is an information processing system according to any one of (1) to (3) that performs processing for outputting a notification on a customer display unit. (5) The information processing system according to any one of (1) to (4), wherein the detected goods are goods detected between a first timing based on the commencement of goods registration and a second timing based on an instruction to terminate goods registration or an instruction relating to accounting. [Explanation of Symbols]

[0150] 1...POS terminal, 2...camera, 3...display terminal, 4...detection terminal, 5...attendant terminal, 6...storage device, 10...processing circuit, 11...main memory, 12...storage, 13...communication circuit, 14...reading device, 15...input device, 16...display device, 17...printing device, 18...change dispenser, 40...processing circuit, 41...main memory, 42...storage, 43...communication circuit, 50...processing circuit, 51...main memory, 52...storage, 53...communication circuit, 54...input device, 55...display device, 101...registration processing unit, 102...accounting processing unit, 103 ...Communication processing unit, 104...Reception unit, 105...Comparison unit, 106...Notification processing unit, 121...Product master storage area, 122...Registered information storage area, 401...Communication processing unit, 402...Detection processing unit, 421...Specific product information storage area, 422...Detection information storage area, 501...Communication processing unit, 502...Output processing unit, AAA...Registered product display area, AAB...Total amount display area, AB...Notification display area, BA..."Subtotal" button, BB..."Close" button, C...Customer, IA...Product registration screen, IB...Alert screen, NW...Network, PA...Product, PB...Product, S...Information processing system.

Claims

1. A comparison unit acquires comparative information between registered products based on the product registration and detected products based on images captured by a camera, based on instructions to terminate product registration or instructions regarding accounting after the product registration. A notification processing unit that performs processing to output a notification based on the aforementioned comparison information, An information processing system equipped with the following features.

2. The information processing system according to claim 1, wherein the detected product is a specific product that has been set.

3. The information processing system according to claim 1, wherein if at least one of the detected products is not included in the registered products, the notification processing unit performs processing to output a notification.

4. The information processing system according to claim 1, wherein the notification processing unit performs processing for outputting a notification on a customer display unit.

5. The information processing system according to claim 1, wherein the detected product is a product detected between a first timing based on the commencement of product registration and a second timing based on an instruction to terminate product registration or an instruction relating to accounting.

Images