Commodity sales data processing device and program

Abstract

To perform transaction smoothly.SOLUTION: Detection means of a commodity sales data processing device detects a commodity existing in a reading region where an identifier attached to a commodity is readable. Commodity registration means registers commodity information based on the identifier read in the reading region. Imaging information acquisition means acquires imaging information including a captured image of identifier reading operation done by a customer in the reading region. Display control means displays a commodity list image based on the commodity information registered by the commodity registration means and a captured image based on the imaging information acquired by the imaging information acquisition means on display means. The display control means displays the list image and the captured image on different display regions when the commodity information is registered by the commodity registration means when the commodity is detected by the detection means, and performs superimposed display in which the captured image is superimposed on the commodity list image when the commodity information is not registered by the commodity registration means although the commodity was detected by the detection means.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to a product sales data processing device and a program. [Background technology]

[0002] Conventionally, in various stores such as supermarkets and convenience stores, transactions are carried out using POS (Point Of Sales) terminals. The POS terminals perform product registration and payment processes. In addition to POS terminals in which a store clerk registers products and performs payment, there are also so-called self-checkouts that customers operate themselves to register products and perform payment (see, for example, Patent Document 1). Each self-checkout is equipped with a monitoring terminal that displays the operating status of each self-checkout, and a store clerk is stationed at the monitoring terminal to monitor the operation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 10-069574 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with conventional technology, the salesperson at the monitoring terminal must perform various tasks, such as assisting customers with operations, performing recovery work, and monitoring for fraud, which can increase the salesperson's workload. Furthermore, if multiple self-checkouts require operational assistance at the same time, one customer may have to wait. Therefore, conventional technology has the problem of preventing transactions from being carried out smoothly.

[0005] The present invention has been made in view of the above circumstances, and its purpose is to provide a technology that enables transactions to be carried out smoothly at self-checkout registers. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, one aspect of the present invention is a product sales data processing device comprising: a detection means for detecting products present in an identifier reading area; a product registration means for registering product information based on the identifier read in the reading area; an image information acquisition means for acquiring image information capturing an image of a customer reading the identifier in the reading area; and a display control means for causing a display means to display a product list image based on the product information registered by the product registration means and an image based on the image information acquired by the image information acquisition means, wherein when a product is detected by the detection means and product information is registered by the product registration means, the display control means displays the product list image and the image in separate display areas; and when a product is detected by the detection means but product information is not registered by the product registration means, the display control means displays the image in a superimposed manner on the product list image. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a network configuration diagram of a POS (Point Of Sales) system according to an embodiment of the present invention. [Figure 2] FIG. 2 is an explanatory diagram showing an example of installation of a POS terminal device 20. [Figure 3] FIG. 2 is a block diagram showing the hardware configuration of the POS terminal device 20. [Figure 4] FIG. 4 is an explanatory diagram showing an example of a reading area 400 of a scanner unit 206. [Figure 5] 10 is a flowchart showing an example of a display control process for a captured image performed by the POS terminal device 20. [Figure 6] 10 is an explanatory diagram showing an example of screen transition relating to display control of a captured image displayed on the operation display unit 205. FIG. [Figure 7] 10 is an explanatory diagram showing an example of screen transition relating to display control of a captured image displayed on the operation display unit 205. FIG. [Figure 8]10 is a flowchart showing an example of a display control process for a captured image performed by the POS terminal device 20 according to the first modification. [Figure 9] 10 is an explanatory diagram showing an example of screen transitions according to Modification 1 displayed on the operation display unit 205. FIG. [Figure 10] 10 is an explanatory diagram showing an example of screen transitions according to Modification 2 displayed on the operation display unit 205. FIG. [Figure 11] FIG. 10 is an explanatory diagram showing an example of a screen according to Modification 4 displayed on the operation display unit 205. [Figure 12] FIG. 10 is an explanatory diagram showing an example of a screen according to Modification 5 that is displayed on the operation display unit 205. DETAILED DESCRIPTION OF THE INVENTION

[0008] (Embodiment) DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a network configuration diagram of a POS (Point Of Sales) system according to an embodiment of the present invention. The POS system 1 can be installed in a variety of stores, such as supermarkets, home improvement stores, convenience stores, and general merchandise stores. As shown in FIG. 1, the POS system 1 includes a store controller 10, a transaction status management device 11, and three POS terminal devices 20-1, 20-2, and 20-3. Hereinafter, when there is no need to distinguish between the POS terminal devices 20-1, 20-2, and 20-3, they will be collectively referred to as the POS terminal device 20.

[0009] Each device is a computer device equipped with a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a communication unit, etc. The devices are connected by wire or wirelessly via communication lines 55 such as a LAN (Local Area Network) or a WAN (Wide Area Network).

[0010] The store controller 10 stores various information necessary for transactions, such as a product master. The product master is a file that stores product information such as product identification information (e.g., JAN (Japanese Article Number) code), product name, and sales price for each product. The product master also includes product identification information, product name, and unit price of products that require weighing (products to be weighed). In addition to the product master, the store controller 10 also stores various information such as inventory status, sales history, and deposit and withdrawal records. The store controller 10 may also store customer membership information.

[0011] The transaction status management device 11 displays the status (processing status, etc.) of the POS terminal device 20 and controls the POS terminal device 20. In the POS system 1, a store clerk can be stationed at the transaction status management device 11 and monitor it. Various types of self-checkout registers, in which customers perform registration and settlement operations, are common in stores. Examples of self-checkout registers include semi-self-checkout registers, in which a store clerk performs registration operations and the customer performs settlement operations, full-self-checkout registers, and self-checkout registers using a mobile device, in which a customer performs registration operations using a mobile device and settlement operations at a settlement device. The transaction status management device 11 can monitor settlements at such self-checkout registers. In the case of a POS terminal device 20 in which a store clerk is involved (performing registration operations), the transaction status management device 11 may not monitor the registration side. In this case, the transaction status management device 11 may monitor only the settlement side, or may not monitor the settlement side either.

[0012] The POS terminal 20 is an example of a product sales data processing device. The POS terminal 20 is a cash register that executes a product registration process for registering products and a settlement process for settling payments. In the product registration process, registration information indicating the products to be purchased by the customer (hereinafter sometimes referred to as "purchased products") is generated. In the settlement process, the total price of the purchased products (hereinafter sometimes referred to as "purchase amount") is settled based on the registration information generated in the product registration process. The POS terminal 20 is a self-checkout that can perform the product registration process and the settlement process by customer operation. Note that although FIG. 1 shows multiple POS terminals 20, there may be only one.

[0013] The POS system 1 may also include a service counter terminal. The service counter terminal handles the shipping and return of products purchased by customers, the ordering of products, and the sale of gift certificates. For example, the service counter terminal receives and manages transaction information indicating the products and amounts for each transaction at each POS terminal device 20 from each POS terminal device 20. The service counter terminal may also manage the transaction status of each POS terminal device 20.

[0014] The POS system 1 may also include a mobile terminal. The mobile terminal is, for example, a terminal device such as a mobile phone, smartphone, or tablet device carried by a store clerk. The mobile terminal may be loaned to each store clerk or may be owned by each store clerk. In response to a call request from a POS terminal device 20 (including a service counter terminal), the mobile terminal notifies the request or receives the call.

[0015] (Example of installation of POS terminal device 20) Fig. 2 is an explanatory diagram showing an example of the installation of the POS terminal device 20. As shown in Fig. 2, a counter is placed on the right side of the POS terminal device 20 as seen by an operator. Although not shown in the figure, a counter may also be placed on the left side of the POS terminal device 20 in Fig. 2. In other words, counters may be placed on both sides of the POS terminal device 20. A shopping cart can be placed on the counter.

[0016] The POS terminal 20 also includes a sign pole 220. The sign pole 220 is installed facing upward and emits a predetermined lighting pattern, allowing even store clerks who are not near the POS terminal 20 to recognize the lighting pattern. Specifically, the sign pole 220 includes a light-emitting element such as a lamp or an LED (light emitting diode). The light-emitting element can be lit in a predetermined lighting pattern. The lighting pattern of the sign pole 220 indicates that the POS terminal 20 is in use or that a store clerk has been called.

[0017] (Configuration example of POS terminal device 20) Next, the configuration of the POS terminal device 20 will be described with reference to FIGS. Fig. 3 is a block diagram showing the hardware configuration of the POS terminal device 20. In Fig. 2 and Fig. 3, the same parts are denoted by the same reference numerals.

[0018] An example of the configuration of the POS terminal 20 shown in Fig. 3 will be described below with reference to Fig. 2. The POS terminal 20 includes a CPU 201, a ROM 202, a RAM 203, a hard disk 204, an operation display unit 205, a scanner unit 206, a card payment unit 208, a change dispenser 209, a printing unit 213, an audio output unit 214, a communication unit 215, and a camera 216. These units can communicate with each other via a bus.

[0019] The CPU 201 is a central processing unit that reads and executes various programs stored in the ROM 202 to control the operation of the POS terminal device 20. The various programs include a product sales data processing program according to this embodiment. The ROM 202 is a read-only memory that stores various programs and various other information used by the CPU 201.

[0020] The RAM 203 is a readable and writable memory that stores various information. For example, the RAM 203 stores information acquired from the outside (e.g., a product master acquired from the store controller 10) and information generated during processing. This information also includes payment information generated during a payment process for settling (paying for) registered products (purchased products).

[0021] The hard disk 204 stores various types of information. For example, the hard disk 204 stores imaging results (e.g., video) captured by the camera 216. For example, the hard disk 204 may store various programs, such as a product sales data processing program executed by the CPU 201, instead of the ROM 202. Furthermore, instead of the RAM 203, the hard disk 204 may store information acquired from an external source or information generated during processing.

[0022] The operation display unit 205 is a touch display (touch panel) that displays various information to the customer and receives various operation inputs from the customer.

[0023] When the scanner unit 206 detects an item (e.g., a product) within a predetermined reading area (see FIG. 4), the reading function is turned on and the scanner unit 206 optically reads various codes. The reading function is turned off when no more items are detected within the reading area. The various codes read by the scanner unit 206 include, for example, barcodes (product codes, etc.) attached to products and codes (barcodes, two-dimensional codes, etc.) printed on receipts (registered trademarks). The various codes also include codes (barcodes, two-dimensional codes, etc.) printed on gift certificates (gift certificates, coupons, complimentary coupons) and various cards (e.g., membership cards, point cards, etc.). The various codes also include store clerk codes attached to store clerk name tags.

[0024] Product registration includes registration by reading the barcode attached to the product as well as registration using a preset key. A preset key is a button corresponding to the product (a button for ordering the product) and is displayed on the operation display unit 205. Product registration is performed by operating (pressing) the preset key.

[0025] The card payment unit 208 is a payment mechanism that accepts various cards (credit cards, prepaid cards such as transportation IC cards, point cards, etc.). The card payment unit 208 is equipped with a card recognition unit (reading unit), a display unit, and an operation unit. The card recognition unit magnetically or electrically reads information from various cards. The read information is used to settle the purchase. The card recognition unit can also recognize information to be used in settling the current purchase, for example, when using points held on a point card. The card recognition unit can also recognize information that is not used in settling the current purchase, for example, when points are awarded to a point card. The card recognition unit can recognize contact cards (IC cards, magnetic cards) and contactless cards (IC cards).

[0026] The change machine 209 (cash settlement unit) is a cash settlement mechanism, and has an input port for banknotes and coins, and an output port for banknotes and coins. The change machine 209 has a sensor that detects banknotes and coins inserted into the input port. The sensor detects that banknotes and coins have been inserted into the input port, and detects the number of banknotes and coins by denomination. The change machine 209 calculates the amount inserted into the input port, calculates the change amount, which is the difference between the input amount and the purchase amount, and dispenses the change from the output port. The change machine 209 faces the operator and accepts various operations and cash insertions from customers.

[0027] The printing unit 213 issues various media (receipts, bills, etc.).

[0028] The audio output unit 214 outputs audio. For example, the audio output unit 214 outputs audio guidance, warning sounds, etc. The audio guidance and warning sounds are related to product registration and payment.

[0029] The communication unit 215 is an interface for transmitting and receiving information to and from other devices (the store controller 10, the transaction status management device 11, and other POS terminal devices 20).

[0030] Camera 216 is attached to the upper right of operation display unit 205. Camera 216 is a camera that continuously captures moving or still images. A CCD (charge coupled device) camera or a CMOS (complementary metal oxide semiconductor) camera can be used as camera 216. Camera 216 captures images of product registration operations and payment operations by a customer, as well as images of the products during the registration operations.

[0031] (Regarding the reading area 400 of the scanner unit 206) FIG. 4 is an explanatory diagram showing an example of a reading area 400 of the scanner unit 206. In FIG. 4, the reading area 400 is an area in which the identifier of a product can be read. The identifier is, for example, a barcode, but may also be a two-dimensional code. The scanner unit 206 reads the barcode of a product present in the reading area 400. The barcode is read using, for example, a laser method. However, the reading method is not limited to the laser method, and a CCD method or a pen method may also be used.

[0032] When a product is present within the reading area 400, the scanner unit 206 turns on its reading function. When the reading function is turned on, for example, a laser beam is directed at the label surface of the barcode, and the reflected light is read by a sensor. On the other hand, when a product is no longer present within the reading area 400, the reading function is turned off. When the reading function is turned off, the laser beam is no longer emitted and the sensor no longer reads.

[0033] (Functional Configuration of POS Terminal Device 20) In the POS system 1, for example, a store clerk is assigned to the transaction status management device 11, and the transaction status management device 11 monitors the transaction. The store clerk assigned to the transaction status management device 11 performs various tasks, such as assisting customers with their operations, performing recovery work, and monitoring for fraud. This can increase the burden on the store clerk, and if multiple POS terminal devices 20 require operational assistance at the same time, one of the customers may have to wait. This can sometimes prevent transactions from being carried out smoothly.

[0034] Therefore, the POS terminal device 20 according to this embodiment captures an image of the customer's operation related to product registration in the reading area 400 and controls the display of the captured image, thereby making it possible to prompt the customer to properly register products. The functional configuration of the POS terminal device 20 according to this embodiment will be described below.

[0035] The functional configuration of the POS terminal 20 will be described below. The POS terminal 20 includes a product registration unit, an image capture information acquisition unit, and a display control unit. Each unit is realized by the CPU 201. That is, the CPU 201 executes a product sales data processing program stored in the ROM 202, thereby realizing the function of each unit. The POS terminal 20 also includes a detection unit. The detection unit is realized by the scanner unit 206.

[0036] The detection unit detects an item (merchandise) present in the reading area 400. The detection unit is realized by, for example, the scanner unit 206, but may also be realized by the camera 216. That is, the camera 216 may detect an item present in the reading area 400. The detection unit may also be a dedicated device (for example, a proximity sensor) for detecting an item (merchandise) present in the reading area 400.

[0037] The product registration unit registers product information based on the barcode read by the scanner unit 206 in the reading area 400. Note that, hereinafter, reading by the scanner unit 206 may be referred to as scanning. The image information acquisition unit acquires image information obtained by capturing an image of a customer reading a barcode (scanning operation) in the reading area 400.

[0038] The display control unit causes the display unit to display a product list image and a captured image. The product list image is an image based on product information registered by the product registration unit. Specifically, the product list image is an image in which products are listed in a list, including product names and prices. The product list image may be an image displayed in a display area showing the registration details, or may be an image generated separately as an image different from the registration details and displayed in a display area different from the display area showing the registration details. When products are registered by the product registration unit, the products indicated by the registered product information are added to the product list image.

[0039] The captured image is an image based on the imaging information acquired by the imaging information acquisition unit. Specifically, the captured image is a real-time image showing the scanning operation. The display means is, for example, the operation display unit 205. Furthermore, the captured image is a moving image, but may also be a still image.

[0040] The display control unit simultaneously displays the product list image and the captured image on the operation display unit 205. Specifically, the display control unit displays the product list image in one area and the captured image in another area. This makes it possible to appeal to customers that an image was taken when the product was registered.

[0041] However, the display control unit does not have to simultaneously display the product list image and the captured image on the display unit. For example, the captured image may be displayed according to a setting. The setting for the captured image may be switched by an authorized operator (store clerk), or a switching button may be displayed on the product registration screen and operated by an unauthorized operator (customer). Furthermore, when the captured image is not to be displayed, the display control unit may display a text image that reads "Recording."

[0042] Camera 216 is on and captures an image of an area including reading area 400 even when the detection unit does not detect a commodity. The display control unit displays a real-time image captured by camera 216 even when the detection unit does not detect a commodity. However, the display control unit may be configured to display a real-time image captured by camera 216 when the detection unit detects a commodity. In this case, camera 216 may be configured to be turned on when the detection unit detects a commodity.

[0043] (About superimposed display) If the product registration unit fails to register product information despite the detection unit detecting the product, i.e., if the scanning operation fails, the display control unit performs a superimposed display in which the captured image is superimposed on the product list image. In the superimposed display, the captured image is displayed on top of the product list image, so that part or all of the product list image becomes invisible.

[0044] Furthermore, the display control unit enlarges the captured image in the superimposed display. The enlarged display means displaying the captured image larger than before the superimposed display, specifically, for example, displaying the captured image using more than half of the display area of the operation display unit 205. When the captured image is enlarged, the product list image becomes more difficult to view.

[0045] The display control unit also displays, in a superimposed display, the captured image captured when the product information was not registered. That is, the captured image displayed in the superimposed display is a recording of the image captured when the scanning operation failed. As described above, the captured image displayed when the superimposed display is not performed is a real-time image.

[0046] (How to cancel superimposed display) If the product information is registered by performing a scan operation again after the superimposed display, the display control unit cancels the superimposed display. Specifically, the scanner unit 206 can scan barcodes even when the superimposed display is performed. Specifically, the scanner unit 206 can detect items (products) present in the reading area 400 and scan barcodes even when the superimposed display is performed. If the product registration unit registers the product information by performing a scan operation again, the display control unit cancels the superimposed display and displays the product list image and the captured image in the original display area.

[0047] Furthermore, if the scanning operation fails, the notification unit issues a notification. The notification may be a notification indicating that the scanning operation has failed or a notification urging the user to perform the scanning operation again. The notification may be a display using the operation display unit 205 or a sound using the sound output unit 214.

[0048] (Example of Display Control Process of Captured Images Performed by POS Terminal Device 20) Next, the display control process of captured images performed by the POS terminal device 20 in this embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of the display control process of captured images performed by the POS terminal device 20. In Fig. 5, the POS terminal device 20 determines whether product registration has started (step S501). The POS terminal device 20 waits until product registration has started (step S501: NO). When product registration has started (step S501: YES), the POS terminal device 20 displays a product list image and the captured image in separate areas (step S502).

[0049] The POS terminal 20 then determines whether the scanner unit 206 has detected a commodity (article) within the reading area 400 (step S503). The POS terminal 20 waits until it detects a commodity within the reading area 400 (step S503: NO). If it detects a commodity within the reading area 400 (step S503: YES), the POS terminal 20 starts scanning the barcode with the scanner unit 206 (step S504).

[0050] Then, the POS terminal 20 determines whether the barcode has been successfully scanned (step S505). If the barcode has not been successfully scanned (step S505: NO), the POS terminal 20 determines whether a commodity has not been detected in the reading area 400 (step S506).

[0051] If the commodity in the reading area 400 is not undetected (step S506: NO), that is, if the scanner unit 206 has detected the commodity in the reading area 400, the POS terminal 20 returns to step S505. If the commodity in the reading area 400 is undetected (step S506: YES), the POS terminal 20 ends the scan (step S507). Then, the POS terminal 20 acquires image information captured by the camera 216 when the scan operation failed (step S508). The image information when the scan operation failed is specifically image information captured from the start of scanning in step S504 to the end of scanning in step S506.

[0052] Then, the POS terminal device 20 superimposes the captured image on the product list image (step S509). Next, the POS terminal device 20 issues a notification to prompt the user to perform another scan operation (step S510), and the process returns to step S503.

[0053] If the barcode is successfully scanned in step S505 (step S505: YES), the POS terminal 20 ends the scan (step S511). Then, the POS terminal 20 registers the product identified from the barcode (step S512). Then, the POS terminal 20 determines whether the captured image is being superimposed on the product list image (step S513).

[0054] If the superimposed display is not in progress (step S513: NO), the POS terminal device 20 proceeds to step S515. If the superimposed display is in progress (step S513: YES), the POS terminal device 20 cancels the superimposed display (step S514), i.e., displays the product list image and the captured image in separate areas. Then, the POS terminal device 20 determines whether the checkout start button has been pressed (step S515).

[0055] If the settlement start button is not pressed (step S515: NO), the POS terminal 20 returns to step S503. If the settlement start button is pressed (step S515: YES), the POS terminal 20 executes the settlement process (step S516) and ends the series of processes.

[0056] (Screen transitions related to display control of captured images) 6 and 7 are explanatory diagrams showing an example of screen transitions related to display control of captured images displayed on the operation display unit 205. FIG. 6(A) shows a product registration screen 600 displayed on the operation display unit 205. The product registration screen 600 includes a product list image 610 and a captured image 620. The product list image 610 and the captured image 620 are displayed in different display areas. In addition, on the product registration screen 600, the display area for the product list image 610 is larger than the display area for the captured image 620. The product registration screen also includes a preset key 630, a checkout start button 640, and a store clerk call button 650.

[0057] Product list image 610 shows a list of registered products. Product list image 610 shows the product name and price of each product. In the illustration, two products (tea and daifuku mochi) are shown to be registered. Captured image 620 is a real-time video captured by camera 216. In the illustration, the captured image shows the customer scanning the milk to register it. When the barcode attached to the milk is successfully scanned and the registration of the milk is completed, the screen transitions to product registration screen 660 shown in FIG. 6(B).

[0058] 6(B), product registration notification 670 indicates that milk has been registered. Furthermore, product list image 610 indicates that milk has been added, bringing the total number of registered products to three. In this way, the customer's scanning operation is constantly displayed on captured image 620, and the registered products are displayed on product list image 610.

[0059] Here, if scanning of the barcode attached to the milk fails on the product registration screen 600 of FIG. 6(A), the screen transitions to the superimposed screen 700 shown in FIG. 7(A). The superimposed screen 700 shown in FIG. 7(A) shows a screen in which a captured image 620 is displayed superimposed on a product list image 610. On the superimposed screen 700, the captured image 620 is an image (recorded) when the scanning operation fails. Specifically, the captured image 620 shows image information when the scanning operation to register milk fails. The same image is repeatedly displayed on the captured image 620. Furthermore, on the superimposed screen 700, the display area of the product list image 610 is almost hidden, and is smaller than the display area of the captured image 620.

[0060] Furthermore, the superimposed screen 700 displays a prompt notification 710 that prompts the user to perform another scan operation. If the user is successful in scanning the barcode attached to the milk by performing another scan operation, the superimposed screen 700 ends, and the screen transitions to the product registration screen 660 shown in Fig. 7(B). The product registration screen 660 shown in Fig. 7(B) is the same screen as the product registration screen 660 shown in Fig. 6(B). Furthermore, even if the user scans the barcode of a product other than milk by performing another scan operation, the superimposed screen 700 ends, and the screen transitions to the product registration screen 660 shown in Fig. 7(B).

[0061] The superimposed screen 700 of FIG. 7(A) also closes when the end button 720 is pressed. In this case, however, the screen returns to the product registration screen 600 of FIG. 6(A). The end button 720 may not be displayed on the superimposed screen 700. In other words, the superimposed screen 700 may not be closed in response to a customer operation. In other words, the condition for canceling the superimposed screen 700 may be that the product information is registered by another scan operation in response to a customer operation.

[0062] As described above, the POS terminal device 20 according to this embodiment displays a superimposed image (superimposed screen 700) of the captured image 620 on the product list image 610 when a product is detected in the reading area 400 but the product information is not registered. This allows the customer to focus on the captured image 620 when a scanning operation fails. Therefore, if a barcode scan fails, the customer can be prompted to rescan. Furthermore, if a customer intentionally commits fraud by failing to scan a barcode, the customer can be notified that they are being monitored, which can have a deterrent effect against fraud. This reduces the burden on the store clerk assigned to the transaction status management device 11 in assisting customers with operations and monitoring for fraud. Therefore, at self-checkouts, store clerks can efficiently assist customers, resulting in smoother transactions.

[0063] Furthermore, the POS terminal device 20 according to this embodiment is configured to enlarge the captured image 620 in the superimposed display, thereby drawing the customer's attention to the captured image 620 more.

[0064] Furthermore, the POS terminal device 20 according to this embodiment cancels the superimposed display when the customer scans the barcode and registers the product information. This allows the user to return to the original screen and register the product again if the barcode is successfully scanned.

[0065] Furthermore, the POS terminal device 20 according to this embodiment is configured to re-display the captured image that was displayed when product information was not registered in a superimposed display. This allows a recording of the scanning operation when a barcode scan fails to be displayed, thereby appealing to customers that the recording is being made. This improves the deterrent effect against fraud.

[0066] (Modification of the embodiment) Next, modified examples of the embodiment will be described. Note that in the following modified examples, the content explained in the above-mentioned embodiment will be omitted as appropriate. Furthermore, the following modified examples and the above-mentioned embodiment can be combined with each other.

[0067] (Variation 1) First, a first modification of the embodiment will be described. In the above-described embodiment, a configuration has been described in which the condition for canceling the superimposed display is that product information is registered by performing a scan again. In the first modification, in addition to or instead of this configuration, a configuration will be described in which the condition for canceling the superimposed display is that the product registered by performing a scan again matches the product captured when the scan failed.

[0068] In the first modification, the imaging information acquisition unit acquires first imaging information and second imaging information. The first imaging information is imaging information captured when product information is not registered, i.e., imaging information captured when a scanning operation fails. The second imaging information is imaging information captured when a scanning operation is attempted again, i.e., imaging information captured when the scanning operation is successful after the scanning operation is attempted again.

[0069] The display control unit cancels the superimposed display according to the similarity based on the first imaging information and the second imaging information. The similarity is obtained, for example, by image analysis of the image of the first imaging information and the image of the second imaging information. Here, the POS terminal device 20 according to the first modification includes a match determination unit. The match determination unit extracts images showing products from the first imaging information and the second imaging information, respectively. Furthermore, the match determination unit extracts feature amounts from each extracted image, compares the extracted feature amounts, and calculates the similarity between the two. The feature amounts include shape, pattern, and color.

[0070] The match determination unit determines that the products match when the calculated similarity is equal to or greater than a predetermined threshold, whereas the match determination unit determines that the products do not match (mismatch) when the calculated similarity is less than the predetermined threshold.

[0071] The display control unit cancels the superimposed display when the match determination unit determines a match, and continues the superimposed display when the match determination unit determines a mismatch. Furthermore, when the match determination results in a mismatch, the notification unit notifies the user of this fact.

[0072] Furthermore, if the result of the match determination indicates a match, the product registration unit registers the product information obtained by the second scan as is.On the other hand, if the result of the match determination indicates a mismatch, the product registration unit receives an instruction from the customer as to whether or not to register the product information obtained by the second scan, and registers the product information according to the received result.

[0073] It should be noted that the product match determination does not need to be performed precisely, and it is sufficient to be able to determine whether or not there is a rough match. For example, even if the feature is color only, it is possible to determine whether or not there is a rough match. Specifically, for example, it is possible to perform a match determination by comparing the color most frequently obtained from product images when the scanning operation has failed with the color most frequently obtained from product images when the scanning operation has been successful. In this way, if the match determination is performed using color only as the feature, the match determination can be simplified.

[0074] (Example of Display Control Process of Captured Images Performed by the POS Terminal Device 20 According to Modification 1) Next, a display control process for a captured image performed by the POS terminal device 20 according to Modification 1 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of a display control process for a captured image performed by the POS terminal device 20 according to Modification 1.

[0075] 8, the POS terminal 20 determines whether product registration has started (step S801). The POS terminal 20 waits until product registration starts (step S801: NO). When product registration starts (step S801: YES), the POS terminal 20 displays a product list image and a captured image in separate areas (step S802).

[0076] The POS terminal 20 then determines whether the scanner unit 206 has detected a commodity (article) within the reading area 400 (step S803). The POS terminal 20 waits until it detects a commodity within the reading area 400 (step S803: NO). If it detects a commodity within the reading area 400 (step S803: YES), the POS terminal 20 starts scanning the barcode with the scanner unit 206 (step S804).

[0077] Then, the POS terminal 20 determines whether the barcode has been successfully scanned (step S805). If the barcode has not been successfully scanned (step S805: NO), the POS terminal 20 determines whether a commodity has not been detected in the reading area 400 (step S806).

[0078] If the commodity in the reading area 400 is not undetected (step S806: NO), that is, if the scanner unit 206 has detected the commodity in the reading area 400, the POS terminal 20 returns to step S805. If the commodity in the reading area 400 is undetected (step S806: YES), the POS terminal 20 ends the scan (step S807). Then, the POS terminal 20 acquires imaging information (first imaging information) captured by the camera 216 when the scan operation failed (step S808). The first imaging information is specifically imaging information captured from the start of scanning in step S804 to the end of scanning in step S806.

[0079] The POS terminal 20 then superimposes the captured image on the product list image (step S809). Next, the POS terminal 20 issues a notification to prompt the user to perform another scan operation (step S810), and the process returns to step S803.

[0080] If the barcode is successfully scanned in step S805 (step S805: YES), the POS terminal 20 ends the scan (step S811). Then, the POS terminal 20 determines whether the captured image is being superimposed on the product list image (step S812).

[0081] If the superimposed display is not in progress (step S812: NO), the POS terminal 20 proceeds to step S819. If the superimposed display is in progress (step S812: YES), the POS terminal 20 acquires imaging information (second imaging information) captured by the camera 216 when the scanning operation was successful (step S813). Specifically, the second imaging information is imaging information captured from the start of scanning in step S804, through step S805: YES, to the end of scanning in step S811.

[0082] The POS terminal 20 then determines the degree of similarity based on the second imaging information acquired in step S813 and the first imaging information acquired in step S808 (step S814).The POS terminal 20 then determines whether the products match using the images of each product extracted from the first imaging information and the second imaging information (step S815).

[0083] If the products do not match (step S815: NO), the POS terminal 20 displays a confirmation screen and registers the product according to the customer's instructions (step S816). Note that the POS terminal 20 does not register the product depending on the customer's instructions. If the products match (step S815: YES), the POS terminal 20 registers the product identified by the barcode (step S817).

[0084] The POS terminal 20 then cancels the superimposed display (step S818), i.e., displays the product list image and the captured image in separate areas. The POS terminal 20 then determines whether the checkout start button has been pressed (step S819). If the checkout start button has not been pressed (step S819: NO), the POS terminal 20 returns to step S803. If the checkout start button has been pressed (step S819: YES), the POS terminal 20 executes the checkout process (step S820) and ends the series of processes.

[0085] (Screen transitions related to Modification 1) Next, Fig. 9 is an explanatory diagram showing an example of a screen transition according to Modification 1 displayed on the operation display unit 205. Fig. 9(A) shows a screen similar to the superimposed screen 700 shown in Fig. 7(A). The superimposed screen 700 in Fig. 9(A) shows image information when a scan operation for the product "Milk" has failed. If a second scan operation succeeds in scanning the barcode attached to the product "Coffee", the screen transitions to a confirmation screen 900 shown in Fig. 9(B).

[0086] The confirmation screen 900 displays a notification display 910. The notification display 910 indicates that the product "Milk" when the scanning operation fails is different from the product "Coffee" when the scanning operation is successful. The notification display 910 also includes a "Yes" button for accepting registration of the product and a "No" button for accepting not to register the product. When the "Yes" button is pressed, the product registration of coffee is completed, and the screen returns to the product registration screen. When the "No" button is pressed, the product registration of coffee is not performed, and the screen returns to the product registration screen. Note that if the barcode attached to the product "Milk" is successfully scanned by a second scanning operation on the superimposed screen 700 in FIG. 9(A), the screen transitions to the product registration screen 660 shown in FIG. 7(B).

[0087] According to the first modification, the superimposed display (superimposed screen 700) is canceled according to the degree of similarity based on the image information when a scan operation fails and the image information when a second scan operation is successful. This prevents the superimposed display from being canceled when the product scanned immediately before and the product scanned again are not the same, i.e., when a different product is scanned after a failed scan operation. This prevents a transaction from being completed without registering a product that failed to be scanned. This further improves the deterrent effect against fraudulent activities.

[0088] (Another aspect of Modification 1) Other aspects of the first modification will be described below. In the first modification, regardless of the result of the match determination, the customer may be asked whether or not the two products match, and the product information may be registered according to the result of the answer. For example, the POS terminal device 20 may notify the customer, "Is this the same product as before?" and accept "Yes" or "No" regardless of the result of the match determination. The POS terminal device 20 registers the product information if it accepts "Yes," and does not register the product information if it accepts "No." The POS terminal device 20 may also cancel the superimposed screen 700 after accepting "Yes" or "No."

[0089] Furthermore, the product registration unit may register the product information obtained by rescanning as is, regardless of the result of the match determination.

[0090] Furthermore, if the match determination indicates a mismatch, the superimposed screen 700 may not be released. The release may require confirmation from a store clerk. Specifically, confirmation from the store clerk means a release operation by the store clerk. For example, if the match determination indicates a mismatch, a store clerk may be called, and the customer may not be able to perform any operations until the store clerk performs a release operation. Note that if the customer is not able to perform any operations, the superimposed screen 700 may continue to display an image of the failed scan operation and may also display a message that a store clerk is being called.

[0091] The store clerk may be called by lighting up the sign pole 220 or by making an alarm sound. Alternatively, the transaction status management device 11 may issue the call. Furthermore, the store clerk may be able to cancel the call from the transaction status management device 11. In other words, the store clerk may be able to perform the cancellation operation remotely.

[0092] (Variation 2) Next, a second modification of the embodiment will be described. In the above-described embodiment, a case where a product with a barcode is registered has been described. In the second modification, in addition to or instead of such a configuration, a case where a product without a barcode is registered will be described. FIG. 10 is an explanatory diagram showing an example of a screen transition related to the second modification, which is displayed on the operation display unit 205.

[0093] Products without barcodes include, for example, vegetables, fruits, prepared foods, and fresh fish, and are registered using the preset key 630 (see FIG. 6(A)). Now, suppose that an operator (e.g., a customer) picks up a product without a barcode and places it in the reading area 400. In this case, the scanner unit 206 detects the presence of the product (e.g., a carrot). Since the product does not have a barcode, when the product leaves the reading area 400, the POS terminal device 20 determines that the scanning operation has failed. Therefore, as shown in FIG. 10(A), the captured image 620 shown on the superimposed screen 1000 displays an image (a recording of a carrot) of when the scanning operation failed.

[0094] In the second modification, as shown in Fig. 10(A), preset keys 1010 are displayed on an overlay screen 1000. The preset keys 1010 include buttons corresponding to, for example, vegetables, fruits, prepared dishes, fresh fish, etc. For example, when the preset key 1010 indicating vegetables is pressed, the screen transitions to the screen shown in Fig. 10(B).

[0095] 10(B) shows a product selection screen 1020 corresponding to the vegetable preset key 1010. The product selection screen 1020 includes a plurality of product selection buttons. When the button indicating "carrot" is selected from among the product selection buttons, product registration is completed, the superimposed screen 1000 is canceled, and the screen returns to the product registration screen.

[0096] According to the second modification, even if it is determined that the scanning operation of a product without a barcode has failed, the product can be easily registered using the preset key 1010. Furthermore, an image of the failed scanning operation is displayed in the captured image 620, which has the effect of deterring fraudulent acts against products without barcodes.

[0097] (Variation 3) Next, a third modification of the embodiment will be described. In the above-described embodiment, the captured image displayed in the superimposed display is the captured image (recorded) when the scanning operation fails. In the third modification, in addition to or instead of this configuration, a configuration will be described in which a real-time captured image is used as the captured image displayed in the superimposed display.

[0098] In Modification 3, a real-time image is simply displayed on the superimposed screen 700. Even in this case, the captured image 620 is displayed superimposed on the product list image 610, which can provide a fraud prevention effect. Furthermore, even if the captured image 620 is a real-time image on the superimposed screen 700, it can be enlarged to further emphasize that monitoring is being carried out. Furthermore, in Modification 3, there is no need to record the image, and therefore no need to provide a storage device or the like. This makes it possible to carry out smooth transactions with a simple configuration.

[0099] (Variation 4) Next, a fourth modification of the embodiment will be described. In the above-described embodiment, only the captured image (recorded image) when the scanning operation failed is used as the captured image displayed in the superimposed display. In the fourth modification, a configuration will be described in which the recorded image and a real-time captured image are used as the captured image displayed in the superimposed display.

[0100] In the fourth modification, a real-time image (an image at the time of the second scan operation) and a captured image (recorded image) when the scan operation fails are displayed side by side on the superimposed screen 700. These images are superimposed on the product list image.

[0101] (Example of a screen according to Modification 4) Fig. 11 is an explanatory diagram showing an example of a screen according to Modification 4 displayed on the operation display unit 205. In Fig. 11, an overlaid parallel screen 1100 shows a screen in which a captured image 620 is displayed superimposed on a product list image 610. The captured image 620 includes a first captured image 620a and a second captured image 620b. The first captured image 620a is an image (recorded) taken when a scanning operation fails, i.e., an image taken during the first scanning operation. The second captured image 620b is an image taken during a second scanning operation (real-time scanning operation), i.e., an image taken during the second scanning operation.

[0102] The condition for canceling the superimposed parallel screen 1100 is that product information is registered by another scan operation. That is, the superimposed parallel screen 1100 can be canceled even if the same product is not scanned. Also, an end button 720 (see FIG. 7(A)) may be displayed on the superimposed parallel screen 1100, so that the superimposed parallel screen 1100 can be canceled by pressing the end button.

[0103] As described above, in the fourth modification, the first captured image 620a and the second captured image 620b are displayed side by side. This allows the customer to easily recognize that the products targeted by the first and second scanning operations are different. This makes it possible to encourage the customer to rescan the same product.

[0104] Furthermore, a screen similar to the superimposed parallel screen 1100 is displayed not only on the POS terminal device 20 but also on the transaction status management device 11. This allows the store clerk at the transaction status management device 11 to easily understand that the products targeted by the first scanning operation and the second scanning operation are different.

[0105] Here, the store clerk performs various tasks (for example, spreading out and stacking the bags to make bundles of bags for easy use by customers, being called when customers purchase shopping bags, moving around multiple customers to assist them with operations, etc.), and therefore is often unable to stare at the transaction status management device 11.

[0106] According to the fourth modification, by displaying the superimposed parallel screen 1100 on the transaction status management device 11, it is possible to determine from the product's appearance (size, color, shape, etc.) whether the same item will be scanned or a different item will be scanned in a second scan operation. Furthermore, because the first captured image 620a and the second captured image 620b are displayed side by side, even if a store clerk is not near the transaction status management device 11 and is viewing the operation display unit 205 from a distance, it is easy to determine that a second scan operation is being performed. This allows the store clerk to quickly take action to prevent fraud.

[0107] (Variation 5) Next, a fifth modification of the embodiment will be described. In the fourth modification described above, a configuration is described in which a match determination is not performed between a captured image (recorded) when a scanning operation fails and a real-time captured image, which are displayed in a superimposed display. In the fifth modification, a configuration is described in which a match determination is performed between a captured image (recorded) when a scanning operation fails and a real-time captured image, which are displayed in a superimposed display.

[0108] In the fifth modification, the POS terminal device 20 includes a match determination unit. As described above, the match determination unit determines whether or not the products targeted by the scan operations match based on the image information captured when the scan operation failed and the image information captured in the second scan operation.

[0109] (Example of a screen according to Modification 5) Fig. 12 is an explanatory diagram showing an example of a screen according to Modification 5 displayed on the operation display unit 205. In Fig. 12, a superimposed parallel screen 1200 shows a screen in which the captured images 620 (first captured image 620a and second captured image 620b) are superimposed on the product list image 610. The superimposed parallel screen 1200 also includes a discrepancy notification 1210. The discrepancy notification 1210 is displayed when a mismatch is obtained in the match determination by the match determination unit.

[0110] The discrepancy notification 1210 is a notification that indicates that the match determination by the match determination unit has resulted in a mismatch and that a store clerk should be called. The background image of the discrepancy notification 1210 is displayed in a color different from that of a normal background image (see, for example, the superimposed parallel screen 1100 in FIG. 11). This allows the customer to rescan the same product and be prompted to register the product.

[0111] On the other hand, if the match determination unit determines that the two images match, the superimposed parallel screen 1200 is released. That is, the condition for releasing the superimposed parallel screen 1200 is that the product registered by a second scan operation matches the product captured when the scan operation failed.

[0112] According to the fifth modification, if a scanning operation fails and another product is scanned, the superimposed display can be prevented from being canceled. This prevents the transaction from being completed without registering the product for which the scanning operation failed. This further improves the deterrent effect against fraudulent activities.

[0113] The superimposed parallel screen 1200 is also displayed on the transaction status management device 11. This allows a store clerk at the transaction status management device 11 to easily understand that the products targeted by the first scanning operation and the second scanning operation are different. In particular, because the first captured image 620a and the second captured image 620b are displayed side by side and the background image of the discrepancy notification 1210 is displayed in a different display mode from the normal background image, even if there is no store clerk near the transaction status management device 11 and the store clerk is viewing the operation display unit 205 from a distance, the store clerk can easily understand that a second scanning operation is being performed. This allows the store clerk to quickly take action to prevent fraud.

[0114] The embodiments will be summarized below. [Name of invention] Product sales data processing device and program TECHNICAL FIELD The present invention relates to a product sales data processing device and a program. [Background technology] Conventionally, in various stores such as supermarkets and convenience stores, transactions are carried out using POS (Point Of Sales) terminals. The POS terminals perform product registration and payment processes. In addition to POS terminals in which a store clerk registers products and performs payment, there are also so-called self-checkouts that customers operate themselves to register products and perform payment (see, for example, Patent Document 1). Each self-checkout is equipped with a monitoring terminal that displays the operating status of each self-checkout, and a store clerk is stationed at the monitoring terminal to monitor the operation. [Prior art document] [Patent documents] [Patent Document 1] Japanese Patent Application Laid-Open No. 10-069574 [Summary of the Invention] [Problem to be solved by the invention] However, with conventional technology, the salesperson at the monitoring terminal must perform various tasks, such as assisting customers with operations, performing recovery work, and monitoring for fraud, which can increase the salesperson's workload. Furthermore, if multiple self-checkouts require operational assistance at the same time, one customer may have to wait. Therefore, conventional technology has the problem of preventing transactions from being carried out smoothly. The present invention has been made in view of the above circumstances, and its purpose is to provide a technology that enables transactions to be carried out smoothly at self-checkout registers.

[0115] [Means for solving the problem] (1) In order to solve the above-mentioned problems, a product sales data processing device according to one aspect of the present invention comprises a detection means for detecting products present in an identifier reading area, a product registration means for registering product information based on the identifier read in the reading area, an image information acquisition means for acquiring image information capturing an image of a customer reading the identifier in the reading area, and a display control means for causing a display means to display a product list image based on the product information registered by the product registration means and an image based on the image information acquired by the image information acquisition means, wherein when a product is detected by the detection means and product information is registered by the product registration means, the display control means displays the product list image and the image in separate display areas, and when a product is detected by the detection means but product information is not registered by the product registration means, the product sales data processing device is characterized in that it displays the image in a superimposed manner on the product list image. According to the above configuration, when a scanning operation fails, the customer can be directed to the captured image 620. Therefore, when a barcode scan fails, the customer can be prompted to rescan. Furthermore, for customers who intentionally fail to scan a barcode, the system can convey that the system is monitoring them, which can have a deterrent effect on fraud. This reduces the burden on the store clerk assigned to the transaction status management device 11 in assisting customers with operations and monitoring for fraud. Therefore, at self-checkout registers, the store clerk can efficiently assist customers, allowing transactions to be carried out smoothly.

[0116] (2) In the configuration of (1) above, the display control means may be configured to enlarge the captured image in the superimposed display compared to the captured image when the product list image and the captured image are displayed in separate display areas. According to the above configuration, the captured image 620 can be more easily noticed by customers.

[0117] (3) In the configuration of (1) or (2) above, the display control means may cancel the superimposed display when product information is registered by performing a reading operation after the superimposed display is performed. According to the above configuration, if the barcode is successfully scanned, the user can return to the original screen and register the product again.

[0118] (5) In any of the configurations (1) to (4) above, the image information acquisition means may acquire first image information captured when product information is not registered and second image information captured during a reading operation after the superimposed display, and the display control means may cancel the superimposed display depending on the similarity based on the first image information and the second image information. According to the above configuration, if the product scanned just before and the product scanned again are not the same, i.e., if a different product is scanned after a failed scan, the superimposed display can be prevented from being canceled. This prevents a transaction from being completed without registering the product that was unsuccessfully scanned. This further improves the deterrent effect against fraudulent activities.

[0119] (5) In any of the configurations (1) to (4) above, the display control means may be configured to display, in the superimposed display, a first image information captured when no product information was registered and a second image information captured during a reading operation after the superimposed display. According to the above configuration, if the product targeted for the first and second scan operations is different, the customer can easily recognize that the product is different. This allows the customer to be prompted to rescan the same product. Furthermore, because the first image information and the second image information are displayed side by side, even if there is no store clerk near the transaction status management device 11 and the clerk is looking at the operation display unit 205 from a distance, the clerk can easily understand that a second scan operation is being performed. This allows the clerk to quickly take action to prevent fraud.

[0120] (6) In addition, (6) in any of the configurations (1) to (5) above, the display control means may cause the captured image, which was displayed when the product information was not registered, to be displayed again in the superimposed display. According to the above configuration, a recording of the scanning operation when a barcode scan fails is displayed, thereby making it possible to appeal to customers that the recording is being made, thereby improving the effect of deterring fraud.

[0121] (7) In order to solve the above-mentioned problems, another aspect of the present invention is a program that causes a computer used in a product sales data processing device to function as a detection means that detects products present in an identifier reading area, a product registration means that registers product information based on the identifier read in the reading area, an image information acquisition means that acquires image information capturing an image of a customer reading the identifier in the reading area, and a display control means that causes a display means to display a product list image based on the product information registered by the product registration means and an image based on the image information acquired by the image information acquisition means, wherein when a product is detected by the detection means and product information is registered by the product registration means, the display control means displays the product list image and the image in separate display areas, and when a product is detected by the detection means but product information is not registered by the product registration means, the display control means displays the image in a superimposed manner on the product list image. According to the above configuration, if a scanning operation fails, the customer can be directed to the captured image 620. Therefore, if a barcode scan fails, the customer can be prompted to rescan. Furthermore, for customers who intentionally commit fraud by failing to scan a barcode, the system can convey that monitoring is being conducted, which has a deterrent effect in preventing fraud. This reduces the burden on the store clerk assigned to the transaction status management device 11 in assisting customers with operations and monitoring for fraud. Therefore, at self-checkouts, the store clerk can efficiently assist customers, resulting in smooth transactions.

[0122] Note that all or part of the functions (input / output, storage, processing (including judgment)) of the POS terminal device 20 described above may be realized by a device other than the device described as the entity that executes the function.

[0123] Specifically, in the above description, the POS terminal device 20 is described as having a product registration unit, an image capture information acquisition unit, and a display control unit. All or some of these functional units may be provided in another computer device. For example, all or some of these functional units may be provided in the store controller 10, the transaction status management device 11, or another computer device. Furthermore, the number of computer devices provided with these functional units is not limited to multiple, and may be one. For example, all of these functional units may be provided in a single computer device.

[0124] Specifically, for example, instead of the POS terminal device 20, the store controller 10 or the transaction status management device 11 may perform a display control process for superimposing a captured image on a product list image.

[0125] In relation to the above, the POS terminal 20 may function as a so-called thin client specialized in the input / output interface for product registration and settlement. In other words, the POS terminal 20 may accept various inputs (operation by an operator, detection by a device such as a scanner), transmit the input information (operation information, scan information, etc.) to a cloud server, receive the processing results of the cloud server based on the input information (updated screen information, device control information, etc.), and perform various outputs (display on a display unit, control of a device).

[0126] The program for implementing the POS terminal device 20 described above may be recorded on a computer-readable recording medium and loaded into a computer system for execution. The term "computer system" as used herein includes hardware such as an operating system and peripheral devices. The term "computer-readable recording medium" also refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into a computer system. The term "computer-readable recording medium" also includes devices that retain the program for a certain period of time, such as volatile memory (RAM) within a computer system that acts as a server or client when the program is transmitted over a network such as the Internet or a communication line such as a telephone line. The program may also be transmitted from a computer system storing the program in a storage device to another computer system via a transmission medium or by transmission waves within the transmission medium. The term "transmission medium" used to transmit the program refers to a medium capable of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may also be used to implement part of the functions described above. Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program). [Explanation of symbols]

[0127] 1...POS system, 10...store controller, 11...transaction status management device, 20...POS terminal device, 201...CPU, 202...ROM, 203...RAM, 204...hard disk, 205...operation display unit, 206...scanner unit, 208...card payment unit, 209...change machine, 215...communication unit, 216...camera

Claims

1. a detection means for detecting a commodity present in a reading area of the identifier; a product registration means for registering product information based on the identifier read in the reading area; an image information acquisition means for acquiring image information obtained by capturing an image of a customer's operation of reading the identifier in the reading area; a display control means for displaying, on a display means, a product list image based on the product information registered by the product registration means and an image based on the imaging information acquired by the imaging information acquisition means; Equipped with The display control means If the product information is not registered by the product registration means even though the product is detected by the detection means, the captured image is superimposed on the product list image and displayed. A product sales data processing device characterized by:

2. the display control means cancels the superimposed display when a reading operation is performed after the superimposed display and product information is registered; 2. The product sales data processing device according to claim 1.

3. the image information acquisition means acquires first image information captured when the product information is not registered and second image information captured during a reading operation after the superimposed display is performed; the display control means determines that the products match when the similarity based on the first imaging information and the second imaging information is equal to or greater than a predetermined threshold, and cancels the superimposed display.

3. The product sales data processing device according to claim 1 or 2.

4. the display control means displays, in the superimposed display, first image information captured when the product information was not registered and second image information captured during a reading operation after the superimposed display is performed, side by side; 4. The merchandise sales data processing device according to claim 1, wherein:

5. A computer used in a product sales data processing device, a detection means for detecting a commodity present in a reading area of the identifier; a product registration means for registering product information based on the identifier read in the reading area; an image information acquisition means for acquiring image information obtained by capturing an image of a customer's operation of reading the identifier in the reading area; a display control means for displaying, on a display means, a product list image based on the product information registered by the product registration means and a captured image based on the imaging information acquired by the imaging information acquisition means; It functions as The display control means If the product information is not registered by the product registration means even though the product is detected by the detection means, the captured image is superimposed on the product list image and displayed. A program characterized by:

Images