Commodity sales data processing apparatus and program

Abstract

To perform transaction smoothly.SOLUTION: Detection means of a commodity sales data processing device detects a commodity existing in a reading region where an identifier attached to a commodity is readable. Commodity registration means registers commodity information based on the identifier read in the reading region. Imaging information acquisition means acquires imaging information including a captured image of identifier reading operation done by a customer in the reading region. Display control means displays a commodity list image based on the commodity information registered by the commodity registration means and a captured image based on the imaging information acquired by the imaging information acquisition means on display means. The display control means displays the list image and the captured image on different display regions when the commodity information is registered by the commodity registration means when the commodity is detected by the detection means, and performs superimposed display in which the captured image is superimposed on the commodity list image when the commodity information is not registered by the commodity registration means although the commodity was detected by the detection means.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to a product sales data processing device and a program.

Background Art

[0002] Conventionally, in various stores such as supermarkets and convenience stores, transactions are conducted using a POS terminal device (Point Of Sales). The POS terminal device performs product registration processing and settlement processing. In addition to the type where a store clerk registers and settles products, there is also a so-called self-checkout where customers themselves operate to register and settle products (see, for example, Patent Document 1). In self-checkout, a monitoring terminal for displaying the operating status of each self-checkout is provided, and a store clerk is placed at the monitoring terminal for monitoring by the store clerk.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, since the store clerk placed at the monitoring terminal performs various tasks such as customer operation support, recovery work, and fraud monitoring, the burden on the store clerk may increase. Also, when operation support occurs simultaneously at multiple self-checkouts, it may cause one customer to wait. For this reason, there was a problem in that transactions could not be smoothly conducted in the prior art.

[0005] The present invention has been made in view of such circumstances, and its object is to provide a technology capable of smoothly conducting transactions at self-checkout.

Means for Solving the Problems

[0006] In order to solve the above problems, a product sales data processing apparatus according to an aspect of the present invention includes: a detection unit that detects a product existing in an identifier reading area; a product registration unit that registers product information based on the identifier read in the reading area; an imaging information acquisition unit that acquires imaging information obtained by imaging an identifier reading operation by a customer in the reading area; a display control unit that causes a display unit to display a product list image based on the product information registered by the product registration unit and an imaging image based on the imaging information obtained by the imaging information acquisition unit. When a product is detected by the detection unit and the product information is registered by the product registration unit, the display control unit displays the product list image and the imaging image in separate display areas. When the product information is not registered by the product registration unit even though a product is detected by the detection unit, the display control unit performs a superimposed display in which the imaging image is superimposed on the product list image. A product sales data processing apparatus is characterized by the above.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Mode for Carrying Out the Invention

[0008] (Embodiment) Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings. FIG. 1 is a network configuration diagram of a POS (Point Of Sales) system according to an embodiment of the present invention. The POS system 1 can be introduced into various stores such as supermarkets, home centers, convenience stores, and various supply stores. As shown in FIG. 1, the POS system 1 includes a store controller 10, a transaction status management device 11, and three POS terminal devices 20-1, 20-2, and 20-3. Hereinafter, when there is no particular distinction between the POS terminal devices 20-1, 20-2, and 20-3, they are collectively referred to as the POS terminal device 20.

[0009] Each device is a computer device equipped with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a communication unit, etc. Each device is connected by wire or wirelessly via a communication line 55 such as a LAN (Local Area Network) or a WAN (Wide Area Network).

[0010] The store controller 10 stores various types of information necessary for transactions such as a product master. The product master is a file that stores product information such as product identification information (e.g., JAN (Japanese Article Number) code), product name, and selling price for each product. Also, the product master includes product identification information, product name, unit price of the product to be measured, etc. for products that require measurement (products to be measured). In addition to the product master, the store controller 10 stores various types of information such as inventory status, sales history, and deposit and withdrawal records. Further, the store controller 10 may store customer membership information.

[0011] The transaction status management device 11 displays the status (such as processing status) of the POS terminal device 20 and controls the POS terminal device 20. In the POS system 1, it is possible to arrange a store clerk at the transaction status management device 11 for monitoring by the store clerk. Here, various types of self-checkouts where customers perform registration operations and settlement operations are widespread in the store. For example, self-checkouts include semi-self-checkouts where a store clerk performs the registration operation and the customer performs the settlement operation, full self-checkouts where the customer performs both the registration operation and the settlement operation, and self-checkouts using a mobile terminal where the customer performs the registration operation using the mobile terminal and the settlement operation using a settlement device. The transaction status management device 11 can monitor the settlement in such self-checkouts. Note that the transaction status management device 11 may not monitor the registration side in the case of the POS terminal device 20 where a store clerk is involved (performs the registration operation). Also, in this case, it may monitor only the settlement side, or it may not monitor the settlement side either.

[0012] The POS terminal device 20 is an example of a merchandise sales data processing device. The POS terminal device 20 is a cash register device that executes a product registration process for registering products and a settlement process for performing settlement. In the product registration process, registration information indicating products to be purchased by a customer (hereinafter sometimes referred to as "purchased products") is generated. In the settlement process, settlement is performed based on the total amount of the purchased products (hereinafter sometimes referred to as "purchase amount") based on the registration information generated in the product registration process. The POS terminal device 20 is a self-checkout that can perform the product registration process and the settlement process by a customer's operation. In FIG. 1, the number of POS terminal devices 20 is shown as a plurality, but it may be one unit.

[0013] Note that the POS system 1 may include a service counter terminal. The service counter terminal accepts the shipping, return, ordering of products, and sale of gift certificates of products purchased by a customer. For example, the service counter terminal receives and manages transaction information indicating products and amounts for each transaction in each POS terminal device 20 from each POS terminal device 20. Further, the service counter terminal may manage the transaction status of each POS terminal device 20.

[0014] Also, the POS system 1 may include a mobile terminal. The mobile terminal is, for example, a terminal device such as a mobile phone, smartphone, or tablet device possessed by a store clerk. The mobile terminal may be lent to each store clerk or may be owned by each store clerk. The mobile terminal notifies or rings in response to a call request from the POS terminal device 20 (including the service counter terminal).

[0015] (Installation example of the POS terminal device 20) FIG. 2 is an explanatory diagram showing an installation example of the POS terminal device 20. As shown in FIG. 2, a counter is placed on the right side of the POS terminal device 20 as viewed from the operator. Although omitted in the illustration, in FIG. 2, a counter may also be placed on the left side of the POS terminal device 20. That is, the counter may be placed on both sides of the POS terminal device 20. The counter can place a shopping basket.

[0016] In addition, the POS terminal device 20 includes a sign pole 220. The sign pole 220 is provided facing upward, and by emitting light in a predetermined lighting pattern, it is possible to make even a store clerk not near the POS terminal device 20 recognize the lighting pattern. Specifically, the sign pole 220 includes a light-emitting part such as a lamp or an LED (light emitting diode). The light-emitting part can emit light in a predetermined lighting pattern. The lighting pattern of the sign pole 220 indicates that the POS terminal device 20 is in use or indicates a call for a store clerk.

[0017] (Configuration example of the POS terminal device 20) Next, with reference to FIGS. 2 and 3, the configuration of the POS terminal device 20 will be described. FIG. 3 is a block diagram showing the hardware configuration of the POS terminal device 20. In FIGS. 2 and 3, the same parts are denoted by the same reference numerals.

[0018] Hereinafter, with reference to FIG. 2, a configuration example of the POS terminal device 20 shown in FIG. 3 will be described. The POS terminal device 20 includes a CPU 201, a ROM 202, a RAM 203, a hard disk 204, an operation display unit 205, a scanner unit 206, a card payment unit 208, a change dispenser 209, a printing unit 213, an audio output unit 214, a communication unit 215, and a camera 216. These can communicate with each other via a bus.

[0019] The CPU 201 is a central processing unit, and controls the operation of the POS terminal device 20 by reading and executing various programs stored in the ROM 202. The various programs include a product sales data processing program according to the present embodiment. The ROM 202 is a read-only memory, and stores various information used by the CPU 201 including various programs.

[0020] The RAM 203 is a memory that can be read from and written to, and stores various information. For example, the RAM 203 stores information acquired from the outside (such as product master obtained from the store controller 10) and information generated during processing. Also, this information includes, among other things, settlement information generated during the settlement process for registered products (purchased products).

[0021] The hard disk 204 stores various information. For example, the hard disk 204 stores imaging results (such as videos) captured by the camera 216. The hard disk 204 may store various programs such as a product sales data processing program executed by the CPU 201, instead of the ROM 202 for example. Also, instead of the RAM 203, it may store information acquired from the outside and information generated during processing.

[0022] The operation display unit 205 is a touch display (touch panel). The operation display unit 205 displays various information to the customer and accepts various operation inputs from the customer.

[0023] When the scanner unit 206 detects an article (such as a product) within a predetermined reading area (see FIG. 4), the reading function is turned on and it optically reads various codes. The reading function turns off when no article is detected within the reading area. The various codes read by the scanner unit 206 are, for example, barcodes (product codes, etc.) attached to products, codes (barcodes, two-dimensional codes, etc.) printed on the receipt (registered trademark), and codes (barcodes, two-dimensional codes, etc.) printed on vouchers (product vouchers, coupon vouchers, discount vouchers) and various cards (such as membership cards, point cards, etc.). Also, the various codes include the staff code attached to the staff name tag.

[0024] In addition, product registration includes not only registration by reading the barcode attached to the product but also registration using a preset key. The preset key is a button corresponding to the product (the button for ordering the product) and is displayed on the operation display unit 205. When the preset key is operated (pressed), product registration is performed.

[0025] The card settlement unit 208 is a settlement mechanism using various cards (such as credit cards, prepaid cards like transportation IC cards, and point cards). The card settlement unit 208 includes a card recognition unit (reading unit), a display unit, and an operation unit. The card recognition unit magnetically or electrically reads information on various cards. The read information is used for settling the purchased goods. Note that the card recognition unit can also recognize information to be used in the settlement of the current purchased goods, for example, when using the points held on a point card. Also, the card recognition unit can recognize information not to be used in the settlement of the current purchased goods, for example, when awarding points to a point card. The card recognition unit can recognize contact-type cards (IC cards, magnetic cards) and non-contact-type cards (IC cards).

[0026] The change dispenser 209 (cash settlement unit) is a settlement mechanism using cash and has an inlet for banknotes and coins and an outlet for banknotes and coins. The change dispenser 209 has a sensor for detecting banknotes and coins inserted into the inlet. The sensor detects, for example, that banknotes or coins have been inserted into the inlet and the number of each denomination. The change dispenser 209 calculates the amount of money inserted into the inlet, calculates the change amount, which is the difference between the inserted amount and the purchase amount, and discharges the change from the outlet. The change dispenser 209 faces the operator side and accepts various operations and cash input from customers.

[0027] The printing unit 213 issues various media (such as receipts and accounting vouchers).

[0028] The voice output unit 214 outputs voice. For example, the voice output unit 214 outputs voice guidance and warning sounds. The voice guidance and warning sounds are related to product registration and settlement.

[0029] The communication unit 215 is an interface for transmitting and receiving information with other devices (the store controller 10, the transaction status management device 11, and other POS terminal devices 20).

[0030] The camera 216 is attached to the upper right of the operation display unit 205. The camera 216 is a camera that continuously captures video or still images. A CCD (charge coupled device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera can be used for the camera 216. The camera 216 captures the products during the registration operation of the products by the customer and the settlement operation, in addition to imaging the products in the registration operation.

[0031] (Regarding the reading area 400 of the scanner unit 206) FIG. 4 is an explanatory diagram showing an example of the reading area 400 of the scanner unit 206. In FIG. 4, the reading area 400 is an area capable of reading the identifier of a product. The identifier is, for example, a barcode, but it may also be a two-dimensional code. The scanner unit 206 reads the barcode of the product existing in the reading area 400. The barcode reading method is, for example, a laser method. However, the reading method is not limited to the laser method, and it is also possible to use a CCD method or a pen method.

[0032] When a product exists in the reading area 400, the reading function of the scanner unit 206 is turned on. When the reading function is turned on, for example, laser light is applied to the label surface of the barcode, and the reflected light is read by a sensor. On the other hand, when no product exists in the reading area 400, the reading function is turned off. When the reading function is turned off, the irradiation of laser light and the reading by the sensor are stopped.

[0033] (Functional configuration of the POS terminal device 20) Here, in the POS system 1, for example, a store clerk is arranged at the transaction status management device 11, and monitoring is performed by the store clerk. The store clerk arranged at the transaction status management device 11 performs various operations such as customer operation support, recovery work, and fraud monitoring. For this reason, the burden on the store clerk may increase, and when operation support occurs simultaneously at a plurality of POS terminal devices 20, it may cause a customer to wait. For this reason, transactions may not be able to be carried out smoothly.

[0034] Therefore, the POS terminal device 20 according to the present embodiment is capable of prompting a customer to appropriately register a product by imaging an operation related to product registration by the customer in the reading area 400 and controlling the display of the captured image. Hereinafter, the functional configuration of the POS terminal device 20 according to the present embodiment will be described.

[0035] Hereinafter, the functional configuration of the POS terminal device 20 will be described. The POS terminal device 20 includes a product registration unit, an imaging information acquisition unit, and a display control unit. Each unit is realized by the CPU 201. That is, by the CPU 201 executing a product sales data processing program stored in the ROM 202, the functions of each unit are realized. Further, the POS terminal device 20 includes a detection unit. The detection unit is realized by the scanner unit 206.

[0036] The detection unit detects an article (product) existing in the reading area 400. The detection unit is realized by, for example, the scanner unit 206, but may also be realized by the camera 216. That is, the camera 216 may detect an article existing in the reading area 400. Further, the detection unit may be a dedicated device (for example, a proximity sensor) that detects an article (product) existing in the reading area 400.

[0037] The product registration department registers product information based on the barcode read by the scanner unit 206 in the reading area 400. Hereinafter, the reading by the scanner unit 206 may be referred to as scanning. The imaging information acquisition unit acquires imaging information obtained by imaging the barcode reading operation (scanning operation) by the customer in the reading area 400.

[0038] The display control unit causes the display unit to display the product list image and the captured image. The product list image is an image based on the product information registered by the product registration department. Specifically, the product list image is an image in which products are listed in a list form and includes product names and prices. The product list image may be an image displayed in the display area indicating the registration details, or may be separately generated as an image different from the image indicating the registration details and displayed in a display area different from the display area indicating the registration details. When a product is registered by the product registration department, the product indicated by the registered product information is added to the product list image.

[0039] The captured image is an image based on the imaging information acquired by the imaging information acquisition unit. Specifically, the captured image is a real-time image showing the scanning operation. The display means is, for example, the operation display unit 205. Also, the captured image is a video, but may be a still image.

[0040] The display control unit simultaneously displays the product list image and the captured image on the operation display unit 205. Specifically, the display control unit displays the product list image in a certain area and displays the captured image in an area different from that area. Thereby, it is possible to appeal to the customer that the product is being imaged at the time of product registration.

[0041] However, the display control unit does not necessarily need to simultaneously display the product list image and the captured image on the display unit. For example, the captured image may be displayed according to the settings. The switching of the settings of the captured image may be performed by the operation of an authorized operator (store clerk), or a switching button may be displayed on the product registration screen and the operation may be performed by an unauthorized operator (customer). Also, when the captured image is not to be displayed, the display control unit may display a character image of "recording" instead.

[0042] Even when no product is detected by the detection unit, the camera 216 is on and captures an area including the reading area 400. The display control unit displays the real-time image captured by the camera 216 even when no product is detected by the detection unit. However, the display control unit may display the real-time image captured by the camera 216 when a product is detected by the detection unit. Also, in this case, the camera 216 may be turned on when a product is detected by the detection unit.

[0043] (Regarding superimposed display) When the product information is not registered by the product registration unit even though a product is detected by the detection unit, that is, when the scan operation fails, the display control unit performs a superimposed display in which the captured image is superimposed on the product list image. In the superimposed display, since the captured image is displayed on top of the product list image, part or all of the product list image becomes unviewable.

[0044] Also, in the superimposed display, the display control unit enlarges and displays the captured image. The enlarged display means to display it larger than before the superimposed display is performed. Specifically, for example, it is to be displayed using a display area of more than half of the operation display unit 205. When the captured image is enlarged and displayed, the product list image becomes more difficult to view.

[0045] In addition, when no product information is registered, the display control unit causes the captured image captured at that time to be displayed again in the superimposed display. That is, the captured image displayed in the superimposed display is a recording when the scan operation fails. As described above, the captured image displayed when the superimposed display is not performed is a real-time image.

[0046] (Regarding cancellation of superimposed display) After performing the superimposed display, when product information is registered by performing a scan operation again, the display control unit cancels the superimposed display. Specifically, the scanner unit 206 can scan the barcode even when the superimposed display is being performed. Specifically, the scanner unit 206 can detect an article (product) existing in the reading area 400 and can scan the barcode even when the superimposed display is being performed. When the product registration unit registers product information by a scan operation again, the display control unit cancels the superimposed display and causes the product list image and the captured image to be displayed in their original display areas, respectively.

[0047] Also, when the scan operation fails, the notification unit performs notification. The notification is a notification indicating that the scan operation has failed or a notification prompting a scan operation again. The notification mode of the notification is a mode of display using the operation display unit 205 or a mode of voice using the voice output unit 214.

[0048] (An example of the display control process of the captured image performed by the POS terminal device 20) Next, with reference to FIG. 5, the display control process of the captured image performed by the POS terminal device 20 in the present embodiment will be described. FIG. 5 is a flowchart showing an example of the display control process of the captured image performed by the POS terminal device 20. In FIG. 5, the POS terminal device 20 determines whether or not the start of product registration has occurred (step S501). The POS terminal device 20 waits until the start of product registration (step S501: NO). When the start of product registration occurs (step S501: YES), the POS terminal device 20 displays the product list image and the captured image in separate areas (step S502).

[0049] Then, the POS terminal device 20 determines whether the scanner unit 206 has detected a product (article) within the reading area 400 (step S503). The POS terminal device 20 waits until a product is detected within the reading area 400 (step S503: NO). When a product is detected within the reading area 400 (step S503: YES), the POS terminal device 20 starts scanning the barcode by the scanner unit 206 (step S504).

[0050] Then, the POS terminal device 20 determines whether the barcode scan has been successful (step S505). If the barcode scan is not successful (step S505: NO), the POS terminal device 20 determines whether the product within the reading area 400 has become undetected (step S506).

[0051] If the product within the reading area 400 has not become undetected (step S506: NO), that is, if the scanner unit 206 has detected a product within the reading area 400, the POS terminal device 20 returns to step S505. If the product within the reading area 400 has become undetected (step S506: YES), the POS terminal device 20 ends the scan (step S507). Then, the POS terminal device 20 acquires the imaging information at the time of the failed scan operation captured by the camera 216 (step S508). The imaging information at the time of the failed scan operation is specifically the imaging information captured from the start of the scan in step S504 to the end of the scan in step S506.

[0052] Then, the POS terminal device 20 performs a superimposed display by superimposing the captured image on the product list image (step S509). Next, the POS terminal device 20 gives a notification prompting a re-scan operation (step S510) and returns to step S503.

[0053] In step S505, if the barcode scan is successful (step S505: YES), the POS terminal device 20 ends the scan (step S511). Then, the POS terminal device 20 registers the product specified from the barcode (step S512). Then, the POS terminal device 20 determines whether it is in the state of superimposed display with the captured image on the product list image (step S513).

[0054] If it is not in the state of superimposed display (step S513: NO), the POS terminal device 20 proceeds to step S515. If it is in the state of superimposed display (step S513: YES), the POS terminal device 20 cancels the superimposed display (step S514), that is, the product list image and the captured image are displayed in separate areas. Then, the POS terminal device 20 determines whether the settlement start button has been pressed (step S515).

[0055] If the settlement start button is not pressed (step S515: NO), the POS terminal device 20 returns to step S503. If the settlement start button is pressed (step S515: YES), the POS terminal device 20 executes the settlement process (step S516) and ends the series of processes.

[0056] (Regarding the screen transition related to the display control of the captured image) Next, FIGS. 6 and 7 are explanatory diagrams showing an example of the screen transition related to the display control of the captured image displayed on the operation display unit 205. FIG. 6(A) shows the product registration screen 600 displayed on the operation display unit 205. The product registration screen 600 includes a product list image 610 and a captured image 620. The product list image 610 and the captured image 620 are displayed in different display areas. Also, in the product registration screen 600, the display area of the product list image 610 is larger than the display area of the captured image 620. The product registration screen includes a preset key 630, a settlement start button 640, and a clerk call button 650.

[0057] The product list image 610 shows the list of registered products. The product list image 610 shows the product name and price of each product. In the illustration, it shows that two products (tea, mochi cakes) are registered. The captured image 620 is a real-time video captured by the camera 216. In the illustration, the captured image shows a scanning operation in which a customer registers milk. When the barcode attached to the milk is successfully scanned and the registration of the milk is completed, the system transitions to the product registration screen 660 shown in FIG. 6(B).

[0058] In the product registration screen 660 shown in FIG. 6(B), the product registration notification 670 indicates that the milk has been registered. Also, the product list image 610 shows that the milk has been added and three products are registered. In this way, the scanning operation by the customer is always displayed in the captured image 620, and the registered products are displayed in the product list image 610.

[0059] Here, in the product registration screen 600 of FIG. 6(A), if the scanning of the barcode attached to the milk fails, the system transitions to the superimposed screen 700 shown in FIG. 7(A). The superimposed screen 700 shown in FIG. 7(A) shows a screen in which the captured image 620 is superimposed on the product list image 610. In the superimposed screen 700, the captured image 620 is an image (recording) when the scanning operation fails. Specifically, the captured image 620 shows the captured information when the scanning operation for registering the milk fails. In the captured image 620, the same image is repeatedly displayed. Also, in the superimposed screen 700, the display area of the product list image 610 is almost hidden and is a smaller display area than the captured image 620.

[0060] Furthermore, the superimposed screen 700 displays a prompt notification 710 that prompts the user to perform a scan operation again. If the user is successful in scanning the barcode on the milk by performing a scan operation again, the superimposed screen 700 ends, and the screen transitions to the product registration screen 660 shown in Fig. 7(B). The product registration screen 660 shown in Fig. 7(B) is the same screen as the product registration screen 660 shown in Fig. 6(B). Even if the user performs a scan operation again to scan the barcode of a product other than milk, the superimposed screen 700 ends, and the screen transitions to the product registration screen 660 shown in Fig. 7(B).

[0061] It should be noted that the superimposed screen is also terminated when the end button 720 is pressed on the superimposed screen 700 of Fig. 7(A). In this case, however, the screen returns to the product registration screen 600 of Fig. 6(A). It should be noted that the end button 720 may not be displayed on the superimposed screen 700. In other words, it may be configured such that the superimposed screen 700 cannot be terminated in response to a customer's operation. In other words, the condition for canceling the superimposed screen 700 may be only that product information is registered by a second scan operation in response to a customer's operation.

[0062] As described above, the POS terminal device 20 according to the present embodiment performs a superimposed display (superimposed screen 700) in which the captured image 620 is superimposed on the product list image 610 when the product information is not registered even though the product is detected in the reading area 400. This allows the customer to focus on the captured image 620 when the scanning operation fails. Therefore, when the barcode scan fails, it is possible to encourage the customer to rescan. In addition, it is possible to show that the customer is being monitored for customers who intentionally commit fraud by failing to scan the barcode, and thus it is possible to obtain a deterrent effect against fraud. This reduces the burden on the store clerks assigned to the transaction status management device 11 in providing operation support to customers and monitoring for fraud. Therefore, at the self-checkout, the store clerks can efficiently support customers, and transactions can be carried out smoothly.

[0063] In addition, the POS terminal device 20 according to the present embodiment is configured to enlarge and display the captured image 620 in the superimposed display. Thereby, the customer can be made to pay more attention to the captured image 620.

[0064] In addition, after performing the superimposed display, when product information is registered by the customer's scanning operation, the POS terminal device 20 according to the present embodiment is configured to cancel the superimposed display. Thereby, when the barcode scan is successful, the original screen can be restored and product registration can be performed again.

[0065] In addition, the POS terminal device 20 according to the present embodiment is configured to redisplay the captured image displayed when the product information was not registered in the superimposed display. Thereby, since the recording of the scanning operation when the barcode scan fails is displayed, it is possible to appeal to the customer that recording is being performed. Therefore, the deterrence effect against fraud can be improved.

[0066] (Modification Example of the Embodiment) Next, a modification example of the embodiment will be described. In each of the following modification examples, the description of the content described in the above-described embodiment will be omitted as appropriate. Also, each of the following modification examples and the above-described embodiment can be combined with each other.

[0067] (Modification Example 1) First, Modification Example 1 of the embodiment will be described. In the above-described embodiment, a configuration was described in which, as a condition for canceling the superimposed display, product information is registered by a second scan operation. In Modification Example 1, in addition to or instead of such a configuration, a configuration will be described in which, as a condition for canceling the superimposed display, the product registered by the second scan operation matches the product captured when the scan operation fails.

[0068] In Modification 1, the imaging information acquisition unit acquires first imaging information and second imaging information. The first imaging information is the imaging information captured when product information was not registered, that is, the imaging information when the scanning operation failed. The second imaging information is the imaging information captured in a subsequent scanning operation, that is, the imaging information when the scanning operation was successful in the subsequent scanning operation.

[0069] The display control unit cancels the superimposed display according to the similarity based on the first imaging information and the second imaging information. The similarity is obtained, for example, by performing image analysis on the image of the first imaging information and the image of the second imaging information. Here, the POS terminal device 20 according to Modification 1 includes a coincidence determination unit. The coincidence determination unit extracts an image indicating a product from the first imaging information and the second imaging information, respectively. Further, the coincidence determination unit extracts feature amounts from the extracted images, compares the extracted feature amounts, and calculates the similarity between the two. The feature amounts include shape, pattern, and color.

[0070] When the calculated similarity is equal to or greater than a predetermined threshold, the coincidence determination unit determines that the products match. On the other hand, when the calculated similarity is less than the predetermined threshold, the coincidence determination unit determines that the products do not match (are inconsistent).

[0071] When the coincidence determination by the coincidence determination unit indicates a match, the display control unit cancels the superimposed display, and when the coincidence determination indicates a mismatch, the display control unit continues the superimposed display. Also, when the coincidence determination indicates a mismatch, the notification unit notifies to that effect.

[0072] Further, when the coincidence determination indicates a match, the product registration unit directly registers the product information obtained by the subsequent scanning. On the other hand, when the coincidence determination indicates a mismatch, the product registration unit is configured to receive an instruction from the customer as to whether to register the product information obtained by the subsequent scanning, and registers according to the received result.

[0073] Note that the matching determination of the product does not need to be performed strictly, and it is sufficient to determine whether they approximately match. For example, even if the feature quantity is only color, it is possible to determine whether they approximately match. Specifically, for example, it is possible to perform the matching determination by comparing the color most obtained from the image of the product when the scan operation fails with the color most obtained from the image of the product when the scan operation succeeds. In this way, if the matching determination is performed with only color as the feature quantity, the matching determination can be simplified.

[0074] (Regarding an example of the display control process of the captured image performed by the POS terminal device 20 according to the first modification) Next, with reference to FIG. 8, the display control process of the captured image performed by the POS terminal device 20 according to the first modification will be described. FIG. 8 is a flowchart showing an example of the display control process of the captured image performed by the POS terminal device 20 according to the first modification.

[0075] In FIG. 8, the POS terminal device 20 determines whether the start of product registration has occurred (step S801). The POS terminal device 20 waits until the start of product registration (step S801: NO). When the start of product registration occurs (step S801: YES), the POS terminal device 20 displays the product list image and the captured image in separate areas (step S802).

[0076] Then, the POS terminal device 20 determines whether the scanner unit 206 has detected a product (article) within the reading area 400 (step S803). The POS terminal device 20 waits until a product is detected within the reading area 400 (step S803: NO). When a product is detected within the reading area 400 (step S803: YES), the POS terminal device 20 starts the barcode scan by the scanner unit 206 (step S804).

[0077] Then, the POS terminal device 20 determines whether the barcode scan was successful (step S805). If the barcode scan is not successful (step S805: NO), the POS terminal device 20 determines whether the product in the reading area 400 has not been detected (step S806).

[0078] If the product in the reading area 400 has not been undetected (step S806: NO), that is, if the scanner unit 206 has detected the product in the reading area 400, the POS terminal device 20 returns to step S805. If the product in the reading area 400 has been undetected (step S806: YES), the POS terminal device 20 ends the scan (step S807). Then, the POS terminal device 20 acquires the imaging information (first imaging information) at the time of the failed scan operation captured by the camera 216 (step S808). Specifically, the first imaging information is the imaging information captured from the start of the scan in step S804 to the end of the scan in step S806.

[0079] Then, the POS terminal device 20 performs an overlapping display by overlapping the captured image on the product list image (step S809). Next, the POS terminal device 20 issues a notification prompting a re-scan operation (step S810) and returns to step S803.

[0080] In step S805, if the barcode scan is successful (step S805: YES), the POS terminal device 20 ends the scan (step S811). Then, the POS terminal device 20 determines whether an overlapping display by overlapping the captured image on the product list image is in progress (step S812).

[0081] If the superimposed display is not in progress (step S812: NO), the POS terminal device 20 proceeds to step S819. If the superimposed display is in progress (step S812: YES), the POS terminal device 20 acquires imaging information (second imaging information) captured by the camera 216 when the scan operation is successful (step S813). The second imaging information is specifically imaging information captured from the start of scanning in step S804, through step S805: YES, to the end of scanning in step S811.

[0082] Then, the POS terminal 20 judges the similarity based on the second imaging information acquired in step S813 and the first imaging information acquired in step S808 (step S814).Then, the POS terminal 20 judges whether the products match using the images of the products extracted from the first imaging information and the second imaging information (step S815).

[0083] If the products do not match (step S815: NO), the POS terminal 20 displays a confirmation screen and registers the product according to the customer's instructions (step S816). Note that the POS terminal 20 does not register the product depending on the customer's instructions. If the products match (step S815: YES), the POS terminal 20 registers the product identified by the barcode (step S817).

[0084] Then, the POS terminal device 20 cancels the superimposed display (step S818), i.e., displays the product list image and the captured image in separate areas. Then, the POS terminal device 20 judges whether or not the checkout start button has been pressed (step S819). If the checkout start button has not been pressed (step S819: NO), the POS terminal device 20 returns to step S803. If the checkout start button has been pressed (step S819: YES), the POS terminal device 20 executes the checkout process (step S820) and ends the series of processes.

[0085] (Screen transitions related to Modification 1) Next, FIG. 9 is an explanatory diagram showing an example of screen transition according to Modification 1 displayed on the operation display unit 205. FIG. 9(A) shows a screen similar to the superimposed screen 700 shown in FIG. 7(A). The superimposed screen 700 in FIG. 9(A) shows imaging information when the scanning operation of the product "milk" fails. Assuming that the barcode attached to the product "coffee" is successfully scanned by a second scanning operation, the process transitions to the confirmation screen 900 shown in FIG. 9(B).

[0086] A notification display 910 is displayed on the confirmation screen 900. The notification display 910 indicates that the product "milk" when the scanning operation fails is different from the product "coffee" when the scanning operation succeeds. Further, the notification display 910 includes an "OK" button for accepting the registration of the product and a "Cancel" button for accepting the non-registration of the product. When the "OK" button is pressed, the product registration of coffee is completed and the process returns to the product registration screen. When the "Cancel" button is pressed, the product registration of coffee is not performed and the process returns to the product registration screen. In addition, in the superimposed screen 700 of FIG. 9(A), assuming that the barcode attached to the product "milk" is successfully scanned by a second scanning operation, the process transitions to the product registration screen 660 shown in FIG. 7(B).

[0087] According to Modification 1, the superimposed display (superimposed screen 700) is canceled according to the similarity based on the imaging information when the scanning operation fails and the imaging information when the second scanning operation succeeds. Thereby, when the product scanned immediately before and the product scanned again are not the same, that is, when another product is scanned after the failure of the scanning operation, the superimposed display can be prevented from being canceled. For this reason, it is possible to suppress the situation where the product for which the scanning operation has failed is not registered and the transaction is completed. Therefore, the deterrent effect against fraud can be further improved.

[0088] (Another aspect of Modification 1) The following describes other aspects of Modification Example 1. In Modification Example 1, regardless of the determination result of the match determination, the customer may be asked whether or not the two products match, and registration may be performed according to the received result. For example, regardless of the determination result of the match determination, the POS terminal device 20 may notify "Is it the same product as before?" and receive "Yes" or "No". When the POS terminal device 20 receives "Yes", it registers the product information, and when it receives "No", it does not register the product information. Further, the POS terminal device 20 may cancel the superimposed screen 700 after receiving "Yes" or "No".

[0089] Further, regardless of the determination result of the match determination, the product registration unit may register the product information obtained by re-scanning as it is.

[0090] Also, when indicating a mismatch in the match determination, the superimposed screen 700 may not be cancelable. For such cancellation, it may be required that the store clerk confirm. Specifically, the store clerk's confirmation is a cancellation operation by the store clerk. For example, when indicating a mismatch in the match determination, the store clerk is called, and the customer's operation is disabled until the cancellation operation by the store clerk is received. Note that when the customer's operation is disabled, an image at the time of failure in the scan operation may be continuously displayed on the superimposed screen 700, and a message indicating that the store clerk is being called may be displayed.

[0091] The store clerk may be called by lighting the sign pole 220, a notification sound, or the like. Further, the transaction status management device 11 may notify the call. Furthermore, the cancellation operation by the store clerk may be performed from the transaction status management device 11. That is, the cancellation operation by the store clerk may be performed remotely.

[0092] (Modification Example 2) Next, a second modification of the embodiment will be described. In the above-described embodiment, the case of registering a product with a barcode was described. In the second modification, in addition to or instead of such a configuration, the case of registering a product without a barcode will be described. FIG. 10 is an explanatory diagram showing an example of screen transition according to the second modification displayed on the operation display unit 205.

[0093] Products without a barcode are, for example, vegetables, fruits, prepared foods, fresh fish, etc., and are registered using the preset key 630 (see FIG. 6(A)). Here, assume that the operator (e.g., a customer) picks up a product without a barcode and places it in the reading area 400. In this case, the presence of the product (e.g., a carrot) is detected by the scanner unit 206. Since the product does not have a barcode, when the product is removed from the reading area 400, the POS terminal device 20 determines that the scan operation has failed. Therefore, as shown in FIG. 10(A), an image (recording of a carrot) at the time of failure of the scan operation is displayed in the captured image 620 shown on the superimposed screen 1000.

[0094] In the second modification, as shown in FIG. 10(A), the preset key 1010 is displayed on the superimposed screen 1000. The preset key 1010 includes buttons corresponding to, for example, vegetables, fruits, prepared foods, fresh fish, etc. For example, when the preset key 1010 indicating vegetables is pressed, the screen shown in FIG. 10(B) is transitioned to.

[0095] FIG. 10(B) shows a product selection screen 1020 corresponding to the preset key 1010 for vegetables. The product selection screen 1020 includes a plurality of product selection buttons. When the button indicating "carrot" among the product selection buttons is selected, the registration of the product is completed, the superimposed screen 1000 is cancelled, and the screen returns to the product registration screen.

[0096] According to Modification 2, even if it is determined that a product without a barcode has failed in the scanning operation, the product can be easily registered using the preset key 1010. Further, since the captured image 620 displays the image at the time of the failed scanning operation, it is possible to obtain a deterrent effect against fraud committed on products without barcodes.

[0097] (Modification 3) Next, Modification 3 of the embodiment will be described. In the above-described embodiment, the captured image (recording) at the time of the failed scanning operation is used for the captured image displayed in the superimposed display. In Modification 3, in addition to or instead of such a configuration, a configuration will be described in which a real-time captured image is used for the captured image displayed in the superimposed display.

[0098] In Modification 3, in the superimposed screen 700, simply a real-time image is displayed. Even if it is configured in this way, since the captured image 620 is displayed superimposed on the product list image 610, a deterrent effect against fraud can be obtained. Further, even if the captured image 620 is a real-time image in the superimposed screen 700, by enlarging the display, it is possible to more strongly emphasize that monitoring is being performed. Furthermore, in Modification 3, since it is not necessary to record, it is not necessary to provide a storage device or the like. Therefore, it is possible to perform a smooth transaction with a simple configuration.

[0099] (Modification 4) Next, Modification 4 of the embodiment will be described. In the above-described embodiment, only the captured image (recording) at the time of the failed scanning operation is used for the captured image displayed in the superimposed display. In Modification 4, a configuration will be described in which the recording and the real-time captured image are used for the captured image displayed in the superimposed display.

[0100] In the fourth modification, a real-time image (an image at the time of the second scan operation) and a captured image (recorded image) at the time of a failed scan operation are displayed side by side on the superimposed screen 700. These images are superimposed on the product list image.

[0101] (Example of a screen according to Modification 4) Fig. 11 is an explanatory diagram showing an example of a screen related to Modification 4 displayed on the operation display unit 205. In Fig. 11, an overlapping parallel screen 1100 shows a screen in which a captured image 620 is displayed overlapping a product list image 610. The captured image 620 includes a first captured image 620a and a second captured image 620b. The first captured image 620a is an image (recorded) when a scanning operation fails, that is, an image at the time of the first scanning operation. The second captured image 620b is an image of a second scanning operation (a real-time scanning operation), that is, an image at the time of the second scanning operation.

[0102] The condition for canceling the superimposed parallel screen 1100 is that product information is registered by a scan operation again. That is, even if the same product is not scanned, the superimposed parallel screen 1100 can be canceled. Also, the end button 720 (see FIG. 7(A)) may be displayed on the superimposed parallel screen 1100 so that the superimposed parallel screen 1100 can be canceled by pressing the end button.

[0103] As described above, in the fourth modification, the first captured image 620a and the second captured image 620b are displayed side by side. This allows the customer to easily recognize that the products targeted for the first and second scan operations are different, if the products are different. This makes it possible to encourage the customer to rescan the same product.

[0104] In addition, not only the POS terminal device 20 but also the transaction status management device 11 displays a screen similar to the superimposed parallel screen 1100. As a result, the store clerk located at the transaction status management device 11 can easily grasp that the products targeted by the first scan operation and the second scan operation are different.

[0105] Here, the store clerk performs various tasks (for example, spreading and stacking the bags for sub-packaging to make a bundle of bags for sub-packaging that is easy for the customer to use, being called by the purchase of a plastic bag, moving around multiple customers for operation support, etc.). For this reason, it is often impossible to stare at the transaction status management device 11.

[0106] According to Modification 4, by displaying the superimposed parallel screen 1100 on the transaction status management device 11, it is possible to grasp from the form (size, color, shape, etc.) of the product whether the same item or a different item is scanned in the second scan operation. In addition, since the first captured image 620a and the second captured image 620b are displayed side by side, even when there is no store clerk near the transaction status management device 11 and the operation display unit 205 is viewed from a distance, it is possible to easily grasp that the second scan operation is being performed. Therefore, the store clerk can quickly respond to anti-fraud measures.

[0107] (Modification 5) Next, Modification 5 of the embodiment will be described. In Modification 4 described above, a configuration in which no coincidence determination is made between the captured image (recording) at the time of scan operation failure and the real-time captured image displayed in the superimposed display has been described. In Modification 5, a configuration in which coincidence determination is made between the captured image (recording) at the time of scan operation failure and the real-time captured image displayed in the superimposed display will be described.

[0108] In Modification 5, the POS terminal device 20 includes a matching determination unit. As described above, the matching determination unit determines whether the products targeted by each scanning operation match based on the imaging information when the scanning operation fails and the imaging information captured in the subsequent scanning operation.

[0109] (An example of the screen according to Modification 5) FIG. 12 is an explanatory diagram showing an example of the screen according to Modification 5 displayed on the operation display unit 205. In FIG. 12, the superimposed parallel screen 1200 shows a screen in which the captured images 620 (the first captured image 620a and the second captured image 620b) are displayed superimposed on the product list image 610. The superimposed parallel screen 1200 also includes a difference notification 1210. The difference notification 1210 is displayed when a result of non - matching is obtained in the matching determination by the matching determination unit.

[0110] The difference notification 1210 is a notification indicating that a non - matching result has been obtained in the matching determination by the matching determination unit and calling a store clerk. Also, the background image of the difference notification 1210 is displayed in a color different from the normal background image (for example, refer to the superimposed parallel screen 1100 in FIG. 11). Thereby, the customer can be prompted to rescan the same product to facilitate the registration of the product.

[0111] On the other hand, when a matching result is obtained in the matching determination by the matching determination unit, the superimposed parallel screen 1200 is cancelled. That is, the condition for cancelling the superimposed parallel screen 1200 is that the product registered by the subsequent scanning operation matches the product captured when the scanning operation failed.

[0112] According to Modification 5, when another product is scanned after the scanning operation fails, the superimposed display can be prevented from being cancelled. Therefore, it is possible to suppress the situation where the product for which the scanning operation has failed is not registered and the transaction is completed. Thus, the deterrent effect against fraud can be further improved.

[0113] In addition, the overlapping parallel screen 1200 is also displayed on the transaction status management device 11. As a result, the store clerk located at the transaction status management device 11 can easily grasp that the products to be scanned are different in the first scan operation and the second scan operation. In particular, since the first captured image 620a and the second captured image 620b are arranged and displayed, and further, the background image of the difference notification 1210 is displayed in a display mode different from the normal background image, even when there is no store clerk near the transaction status management device 11 and the operation display unit 205 is viewed from a distance, it is possible to easily grasp that a second scan operation is being performed. Therefore, the store clerk can quickly respond to prevent fraud.

[0114] The following summarizes the embodiments. [Title of the Invention] Product sales data processing apparatus and program [Technical Field] The present invention relates to a product sales data processing apparatus and a program. [Background Art] Conventionally, transactions are conducted in various stores such as supermarkets and convenience stores using a POS terminal device (Point Of Sales). The POS terminal device performs product registration processing and settlement processing. In addition to the type where a store clerk registers and settles products, there is also a so-called self-checkout where customers themselves operate to register and settle products (see, for example, Patent Document 1). In self-checkout, a monitoring terminal for displaying the operating status of each self-checkout is provided, and a store clerk is placed at the monitoring terminal for monitoring by the store clerk. [Prior Art Documents] [Patent Documents] [Patent Document 1] Japanese Patent Laid-Open No. 10-069574 [Summary of the Invention] [Problems to be Solved by the Invention] However, in the prior art, since the store employees arranged at the monitoring terminals perform various operations such as customer operation support, recovery work, and fraud monitoring, the burden on the store employees may increase. Also, when operation support occurs simultaneously at multiple self-checkouts, one customer may be made to wait. For this reason, there has been a problem in the prior art that transactions may not be carried out smoothly. The present invention has been made in view of such circumstances, and an object thereof is to provide a technology capable of smoothly performing transactions at a self-checkout.

[0115] [Means for Solving the Problems] (1) In order to solve the above-described problems, a merchandise sales data processing apparatus according to an aspect of the present invention includes: detection means for detecting a product present in an identifier reading area; product registration means for registering product information based on the identifier read in the reading area; imaging information acquisition means for acquiring imaging information obtained by imaging an identifier reading operation by a customer in the reading area; display control means for causing a display means to display a product list image based on the product information registered by the product registration means and an imaging image based on the imaging information obtained by the imaging information acquisition means; and when a product is detected by the detection means and product information is registered by the product registration means, the display control means displays the product list image and the imaging image in separate display areas, and when, despite the product being detected by the detection means, product information is not registered by the product registration means, performs a superimposed display in which the imaging image is superimposed on the product list image. A merchandise sales data processing apparatus characterized by the above. According to the above configuration, when the scanning operation fails, the customer can be made to notice the captured image 620. Therefore, when the barcode scanning fails, a rescan can be prompted. Also, for a customer who performs an illegal act of intentionally failing the barcode scan, it is possible to appeal that they are being monitored, so an illegal deterrence effect can be obtained. As a result, the burden on the store clerk arranged in the transaction status management device 11 regarding operation support for customers and illegal monitoring can be reduced. Therefore, in self-checkout, the store clerk can efficiently support the customer, and thus the transaction can be carried out smoothly.

[0116] (2) In the configuration of (1) above, the display control means may enlarge and display the captured image in the superimposed display compared to the captured image when the product list image and the captured image are displayed in separate display areas. According to the above configuration, the customer can be made to notice the captured image 620 more.

[0117] (3) In the configuration of (1) or (2) above, the display control means may cancel the superimposed display when product information is registered by performing a reading operation after the superimposed display is performed. According to the above configuration, when the barcode scan is successful, the original screen can be restored and product registration can be performed again.

[0118] (4) In any of the configurations of (1) to (3) above, the imaging information acquisition means acquires first imaging information captured when product information was not registered and second imaging information captured in the reading operation after the superimposed display is performed, and the display control means may cancel the superimposed display according to the similarity based on the first imaging information and the second imaging information. According to the above configuration, when the product scanned immediately before and the product scanned again are not the same, that is, when another product is scanned after the failure of the scan operation, the superimposed display can be prevented from being canceled. For this reason, it is possible to prevent a transaction from being completed without the product for which the scan operation has failed being registered. Therefore, the deterrent effect against fraud can be further improved.

[0119] (5) In any of the configurations (1) to (4) above, the display control means may display the first imaging information captured when the product information was not registered and the second imaging information captured in the reading operation after the superimposed display side by side in the superimposed display. According to the above configuration, when the products targeted by the first scan operation and the second scan operation are different, it is possible to easily make the customer recognize that the products are different. Thereby, it is possible to prompt the customer to rescan the same product. In addition, since the first imaging information and the second imaging information are displayed side by side, even when there is no store clerk near the transaction status management device 11 and the operation display unit 205 is viewed from a distance, it is possible to easily grasp that a rescan operation is being performed. Therefore, the store clerk can promptly respond to fraud prevention.

[0120] In addition, add (6). (6) In any of the configurations (1) to (5) above, the display control means may display the captured image displayed when the product information was not registered again in the superimposed display. According to the above configuration, since the recording of the scan operation when the barcode scan fails is displayed, it is possible to appeal to the customer that recording is being performed, so that the deterrent effect against fraud can be improved.

[0121] (7) In order to solve the above problems, a program according to another aspect of the present invention causes a computer used in a product sales data processing device to function as a detection means for detecting a product existing in an identifier reading area, a product registration means for registering product information based on the identifier read in the reading area, an imaging information acquisition means for acquiring imaging information obtained by imaging an identifier reading operation by a customer in the reading area, and a display control means for causing a display means to display a product list image based on the product information registered by the product registration means and an imaging image based on the imaging information obtained by the imaging information acquisition means. When a product is detected by the detection means, if product information is registered by the product registration means, the display control means displays the product list image and the imaging image in separate display areas. When, despite the product being detected by the detection means, product information is not registered by the product registration means, the display control means performs a superimposed display in which the imaging image is superimposed on the product list image. This is a program characterized by the above. According to the above configuration, when the scan operation fails, the customer can be made to pay attention to the imaging image 620. Therefore, when the barcode scan fails, a rescan can be prompted. In addition, for a customer who intentionally performs an illegal act of causing the barcode scan to fail, it is possible to appeal that they are being monitored, so that an effect of preventing and deterring illegal acts can be obtained. As a result, the burden on the store clerk arranged in the transaction status management device 11 regarding operation support for customers and illegal monitoring can be reduced. Therefore, in self-checkout, the store clerk can efficiently support the customer, and thus a smooth transaction can be carried out.

[0122] Note that all or part of each function (input / output, storage, processing (including judgment)) in the POS terminal device 20 described above may be realized in another device different from the device described as the execution subject of the function.

[0123] Specifically, in the above description, the configuration in which the POS terminal device 20 includes a product registration unit, an imaging information acquisition unit, and a display control unit has been described. All or part of these functional units may be provided in other computer devices. For example, all or part of these functional units may be provided in the store controller 10, may be provided in the transaction status management device 11, or may be provided in computer devices other than these. Also, the computer devices in which these functional units are provided are not limited to multiple units, and may be one unit. For example, all of these functional units may be provided in one computer device.

[0124] Specifically, for example, instead of the POS terminal device 20, the store controller 10 or the transaction status management device 11 may perform a display control process for performing a superimposed display in which the captured image is superimposed on the product list image.

[0125] In relation to the above, the POS terminal device 20 may function as a so-called thin client specialized for the input / output interface part with respect to product registration and settlement. That is, the POS terminal device 20 receives various inputs (operations by an operator, detections by devices such as scanners), transmits input information (operation information, scan information, etc.) to the cloud server, receives the processing results of the cloud server (updated screen information, device control information, etc.) based on the input information, and may perform various outputs (display on the display unit, device control).

[0126] Note that a program for realizing the POS terminal device 20 described above may be recorded on a computer-readable recording medium, and the program may be read into a computer system and executed. Here, the "computer system" is assumed to include hardware such as an OS and peripheral devices. Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, etc., and a storage device such as a hard disk built in a computer system. Furthermore, the "computer-readable recording medium" also includes a volatile memory (RAM) inside a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line, and holds the program for a certain period of time. Also, the above program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the "transmission medium" for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. Also, the above program may be for realizing a part of the functions described above. Furthermore, it may be a so-called difference file (difference program) that can realize the functions described above in combination with a program already recorded in the computer system.

Explanation of Signs

[0127] 1…POS system, 10…store controller, 11…transaction status management device, 20…POS terminal device, 201…CPU, 202…ROM, 203…RAM, 204…hard disk, 205…operation display unit, 206…scanner unit, 208…card settlement unit, 209…change machine, 215…communication unit, 216…camera

Claims

1. detection means for detecting a product present in the reading area of the identifier; product registration means for registering product information based on the identifier read in the reading area; imaging information acquisition means for acquiring imaging information obtained by imaging the identifier reading operation by a customer in the reading area; display control means for causing a display means to display a product list image based on the product information registered by the product registration means and an imaging image based on the imaging information acquired by the imaging information acquisition means; comprising: wherein the display control means: when the product information is not registered by the product registration means despite the product being detected by the detection means, performs a superimposed display in which the imaging image is superimposed on the product list image; A product sales data processing apparatus characterized by the above.

2. After performing the superimposed display, when the product information is registered by a reading operation being performed, the display control means cancels the superimposed display. The product sales data processing apparatus according to claim 1, characterized by the above.

3. The imaging information acquisition means acquires first imaging information captured when the product information was not registered and second imaging information captured during a reading operation after the superimposed display is performed. When the similarity based on the first imaging information and the second imaging information is equal to or greater than a predetermined threshold value, the display control means determines that the products match and cancels the superimposed display. The product sales data processing apparatus according to claim 1 or 2, characterized by the above.

4. In the superimposed display, the display control means displays side by side the first imaging information captured when the product information was not registered and the second imaging information captured during a reading operation after the superimposed display is performed. The product sales data processing apparatus according to any one of claims 1 to 3, characterized by the above.

5. A computer used in a product sales data processing apparatus, functioning as detection means for detecting a product present in the reading area of the identifier, product registration means for registering product information based on the identifier read in the reading area, imaging information acquisition means for acquiring imaging information obtained by imaging the identifier reading operation by a customer in the reading area, display control means for causing a display means to display a product list image based on the product information registered by the product registration means and an imaging image based on the imaging information acquired by the imaging information acquisition means, and functioning as such, wherein the display control means: Even if a product is detected by the detection means, when product information is not registered by the product registration means, a superimposed display is performed in which the captured image is superimposed on the product list image. A program characterized by the above.

Images