Registration device, information processing device, and program

Abstract

To provide a registration device, an information processor, and a program capable of increasing the effectiveness of controlling fraudulent activities related to discount sales.SOLUTION: A registration device includes: a reading unit that reads item identification information from a code symbol and privilege information from a privilege symbol; an image capturing unit that captures an image of an image capturing area that includes a readable area of the reading unit; an extraction unit that extracts identification data corresponding to the item identification information from a memory unit that stores the item identification information and identification data pertaining to an item image in correspondence therewith; an acquisition unit that acquires the image data captured by the image capturing unit at the time of reading the privilege information; a determination unit that determines, based on the identification data extracted by the extraction unit, whether or not the item included in the image data acquired by the acquisition unit is the same item as the one read by the reading unit; and a registration unit that registers transaction information for the item identified by the item identification information based on the item identification information and the privilege information.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] Embodiments of the present invention relate to a registration device, an information processing device, and a program.

Background Art

[0002] Conventionally, in stores such as supermarkets, for products such as fresh foodstuffs, discount sales are conducted at a price obtained by subtracting a certain amount from the list price, or discount sales are conducted at a price obtained by subtracting a certain percentage of the list price. In the following description, discounts and price cuts are collectively referred to as "price cuts", and discount sales and price cut sales are collectively referred to as "discount sales".

[0003] When conducting discount sales, the store attaches a discount sticker with the discount amount etc. printed thereon to the product so that customers can recognize the discount information. The registration device that registers product information for accounting processes reads a product code that identifies the product from a barcode etc. attached to the product. Also, the registration device reads discount information from character information such as the printed discount amount etc., or a barcode etc. that indicates discount information printed together with the character information. Then, the registration device performs registration of transaction information (hereinafter, also referred to as "product registration") that includes product information (product name, price, etc.) obtained based on the read product code and discount information.

[0004] On the other hand, in recent years, against the backdrop of a labor shortage, registration devices operated by customers who purchase products have been put into practical use in stores. As this type of registration device, for example, those called self-POS (Point Of Sales) terminals and cart POS terminals are known.

[0005] Self-service POS terminals are installed at the checkout counter of stores, allowing customers to register their own items and handle payment for those items themselves. Cart POS terminals are equipped with a scanner and information terminal on a shopping cart, allowing customers to register items using the scanner in the sales area. Transaction information regarding the registered items is transferred to an accounting device that processes payments when the customer pays. In addition, there are also systems that allow customers to register items using their own mobile devices such as smartphones instead of the tablet terminal and scanner mentioned above.

[0006] In this type of registration device, since product registration is left to the customer, fraudulent activity by customers regarding discounted sales is possible. For example, a customer might scan the product code of a product that is not eligible for a discount, and then scan a discount sticker attached to another product to register it. To suppress such fraud, a system has been proposed that prevents fraud by checking the past transaction history of the product when it is registered by the registration device (for example, Patent Document 1).

[0007] However, the conventional technology described above does not verify the discount sticker attached to the product that the customer purchases, and therefore, it cannot be said to be sufficiently effective in deterring fraudulent activity. [Overview of the project] [Problems that the invention aims to solve]

[0008] The problem that this invention aims to solve is to provide a registration device, an information processing device, and a program that can enhance the deterrent effect against fraudulent activities related to discount sales. [Means for solving the problem]

[0009] The registration device of the embodiment includes: a reading unit that reads product identification information that identifies a product from a code symbol attached to a product and reads benefit information related to the benefit of the product from a benefit symbol attached to the product; an imaging unit that images an imaging area including the readable area of ​​the reading unit; an acquisition unit that acquires first imaging data captured by the imaging unit when the reading unit reads the product identification information and second imaging data captured by the imaging unit when the reading unit reads the benefit information; a determination unit that determines whether the product included in the first imaging data is the same product as the product included in the second imaging data; and a registration unit that, if the determination unit determines that they are the same product, registers transaction information relating to the transaction of the product identified by the product identification information based on the product identification information and benefit information read by the reading unit. The determination unit determines that if the second image data contains the same image area as the image area containing the code symbol and the special offer symbol in the first image data, then the product included in the first image data is the same product as the product included in the second image data. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is a schematic diagram of an accounting system including a registration device according to the first embodiment. [Figure 2] Figure 2 shows the external appearance of a shopping cart to which the registration device of the first embodiment is attached. [Figure 3] Figure 3 shows a product with a discount sticker attached, as used in the first embodiment. [Figure 4] Figure 4 is a block diagram showing the hardware configuration of a registration device including an information processing device according to the first embodiment. [Figure 5] Figure 5 shows the data structure of the product master stored in the memory section of the information processing device according to the first embodiment. [Figure 6] Figure 6 is a block diagram showing the functional configuration of the control unit in the information processing device of the first embodiment. [Figure 7] Figure 7 is a flowchart showing the flow of the registration process by the control unit in the information processing device of the first embodiment. [Figure 8] Figure 8 is a block diagram showing the functional configuration of the control unit in the information processing device of the second embodiment. [Figure 9] Figure 9 shows an example of image data captured by the imaging unit when the reading unit reads product identification information in the second embodiment. [Figure 10] Figure 10 shows an example of image data captured by the imaging unit when the reading unit reads the bonus information in the second embodiment. [Figure 11] Figure 11 is a flowchart showing the flow of the registration process by the control unit in the information processing device of the second embodiment. [Figure 12] Figure 12 is a flowchart showing the flow of the registration process by the control unit in the information processing device of the third embodiment. [Modes for carrying out the invention]

[0011] The following describes the registration device, information processing device, and program of the embodiment with reference to the drawings. However, the present invention is not limited to the embodiments described below. For example, in the embodiment described below, an example is described in which the registration device is composed of a tablet terminal and a scanner, but the registration device may be a single information device equipped with a function to read product information, a function to register transaction information, and an imaging function, and may be composed of, for example, a smartphone with an application program for product registration installed.

[0012] (First embodiment) The registration device, information processing device, and program of the first embodiment will be described below with reference to the drawings. Figure 1 is a schematic diagram of an accounting system including a registration device. The accounting system 1 of this embodiment is applicable, for example, to a supermarket that sells fresh food products and the like that are subject to discount sales. The accounting system 1 comprises a plurality of accounting devices 2, a store server 3, and a plurality of shopping carts 10 to which registration devices 20 are attached. The accounting devices 2 and the store server 3 are connected to each other so as to be able to communicate via a network such as a LAN (Local Area Network). In addition, each registration device 20 is connected to the accounting devices 2 and the store server 3 so as to be able to communicate via a wireless LAN or the like.

[0013] The accounting device 2 is a so-called self-service accounting device in which, for example, customer C performs the accounting operations themselves. Based on the transaction information received from the registration device 20, the accounting device 2 performs accounting processing related to payments made by cash or cashless payment methods such as credit card payments. Accounting processing is the process of paying for the goods purchased by customer C. Note that the accounting device 2 may also be a POS terminal operated by a store employee.

[0014] The store server 3 receives payment information from each accounting device 2, including product information and payment method details for items paid for during the accounting process. The store server 3 also receives sales information from each accounting device 2, showing the total sales amount for a predetermined period (e.g., one day). The store server 3 centrally manages the product information, payment information, sales information, etc., received from each accounting device 2 to perform sales management for each store. The store server 3 also stores a product master that associates product codes with product information (product name, price, identification data, etc.) for the products handled by the store, and transmits it to the registration device 20 as needed.

[0015] The shopping cart 10 is placed in the sales area of ​​the store and used to transport goods purchased by customer C. Customer C pushes the shopping cart 10 and moves around the sales area, registering the items to be purchased using the registration device 20 and storing them in a basket (not shown) placed on the shopping cart 10.

[0016] Figure 2 is a diagram showing the appearance of the shopping cart 10 to which the registration device 20 is attached. The shopping cart 10 includes a handle 11, a basket placement section 12, and casters 13, and the registration device 20 is attached thereto. The handle 11 is for the customer C to grip and move the shopping cart 10. The basket placement section 12 has a two-tier structure, and baskets for storing the goods purchased by the customer C can be placed thereon. Note that a basket may be integrally provided on the shopping cart 10. The casters 13 are provided at the four corners of the lower part of the shopping cart 10, respectively. By individually rotating these casters 13, the shopping cart 10 can move freely in the store. The shopping cart 10 is a moving body provided with the registration device 20.

[0017] The registration device 20 registers transaction information of goods and includes a tablet terminal 30 and a scanner 40 having a camera 41 (see FIG. 4). The transaction information is information necessary for the customer C to pay for the goods purchased, and includes product information (product name, price, etc.) and privilege information (discount amount, etc.). The discount information regarding discounts such as the discount amount is an example of privilege information. The privilege information is not limited to the discount information, and may be information indicating, for example, the granting of points specially added.

[0018] The tablet terminal 30 includes a display 31, a touch panel 32, and a card reader 33. The tablet terminal 30 is an example of an information processing device.

[0019] The display 31 is constituted by, for example, a liquid crystal panel and functions as a display unit for displaying various information. The display 31 displays, for example, the product information of the registered products and operation elements for the customer C, who is the user, to operate.

[0020] The touch panel 32 is located on the surface of the display 31 and inputs information corresponding to the touch position to the control unit 300 (see Figure 4) of the tablet terminal 30. It functions as an operation input unit that inputs information corresponding to the actions of the user, customer C. For example, the touch panel 32 inputs accounting instructions to the control unit 300 to instruct the transmission of transaction information to the accounting device 2.

[0021] The card reader 33 reads the membership code from customer C's membership card or point card or other media. Furthermore, if the registration device 20 has a payment function, the card reader 33 can also read credit information from customer C's credit card, for example. The card reader 33 may be a magnetic card reader that reads information from magnetic cards, or an IC card reader that reads information from cards with a built-in IC chip.

[0022] The scanner 40 is located on the handle 11 of the shopping cart 10. The scanner 40 has a reading window 42. The camera 41 captures an imaging area that includes a reading area from which the scanner 40 can read product codes and discount information, in a manner described later. For example, the camera 41 captures an image of the product held up to the reading window 42 and the barcode attached to the product.

[0023] Scanner 40 reads product identification information that identifies a product from a code symbol attached to the product. For example, Scanner 40 reads a product code that identifies a product from a barcode BC printed on a product label X attached to a product shown in Figure 3. Specifically, based on an image captured by Camera 41 of the barcode BC located in the readable area of ​​Scanner 40, Scanner 40 reads the information indicated by the barcode BC. More specifically, when Customer C places the barcode BC attached to a product to be purchased in the readable area facing the reading window 42, Camera 41 captures an image including the barcode BC. Scanner 40 extracts and decodes the barcode BC from a predetermined area of ​​the image captured by Camera 41 using pattern recognition or the like, and reads the product code indicated by the barcode BC. Barcode BC is an example of a code symbol, and the product code is an example of product identification information.

[0024] Furthermore, the scanner 40 reads benefit information related to the benefits of a product from the benefit symbols attached to the product. For example, when a discount sticker Y attached to a product purchased by customer C is placed in the readable area facing the reading window 42, the camera 41 captures an image including the discount sticker Y. The scanner 40 extracts the discount sticker Y from a predetermined area of ​​the image captured by the camera 41 by pattern recognition or the like, and reads the character information printed on the discount sticker Y by character recognition processing such as OCR (Optical Character Reader), or recognizes the discount amount or discount rate shown on the discount sticker by image recognition processing. A discount sticker Y with characters indicating the content of the discount printed on it is an example of a benefit symbol.

[0025] As described above, scanner 40 reads the product code (product identification information) that identifies the product from the barcode (code symbol) attached to the product, and also reads the special offer information related to the product from the discount sticker Y (special offer symbol) attached to the product, and is an example of a reading unit. Camera 41 is an example of an imaging unit.

[0026] Here, we will explain an example of the process for reading bonus information related to product benefits. First, the scanner 40 reads flag information indicating that a label showing bonus information is attached to the product. Specifically, the scanner 40 reads the above flag information by detecting the flag sticker Z (see Figure 3) from the image captured when reading the barcode BC of the product label. The scanner 40 detects the flag sticker Z by performing image processing to detect a predetermined shape (a double circle in this embodiment) from the captured image. The information indicated by the flag sticker Z is an example of flag information.

[0027] The flag sticker Z is affixed to the barcode BC, which indicates the product code, according to the store's operation. This is so that when customer C brings barcode BC close to the reading window 42 to have the product code read, the scanner 40 can recognize not only barcode BC but also the flag sticker Z. As a result, the scanner 40 can display a message on the display 31 prompting customer C to have the discount sticker Y read, thus preventing customer C from forgetting to read the discount information.

[0028] In the example shown in Figure 3, the flag sticker Z is attached integrally with the discount sticker Y, but it may also be attached separately from the discount sticker Y. For example, if the barcode BC is attached to the back of the product, the flag sticker Z is attached to the back of the product close to the barcode BC, and the discount sticker Y is attached to the front of the product so that customer C can easily recognize that it is a discounted item.

[0029] When scanner 40 reads flag information from flag sticker Z, it then reads discount information from discount sticker Y. Scanner 40 detects discount sticker Y from a specific area of ​​the captured image when camera 41 captures an image including discount sticker Y, and reads the discount information indicated by the text on the discount sticker. Scanner 40 also outputs the image including discount sticker Y captured by camera 41 to tablet terminal 30.

[0030] Furthermore, the control unit 300 of the tablet terminal 30 may perform at least one of the following processes from the image captured by the camera 41: reading the information indicated by the barcode BC (hereinafter also referred to as the barcode reading process), reading the information indicated by the flag sticker Z (hereinafter also referred to as the flag sticker reading process), and reading the information indicated by the discount sticker Y (hereinafter also referred to as the discount sticker reading process). In this case, the reading unit will consist of the scanner 40 and the control unit 300.

[0031] In the following explanation, when scanner 40 reads a product code from barcode BC, it may be referred to as "reading barcode BC," when it reads flag information from flag sticker Z, it may be referred to as "reading flag sticker Z," and when it reads discount information from discount sticker Y, it may be referred to as "reading discount sticker Y."

[0032] Figure 4 is a block diagram showing the hardware configuration of the registration device 20. As described above, the registration device 20 comprises a tablet terminal 30 and a scanner 40. The tablet terminal 30 comprises a control unit 300, a memory unit 310, a display 31, a touch panel 32, a card reader 33, and a communication unit 320. The control unit 300, memory unit 310, display 31, touch panel 32, card reader 33, and communication unit 320 are connected to each other via a bus 330, etc.

[0033] The control unit 300 consists of a computer equipped with a CPU (Central Processing Unit) 301, ROM (Read Only Memory) 302, and RAM (Random Access Memory) 303. The CPU 301, ROM 302, and RAM 303 are connected to each other via a bus 330.

[0034] The CPU 301 controls the overall operation of the tablet terminal 30. The ROM 302 stores various programs and data, such as the program used to drive the CPU 301. The RAM 303 includes a transaction information storage unit 304. The transaction information storage unit 304 is an area that stores transaction information based on the product code and discount information read by the scanner 40 in a single transaction. The RAM 303 is also used as a work area for the CPU 301 and loads various programs and data stored in the ROM 302 and memory unit 310. The control unit 300 executes various control processes for the tablet terminal 30 by having the CPU 301 operate according to the control programs stored in the ROM 302 and memory unit 310 and loaded into the RAM 303.

[0035] The memory unit 310 is composed of a storage medium such as an HDD (Hard Disk Drive) or flash memory, and retains its contents even when the power is cut off. The memory unit 310 stores the control program 311 and the product master 312.

[0036] The control program 311 is a program that implements functions such as registering products based on product codes and discount information read by the scanner 40, and determining whether the discount information read by the scanner 40 is correct based on the image data captured by the camera 41.

[0037] The product master 312 is a master file that stores information about the products handled by the store, and is received from the store server 3 via the communication unit 320. Since the products handled by the store change daily, the product master 312 is updated as needed based on information from the store server 3. Figure 5 shows the data structure of the product master 312. The product master 312 associates information such as product code, product name, price, and feature quantities.

[0038] The product code field stores the product code that identifies the product. The product name field stores information indicating the name of the product. The price field stores information indicating the unit price of the product. The unit price of the product may be the base price or the price including consumption tax. The information stored in the feature field is information indicating the features used for generic object recognition to identify the product from the image data (frame image). The information indicating the features is matching data that indicates the features of the appearance of the product image, such as data related to the color, external shape, and surface irregularities of the product. The information stored in the feature field is an example of identification data related to the product image.

[0039] Let's return to Figure 4 for explanation. The configuration and functions of the display 31, touch panel 32, and card reader 33 are as described above. The communication unit 320 is an interface for communicating with the scanner 40 and the store server 3. The control unit 300 is connected to the scanner 40 and the store server 3 via the communication unit 320, enabling it to send and receive information (data) with each of these devices.

[0040] Next, the functional configuration of the control unit 300 of the tablet terminal 30 will be described. Figure 6 is a block diagram showing the functional configuration of the control unit 300 of the tablet terminal 30. The control unit 300 functions as an input unit 3001, an acquisition unit 3002, an extraction unit 3003, a determination unit 3004, a registration unit 3005, a notification unit 3006, and an output unit 3007, with the CPU 301 operating according to the control program stored in the ROM 302 and the memory unit 310. Note that each of these functions may be configured with hardware such as dedicated circuits.

[0041] The input unit 3001 receives product identification information and benefit information related to product benefits from the scanner 40, which reads the product identification information and benefit information related to the product. Specifically, the input unit 3001 receives the product code read by the scanner 40 from the barcode BC attached to the product. In addition, the input unit 3001 receives discount information read by the scanner 40 from the discount sticker Y attached to the product. Furthermore, the input unit 3001 receives flag information read by the scanner 40 from the flag sticker Z, and various information related to the customer C's operation of the touch panel 32.

[0042] The acquisition unit 3002 acquires image data captured by the camera 41 when the scanner 40 reads the discount information. Specifically, the acquisition unit 3002 acquires image data captured by the camera 41 when the scanner 40 reads the discount information on the discount sticker Y. The image data acquired by the acquisition unit 3002 is a product image of the product including the discount sticker Y.

[0043] The extraction unit 3003 extracts identification data corresponding to the product identification information read by the scanner 40 from the memory unit 310, which stores identification data related to product identification information and product images in association. Specifically, the extraction unit 3003 reads the feature quantities corresponding to the product code entered into the input unit 3001 from the memory unit 310, which stores a product master 312 that associates product codes with matching information (hereinafter also simply referred to as feature quantities) indicating the appearance characteristics of the product. The extraction unit 3003 outputs the read feature quantities to the determination unit 3004. Note that the memory unit 310 that stores the product master 312 may be provided in an external device such as a store server 3.

[0044] The determination unit 3004 determines, based on the identification data extracted by the extraction unit 3003, whether the product included in the image data acquired by the acquisition unit 3002 is the same product as the product identified by the product identification information read by the scanner 40. Specifically, the determination unit 3004 extracts the feature quantities of the product included in the image data acquired by the acquisition unit 3002, compares them with the feature quantities extracted by the extraction unit 3003 from the memory unit 310, and calculates the similarity. Based on the calculated similarity, the determination unit 3004 determines whether the product included in the image data acquired by the acquisition unit 3002 is the same product as the product identified by the product code entered into the input unit 3001. In other words, it determines whether the product on which the scanner 40 reads the discount sticker Y is the same product as the product on which the scanner 40 reads the barcode BC. For example, if the calculated similarity is greater than or equal to a predetermined set value, the determination unit 3004 determines that the two products are the same product. Furthermore, the extraction of product features from the image data acquired by the acquisition unit 3002 is achieved using known image recognition techniques such as general object recognition.

[0045] If the determination unit 3004 determines that the products are the same, the registration unit 3005 registers transaction information relating to the transaction of the product identified by the product identification information, based on the product identification information and benefit information read by the scanner 40. Specifically, if the determination unit 3004 determines that the product included in the image data acquired by the acquisition unit 3002 is the same product as the product identified by the product code entered into the input unit 3001, the registration unit 3005 stores transaction information, which associates product information and discount information, in the transaction information storage unit 304. If the determination unit 3004 determines that the products are not the same, the registration unit 3005 determines that a discount sticker different from the one attached to the product whose product code was read by the scanner 40 was read, and does not store the transaction information in the transaction information storage unit 304.

[0046] Furthermore, if the scanner 40 does not read the flag information, the registration unit 3005 stores the transaction information in the transaction information storage unit 304, assuming that the product identified by the product identification information does not have any benefits. Specifically, if the flag information is not entered in the input unit 3001 along with the product code, the registration unit 3005 determines that the product identified by the product code is not eligible for a discount and stores the product information as transaction information in the transaction information storage unit 304. Product information such as product name and price is obtained from the product master 312 based on the product code entered in the input unit 3001. Alternatively, when a product code is entered in the input unit 3001, the registration unit 3005 may output a query for product information based on the product code to the store server 3 which stores the product master 312, and obtain the product information from the store server 3. In this case, the memory unit 310 does not need to store the product master 312. The act of the registration unit 3005 storing (registering) transaction information in the transaction information storage unit 304 is called product registration.

[0047] Furthermore, if the scanner 40 does not read the bonus information even after a predetermined time has elapsed since the scanner 40 read the flag information, the registration unit 3005 will not register the transaction information of the product identified by the product identification information. Specifically, if the discount information is not entered into the input unit 3001 even after a predetermined time has elapsed since the flag information has been entered into the input unit 3001, the registration unit 3005 will determine that there is a possibility that a discount sticker different from the discount sticker attached to the product identified by the entered product code may be read, and will not register the product.

[0048] If the determination unit 3004 determines that the product included in the image data acquired by the acquisition unit 3002 is not the same product as the product identified by the product code entered in the input unit 3001, the notification unit 3006 notifies customer C of an error message. For example, the notification unit 3006 displays a message on the display 31 prompting the customer to register the product again. The notification by the notification unit 3006 may also be made by voice. Similarly, if discount information is not entered in the input unit 3001 even after a predetermined time has elapsed, despite flag information being entered in the input unit 3001, the notification unit 3006 also notifies the customer to re-register the product.

[0049] When an accounting instruction is input to the input unit 3001 from the touch panel 32, the output unit 3007 outputs transaction information for one transaction stored in the transaction information storage unit 304 to the accounting device 2. Upon receiving the transaction information, the accounting device 2 can perform accounting processing.

[0050] The operation of the registration device 20 based on the above configuration will now be explained. Figure 7 is a flowchart showing the flow of the registration process by the control unit 300 of the tablet terminal 30.

[0051] First, the control unit 300 determines whether or not a product code has been entered into the input unit 3001 (S1). If it has not been entered (N in S1), it returns to the process of S1 and waits. In other words, the control unit 300 determines whether or not the scanner 40 has read a product code from the barcode BC attached to the product.

[0052] When a product code is entered into the input unit 3001 (Y in S1), the control unit 300 determines whether or not flag information has been entered into the input unit 3001 (S2). In other words, the control unit 300 determines whether or not the scanner 40 has read the flag information from the flag sticker Z attached to the product.

[0053] When flag information is input to the input unit 3001 (Y in S2), the control unit 300 outputs an instruction signal to the display 31 to prompt the reader of the discount sticker Y (S3). The display 31, upon receiving the instruction signal, displays a message prompting customer C to read the discount sticker Y. Next, the control unit 300 determines whether or not discount information has been input to the input unit 3001 (S4). In other words, the control unit 300 determines whether or not the scanner 40 has read the discount information from the discount sticker Y attached to the product.

[0054] When discount information is entered into the input unit 3001 (Y in S4), the acquisition unit 3002 acquires the image data from when the discount sticker was read, that is, the image data captured by the camera 41 when the scanner 40 reads the discount information from the discount sticker Y (S5). Subsequently, the extraction unit 3003 refers to the product master 312 and extracts feature quantities, which are identification data corresponding to the product code entered into the input unit 3001 (S6).

[0055] Next, the determination unit 3004 compares the feature quantities of the product image included in the imaging data acquired by the acquisition unit 3002 with the feature quantities extracted from the product master 312 by the extraction unit 3003 to determine whether the product included in the imaging data acquired by the acquisition unit 3002 is the same product as the product identified by the product code entered into the input unit 3001 (S7). The control unit 300 determines whether the determination unit 3004 has determined that the product included in the imaging data and the product identified by the product code entered into the input unit 3001 are the same product (S8).

[0056] If the determination unit 3004 determines that the items are the same product (Y in S8), the registration unit 3005 registers the product (S9). That is, the registration unit 3005 registers transaction information in the transaction information storage unit 304, which associates the product information obtained from the product master 312 based on the product code entered in the input unit 3001 with the discount information entered in the input unit 3001.

[0057] Next, the control unit 300 determines whether or not an accounting instruction has been entered into the input unit 3001 (S10). If no instruction has been entered (N in S10), it returns to the process in S1 and waits until the next product code is entered. When an accounting instruction is entered (Y in S10), the output unit 3007 outputs the transaction information for one transaction stored in the transaction information storage unit 304 to the accounting device 2 (S11). Following the output of the transaction information by the output unit 3007, the control unit 300 erases the transaction information for one transaction stored in the transaction information storage unit 304 (S12) and terminates the registration process.

[0058] If no flag information is entered during the S2 process (S2 N), the control unit 300 skips the S3-S8 processes and proceeds to the S9 process. If no flag information is entered, the registration unit 3005 determines that the product with the entered product code is not eligible for a discount and registers the product. In this case, the registration unit 3005 registers the product information obtained from the product master 312 based on the entered product code as transaction information in the transaction information storage unit 305. In other words, the transaction information does not include discount information.

[0059] Furthermore, if discount information is not entered into the input unit 3001 during processing S4 (S4, N), the control unit 300 determines whether a predetermined time has elapsed since the product code was entered into the input unit 3001 (S13). If the predetermined time has not elapsed (S13, N), the control unit 300 returns to processing S3. If the predetermined time has elapsed (S13, Y), the notification unit 3006 determines that customer C has placed the product in the cart without allowing the discount information to be read and displays an error message on the display 31 (S14). The displayed error message is, for example, "Discount information could not be read. Please re-register the product," prompting the customer to re-register the product. Subsequently, the control unit 300 proceeds to processing S10. If it is determined in S8 that the products are not the same (S8, N), the control unit 300 proceeds to processing S14. In this case, since the entered discount information may be based on fraudulent activity, the notification unit 3006 displays an error message to prompt the customer to re-register the product.

[0060] Having received transaction information for one transaction from the tablet terminal 30 through the registration process described above, the accounting device 2 performs accounting processing based on said transaction information.

[0061] According to the first embodiment described above, if the registration device 20 determines that the product whose product code has been read by the scanner 40 and the product whose discount information has been read are the same, it validates the discount information and registers the product. If the registration device 20 determines that the product whose product code has been read by the scanner 40 and the product whose discount information has been read are not the same, it invalidates the discount information and does not register the product, prompting customer C to re-register the product. This makes it possible to suppress fraudulent activity by customer C regarding discounted sales, even in a registration device where product registration is performed by customer C.

[0062] Furthermore, according to the first embodiment, even if the discount sticker Y is affixed to a product label X having a barcode BC at a distance from the product, it is possible to determine whether the product whose barcode BC is read and the product whose discount sticker Y is read are the same product. In other words, since the affixing position of the discount sticker Y is not limited, even if the barcode BC is on the back of the product, it is possible to affix the discount sticker Y to the front of the product so that it is easily visible to the customer C.

[0063] (Second embodiment) Next, a second embodiment will be described. The second embodiment differs from the first embodiment in that the scanner 40 determines whether the product whose product code was read and the product whose discount information was read are the same by comparing the first image data obtained when the scanner 40 reads the barcode BC with the second image data obtained when the discount sticker Y is read. In the following, descriptions of configurations and functions similar to those of the first embodiment may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art.

[0064] Since the hardware configuration of the accounting system 1, including the registration device 20, is the same as in the first embodiment, we will first describe the functional configuration of the control unit 300 of the tablet terminal 30. Figure 8 is a block diagram showing the functional configuration of the control unit 300 of the tablet terminal 30. The control unit 300 functions as an input unit 3001, an acquisition unit 3002, a determination unit 3004, a registration unit 3005, a notification unit 3006, and an output unit 3007, with the CPU 301 operating according to the control program stored in the ROM 302 and the memory unit 310. Note that each of these functions may be configured with dedicated circuits or other hardware.

[0065] The acquisition unit 3002 acquires first image data captured by the camera 41 when the scanner 40 reads product identification information, and second image data captured by the camera 41 when the scanner 40 reads the special offer information. Specifically, the acquisition unit 3002 acquires first image data, which is a frame image including the product with barcode BC, captured by the camera 41 when the scanner 40 reads barcode BC. The acquisition unit 3002 also acquires second image data, which is a frame image including the product with discount sticker Y, captured by the camera 41 when the scanner 40 reads the discount sticker Y. Note that the discount sticker Y attached to the product is placed in close proximity to barcode BC.

[0066] Figure 9 shows an example of the first imaging data, and Figure 10 shows an example of the second imaging data. Figures 9 and 10 show the relationship between the imaging area and the reading area of ​​the camera 41. In Figures 9 and 10, the outer frame is the imaging area A that the camera 41 captures in one frame. A reading area B is set in the center of imaging area A, from which product codes and discount information can be read. Imaging area A is the image area captured by the camera 41 of the imaging area facing the reading window 42 of the scanner 40, and reading area B is the image area captured by the camera 41 of the reading area facing the reading window 42.

[0067] Scanner 40 is configured to read information from barcode BC and discount sticker Y contained within reading area B, but not from barcode BC and discount sticker Y contained within imaging area A outside reading area B. Furthermore, scanner 40 is configured to read information from flag sticker Z contained within imaging area A. In other words, the product code indicated by barcode BC and the discount information indicated by discount sticker Y can only be read within reading area B, while the flag information indicated by flag sticker Z can only be read within imaging area A.

[0068] Returning to Figure 8, the functional configuration of the control unit 300 of the tablet terminal 30 will be explained. The determination unit 3004 determines whether the product included in the first image data is the same product as the product included in the second image data. For example, if the second image data contains the same image area as the image area in the first image data that includes the code symbol and the special offer symbol, the determination unit 3004 determines that the product included in the first image data is the same product as the product included in the second image data.

[0069] More specifically, the determination unit 3004 uses image processing technology to determine whether there is a common image area containing barcode BC and discount sticker Y in the first and second image data. As shown in Figures 9 and 10, if a common image area SA containing barcode BC and discount sticker Y exists in the first and second image data, the determination unit 3004 determines that the product included in the first image data is the same product as the product included in the second image data. Since product labels X with barcode BC and discount sticker Y are applied manually, the positional relationship between barcode BC and discount sticker Y is considered to differ for each product. Therefore, if there is a common image containing barcode BC and discount sticker Y in the two images, the determination unit 3004 determines that the positional relationship between barcode BC and discount sticker Y in the two images is the same and determines that the products shown in both images are the same product. The determination unit 3004 may determine whether the product included in the first image data and the product included in the second image data are the same product by comparing the product image included in the first image data with the product image included in the second image data, without considering the positional relationship between the barcode BC and the discount sticker Y. For example, the determination unit 3004 may determine that the products are the same if a part of the image area A (a sufficient range to determine that they are the same product) when reading the product code with the barcode BC positioned in the reading area B is located within the image area A when reading the discount information with the discount sticker Y positioned in the reading area B.

[0070] The operation of the registration device 20 based on the above configuration will now be described. Figure 11 is a flowchart showing the flow of the registration process by the control unit 300 of the tablet terminal 30. Processes similar to those in the first embodiment are denoted by the same reference numerals, and the explanation is simplified.

[0071] First, the control unit 300 determines whether or not a product code has been entered into the input unit 3001 (S1). If it has not been entered (N in S1), it returns to the process of S1 and waits. If a product code has been entered into the input unit 3001 (Y in S1), the control unit 300 determines whether or not flag information has been entered into the input unit 3001 (S2).

[0072] When flag information is input to the input unit 3001 (Y in S2), the acquisition unit 3002 acquires the first imaging data, that is, the imaging data captured by the camera 41 for the scanner 40 to read the product code (S21). Subsequently, the control unit 300 outputs an instruction signal to the display 31 to prompt the reading of the discount sticker Y (S3).

[0073] Next, the control unit 300 determines whether or not discount information has been input to the input unit 3001 (S4). If discount information has been input to the input unit 3001 (Y in S4), the acquisition unit 3002 acquires second imaging data, that is, imaging data of the product captured by the camera 41 in order for the scanner 40 to read the discount information on the discount sticker Y (S22).

[0074] Next, the determination unit 3004 determines whether the product included in the first image data and the product included in the second image data are the same product by determining whether a common image area including barcode BC and discount sticker Y exists in the first image data and the second image data acquired by the acquisition unit 3002 (S7). The control unit 300 determines whether the determination unit 3004 has determined that the product included in the first image data and the product included in the second image data are the same product (S8).

[0075] If the determination unit 3004 determines that the items are the same product (Y in S8), the registration unit 3005 registers the product (S9). Next, the control unit 3000 determines whether or not an accounting instruction has been entered into the input unit 3001 (S10). If no instruction has been entered (N in S10), it returns to the process in S1 and waits until the next product code is entered. When an accounting instruction is entered (Y in S10), the output unit 3007 outputs the transaction information stored in the transaction information storage unit 304 to the accounting device 2 (S11). Following the output of the transaction information by the output unit 3007, the control unit 3000 erases the transaction information for one transaction stored in the transaction information storage unit 304 (S12) and terminates the registration process.

[0076] If no flag information is entered during the S2 process (S2, N), the control unit 300 proceeds to the S9 process. Also, if no discount information is entered into the input unit 3001 during the S4 process (S4, N), the control unit 300 determines whether a predetermined time has elapsed since the product code was entered into the input unit 3001 (S13). If the predetermined time has not elapsed (S13, N), the control unit 300 returns to the S3 process. If the predetermined time has elapsed (S13, Y), the notification unit 3006 displays an error message on the display 31 (S14). The displayed error message is, for example, "Discount information could not be read. Please re-register the product," prompting the user to re-register the product. Subsequently, the control unit 300 proceeds to the S10 process. Also, if it is determined in S8 that the products are not the same (S8, N), the control unit 300 proceeds to the S14 process.

[0077] According to the second embodiment, even in a registration device where product registration is performed by customer C, similar to the first embodiment, fraudulent activity by customer C regarding discounted sales can be suppressed.

[0078] Furthermore, according to the second embodiment, whether or not a common image area SA, including barcode BC and discount sticker Y, exists in the first and second imaging data determines whether the product whose product code was read and the product whose discount information was read are the same product. Therefore, since the above determination can be made on an individual product basis, fraudulent activity by customer C can be further suppressed. For example, even if the product code of a product without a discount sticker Y is read, and then a discount sticker Y attached to the same product (a product with the same product code) is read, the registration device 20 will not register the discount information, thus further suppressing fraud.

[0079] (Third embodiment) Next, a third embodiment will be described. In the third embodiment, the determination of whether the product whose product code has been read by the scanner 40 and the product whose discount information has been read are the same is performed using both the determination method of the first embodiment and the determination method of the second embodiment. Hereafter, the same configurations and functions as in the first and / or second embodiments may be omitted from the description.

[0080] The hardware configuration of the accounting system 1, including the registration device 20, is the same as in the first and second embodiments. Furthermore, the functions of the control unit 300 of the tablet terminal 30 include the functions of the first embodiment and the functions of the second embodiment.

[0081] The operation of the registration device 20 will now be described. Figure 12 is a flowchart showing the flow of the registration process by the control unit 300 of the tablet terminal 30. Note that processes similar to those in the first and / or second embodiments are denoted by the same reference numerals, and the explanation is simplified.

[0082] First, the control unit 300 determines whether or not a product code has been entered into the input unit 3001 (S1). If it has not been entered (N in S1), it returns to the process of S1 and waits. If a product code has been entered into the input unit 3001 (Y in S1), the control unit 300 determines whether or not flag information has been entered into the input unit 3001 (S2).

[0083] When flag information is input to the input unit 3001 (Y in S2), the acquisition unit 3002 acquires the first imaging data, that is, the imaging data captured by the camera 41 for the scanner 40 to read the product code (S21). Subsequently, the control unit 300 outputs an instruction signal to the display 31 to prompt the reading of the discount sticker Y (S3).

[0084] Next, the control unit 300 determines whether or not discount information has been input to the input unit 3001 (S4). If discount information has been input to the input unit 3001 (Y in S4), the acquisition unit 3002 acquires second imaging data, that is, imaging data of the product captured by the camera 41 in order for the scanner 40 to read the discount information on the discount sticker Y (S22).

[0085] Next, the determination unit 3004 performs a first determination (S31). The first determination, similar to the determination in the second embodiment, uses the first imaging data and the second imaging data to determine whether the product whose product code was read and the product whose discount information was read are the same product. The control unit 300 determines whether the determination unit 3004 has determined that the product included in the first imaging data and the product included in the second imaging data are the same product (S32).

[0086] If the determination unit 3004 determines that the items are the same product (Y in S32), the registration unit 3005 registers the product (S9). Next, the control unit 3000 determines whether or not an accounting instruction has been entered into the input unit 3001 (S10). If no instruction has been entered (N in S10), it returns to the process in S1 and waits until the next product code is entered. If an accounting instruction is entered (Y in S10), the output unit 3007 outputs the transaction information for one transaction stored in the transaction information storage unit 304 to the accounting device 2 (S11). Following the output of the transaction information by the output unit 3007, the control unit 3000 erases the transaction information for one transaction stored in the transaction information storage unit 304 (S12) and terminates the registration process.

[0087] If no flag information is entered during the S2 process (S2, N), the control unit 300 proceeds to the S9 process. Also, if no discount information is entered into the input unit 3001 during the S4 process (S4, N), the control unit 300 determines whether a predetermined time has elapsed since the product code was entered into the input unit 3001 (S13). If the predetermined time has not elapsed (S13, N), the control unit 300 returns to the S3 process. If the predetermined time has elapsed (S13, Y), the notification unit 3006 displays an error message on the display 31 (S14). The displayed error message is, for example, "Discount information could not be read. Please re-register the product," prompting the user to re-register the product. Subsequently, the control unit 300 proceeds to the S10 process.

[0088] Furthermore, if the products are not determined to be the same in the processing of S32 (N in S32), the extraction unit 3003 refers to the product master 312 and extracts feature quantities, which are identification data corresponding to the product code entered in the input unit 3001 (S6). Subsequently, the determination unit 3004 performs a second determination (S33). The second determination, similar to the determination in the first embodiment, uses the image data from when the discount information was read (second image data) and the feature quantities of the product image stored in the product master 312 to determine whether the product from which the product code was read and the product from which the discount information was read are the same product.

[0089] The reason for performing a second check when the first check determines that the product code read and the product from which the discount information was read are not the same product is as follows:

[0090] The first determination method has the advantage of being able to determine on an individual item basis whether the item from which the product code was read and the item from which the discount information was read are the same item, as described in the second embodiment. However, in order to perform determination on an individual item basis, the barcode BC and the discount sticker Y must be attached to the item in close proximity. Specifically, as shown in Figure 9, when the barcode BC is positioned in the reading area B to read the product code, the barcode BC and the discount sticker Y must be placed close together so that at least a part of the discount sticker Y is located within the imaging area A. For this reason, it is not necessarily suitable for items where, for example, the barcode BC is attached to the back of the item. It is desirable to attach the discount sticker Y to the front of the item so that it is easy for the customer C to recognize, and as a result, the barcode BC and the discount sticker Y will be attached to the item at a distance from each other.

[0091] On the other hand, the second determination method has the advantage, as explained in the first embodiment, that it can determine whether the product from which barcode BC was read and the product from which discount sticker Y was read are the same product, even if the barcode BC and discount sticker Y are attached in separate locations.

[0092] Therefore, in the third embodiment, a second determination is performed when it is determined in the first determination that the product whose product code was read and the product whose discount information was read are not the same product, thereby enabling determination on an individual product basis and without being constrained by the positional relationship between the barcode BC and the discount sticker Y. In other words, by performing the second determination after it is determined in the first determination that the product whose product code was read and the product whose discount information was read are not the same product, the advantages of both the first and second embodiments can be obtained.

[0093] Based on the result of the second determination, the control unit 300 determines whether the product included in the second imaging data is the same product as the product identified by the product code entered in the input unit 3001 (S34). If the second determination determines that they are the same product (Y in S34), the control unit 300 proceeds to the process in S9. If the second determination does not determine that they are the same product (N in S34), the control unit 300 proceeds to the process in S14.

[0094] According to the third embodiment, the registration device 20, like the first and second embodiments, can suppress fraudulent activity by customer C regarding discounted sales, even if it is a registration device in which product registration is performed by customer C.

[0095] In addition, according to the third embodiment, it is possible to determine on an individual item basis whether the product from which the product code has been read and the product from which the discount information has been read are the same product, and there are no constraints on the positional relationship between the barcode BC attached to the product and the discount sticker Y.

[0096] As described above, the registration device of the above embodiment includes: a reading unit that reads product identification information that identifies a product from a code symbol attached to a product and reads bonus information related to the bonus of the product from a bonus symbol attached to the product; an imaging unit that images an imaging area including the readable area of ​​the reading unit; an extraction unit that extracts identification data corresponding to the product identification information read by the reading unit from a memory unit that stores the product identification information and identification data related to the product image in association; an acquisition unit that acquires imaging data captured by the imaging unit when the reading unit reads the bonus information; a determination unit that determines, based on the identification data extracted by the extraction unit, whether the product included in the imaging data acquired by the acquisition unit is the same product as the product identified by the product identification information read by the reading unit; and a registration unit that, if the determination unit determines that they are the same product, registers transaction information related to the transaction of the product identified by the product identification information based on the product identification information and bonus information read by the reading unit.

[0097] This makes it possible to deter fraudulent activity by customer C regarding discounted sales, even if the registration device is operated by customer C. Furthermore, there are no restrictions on the relative positions of the barcode BC attached to the product and the discount sticker Y.

[0098] Furthermore, the registration device of the above embodiment includes: a reading unit that reads product identification information that identifies a product from a code symbol attached to the product and reads bonus information relating to the bonus of the product from a bonus symbol attached to the product; an imaging unit that images an imaging area including the readable area of ​​the reading unit; an acquisition unit that acquires first imaging data captured by the imaging unit when the reading unit reads the product identification information and second imaging data captured by the imaging unit when the reading unit reads the bonus information; a determination unit that determines whether the product included in the first imaging data is the same product as the product included in the second imaging data; and a registration unit that, if the determination unit determines that they are the same product, registers transaction information relating to the transaction of the product identified by the product identification information based on the product identification information and bonus information read by the reading unit.

[0099] This makes it possible to deter fraudulent activity by customer C regarding discounted sales, even if the registration device is operated by customer C.

[0100] Furthermore, the determination unit of the registration device in the above embodiment determines that the product included in the first image data is the same product as the product included in the second image data if the second image data includes the same image area as the image area including the code symbol and the reward symbol in the first image data.

[0101] This allows for individual determination of whether the product code read and the product information read are the same product, thereby further deterring fraudulent activity by customer C.

[0102] In addition, the reading unit of the registration device in the above embodiment reads flag information indicating that a label showing the bonus information is attached to the product, and if the reading unit does not read the bonus information even after a predetermined time has elapsed since the reading unit read the flag information, the registration unit does not register the transaction information of the product identified by the product identification information.

[0103] This will help to further deter fraudulent activity by customer C.

[0104] In the above embodiment, the control programs executed by the tablet terminal 30, scanner 40, and store server 3 may be provided by recording them on a computer-readable recording medium such as a CD-ROM. Alternatively, the control programs executed by each device in the above embodiment may be stored on a computer connected to a network such as the Internet and provided by downloading them via the network, or they may be provided via a network such as the Internet.

[0105] Although embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. For example, in each embodiment, the registration device 20 is configured with a tablet terminal 30 and a scanner 40, but a smartphone with a camera function can also be used as a registration device by installing an application program for product registration on the smartphone. Furthermore, some or all of the processing performed by the tablet terminal 30 based on the information read by the scanner 40 may be performed on a cloud server or the like. Moreover, in each of the above embodiments, a flag sticker Z is used to prompt customer C to read the discount sticker Y, but the flag sticker Z is not required. It is also possible to provide a camera separately from the scanner 40 and use the camera as an imaging unit.

[0106] Furthermore, this embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0107] 20 Registered devices 30. Tablet devices (information processing devices) 40 Scanner (reading unit) 41 Camera (imaging unit) 310 Memory section 3001 Input section 3002 Acquisition Department 3003 Extraction part 3004 Judgment section 3005 Registration Department [Prior art documents] [Patent Documents]

[0108] [Patent Document 1] Japanese Patent Publication No. 2016-177419

Claims

1. A reading unit reads product identification information that identifies the product from the code symbol attached to the product, and also reads bonus information related to the bonus of the product from the bonus symbol attached to the product. An imaging unit that images an imaging area including the readable area of ​​the aforementioned reading unit, An acquisition unit that acquires first image data captured by the imaging unit when the reading unit reads product identification information, and second image data captured by the imaging unit when the reading unit reads bonus information, A determination unit that determines whether the product included in the first imaging data is the same product as the product included in the second imaging data, If the determination unit determines that the products are the same, the registration unit registers transaction information relating to the transaction of the product identified by the product identification information, based on the product identification information and the benefit information read by the reading unit. Equipped with, The determination unit is a registration device that determines that the product included in the first imaging data is the same product as the product included in the second imaging data if the second imaging data includes the same image area as the image area including the code symbol and the special symbol in the first imaging data.

2. The reading unit reads flag information indicating that a label showing bonus information is attached to the product. The registration unit shall not register the transaction information of the product identified by the product identification information if the reading unit does not read the benefit information even after a predetermined time has elapsed since the reading unit read the flag information. The registration device according to claim 1.

3. A reading unit reads product identification information that identifies the product from a code symbol attached to the product, and a reading unit reads bonus information relating to the bonus of the product from a bonus symbol attached to the product, and an input unit into which the product identification information and the bonus information are input. An acquisition unit acquires imaging data of an imaging area including the readable area of ​​the reading unit, which includes first imaging data captured when the reading unit reads product identification information, and second imaging data captured when the reading unit reads bonus information. A determination unit that determines whether the product included in the first imaging data is the same product as the product included in the second imaging data, If the determination unit determines that the products are the same, the registration unit registers transaction information relating to the transaction of the product identified by the product identification information, based on the product identification information and the benefit information entered into the input unit. Equipped with, The determination unit determines that if the second imaging data contains the same image area as the first imaging data containing the code symbol and the special offer symbol, the product included in the first imaging data is the same product as the product included in the second imaging data.

4. A program for controlling a registration device by computer, comprising: a reading unit that reads product identification information to identify a product from a code symbol attached to a product and reads bonus information related to the bonus for the product from a bonus symbol attached to the product; and an imaging unit that images an imaging area including the readable area of ​​the reading unit, The aforementioned computer, An acquisition unit that acquires first image data captured by the imaging unit when the reading unit reads product identification information, and second image data captured by the imaging unit when the reading unit reads bonus information, A determination unit that determines whether the product included in the first imaging data is the same product as the product included in the second imaging data, If the determination unit determines that the products are the same, the registration unit registers transaction information relating to the transaction of the product identified by the product identification information, based on the product identification information and the benefit information read by the reading unit. and make it work The determination unit is a program that determines that if the second image data contains the same image area as the image area containing the code symbol and the special offer symbol in the first image data, then the product included in the first image data is the same product as the product included in the second image data.

5. A program for controlling an information processing device with a computer, The aforementioned computer, A reading unit reads product identification information that identifies the product from a code symbol attached to the product, and a reading unit reads bonus information related to the bonus of the product from a bonus symbol attached to the product. An input unit receives the product identification information and the bonus information from the reading unit. An acquisition unit acquires imaging data of an imaging area including the readable area of ​​the reading unit, which includes first imaging data captured when the reading unit reads product identification information, and second imaging data captured when the reading unit reads bonus information. A determination unit that determines whether the product included in the first imaging data is the same product as the product included in the second imaging data, If the determination unit determines that the products are the same, the registration unit registers transaction information relating to the transaction of the product identified by the product identification information, based on the product identification information and the benefit information entered into the input unit. and make it work The determination unit is a program that determines that if the second image data contains the same image area as the image area containing the code symbol and the special offer symbol in the first image data, then the product included in the first image data is the same product as the product included in the second image data.

Images