Registration device, information processing device, and program

Abstract

To provide a registration device, an information processor, and a program capable of increasing the effectiveness of controlling fraudulent activities related to discount sales.SOLUTION: A registration device includes: a reading unit that reads item identification information from a code symbol and privilege information from a privilege symbol; an image capturing unit that captures an image of an image capturing area that includes a readable area of the reading unit; an extraction unit that extracts identification data corresponding to the item identification information from a memory unit that stores the item identification information and identification data pertaining to an item image in correspondence therewith; an acquisition unit that acquires the image data captured by the image capturing unit at the time of reading the privilege information; a determination unit that determines, based on the identification data extracted by the extraction unit, whether or not the item included in the image data acquired by the acquisition unit is the same item as the one read by the reading unit; and a registration unit that registers transaction information for the item identified by the item identification information based on the item identification information and the privilege information.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] An embodiment of the present invention relates to a registration device, an information processing device, and a program. [Background technology]

[0002] Conventionally, in stores such as supermarkets, for example, fresh food products are sold at a discount by deducting a certain amount from the list price, or at a discount by deducting a certain percentage from the list price. In the following explanation, discounts and discounts are collectively referred to as "discounts," and discount sales and discount sales are collectively referred to as "discount sales."

[0003] When selling at a discount, the store attaches discount stickers with the discount amount and other information printed on them to the products so that customers can recognize the discount information. A registration device that registers product information for accounting purposes reads a product code that identifies the product from a barcode or other code attached to the product. The registration device also reads the discount information from character information such as the printed discount amount, or a barcode showing the discount information printed together with the character information. The registration device then registers transaction information including the product information (product name, price, etc.) and the discount information obtained based on the read product code (hereinafter also referred to as "product registration").

[0004] On the other hand, in recent years, due to the labor shortage in stores, registration devices operated by customers who purchase products have been put into practical use. As this type of registration device, for example, self-POS (Point Of Sales) terminals and cart POS terminals are known.

[0005] A self-service POS terminal is installed at the checkout area of ​​a store, and allows customers to register products they bring in and pay for them themselves. A cart POS terminal is equipped with a scanner and an information terminal in a shopping cart, and allows customers to register products using the scanner in the sales area. Transaction information regarding the transaction of registered products is transferred to an accounting device that processes the transaction when the customer pays the price. It is also known that, instead of the tablet terminal and scanner, products are registered using a mobile terminal such as a smartphone owned by the customer.

[0006] In this type of registration device, since product registration is left to the customer, fraudulent acts by customers regarding discount sales may occur. For example, a scanner may read the product code of a product that is not subject to discount, and then a discount sticker attached to another product may be read to register the product. In order to prevent such fraud, a device has been proposed that prevents fraud by checking the past transaction history of the product when registering the product using a registration device (for example, Patent Document 1).

[0007] However, the above-mentioned conventional technology does not check the discount stickers attached to the products that customers purchase, and therefore is not effective in preventing fraudulent activities. Summary of the Invention [Problem to be solved by the invention]

[0008] The problem to be solved by the present invention is to provide a registration device, an information processing device, and a program that can increase the effectiveness of suppressing fraudulent activities related to discount sales. [Means for solving the problem]

[0009] The registration device of the embodiment includes a reading unit that reads product identification information that identifies a product from a code symbol attached to the product and reads bonus information related to a bonus of the product from a bonus symbol attached to the product, an imaging unit that images an imaging area including a readable area of ​​the reading unit, an extraction unit that extracts identification data corresponding to the product identification information read by the reading unit from a memory unit that stores the product identification information in correspondence with identification data related to a product image, an acquisition unit that acquires imaging data captured by the imaging unit when the reading unit reads the bonus information, a determination unit that determines whether the product included in the imaging data acquired by the acquisition unit is the same product as the product identified by the product identification information read by the reading unit based on the identification data extracted by the extraction unit, and a registration unit that registers transaction information related to the transaction of the product identified by the product identification information based on the product identification information and the bonus information read by the reading unit when the determination unit determines that they are the same product. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an overview of a transaction system including a registration device according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing the appearance of a shopping cart to which the registration device of the first embodiment is attached. [Diagram 3] FIG. 3 is a diagram showing a product to which a discount sticker used in the first embodiment is attached. [Figure 4] FIG. 4 is a block diagram showing a hardware configuration of a registration device including an information processing device according to the first embodiment. [Diagram 5] FIG. 5 is a diagram showing a data configuration of a product master stored in a memory unit in the information processing device of the first embodiment. [Figure 6] FIG. 6 is a block diagram illustrating a functional configuration of a control unit in the information processing apparatus according to the first embodiment. [Figure 7] FIG. 7 is a flowchart showing the flow of the registration process by the control unit in the information processing apparatus of the first embodiment. [Figure 8] FIG. 8 is a block diagram illustrating a functional configuration of a control unit in an information processing apparatus according to the second embodiment. [Figure 9] FIG. 9 is a diagram showing an example of image data captured by an imaging unit when the reading unit reads commodity identification information according to the second embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of imaging data captured by an imaging unit when the reading unit reads bonus information according to the second embodiment. [Figure 11] FIG. 11 is a flowchart showing the flow of the registration process by the control unit in the information processing apparatus of the second embodiment. [Figure 12] FIG. 12 is a flowchart showing the flow of registration processing by the control unit in the information processing apparatus of the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, a registration device, an information processing device, and a program according to an embodiment will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. For example, in the embodiment described below, an example in which the registration device is configured with a tablet terminal and a scanner will be described, but the registration device may be a single information device having a function of reading product information, a function of registering transaction information, and an imaging function, and may be configured, for example, with a smartphone or the like on which an application program for product registration is installed.

[0012] (First embodiment) The registration device, information processing device, and program of the first embodiment will be described below with reference to the drawings. FIG. 1 is a diagram showing an outline of an accounting system including a registration device. An accounting system 1 of this embodiment is applied to, for example, a supermarket that sells fresh food items that are subject to discount sales. The accounting system 1 comprises multiple accounting devices 2, a store server 3, and multiple shopping carts 10 to which registration devices 20 are attached. The accounting devices 2 and the store server 3 are connected to each other so as to be able to communicate with each other via a network such as a LAN (Local Area Network). In addition, each registration device 20 is connected to the accounting device 2 and the store server 3 so as to be able to communicate with each other via a wireless LAN or the like.

[0013] The accounting device 2 is a so-called self-service accounting device where, for example, the customer C performs the accounting operation himself. The accounting device 2 executes accounting processing related to payment by cash payment or cashless payment such as credit card payment based on the transaction information received from the registration device 20. The accounting processing is processing for making payment for the products purchased by the customer C. The accounting device 2 may also be a POS terminal operated by a store clerk.

[0014] The store server 3 receives payment information related to the payment method and product information of the products paid for in the transaction from each accounting device 2. The store server 3 also receives sales information indicating the sales amount for a predetermined period (e.g., one day) from each accounting device 2. The store server 3 centrally manages the product information, payment information, sales information, etc. received from each accounting device 2, and performs sales management for one store. The store server 3 also stores a product master that associates product codes with product information (product name, price, identification data, etc.) for products handled in the store, and transmits this to the registration device 20 as appropriate.

[0015] The shopping cart 10 is placed in the sales floor of a store and is used to transport products purchased by a customer C. While pushing the shopping cart 10 around the sales floor, the customer C registers the products to be purchased in a registration device 20 and places the products in a basket (not shown) placed on the shopping cart 10.

[0016] FIG. 2 is a diagram showing the appearance of a shopping cart 10 to which a registration device 20 is attached. The shopping cart 10 is equipped with a handle 11, a basket placement section 12, and casters 13, and is equipped with a registration device 20. The handle 11 is for a customer C to hold and move the shopping cart 10. The basket placement section 12 has two levels, an upper level and an lower level, and each level can be used to place a basket for storing products to be purchased by the customer C. The basket may be provided integrally with the shopping cart 10. The casters 13 are provided at the four corners of the lower part of the shopping cart 10. The casters 13 rotate individually, allowing the shopping cart 10 to move freely within the store. The shopping cart 10 is a moving object equipped with a registration device 20.

[0017] The registration device 20 registers transaction information for goods, and includes a tablet terminal 30 and a scanner 40 with a camera 41 (see FIG. 4). The transaction information is information necessary for the customer C to make payment for the goods he purchases, and includes product information (product name, price, etc.) and benefit information (discount amount, etc.). Discount information relating to the discount amount, etc., is an example of benefit information. The benefit information is not limited to discount information, and may be, for example, information indicating the granting of special points.

[0018] The tablet terminal 30 includes a display 31, a touch panel 32, and a card reader 33. The tablet terminal 30 is an example of an information processing device.

[0019] The display 31 is, for example, a liquid crystal panel, and functions as a display unit that displays various information. For example, the display 31 displays product information of registered products, controls to be operated by the customer C who is the user, and the like.

[0020] The touch panel 32 is provided on the surface of the display 31 and inputs information according to the touched position to the control unit 300 (see FIG. 4) of the tablet terminal 30, and functions as an operation input unit that inputs information according to operations by the user, customer C. The touch panel 32 inputs, for example, accounting instructions to the control unit 300 to instruct the accounting device 2 to send transaction information.

[0021] The card reader 33 reads a membership code from a medium such as a membership card or a point card of the customer C. If the registration device 20 has a payment function, the card reader 33 can also read credit information from, for example, the credit card of the customer C. The card reader 33 may be a magnetic card reader that reads information from a magnetic card, or an IC card reader that reads information from a card with an embedded IC chip.

[0022] The scanner 40 is provided on the handle 11 of the shopping cart 10. The scanner 40 is formed with a reading window 42. The camera 41 captures an image of an imaging area including a reading area where the scanner 40 can read product codes and discount information, using a method to be described later. For example, the camera 41 captures an image of a product held over the reading window 42 and a barcode attached to the product.

[0023] The scanner 40 reads product identification information for identifying a product from a code symbol attached to the product. The scanner 40 reads a product code for identifying the product from a barcode BC printed on a product label X attached to the product shown in FIG. 3, for example. Specifically, the scanner 40 reads information indicated by the barcode BC based on an image captured by the camera 41 of the barcode BC located in a readable area of ​​the scanner 40. More specifically, when the barcode BC attached to the product to be purchased by the customer C is placed in a readable area facing the reading window 42, the camera 41 captures an image including the barcode BC. The scanner 40 extracts and decodes the barcode BC from a predetermined area of ​​the image captured by the camera 41 by pattern recognition or the like, and reads the product code indicated by the barcode BC. The barcode BC is an example of a code symbol, and the product code is an example of product identification information.

[0024] The scanner 40 also reads bonus information related to the bonus of the product from a bonus symbol attached to the product. For example, when a discount sticker Y attached to a product to be purchased by a customer C is placed in a readable area facing the reading window 42, the camera 41 captures an image including the discount sticker Y. The scanner 40 extracts the discount sticker Y from a predetermined area of ​​the image captured by the camera 41 by pattern recognition or the like, and reads the character information printed on the discount sticker Y by character recognition processing such as OCR (Optical Character Reader), or recognizes the discount amount or discount rate shown on the discount sticker by image recognition processing. The discount sticker Y on which characters indicating the content of the discount are printed is an example of a bonus symbol.

[0025] As described above, the scanner 40 is an example of a reading unit that reads a product code (product identification information) that identifies the product from a barcode (code symbol) attached to the product, and also reads bonus information related to the bonus of the product from a discount sticker Y (bonus symbol) attached to the product. The camera 41 is an example of an imaging unit.

[0026] Here, an example of a process for reading bonus information related to a product bonus will be described. First, the scanner 40 reads flag information indicating that a label indicating bonus information is attached to the product. Specifically, the scanner 40 reads the flag information by detecting a flag sticker Z (see FIG. 3) from an image captured when reading the barcode BC on the product label. The scanner 40 detects the flag sticker Z by performing image processing to detect a predetermined shape (a double circle in this embodiment) from the captured image. The information indicated by the flag sticker Z is an example of flag information.

[0027] The flag sticker Z is attached adjacent to the barcode BC indicating the product code according to the store's operations. This is so that when the customer C brings the barcode BC close to the reading window 42 to have the product code read, the scanner 40 can recognize not only the barcode BC but also the flag sticker Z. This allows the scanner 40 to display on the display 31 a message urging the customer C to read the discount sticker Y, preventing the customer C from forgetting to read the discount information.

[0028] 3, the flag sticker Z is provided integrally with the discount sticker Y, but it may be attached separately from the discount sticker Y. For example, when the barcode BC is attached to the back side of the product, the flag sticker Z is attached to the back side of the product in close proximity to the barcode BC, and the discount sticker Y is attached to the front side of the product so that the customer C can easily recognize that it is a discounted product.

[0029] When the scanner 40 reads the flag information from the flag sticker Z, it then reads the discount information from the discount sticker Y. The scanner 40 captures an image including the discount sticker Y with the camera 41, detects the discount sticker Y from a specific area of ​​the captured image, and reads the discount information indicated by the text information on the discount sticker. The scanner 40 also outputs the image including the discount sticker Y captured by the camera 41 to the tablet terminal 30.

[0030] At least one of the process of reading information indicated by the barcode BC from an image captured by the camera 41 (hereinafter also referred to as a barcode reading process), the process of reading information indicated by the flag sticker Z (hereinafter also referred to as a flag sticker reading process), and the process of reading information indicated by the discount sticker Y (hereinafter also referred to as a discount sticker reading process) may be performed by the control unit 300 of the tablet terminal 30. In this case, the reading unit is configured to include the scanner 40 and the control unit 300.

[0031] In the following description, the scanner 40 reading the product code from the barcode BC will be referred to as "reading the barcode BC," reading flag information from the flag sticker Z will be referred to as "reading the flag sticker Z," and reading discount information from the discount sticker Y will be referred to as "reading the discount sticker Y."

[0032] 4 is a block diagram showing a hardware configuration of the registration device 20. As described above, the registration device 20 includes the tablet terminal 30 and the scanner 40. The tablet terminal 30 includes a control unit 300, a memory unit 310, a display 31, a touch panel 32, a card reader 33, and a communication unit 320. The control unit 300, the memory unit 310, the display 31, the touch panel 32, the card reader 33, and the communication unit 320 are connected to each other via a bus 330 or the like.

[0033] The control unit 300 is configured as a computer including a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, and a RAM (Random Access Memory) 303. The CPU 301, the ROM 302, and the RAM 303 are connected to each other via a bus 330.

[0034] The CPU 301 controls the overall operation of the tablet terminal 30. The ROM 302 stores various programs, such as a program used to drive the CPU 301, and various data. The RAM 303 includes a transaction information storage unit 304. The transaction information storage unit 304 is an area for storing transaction information based on the product code and discount information read by the scanner 40 in one transaction. The RAM 303 is also used as a work area for the CPU 301, and loads various programs and data stored in the ROM 302 and the memory unit 310. The control unit 300 executes various control processes for the tablet terminal 30 by the CPU 301 operating in accordance with the control programs stored in the ROM 302 and the memory unit 310 and loaded in the RAM 303.

[0035] The memory unit 310 is configured with a storage medium such as a hard disk drive (HDD) or a flash memory, and maintains the stored contents even when the power is cut off. The memory unit 310 stores a control program 311 and a product master 312.

[0036] The control program 311 is a program for realizing functions such as registering products based on product codes and discount information read by the scanner 40, and determining whether the discount information read by the scanner 40 is correct based on image data captured by the camera 41.

[0037] The product master 312 is a master file that stores information about products handled in the store, and is received from the store server 3 via the communication unit 320. Since the products handled in the store change daily, the product master 312 is appropriately updated based on the information from the store server 3. Fig. 5 is a diagram showing the data configuration of the product master 312. The product master 312 associates each piece of information indicating the product code, product name, price, and feature amount.

[0038] A product code for identifying a product is registered in the product code field. Information indicating the name of the product is registered in the product name field. Information indicating the unit price of the product is registered in the price field. The unit price of the product may be the product's base price or the price including consumption tax. Information registered in the feature field is information indicating features for generic object recognition for identifying a product from imaging data (frame image). Information indicating features is data for matching indicating features of the appearance of a product image, such as data relating to the color, external shape, and uneven surface shape of the product. The information stored in the feature field is an example of identification data related to a product image.

[0039] Returning to Fig. 4, the explanation will be given below. The configurations and functions of the display 31, touch panel 32, and card reader 33 are as described above. The communication unit 320 is an interface for communicating with the scanner 40 and the store server 3. The control unit 300 is connected to each device of the scanner 40 and the store server 3 via the communication unit 320, thereby enabling transmission and reception of information (data) with each device.

[0040] Next, the functional configuration of the control unit 300 of the tablet terminal 30 will be described. Fig. 6 is a block diagram showing the functional configuration of the control unit 300 of the tablet terminal 30. The control unit 300 functions as an input unit 3001, an acquisition unit 3002, an extraction unit 3003, a determination unit 3004, a registration unit 3005, a notification unit 3006, and an output unit 3007, as a result of the CPU 301 operating in accordance with a control program stored in the ROM 302 or memory unit 310. Each of these functions may be configured by hardware such as a dedicated circuit.

[0041] The input unit 3001 receives input of product identification information for identifying a product and bonus information related to a bonus for the product from the scanner 40, which reads the product identification information and the bonus information. Specifically, the input unit 3001 receives input of a product code read by the scanner 40 from a barcode BC attached to the product. The input unit 3001 also receives input of discount information read by the scanner 40 from a discount sticker Y attached to the product. Furthermore, the input unit 3001 receives input of flag information read by the scanner 40 from a flag sticker Z and various information associated with the operation of the touch panel 32 by the customer C.

[0042] The acquisition unit 3002 acquires imaging data captured by the camera 41 when the scanner 40 reads the bonus information. Specifically, the acquisition unit 3002 acquires imaging data captured by the camera 41 of a product so that the scanner 40 can read the discount information on the discount sticker Y. The imaging data acquired by the acquisition unit 3002 is a product image of the product including the discount sticker Y.

[0043] The extraction unit 3003 extracts identification data corresponding to the product identification information read by the scanner 40 from the memory unit 310 in which the product identification information and the identification data related to the product image are stored in association with each other. Specifically, the extraction unit 3003 reads out the feature amount corresponding to the product code input to the input unit 3001 from the memory unit 310 in which the product master 312 in which the product code is associated with information for collation indicating the feature amount of the appearance of the product (hereinafter also simply referred to as the feature amount) is stored. The extraction unit 3003 outputs the read out feature amount to the determination unit 3004. The memory unit 310 in which the product master 312 is stored may be provided in an external device such as the store server 3.

[0044] The determination unit 3004 determines whether or not the commodity included in the imaging data acquired by the acquisition unit 3002 is the same as the commodity identified by the commodity identification information read by the scanner 40, based on the identification data extracted by the extraction unit 3003. Specifically, the determination unit 3004 extracts a feature amount of the commodity included in the imaging data acquired by the acquisition unit 3002 from the imaging data acquired by the acquisition unit 3002, compares it with the feature amount extracted from the memory unit 310 by the extraction unit 3003, and calculates a similarity. The determination unit 3004 determines whether or not the commodity included in the imaging data acquired by the acquisition unit 3002 is the same as the commodity identified by the commodity code input to the input unit 3001, based on the calculated similarity. In other words, it determines whether or not the commodity whose discount sticker Y is read by the scanner 40 is the same as the commodity whose barcode BC is read. For example, the determination unit 3004 determines that the two commodities are the same when the calculated similarity is equal to or greater than a predetermined set value. The extraction of the feature amount of the product from the captured image data acquired by the acquisition unit 3002 is realized using a known image recognition technique such as general object recognition.

[0045] When the determination unit 3004 determines that the products are the same product, the registration unit 3005 registers transaction information related to the transaction of the product identified by the product identification information based on the product identification information and the bonus information read by the scanner 40. Specifically, when the determination unit 3004 determines that the product included in the imaging data acquired by the acquisition unit 3002 is the same product as the product identified by the product code input to the input unit 3001, the registration unit 3005 stores transaction information in which the product information and the discount information are associated in the transaction information storage unit 304. When the determination unit 3004 determines that the products are not the same product, the registration unit 3005 determines that a discount sticker different from the discount sticker attached to the product whose product code the scanner 40 read has been read, and does not store the transaction information in the transaction information storage unit 304.

[0046] Furthermore, when the scanner 40 does not read the flag information, the registration unit 3005 stores the transaction information in the transaction information storage unit 304 as if the product identified by the product identification information does not have a special offer. Specifically, when the flag information is not input to the input unit 3001 together with the product code, the registration unit 3005 determines that the product identified by the product code is not a discounted product, and stores the product information in the transaction information storage unit 304 as transaction information. Product information such as product name and price is acquired from the product master 312 based on the product code input to the input unit 3001. Note that when a product code is input to the input unit 3001, the registration unit 3005 may output an inquiry about product information based on the product code to the store server 3 that stores the product master 312, and acquire the product information from the store server 3. In this case, the memory unit 310 does not need to store the product master 312. The registration unit 3005 storing (registering) the transaction information in the transaction information storage unit 304 is called product registration.

[0047] Furthermore, if scanner 40 does not read bonus information even after a predetermined time has elapsed since scanner 40 reads flag information, registration unit 3005 does not register transaction information of the product identified by the product identification information. Specifically, if discount information is not input to input unit 3001 even after a predetermined time has elapsed since flag information was input to input unit 3001, registration unit 3005 determines that there is a possibility that a discount sticker different from the discount sticker attached to the product identified by the input product code will be read, and does not register the product.

[0048] The notification unit 3006 notifies the customer C of an error message when the determination unit 3004 determines that the product included in the imaging data acquired by the acquisition unit 3002 is not the same product as the product identified by the product code input to the input unit 3001. For example, the notification unit 3006 displays a message on the display 31 urging the customer C to register the product again. The notification by the notification unit 3006 may be by voice. The notification unit 3006 also issues a notification urging the customer C to re-register the product when discount information is not input to the input unit 3001 even after a predetermined time has elapsed despite flag information being input to the input unit 3001.

[0049] When a transaction instruction is input to the input unit 3001 via the touch panel 32, the output unit 3007 outputs the transaction information for one transaction stored in the transaction information storage unit 304 to the accounting device 2. Upon receiving the transaction information, the accounting device 2 can carry out the transaction process.

[0050] The operation of the registration device 20 based on the above configuration will be described below.

[0051] First, the control unit 300 judges whether or not a product code has been input to the input unit 3001 (S1), and if not (N in S1), returns to the process of S1 and waits. In other words, the control unit 300 judges whether or not the scanner 40 has read the product code from the barcode BC attached to the product.

[0052] When a product code is input to the input unit 3001 (Y in S1), the control unit 300 judges whether or not flag information has been input to the input unit 3001 (S2). In other words, the control unit 300 judges whether or not the scanner 40 has read the flag information from the flag sticker Z attached to the product.

[0053] When flag information is input to the input unit 3001 (Y in S2), the control unit 300 outputs an instruction signal to the display 31 to display a message encouraging the customer C to read the discount sticker Y (S3). The display 31 to which the instruction signal is input displays a message encouraging the customer C to read the discount sticker Y. The control unit 300 then determines whether discount information has been input to the input unit 3001 (S4). In other words, the control unit 300 determines whether the scanner 40 has read the discount information from the discount sticker Y affixed to the product.

[0054] When discount information is input to the input unit 3001 (Y in S4), the acquisition unit 3002 acquires image data obtained when the discount sticker is read, that is, image data obtained by the camera 41 capturing an image of the product so that the scanner 40 can read the discount information on the discount sticker Y (S5). Next, the extraction unit 3003 refers to the product master 312 and extracts features that are identification data corresponding to the product code input to the input unit 3001 (S6).

[0055] Next, the determination unit 3004 compares the feature amount of the product image included in the imaging data acquired by the acquisition unit 3002 with the feature amount extracted by the extraction unit 3003 from the product master 312, and determines whether or not the product included in the imaging data acquired by the acquisition unit 3002 is the same product as the product identified by the product code input to the input unit 3001 (S7). The control unit 300 determines whether or not the determination unit 3004 has determined that the product included in the imaging data and the product identified by the product code input to the input unit 3001 are the same product (S8).

[0056] If the determination unit 3004 determines that the products are the same (Y in S8), the registration unit 3005 registers the products (S9). That is, the registration unit 3005 registers in the transaction information storage unit 304 the product information obtained from the product master 312 based on the product code input to the input unit 3001 and the discount information input to the input unit 3001 in association with each other.

[0057] Next, the control unit 300 determines whether a checkout instruction has been input to the input unit 3001 (S10), and if not (N in S10), returns to the process of S1 and waits until the next product code is input. If a checkout instruction is input (Y in S10), the output unit 3007 outputs the transaction information for one transaction stored in the transaction information storage unit 304 to the checkout device 2 (S11). Following the output of the transaction information by the output unit 3007, the control unit 300 erases the transaction information for one transaction stored in the transaction information storage unit 304 (S12), and ends the registration process.

[0058] If flag information is not input in the process of S2 (N in S2), the control unit 300 skips the processes of S3 to S8 and proceeds to the process of S9. If flag information is not input, the registration unit 3005 determines that the product whose product code has been input is not a discounted product and registers the product. In this case, the registration unit 3005 registers the product information obtained from the product master 312 based on the input product code as transaction information in the transaction information storage unit 305. In other words, the transaction information does not include discount information.

[0059] Also, if discount information is not input to the input unit 3001 in the process of S4 (N in S4), the control unit 300 judges whether a predetermined time has passed since the product code was input to the input unit 3001 (S13). If the predetermined time has not passed (N in S13), the control unit 300 returns to the process of S3. If the predetermined time has passed (Y in S13), the notification unit 3006 judges that the customer C has put the product in the basket without having the discount information read, and displays an error message on the display 31 (S14). The displayed error message is, for example, a message such as "Discount information could not be read. Please re-register the product", which urges the customer to re-register the product. Then, the control unit 300 proceeds to the process of S10. If it is judged in S8 that the product is not the same (N in S8), the control unit 300 proceeds to the process of S14. In this case, since the input discount information may be based on fraudulent activity, the notification unit 3006 displays an error message to urge the customer to re-register the product.

[0060] The accounting device 2 receives transaction information for one transaction from the tablet terminal 30 through the above registration process, and executes the accounting process based on the transaction information.

[0061] According to the first embodiment, when the registration device 20 determines that the product whose product code is read by the scanner 40 and the product whose discount information is read are the same, the registration device 20 registers the product as valid discount information. When the registration device 20 determines that the product whose product code is read by the scanner 40 and the product whose discount information is read are not the same, the registration device 20 invalidates discount information, does not register the product, and prompts the customer C to reregister the product. This makes it possible to prevent fraudulent acts by the customer C regarding discount sales, even in a registration device where the product is registered by the customer C.

[0062] Furthermore, according to the first embodiment, even if the discount sticker Y is attached to a product at a position away from the product label X having the barcode BC, it is possible to determine whether the product from which the barcode BC is read and the product from which the discount sticker Y is read are the same product. In other words, since the attachment position of the discount sticker Y is not limited, it is possible to attach the discount sticker Y to the front of the product so that the customer C can easily see it, even if the product has the barcode BC attached to the back side.

[0063] Second embodiment Next, a second embodiment will be described. The second embodiment differs from the first embodiment in that the scanner 40 determines whether the product whose product code is read by the scanner 40 and the product whose discount information is read by the scanner 40 are the same as each other by comparing the first image data obtained when the scanner 40 reads the barcode BC with the second image data obtained when the scanner 40 reads the discount sticker Y. Hereinafter, the description of the same configuration and function as the first embodiment may be omitted. This is to avoid the following description from being unnecessarily redundant and to facilitate understanding by those skilled in the art.

[0064] The hardware configuration of the accounting system 1, including the registration device 20, is the same as in the first embodiment, so we will first explain the functional configuration of the control unit 300 of the tablet terminal 30. Fig. 8 is a block diagram showing the functional configuration of the control unit 300 of the tablet terminal 30. The control unit 300 functions as an input unit 3001, an acquisition unit 3002, a determination unit 3004, a registration unit 3005, a notification unit 3006, and an output unit 3007, as a result of the CPU 301 operating in accordance with a control program stored in the ROM 302 or memory unit 310. Each of these functions may be configured using hardware such as a dedicated circuit.

[0065] The acquiring unit 3002 acquires first imaging data captured by the camera 41 when the scanner 40 reads the commodity identification information, and second imaging data captured by the camera 41 when the scanner 40 reads the bonus information. Specifically, the acquiring unit 3002 acquires first imaging data which is a frame image including a commodity with a barcode BC attached, captured by the camera 41 when the scanner 40 reads the barcode BC. The acquiring unit 3002 also acquires second imaging data which is a frame image including a commodity with a discount sticker Y attached, captured by the camera 41 when the scanner 40 reads the discount sticker Y. The discount sticker Y attached to the commodity is attached in close proximity to the barcode BC.

[0066] Fig. 9 is a diagram showing an example of the first imaging data, and Fig. 10 is a diagram showing an example of the second imaging data. Figs. 9 and 10 show the relationship between the imaging area and the reading area of ​​the camera 41. In Figs. 9 and 10, the outer frame is imaging area A that the camera 41 captures in one frame. In the center of imaging area A, a reading area B in which a product code and discount information can be read is set. Imaging area A is an image area in which the camera 41 captures an imaging area facing the reading window 42 of the scanner 40, and reading area B is an image area in which the camera 41 captures an imaging area facing the reading window 42.

[0067] Scanner 40 is set to be capable of reading information on barcode BC and discount label Y contained in reading area B, but not to read information on barcode BC and discount label Y contained in imaging area A outside reading area B. Scanner 40 is also set to be capable of reading information on flag label Z contained in imaging area A. In other words, the product code indicated by barcode BC and the discount information indicated by discount label Y can be read only within reading area B, and the flag information indicated by flag label Z can be read within imaging area A.

[0068] Returning to Fig. 8, the functional configuration of the control unit 300 of the tablet terminal 30 will be described. The determination unit 3004 determines whether or not the commodity included in the first imaging data is the same commodity as the commodity included in the second imaging data. For example, when the second imaging data includes an image area that is the same as an image area including a code symbol and a bonus symbol in the first imaging data, the determination unit 3004 determines that the commodity included in the first imaging data is the same commodity as the commodity included in the second imaging data.

[0069] More specifically, the determination unit 3004 uses an image processing technique to determine whether or not the first and second captured image data have a common image area including the barcode BC and discount sticker Y. As shown in FIG. 9 and FIG. 10, when the first and second captured image data have a common image area SA including the barcode BC and discount sticker Y, the determination unit 3004 determines that the product included in the first captured image data is the same product as the product included in the second captured image data. Since the product label X having the barcode BC and the discount sticker Y are attached by hand, the positional relationship between the barcode BC and the discount sticker Y is considered to be different for each product. Therefore, when the two images have a common image including the barcode BC and discount sticker Y, the determination unit 3004 determines that the positional relationship between the barcode BC and the discount sticker Y in the two images is the same, and determines that the products shown in both images are the same product. The determination unit 3004 may determine whether the product included in the first imaging data and the product included in the second imaging data are the same product by comparing the product image included in the first imaging data with the product image included in the second imaging data without considering the positional relationship between the barcode BC and the discount sticker Y. For example, the determination unit 3004 may determine that the products are the same product when a part of the imaging area A when the barcode BC is positioned in the reading area B and the product code is read (a range sufficient to determine that the products are the same product) is located within the imaging area A when the discount sticker Y is positioned in the reading area B and the discount information is read.

[0070] The operation of the registration device 20 based on the above configuration will be described. Fig. 11 is a flowchart showing the flow of registration processing by the control unit 300 of the tablet terminal 30. Note that the same processes as those in the first embodiment are given the same reference numerals and the description will be simplified.

[0071] First, the control unit 300 judges whether or not a product code has been input to the input unit 3001 (S1), and if not (N in S1), returns to the process of S1 and waits. If a product code has been input to the input unit 3001 (Y in S1), the control unit 300 judges whether or not flag information has been input to the input unit 3001 (S2).

[0072] When flag information is input to the input unit 3001 (Y in S2), the acquisition unit 3002 acquires the first image data, i.e., the image data captured by the camera 41 so that the scanner 40 can read the product code (S21). Next, the control unit 300 outputs an instruction signal to the display 31 to display a message prompting the reader to read the discount sticker Y (S3).

[0073] Next, the control unit 300 judges whether discount information has been input to the input unit 3001 (S4). When discount information has been input to the input unit 3001 (Y in S4), the acquisition unit 3002 acquires the second imaging data, that is, imaging data of the product captured by the camera 41 so that the scanner 40 can read the discount information on the discount sticker Y (S22).

[0074] Next, the determination unit 3004 determines whether the first captured image data and the second captured image data acquired by the acquisition unit 3002 have a common image area including the barcode BC and the discount sticker Y, thereby determining whether the product included in the first captured image data and the product included in the second captured image data are the same product (S7). The control unit 300 determines whether the determination unit 3004 has determined that the product included in the first captured image data and the product included in the second captured image data are the same product (S8).

[0075] If the determination unit 3004 determines that the products are the same (Y in S8), the registration unit 3005 registers the product (S9). Next, the control unit 300 determines whether a checkout instruction has been input to the input unit 3001 (S10), and if not (N in S10), the process returns to S1 and waits until the next product code is input. If a checkout instruction has been input (Y in S10), the output unit 3007 outputs the transaction information stored in the transaction information storage unit 304 to the checkout device 2 (S11). Following the output of the transaction information by the output unit 3007, the control unit 300 erases the transaction information for one transaction stored in the transaction information storage unit 304 (S12) and ends the registration process.

[0076] If the flag information is not input in the process of S2 (N in S2), the control unit 300 proceeds to the process of S9. If the discount information is not input to the input unit 3001 in the process of S4 (N in S4), the control unit 300 judges whether a predetermined time has elapsed since the product code was input to the input unit 3001 (S13). If the predetermined time has not elapsed (N in S13), the control unit 300 returns to the process of S3. If the predetermined time has elapsed (Y in S13), the notification unit 3006 displays an error message on the display 31 (S14). The displayed error message is, for example, a message such as "Discount information could not be read. Please re-register the product", which urges the user to re-register the product. Then, the control unit 300 proceeds to the process of S10. If it is determined in S8 that the products are not the same (N in S8), the control unit 300 proceeds to the process of S14.

[0077] According to the second embodiment, as in the first embodiment, even if the registration device is one in which the customer C registers products, it is possible to prevent fraudulent acts by the customer C regarding discount sales.

[0078] Furthermore, according to the second embodiment, it is determined whether the product whose product code has been read and the product whose discount information has been read are the same product, depending on whether a common image area SA including a barcode BC and a discount sticker Y exists in the first imaging data and the second imaging data. Therefore, the above determination can be made on an individual product basis, which further prevents fraudulent acts by customer C. For example, even if the product code of a product without a discount sticker Y is read and then the discount sticker Y attached to the same product as the product (product with the same product code) is read, the registration device 20 does not register the discount information, which further prevents fraud.

[0079] (Third embodiment) Next, a third embodiment will be described. In the third embodiment, the scanner 40 judges whether the product whose product code is read and the product whose discount information is read are the same or not by using both the judgment of the first embodiment and the judgment of the second embodiment. Hereinafter, the explanation of the same configuration and function as the first embodiment and / or the second embodiment may be omitted.

[0080] The hardware configuration of the transaction system 1, including the registration device 20, is similar to that of the first and second embodiments. Furthermore, the function of the control unit 300 of the tablet terminal 30 includes the functions of the first and second embodiments.

[0081] The operation of the registration device 20 will be described. Fig. 12 is a flowchart showing the flow of registration processing by the control unit 300 of the tablet terminal 30. Note that the same processes as those in the first embodiment and / or the second embodiment are denoted by the same reference numerals, and the description will be simplified.

[0082] First, the control unit 300 judges whether or not a product code has been input to the input unit 3001 (S1), and if not (N in S1), returns to the process of S1 and waits. If a product code has been input to the input unit 3001 (Y in S1), the control unit 300 judges whether or not flag information has been input to the input unit 3001 (S2).

[0083] When flag information is input to the input unit 3001 (Y in S2), the acquisition unit 3002 acquires the first image data, i.e., the image data captured by the camera 41 so that the scanner 40 can read the product code (S21). Next, the control unit 300 outputs an instruction signal to the display 31 to display a message prompting the reader to read the discount sticker Y (S3).

[0084] Next, the control unit 300 judges whether discount information has been input to the input unit 3001 (S4). When discount information has been input to the input unit 3001 (Y in S4), the acquisition unit 3002 acquires the second imaging data, that is, imaging data of the product captured by the camera 41 so that the scanner 40 can read the discount information on the discount sticker Y (S22).

[0085] Next, the determination unit 3004 performs a first determination (S31). The first determination, like the determination in the second embodiment, uses the first imaging data and the second imaging data to determine whether the product whose product code is read and the product whose discount information is read are the same product. The control unit 300 judges whether the determination unit 3004 has determined that the product included in the first imaging data and the product included in the second imaging data are the same product (S32).

[0086] If the determination unit 3004 determines that the products are the same (Y in S32), the registration unit 3005 registers the product (S9). Next, the control unit 300 determines whether a checkout instruction has been input to the input unit 3001 (S10), and if not (N in S10), the process returns to S1 and waits until the next product code is input. If a checkout instruction has been input (Y in S10), the output unit 3007 outputs the transaction information for one transaction stored in the transaction information storage unit 304 to the checkout device 2 (S11). Following the output of the transaction information by the output unit 3007, the control unit 300 erases the transaction information for one transaction stored in the transaction information storage unit 304 (S12) and ends the registration process.

[0087] If flag information is not input in the process of S2 (N in S2), the control unit 300 proceeds to the process of S9. If discount information is not input to the input unit 3001 in the process of S4 (N in S4), the control unit 300 judges whether a predetermined time has elapsed since the product code was input to the input unit 3001 (S13). If the predetermined time has not elapsed (N in S13), the control unit 300 returns to the process of S3. If the predetermined time has elapsed (Y in S13), the notification unit 3006 displays an error message on the display 31 (S14). The displayed error message is, for example, a message such as "Discount information could not be read. Please re-register the product", encouraging the user to re-register the product. The control unit 300 then proceeds to the process of S10.

[0088] Furthermore, if the process of S32 does not determine that the products are the same (N in S32), the extraction unit 3003 refers to the product master 312 and extracts features that are identification data corresponding to the product code input to the input unit 3001 (S6). Next, the determination unit 3004 performs a second determination (S33). As in the determination in the first embodiment, the second determination determines whether the product whose product code was read and the product whose discount information was read are the same product, using the image data (second image data) captured when the discount information was read and the features of the product image stored in the product master 312.

[0089] The reason for making a second determination when it is determined in the first determination that the product whose product code has been read and the product whose discount information has been read are not the same product is as follows.

[0090] The first judgment method has an advantage that, as described in the second embodiment, it is possible to judge whether the product whose product code is read and the product whose discount information is read are the same product on an individual basis. However, in order to judge on an individual basis, the barcode BC and the discount sticker Y need to be attached to the product in close proximity. Specifically, as shown in FIG. 9, the barcode BC and the discount sticker Y need to be placed close to each other so that at least a part of the discount sticker Y is located within the imaging area A when the barcode BC is positioned in the reading area B to read the product code. For this reason, for example, it is not necessarily suitable for products in which the barcode BC is attached on the back side of the product. This is because it is desirable to attach the discount sticker Y to the front side of the product so that the customer C can easily recognize it, and as a result, the barcode BC and the discount sticker Y are attached to the product apart from each other.

[0091] On the other hand, the second judgment method has the advantage that, as described in the first embodiment, it is possible to determine whether the product whose barcode BC has been read and the product whose discount sticker Y has been read are the same product, even if the barcode BC and discount sticker Y are attached at positions distant from each other.

[0092] Therefore, in the third embodiment, when it is determined in the first determination that the product whose product code has been read and the product whose discount information has been read are not the same product, a second determination is performed, thereby making it possible to perform a determination on an individual product basis and without being restricted by the positional relationship between the barcode BC and the discount sticker Y. In other words, by performing the second determination after it is determined in the first determination that the product whose product code has been read and the product whose discount information has been read are not the same product, it is possible to obtain the advantages of the first embodiment and the second embodiment.

[0093] The control unit 300 judges whether or not the product included in the second imaging data is the same product as the product identified by the product code input to the input unit 3001 as a result of the second judgment (S34). If the second judgment judges that they are the same product (Y in S34), the control unit 300 proceeds to processing of S9. If the second judgment does not judge that they are the same product (N in S34), the control unit 300 proceeds to processing of S14.

[0094] According to the third embodiment, even if the registration device 20 is a registration device in which product registration is performed by the customer C, similar to the first and second embodiments, it can prevent fraudulent behavior by the customer C regarding discount sales.

[0095] In addition, according to the third embodiment, not only can it be determined on an individual item basis whether the product whose product code has been read and the product whose discount information has been read are the same product, but there are no restrictions on the positional relationship between the barcode BC and the discount sticker Y affixed to the product.

[0096] As described above, the registration device of the above embodiment comprises a reading unit that reads product identification information that identifies a product from a code symbol attached to the product and reads bonus information related to the bonus of the product from the bonus symbol attached to the product, an imaging unit that images an imaging area including a readable area of ​​the reading unit, an extraction unit that extracts identification data corresponding to the product identification information read by the reading unit from a memory unit that stores the product identification information and identification data related to a product image in correspondence with each other, an acquisition unit that acquires imaging data captured by the imaging unit when the reading unit reads the bonus information, a determination unit that determines whether the product included in the imaging data acquired by the acquisition unit is the same product as the product identified by the product identification information read by the reading unit based on the identification data extracted by the extraction unit, and a registration unit that registers transaction information related to the transaction of the product identified by the product identification information based on the product identification information and the bonus information read by the reading unit when the determination unit determines that they are the same product.

[0097] This makes it possible to prevent fraudulent acts by the customer C regarding discount sales, even if the registration device is operated by the customer C. In addition, there are no restrictions on the positional relationship between the barcode BC and the discount sticker Y attached to the product.

[0098] In addition, the registration device of the above embodiment includes a reading unit that reads product identification information that identifies the product from a code symbol attached to the product and reads bonus information related to the bonus of the product from the bonus symbol attached to the product; an imaging unit that images an imaging area including a readable area of ​​the reading unit; an acquisition unit that acquires first imaging data captured by the imaging unit when the reading unit reads the product identification information and second imaging data captured by the imaging unit when the reading unit reads the bonus information; a determination unit that determines whether the product included in the first imaging data is the same product as the product included in the second imaging data; and a registration unit that, when the determination unit determines that they are the same product, registers transaction information related to the transaction of the product identified by the product identification information based on the product identification information and the bonus information read by the reading unit.

[0099] As a result, even if the registration device is operated by the customer C, it is possible to prevent fraudulent acts by the customer C regarding discount sales.

[0100] Furthermore, the determination unit of the registration device of the above embodiment determines that the product included in the first imaging data is the same product as the product included in the second imaging data when the second imaging data contains an image area identical to an image area including a code symbol and a bonus symbol in the first imaging data.

[0101] This makes it possible to determine whether the product whose product code has been read and the product whose discount information has been read are the same product on an individual product basis, thereby further preventing fraudulent behavior by customer C.

[0102] In addition, the reading unit of the registration device in the above embodiment reads flag information indicating that a label indicating bonus information is attached to the product, and if the reading unit does not read the bonus information even after a predetermined time has elapsed since the reading unit read the flag information, the registration unit does not register the transaction information of the product identified by the product identification information.

[0103] This can further prevent fraudulent activities by customer C.

[0104] In the above embodiment, the control programs executed by each device of the tablet terminal 30, the scanner 40, and the store server 3 may be configured to be provided by recording them on a computer-readable recording medium such as a CD-ROM. Also, the control programs executed by each device of the above embodiment may be configured to be stored on a computer connected to a network such as the Internet and provided by downloading them via the network, or may be configured to be provided via a network such as the Internet.

[0105] Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. For example, in each embodiment, the registration device 20 is configured by the tablet terminal 30 and the scanner 40, but a smartphone having a camera function can also be used as the registration device by installing an application program for product registration on the smartphone. In addition, a part or all of the processing executed by the tablet terminal 30 based on the information read by the scanner 40 can be executed by a cloud server or the like. Furthermore, in each of the above embodiments, the flag sticker Z is used to encourage the customer C to read the discount sticker Y, but the flag sticker Z does not have to be used. In addition, a camera can be provided separately from the scanner 40 and the camera can be used as the imaging unit.

[0106] In addition, this embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0107] 20 Registration device 30 Tablet terminal (information processing device) 40 Scanner (reading unit) 41 Camera (imaging unit) 310 Memory section 3001 Input section 3002 Acquisition Department 3003 Extraction part 3004 Judgment section 3005 Registration Department [Prior art documents] [Patent documents]

[0108] [Patent Document 1] JP 2016-177419 A

Claims

1. a reading unit that reads product identification information for identifying the product from a code symbol attached to the product, and also reads bonus information related to a bonus for the product from a bonus symbol attached to the product; an imaging unit that captures an imaging area including a readable area of ​​the reading unit; an extracting unit that extracts, from a memory unit that stores the commodity identification information and identification data related to a commodity image in association with each other, identification data corresponding to the commodity identification information read by the reading unit; an acquisition unit that acquires image data captured by the imaging unit when the reading unit reads the bonus information; a determination unit that determines whether or not the commodity included in the imaging data acquired by the acquisition unit is the same commodity as the commodity identified by the commodity identification information read by the reading unit, based on the identification data extracted by the extraction unit; a registration unit that registers transaction information regarding a transaction of a commodity identified by the commodity identification information based on the commodity identification information and the bonus information read by the reading unit when the determination unit determines that the commodity is the same commodity; A registration device comprising:

2. The reading unit reads flag information indicating that a label indicating special benefit information is attached to the product, the registration unit does not register transaction information of the commodity identified by the commodity identification information when the reading unit does not read the bonus information even after a predetermined time has elapsed since the reading unit read the flag information. The registration device according to claim 1 .

3. an input unit to which the product identification information and the benefit information related to a benefit of the product are inputted from a reading unit which reads the product identification information and the benefit information; an extraction unit that extracts, from a memory unit that stores the commodity identification information and identification data related to a commodity image in association with each other, identification data corresponding to the commodity identification information input to the input unit; an acquisition unit that acquires imaging data obtained by capturing an imaging area including a readable area of ​​the reading unit, the imaging data being captured when the reading unit reads the bonus information; a determination unit that determines whether or not a product included in the imaging data acquired by the acquisition unit is the same product as a product identified by the product identification information input to the input unit, based on the identification data extracted by the extraction unit; a registration unit that registers transaction information regarding a transaction of a product identified by the product identification information based on the product identification information and the benefit information input to the input unit when the determination unit determines that the products are the same product; An information processing device comprising:

4. A program for controlling a registration device by a computer, the registration device including a reading unit that reads product identification information for identifying a product from a code symbol attached to the product and reads bonus information related to a bonus of the product from a bonus symbol attached to the product, and an imaging unit that images an imaging area including a readable area of ​​the reading unit, The computer, an extracting unit that extracts, from a memory unit that stores the commodity identification information and identification data related to a commodity image in association with each other, identification data corresponding to the commodity identification information read by the reading unit; an acquisition unit that acquires image data captured by the imaging unit when the reading unit reads the bonus information; a determination unit that determines whether or not the commodity included in the imaging data acquired by the acquisition unit is the same commodity as the commodity identified by the commodity identification information read by the reading unit, based on the identification data extracted by the extraction unit; a registration unit that registers transaction information regarding a transaction of a commodity identified by the commodity identification information based on the commodity identification information and the bonus information read by the reading unit when the determination unit determines that the commodity is the same commodity; A program that makes it work.

5. A program for controlling an information processing device by a computer, The computer, an input unit to which the product identification information and the benefit information related to a benefit of the product are inputted from a reading unit which reads the product identification information and the benefit information; an extraction unit that extracts, from a memory unit that stores the commodity identification information and identification data related to a commodity image in association with each other, identification data corresponding to the commodity identification information input to the input unit; an acquisition unit that acquires imaging data obtained by capturing an imaging area including a readable area of ​​the reading unit, the imaging data being captured when the reading unit reads the bonus information; a determination unit that determines whether or not a product included in the imaging data acquired by the acquisition unit is the same product as a product identified by the product identification information input to the input unit, based on the identification data extracted by the extraction unit; a registration unit that registers transaction information regarding a transaction of a product identified by the product identification information based on the product identification information and the benefit information input to the input unit when the determination unit determines that the products are the same product; A program that makes it work.

Images