Information processing device and program

Abstract

To provide practical reliability by expanding the range of a product to be identified by image recognition, and to improve practicality in the operation of a system for providing technique.SOLUTION: An information processing apparatus includes: a code information acquisition section that acquires code information which is obtained by reading a code symbol displayed on a package of a product and enables the product to be identified; an image data acquisition section that acquires image data on the product imaged when reading the code symbol; a feature information acquisition section that acquires feature information which is information indicating a feature of an appearance of the product from the image data; and a dictionary output section that outputs a dictionary for collation in which one or more pieces of the feature information are stored in association with one piece of the code information, and when the number of pieces of code information included in the dictionary for collation exceeds a threshold, outputs a dictionary for collation which does not include code information expected to be less likely to be referred to by a predetermined criterion and feature information associated with the code information.SELECTED DRAWING: Figure 15

Description

[Technical Field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] In sales data processing, a technology is used to identify products using information indicating the external characteristics (shape, color, pattern, etc.) of an object obtained by image recognition (for example, Patent Document 1). Currently, this technology is mainly used to identify products that do not have code symbols such as barcodes, such as fruits and vegetables. For other products that have code symbols on their packaging, products are identified using code information obtained by reading the code symbols, as in the past.

[0003] In recent years, attempts have been made to expand the scope of product identification using image recognition to include products with code symbols, and to identify products based on the external characteristics of the package, rather than relying on reading the code symbol.Identifying packaged products using image recognition poses a challenge in terms of increasing reliability (accuracy), and efforts are being made to make this technology practical. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem that the present invention aims to solve is to expand the range of products that can be identified by image recognition, to enable practical reliability to be provided, and to increase the practicality of the operation of the system that provides the technology. [Means for solving the problem]

[0005] The information processing device of the embodiment includes a code information acquisition unit that acquires code information that enables a product to be identified by reading a code symbol displayed on the product's packaging; an image data acquisition unit that acquires image data of the product captured when the code symbol is read; a feature information acquisition unit that acquires feature information that indicates the product's external characteristics from the image data; and a dictionary output unit that outputs a matching dictionary that stores one or more pieces of feature information associated with one piece of code information, and if the number of pieces of code information included in the matching dictionary exceeds a threshold, outputs the matching dictionary that does not include the code information that is expected to be unlikely to be referenced based on predetermined judgment criteria and the feature information associated with the code information. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a product registration system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of a POS terminal. [Figure 3] FIG. 3 is a diagram showing examples of items included in the product master. [Figure 4] FIG. 4 is a diagram showing examples of items included in the registered product information. [Figure 5] FIG. 5 is a block diagram showing an example of the configuration of a code scanner. [Figure 6] FIG. 6 is a block diagram showing an example of the configuration of the verification terminal. [Figure 7] FIG. 7 is a diagram showing examples of items included in the matching dictionary. [Figure 8] FIG. 8 is a diagram showing examples of items included in the image information. [Figure 9] FIG. 9 is a block diagram showing an example of the configuration of the store server. [Figure 10] FIG. 10 is a block diagram illustrating an example of the configuration of the server. [Figure 11] FIG. 11 is a diagram showing examples of items included in the product master. [Figure 12]FIG. 12 is a diagram showing examples of items included in the transaction information. [Figure 13] FIG. 13 is a diagram showing an example of various functional units included in each control unit and the correspondence between them. [Figure 14] FIG. 14 is a diagram showing the operation timing and relationship of each functional unit. [Figure 15] FIG. 15 is a diagram illustrating an example of a process for distributing a check dictionary. DETAILED DESCRIPTION OF THE INVENTION

[0007] (First embodiment) An embodiment will be described with reference to the drawings. Fig. 1 is a diagram showing an example of the configuration of a product registration system 100 according to an embodiment. The product registration system 100 includes a server 1, a store server 3, a POS terminal 5, a code scanner 6, and a verification terminal 7.

[0008] In order for the product registration system 100 to correctly identify products from captured images, it is necessary to enrich the dictionary for inferring products from images. To do this, it is necessary to collect many images related to the products. Furthermore, for example, when a new product is released or when the package design is changed for a limited time even if the product remains unchanged, the feature information obtained from the captured image will no longer match the matching data. For this reason, it is necessary to continuously update the dictionary to accommodate new packages.

[0009] Since new packages appear every day, relying on manual updating of the dictionary is not desirable in terms of preventing omissions in the dictionary, and the number of entries would be impossible for a large-scale store. Therefore, in this embodiment, the dictionary is configured to be updated automatically and learning-based, automating the process of responding to new packages.

[0010] However, when new package information is automatically learned (registered and updated), the dictionary contents continue to grow, and there is a risk that it will become enormous. If the number of entries handled by the dictionary becomes too large, it becomes difficult to extract appropriate information from the dictionary, and the time required for extraction increases. Therefore, this embodiment proposes a configuration for appropriately managing the number of entries handled by the dictionary.

[0011] A server 1 (an example of an information processing device) can communicate with a store server 3 via a network 2 to send and receive information. The store server 3 is communicably connected to one or more POS terminals 5 via a network 9 such as a LAN (Local Area Network), and sends and receives information.

[0012] One code scanner 6 and one verification terminal 7 are provided for each POS terminal 5. The verification terminal 7 is connected to the POS terminal 5 via the code scanner 6. The code scanner 6 also relays communication between the verification terminal 7 and the POS terminal 5. The verification terminal 7 is connected to the store server 3 via a network 9 and is capable of communicating with the store server 3. The code scanner 6 and the POS terminal 5 are connected via USB, and the code scanner 6 and the verification terminal 7 are connected via a LAN.

[0013] The POS terminal 5 receives input from the code scanner 6, registers the product, and makes payment for the registered product. The code scanner 6 captures an image of the product's exterior, and outputs the read result (code information) of a code symbol such as a barcode or two-dimensional code, as well as information (code information) input from the verification terminal 7, to the POS terminal 5.

[0014] The verification terminal 7 obtains information (feature information) indicating the external characteristics (shape, color, pattern, etc.) of the product from the data of the image captured by the code scanner 6, and returns information (code information) that can identify a product that matches this information to the code scanner 6. The verification terminal 7 also associates data (image data) of the image captured by the code scanner 6 (captured image) with the read result of the code symbol output by the code scanner 6 (code information), and provides this to the store server 3.

[0015] The store server 3 accumulates information on the paid product (transaction information) sent from the POS terminal 5 and transfers it to the server 1. The store server 3 also transfers a set of image data and code information sent from the verification terminal 7 to the server 1. The store server 3 also receives product master data and a verification dictionary suitable for its own store from the server 1 and deploys them to each POS terminal 5 and verification terminal 7 in its own store.

[0016] The server 1 accumulates pairs of image data and code information acquired from each store via the store server 3, and generates verification data to be associated with the code information based on the pairs.

[0017] 2 is a block diagram showing an example of the configuration of the POS terminal 5. The POS terminal 5 includes a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, a communication unit 54, a display unit 55, an operation unit 56, an audio output unit 57, a cash deposit / withdrawal unit 58, a storage unit 59, etc.

[0018] The CPU 51 is an example of a processor and controls all the components of the POS terminal 5. The ROM 52 stores various programs. The RAM 53 is a workspace for storing programs and various data. The CPU 51, ROM 52, and RAM 53 are connected via a bus or the like to form a control unit 50 having a computer configuration.

[0019] The communication unit 54 is a communication interface that connects the control unit 50 and an external device (for example, the store server 3) so that they can communicate with each other via the network 9. The communication unit 54 also accepts input of code information output by the USB-connected code scanner 6.

[0020] The display unit 55 has a display device such as an LCD (Liquid Crystal Display), and displays various information under the control of the CPU 51.

[0021] The operation unit 56 has input devices such as a touch panel provided over the surface of the display unit 55, a keyboard, and a pointing device, and outputs operation contents input via the input devices to the CPU 51.

[0022] The audio output unit 57 has a speaker and a buzzer, and outputs audio under the control of the CPU 51.

[0023] The deposit / withdrawal unit 58 is, for example, a change machine that stores cash (coins and bills) and receives deposits and dispenses change during settlement.

[0024] The storage unit 59 has a storage medium such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory, and maintains its stored contents even when power is cut off. The storage unit 59 stores various setting information such as a program 591 executable by the CPU 51 and a product master 592. The storage unit 59 (or RAM 53) also stores registered product information 593, which is information on registered products (registered products), from the start to the completion of at least one transaction.

[0025] 3 is a diagram showing examples of items included in the product master 592. The product master 592 is an example of product information, and is information about products handled by a store compiled, for example, in the form of a table. Items of product information include, for example, "product code," "product name," "unit price," and "color."

[0026] The product code is an example of information that can identify a product, such as a JAN code. Other information (unit price, verification data, color, corresponding product, etc.) is stored in association with the product code.

[0027] The "Product Name" field records the name of the product. The "Unit Price" field records the price for one product. The "Color" field records information indicating the color and pattern of the product.

[0028] Fig. 4 is a diagram showing examples of items included in registered product information 593. Registered product information 593 is information on products registered for purchase by customers (i.e., products subject to transaction) compiled, for example, in the form of a table. Product information items include, for example, "product code," "unit price," and "quantity." "Quantity" is the number of products purchased.

[0029] The program 591 is application software for causing the POS terminal 5 to function. POS is an abbreviation for "Point Of Sale" and means "point of sale information management." The POS terminal is a device that performs point of sale information management.

[0030] The control unit 50 of the POS terminal 5 executes various processes by the CPU 51 operating in accordance with programs stored in the ROM 52 or the storage unit 59 and loaded into the RAM 53. The control unit 50 also provides various functional units (described later, see FIG. 13) by executing the program 591.

[0031] 5 is a block diagram showing an example of the configuration of the code scanner 6. The code scanner 6 includes a CPU 61, a ROM 62, a RAM 63, a communication unit 64, an imaging unit 65, and the like.

[0032] The CPU 61 is an example of a processor and controls all the components of the code scanner 6. The ROM 62 stores various programs. The RAM 63 is a workspace for storing programs and various data. The CPU 61, ROM 62, and RAM 63 are connected via a bus or the like to form a control unit 60 having a computer configuration.

[0033] The communication unit 64 is a communication interface that connects the control unit 60 and an external device (for example, the verification terminal 7) so that they can communicate with each other via the network 9. The communication unit 64 also communicates with the POS terminal 5 via a USB cable.

[0034] The imaging unit 65 has an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS), captures an image of an item held over by the operator, and acquires image data. The imaging unit 65 captures an image of an item each time the operator holds it over for scanning, and acquires multiple pieces of image data.

[0035] The control unit 60 of the code scanner 6 executes various processes by the CPU 61 operating in accordance with a program stored in the ROM 62 and loaded into the RAM 63, and provides the following functions.

[0036] The code scanner 6 extracts a code symbol such as a barcode or two-dimensional code from an image (captured image) made up of image data, and decodes the code symbol to obtain code information. The code information is information that can identify a product, such as a product code such as a JAN code. In other words, the code symbol in this case is an encoded JAN code.

[0037] The code scanner 6 also outputs image data to the collating terminal 7 and receives a product code from the collating terminal 7. The code scanner 6 outputs the product code it obtains by decoding the code symbol itself or the product code it receives from the collating terminal 7, whichever is obtained first, to the POS terminal 5. If the code scanner 6 finishes decoding and obtains a product code before receiving the product code from the collating terminal 7, it transmits the product code to the collating terminal 7.

[0038] 6 is a block diagram showing an example of the configuration of the verification terminal 7. The verification terminal 7 includes a CPU 71, a ROM 72, a RAM 73, a communication unit 74, a storage unit 79, and the like.

[0039] The CPU 71 is an example of a processor and controls all the components of the verification terminal 7. The ROM 72 stores various programs. The RAM 73 is a workspace for storing programs and various data. The CPU 71, ROM 72, and RAM 73 are connected via a bus or the like to form a control unit 70 having a computer configuration.

[0040] The communication unit 74 is a communication interface that connects the control unit 70 and external devices (for example, the store server 3 and the code scanner 6) via the network 9 so that they can communicate with each other.

[0041] The storage unit 79 has a storage medium such as an HDD, SSD, or flash memory, and maintains its stored contents even when power is cut off. The storage unit 79 stores programs executable by the CPU 71 and various setting information. The storage unit 79 also stores a comparison dictionary 794 and image information 795.

[0042] 7 is a diagram showing examples of items included in the matching dictionary 794. The matching dictionary 794 stores product codes and matching data in association with each other, for example, in the form of a table. The product codes included in the matching dictionary 794 correspond to products sold in the store where the matching terminal 7 is installed. In other words, the product codes included in the matching dictionary 794 are the product codes included in the product master 592.

[0043] The matching data is a representative value of the feature information. The feature information is information that indicates the characteristics of the appearance of an item. The feature information is a value that is output (obtained) by performing a predetermined process on image data obtained by capturing an image of the appearance of a product, and is, for example, a quantity that has a magnitude and direction, such as a vector. The matching data is a standard value of the feature information that varies depending on the capturing conditions, etc.

[0044] To identify a product from its external appearance (i.e., its packaging), it is necessary to be able to view the product from various angles, so it is preferable to have matching data corresponding to various angles. Therefore, multiple matching data are registered for one product code.

[0045] 8 is a diagram showing examples of items included in the image information 795. The image information 795 stores product codes and image data in association with each other, for example, in the form of a table. The image data and product codes are received from the code scanner 6.

[0046] The control unit 70 of the verification terminal 7 executes various processes and provides various functional units (described later, see FIG. 13) by the CPU 71 operating in accordance with a program stored in the ROM 72 and loaded into the RAM 73.

[0047] 9 is a block diagram showing an example of the configuration of the store server 3. The store server 3 includes a CPU 31, a ROM 32, a RAM 33, a communication unit 34, a storage unit 39, and the like.

[0048] The CPU 31 is an example of a processor and controls all the components of the store server 3. The ROM 32 stores various programs. The RAM 33 is a workspace for storing programs and various data. The CPU 31, ROM 32, and RAM 33 are connected via a bus or the like to form a control unit 30 having a computer configuration.

[0049] The communication unit 34 is a communication interface that communicatively connects the control unit 30 and external devices (for example, the POS terminal 5 and the verification terminal 7) via the network 9. The communication unit 34 is also communicatively connected to the server 1 via the network 2.

[0050] The storage unit 39 has a storage medium such as an HDD, SSD, or flash memory, and maintains its stored contents even when the power is turned off. The storage unit 39 stores various setting information such as a program 391 executable by the CPU 31 and a product master 392. The storage unit 39 also stores transaction information 393 and a matching dictionary 394.

[0051] The items included in the product master 392 are the same as those included in the product master 592 shown in Fig. 3. The items included in the transaction information 393 are the same as those included in the registered product information 593 shown in Fig. 4. The items included in the matching dictionary 394 are the same as those included in the matching dictionary 794 shown in Fig. 7.

[0052] The control unit 30 of the store server 3 executes various processes by the CPU 31 operating in accordance with programs stored in the ROM 32 or the storage unit 39 and loaded into the RAM 33. The control unit 30 also provides various functional units (described later, see FIG. 13) by executing the program 391.

[0053] 10 is a block diagram showing an example of the configuration of the server 1. The server 1 includes a CPU 11, a ROM 12, a RAM 13, a communication unit 14, a storage unit 19, and the like.

[0054] The CPU 11 is an example of a processor and controls all parts of the server 1. The ROM 12 stores various programs. The RAM 13 is a workspace for storing programs and various data. The CPU 11, ROM 12, and RAM 13 are connected via a bus or the like to form a control unit 10 of a computer configuration.

[0055] The communication unit 14 is a communication interface that connects the control unit 10 and an external device (for example, the store server 3) via the network 2 so that they can communicate with each other.

[0056] The memory unit 19 has a storage medium such as an HDD, SSD, or flash memory, and maintains its stored contents even when the power is turned off. The memory unit 19 stores various setting information such as a program 191 executable by the CPU 11 and a product master 192. The memory unit 19 also stores transaction information 193, a matching dictionary 194, image information 195, etc.

[0057] 11 is a diagram showing examples of items included in the product master 192. The product master 192 is an example of product information, and is information about products handled by a store compiled, for example, in the form of a table. Items of product information include, for example, "store code," "product code," "product name," "unit price," "color," and "not available."

[0058] The store code is information that can identify a store, and is, for example, a unique number assigned to each store. In other words, the store code is not duplicated among stores of the same chain that are managed by the server 1.

[0059] The "Not Available" item is, for example, a flag; if the flag is OFF, it indicates that the store is currently selling the product with the product code in the same record; if the flag is ON, it indicates that the store is not selling the product.

[0060] The product master 192 is the product master 592 (392) shown in Fig. 3 with the addition of the fields "store code" and "not available." The server 1 is connected to the store servers 3 of one or more stores. The server 1 extracts and transmits, from the records contained in the product master 192, records to which the store code of each store is associated and whose "not available" flag is OFF, as the product master 592 to be used by the POS terminal 5 of each store. Upon receiving this, each store server 3 updates the product master 592 of the POS terminal 5 of its own store.

[0061] FIG. 12 is a diagram showing examples of items included in transaction information 193. Transaction information 193 is information about products purchased by a customer, compiled, for example, in the form of a table. Items of product information include, for example, "store code," "product code," "unit price," and "quantity." The items included in transaction information 193 are the same as those in registered product information 593 shown in FIG. 4, with the addition of an item for "store code."

[0062] The items included in the matching dictionary 194 are the same as those included in the matching dictionary 794 shown in Fig. 7. The items included in the image information 195 are the same as those included in the image information 795 shown in Fig. 8.

[0063] The control unit 10 of the server 1 executes various processes by the CPU 11 operating in accordance with programs stored in the ROM 12 or the storage unit 19 and loaded into the RAM 13. The control unit 10 also provides various functional units (described later, see FIG. 13) by executing the program 191.

[0064] Fig. 13 is a diagram showing an example of various functional units and their corresponding relationships provided in each of the control units 10, 30, 50, 60, and 70. Fig. 14 is a diagram showing the operation timing and relationships of the above-mentioned functional units.

[0065] The control unit 10 of the server 1 includes a transaction information update unit 101, an image information storage unit 103, a matching dictionary update unit 104, a master distribution unit 105, etc. The control unit 30 of the store server 3 includes a transaction information update unit 301, an image information transfer unit 303, a master update unit 305, a master distribution unit 306, etc. The control unit 50 of the POS terminal 5 includes a product registration unit 501, a payment processing unit 502, a master update unit 505, etc. The control unit 70 of the matching terminal 7 includes a matching unit 701, an image information storage unit 702, an image information transfer unit 703, a matching dictionary update unit 704, etc. The operation of each unit will be described below with reference to FIG. 14.

[0066] First, when the POS terminal 5 starts a transaction during store hours, the control unit 60 of the code scanner 6 connected thereto captures an image of the commodity (step S61). The control unit 60 transfers the captured image data (image data) to the verification terminal 7 (step S62).

[0067] Furthermore, the control unit 60 cuts out a code symbol from the captured image (step S63), and decodes the cut-out code symbol (step S64) to obtain a product code.

[0068] Meanwhile, in the collation terminal 7 that has received the image data, the collation unit 701 performs a predetermined process on the image data to obtain information indicating the external characteristics of the product (characteristic information) (step S71).

[0069] Next, the matching unit 701 compares the acquired characteristic information with the matching data stored in the matching dictionary 794 (step S72).Then, the matching unit 701 transmits the product code associated with the matching data that matches the characteristic information to the code scanner 6 (step S73).

[0070] If the code scanner 6 completes the decoding in step S64 earlier than step S73, the control unit 60 transmits the decoded product code to the verification terminal 7 (step S66). In this case, the verification terminal 7 does not transmit the product code to the code scanner 6. Also, in this case, the image information storage unit 702 of the verification terminal 7 stores the image data (step S74). In step S74, the image information storage unit 702 associates the image data transferred in step S62 with the product code received in step S66, and stores the image data in the storage unit 79 as image information 795.

[0071] The capturing of an image by the code scanner 6 (step S61) and the transfer of image data (step S62) are repeated until decoding is completed (step S64) or a product code is received from the verifying terminal 7 (step S73). Therefore, there is a high possibility that multiple image data will be transferred from the code scanner 6 to the verifying terminal 7. In step S74, the same product code is associated with all of the image data and stored.

[0072] Furthermore, if the verification (step S72) is successful in the verification terminal 7, the image data received by the verification terminal 7 through the transfer in step S62 may be discarded.

[0073] Then, the control unit 60 of the code scanner 6 transmits the product code acquired in step S64 or step S73 to the POS terminal 5 (step S65).

[0074] When a product code is received by the POS terminal 5, the product registration unit 501 obtains information (such as product name and unit price) of the product that matches the received product code from the product master 592, specifies the quantity, and records it as registered product information 593 (step S51).

[0075] In the product registration from the start of the transaction until the transition to the payment, a series of processes from step S61 to step S51 is repeated. When a key for instructing the transition to the payment provided on the operation unit 56 of the POS terminal 5 is operated, the control unit 50 ends the product registration and proceeds to the payment as the payment processing unit 502.

[0076] The payment processing unit 502 calculates the price of the product recorded in the registered product information 593 and performs payment processing, such as paying or receiving cash via the deposit / withdrawal unit 58 (step S52). Payment may not be made in cash, but may be made by cashless payment such as credit card payment or electronic money payment. When the payment processing is completed, the payment processing unit 502 transfers the registered product information 593 to the store server 3 (step S53).

[0077] When the store server 3 receives the registered product information 593, the control unit 30 functions as the transaction information update unit 301 and updates the transaction information 393 with the registered product information 593 (step S31). In other words, the transaction information update unit 301 stores the registered product information 593 received from the store server 3 in the memory unit 19 as the transaction information 393.

[0078] The transaction information update unit 301 further transmits the transaction information 393 to the server 1 (step S32). The transaction information 393 transmitted at this time may be the increment from the previous transmission (that is, the amount equivalent to the registered product information 593).

[0079] When the server 1 receives the transaction information 393, the control unit 10 functions as the transaction information update unit 101 and updates the transaction information 193 with the transaction information 393 (step S11). At this time, the transaction information update unit 101 associates the transaction information 393 with a store code that identifies the store that sent the information, and stores the associated store code in the transaction information 193.

[0080] Next, a process performed at an arbitrary timing will be described. The arbitrary timing does not have to be during the store's business hours, but may be outside the business hours (after closing time to before opening time), or may be when there is a margin in the traffic of the product registration system 100.

[0081] First, the control unit 30 of the verification terminal 7 functions as the image information transfer unit 703 to transfer the image information 795 to the store server 3 (step S75). Note that the image information 795 may be deleted after being transferred in step S75.

[0082] When the store server 3 receives the image information 795, the control unit 30 functions as the image information transfer unit 303 and transfers it to the server 1 (step S33).

[0083] When the server 1 receives the image information 795, the control unit 10 functions as the image information storage unit 103 and updates the image information 195 (step S12). That is, the image information storage unit 103 adds the image information 795 received from the store server 3 to the storage unit 19 as the image information 195.

[0084] Here, the image information storage unit 103 functions as an example of a code information acquisition unit that acquires code information that enables a product to be identified by reading a code symbol displayed on the product's packaging, and an image data acquisition unit that acquires image data of the product captured when the code symbol is read.

[0085] Next, a process performed outside business hours will be described. The control unit 10 of the server 1 functions as the matching dictionary update unit 104 and updates the matching dictionary 194 (step S13). For this update, the matching dictionary update unit 104 uses the record that is the most recent increment (the record added in the previous step S12) from the image information 195. The matching dictionary update unit 104 performs a predetermined process on the image data of each record to obtain feature information, and adds the product data of that record associated with the feature information to the matching dictionary 194. In this step, automatic learning (registration, updating) of new package information in the matching dictionary 194 is realized.

[0086] Here, the check dictionary update unit 104 functions as an example of a feature information acquisition unit that acquires feature information, which is information indicating the external features of a product, from image data.

[0087] Next, the control unit 10, functioning as the master distribution unit 105, distributes the product master 192 (step S14) and the matching dictionary 194 (step S15) to the store server 3 of each store.

[0088] First, in step S14, the master data distribution unit 105 transmits records that have been changed since the previous transfer among those that match the store code of the destination store in the product master data 192. Furthermore, for records that have been changed from available to unavailable since the previous transfer, the master data distribution unit 105 transmits an instruction to the store server 3 to delete the record of the corresponding product code.

[0089] In step S15, the master distribution unit 105 extracts and distributes the matching dictionary 194 as needed when distributing the matching dictionary 194. The extraction here is a process for preventing the number of entries handled by the matching dictionary 794 from becoming too large. This process keeps the number of entries handled by the matching dictionary 794 appropriate.

[0090] Here, the master distribution unit 105 functions as an example of a dictionary output unit. That is, the master distribution unit 105 outputs a matching dictionary 794 that stores one or more pieces of matching data in association with one product code, and when the number of product codes that can be included in the matching dictionary 794 exceeds a threshold, the master distribution unit 105 outputs (distributes) a matching dictionary 794 (an excerpt from the matching dictionary 194) that does not include information on product codes that are expected to be unlikely to be referenced according to a predetermined criterion.

[0091] The process of distributing the check dictionary 194 in step S15 will be described with reference to Fig. 15. Fig. 15 is a diagram showing an example of the process of distributing the check dictionary 194.

[0092] First, the master distribution unit 105 extracts from the product master 192 product codes for which transactions have been made with a specified store code (of the store to which the product is to be distributed) and creates a list (step S151).

[0093] Next, the master distribution unit 105 determines whether the number of product codes (extracted number) included in the list created in step S151 exceeds a threshold (step S152). Here, the threshold is, for example, 10,000 or 20,000. The threshold can be set or changed as appropriate.

[0094] In step S152, if the number of extractions exceeds the threshold (Yes in step S152), the master distribution unit 105 refers to the transaction information 193 and deletes from the list any product codes that do not exist in the transaction information 193 for the most recent few months (e.g., three months) (step S153).

[0095] Here, the above-mentioned "3 months" is an example of the second threshold. The master distribution unit 105 determines (predicts) that a product code whose elapsed time since its last registration as a trading object exceeds the second threshold is unlikely to be referenced in future product registrations, and excludes it from distribution targets.

[0096] Furthermore, in step S152, if the number of extractions does not exceed the threshold value (No in step S152), the master distributor 105 advances the process to step S154.

[0097] Next, the master distribution unit 105 extracts records associated with the product codes included in the list from the collation dictionary 194 (step S154) and transmits them to the store server 3 (step S155).

[0098] Returning to FIG. 14, when the store server 3 receives the product master 192 and the matching dictionary 194 from the server 1, the control unit 30, functioning as the master update unit 305, updates the product master 392 (step S34) and updates the matching dictionary 394 (step S35).

[0099] When the product master 392 and the matching dictionary 394 are updated, the control unit 30 of the store server 3, as the master distribution unit 306, distributes the product master 392 to the POS terminals 5 in the store (step S36), and also distributes the matching dictionary 394 to the matching terminal 7 (step S37).

[0100] In the POS terminal 5 that has received the product master 392, the control unit 50 functions as the master update unit 505 and updates the product master 592 (step S54).

[0101] In the verification terminal 7 that has received the verification dictionary 394, the control unit 70 functions as the verification dictionary update unit 704 to update the verification dictionary 794 (step S76).

[0102] In the product registration system 100 configured as described above, the code scanner 6 decodes the code symbol while the verification terminal 7 recognizes the image, and product registration and payment are performed based on the code information obtained earlier.

[0103] The image data output by the code scanner 6 is input to the verification terminal 7. The verification terminal 7 generates information (feature information) indicating the external features (shape, color, pattern, etc.) of the product captured in the captured image indicated by the image data, and compares the feature information with the verification data by referring to the verification dictionary 794.

[0104] The verification terminal 7 identifies the product by image recognition as described above, and returns the result to the code scanner 6. The recognition result output by the verification terminal 7 is output to the POS terminal 5 via the code scanner 6.

[0105] The POS terminal 5 registers the product and performs payment for the registered product based on the code information output by the code scanner 6. The POS terminal 5 automatically registers the information of the identified product as an item to be purchased (transaction item).

[0106] Of the image data obtained by the code scanner 6 and transmitted to the verification terminal 7, if there is no verification data matching the characteristic information in the verification dictionary 793, the image data is sent to the server 1 together with the product code identified by the code scanner 6. The server 1 generates verification data from the newly added (updated) image data and updates the verification dictionary 194. The additions (updated) to the verification dictionary 194 are sent to the verification terminal 7. This allows the verification terminal 7 to obtain verification data for products that could not be verified last time.

[0107] Furthermore, when updating the matching dictionary 794, if the number of entries becomes too large (exceeds a threshold), product codes that have not appeared in recent (e.g., recent months) transaction information 193 are excluded. This makes it possible to omit matching data for products that are unlikely to be used in the product registration process.

[0108] The above-described embodiment can be modified as needed by changing part of the configuration or function of each of the above-described devices.

[0109] For example, in the above embodiment, the number of entries in the matching dictionary 794 is reduced by processing the transaction information 193 so as not to include product codes that have not appeared in the past three months, but the present invention is not limited to this.

[0110] For example, in implementation, the master distribution unit 105 may reduce the number of items in the matching dictionary 794 by not including in the matching dictionary 794 any matching data (feature information) that was acquired by the matching dictionary update unit 104 (when it was added to the matching dictionary 194) older than a predetermined standard.

[0111] If the predetermined standard is set to, for example, 12 months, the matching data included in the matching dictionary 794 is limited to the characteristic information of packages registered in the past year. In this case, matching data of a package that has not changed for a long period of time, more than a year, will not be included in the matching dictionary 794. Therefore, for that package, new matching data based on new captured images is generated, and the matching dictionaries 194, 394, and 794 are updated.

[0112] Alternatively, if the number of product codes included in the matching dictionary 794 exceeds a threshold, the master distribution unit 105 (dictionary output unit) may not include new matching data in the matching dictionary 794. In this case, product codes that were not previously included in the matching dictionary 794 will not be added. In this case, therefore, manual maintenance of the recorded data is performed as appropriate.

[0113] In addition, in the present embodiment, the POS terminal 5 may be operated by a store clerk or a customer. In addition, in the present embodiment, the server 1 may be composed of multiple devices rather than a single device. In addition, in the present embodiment, the functional units described as being possessed by the server 1 may be performed by any of the devices in the store. In addition, in the present embodiment, a device corresponding to the server 1 may be installed in the store. In addition, in the present embodiment, the store server 3 may not be required. In addition, in the present embodiment, the verification terminal 7 may be shared by multiple code scanners 6. In addition, the memory unit 19 (39, 59, 79) is an example of a device that provides a memory area capable of storing various information. In the above embodiment, the information stored in the same memory unit does not need to be stored in the same memory unit, and may be stored separately in multiple memory devices.

[0114] The programs executed by each device in the above-described embodiments are provided in advance in a ROM, etc. The programs executed by each device in the above-described embodiments may be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD).

[0115] Furthermore, the programs executed by each device in the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by each device in the above-described embodiments may be provided or distributed via a network such as the Internet.

[0116] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, modifications, and combinations can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0117] 100...Product registration system, 1...server, 10...control unit, 101...transaction information update unit, 103...image information storage unit, 104...check dictionary update unit, 105...master distribution unit, 11...CPU, 12...ROM, 13...RAM, 14...Communication section, 19...Storage section, 191...program, 192...product master, 193...transaction information, 194... Matching dictionary, 195... Image information, 2...Network, 3...store server, 30...control unit, 301...transaction information update unit, 303...image information transfer unit, 305...master update unit, 306...master distribution unit, 31...CPU, 32...ROM, 33...RAM, 34...Communication section, 39...Storage section, 391...program, 392...product master, 393...transaction information, 394...matching dictionary, 5...POS terminals, 50...control unit, 501...product registration unit, 502...payment processing unit, 505...master update unit, 51...CPU, 52...ROM, 53...RAM, 54...Communication section, 55...display unit, 56...operation unit, 57...audio output unit, 58...deposit / withdrawal unit, 59...storage unit, 591...program, 592...product master, 593...registered product information, 6...code scanner, 60...control unit, 61...CPU, 62...ROM, 63...RAM, 64...communication unit, 65...imaging unit, 7 ... collating terminal, 70...control unit, 701: Collation unit; 702: Image information storage unit; 703...image information transfer unit, 704...matching dictionary update unit, 71...CPU, 72...ROM, 73...RAM, 74...Communication section, 79...Memory unit, 793...Comparison dictionary, 794...Comparison dictionary, 795...Image information, 9...Network. [Prior art documents] [Patent documents]

[0118] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-021915

Claims

1. a code information acquiring unit that acquires code information that enables a product to be identified by reading a code symbol displayed on a product package; an image data acquisition unit that acquires image data of the product captured when the code symbol is read; a characteristic information acquisition unit that acquires characteristic information indicating characteristics of the appearance of the product from the image data; a dictionary output unit that outputs a matching dictionary that stores one or more pieces of feature information in association with one piece of code information, and when the number of pieces of code information included in the matching dictionary exceeds a threshold, outputs the matching dictionary that does not include the code information that is expected to be unlikely to be referenced based on a predetermined judgment criterion and the feature information associated with the code information; An information processing device comprising:

2. The dictionary output unit determines the code information, for which the elapsed time since it was last registered as a transaction object exceeds a second threshold, as the code information that is expected to be unlikely to be referenced based on a predetermined determination criterion. The information processing device according to claim 1 .

3. The dictionary output unit does not include, in the collation dictionary, any of the feature information that was acquired by the feature information acquisition unit at a time exceeding a predetermined standard. The information processing device according to claim 1 .

4. When the number of pieces of code information included in the matching dictionary exceeds a threshold, the dictionary output unit does not include new pieces of feature information in the matching dictionary. The information processing device according to claim 1 .

5. A computer equipped in a system that performs product registration related to sales data processing, a code information acquiring unit that acquires code information that enables a product to be identified by reading a code symbol displayed on a product package; an image data acquisition unit that acquires image data of the product captured when the code symbol is read; a characteristic information acquisition unit that acquires characteristic information indicating characteristics of the appearance of the product from the image data; a dictionary output unit that outputs a matching dictionary that stores one or more pieces of feature information in association with one piece of code information, and when the number of pieces of code information included in the matching dictionary exceeds a threshold, outputs the matching dictionary that does not include the code information that is expected to be unlikely to be referenced based on a predetermined judgment criterion and the feature information associated with the code information; A program to function as a

Images