Information processing apparatus and program

JP2024161703AActive Publication Date: 2024-11-20TOSHIBA TEC KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023076626
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-08
Publication Date
2024-11-20
Estimated Expiration
2043-05-08

Smart Images

  • Figure 2024161703000001_ABST
    Figure 2024161703000001_ABST
Patent Text Reader

Abstract

To provide practical reliability by expanding the range of a product to be identified by image recognition, and to improve practicality in the operation of a system for providing technique.SOLUTION: An information processing apparatus includes: a code information acquisition section that acquires code information which is obtained by reading a code symbol displayed on a package of a product and enables the product to be identified; an image data acquisition section that acquires image data on the product imaged when reading the code symbol; a feature information acquisition section that acquires feature information which is information indicating a feature of an appearance of the product from the image data; and a dictionary output section that outputs a dictionary for collation in which one or more pieces of the feature information are stored in association with one piece of the code information, and when the number of pieces of code information included in the dictionary for collation exceeds a threshold, outputs a dictionary for collation which does not include code information expected to be less likely to be referred to by a predetermined criterion and feature information associated with the code information.SELECTED DRAWING: Figure 15
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing device and a program. [Background technology]

[0002] In sales data processing, a technology is used to identify products using information indicating the external characteristics (shape, color, pattern, etc.) of an object obtained by image recognition (for example, Patent Document 1). Currently, this technology is mainly used to identify products that do not have code symbols such as barcodes, such as fruits and vegetables. For other products that have code symbols on their packaging, products are identified using code information obtained by reading the code symbols, as in the past.

[0003] In recent years, the scope of product identification using image recognition has been expanded to include products with code symbols, and attempts have been made to identify products from the external characteristics of the package, rather than by reading the code symbol.Identifying packaged products using image recognition poses the challenge of increasing reliability (accuracy), and efforts are being made toward practical use. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem that the present invention aims to solve is to expand the range of products that can be identified by image recognition, to enable the provision of practical reliability, and to increase the practicality of the operation of the system that provides the technology. [Means for solving the problem]

[0005] An information processing device of an embodiment includes a code information acquisition unit that acquires code information that enables a product to be identified by reading a code symbol displayed on a product package; an image data acquisition unit that acquires image data of the product captured when the code symbol is read; a feature information acquisition unit that acquires feature information that is information indicating the external features of the product from the image data; and a dictionary output unit that outputs a matching dictionary that associates one or more of the feature information with one of the code information and stores it, and when the number of the code information included in the matching dictionary exceeds a threshold value, outputs the matching dictionary that does not include the code information that is expected to be unlikely to be referenced based on a predetermined judgment criterion and the feature information associated with the code information. [Brief description of the drawings]

[0006] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a product registration system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of the configuration of a POS terminal. [Diagram 3] FIG. 3 is a diagram showing examples of items included in the product master. [Figure 4] FIG. 4 is a diagram showing examples of items included in the registered product information. [Diagram 5] FIG. 5 is a block diagram showing an example of the configuration of a code scanner. [Figure 6] FIG. 6 is a block diagram showing an example of the configuration of the collation terminal. [Figure 7] FIG. 7 is a diagram showing examples of items included in the collation dictionary. [Figure 8] FIG. 8 is a diagram showing examples of items included in the image information. [Figure 9] FIG. 9 is a block diagram showing an example of the configuration of the store server. [Figure 10] FIG. 10 is a block diagram showing an example of the configuration of the server. [Figure 11] FIG. 11 is a diagram showing examples of items included in the product master. [Figure 12]FIG. 12 is a diagram showing examples of items included in the transaction information. [Figure 13] FIG. 13 is a diagram showing an example of various functional units included in each control unit and the corresponding relationships between them. [Figure 14] FIG. 14 is a diagram showing the operation timing and relationship of each functional unit. [Figure 15] FIG. 15 is a diagram illustrating an example of a process for distributing a comparison dictionary. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] (First embodiment) An embodiment will be described with reference to the drawings. Fig. 1 is a diagram showing an example of the configuration of a product registration system 100 according to an embodiment. The product registration system 100 includes a server 1, a store server 3, a POS terminal 5, a code scanner 6, and a verification terminal 7.

[0008] In the product registration system 100, in order to correctly determine a product from a captured image, it is necessary to enrich the dictionary for estimating the product from the image. To do this, it is necessary to collect many images related to the product. In addition, for example, when a new product is released or the package design is changed for a limited time even if the product remains unchanged, the feature information obtained from the captured image and the matching data will no longer match. For this reason, it is necessary to continuously update the dictionary to correspond to the new package.

[0009] Since new packages appear every day, relying on manual updating of the above-mentioned dictionary is not preferable in terms of preventing omissions in the dictionary, and the number of entries would be impossible for a large-scale store. Therefore, in this embodiment, the above-mentioned dictionary is configured to be updated in an automatic learning manner, and the handling of new packages is automated.

[0010] However, when new package information is automatically learned (registered and updated), the contents of the dictionary continue to increase, and there is a risk that it will become enormous. If the number of items handled by the dictionary becomes too large, it becomes difficult to extract appropriate information from the dictionary, and the time required for extraction becomes long. Therefore, this embodiment proposes a configuration for appropriately managing the number of items handled by the dictionary.

[0011] A server 1 (an example of an information processing device) can communicate with a store server 3 via a network 2 to transmit and receive information. The store server 3 is communicably connected to one or more POS terminals 5 via a network 9 such as a LAN (Local Area Network), to transmit and receive information.

[0012] One code scanner 6 and one verification terminal 7 are provided for each POS terminal 5. The verification terminal 7 is connected to the POS terminal 5 via the code scanner 6. The code scanner 6 also relays communication between the verification terminal 7 and the POS terminal 5. The verification terminal 7 is connected to the store server 3 via a network 9 and can communicate with the store server 3. The code scanner 6 and the POS terminal 5 are connected via a USB, and the code scanner 6 and the verification terminal 7 are connected via a LAN.

[0013] The POS terminal 5 receives input from the code scanner 6, registers the product, and makes payment for the registered product. The code scanner 6 captures an image of the exterior of the product, and outputs to the POS terminal 5 the read result (code information) of a code symbol such as a barcode or a two-dimensional code, and information (code information) input from the verification terminal 7.

[0014] The collation terminal 7 obtains information (feature information) indicating the external characteristics (shape, color, pattern, etc.) of the product from the data of the image captured by the code scanner 6, and returns information (code information) capable of identifying a product that matches this information to the code scanner 6. The collation terminal 7 also provides the store server 3 with data (image data) of the image (captured image) captured by the code scanner 6 in association with the read result of the code symbol output by the code scanner 6 (code information), in association with each other.

[0015] The store server 3 accumulates information on the paid product (transaction information) sent from the POS terminal 5, and transfers it to the server 1. The store server 3 also transfers a set of image data and code information sent from the collation terminal 7 to the server 1. The store server 3 also receives product master data and a collation dictionary suitable for its own store from the server 1, and deploys them to each POS terminal 5 and collation terminal 7 in its own store.

[0016] The server 1 accumulates pairs of image data and code information acquired from each store via the store server 3, and generates verification data to be associated with the code information based on the pairs.

[0017] 2 is a block diagram showing an example of the configuration of the POS terminal 5. The POS terminal 5 includes a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, a communication unit 54, a display unit 55, an operation unit 56, an audio output unit 57, a deposit / withdrawal unit 58, a storage unit 59, etc.

[0018] The CPU 51 is an example of a processor and controls each part of the POS terminal 5. The ROM 52 stores various programs. The RAM 53 is a workspace for developing programs and various data. The CPU 51, the ROM 52, and the RAM 53 are connected via a bus or the like to constitute a control unit 50 having a computer configuration.

[0019] The communication unit 54 is a communication interface that communicatively connects the control unit 50 and an external device (e.g., the store server 3) via the network 9. The communication unit 54 also accepts input of code information output by the USB-connected code scanner 6.

[0020] The display unit 55 has a display device such as an LCD (Liquid Crystal Display), and displays various types of information under the control of the CPU 51.

[0021] The operation unit 56 has input devices such as a touch panel provided over the surface of the display unit 55, a keyboard, and a pointing device, and outputs to the CPU 51 the contents of operations input via the input devices.

[0022] The audio output unit 57 has a speaker and a buzzer, and outputs audio under the control of the CPU 51.

[0023] The deposit / withdrawal unit 58 is, for example, a change machine that stores cash (coins and bills) and receives deposits and dispenses change during settlement.

[0024] The storage unit 59 has a storage medium such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory, and maintains the stored contents even when the power is cut off. The storage unit 59 stores various setting information such as a program 591 executable by the CPU 51 and a product master 592. The storage unit 59 (or RAM 53) also stores registered product information 593, which is information on registered products (registered products), from the start to the completion of at least one transaction.

[0025] 3 is a diagram showing examples of items included in the product master 592. The product master 592 is an example of product information, and information on products handled by a store is compiled, for example, in the form of a table. Items of product information include, for example, "product code," "product name," "unit price," and "color."

[0026] The product code is an example of information that can identify a product, such as a JAN code. Other information (unit price, verification data, color, corresponding products, etc.) is stored in association with the product code.

[0027] The "Product Name" field records the name of the product. The "Unit Price" field records the price for one product. The "Color" field records information indicating the color and design of the product.

[0028] 4 is a diagram showing examples of items included in registered product information 593. Registered product information 593 is information on products registered for purchase by customers (i.e. products subject to transaction) compiled, for example, in the form of a table. Items of product information include, for example, "product code," "unit price," and "quantity." "Quantity" is the number of products purchased.

[0029] The program 591 is application software for operating the POS terminal 5. POS is an abbreviation for "Point Of Sale" and means "point of sale information management." The POS terminal is a device that performs point of sale information management.

[0030] The control unit 50 of the POS terminal 5 executes various processes by the CPU 51 operating in accordance with programs stored in the ROM 52 or the storage unit 59 and loaded into the RAM 53. The control unit 50 also provides various functional units (described later, see FIG. 13) by executing a program 591.

[0031] 5 is a block diagram showing an example of the configuration of the code scanner 6. The code scanner 6 includes a CPU 61, a ROM 62, a RAM 63, a communication unit 64, an imaging unit 65, and the like.

[0032] The CPU 61 is an example of a processor and controls each part of the code scanner 6. The ROM 62 stores various programs. The RAM 63 is a workspace for developing programs and various data. The CPU 61, the ROM 62, and the RAM 63 are connected via a bus or the like to constitute a control unit 60 having a computer configuration.

[0033] The communication unit 64 is a communication interface that communicatively connects the control unit 60 and an external device (for example, the collation terminal 7) via the network 9. The communication unit 64 also communicates with the POS terminal 5 via a USB cable.

[0034] The imaging unit 65 has an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS), captures an image of an article held by an operator, and acquires image data. The imaging unit 65 acquires multiple image data for each image captured by the operator holding an article over the camera.

[0035] The control unit 60 of the code scanner 6 executes various processes by the CPU 61 operating in accordance with a program stored in the ROM 62 and loaded in the RAM 63, thereby providing the following functions.

[0036] The code scanner 6 extracts a code symbol such as a barcode or a two-dimensional code from an image (captured image) that is composed of image data, and decodes the code symbol to obtain code information. The code information is information that can identify a product, such as a product code such as a JAN code. In other words, the code symbol in this case is an encoded JAN code.

[0037] Furthermore, the code scanner 6 outputs image data to the collating terminal 7 and receives a product code from the collating terminal 7. The code scanner 6 outputs to the POS terminal 5 either the product code it obtains by decoding the code symbol itself or the product code it receives from the collating terminal 7, whichever is obtained first. Furthermore, if the code scanner 6 finishes decoding and obtains a product code before receiving the product code from the collating terminal 7, it transmits the product code to the collating terminal 7.

[0038] 6 is a block diagram showing an example of the configuration of the verification terminal 7. The verification terminal 7 includes a CPU 71, a ROM 72, a RAM 73, a communication unit 74, a storage unit 79, and the like.

[0039] The CPU 71 is an example of a processor and controls each part of the collation terminal 7. The ROM 72 stores various programs. The RAM 73 is a workspace for developing programs and various data. The CPU 71, the ROM 72, and the RAM 73 are connected via a bus or the like to constitute a control unit 70 having a computer configuration.

[0040] The communication unit 74 is a communication interface that connects the control unit 70 and an external device (for example, the store server 3 and the code scanner 6) via the network 9 so that they can communicate with each other.

[0041] The storage unit 79 has a storage medium such as an HDD, SSD, or flash memory, and maintains the stored contents even when the power is cut off. The storage unit 79 stores programs executable by the CPU 71 and various setting information. The storage unit 79 also stores a comparison dictionary 794 and image information 795.

[0042] 7 is a diagram showing examples of items included in the matching dictionary 794. The matching dictionary 794 stores product codes and matching data in association with each other, for example, in the form of a table. The product codes included in the matching dictionary 794 correspond to products handled in the store in which the matching terminal 7 is installed. In other words, the product codes included in the matching dictionary 794 are product codes included in the product master 592.

[0043] The matching data is a representative value of the feature information. The feature information is information that indicates the external characteristics of an item. The feature information is a value that is output (obtained) by performing a predetermined process on image data obtained by imaging the external appearance of a product, and is, for example, a quantity having a magnitude and direction, such as a vector. The matching data is a standard value of the feature information that varies depending on the imaging conditions, etc.

[0044] In order to identify a product from its external appearance (i.e., its packaging), it is necessary to be able to view the product from various angles, so it is preferable to have matching data corresponding to various angles. Therefore, multiple matching data are registered for one product code.

[0045] 8 is a diagram showing examples of items included in the image information 795. The image information 795 stores product codes and image data in association with each other, for example, in the form of a table. The image data and product codes are received from the code scanner 6.

[0046] In the control unit 70 of the collation terminal 7, the CPU 71 operates according to a program stored in the ROM 72 and loaded into the RAM 73, thereby executing various processes and providing various functional units (described later, see FIG. 13).

[0047] 9 is a block diagram showing an example of the configuration of the store server 3. The store server 3 includes a CPU 31, a ROM 32, a RAM 33, a communication unit 34, a storage unit 39, and the like.

[0048] The CPU 31 is an example of a processor, and controls each part of the store server 3. The ROM 32 stores various programs. The RAM 33 is a workspace for expanding the programs and various data. The CPU 31, the ROM 32, and the RAM 33 are connected via a bus or the like, and constitute the control unit 30 of the computer configuration.

[0049] The communication unit 34 is a communication interface that communicatively connects the control unit 30 and an external device (for example, the POS terminal 5 and the collation terminal 7) via the network 9. The communication unit 34 is also communicatively connected to the server 1 via the network 2.

[0050] The storage unit 39 has a storage medium such as an HDD, SSD, or flash memory, and maintains the stored contents even when the power is cut off. The storage unit 39 stores various setting information such as a program 391 executable by the CPU 31 and a product master 392. The storage unit 39 also stores transaction information 393 and a comparison dictionary 394.

[0051] The items included in the product master 392 are the same as those included in the product master 592 shown in Fig. 3. The items included in the transaction information 393 are the same as those included in the registered product information 593 shown in Fig. 4. The items included in the matching dictionary 394 are the same as those included in the matching dictionary 794 shown in Fig. 7.

[0052] The control unit 30 of the store server 3 executes various processes by the CPU 31 operating in accordance with programs stored in the ROM 32 or the storage unit 39 and loaded into the RAM 33. The control unit 30 also provides various functional units (described later, see FIG. 13) by executing a program 391.

[0053] 10 is a block diagram showing an example of the configuration of the server 1. The server 1 includes a CPU 11, a ROM 12, a RAM 13, a communication unit 14, a storage unit 19, and the like.

[0054] The CPU 11 is an example of a processor and controls each part of the server 1. The ROM 12 stores various programs. The RAM 13 is a workspace for expanding the programs and various data. The CPU 11, the ROM 12, and the RAM 13 are connected via a bus or the like to constitute a control unit 10 of a computer configuration.

[0055] The communication unit 14 is a communication interface that connects the control unit 10 and an external device (eg, the store server 3) via the network 2 so that they can communicate with each other.

[0056] The storage unit 19 has a storage medium such as an HDD, SSD, or flash memory, and maintains the stored contents even when the power is cut off. The storage unit 19 stores various setting information such as a program 191 executable by the CPU 11 and a product master 192. The storage unit 19 also stores transaction information 193, a comparison dictionary 194, image information 195, etc.

[0057] 11 is a diagram showing examples of items included in the product master 192. The product master 192 is an example of product information, and information on products handled by a store is compiled, for example, in the form of a table. Items of product information include, for example, "store code," "product code," "product name," "unit price," "color," and "not available."

[0058] The store code is information that can identify a store, and is, for example, a unique number assigned to each store. In other words, the store code is not duplicated among stores of the same chain that are managed by the server 1.

[0059] The "Not Available" item is, for example, a flag; if the flag is OFF, it indicates that the store is carrying the product with the product code in the same record, and if the flag is ON, it indicates that the store is not carrying the product.

[0060] The product master 192 is the product master 592 (392) shown in Fig. 3 with the addition of the fields "store code" and "not available". The server 1 is connected to the store servers 3 of one or more stores. The server 1 extracts records contained in the product master 192 that are associated with the store code of each store and have the "not available" flag set to OFF, and transmits them as the product master 592 to be used by the POS terminal 5 of each store. Each store server 3 that receives these records updates the product master 592 of the POS terminal 5 of its own store.

[0061] FIG. 12 is a diagram showing examples of items included in transaction information 193. Transaction information 193 is information about products purchased by a customer compiled, for example, in the form of a table. Items of product information are, for example, "store code," "product code," "unit price," and "quantity." The items included in transaction information 193 are the same as those of registered product information 593 shown in FIG. 4, with the addition of an item of "store code."

[0062] The items included in the matching dictionary 194 are the same as those included in the matching dictionary 794 shown in Fig. 7. The items included in the image information 195 are the same as those included in the image information 795 shown in Fig. 8.

[0063] The control unit 10 of the server 1 executes various processes by the CPU 11 operating in accordance with programs stored in the ROM 12 or the storage unit 19 and loaded into the RAM 13. The control unit 10 also executes the program 191 to provide various functional units (described later, see FIG. 13).

[0064] Fig. 13 is a diagram showing an example of various functional units and their corresponding relationships included in each of the control units 10, 30, 50, 60, and 70. Fig. 14 is a diagram showing the operation timing and relationships of the above-mentioned functional units.

[0065] The control unit 10 of the server 1 includes a transaction information update unit 101, an image information storage unit 103, a matching dictionary update unit 104, a master distribution unit 105, etc. The control unit 30 of the store server 3 includes a transaction information update unit 301, an image information transfer unit 303, a master update unit 305, a master distribution unit 306, etc. The control unit 50 of the POS terminal 5 includes a product registration unit 501, a payment processing unit 502, a master update unit 505, etc. The control unit 70 of the matching terminal 7 includes a matching unit 701, an image information storage unit 702, an image information transfer unit 703, a matching dictionary update unit 704, etc. The operation of each unit will be described below with reference to FIG. 14.

[0066] First, when the POS terminal 5 starts a transaction during business hours, the control unit 60 of the code scanner 6 connected thereto captures an image of the commodity (step S61). The control unit 60 transfers data of the captured image (image data) to the collation terminal 7 (step S62).

[0067] Furthermore, the control unit 60 cuts out a code symbol from the captured image (step S63), and decodes the cut out code symbol (step S64) to obtain a product code.

[0068] Meanwhile, in the collation terminal 7 that has received the image data, the collation unit 701 performs a predetermined process on the image data to obtain information indicating the external characteristics of the product (characteristic information) (step S71).

[0069] Next, the matching unit 701 checks the acquired characteristic information against the matching data stored in the matching dictionary 794 (step S72). Then, the matching unit 701 transmits the product code associated with the matching data that matches the characteristic information to the code scanner 6 (step S73).

[0070] If the code scanner 6 completes the decoding in step S64 at an earlier timing than step S73, the control unit 60 transmits the product code obtained by the decoding to the verification terminal 7 (step S66). In this case, the verification terminal 7 does not transmit the product code to the code scanner 6. Also, in this case, the image information storage unit 702 of the verification terminal 7 stores the image data (step S74). In step S74, the image information storage unit 702 associates the image data transferred in step S62 with the product code received in step S66, and stores them in the storage unit 79 as image information 795.

[0071] The capturing of the image by the code scanner 6 (step S61) and the transfer of the image data (step S62) are repeated until the decoding is completed (step S64) or the product code is received from the verifying terminal 7 (step S73). Therefore, there is a high possibility that a plurality of image data are transferred from the code scanner 6 to the verifying terminal 7. In step S74, the same product code is associated with all of the image data and stored.

[0072] Moreover, if the collation (step S72) is successful in the collation terminal 7, the image data received by the collation terminal 7 through the transfer in step S62 may be discarded.

[0073] Then, the control unit 60 of the code scanner 6 transmits the product code acquired in step S64 or step S73 to the POS terminal 5 (step S65).

[0074] When a product code is received by the POS terminal 5, the product registration unit 501 obtains information about the product that matches the received product code (such as product name and unit price) from the product master 592, specifies the quantity, and records it as registered product information 593 (step S51).

[0075] In the product registration from the start of the transaction until the payment, a series of processes from step S61 to step S51 are repeated. When a key for instructing the transition to the payment provided in the operation unit 56 of the POS terminal 5 is operated, the control unit 50 ends the product registration and proceeds to the payment as the payment processing unit 502.

[0076] The payment processing unit 502 calculates the price of the product recorded in the registered product information 593 and performs payment processing such as transferring cash via the deposit / withdrawal unit 58 (step S52). Note that payment may be made by cashless payment such as credit card payment or electronic money payment instead of cash. When the payment processing is completed, the payment processing unit 502 transfers the registered product information 593 to the store server 3 (step S53).

[0077] When the store server 3 receives the registered product information 593, the control unit 30, functioning as the transaction information update unit 301, updates the transaction information 393 with the registered product information 593 (step S31). In other words, the transaction information update unit 301 stores the registered product information 593 received from the store server 3 in the storage unit 19 as the transaction information 393.

[0078] The transaction information update unit 301 further transmits the transaction information 393 to the server 1 (step S32). The transaction information 393 transmitted at this time may be an increment from the previous transmission (that is, an amount equivalent to the registered product information 593).

[0079] When the server 1 receives the transaction information 393, the control unit 10, functioning as the transaction information update unit 101, updates the transaction information 193 with the transaction information 393 (step S11). At this time, the transaction information update unit 101 associates the transaction information 393 with a store code that identifies the store that sent the transaction information, and stores the associated store code in the transaction information 193.

[0080] Next, a process performed at an arbitrary timing will be described. The arbitrary timing does not have to be during the business hours of the store, but may be outside the business hours (after closing to before opening), or may be when the product registration system 100 has sufficient traffic.

[0081] First, the control unit 30 of the collation terminal 7 functions as the image information transfer unit 703 to transfer the image information 795 to the store server 3 (step S75). Note that the image information 795 may be deleted after being transferred in step S75.

[0082] When the shop server 3 receives the image information 795, the control unit 30, functioning as the image information transfer unit 303, transfers it to the server 1 (step S33).

[0083] When the server 1 receives the image information 795, the control unit 10, as the image information storage unit 103, updates the image information 195 (step S12). That is, the image information storage unit 103 adds the image information 795 received from the store server 3 to the storage unit 19 as the image information 195.

[0084] Here, the image information storage unit 103 functions as an example of a code information acquisition unit that acquires code information that enables a product to be identified by reading a code symbol displayed on the product's packaging, and an image data acquisition unit that acquires image data of the product captured when the code symbol is read.

[0085] Next, the process performed outside business hours will be described. The control unit 10 of the server 1 functions as the matching dictionary update unit 104 and updates the matching dictionary 194 (step S13). In this update, the matching dictionary update unit 104 uses the record that is the latest increment (the record added in the previous step S12) among the image information 195. The matching dictionary update unit 104 performs a predetermined process on the image data of each record to obtain characteristic information, and adds the product data of the record associated with the characteristic information to the matching dictionary 194. In this step, automatic learning (registration, update) of new package information in the matching dictionary 194 is realized.

[0086] Here, the comparison dictionary update unit 104 functions as an example of a characteristic information acquisition unit that acquires characteristic information, which is information indicating the external characteristics of a product, from image data.

[0087] Next, the control unit 10, functioning as the master distribution unit 105, distributes the product master 192 (step S14) and the matching dictionary 194 (step S15) to the store server 3 of each store.

[0088] First, in step S14, the master distribution unit 105 transmits records that have been changed since the previous time among records that match the store code of the destination store in the product master 192. In addition, for records that have been changed from available to unavailable since the previous time, the master distribution unit 105 transmits an instruction to the store server 3 to delete the record of the corresponding product code.

[0089] In step S15, the master distribution unit 105 excerpts and distributes the matching dictionary 194 as necessary when distributing the matching dictionary 194. The excerpting here is a process for preventing the number of items handled by the matching dictionary 794 from becoming too large. This process keeps the number of items handled by the matching dictionary 794 appropriate.

[0090] Here, the master distribution unit 105 functions as an example of a dictionary output unit. In other words, the master distribution unit 105 outputs a matching dictionary 794 that stores one or more pieces of matching data in association with one product code, and when the number of product codes that can be included in the matching dictionary 794 exceeds a threshold, the master distribution unit 105 outputs (distributes) a matching dictionary 794 (an excerpt from the matching dictionary 194) that does not include information on product codes that are expected to be unlikely to be referenced based on a predetermined criterion.

[0091] The process of distributing the check dictionary 194 in step S15 will be described with reference to Fig. 15. Fig. 15 is a diagram showing an example of the process of distributing the check dictionary 194.

[0092] First, the master distribution unit 105 extracts from the product master 192 product codes that have been traded with a specified store code (of a store that is a distribution destination) and creates a list (step S151).

[0093] Next, the master distribution unit 105 determines whether the number of product codes (extracted number) included in the list created in step S151 exceeds a threshold (step S152). Here, the threshold is, for example, 10,000 or 20,000. The threshold can be appropriately changed.

[0094] In step S152, if the number of extractions exceeds the threshold value (Yes in step S152), the master distribution unit 105 refers to the transaction information 193 and deletes from the list any product codes that do not exist in the transaction information 193 for the most recent months (e.g., three months) (step S153).

[0095] Here, the above-mentioned "3 months" is an example of the second threshold value. The master distribution unit 105 determines (predicts) that a product code whose elapsed time since it was last registered as a trading object exceeds the second threshold value is unlikely to be referenced in future product registrations, and excludes it from distribution targets.

[0096] Furthermore, in step S152, if the number of extractions does not exceed the threshold value (No in step S152), the master distributor 105 advances the process to step S154.

[0097] Next, the master distribution unit 105 extracts records associated with the product codes included in the list from the collation dictionary 194 (step S154), and transmits them to the store server 3 (step S155).

[0098] Returning to FIG. 14, when the store server 3 receives the product master 192 and the matching dictionary 194 from the server 1, the control unit 30, functioning as the master update unit 305, updates the product master 392 (step S34) and updates the matching dictionary 394 (step S35).

[0099] When the product master 392 and the matching dictionary 394 are updated, the control unit 30 of the store server 3, as the master distribution unit 306, distributes the product master 392 to the POS terminals 5 in the store (step S36), and also distributes the matching dictionary 394 to the matching terminal 7 (step S37).

[0100] In the POS terminal 5 that has received the product master 392, the control unit 50 functions as the master update unit 505 and updates the product master 592 (step S54).

[0101] In the collation terminal 7 that has received the collation dictionary 394, the control unit 70 functions as the collation dictionary update unit 704 and updates the collation dictionary 794 (step S76).

[0102] In the product registration system 100 configured as above, image recognition is performed by the verification terminal 7 in parallel with decoding of the code symbol by the code scanner 6, and product registration and settlement are performed based on the code information obtained early.

[0103] The image data output by the code scanner 6 is input to the collation terminal 7. The collation terminal 7 generates information (characteristic information) indicating the external characteristics (shape, color, pattern, etc.) of the product captured in the captured image indicated by the image data, and compares the characteristic information with the collation data by referring to the collation dictionary 794.

[0104] The collation terminal 7 identifies the product by image recognition as described above, and returns the result to the code scanner 6. The recognition result output by the collation terminal 7 is output to the POS terminal 5 via the code scanner 6.

[0105] The POS terminal 5 registers the product and makes a payment for the registered product based on the code information output by the code scanner 6. The POS terminal 5 automatically registers the information of the identified product as a purchase target (transaction target).

[0106] Of the image data obtained by the code scanner 6 and transmitted to the verification terminal 7, those for which there is no verification data matching the characteristic information in the verification dictionary 793 are transmitted to the server 1 together with the product code specified by the code scanner 6. The server 1 generates verification data from the newly added (updated) image data and updates the verification dictionary 194. The additions (updates) to the verification dictionary 194 are transmitted to the verification terminal 7. This enables the verification terminal 7 to obtain verification data for products that could not be verified last time.

[0107] Furthermore, when updating the matching dictionary 794, if the number of entries becomes too large (exceeds a threshold value), items with product codes that have not appeared in recent (e.g., the last few months) transaction information 193 are excluded. This makes it possible to omit matching data for products that are unlikely to be used in the product registration process.

[0108] The above-described embodiment can be modified as appropriate by changing part of the configuration or function of each of the above-described devices.

[0109] For example, in the above embodiment, the number of entries in the comparison dictionary 794 is reduced by not including product codes that have not appeared in the transaction information 193 for three months, but the present invention is not limited to this.

[0110] For example, in implementation, the master distribution unit 105 may reduce the number of items in the matching dictionary 794 by not including in the matching dictionary 794 matching data (feature information) that was acquired by the matching dictionary update unit 104 (when it was added to the matching dictionary 194) older than a predetermined standard.

[0111] If the above-mentioned predetermined standard is set to, for example, 12 months, the matching data included in the matching dictionary 794 is limited to the characteristic information of packages registered in the past year. In this case, matching data of a package that has not been changed for a long period of time exceeding one year will not be included in the matching dictionary 794. Therefore, for that package, matching data based on new captured images is generated again, and the matching dictionaries 194, 394, 794 are updated.

[0112] Alternatively, when the number of product codes included in the matching dictionary 794 exceeds a threshold value, the master distribution unit 105 (dictionary output unit) may not include new matching data in the matching dictionary 794. In this case, product codes that were not previously included in the matching dictionary 794 will not be added. In this case, therefore, manual maintenance of the recorded data is performed as appropriate.

[0113] In addition, in the embodiment, the POS terminal 5 may be operated by a store clerk or may be operated by a customer. In the embodiment, the server 1 may be composed of multiple devices instead of a single device. In the embodiment, the functional unit described as being possessed by the server 1 may be performed by any of the devices in the store. In the embodiment, a device corresponding to the server 1 may be provided in the store. In the embodiment, the store server 3 may not be required. In the embodiment, the collation terminal 7 may be shared by multiple code scanners 6. In the embodiment, the memory unit 19 (39, 59, 79) is an example of a device that provides a memory area capable of storing various information, and the information that is stored in the same memory unit in the above embodiment does not need to be stored in the same memory unit in the embodiment, and may be stored separately in multiple storage devices.

[0114] The programs executed by each device of the above-described embodiments are provided by being pre-installed in a ROM, etc. The programs executed by each device of the above-described embodiments may be provided by being recorded in an installable or executable format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD).

[0115] Furthermore, the programs executed by each device of the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by each device of the above-described embodiments may be provided or distributed via a network such as the Internet.

[0116] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0117] 100...Product registration system, 1 ... server, 10 ... control unit, 101: transaction information update unit; 103: image information storage unit; 104: Matching dictionary update unit; 105: Master distribution unit; 11...CPU, 12...ROM, 13...RAM, 14...Communication section, 19...Storage section, 191... program, 192... product master, 193... transaction information, 194... Matching dictionary, 195... Image information, 2 …Network, 3...Store server, 30 ... control unit, 301: transaction information update unit; 303: image information transfer unit; 305...master update unit, 306...master distribution unit, 31...CPU, 32...ROM, 33...RAM, 34...Communication section, 39...Storage section, 391...program, 392...product master, 393...transaction information, 394...collation dictionary, 5 … POS terminals, 50: control unit; 501: product registration unit; 502: payment processing unit; 505: master update unit; 51...CPU, 52...ROM, 53...RAM, 54...Communication section, 55 ... display unit, 56 ... operation unit, 57 ... voice output unit, 58 ... deposit and withdrawal unit, 59 ... memory unit, 591 ... program, 592 ... product master, 593 ... registered product information, 6 ... code scanner, 60 ... control unit, 61 ... CPU, 62 ... ROM, 63 ... RAM, 64 ... communication unit, 65 ... imaging unit, 7 …collation terminal, 70 ... control unit, 701: Collation unit; 702: Image information storage unit; 703: Image information transfer unit; 704: Matching dictionary update unit; 71...CPU, 72...ROM, 73...RAM, 74...Communication section, 79 ... memory unit, 793 ... dictionary for matching, 794 ... dictionary for matching, 795 ... image information, 9...Network. [Prior art documents] [Patent documents]

[0118] [Patent Document 1] JP 2014-021915 A

Claims

1. a code information acquiring unit that acquires code information for identifying a product by reading a code symbol displayed on a package of the product; an image data acquisition unit that acquires image data of the product captured when the code symbol is read; a characteristic information acquiring unit that acquires characteristic information indicating characteristics of an external appearance of the product from the image data; a dictionary output unit that outputs a comparison dictionary that stores one or more pieces of feature information in association with one piece of code information, and when the number of pieces of code information included in the comparison dictionary exceeds a threshold value, outputs the comparison dictionary that does not include the code information that is expected to be unlikely to be referenced based on a predetermined judgment criterion and the feature information associated with the code information; An information processing device comprising:

2. The dictionary output unit determines the code information, for which a period of time elapsed since the code information was last registered as a transaction target exceeds a second threshold, as the code information that is expected to be unlikely to be referenced based on a predetermined determination criterion. The information processing device according to claim 1 .

3. The dictionary output unit does not include, in the comparison dictionary, any of the feature information that was acquired by the feature information acquisition unit more than a predetermined criterion years ago. The information processing device according to claim 1 .

4. When the number of pieces of code information included in the comparison dictionary exceeds a threshold, the dictionary output unit does not include new pieces of feature information in the comparison dictionary. The information processing device according to claim 1 .

5. A computer included in a system for registering products related to sales data processing, a code information acquiring unit that acquires code information for identifying a product by reading a code symbol displayed on a package of the product; an image data acquisition unit that acquires image data of the product captured when the code symbol is read; a characteristic information acquiring unit that acquires characteristic information indicating characteristics of an external appearance of the product from the image data; a dictionary output unit that outputs a comparison dictionary that stores one or more pieces of feature information in association with one piece of code information, and when the number of pieces of code information included in the comparison dictionary exceeds a threshold value, outputs the comparison dictionary that does not include the code information that is expected to be unlikely to be referenced based on a predetermined judgment criterion and the feature information associated with the code information; A program to function as a

Citation Information

Patent Citations

  • Commodity recognition device and recognition dictionary adding program

    JP2014021915A

  • Object recognition scanner system, dictionary server, object recognition scanner, dictionary server program and control program

    JP2014032539A

  • Shop system

    JP2015064628A