Information processing device and product information registration system

Abstract

To provide an information processor and an article information registration system capable of improving operability for an operator to specify an article.SOLUTION: An information processor according to an embodiment includes: acquisition means for acquiring a captured image of an article; first specification means for specifying the article based on a code symbol affixed to the article included in the captured image acquired by the acquisition means; second specification means for specifying the article based on a feature of the appearance of the article included in the image captured by the acquisition means; and output means for outputting article identification information identifying the article specified by the first specification means or the second specification means.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an information processing device and a product information registration system. [Background technology]

[0002] Stores that sell goods and services (hereinafter collectively referred to as "goods") use a POS (Point of Sales) system. This type of POS system is equipped with a scanner that reads product codes from barcodes attached to products (hereinafter also referred to as "product barcodes"). The POS system registers information about the products that customers intend to purchase based on the product codes read by the scanner.

[0003] Operators of POS systems had to find product barcodes on items and scan them, making the product code reading process cumbersome. As a result, registering product information (hereinafter also referred to as "product registration") was a time-consuming task for operators. In particular, in so-called self-service POS systems, customers unfamiliar with product registration need to scan product barcodes, so there is a need to improve the usability of product code reading, or in other words, the operator's ability to identify products. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide an information processing device and a product information registration system that can improve the operability of an operator for identifying a product. [Means for solving the problem]

[0005] The information processing device of the embodiment includes an acquisition means for acquiring an image of a product, a first identification means for identifying the product based on a code symbol attached to the product included in the image acquired by the acquisition means, a second identification means for identifying the product based on the appearance characteristics of the product included in the image acquired by the acquisition means, and an output means for outputting product identification information that identifies the product identified by the first identification means or the second identification means. In addition, the output means outputs product identification information identifying the product identified by the first identification means if the product identification by the first identification means is performed more than a predetermined time after the product identification by the second identification means, and outputs product identification information identifying the product identified by the second identification means if the product identification by the first identification means is performed more than a predetermined time after the product identification by the second identification means. [Brief explanation of the drawings]

[0006] [Figure 1] Figure 1 is a perspective view showing the external appearance of the self-service POS system according to the embodiment. [Figure 2] Figure 2 is a block diagram showing the hardware configuration of the self-service POS system according to the embodiment. [Figure 3] Figure 3 shows the data structure of the product master stored in the memory unit of the POS terminal of the embodiment. [Figure 4] Figure 4 is a block diagram showing the functional configuration of the control unit of the POS terminal according to the embodiment. [Figure 5] Figure 5 shows the data structure of the code information management table stored in the memory unit of the scanner of the embodiment. [Figure 6] Figure 6 is a block diagram showing the functional configuration of the control unit of the scanner according to the embodiment. [Figure 7] Figure 7 illustrates the timing of product code output by the control unit of the scanner in this embodiment. [Figure 8] Figure 8 is a flowchart showing the operation flow of the first identification process by the control unit of the scanner in the embodiment. [Figure 9] Figure 9 is a flowchart showing the operation flow of the second identification process by the control unit of the scanner in the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] The following describes an information processing device and a product information registration system based on embodiments, with reference to the drawings. However, the invention is not limited to the embodiments described below. For example, the embodiments described below describe an example in which a scanner is used as the information processing device, but the invention is not limited to this. The information processing device may also consist of a POS terminal.

[0008] Alternatively, the information processing device may be configured with a scanner and a POS terminal. In this case, the scanner functions described in this embodiment are realized by the cooperation of the scanner and the POS terminal. For example, only the decoding of product barcodes may be performed by the POS terminal.

[0009] In the embodiment described below, the product information registration system is an example of a self-service POS system, but the present invention is not limited to this. The product information registration system may also be a POS system operated by a salesperson at a store that sells products.

[0010] 1 is a perspective view showing the appearance of a self-service POS system 1. The self-service POS system 1 has a POS terminal 10 and a scanner 20 built into the POS terminal 10. Here, the self-service POS system 1 is an example of a product information registration system, the POS terminal 10 is an example of a registration device, and the scanner 20 is an example of an information processing device.

[0011] The scanner 20 identifies the product the customer is purchasing and outputs the product code for that product to the POS terminal 10. The product code is an example of product identification information that identifies a product. The POS terminal 10 registers the product based on the product code entered from the scanner 20 and also performs accounting processing related to the registered product. Accounting processing is the process that the POS terminal 10 performs in order for the customer to pay for the purchased product.

[0012] As shown in Figure 1, the POS terminal 10 comprises a main unit 50, a first basket stand 70, and a second basket stand 80. The main unit 50 has a display 51 and a touch panel 52 on its top, and houses a printer 53, a card reader 54, and a change dispenser 55 (see Figure 2 for each) inside.

[0013] Display 51 is a display device such as an LCD (Liquid Crystal Display) that displays various information. For example, display 51 displays product information such as the product name and price of a product registered by a customer. Display 51 also displays transaction information such as the total amount of the transaction and the amount of change due as the customer completes the transaction.

[0014] The touch panel 52 is located on the surface of the display 51 and inputs information corresponding to the touch location to the control unit 100 (see Figure 2) of the POS terminal 10. Customers using the POS terminal 10 can operate the touch panel 52 by touching various buttons and operation keys displayed on the display 51.

[0015] As shown in Figure 1, below the display 51, facing the direction of the customer, are the reading window 230 for the scanner 20, the receipt printing slot 531 for the printer 53, and the card insertion slot 541 for the card reader 54.

[0016] The reading window 230 is a window through which the scanner 20 captures an image of the exterior of a product. A customer, who is an operator operating the self-service POS system 1, performs an operation related to product registration by holding the product to be purchased over the reading window 230. The customer holds the product over the reading window 230 while changing the orientation of the product relative to the reading window 230 until the self-service POS system 1 executes product registration and generates a registration completion sound.

[0017] The scanner 20 identifies a product using a captured image of the product. Specifically, the scanner 20 executes a first identification method for identifying the product based on a product barcode included in the captured image, and a second identification method for identifying the product based on the external characteristics of the product included in the captured image. The first and second identification methods will be described in detail below. Here, the product barcode is an example of a code symbol attached to a product.

[0018] The issuing port 531 is an opening through which receipts printed by the printer 53 are ejected. Information related to transactions processed by the POS terminal 10 is printed on the receipt. The POS terminal 10 may be configured to issue electronic receipts instead of paper receipts printed by the printer 53.

[0019] Card insertion slot 541 is an opening for inserting a credit card or the like to be read by card reader 54. A card is inserted through card insertion slot 541 when a customer makes a payment by credit card or when a customer has a store membership card or the like read.

[0020] In addition, the main body 50 is formed with a coin insertion slot 551, a coin ejection slot 552, a coin receiving tray 553, a bill insertion slot 554, and a bill ejection slot 555 corresponding to the position of the change dispenser 55 housed inside.

[0021] The coin slot 551 is an opening through which customers insert coins to be paid. Coins inserted into the coin slot 551 are stored in the change machine 55. The coin discharge slot 552 is an opening through which coins to be dispensed from the change machine 55 are discharged. The coin discharge slot 552 discharges change or coins inserted into the coin slot 551 but not accepted by the change machine 55. The coin tray 553 is a tray that receives coins discharged from the coin discharge slot 552. The banknote slot 554 is an opening through which customers insert banknotes to be paid. Banknotes inserted into the banknote slot 554 are stored in the change machine 55. The banknote discharge slot 555 is an opening through which banknotes that are change to be dispensed from the change machine 55 are discharged.

[0022] The first basket stand 70 is a stand on which a shopping basket (not shown) containing items that a customer wishes to purchase is placed. The first basket stand 70 is equipped with a first weighing unit 71. The first weighing unit 71 weighs the total weight of the shopping basket placed on the first basket stand 70 and the items contained in the shopping basket.

[0023] The second basket stand 80 is a stand for placing shopping baskets (not shown) containing registered products that have been removed from the shopping basket placed on the first basket stand 70 and whose product codes have been read, for example, by the scanner 20. The second basket stand 80 includes a second weighing unit 81, a pair of support rods 82, and a temporary stand 83.

[0024] The second weighing unit 81 weighs the total weight of a shopping basket placed on the second basket placement table 80 and the items contained in the shopping basket, or the total weight of a shopping bag (not shown) supported by a pair of support rods 82 and the items contained in the shopping bag. The support rods 82 are rods for hooking and supporting a shopping bag containing registered items. The support rods 82 support the shopping bag in an open state, making it easier to place items into the shopping bag. The temporary placement table 83 is a table for temporarily placing registered items that are easily broken or deformed, such as tofu or eggs. The customer can then place the items placed on the temporary placement table 83 into a shopping basket or shopping bag.

[0025] The customer registers the product by holding the product taken out of the shopping basket placed on the first basket placement stand 70 over the reading window 230. The customer then places the registered product into a shopping basket placed on the second basket placement stand 80 or a shopping bag supported by the support rod 82.

[0026] The control unit 100 (see FIG. 2) recognizes the weight change when the first weighing unit 71 weighs the weight before and after an item is removed from a shopping basket placed on the first basket placing table 70. The control unit 100 recognizes the weight change when the second weighing unit 81 weighs the weight before and after an item is placed in a shopping basket placed on the second basket placing table 80 or a shopping bag supported by the support rod 82. Depending on whether these two weight changes are equal, the control unit 100 can determine whether all of the items the customer wishes to purchase have been registered.

[0027] The main body 50 also has a cylindrical pole 57 extending upward. The pole 57 has a light emitting part 571 at its upper end that emits light when a store clerk is called.

[0028] 2 is a block diagram showing the hardware configuration of the self-checkout POS system 1. As described above, the self-checkout POS system 1 includes the POS terminal 10 and the scanner 20. The POS terminal 10 and the scanner 20 are connected to each other via connection interfaces 121 and 221 so as to be able to communicate with each other.

[0029] First, let's describe the hardware configuration of POS terminal 10.

[0030] The POS terminal 10 includes a control unit 100, a memory unit 110, a display 51, a touch panel 52, a printer 53, a card reader 54, a change dispenser 55, a first weighing unit 71, a second weighing unit 81, a light-emitting unit 571, an audio output unit 120, a connection interface 121, and a communication unit 122. The control unit 100, the memory unit 110, the display 51, the touch panel 52, the printer 53, the card reader 54, the change dispenser 55, the first weighing unit 71, the second weighing unit 81, the light-emitting unit 571, the audio output unit 120, the connection interface 121, and the communication unit 122 are connected to one another via a bus 123 or the like.

[0031] The control unit 100 is configured as a computer including a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103. The CPU 101, the ROM 102, and the RAM 103 are connected to each other via a bus 123.

[0032] The CPU 101 controls the entire POS terminal 10. The ROM 102 stores various programs and data, such as the program used to drive the CPU 101. The RAM 103 is used as the work area for the CPU 101 and loads the various programs and data stored in the ROM 102 and the memory unit 110. The control unit 100 executes various control processes for the POS terminal 10 by having the CPU 101 operate according to the control programs stored in the ROM 102 and the memory unit 110 and loaded into the RAM 103.

[0033] The RAM 103 also has a product information unit 1031. The product information unit 1031 stores product information read from the product master 112 (described later) based on the product code acquired from the scanner 20. Product registration is performed when product information is stored (registered) in the product information unit 1031. The product information stored in the product information unit 1031 includes the product code, product name, and price. The product information unit 1031 stores product information related to one transaction and is cleared when the accounting processing for that transaction is completed.

[0034] The storage unit 110 is configured with a storage medium such as a hard disk drive (HDD) or flash memory, and maintains its stored contents even when power is cut off. The storage unit 110 stores a control program 111 and a product master 112.

[0035] The control program 111 is a program for realizing functions such as acquiring a product code from the scanner 20, performing product registration based on the acquired product code, and performing accounting processing for the registered product.

[0036] The product master 112 is a master file that stores product information for the products handled by the store. Since the products handled by the store change daily, the product master 112 is updated as needed by a store server (not shown) connected via the communication unit 122. Figure 3 shows the data structure of the product master 112. The product master 112 stores product classification, product name, and price, associated with the product code.

[0037] The product code is information that identifies a product. The product classification is information that classifies the products sold in the store. The product name is information that indicates the name of the product. The price is information that indicates the price (unit price) of the product. Note that the product master 112 may store other information in association with the product code.

[0038] 2, the hardware configuration of the POS terminal 10 will be described. The configurations and functions of the display 51 and the touch panel 52 are as described above.

[0039] The printer 53 is configured by, for example, a thermal printer. The printer 53 prints information about the transaction on a roll of receipt paper and issues the paper as a receipt from the issuing port 531.

[0040] The card reader 54 reads the credit information necessary for payment from the credit card inserted through the card slot 541. The card reader 54 also reads member information that identifies the member from a membership card or point card or other medium inserted through the card slot 541. The card reader 54 may read information magnetically from the card, or it may be an IC card reader that reads information from an IC card with a built-in IC (Integrated Circuit) chip.

[0041] When a customer pays for a product in cash, the change dispenser 55 accepts the bills and coins paid by the customer and dispenses change as needed. Bills are inserted through a bill insertion slot 554, and coins are inserted through a coin insertion slot 551. Furthermore, bills as change are ejected from a bill ejection slot 555, and coins as change are ejected from a coin ejection slot 552.

[0042] The configuration and functions of the first weighing unit 71, the second weighing unit 81, and the light-emitting unit 571 are as described above. The voice output unit 120 generates voice as needed to notify the customer of information. For example, the voice output unit 120 outputs a notification sound to indicate that product registration is complete. The voice output unit is an example of a notification unit.

[0043] The connection interface 121 is an interface for communicating with the scanner 20. The control unit 100 transmits and receives information (data) to and from the scanner 20 via the connection interface 121. The communication unit 58 is an interface for communicating with an external device such as a store server (not shown) managed by the store. The control unit 100 transmits and receives information to and from the external device via the communication unit 122.

[0044] Next, the hardware configuration of the scanner 20 will be described.

[0045] The scanner 20 identifies a product purchased by a customer using a first and second identification methods based on a captured image of the product. The first identification method identifies the product by recognizing the product barcode included in the captured image, i.e., the barcode attached to the captured product, and decoding the recognized product barcode to read the product code. The second identification method identifies the product by so-called object recognition, which identifies the product based on the external features of the product included in the product image, i.e., the external features of the captured product.

[0046] In the first and second identification methods, the process for identifying a product executed by the control unit 200 may be executed by the control unit 100 of the POS terminal 10. In this case, the POS terminal 10 constitutes an information processing device. In the first and second identification methods, the process for identifying a product executed by the control unit 200 may be executed by the control unit 100 of the POS terminal 10 in cooperation with the control unit 200 of the scanner 20. In this case, the POS terminal 10 and the scanner 20 constitute an information processing device.

[0047] The scanner 20 includes a control unit 200, a storage unit 210, an imaging unit 220, and a connection interface 221. The control unit 200, the storage unit 210, the imaging unit 220, and the connection interface 221 are connected to one another via a bus 222 or the like.

[0048] The control unit 200 is configured as a computer including a CPU 201, a ROM 202, and a RAM 203. The CPU 201, the ROM 202, and the RAM 203 are connected to one another via a bus 222.

[0049] The CPU 201 controls the entire scanner 20. The ROM 202 stores various programs, such as a program used to drive the CPU 201, and various data. The RAM 203 is used as a work area for the CPU 201, and loads various programs and data stored in the ROM 202 and the storage unit 210. The control unit 200 executes various control processes for the scanner 20 by the CPU 201 operating in accordance with the control programs stored in the ROM 202 and the storage unit 210 and loaded in the RAM 203.

[0050] The storage unit 210 is configured with a storage medium such as a HDD or flash memory, and maintains its stored contents even when the power is turned off. The storage unit 210 stores a control program 211 and a code information management table 212.

[0051] The control program 211 is a program that implements functions such as acquiring images of products, identifying products in the images based on the product barcodes included in the images, identifying products based on the external characteristics of the products included in the images, and outputting the product code of the identified product to the POS terminal 10.

[0052] The code information management table 212 is a data table that manages products in association with their appearance feature amounts. Fig. 5 is a diagram showing the data structure of the code information management table 212. The code information management table 212 stores product names and feature amounts in association with product codes.

[0053] As described above, the product code is information that identifies a product, and the product name is information that indicates the name of the product. Feature quantities are parameterized representations of the product's appearance, such as its standard shape, surface color, pattern, and unevenness. The control unit 200 identifies a product from among the products pre-stored in the code information management table 212 based on the feature quantities extracted from the product's appearance included in the captured image.

[0054] Returning to FIG. 2, the hardware configuration of the scanner 20 will be described.

[0055] The imaging unit 220 is composed of, for example, a color CCD image sensor or a color CMOS image sensor. The imaging unit 220, under the control of the control unit 200, captures images of the product through the reading window 230 and outputs the captured images of the product. For example, the imaging unit 220 captures moving images at a predetermined frame rate (for example, 30fps). The frame images sequentially captured by the imaging unit 220 are stored in the RAM 203.

[0056] The frame image (captured image of the product) stored in the RAM 203 is used to identify the product included in the frame image. In other words, the control unit 200 identifies the product included in the captured image, i.e., the product captured by the imaging unit 220, based on the captured image stored in the RAM 203.

[0057] The connection interface 221 is an interface for communicating with the POS terminal 10. The control unit 200 transmits and receives information (data) to and from the POS terminal 10 via the connection interface 221.

[0058] Next, the functional configuration of POS terminal 10 will be described. Fig. 4 is a block diagram showing the functional configuration of control unit 100 of POS terminal 10. Control unit 100 functions as input means 1001, registration means 1002, accounting processing means 1003, and output means 1004 when CPU 101 operates in accordance with control programs stored in ROM 102 or storage unit 110. Note that each of these functions may be configured using hardware such as a dedicated circuit.

[0059] Various information is input to the input means 1001 from the scanner 20, the touch panel 52, the card reader 54, the first weighing unit 71, the second weighing unit 81, etc. For example, a product code is input to the input means 1001 from the scanner 20.

[0060] Furthermore, information based on the operation of the touch panel 52 is input to the input means 1001. For example, transaction start information declaring the start of one transaction is input to the input means 1001. Furthermore, registration completion information indicating that product registration of the product related to one transaction has been completed is input to the input means 1001.

[0061] The registration means 1002 executes product registration of a product that the customer wishes to purchase through an operation by the customer. In other words, the registration means 1002 registers information about the product identified by the product identification information input to the input means 1001. Specifically, the registration means 1002 reads product information from the product master 112 based on the product code input to the input means 1001. Then, the registration means 1002 stores the read product information in the product information section 1031. The product information is information including the product code, product name, price, etc.

[0062] The transaction processing means 1003 executes transaction processing related to payment for the products registered by the registration means 1002. Specifically, the transaction processing means 1003 executes processing to calculate the total price (transaction amount) of the registered products, calculate the amount of change, display various information, issue receipts, etc. If the customer desires cashless payment such as credit card payment or two-dimensional code payment, the transaction processing means 1003 can execute the transaction processing necessary for payment.

[0063] The output means 1004 outputs various information to the scanner 20, the printer 53, the change dispenser 55, the light emitting unit 571, the audio output unit 120, etc. For example, when transaction start information is input to the input means 1001, the output means 1004 outputs an imaging start signal that instructs the scanner 20 to start imaging. Also, when registration completion information is input to the input means 1001, the output means 1004 outputs an imaging stop signal that instructs the scanner 20 to stop imaging.

[0064] When the registration means 1002 completes the product registration for one product, the output means 1004 outputs a control signal to the audio output unit 120 to output an alert sound. The output means 1004 functions as an alert means for causing the alert unit (audio output unit 120) to notify that the registration means 1002 has completed the registration of product information. The audio output unit 120 may be provided in the scanner 20. In this case, the audio output unit 120 may be configured to emit an alert sound when the scanner 20 identifies the product code.

[0065] Next, the functional configuration of scanner 20 will be described. Fig. 6 is a block diagram showing the functional configuration of control unit 200 of scanner 20. Control unit 200 functions as acquisition means 2001, first identification means 2002, second identification means 2003, and output means 2004 when CPU 201 operates in accordance with a control program stored in ROM 202 or storage unit 210. Note that each of these functions may be configured using hardware such as a dedicated circuit.

[0066] The acquisition unit 2001 acquires captured images of merchandise. Specifically, the acquisition unit 2001 acquires frame images (hereinafter simply referred to as "captured images") of merchandise captured by the imaging unit 220, and stores them in the RAM 203. The acquisition unit 2001 may acquire all captured images of merchandise by sequentially acquiring the captured images captured by the imaging unit 220, or may acquire only the necessary captured images. The acquisition unit 2001 may also acquire captured images of merchandise from an external camera.

[0067] The acquiring unit 2001 acquires various other information, for example, an imaging start signal and an imaging stop signal from the POS terminal 10.

[0068] The first identification means 2002 identifies a product included in the captured image by a first identification method. Specifically, the first identification means 2002 identifies the product based on a code symbol attached to the product included in the captured image acquired by the acquisition means 2001. More specifically, the first identification means 2002 extracts a product barcode from the captured image acquired by the acquisition means 2001. Then, the first identification means 2002 decodes the extracted product barcode to read the product code indicated by the product barcode.

[0069] Since the product code is product identification information, reading the product code, i.e., identifying the product code, is synonymous with identifying the product. Therefore, it can be said that the first identification means 2002 identifies the product by reading the product code from the product barcode included in the captured image.

[0070] The second identification means 2003 identifies a product included in the captured image by a second identification method. Specifically, the second identification means 2003 identifies the product based on the external characteristics of the product included in the captured image acquired by the acquisition means 2001. More specifically, the second identification means 2003 extracts external characteristics of the product from the captured image acquired by the acquisition means 2001. Then, the second identification means 2003 identifies a product code corresponding to the extracted characteristics by referring to the code information management table 212. The second identification means 2003 identifies the product by identifying the product code of the product included in the captured image.

[0071] The second identification unit 2003 may identify the product code of the product included in the captured image using character recognition. In this case, for example, the code information management table 212 stores the product code in association with the character information. The second identification unit 2003 then extracts an external image of the product from the captured image, recognizes the characters included in the external image, and identifies the product code by referring to the code information management table 212.

[0072] The output means 2004 outputs product identification information that identifies the product identified by the first identification means 2002 or the second identification means 2003. Specifically, the output means 2004 outputs the product code identified by the first identification means 2002 or the second identification means 2003 to the POS terminal 10 via the connection interface 221.

[0073] More specifically, if the product identification by the first identification means 2002 is performed before a predetermined time has elapsed since the product identification by the second identification means 2003, the output means 2004 outputs the product code identified by the first identification means 2002 to the POS terminal 10. Furthermore, if the product identification by the first identification means 2002 is performed after a predetermined time has elapsed since the product identification by the second identification means 2003, the output means 2004 outputs the product code identified by the second identification means 2003 to the POS terminal 10.

[0074] Here, we will explain the timing at which the scanner 20 outputs the product code to the POS terminal 10. Figure 7 is a diagram illustrating the timing of product code output by the control unit 200 of the scanner 20. Case (A) in Figure 7 shows the case in which a product code identified by the first identification method by the first identification means 2002 is output, and case (B) shows the case in which a product code identified by the second identification method by the second identification means 2003 is output.

[0075] The process by which the first identification means 2002 implements the first identification method (hereinafter also referred to as the "first identification process") and the process by which the second identification means 2003 implements the second identification method (hereinafter also referred to as the "second identification process") are executed simultaneously. In Figure 7, T1 is the time it takes for the first identification means 2002 to identify the product code, T2 is the time it takes for the second identification means 2003 to identify the product code, and T3 is a pre-set waiting time.

[0076] The time T1, during which the first identification means 2002 identifies the product code, includes cases where multiple captured images are processed to identify the product code by the first identification method. Similarly, the time T2, during which the second identification means 2003 identifies the product code, includes cases where multiple captured images are processed to identify the product code by the second identification method.

[0077] The waiting time T3 is an example of a predetermined time from product identification by the second identification means 2003. Generally, product code identification based on product barcodes is more accurate than product code identification based on product appearance features. For this reason, in this embodiment, the waiting time T3 is set to prioritize product code identification by the first identification means 2002 as much as possible. The waiting time T3 is a length of time that does not cause the operator to feel that the operation is inconvenient while waiting for product code identification by the first identification means 2002, and can be set arbitrarily by the store introducing the self-POS system 1.

[0078] By setting the waiting time T3, it is possible to ensure the accuracy of product identification while improving the operability of the operator. Note that the waiting time T3 does not necessarily have to be set.

[0079] In case (A), since T1 < T2 + T3, the product code identification result by the first identification means 2002 is output to the POS terminal 10. In this case, although the product code identification by the second identification means 2003 is faster than the product code identification by the first identification means 2002, the output means 2004 gives priority to the accuracy of the product code identification and outputs the product code identified by the first identification means 2002.

[0080] In case (B), since T1 > T2 + T3, the product code identification result by the second identification means 2003 is output to the POS terminal 10. In this case, similar to case (A), the product code identification by the second identification means 2003 is faster than the product code identification by the first identification means 2002. However, if waiting for the product code identification by the first identification means 2002, the operability is considered to decrease. Therefore, giving priority to the operability, the output means 2004 outputs the product code identified by the second identification means 2003.

[0081] In the case of T1 = T2 + T3, it is desirable for the output means 2004 to output the product code identified by the more accurate first identification means 2002.

[0082] Next, the operation of the scanner 20 based on the above configuration will be described. When the scanner 20 acquires an imaging start signal from the POS terminal 10, it operates the imaging unit 220 and performs the first identification process and the second identification process in parallel.

[0083] First, the first identification process will be described. FIG. 8 is a flowchart showing the operation flow of the first identification process by the control unit 200 of the scanner 20.

[0084] The first identification means 2002 reads out a captured image from the RAM 203 (step S1). Then, the control unit 200 determines whether the first identification means 2002 has detected a product barcode from the read-out captured image (step S2). In other words, the control unit 200 determines whether a product barcode is captured in the read-out frame image.

[0085] If a product barcode is not detected from the captured image (N in step S2), the control unit 200 returns to the processing in step S1. In this case, the first identification means 2002 reads the next captured image from the RAM 203. If a product barcode is detected from the captured image (Y in step S1), the control unit 200 determines whether the output means 2004 has not yet transmitted a product code to the POS terminal 10 (step S3). In other words, the control unit 200 determines whether the product code identified by the second identification means 2003 has already been output to the POS terminal 10 by the output means 2004.

[0086] If the product code has not yet been transmitted (N in step S3), that is, if the product code identified by the second identification means has already been output by the output means 2004, the control unit 200 ends the first identification process. If the product code has not yet been transmitted (Y in step S3), the first identification means 2002 decodes the product barcode detected from the captured image and reads the product code indicated by the product barcode (step S4).

[0087] The output means 2004 outputs a signal to cause the audio output unit 120 to output an alarm sound (step S5). Subsequently, the output means 2004 outputs the read product code to the POS terminal 10 (step S6). Then, the control unit 200 ends the first identification process.

[0088] Next, the second identification process will be explained. Figure 9 is a flowchart showing the operation flow of the second identification process by the control unit 200 of the scanner 20.

[0089] The second identification means 2003 reads the captured image from the RAM 203 (step S11). Subsequently, the second identification means 2003 extracts feature quantities of the product's appearance from the read captured image (step S12). The control unit 200 determines whether or not it has identified the product code based on the feature quantities extracted by the second identification means 2003 (step S13).

[0090] If the second identification means 2003 does not identify the product code (N in step S13), the control unit 200 returns to the process of step S11. In this case, the second identification means 2003 reads the next captured image from the RAM 203. If the second identification means 2003 identifies the product code (Y in step S13), the control unit 200 waits for a predetermined time (T3 in FIG. 7) (step S14).

[0091] Next, the control unit 200 determines whether the output means 2004 has not yet transmitted the product code to the POS terminal 10 (step S15). In other words, the control unit 200 determines whether the product code identified by the first identification means 2002 has already been output to the POS terminal 10 by the output means 2004.

[0092] If the product code has not been sent (N in step S15), that is, if the product code identified by the first identification means has already been output by the output means 2004, the control unit 200 terminates the second identification process.

[0093] If the product code has not been transmitted (Y in step S15), the output means 2004 outputs a signal to the audio output unit 120 to output an alert sound (step S16). Next, the output means 2004 outputs the read product code to the POS terminal 10 (step S17). Then, the control unit 200 terminates the second identification process.

[0094] The control unit 200 of the scanner 20 processes the first identification process and the second identification process in parallel and outputs the product code identified by either process to the POS terminal 10. This allows the scanner 20 to quickly identify the product code using the second identification process if the first identification process takes time. Conversely, if the second identification process takes time to identify the product code, the scanner 20 can quickly identify the product code using the first identification process.

[0095] As described above, the scanner 20 of the embodiment includes an acquisition means 2001 for acquiring an image of a product, a first identification means 2002 for identifying the product based on the product barcode included in the image acquired by the acquisition means 2001, a second identification means 2003 for identifying the product based on the external features of the product included in the image acquired by the acquisition means 2001, and an output means 2004 for outputting a product code that identifies the product identified by the first identification means 2002 or the second identification means 2003.

[0096] This allows the scanner 20 to identify products included in the captured image based on their barcodes or external characteristics. As a result, the time it takes for an operator to read product codes can be reduced. Therefore, the scanner 20 can improve the operator's ability to identify products.

[0097] In addition, in the scanner 20 of the embodiment, if the product identification by the first identification means 2002 is performed more than a predetermined time after the product identification by the second identification means 2003, the output means 2004 outputs a product code that identifies the product identified by the first identification means 2002.

[0098] As a result, if the product code has been identified by the first identification means 2002, which has higher accuracy, before a predetermined time has elapsed since the product was identified by the second identification means 2003, the scanner 20 can output the product code identified by the first identification means 2002.

[0099] Furthermore, in the scanner 20 of the embodiment, if the product identification by the first identification means 2002 is performed after a predetermined time has elapsed since the product identification by the second identification means 2003, the output means 2004 outputs a product code that identifies the product identified by the second identification means 2003.

[0100] As a result, if the product code has not been identified by the first identification unit 2002 before a predetermined time has elapsed since the product was identified by the second identification unit 2003, the scanner 20 outputs the product code identified by the second identification unit 2003, thereby enabling the product code to be output early. As a result, the time required for the operator to read the product code can be shortened. Therefore, the scanner 20 can improve the operability of the operator for identifying the product while ensuring reading accuracy.

[0101] Furthermore, the POS terminal 10 in the self-service POS system 1 of the embodiment includes an output means (notification means) 1004 that notifies the notification unit that product registration by the registration means 1002 has been completed.

[0102] This allows the operator to recognize the completion of product registration even if the product barcode is not held up to the reading window 230. Therefore, the self-service POS system 1 can improve the operator's operability.

[0103] In the above embodiment, the control programs executed by the POS terminal 10 and the scanner 20 may be provided by being recorded on a computer-readable recording medium such as a CD-ROM. Also, the control programs executed by the POS terminal 10 and the scanner 20 in the above embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network, or may be provided via a network such as the Internet.

[0104] Although embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0105] 1. Self-service POS system (product information registration system) 10 POS terminal (registration device) 20 Scanner (information processing device) 1001 Input means 1002 Registration Method 1004 Output means (notification means) 2001 Acquisition method 2002 First identification means 2003 Second identification means 2004 Output means [Prior art documents] [Patent documents]

[0106] [Patent Document 1] Japanese Patent Application Publication No. 2019-21168

Claims

1. An acquisition means for acquiring a captured image of a product; a first identification means for identifying a product based on a code symbol attached to the product included in the captured image acquired by the acquisition means; a second identification means for identifying a product based on an appearance feature of the product included in the captured image acquired by the acquisition means; an output means for outputting commodity identification information for identifying the commodity identified by the first identification means or the second identification means; Equipped with The output means outputs product identification information that identifies the product identified by the first identification means if the product identification by the first identification means is performed before a predetermined time has elapsed since the product identification by the second identification means, and outputs product identification information that identifies the product identified by the second identification means if the product identification by the first identification means is performed after a predetermined time has elapsed since the product identification by the second identification means.

2. A product information registration system including an information processing device that identifies a product from a captured image of the product, and a registration device that registers information on the product identified by the information processing device, The information processing device includes: An acquisition means for acquiring a captured image of a product; a first identification means for identifying a product based on a code symbol attached to the product included in the captured image acquired by the acquisition means; a second identification means for identifying a product based on an appearance feature of the product included in the captured image acquired by the acquisition means; an output means for outputting to the registration device commodity identification information that identifies the commodity identified by the first identification means or the second identification means; The registration device an input means for inputting the product identification information output by the output means; a registration means for registering information on a product identified by the product identification information input to the input means; Equipped with The output means outputs product identification information that identifies the product identified by the first identification means if the product identification by the first identification means is performed before a predetermined time has elapsed since the product identification by the second identification means, and outputs product identification information that identifies the product identified by the second identification means if the product identification by the first identification means is performed after a predetermined time has elapsed since the product identification by the second identification means.

3. 3. The product information registration system according to claim 2, further comprising a notification unit that notifies the notification unit that registration of product information by said registration unit has been completed.

Images