Image processing device, image processing method, and program

Abstract

The present invention provides an image processing device, an image processing method, and a program that can smoothly process discounts on products even when product registration processing for the products is performed using two-dimensional codes. [Solution] An image processing device according to an embodiment includes an acquisition means, a decoding means, a first detection means, and an output means. The acquisition means acquires a captured image of a product. The decoding means detects a two-dimensional code from the captured image and decodes the two-dimensional code to acquire information contained in the two-dimensional code. If the acquired information includes a product code that can identify the product, the first detection means detects a discount sticker attached to the product eligible for discount from the captured image. If a discount sticker is detected, the output means outputs the product code and discount information corresponding to the discount sticker.

Description

[Technical Field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] Conventionally, when a store such as a shopping center, mass retailer, or department store reduces (or discounts) the price of a product, it affixes a discount sticker or discount label (hereinafter collectively referred to as a "discount sticker") to the product to indicate that the product is a discounted product.

[0003] In addition, in such stores, a discount sticker indicating that the product is a discounted product (or a flag sticker indicating that a discount sticker is attached) is attached near a one-dimensional code such as a barcode that holds a product code that can identify the product. This allows a product registration device such as a POS (Point of Sales) terminal to recognize that the product is a discounted product if the discount sticker is visible in an image captured from the one-dimensional code to read product information.

[0004] Incidentally, in recent years, two-dimensional codes, which can store more information than one-dimensional codes, have become increasingly popular. As a result, it has become common to write additional product information (such as the calorie content of food, expiration date, production date, and information about the producer) into two-dimensional codes. It is also expected that in the future, there will be an increasing number of situations in which product codes will be written into two-dimensional codes and then product registration processing will be performed by reading the two-dimensional codes.

[0005] However, the conventional technology for obtaining discount information from discount stickers and discount labels described above targets one-dimensional codes, so it may not be possible to obtain discount information in a format where a product code is integrated into a two-dimensional code. If discount information cannot be obtained, users will have to visually check the discount stickers and discount labels and manually enter the discount amount, etc., which may cause delays in the product registration process. Summary of the Invention [Problem to be solved by the invention]

[0006] The problem that the present invention aims to solve is to provide an image processing device, an image processing method, and a program that can smoothly process discounts on products even when product registration processing for the products is performed using two-dimensional codes. [Means for solving the problem]

[0007] An image processing device according to an embodiment includes an acquisition means, a decoding means, a first detection means, and an output means. The acquisition means acquires a captured image of a product. The decoding means detects a two-dimensional code from the captured image and decodes the two-dimensional code to acquire information stored in the two-dimensional code. If the acquired information includes a product code that can identify the product, the first detection means detects a discount sticker attached to the product eligible for discount from the captured image. If a discount sticker is detected, the output means outputs the product code and discount information corresponding to the discount sticker. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a perspective view schematically illustrating an example of the configuration of a checkout lane system equipped with a scanner according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of the scanner according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of the relationship between a commodity and an imaging area of ​​a camera according to the embodiment. [Figure 4] FIG. 4 is a flowchart showing an example of the overall process executed by the scanner according to the embodiment. [Figure 5] FIG. 5 is a flowchart showing an example of a discount sticker or flag sticker detection process executed by the scanner according to the embodiment. [Figure 6]FIG. 6 is a flowchart showing an example of a discount sticker detection process executed by the scanner according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] In the following, an example will be described in which the image processing device according to this embodiment is applied to a scanner that reads product codes and the like in a store such as a supermarket.

[0010] Fig. 1 is a perspective view showing an example of the configuration of a checkout lane system equipped with a scanner 2 according to an embodiment. As shown in Fig. 1, the checkout lane system 4 includes a checkout stand 1 for placing a shopping cart containing merchandise, a scanner 2 erected in the approximate center of the checkout stand 1, and a POS terminal 3 connected to the scanner 2 via a transmission line (not shown) so as to be able to communicate with each other.

[0011] The POS terminal 3 is used to register the sale of products purchased by customers. As shown in Figure 1, the POS terminal 3 is equipped with a keyboard 31, a display 32 for the operator, a display 33 for the customer, a printer 34 for printing receipts, etc., and a drawer 35 for storing cash, etc. The keyboard 31 is equipped with a closing key and other keys required for settling the price of products. The POS terminal 3 has the same configuration and functions as the POS terminals typically used in this type of checkout lane system.

[0012] The scanner 2 is a device for reading a two-dimensional code attached to a product and outputting the product information contained in the two-dimensional code to the POS terminal 3. As shown in FIG. 1, the scanner 2 mainly includes a reading window 21, a keyboard 22, a customer display 23, a store clerk display 24, a speaker 25, and an LED 26.

[0013] The keyboard 22 accepts input from various keys when registering a product that cannot be registered using a two-dimensional code. The customer display 23 displays the name and price of the registered product to the shopper or store clerk. The store clerk display 24 displays the name and price of the registered product, as well as other error messages, to the operating store clerk.

[0014] The scanner 2 has a built-in camera 20 (see FIG. 2) inside, which is provided with a reading window 21. The camera 20 may be, for example, an imaging device using a CCD (Charge Coupled Device), or may be an imaging device using other imaging elements such as a CMOS (Complementary Metal Oxide Semiconductor). The camera 20 captures an image of a commodity held over an imaging area facing the reading window 21.

[0015] 2 is a block diagram showing the configuration of the scanner 2. The scanner 2 mainly comprises a CPU 50, a ROM 42, a RAM 43, a communication I / F 44, an output port 45, a keyboard controller 46, display controllers 47 and 48, a camera controller 49, and a memory 27, which are connected by bus lines 41 such as an address bus and a data bus.

[0016] The CPU 50 functions as a control unit that controls the overall operation of the scanner 2. The ROM 42 stores the program according to this embodiment and other programs that control the operation of the CPU 50. The RAM 43 functions as a work area when the CPU 50 loads the various programs stored in the ROM 42. The RAM 43 also stores various data such as image data captured by the camera 20. The functions of each unit (image capture unit 51 to information output unit 57) included in the CPU 50 will be described later.

[0017] The communication I / F 44 controls data communication with the POS terminal 3 (see FIG. 1) connected via a bus. The output port 45 outputs drive signals to the speaker 25 and LED 26. The keyboard controller 46 takes in key signals from the keyboard 22. The display controller 47 controls data display on the customer display 23. The display controller 48 controls data display on the clerk display 24. The camera controller 49 controls the imaging operation of the camera 20.

[0018] The camera 20 captures an image within an imaging area 70 (for example, imaging areas 70a and 70b shown in FIG. 3).

[0019] The memory 27 is a non-volatile memory and stores an identification pattern storage folder 27a. The identification pattern storage folder 27a stores information about the characteristics of flag stickers F and discount stickers L (described later), identification patterns for pattern identification, information for character recognition, and the like.

[0020] Next, the discount sticker L that is affixed to a product to sell the product at a discount and the flag sticker F that is affixed near the two-dimensional code to prevent the discount sticker L from being overlooked will be explained using Fig. 3. Note that existing technology can be used for a preferred embodiment of the flag sticker F and a method for detecting the flag sticker F, so detailed explanations will be omitted here.

[0021] 3 is a diagram showing an example of the relationship between a product 60 and imaging areas 70 (70a, 70b) of the camera 20. The areas surrounded by two-dot chain lines in the figure are imaging areas 70a, 70b, which are areas that the camera 20 can capture in one frame.

[0022] 3 has a discount sticker L attached in addition to a product label 61. The product label 61 displays the product name, product price, calorie content per package, processing date, expiration date, price per 100 grams, content volume, storage method, product number, and a two-dimensional code 62.

[0023] The two-dimensional code 62 incorporates information indicating the product code, product name, product price, calorie content per package, processing date, expiration date, price per 100 grams, content volume, storage method, product number, etc., which are used to register and process sales data of the product 60 on the POS terminal 3. The discount sticker L displays letters and symbols indicating the discount amount and discount rate for the product 60.

[0024] Furthermore, a flag sticker F (sometimes called a trigger label) indicating that a discount sticker L is attached to the product 60 is attached near the two-dimensional code 62. When the scanner 2 detects this flag sticker F, it recognizes that a discount sticker L is attached to the product 60 and allows the operator to capture an image of the discount sticker L.

[0025] That is, as shown in FIG. 3, when the two-dimensional code 62 and the discount label L are attached separately to the product 60, the two-dimensional code 62 and the discount label L are not imaged by the same imaging area 70.

[0026] However, when the scanner 2 detects the flag sticker F, it notifies the operator to hold the discount sticker L over the reading window 21. Therefore, the operator can change the position of the product 60 held over the reading window 21 in accordance with the notification, thereby capturing images of the product 60 multiple times using multiple frames of the imaging area 70a including the two-dimensional code 62 and the imaging area 70b including the discount sticker L, and reading the discount sticker L.

[0027] By doing so, even if the discount label L is affixed away from the two-dimensional code 62 and it is not possible to capture an image of both the two-dimensional code 62 and the discount label L in one shot, it is possible to prevent the discount label L from being overlooked even when the product 60 is a discounted product. In other words, the scanner 2 according to this embodiment can prevent sales of the product 60 from being registered without a discount process being performed.

[0028] Next, we will explain the functional configuration of the scanner 2, which is realized by the execution of a program by the CPU 50. By operating in accordance with the program stored in the ROM 42 expanded in the RAM 43, the CPU 50 functions as an image capture unit 51, a two-dimensional code detection unit 52, an information determination unit 53, a flag sticker detection unit 54, a discount sticker detection unit 55, an audio output unit 56, and an information output unit 57, as shown in FIG.

[0029] The image capturing unit 51 outputs an imaging-on signal to the camera controller 49 to cause the camera 20 to start imaging. The image capturing unit 51 also captures one frame of image captured by the camera 20 (for example, the image in the imaging area 70a or the image in the imaging area 70b shown in FIG. 3 ) and stores it in the image work area of ​​the RAM 43.

[0030] The two-dimensional code detection unit 52 detects a two-dimensional code from the image stored in the image work area of ​​the RAM 43 by the image capture unit 51. The two-dimensional code detection unit 52 is an example of a first detection means. Specifically, the two-dimensional code detection unit 52 detects a two-dimensional code using a pattern matching technique, or detects a two-dimensional code from a predetermined finder pattern.

[0031] When the two-dimensional code detection unit 52 detects a two-dimensional code, the information determination unit 53 determines whether or not a product code is included in the information recorded in the two-dimensional code.

[0032] For example, the information determination unit 53 reads information recorded in a two-dimensional code detected according to a predetermined decoding method. Therefore, the information determination unit 53 is an example of a decoding means. The information determination unit 53 also determines whether the read information includes a product code. If the information determination unit 53 determines that the read information includes a product code, the information determination unit 53 temporarily stores the product code in the memory 27.

[0033] Also, for example, the information determination unit 53 performs processing to start and end a reading omission prevention timer.

[0034] Here, the missed reading prevention timer is a timer for preventing missed reading of the flag sticker F. In this embodiment, the information determination unit 53 starts the missed reading prevention timer when it determines that the information recorded in the two-dimensional code 62 includes a product code, and ends the missed reading prevention timer after a predetermined time has elapsed. The predetermined time in this case is an example of a first predetermined time.

[0035] From the start to the end of the missed reading prevention timer, the image capture unit 51 repeatedly captures one frame of image captured by the camera 20 and stores it in the image work area of ​​the RAM 43.

[0036] When the information determination unit 53 determines that a product code is included in the information recorded in the two-dimensional code, the flag sticker detection unit 54 detects the image of the flag sticker F from the image stored in the image work area of ​​the RAM 43 by the image capture unit 51.

[0037] For example, the flag sticker detection unit 54 performs pattern recognition to detect an image of a flag sticker F. The details of the detection method are not particularly limited, and existing technology can be used. Furthermore, if the flag sticker detection unit 54 detects an image of a flag sticker F, it determines that a discount sticker L is attached to the product 60.

[0038] The discount label detection unit 55 detects the image of the discount label L from the image stored in the image work area of ​​the RAM 43 by the image capture unit 51 .

[0039] Specifically, the discount label detection unit 55 detects the image area of ​​the discount label L using information indicating the graphical features of the discount label L, such as the border and shape, which is pre-set in the identification pattern storage folder 27a.

[0040] Also, when an image of a discount sticker L is detected, the discount sticker detection unit 55 determines whether the distance between the two-dimensional code and the discount sticker L is less than a predetermined threshold value based on the image stored in the image work area of ​​RAM 43 by the image acquisition unit 51.

[0041] For example, if the distance between the two-dimensional code 62 and the discount label L is large, there is a possibility that the image of the discount label L attached to another product has been captured. Therefore, in this embodiment, if the distance between the two-dimensional code and the discount label L is less than a predetermined threshold, the discount information indicated on the discount label L is read from the image of the detected discount label L.

[0042] This makes it possible to prevent the discount sticker detection unit 55 from carrying out a discount process in accordance with information indicated on a discount sticker L attached to another product.

[0043] If the distance between the two-dimensional code and the discount sticker L is less than a predetermined threshold, the discount sticker detection unit 55 performs character recognition processing such as OCR (Optical Character Reader) or pattern recognition processing on the image area of ​​the detected discount sticker L.

[0044] By performing the above processing, the discount sticker detection unit 55 reads discount information such as the discount amount and discount rate indicated on the discount sticker L. In addition, the discount sticker detection unit 55 sends the read discount information to the information output unit 57.

[0045] The audio output unit 56 notifies the operator by audio.

[0046] For example, when the flag sticker detection unit 54 determines that a discount sticker L is attached to the product 60, the voice output unit 56 notifies the operator by voice output that the discount sticker L is attached to the product 60, and instructs the operator to hold the discount sticker L over the reading window 21 or to read the discount sticker L.

[0047] This allows the operator to recognize that the discount sticker L is attached to the product 60. In addition, since the operator is likely to hold the discount sticker L over the reading window 21 in response to the notification, it is more likely that the discount sticker L can be imaged in a state in which discount information such as the discount amount and discount rate can be read.

[0048] The notification method is not particularly limited, and the scanner 2 may notify the user by displaying the notification on the store clerk display 24.

[0049] Also, for example, if the discount sticker detection unit 55 fails to detect a discount sticker even though the flag sticker F is detected, the voice output unit 56 will notify the operator by voice output that the discount sticker could not be detected.

[0050] Specifically, if the discount sticker detection unit 55 is unable to detect a discount sticker when the shading wait timer described below expires, the voice output unit 56 will notify the operator by voice output that a discount sticker was not detected.

[0051] Here, the holding wait timer is a timer for ensuring time for the operator to hold the discount sticker L over the reading window 21. In this embodiment, the audio output unit 56 starts the holding wait timer when an announcement is made to hold the discount sticker L over the reading window 21, and ends the holding wait timer after a predetermined time has elapsed. The predetermined time in this case is an example of the second predetermined time.

[0052] If the discount sticker L cannot be detected even after the holding timer has finished, it is highly likely that the discount information such as the discount amount and discount rate cannot be read because the discount sticker L is peeling off or the characters printed on the discount sticker L are difficult to read. In such a case, if the camera 20 is to repeatedly capture an image until the discount sticker L is detected, the process may loop and not proceed further.

[0053] In this embodiment, as described above, if the discount sticker L cannot be detected even after the holding timer has finished, the voice output unit 56 notifies the operator that the discount sticker L cannot be detected. This allows the operator to recognize that there is a possibility that the discount sticker L cannot be detected for some reason.

[0054] The information output unit 57 outputs the product code temporarily stored in the memory 27 by the information determination unit 53 to the POS terminal 3 via the communication I / F 44. Furthermore, when discount information is sent from the discount sticker detection unit 55, the information output unit 57 outputs the discount information together with the product code to the POS terminal 3.

[0055] The POS terminal 3 receives the product code output by the information output unit 57 of the scanner 2 and uses the received product code to register the sale of the product 60. Furthermore, when the POS terminal 3 receives discount information together with the product code, it discounts the product 60 according to the discount information and registers the sale of the product 60.

[0056] Next, the procedure of the information reading process executed by the scanner 2 will be described with reference to Figures 4 to 6. Figure 4 is a flowchart showing the procedure of the information reading process executed by the scanner 2.

[0057] When receiving an instruction to start scanning from the POS terminal 3, the image capturing unit 51 of the scanner 2 outputs an imaging-on signal to the camera controller 49, and starts imaging by the camera 20 (step S101).

[0058] Next, the image capturing unit 51 starts capturing the image captured by the camera 20 (step S102). Then, the two-dimensional code detection unit 52 starts a process of detecting the image of the two-dimensional code 62 from the captured image (step S103).

[0059] Next, the two-dimensional code detection unit 52 determines whether an image of the two-dimensional code 62 has been detected in the captured image (step S104). If an image of the two-dimensional code 62 has not been detected (step S104: No), the process returns to step S102 and the two-dimensional code detection process continues. That is, the image capture unit 51 continues capturing images using the camera 20, and the two-dimensional code detection unit 52 performs the two-dimensional code detection process on the newly captured frame image.

[0060] On the other hand, if the image of the two-dimensional code 62 is detected (step S104: Yes), the information determination unit 53 reads the information recorded in the two-dimensional code from the image of the detected two-dimensional code 62. Then, the information determination unit 53 determines whether the read information includes a product code (step S105).

[0061] If a product code is not included (step S105: No), the process returns to step S102, as in the case where an image of the two-dimensional code 62 is not detected in step S104 (step S104: No). On the other hand, if a product code is included (step S105: Yes), the information determination unit 53 temporarily stores the product code in the memory 27 and proceeds to the process of detecting a discount sticker L or a flag sticker F (A).

[0062] FIG. 5 is a flowchart showing an example of a process for detecting a discount sticker L or a flag sticker F.

[0063] 4 (Step S105: Yes), the information determination unit 53 starts a timer to prevent missing information (Step S1051). Next, the discount sticker detection unit 55 determines whether a discount sticker L has been detected (Step S1052).

[0064] If the discount label L is detected (step S1052: Yes), the discount label detection unit 55 determines whether the distance between the two-dimensional code 62 and the discount label L is less than a predetermined threshold (step S1054). If the distance is less than the threshold (step S1054: Yes), the process proceeds to step S106 in Fig. 4. On the other hand, if the distance exceeds the threshold (step S1054: No), the process proceeds to step S1056, which will be described later.

[0065] If the discount sticker L is not detected in step S1052 (step S1052: No), the flag sticker detection unit 54 determines whether the flag sticker F is detected (step S1053). If the flag sticker F is not detected (step S1053: No), the process proceeds to step S1056, which will be described later.

[0066] On the other hand, if the flag sticker F is detected (step S1053: Yes), the flag sticker detection unit 54 determines whether the distance between the two-dimensional code 62 and the flag sticker F is less than a predetermined threshold value (step S1055).

[0067] Here, the flag sticker F is affixed to a location closer to the two-dimensional code 62 than the discount sticker L. For this reason, the threshold value of the distance between the two-dimensional code 62 and the flag sticker F is set to a value smaller than the threshold value of the distance between the two-dimensional code 62 and the discount sticker L.

[0068] If the distance is less than the threshold (step S1055: Yes), the process proceeds to step S106 in Fig. 4. On the other hand, if the distance exceeds the threshold (step S1055: No), the image capture unit 51 determines whether the omission timer has expired (step S1056).

[0069] If the omission timer has not expired (step S1056: No), the image capture unit 51 captures a new frame image (step S1057) and returns to the process of step S1052. On the other hand, if the omission timer has expired (step S1056: Yes), the process proceeds to the process of step S106 in FIG.

[0070] The description will continue by returning to Fig. 4. After step S1054: Yes or step S1055: Yes in Fig. 5, the discount sticker detection unit 55 determines whether the discount sticker L is detected (step S106).

[0071] If the discount label L is detected (step S106: Yes), the discount label detection unit 55 reads discount information from the discount label L (step S110). Next, the information output unit 57 outputs the product code temporarily stored in the memory 27 in step S105 and the discount information read in step S110 to the POS terminal 3 (step S111).

[0072] Next, the image capturing unit 51 determines whether the sales registration process has ended and an instruction to end the two-dimensional code reading process has been issued from the POS terminal 3 (step S114). If an instruction to end the two-dimensional code reading process has not been issued (step S114: No), the process returns to step S102.

[0073] If an instruction to end the two-dimensional code reading process is given (step S114: Yes), the image capturing unit 51 outputs an imaging-off signal to the camera controller 49 (step S115), and ends this process.

[0074] On the other hand, if the discount sticker L is not detected in step S106 (step S106: No), the flag sticker detection unit 54 determines whether the flag sticker F is detected (step S107).

[0075] If the flag sticker F is not detected (step S107: No), the information output unit 57 outputs the product code temporarily stored in the memory 27 in step S105 to the POS terminal 3 (step S112), and proceeds to the processing of step S114 described above.

[0076] On the other hand, if the flag sticker F is detected (step S107: Yes), the voice output unit 56 notifies the operator to hold the discount sticker L over the reading window 21 (step S108), and proceeds to the detection process of the discount sticker L (B).

[0077] FIG. 6 is a flowchart showing an example of a process for detecting a discount label L.

[0078] 4, the audio output unit 56 starts the holding timer (step S1081). Next, the discount sticker detection unit 55 determines whether the discount sticker L has been detected (step S1082). If the discount sticker L has not been detected (step S1082: No), the image capture unit 51 determines whether the holding timer has finished (step S1084).

[0079] If the holding-over waiting timer has not expired (step S1084: No), the image capturing unit 51 captures a new frame image (step S1085) and returns to the process of step S1082. On the other hand, if the holding-over waiting timer has expired, the process proceeds to step S109 in FIG.

[0080] On the other hand, if the discount label L is detected (step S1082: Yes), the discount label detection unit 55 determines whether the distance between the two-dimensional code 62 and the discount label L is less than a predetermined threshold (step S1083). If the distance is less than the threshold (step S1083: Yes), the process proceeds to step S109 in Fig. 4. On the other hand, if the distance exceeds the threshold (step S1083: No), the process proceeds to the above-mentioned step S1084.

[0081] Returning to Fig. 4, the explanation will be continued. After step S1083: Yes or S1084: Yes in Fig. 6, the discount sticker detection unit 55 determines whether the discount sticker L is detected (step S109). If the discount sticker L is detected (step S109: Yes), the process proceeds to the above-mentioned step S110.

[0082] On the other hand, if the discount sticker L is not detected (step S109: No), the voice output unit 56 notifies the operator that the discount sticker L was not found (step S113), and proceeds to the processing of the above-mentioned step S114.

[0083] As described above, the scanner 2 of this embodiment acquires an image of a product, detects a two-dimensional code from the image, and decodes the two-dimensional code to acquire the information stored in the two-dimensional code.If the acquired information includes a product code, it detects a discount sticker attached to a product eligible for a discount from the image, and if a discount sticker is detected, it outputs the product code and discount information corresponding to the discount sticker.

[0084] With the recent widespread use of two-dimensional codes, it is expected that stores will sell a mixture of products with two-dimensional codes that do not include a product code and products with two-dimensional codes that include a product code. In such cases, it is impossible to obtain information indicating the product price from products with two-dimensional codes that do not include a product code. Therefore, even if a process for detecting discount labels L is performed on products with two-dimensional codes that do not include a product code, it is likely to be a futile process. Repeated such futile processes may hinder smooth product registration. The scanner 2 according to this embodiment performs discount processing only when the information recorded in the two-dimensional code includes a product code. Therefore, the potentially futile process described above is not executed. In other words, the scanner 2 according to this embodiment enables smooth product registration processing, including discount processing, even when a product code is written in the two-dimensional code.

[0085] The above-described embodiment can be modified as needed by partially changing the configuration or function of each device in the checkout lane system 4. Therefore, the following describes modifications of the above-described embodiment as other embodiments. The following mainly describes differences from the above-described embodiment, and a detailed description of commonalities with the content already described will be omitted. The modifications described below may be implemented individually or in appropriate combination.

[0086] (Variation 1) In the above embodiment, only the discount sticker L has discount information. In this modified example, a case will be described in which the two-dimensional code 62 also has discount information.

[0087] In this modification, the two-dimensional code 62 affixed to the discounted product 60 contains discount information. When the information determination unit 53 determines that the information recorded in the two-dimensional code 62 contains a product code, it determines whether the read information contains discount information. When the read information contains discount information, the information determination unit 53 temporarily stores the discount information in the memory 27.

[0088] After reading the discount information from the discount label L, the discount label detection unit 55 sends the discount information to the information determination unit 53. The information determination unit 53 compares the discount information temporarily stored in the memory 27 with the discount information read from the discount label L.

[0089] When the discount information in memory 27 matches the discount information on discount label L, information determination unit 53 sends the discount information to information output unit 57. In other words, when the discount information in memory 27 does not match the discount information on discount label L or when only one of the discount information in memory 27 and the discount information on discount label L exists, information output unit 57 restricts the output of the discount information.

[0090] According to this modified example, for example, if a discount sticker L different from the one that should have been attached is attached to a product 60, it is possible to prevent an incorrect discount process from being carried out.

[0091] (Variation 2) In the above embodiment, a form in which a flag sticker F is affixed to the product 60 has been described. In this modified example, a form in which the information recorded in the two-dimensional code 62 includes information indicating that a discount sticker L is affixed will be described.

[0092] In this modification, the two-dimensional code 62 affixed to the discounted product 60 contains information indicating that a discount sticker L is affixed. When the information determination unit 53 determines that the information recorded in the two-dimensional code 62 contains a product code, it determines whether the read information contains information indicating that a discount sticker L is affixed.

[0093] In this modified example, if the information read by the information determination unit 53 is determined to include information indicating that a discount sticker L is attached, the scanner 2 performs processing similar to that performed when a flag sticker F is detected in the above-mentioned embodiment.

[0094] According to this modification, the scanner 2 can recognize that a discount sticker L is attached to the product 60 without attaching a flag sticker F to the product 60.

[0095] Furthermore, the program executed by the scanner 2 of this embodiment is provided by being pre-installed in a ROM or the like. The program executed by the scanner 2 of this embodiment may also be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

[0096] Furthermore, the program executed by the scanner 2 of this embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the program executed by the scanner 2 of this embodiment may be provided or distributed via a network such as the Internet.

[0097] The program executed by the scanner 2 of this embodiment is modularly structured to include the above-mentioned units (image capture unit 51, two-dimensional code detection unit 52, information judgment unit 53, flag sticker detection unit 54, discount sticker detection unit 55, audio output unit 56, and information output unit 57), and in actual hardware, the CPU (processor) reads and executes the program from the ROM, loading the above-mentioned units onto the main memory, and the image capture unit 51, two-dimensional code detection unit 52, information judgment unit 53, flag sticker detection unit 54, discount sticker detection unit 55, audio output unit 56, and information output unit 57 are generated on the main memory.

[0098] In addition, some of the functions of the above-mentioned parts of the scanner 2 (for example, functions such as the 2D code detection part 52, the information determination part 53, the flag sticker detection part 54, and the discount sticker detection part 55) may be provided in the POS terminal 3.

[0099] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0100] 2. Scanner 3. POS terminals 4 Checkout Lane System 51 Image capture unit 52 2D code detector 53 Information Judgment Department 54 Flag seal detector 55 Discount sticker detector 56 Audio output section 57 Information output section 60 items 61 Product Label 62 2D Code 70, 70a, 70b Imaging area F Flag Sticker L Discount Sticker [Prior art documents] [Patent documents]

[0101] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-178369

Claims

1. An acquisition means for acquiring a captured image of a product; a decoding means for detecting a two-dimensional code from the captured image and decoding the two-dimensional code to obtain information stored in the two-dimensional code; a first detection means for detecting a discount sticker attached to a discounted product from the captured image when the acquired information includes a product code that can identify the product; an output means for outputting the product code and discount information corresponding to the discount label when the discount label is detected; An image processing device comprising:

2. and a second detection means for detecting, when the acquired information includes the product code, a flag sticker indicating that the discount sticker is affixed to the product from the captured image; When the flag sticker is detected, the output means notifies the user that the discount sticker is attached to the product. The image processing device according to claim 1 .

3. When the flag sticker is detected, the output means issues a notification to prompt the customer to hold the discount sticker over an imaging unit that images the product. The image processing device according to claim 2 .

4. If the acquired information includes a product code, the first detection means repeats the process of detecting the discount label until a first predetermined time has elapsed or the discount label is detected; the second detection means repeats the process of detecting the flag sticker until the first predetermined time has elapsed or the discount sticker or the flag sticker is detected; When the flag sticker is detected, the first detection means repeats the process of detecting the discount sticker until a second predetermined time has elapsed. The image processing device according to claim 2 .

5. When the flag sticker is detected and the discount sticker is not detected even after the second predetermined time has elapsed, the output means notifies the user that the discount sticker has not been detected. The image processing device according to claim 4 .

6. An image processing method by an image processing device, Acquire a captured image of the product, detecting a two-dimensional code from the captured image and decoding the two-dimensional code to obtain information stored in the two-dimensional code; If the acquired information includes a product code that can identify the product, a discount sticker attached to the product that is eligible for discount is detected from the captured image; When the discount sticker is detected, the product code and discount information corresponding to the discount sticker are output. Image processing methods.

7. The computer of the image processing device, An acquisition means for acquiring a captured image of a product; a decoding means for detecting a two-dimensional code from the captured image and decoding the two-dimensional code to obtain information stored in the two-dimensional code; a first detection means for detecting a discount sticker attached to a discounted product from the captured image when the acquired information includes a product code that can identify the product; an output means for outputting the product code and discount information corresponding to the discount label when the discount label is detected; A program that functions as a

Images