Inspection system, inspection method, and program

Abstract

To allow for reading a barcode attached to each of multiple articles and inspecting the articles more accurately.SOLUTION: An inspection system 1 is provided, comprising an inspection camera 10 configured to identify multiple barcodes in a captured image, and a management server 100 configured to output a result of cross-check performed by using an ID corresponding to a barcode attached to a product identified by the inspection camera 10 and an ID corresponding to a barcode on a list of products to determine whether the product with the barcode is included in the list or not.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a technique for inspecting items such as merchandise. [Background technology]

[0002] BACKGROUND ART Conventionally, devices have been disclosed that read and recognize barcodes attached to a plurality of items such as merchandise (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 11-306278 Summary of the Invention [Problem to be solved by the invention]

[0004] In shipping operations, etc., when workers inspect whether all the items are present based on the multiple barcodes read by the conventional device while looking at a list of items, the workers may misread the information on the list or the barcodes recognized by the device (e.g., product names).In addition, the workers may mix up and use the wrong list for the inspection.

[0005] An object of the present invention is to read barcodes attached to a plurality of items and inspect them with higher accuracy. [Means for solving the problem]

[0006] In order to solve the above problem, a first aspect of the present invention is a method for identifying a plurality of two-dimensional codes from an image captured by the imaging means, and a method for identifying the two-dimensional codes based on information associated with the two-dimensional codes attached to the items identified by the identification means and information associated with the two-dimensional codes attached to a list of the items identified by the identification means. Ex-girlfrienda checking means for outputting a checking result as to whether or not the item to which the code is attached is included in the list; The collation means performs collation based on the two-dimensional code attached to the item identified by the identification means and the two-dimensional code attached to the list from the same image captured by the imaging means. It is an inspection system that

[0008] The present invention 2 In this aspect, the list includes a description of the item, and the collating means collates the second dimensional code based on information associated with the two-dimensional code attached to the item identified by the identifying means, information associated with the two-dimensional code attached to the description identified by the identifying means, and information associated with the two-dimensional code attached to the list of the item identified by the identifying means. Ex-girlfriend It is preferable to output a collation result indicating whether the article and the instruction manual to which the code is attached are included in the list.

[0009] In order to solve the above problems, the present invention 3 The aspect is an inspection method by an inspection system having an identification means and a collating means, and includes an identification step in which the identification means identifies a plurality of two-dimensional codes from within an image captured by an imaging means, and a collating step in which the collating means collates the two-dimensional codes based on information associated with the two-dimensional codes attached to the items identified by the identification means and information associated with the two-dimensional codes attached to a list of items identified by the identification means. Ex-girlfriend a comparison step of outputting a comparison result indicating whether the item to which the code is attached is included in the list; The collation means performs collation based on the two-dimensional code attached to the item identified by the identification means and the two-dimensional code attached to the list from the same image captured by the imaging means. This is an inspection method.

[0010] In order to solve the above problems, the present invention 4 The aspect of the present invention includes a step of identifying a plurality of two-dimensional codes from an image captured by an imaging means by an identifying means, and a step of verifying the two-dimensional codes based on information associated with the two-dimensional codes attached to the items identified by the identifying means and information associated with the two-dimensional codes attached to a list of items identified by the identifying means. Ex-girlfriend a comparison step of outputting a comparison result indicating whether the item to which the code is attached is included in the list; Realize Let's go The collating means is a computer that performs collating based on the two-dimensional code attached to the item identified by the identifying means and the two-dimensional code attached to the list from the same image captured by the imaging means. It is a program. [Effects of the Invention]

[0011] The first and second aspects of the present invention 3 , 4 According to this aspect, the inspection system can automatically read and compare information on the list of items without requiring a worker to visually check it, thereby enabling inspection of multiple items with higher accuracy. Furthermore, according to the first, third, and fourth aspects of the present invention, the inspection system can simultaneously identify the two-dimensional code attached to the item and the two-dimensional code attached to the list from the same image captured by the imaging means, thereby reducing the risk of imaging errors that occur when the item and the list are captured separately by the imaging means, thereby enabling the inspection system to perform inspection with higher accuracy.

[0013] The above-mentioned invention 2 According to this aspect, the inspection system can inspect the presence or absence of an item's instruction manual with higher accuracy. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an inspection system. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of an inspection camera. [Figure 3] FIG. 3 is a block diagram illustrating an example of the configuration of the management server. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of a database stored in the storage unit. [Figure 5] FIG. 5 is a diagram illustrating an example of the product information database. [Figure 6] FIG. 6 is a diagram showing an example of the product manual information database. [Figure 7] FIG. 7 is a diagram illustrating an example of the product list information database. [Figure 8] FIG. 8 is a diagram showing an example of the shipping destination information database. [Figure 9] FIG. 9 is a diagram showing an example of the waybill information database. [Figure 10] FIG. 10 is a diagram showing an example of the shipping list information database. [Figure 11] FIG. 11 is a flowchart showing an example of the inspection process of the processing section. [Figure 12] FIG. 12 is a front view showing an example of the arrangement of the inspection cameras and the dedicated camera terminals. [Figure 13] FIG. 13 is a side view showing an example of the arrangement of the inspection cameras and the dedicated camera terminals. [Figure 14] FIG. 14 is a plan view showing an example of the state of the inspection target before inspection. [Figure 15] FIG. 15 is a plan view showing an example of the state of the inspection target during inspection. DETAILED DESCRIPTION OF THE INVENTION

[0015] An embodiment of the present invention will be described with reference to the drawings. In this embodiment, a food delivery system is taken as an example.

[0016] (composition) FIG. 1 is a block diagram showing an example of the configuration of an inspection system 1. As shown in FIG.

[0017] 1, the inspection system 1 includes an inspection camera 10, a dedicated camera terminal 20, and a management server 100. The dedicated camera terminal 20 and the management server 100 are capable of communicating with each other via a communication network NW. The communication network NW is a communication network such as the Internet that can be connected by wire or wirelessly.

[0018] This inspection system 1 is a system that simultaneously captures images of the products to be included in the package, the product instruction manual, the product list, and the invoice (delivery slip) using an inspection camera 10 before the products are shipped, recognizes the barcodes attached to the products, the product instruction manual, the product list, and the invoice from the images captured by the inspection camera 10, and inspects the package to ensure that there are no missing items based on the recognized barcodes.

[0019] The inspection camera 10 extracts barcode information from the captured image and outputs the extracted barcode information. Even if multiple barcodes exist in the captured image, the inspection camera 10 can extract the barcode information and output the extracted barcode information.

[0020] FIG. 2 is a block diagram showing an example of the configuration of the inspection camera 10.

[0021] As shown in FIG. 2, the inspection camera 10 has an imaging unit 11, a barcode information extraction unit 12, and an output unit 13. The imaging unit 11 is composed of a lens and other components, and outputs image data when an image is captured. The barcode information extraction unit 12 identifies a barcode in the captured image and extracts barcode information based on the image data output from the imaging unit 11. The barcode information extraction unit 12 can also simultaneously identify multiple barcodes in the captured image and extract the barcode information for them. The output unit 13 is an interface that outputs the barcode information extracted by the barcode information extraction unit 12 to the outside. When the barcode information extraction unit 12 extracts multiple pieces of barcode information, the output unit 13 links the barcode information together and outputs the grouped barcode information.

[0022] The inspection camera 10 captures images of products, product instruction manuals, product lists, and invoices, and extracts their barcode information. The barcode information attached to the products includes a product ID (e.g., a JAN code). The barcode information attached to the product instruction manual includes a product instruction manual ID. The barcode information attached to the product list includes a product list ID. The barcode information attached to the invoice includes an invoice ID.

[0023] The camera-dedicated terminal 20 is a processing terminal dedicated to the inspection camera. The camera-dedicated terminal 20 is operated by a user to configure the settings of the inspection camera 10. The camera-dedicated terminal 20 also transmits barcode information output from the inspection camera 10 to the management server 100. For example, the camera-dedicated terminal 20 is a personal computer or a tablet terminal.

[0024] FIG. 3 is a block diagram showing an example of the configuration of the management server 100. As shown in FIG.

[0025] As shown in FIG. 3, the management server 100 includes a communication unit 101, a storage unit 110, and a processing unit 120. The communication unit 101 communicates with other devices, such as the camera-dedicated terminal 20, via a communication interface NW. The storage unit 110 is, for example, an HDD, and stores various data and programs. The processing unit 120 executes various processes in the management server 100. The processing unit 120 includes, for example, a microcomputer and its peripheral circuits, and is configured, for example, with a CPU, a ROM, a RAM, and the like. The ROM stores one or more programs. The CPU executes various processes in accordance with one or more programs stored in the ROM. The processing unit 120 executes various processes as needed in accordance with various data and various programs 110a stored in the storage unit 110. In this embodiment, the processing unit 120 executes an inspection process for inspecting products, etc., based on barcode information transmitted from the inspection camera 10 via the camera-dedicated terminal 20.

[0026] FIG. 4 is a block diagram showing an example of the structure of a database stored in the storage unit 110. As shown in FIG.

[0027] As shown in FIG. 4, the storage unit 110 stores a product information database 111, a product instruction manual information database 112, a product list information database 113, a shipping destination information database 114, an invoice information database 115, and a shipping list information database 116.

[0028] FIG. 5 is a diagram showing an example of the product information database 111. As shown in FIG.

[0029] 5, the product information database 111 includes various pieces of information related to products, such as product IDs and product information, and these pieces of information are associated with each other. Here, the product ID is product identification information. The product information is information such as the product manufacturer name and product name.

[0030] FIG. 6 is a diagram showing an example of the product manual information database 112. As shown in FIG.

[0031] 6, the product manual information database 112 includes various pieces of information related to product manuals, such as product manual IDs and product manuals, and these pieces of information are associated with each other. Here, the product manual ID is identification information for the product manual. The product manual information is information on how to handle the product, etc.

[0032] FIG. 7 is a diagram showing an example of the product list information database 113. As shown in FIG.

[0033] 7, the product list information database 113 includes information related to the list of products to be included, such as a product list ID, each product ID (product ID1, product ID2, ...), and product instruction manual ID, and these pieces of information are associated with each other. Here, the product list ID is identification information for the product list. The product list information database 113 associates the included products (product IDs) with the product instruction manual (product instruction manual ID).

[0034] FIG. 8 is a diagram showing an example of the delivery destination information database 114. As shown in FIG.

[0035] 8, the shipping destination information database 114 includes information related to the delivery destination, such as a shipping destination ID and shipping destination information, and these pieces of information are associated with each other. Here, the shipping destination ID is identification information of the shipping destination. The shipping destination information is the address, contact information, etc. of the shipping destination.

[0036] FIG. 9 is a diagram showing an example of the waybill information database 115.

[0037] 9, the waybill information database 115 includes information related to the waybill, such as the waybill ID and the shipping destination ID, and these pieces of information are associated with each other. Here, the waybill ID is identification information of the waybill.

[0038] FIG. 10 is a diagram showing an example of the shipping list information database 116.

[0039] 10, the shipping list information database 116 includes information related to the shipping list of products to be included in the shipment, such as a shipping list ID, a product list ID, and an invoice ID, and these pieces of information are associated with each other. Here, the shipping list ID is identification information for the shipping list.

[0040] FIG. 11 is a flowchart showing an example of the inspection process of the processing unit 120.

[0041] 11, first, in the process of step S1, the processing unit 120 determines whether or not barcode information has been received from the camera-dedicated terminal 20. If the processing unit 120 determines that barcode information has been received from the camera-dedicated terminal 20, the processing proceeds to the process of step S2.

[0042] In step S2, the processing unit 120 executes a matching process based on the barcode information received in step S1. In the matching process, the processing unit 120 acquires each ID included in the received grouped barcode information and verifies whether the acquired IDs are the IDs of the products, etc., to be included in the package. Specifically, the processing unit 120 references the shipping list information database 116 to verify whether the acquired product list ID corresponds to the acquired invoice ID. The processing unit 120 also references the product list information database 113 to verify whether the acquired product list ID corresponds to each acquired product ID and product instruction manual ID. If the processing unit 120 references these databases and determines that the acquired product list ID corresponds to the acquired invoice ID and that the acquired product list ID corresponds to each acquired product ID and product instruction manual ID, the processing unit 120 sets the matching result to information indicating that all products, etc., to be included in the package are included without any problems, such as "OK." On the other hand, if the acquired product list ID and the acquired invoice ID are not associated, or if the acquired product list ID and each acquired product ID and product instruction manual ID are not associated, the processing unit 120 sets the matching result to information indicating that the products to be included are not complete or do not match, such as "NG." For example, if a required product ID or product instruction manual ID is missing, the processing unit 120 sets the matching result to "NG."

[0043] In the process of step S3, the processing unit 120 transmits the matching result acquired in the process of step S2 to the camera-dedicated terminal 20. The camera-dedicated terminal 20 displays the matching result received from the management server 100 on a display means such as a monitor.

[0044] In this way, when the processing unit 120 determines that barcode information has been received from the camera-dedicated terminal 20, it executes a matching process based on the received barcode information. Then, the processing unit 120 transmits the matching result to the camera-dedicated terminal 20.

[0045] 12 and 13 are diagrams showing examples of the arrangement of the inspection camera 10 and the camera-dedicated terminal 20. Fig. 12 is a front view, and Fig. 13 is a side view.

[0046] 12 and 13, the inspection system 1 has each component attached to an equipment support frame 200, and an inspection stand 250 such as a table disposed in front of the equipment support frame 200. The equipment support frame 200 has a flat base 201, a columnar support 202 extending upward on the base 201, and a camera mounting arm 203 extending forward from the upper end of the support 202. Rotating rollers 204 are attached to the back surface of the base 201 so that the equipment support frame 200 can move. During inspection, the equipment support frame 200 is moved so that the base 201 is positioned between the legs 251 of the inspection stand 250, and is installed immediately in front of the inspection stand 250.

[0047] A camera-dedicated terminal 20 is installed on a support 202 of the apparatus support structure 200. In this example, the camera-dedicated terminal 20 is a notebook personal computer. Also, in this example, a monitor 30 is attached to the top of the support 202 so as to face the inspection table 250. The monitor 30 is connected to the camera-dedicated terminal 20. Also, an inspection camera 10 is attached to a camera mounting arm 203 so as to face above a base 252 of the inspection table 250. An inspection object is placed on the base 252 of the inspection table 250 so as to be within the shooting range A of the inspection camera 10.

[0048] As shown in FIGS. 12 and 13, the inspection system 1 may also include an inspection camera 10, a dedicated camera terminal 20, and a battery 40 for the monitor 30.

[0049] (action, effect, etc.) Next, the operation and function of the inspection system 1 in this embodiment will be described.

[0050] FIG. 14 is a plan view showing an example of the state of the inspection target before inspection.

[0051] The items to be inspected are a product list, products, product instructions, and invoices, which are all placed together in one basket 310, as shown in Fig. 14. In this example, a product list 311 is placed on top of the products, product instructions, and invoices placed in the basket 310.

[0052] FIG. 15 is a plan view showing an example of the state of the inspection target during inspection.

[0053] 15, the inspection worker removes product list 311 from basket 310 and arranges product list 311 and basket 310 side by side on table 252 of inspection table 250. Barcodes 311a, 312a, 313a, 314a, and 315a are attached to product list 311, two products 312 and 313 in basket 310, product instruction manual 314, and waybill 315, respectively. The inspection worker adjusts the arrangement and orientation of the products, etc. as appropriate so that inspection camera 10 can accurately recognize the barcodes.

[0054] Then, when the inspection worker operates the inspection camera 10 or the dedicated camera terminal 20 to perform inspection processing, or when the inspection camera 10 detects an inspection target, the inspection camera 10 captures an image of the inspection target product list 311, two products 312, 313, product instruction manual 314, and waybill 315 placed on the table 252 of the inspection table 250, extracts barcode information from the captured image, and outputs the extracted barcode information. The dedicated camera terminal 20 transmits the barcode information output from the inspection camera 10 to the management server 100.

[0055] In the management server 100, when the processing unit 120 receives the barcode information from the camera-dedicated terminal 20, it executes a matching process based on the received barcode information. Then, the processing unit 120 transmits the acquired matching result to the camera-dedicated terminal 20. In the camera-dedicated terminal 20, the matching result received from the management server 100 is displayed on a display means such as a monitor.

[0056] This allows the inspector to check based on the collation results displayed on the display means whether the combination of products to be packed together is correct and whether all the products are present.

[0057] (Effects of this embodiment) (1) The inspection system 1 can automatically read and compare information on the product list without requiring workers to visually check it, eliminating human error caused by misrecognition by workers during inspection work. This allows the inspection system 1 to inspect multiple products with higher accuracy and in a shorter time.

[0058] (2) The inspection system 1 can simultaneously identify the barcode attached to the product and the barcode attached to the product list from the same image captured by the inspection camera 10, thereby reducing the risk of mistaking the product list, which occurs when the product and the product list are captured separately by the inspection camera 10. This allows the inspection system to perform inspections with higher accuracy.

[0059] (3) The inspection system can also inspect with greater accuracy whether or not a product instruction manual is included.

[0060] In the above-described embodiment, the inspection camera 10 constitutes, for example, an imaging means and an identification means. The processing unit 120 constitutes, for example, a matching means. The product, the product instruction manual, and the invoice constitute, for example, an article. The barcode constitutes, for example, a two-dimensional code. The product list ID, the product ID, the product instruction manual ID, and the invoice ID constitute, for example, information associated with the two-dimensional code. The product instruction manual constitutes, for example, a description of the product.

[0061] (Modifications of this embodiment) As another example of the above embodiment, other two-dimensional codes such as a QR code (registered trademark) may also be used.

[0062] As another example of the above embodiment, the inspection system 1 can identify a barcode from a captured image on the management server 100 side, rather than on the inspection camera 10 side, and extract barcode information.

[0063] As another example of the above embodiment, the inspection system 1 does not have the management server 100, and the camera-dedicated terminal 20 can execute the same processing as the management server 100.

[0064] As another example of the above embodiment, the inspection system 1 can also inspect items other than merchandise. The inspection system 1 can also inspect items that are not intended for shipping, such as items that are handled only within a company.

[0065] As another example of the above embodiment, the inspection system 1 may exclude the product instruction manual from the inspection targets.

[0066] As another example of the above embodiment, the product list can be used only at the time of product inspection, and only the products and product instruction manuals can be shipped without the product list included.

[0067] As another example of the above embodiment, the barcode information extraction unit 12 can group a barcode with other barcodes even if the barcode is not included in the same captured image, if the barcode satisfies certain requirements. For example, when the barcode information extraction unit 12 identifies a barcode (a barcode attached to a product or the like in one captured image) within a preset time, the barcode information extraction unit 12 can group the identified barcode with other barcodes (barcodes attached to products or the like in other captured images) identified within the same preset time. Alternatively, when the management server 100 receives a barcode within a preset time, the management server 100 can group the identified barcode with other barcodes received within the same preset time and proceed with the processing.

[0068] In addition, the above embodiment realizes an inspection method using an inspection system having an identification means and a matching means, which includes an identification step in which the identification means identifies multiple two-dimensional codes from within an image captured by the imaging means, and a matching step in which the matching means outputs a matching result indicating whether or not an item to which the two-dimensional barcode is attached is included in the list, based on information associated with the two-dimensional code attached to the item identified by the identification means and information associated with the two-dimensional code attached to a list of items identified by the identification means.

[0069] In addition, in the above embodiment, a program is realized that causes a computer to execute the following steps: an identification step in which an identification means identifies multiple two-dimensional codes from within an image captured by an imaging means; and a comparison step in which a matching means outputs a comparison result indicating whether or not an item to which the two-dimensional barcode is attached is included in the list, based on information associated with the two-dimensional code attached to the item identified by the identification means and information associated with the two-dimensional code attached to a list of items identified by the identification means.

[0070] Additionally, while embodiments of the present invention have been disclosed, it will be apparent to those skilled in the art that modifications may be made thereto without departing from the scope of the present invention, and it is intended that all such modifications and equivalents be included in the following claims. [Explanation of symbols]

[0071] 1 inspection system, 10 inspection camera, 11 imaging unit, 12 barcode information extraction unit, 13 output unit, 20 dedicated camera terminal, 100 management server, 120 processing unit

Claims

1. An imaging means; an identification means for identifying a plurality of two-dimensional codes from within the image captured by the imaging means; and a matching means for outputting a matching result indicating whether or not an item to which the two-dimensional code is attached is included in the list based on information associated with the two-dimensional code attached to the item identified by the identifying means and information associated with the two-dimensional code attached to a list of items identified by the identifying means, The comparison means is an inspection system that compares the two-dimensional code attached to the item identified by the identification means from the same image captured by the imaging means and the two-dimensional code attached to the list.

2. the list includes a description of the article; The inspection system described in claim 1, wherein the matching means outputs a matching result indicating whether the item to which the two-dimensional code is attached and the instruction manual are included in the list based on information associated with the two-dimensional code attached to the item identified by the identification means, information associated with the two-dimensional code attached to the instruction manual identified by the identification means, and information associated with the two-dimensional code attached to a list of items identified by the identification means.

3. An inspection method using an inspection system having a specifying means and a matching means, an identifying step in which an identifying means identifies a plurality of two-dimensional codes from within an image captured by an imaging means; a comparison step in which a comparison means outputs a comparison result indicating whether or not an item to which the two-dimensional code is attached is included in the list based on information associated with the two-dimensional code attached to the item identified by the identification means and information associated with the two-dimensional code attached to a list of items identified by the identification means, The collation means performs collation based on the two-dimensional code attached to the item identified by the identification means and the two-dimensional code attached to the list from the same image captured by the imaging means. Inspection method.

4. an identifying step in which an identifying means identifies a plurality of two-dimensional codes from within an image captured by an imaging means; a comparison step in which a comparison means outputs a comparison result indicating whether or not an item to which a two-dimensional code is attached is included in the list based on information associated with the two-dimensional code attached to the item identified by the identification means and information associated with the two-dimensional code attached to a list of items identified by the identification means; Execute The collation means is a computer that performs collation based on the two-dimensional code attached to the item identified by the identification means and the two-dimensional code attached to the list from the same image captured by the imaging means. program.

Images