Collation terminal, collation method, and collation program

Abstract

To provide a technique that can efficiently execute the confirmation work for the presence of a confirmation object.SOLUTION: A collation device (collation terminal) 10 includes: a reading unit 104 that reads code information of a confirmation object from a first image through OCR processing and code information of a handling object from a second image through the OCR processing; and a collation unit 105 that collates the code information of the confirmation object with the code information of the handling object, and performs deletion processing for the confirmation object when the code information of the confirmation object matches the code information of the handling object, or when code information previously associated with the code information of the confirmation object matches the code information of the handling object.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a verification terminal, a verification method, and a verification program. [Background technology]

[0002] Patent document 1 discloses a technology in which a payment slip, which has a character code and a barcode containing payment slip issuance information, payment deadline information, and payment amount information, is read by an OCR (Optical Character Recognition) device, the barcode is read by a barcode device, and the code information of the character code is compared with the code information of the barcode. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-130772 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, since the barcode is read using a barcode device, a barcode device is required and it takes time to verify the code information.

[0005] The present disclosure has been made in consideration of the above circumstances, and aims to provide a technology that enables efficient confirmation of the presence of a confirmation target object. [Means for solving the problem]

[0006] A verification terminal according to one embodiment of the present disclosure includes a reading unit that reads code information of an object to be confirmed from a first image using OCR processing and reads code information of an object to be handled from a second image using OCR processing, and a verification unit that compares the code information of the object to be confirmed with the code information of the object to be handled, and performs a clearing process on the object to be confirmed if the code information of the object to be confirmed and the code information of the object to be handled match each other, or if code information previously associated with the code information of the object to be confirmed and the code information of the object to be handled match each other.

[0007] A matching method according to one embodiment of the present disclosure is a matching method performed on a matching terminal, which reads code information of an object to be confirmed from a first image using OCR processing, reads code information of an object to be handled from a second image using OCR processing, matches the code information of the object to be confirmed with the code information of the object to be handled, and if the code information of the object to be confirmed and the code information of the object to be handled match each other, or if code information previously associated with the code information of the object to be confirmed and the code information of the object to be handled match each other, a clearing process is performed on the object to be confirmed.

[0008] A collation program according to an embodiment of the present disclosure causes a computer to function as the collation terminal. Effect of the Invention

[0009] According to the present disclosure, a technique can be provided that enables efficient confirmation of the presence of a confirmation target object. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a diagram illustrating a configuration of a terminal device. [Diagram 2] FIG. 13 is a diagram showing a process flow for setting the format of code information of a product to be handled. [Diagram 3] FIG. 13 is a diagram illustrating an example of a setting screen. [Figure 4] FIG. 13 is a diagram showing a process flow for reading code information and quantity of a product to be confirmed. [Diagram 5]FIG. 2 is a diagram showing an example of a form. [Figure 6] FIG. 13 is a diagram showing an example of master data of code information and quantity. [Figure 7] FIG. 13 is a diagram showing a process flow for checking and deleting code information of a product to be confirmed. [Figure 8] FIG. 13 is a diagram showing an example of a label image. [Figure 9] FIG. 13 is a diagram showing an example of a matching and clearing result screen. [Figure 10] FIG. 13 is a diagram showing a comparison target in Modification 1. [Figure 11] FIG. 13 is a diagram illustrating an example of a code conversion master table. [Figure 12] FIG. 13 is a diagram showing a matching target in application example 1. [Figure 13] FIG. 13 is a diagram showing a matching and clearing result screen in application example 1. [Figure 14] FIG. 13 is a diagram showing a matching target in application example 2. [Figure 15] FIG. 13 is a diagram showing a matching result screen of application example 2. [Figure 16] FIG. 13 is a diagram illustrating a collation example of application example 3. [Figure 17] FIG. 13 is a diagram showing a collation example of application example 4. [Figure 18] FIG. 2 is a diagram illustrating a hardware configuration of a collation device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. In the description of the drawings, the same parts are given the same reference numerals and the description will be omitted.

[0012] [Summary of this disclosure] The present disclosure aims to improve the efficiency of the process of checking whether or not products, packages, etc. listed on a document or the like actually exist.

[0013] For example, at logistics warehouses and factories, when goods are shipped or received, an inspection check is carried out to ensure that the products and quantities listed on the slip match the products and quantities to be inspected.

[0014] In this case, for products with barcodes attached, inspection checks are performed by reading the product information with a barcode device. However, a barcode device is required. Also, for products such as building materials that do not have barcodes attached, inspection checks are performed visually, which takes a lot of time. Therefore, it is not possible to efficiently check whether the products or packages listed on the slips actually exist.

[0015] In this disclosure, the image of the form is read by OCR processing, and the product and quantity in the form are converted into master data in the terminal device. After that, the image of the label attached to the product is read by OCR processing, and the read product is compared with the product in the master data, and the matching or corresponding product and quantity are cancelled. In addition, the progress of the cancellation process and the result of the comparison are displayed on the screen.

[0016] In this manner, in the present disclosure, not only one of the objects to be compared but also the other is read by OCR processing, making a barcode device unnecessary, and inspection can be performed simply by photographing the form and label with the camera of the terminal device.

[0017] In addition, this disclosure displays information regarding the reconciliation process for products and quantities on the screen, making it easy to understand the progress of inspection checks and the results of comparison.

[0018] This reduces the workload of inspectors and shortens inspection time. It also reduces labor costs. As a result, it is possible to efficiently check whether the products listed on the slips are actually present.

[0019] Hereinafter, in this embodiment, the products listed on the slip or the like are referred to as the products to be confirmed, and the products handled on-site at the time of shipment or arrival are referred to as the products to be handled. Note that the products to be confirmed are an example of the objects to be confirmed. The products to be handled are an example of the objects to be handled. The slip image is an example of the first image. The label image is an example of the second image.

[0020] [Terminal device configuration] FIG. 1 is a diagram showing a configuration of a terminal device 1 according to this embodiment.

[0021] The terminal device 1 includes a verification device 10 that verifies data, an imaging device 20 that captures the data to be verified, and a display device 30 that displays the results of the data verification and the result of the transaction, etc. The imaging device 20 is a camera included in the terminal device 1. The display device 30 is a display screen included in the terminal device 1.

[0022] The terminal device 1 is, for example, a mobile terminal, a smartphone terminal, or a tablet terminal. Although not shown in FIG. 1, the terminal device 1 also includes a functional unit that is generally included in a mobile terminal, such as a communication unit that can be connected to a communication network such as the Internet.

[0023] Next, the function of the collation device 10 will be described.

[0024] The verification device 10 is a verification terminal that operates inside the terminal device 1. As shown in FIG. 1, the verification device 10 includes a reception unit 101, a storage unit 102, an acquisition unit 103, a reading unit 104, a verification unit 105, and an output unit 106.

[0025] The accepting unit 101 has a function of accepting a setting area set by a user on the form image displayed on the display device 30, that is, an area in the form image that includes code information and quantity related to the product to be confirmed.

[0026] The reception unit 101 also has a function of displaying a setting screen for setting the format of code information related to the product on the display device 30 and storing the format set by the user in the storage unit 102.

[0027] The storage unit 102 has a function of storing the format of the code information of the product to be handled that is set by the user. The storage unit 102 also has a function of storing the code information and the quantity of the product to be confirmed that are read from the form image by the reading unit 104. The storage unit 102 also has a function of storing various data handled by the verification device 10 and the terminal device 1.

[0028] The acquiring unit 103 has a function of acquiring a form image from the imaging device 20. The acquiring unit 103 also has a function of acquiring a label image from the imaging device 20. In addition, the acquiring unit 103 has a function of repeatedly acquiring a label image from the imaging device 20 until the reading unit 104 reads code information that matches the format of the code information of the product to be handled that is set by the user.

[0029] The reading unit 104 has a function of reading form information from a form image by OCR processing, and extracting (reading) the code information and quantity of the confirmation target product included in the above-mentioned user setting area from the form information.

[0030] The reading unit 104 also has a function of reading label information from a label image by OCR processing, and extracting (reading) code information that matches the format of the code information of the above-mentioned target product from the label information.

[0031] In order to improve the accuracy of character recognition, the reading unit 104 may multiply each pixel value of the image by a certain coefficient or perform morphological transformation before executing the OCR process. Morphological transformation is a technique for adjusting the size of an object in an image by changing the pixel value of each pixel in the image taking into account the pixel values ​​of neighboring pixels.

[0032] The collation unit 105 has a function of collating the code information of the confirmation target product read from the form image with the code information of the handling target product read from the label image.

[0033] In addition, the collation unit 105 has a function of performing a clearing process on the code information and quantity of the product to be confirmed when the code information of the product to be confirmed and the code information of the product to be handled match each other, or when the code information previously associated with the code information of the product to be confirmed and the code information of the product to be handled match each other. For example, the collation unit 105 subtracts '1' from the quantity of the product to be confirmed.

[0034] The output unit 106 has a function of outputting information on the clearing process to the display device 30. The information on the clearing process is, for example, the progress of the clearing process, and the collation results for each item to be checked or for all items to be checked.

[0035] Specifically, the output unit 106 outputs the confirmed quantity and unconfirmed quantity of the product to be confirmed on the screen for each code information of the product to be confirmed, and each time code information of a product to be handled that is related to (matches or corresponds to) the code information of the product to be confirmed is read, the output unit 106 increases the confirmed quantity of the product to be confirmed displayed on the screen and decreases the unconfirmed quantity of the product to be confirmed.

[0036] For example, for the information displayed on the screen, these processes include subtracting '1' from the quantity of the item being checked, deleting the product name and code information of the item being checked when the quantity becomes '0', striking through the product name, code information, and quantity of the item being checked when the quantity becomes '0', entering a check flag to indicate that the item has been cleared, and adding '1' to the actual quantity or accumulated quantity of the item being checked.

[0037] It is also possible to carry out a process to emphasize the difference between the two code information to be compared, for example, by changing the font size, color, or underlining the difference.

[0038] Characters are Roman letters, commonly known as the alphabet, Greek letters, special characters, uppercase letters, lowercase letters, half-width characters, full-width characters, etc. Characters include Japanese characters such as hiragana, full-width katakana, half-width katakana, and kanji.

[0039] Characters include numbers and symbols. Numbers include Roman numerals, Arabic numerals, etc. Symbols include hyphens, commas, parentheses, colons, etc. Code information is a string of characters in which any combination of letters, numbers, and symbols is arranged consecutively.

[0040] [Operation of the verification device] Next, the operation of the collation device 10 will be described.

[0041] (How to set the format of the code information for the products you are handling) For products that are handled at the site when shipped or received, the user takes an image of the label attached to the product with the imaging device 20 of the terminal device 1. After that, the verification device 10 reads code information that matches the preset format of the code information of the product from the image of the label.

[0042] First, a method for setting the format of the code information of the handled products will be described with reference to Fig. 2. Fig. 2 is a diagram showing a process flow for setting the format of the code information of the handled products.

[0043] First, the reception unit 101 of the verification device 10 outputs a setting screen for setting the format of the code information of the product to be handled to the display device 30 (step S101).

[0044] Next, after the user inputs the format of the code information of the handled product to be read on the setting screen, the reception unit 101 of the verification device 10 registers the format in the storage unit 102 (step S102).

[0045] An example of the setting screen is shown in Fig. 3. The setting screen 40 has a type selection field 41 for selecting the type (kind) of character, a consecutive number selection field 42 for selecting the consecutive number of the selected character, and a format display field 43 for displaying the format of the code information to be set.

[0046] One or more inverted triangular buttons 411 are pre-displayed in the type selection field 41. When the user touches the button 411 with his / her finger, a list is displayed. The list includes each character type (more precisely, representative examples of each type) such as uppercase Roman letters, lowercase Roman letters, numbers, hyphens, etc. When a desired type is selected from the list, the character type is decided and displayed in the format display field 43.

[0047] The number of character types (number of types) can be increased or decreased. When two or more buttons 411 are touched to select two or more character types, the character types in the format are determined in order from the top row in the setting screen 40. In the example of FIG. 3, the order is determined as follows: capital Roman letters in the first row, numbers in the second row, capital Roman letters in the third row. In FIG. 3, "A" indicates a representative example of a capital Roman letter type, and "1" indicates a representative example of a number type.

[0048] In the consecutive number selection field 42, for the character type selected in the type selection field 41, a consecutive number selection bar 421 for selecting the consecutive number of that character type is displayed with its length variable, and the Roman numerals for the consecutive number are written on the left side.

[0049] For example, when a user touches the right end of consecutive number selection bar 421 with his / her finger and slides it rightward to the desired consecutive number position, the consecutive number of the character type selected in type selection field 41 is determined and displayed in format display field 43.

[0050] In the example of Fig. 3, the number of consecutive capital Roman letters in the first row is set to 4, the number of consecutive numbers in the second row is set to 2, and the number of capital Roman letters in the third row is set to 1. As a result, "AAAA11A" is displayed in the format display field 43, and this "AAAA11A" is registered in the storage unit 102 as the format of the code information of the handled product. Multiple formats of the code information of the handled product can be set.

[0051] (How to read the code information and quantity of the product to be checked) Next, a method for reading the code information and quantity of the confirmation target product from the form image will be described below. Fig. 4 is a diagram showing a process flow for reading the code information and quantity of the confirmation target product.

[0052] First, the user turns on the imaging device 20 of the terminal device 1 and captures an image of a form (see FIG. 5) (step S201).

[0053] Next, the user sets a desired area (an area including code information and quantity related to the product to be confirmed within the form image) on the form displayed on the display device 30 (step S202).

[0054] Specifically, the user specifies the position of the table in which the code information and the quantity are written, and specifies each column of the code information and the quantity in the table. For example, the user sets a predetermined reference point, the start position of the table from the reference point, the number and size of columns including the code information and the quantity, and the number and size of rows including the code information and the quantity.

[0055] Next, the acquisition unit 103 of the verification device 10 acquires a form image of the form paper from the imaging device 20 of the terminal device 1 (step S203).

[0056] Finally, the reading unit 104 of the verification device 10 reads the form information from the form image using OCR processing, extracts from the form information the code information and quantity of the product to be confirmed that is included in the setting area set by the user in step S202, and registers the code information and quantity in the memory unit 102 as master data (see Figure 6) (step S204).

[0057] (Method of verifying and canceling code information) Next, we will explain how to check the code information of the product to be confirmed with the code information of the product to be handled and how to cancel the product to be confirmed. This corresponds to an inspection check of the product and quantity of the product to be confirmed that is written on the slip and registered, and the product and quantity of the product to be handled that is about to be shipped or received.

[0058] 7 is a diagram showing a process flow for verifying and deleting code information. In the storage unit 102 of the verifying device 10, one or more code information formats related to the products to be handled are registered in advance, and master data of the code information and quantity related to the products to be confirmed is also registered in advance.

[0059] First, the user turns on the imaging device 20 of the terminal device 1 and captures an image of a label attached to a product to be shipped or received (step S301).

[0060] Next, the acquisition unit 103 of the collation device 10 acquires a label image (see FIG. 8) of the label from the imaging device 20 of the terminal device 1 (step S302).

[0061] Next, the reading unit 104 of the verification device 10 reads the format of the code information of the target product from the storage unit 102, reads the label information from the label image by OCR processing, and extracts code information that matches the format from the label information (step S303).

[0062] For example, the format of the code information of a product to be handled, "AAAA-1111AA," is preset, and the code information "PBMG-0820SC" is extracted from the label image shown in FIG.

[0063] Next, the matching unit 105 of the matching device 10 reads the master data from the memory unit 102, and matches the code information of the product to be confirmed contained in the master data with the code information of the product to be handled extracted from the label image in step S303 (step S304).

[0064] Next, if the code information of the product to be confirmed and the code information of the product to be handled match each other, the collation unit 105 of the collation device 10 performs a cancellation process to subtract '1' from the quantity of the product to be confirmed in the master data, and the output unit 106 outputs the status of the cancellation process and the collation results to the display device 30 using the master data before and after the cancellation process (step S305).

[0065] For example, the output unit 106 first uses the master data before the clearing process (see FIG. 6) to output to the display device 30 a matching clearing result screen 50 (see the left side of FIG. 9) in which columns for the number of picks and the number of remaining items are added to the code information of the item to be confirmed. Next, the output unit 106 uses the master data after the clearing process to add '1' to the "number of picks" of the matched item to be confirmed and subtract '1' from the "number of remaining items" (see the right side of FIG. 9).

[0066] Next, the collation unit 105 of the collation device 10 judges whether or not the quantities of the confirmation target products in the master data are all '0' (step S306).

[0067] If the quantities of the products to be handled are not all '0', the process returns to step S301, and steps S301 to S305 are repeated. Each time the terminal device 1 (verification device 10) reads the label of a product to be handled, the number of picks and the remaining number on the verification clearing result screen 50 shown in FIG. 9 change, and eventually the remaining numbers of all products to be checked become '0'. At this time, the verification result (OK or NG) may be displayed for each product to be checked, or one verification result may be displayed for all products to be checked. If the quantities (remaining numbers) of all products to be handled are '0', the process ends.

[0068] In this manner, in this embodiment, the code information of the product to be confirmed is read from the document image using OCR processing, the code information of the item to be handled is read from the label image using OCR processing, and the code information of the item to be confirmed is compared with the code information of the item to be handled. If the code information of the item to be confirmed and the code information of the item to be handled match each other, a check is performed on the item to be confirmed. Therefore, an inspection can be performed simply by photographing the document and label with the camera of terminal device 1, and the task of confirming the presence of the product to be confirmed can be carried out efficiently.

[0069] [Variation 1] The above operations have been explained assuming that the code information of the product to be checked and the code information of the product to be handled match each other. However, if the document creator (e.g., contract manager) and the label creator (e.g., shipping manager) are different, or if a mistake is made in inputting one of the code information, different code information may be mistakenly assigned to the same product.

[0070] Therefore, even if the code information of the product to be confirmed and the code information of the product to be handled are different from each other as shown in FIG. 10, the product to be confirmed may be cancelled by previously associating them one-to-one with each other and managing them as a code conversion master table.

[0071] For example, when the user images the form using the imaging device 20 of the terminal device 1, he or she also images the label to be attached to the product to be handled. At this time, the reading unit 104 of the verification device 10 extracts the code information and the quantity of the product to be verified from the form image, and registers the code information and the quantity in the storage unit 102 as master data.

[0072] At this time, the user selects the code information of the product to be confirmed from the form image being displayed on the display device 30 of the terminal device 1. The reading unit 104 of the collation device 10 extracts the code information of the product to be handled from the label image, generates a code conversion master table (see FIG. 11 ) for code information conversion in which the code information of the product to be handled corresponds to the code information of the product to be confirmed selected by the user, and registers the code conversion master table in the storage unit 102.

[0073] When verifying and canceling the code information at the time of shipping the product, the reading unit 104 of the verifying device 10 extracts the code information of the product from the label attached to the product. Then, the verifying unit 105 of the verifying device 10 reads the code conversion master table from the storage unit 102, and searches the extracted code information of the product from the code conversion master table.

[0074] If the code conversion master table contains code information of the product to be handled at the time of shipment, that is, if the extracted code information of the product to be handled matches the code information of the product to be handled in the code conversion master table, the matching unit 105 uses the code conversion master table to convert the code information of the matching product to code information of a product to be confirmed, and deletes the product to be confirmed related to that code information from the master data.

[0075] [Variation 2] In steps S201 and S203, a case has been described in which a form image captured by the terminal device 1 is used, but a form image transmitted from a server device in the cloud via a communication network or a form image captured by another terminal device may also be used.

[0076] [Variation 3] In steps S204 and S303, the collation device 10 performs OCR processing. However, it is also possible to request a server device in the cloud having an OCR function to perform OCR processing, and use the form information or label information that is the result of the execution.

[0077] [Variation 4] Steps S301 to S306 may be performed for each handled product, or may be performed for a plurality of handled products at once if the labels of the plurality of handled products can be imaged at once.

[0078] [Variation 5] If there are multiple forms, the forms may be imaged and read one by one, or multiple forms may be imaged and read all at once. If the user's setting work in step S202 is time-consuming, an instruction may be given in step S201 to image only the code information and quantity. In this case, the code information and quantity that span multiple lines on the form may be imaged and read one line at a time or multiple lines at a time.

[0079] [Examples of application of the verification device] The collation device 10 is applicable to the supply chain industry, the logistics industry, etc. For example, it is applicable to the shipping inspection work and the receiving inspection work of things (raw materials, parts, products, luggage, cargo, etc.) both in Japan and overseas.

[0080] The objects of matching include, for example, information on items written on shipping instructions, and information on items written directly on packages and cargo (case marks, container numbers, etc.). It can also be applied to alphanumeric characters, Japanese characters, and handwritten characters. Cargo includes containers, trucks, freight cars, ships, etc.

[0081] [Application example 1] The collation device 10 is applicable to an inspection operation that uses a shipping instruction sheet and a product model code.

[0082] Building material manufacturers and 3PL (3rd Party Logistics) create shipping instructions that indicate the alphanumeric model code and quantity of each building material based on the purchase and sale contract for the building material. Each building material is packed in a cardboard box, and the alphanumeric model code of each building material is affixed to the surface of each cardboard box.

[0083] However, in the past, inspections of these building materials were done visually at the time of shipment, which meant there was a possibility of inspection errors.In addition, commercially available handheld devices such as barcode devices could not read the alphanumeric model codes.

[0084] Therefore, the collation device 10 can be applied to such a task.

[0085] A worker takes an image of the shipping instruction sheet in advance using the imaging device 20 of the terminal device 1 (see the left side of FIG. 12). At this time, the collation device 10 reads and stores the model code and quantity of each building material product from the image of the shipping instruction sheet using OCR processing.

[0086] When the building materials are shipped, a worker captures an image of the model code of each building material affixed to each cardboard box with the imaging device 20 of the terminal device 1 (see the right side of FIG. 12). Every time an image is captured, the collation device 10 reads the model code of the building material from the captured image by OCR processing and compares it with the model code of each building material on the shipping instructions that have been read in advance.

[0087] If the model codes match, the collation device 10 performs a clearing process for the building material product and quantity on the shipping instruction, and displays a collation clearing result screen 50 as shown in FIG.

[0088] In this way, the verification device 10 automatically reads the model code on the shipping instruction sheet and the model code on the cardboard box by OCR processing, and verifies and cancels the two model codes, so that inspection checks can be easily performed and inspection errors can be reliably prevented. In addition, since the verification device reads not only one of the verification targets but also the other by OCR processing, it can also be used in cases where the model code cannot be read by commercially available handheld devices.

[0089] [Application example 2] The collation device 10 can be applied to inspection work, document storage work, and warehousing, which use management labels on documents and handwritten characters on cardboard boxes.

[0090] When storing documents, handwritten characters that identify the documents in the same cardboard box may be written on the surface of the box, and a management label showing the handwritten characters (management characters) may be affixed to the box.

[0091] However, commercially available handheld devices could not read handwritten characters.

[0092] Therefore, the collation device 10 can be applied to such a task.

[0093] The worker captures images of the printed characters and the handwritten characters with the imaging device 20 of the terminal device 1 (see FIG. 14).

[0094] At this time, the matching device 10 reads the printed characters and the handwritten characters from the images of the printed characters and the handwritten characters by OCR processing, and matches the read printed characters with the handwritten characters. If the printed characters and the handwritten characters match each other, the matching device 10 performs a deletion process on the printed characters (control characters), and outputs a matching deletion result screen 50 as shown in FIG. 15 to the display device 30 of the terminal device 1.

[0095] In this way, OCR technology is used to read handwritten characters.

[0096] [Application example 3] The collation device 10 is applicable to inspection work using shipping instructions and case marks of luggage, and to import and export work of luggage.

[0097] In logistics, a shipping instruction sheet from the exporter is printed out and then visually checked to ensure that the case mark on the shipping instruction sheet matches the case mark on the cargo being exported.

[0098] However, visual inspection placed a heavy burden on workers, and commercially available handheld devices were unable to read the case marks.

[0099] Therefore, the collation device 10 can be applied to such a task.

[0100] The worker takes an image of the shipping instruction sheet in advance with the imaging device 20 of the terminal device 1 (see the upper left of FIG. 16). At this time, the collation device 10 reads the case mark from the image of the shipping instruction sheet by OCR processing.

[0101] When exporting a package, a worker captures an image of the package's case mark with the imaging device 20 of the terminal device 1 (see the upper right of FIG. 16). At this time, the verification device 10 reads the package's case mark from the captured image by OCR processing and verifies it with the case mark on the shipping instruction sheet that was previously read.

[0102] Then, when the case marks match, the collation device 10 displays an OK collation result on the display device 30 of the terminal device 1, and when the case marks do not match, the mismatched parts are clearly indicated and an NG collation result is displayed. In the case mark collation result illustrated in Fig. 16, the difference in case numbers (C / NO.) is highlighted in bold.

[0103] In this way, the verification device 10 reads the case mark on the shipping instruction sheet and the case mark on the package by OCR processing and verifies the two case marks, thereby reducing the inspection check load. In addition, since the verification device reads not only one of the verification targets but also the other by OCR processing, it can also handle cases where the case mark cannot be read by commercially available handheld devices.

[0104] [Application example 4] The collation device 10 can be applied to inspection work and cargo import / export work, which are carried out using the container cargo delivery slip and the container number and the like written on the container.

[0105] In logistics, a visual check is performed to ensure that the container cargo receipt and the various information painted on the surface of the container match, and the results of this check are then entered into systems such as NACCS (Nippon Automated Cargo and Port Consolidated SYSTEM).

[0106] However, visual checks placed a heavy burden on workers.

[0107] Therefore, the collation device 10 can be applied to such a task.

[0108] A worker takes an image of the container cargo delivery slip with the imaging device 20 of the terminal device 1 (see the upper left of FIG. 17). At this time, the verification device 10 reads the container number, container weight, seal number, container size, container type, etc. (hereinafter, various container information) from the image of the container cargo delivery slip by OCR processing.

[0109] When exporting a container, a worker captures various container information etc. painted on the surface of the container with the imaging device 20 of the terminal device 1 (see the upper right of FIG. 17). At this time, the verification device 10 reads the various container information from the captured image by OCR processing and verifies it against the various container information on the container cargo delivery slip that was previously read.

[0110] Then, if the same type of information matches each other, the matching device 10 displays an OK matching result on the display device 30 of the terminal device 1, and if the case marks do not match each other, it clearly indicates the parts that do not match and displays an NG matching result.

[0111] The worker may visually check the differences in various container information using the collation result. The collation result by the collation device 10 and the visual difference check result are transmitted from the terminal device 1 to the NACCS or the like for linkage.

[0112] In this way, the verification device 10 reads the various container information on the container cargo delivery slip and the various container information on the container by OCR processing, and verifies the two pieces of container information, thereby reducing the inspection check load.

[0113] [Effects of the embodiment] According to this embodiment, the matching device 10 is equipped with a reading unit 104 that reads code information of the product to be confirmed from the document image by OCR processing and reads code information of the product to be handled from the label image by OCR processing, and a matching unit 105 that compares the code information of the product to be confirmed with the code information of the product to be handled, and performs a clearing process on the product to be confirmed if the code information of the product to be confirmed and the code information of the product to be handled match each other, or if the code information previously associated with the code information of the product to be confirmed and the code information of the product to be handled match each other, a technology can be provided that can efficiently carry out the task of confirming the existence of the product to be confirmed.

[0114] Furthermore, according to the present embodiment, since the output unit 106 that outputs information on the clearing process to a screen is provided, a technique can be provided that enables the task of checking the existence of a product to be checked to be carried out more efficiently.

[0115] Furthermore, according to this embodiment, the output unit 106 outputs the confirmed quantity and unconfirmed quantity of the product to be confirmed to the screen for each code information of the product to be confirmed, and each time the code information of a product to be handled related to the code information of the product to be confirmed is read, the confirmed quantity of the product to be confirmed is increased and the unconfirmed quantity of the product to be confirmed is decreased, thereby providing a technology that enables the task of confirming the existence of products to be confirmed to be carried out even more efficiently.

[0116] [others] The present disclosure is not limited to the above-described embodiment, and various modifications are possible within the scope of the present disclosure.

[0117] The above-described collation device 10 of the present embodiment can be realized, for example, as shown in Fig. 18, by using a general-purpose computer system including a CPU 901, a memory 902, a storage 903, a communication device 904, an input device 905, and an output device 906. The memory 902 and the storage 903 are storage devices. In the computer system, the CPU 901 executes a predetermined program loaded on the memory 902, thereby realizing each function of the collation device 10.

[0118] The collation device 10 may be implemented by one computer. The collation device 10 may be implemented by multiple computers. The collation device 10 may be a virtual machine implemented in a computer. The program for the collation device 10 may be stored in a computer-readable recording medium such as a HDD, SSD, USB memory, CD, or DVD. The computer-readable recording medium is, for example, a non-transitory recording medium. The program for the collation device 10 may also be distributed via a communication network. [Explanation of symbols]

[0119] 1...Terminal device 10. Matching device 20...Imaging device 30…Display device 101…Reception 102...Storage section 103…Acquisition part 104...Reading unit 105…Collation section 106...Output section 901...CPU 902…Memory 903…Storage 904...Communication equipment 905…Input device 906...Output device

Claims

1. a reading unit that reads code information of the confirmation object from the first image by OCR processing and reads code information of the handling object from the second image by OCR processing; a verification unit that collates the code information of the confirmation object with the code information of the handling object, and performs a clearing process on the confirmation object when the code information of the confirmation object and the code information of the handling object match each other, or when the code information previously associated with the code information of the confirmation object and the code information of the handling object match each other; A collation terminal comprising:

2. an output unit that outputs information on the clearing process to a screen; The verification terminal according to claim 1 , comprising:

3. The output unit is The collation terminal according to claim 2, wherein the confirmed quantity and unconfirmed quantity of the object to be confirmed are output to the screen for each code information of the object to be confirmed, and each time the code information of an object to be handled related to the code information of the object to be confirmed is read, the confirmed quantity of the object to be confirmed is increased and the unconfirmed quantity of the object to be confirmed is decreased.

4. The reading unit is 2. The collation terminal according to claim 1, further comprising a step of extracting code information from said object that matches a format of the code information of said object.

5. the first image is a form image, The second image is 2. The verification terminal according to claim 1, which is a label image.

6. In the verification method performed at the verification terminal, Reading code information of the object to be confirmed from the first image by OCR processing; reading code information of the object from the second image by OCR processing; comparing the code information of the confirmation object with the code information of the handling object, and if the code information of the confirmation object and the code information of the handling object match each other, or if the code information previously associated with the code information of the confirmation object and the code information of the handling object match each other, performing a clearing process on the confirmation object; Matching method.

7. A verification program that causes a computer to function as the verification terminal according to any one of claims 1 to 5.

Images