Identification code detection device and identification code detection method

Abstract

Provided is an identification code detection device that can accurately detect code information of a plurality of identification codes in a simple manner. 【Solution means】The identification code detection device 10 of the present invention includes an imaging unit 11 that acquires image information including an image of a package 2 to which an identification code 4 is assigned, a distance measurement unit 13 that measures the distance from the imaging unit for a plurality of packages 2 extracted from the image information, a distance map generation unit 14 that generates a distance map showing the relationship between the subject distance and the in-focus range using the measurement result of the distance of the package 2, and an identification code detection unit 15 that detects the code information of the identification code 4 using the image information acquired according to the in-focus range in the distance map.

Description

Technical Field

[0001] The present invention relates to an identification code detection device that detects an identification code assigned to a package.

Background Art

[0002] As a technology for managing packages in a warehouse, a method of managing the presence or absence and installation location of packages in the warehouse by reading an identification code assigned to the package has been implemented. For example, in Patent Document 1, a scanner reads an identification display for identifying a product to be managed and an identification display for identifying the location where the product is placed, compares the actual number data of the read product with the product data stored in a database, and a system for rewriting the product inventory record in the database has been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When reading an identification code for identifying a product to be managed in a warehouse or the like with a scanner, it is necessary to read the identification codes of a large number of products to be managed during inspection at the time of incoming and outgoing shipments, and the burden of manual labor for reading the identification codes is large. Recently, a technology for simultaneously reading a plurality of identification codes with a high-quality camera mounted on a mobile terminal such as a smartphone has been put into practical use. However, when simultaneously photographing a plurality of identification codes with the camera of the mobile terminal, if the number of identification codes to be photographed is large, it is necessary to secure a certain distance between the camera and the package, so the photographing resolution deteriorates according to the distance between the camera and the package, and all the identification codes may not be accurately detected.

[0005] The present invention has been made to solve the above problems, and an object thereof is to provide an identification code detection device capable of accurately detecting code information of a plurality of identification codes in a simple manner.

Means for Solving the Problems

[0006] In order to solve the above-described problems, the identification code detection device of the present invention includes an imaging unit that acquires image information including an image of a package to which an identification code is attached, and in first image information including a plurality of the packages acquired by the imaging unit, a distance measurement unit that extracts a region of the package and measures a distance from the imaging unit for each of the extracted regions of the package, a distance map generation unit that generates a distance map showing the relationship between the subject distance and the in-focus range using the measurement result of the distance measurement unit, and an identification code detection unit that detects code information of the identification code using second image information acquired by the imaging unit according to the in-focus range in the distance map. The imaging unit acquires the second image information including at least one of the identification codes in the in-focus range including the distance of the region of the package according to a focus drive position determined based on the in-focus range and the distance of the region of the identification code, and the identification code detection unit detects the code information of the identification code in the second image information.

[0007] Further, the distance map generation unit generates the distance map in which the in-focus range is set so that the distances of the regions of the plurality of packages are included in at least one of the in-focus ranges, The imaging unit may acquire the second image information including a plurality of the identification codes in the in-focus range set in the distance map.

[0008] In order to solve the problems described above, the identification code detection method of the present invention is an identification code detection method executed in an identification code detection device including an imaging unit that acquires image information including an image of a package to which an identification code is attached, a distance measurement unit that measures the distance from the imaging unit of the area of the package in the image information, a distance map generation unit that generates a distance map showing the relationship between the subject distance and the in-focus range using the measurement result of the distance measurement unit, and an identification code detection unit that detects the code information of the identification code using the image information acquired by the imaging unit according to the in-focus range in the distance map, the method including: a step in which the imaging unit acquires first image information including a package to which the identification code is attached; a step in which the distance measurement unit extracts the area of the package in the first image information including a plurality of the packages acquired by the imaging unit, and measures the distance from the imaging unit for each of the extracted areas of the package; a step in which the distance map generation unit generates a distance map showing the relationship between the subject distance and the in-focus range using the measurement result of the distance measurement unit; and a step in which the identification code detection unit detects the code information of the identification code using second image information acquired by the imaging unit according to the in-focus range in the distance map, wherein the imaging unit acquires second image information including at least one of the identification codes in the in-focus range including the distance of the area of the package according to the focus drive position determined based on the in-focus range and the distance of the area of the identification code, and the identification code detection unit detects the code information of the identification code in the second image information.

[0009] Further, the distance map generation unit may generate a distance map in which the in-focus range is set so that the distances of the areas of a plurality of the packages are included in at least one of the in-focus ranges, and the imaging unit may acquire second image information including a plurality of the identification codes in the in-focus range set in the distance map.

Advantages of the Invention

[0010] According to the present invention, it is possible to provide an identification code detection device that can accurately detect the code information of a plurality of identification codes in a simple manner.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. It should be noted that the present invention can be implemented in various embodiments and is not limited to the embodiments of the invention described below.

[0013] <Configuration of Package Management System> FIG. 1 is an example of a system configuration including an identification code detection device according to an embodiment of the present invention. The identification code detection system 1 in FIG. 1 acquires a package image in a state where a package 2 with an identification code 4 is placed on a pallet 3, and uses the acquired package image to detect the code information of the identification code assigned to the package 2. The identification code detection system 1 includes an identification code detection device 10 and an identification code management server 20 that manages the code information of the identification code detected by the identification code detection device 10.

[0014] Recently, technologies for simultaneously reading multiple identification codes using high-quality cameras mounted on mobile terminals such as smartphones have been put into practical use. However, when simultaneously photographing multiple identification codes with the camera of a mobile terminal, if the number of identification codes to be photographed is large, it is necessary to ensure a certain distance between the camera and the luggage. Therefore, depending on the distance between the camera of the mobile terminal and the luggage, the imaging resolution deteriorates, and it may not be possible to accurately detect all the identification codes.

[0015] In this embodiment, when detecting the code information of a plurality of identification codes 4 attached to the luggage 2 placed at different positions, the imaging unit 11 acquires image information (first image information) including a plurality of luggage 2, extracts the area of the luggage 2 to which the identification code 4 is attached, measures the distance between the imaging unit 11 and the extracted area of the luggage, generates a distance map showing the relationship between the subject distance and the focusing range using the measured distance, determines the focus drive position of the imaging unit 11 according to the focusing range in the generated distance map, and detects the code information of the identification code 4 using the image information (second image information) of the identification code 4 acquired at the determined focus drive position.

[0016] By determining the focus drive position of the imaging unit 11 according to the focusing range in the distance map created according to the distance between the imaging unit 11 and the luggage 2, it is possible to acquire images of a plurality of identification codes in a focused state included in one focusing range. Therefore, it is possible to detect the code information of a plurality of identification codes 4 at different positions with fewer focus drive operations without performing a focus drive operation for each individual identification code.

[0017] <Configuration of the Identification Code Detection Device> FIG. 2 is an example of a functional block of an identification code detection device according to an embodiment of the present invention.

[0018] The identification code detection device 10 includes an imaging unit 11 for acquiring a captured image including an image of a package with an identification code 4, a distance sensor unit 12 for measuring the distance to the package 2, a central processing unit that measures the distance to the package 2 using the distance sensor unit 12 to generate a distance map, and detects the code information of the identification code 4 using the generated distance map, a storage unit 16 for storing various information, etc., an input unit 17 for the photographer to input information, a display unit 18 for displaying the detection status of the identification code 4, and a wireless unit 19 for transmitting information to the identification code management server 20.

[0019] The central processing unit functions as a distance measurement unit 13 that measures the distance to the package 2 using the distance sensor unit 12, a distance map generation unit 14 that generates a distance map showing the relationship between the subject distance and the focus range using the measurement result of the distance measurement unit 13, and an identification code detection unit 15 that detects the code information of the identification code 4 using the image information acquired by the imaging unit 11 according to the focus range in the generated distance map.

[0020] The identification code detection unit 15 determines the focus drive position of the imaging unit 11 according to the focus range in the distance map showing the relationship between the subject distance and the focus range, which is generated using the distance measured by the distance measurement unit 13, and detects the code information of the identification code 4 using the image information of the identification code 4 acquired by the imaging unit 11 at the determined focus drive position.

[0021] As a result, it is possible to acquire the images of the plurality of identification codes 4 included in one focus range in a focused state. Therefore, without performing a focus drive operation for each individual identification code 4, it is possible to detect the code information of the plurality of identification codes 4 at different positions with fewer focus drive operations.

[0022] The storage unit 16 stores the measured distance information of the package 2 and the distance map generated using the measured distance information. The identification code detection unit 15 determines the focus drive position of the imaging unit 11 according to the in-focus range in the distance map stored in the storage unit 16, and can detect the code information of the identification code 4 using the image information of the identification code acquired by the imaging unit 11 at the determined focus drive position.

[0023] As the imaging unit 11, a general-purpose RGB camera can be used. As the identification code detection device 10 including the imaging unit 11, for example, a digital camera equipped with an RGB camera, a smartphone, or the like can be used. As the distance sensor unit 12, a general-purpose distance measurement sensor such as a TOF (Time of Flight) sensor or a LiDAR sensor can be used.

[0024] The identification code detection device 10 can be configured by a computer including a CPU, a memory, and an interface for connecting to an external device.

[0025] <Measurement of the distance of the identification code> FIG. 3 is a diagram for explaining the measurement of the distance of the package in the embodiment of the present invention. In the example of FIG. 3, a plurality of packages 2 with the identification code 4 are placed on the pallet 3.

[0026] The identification code detection device 10 extracts the region of the package 2 from the image information including a plurality of packages 2 acquired by the imaging unit 11, and measures the distance (L1-L5) from the imaging unit 11 for each of the extracted regions of the package 2.

[0027] In the example of FIG. 3, image information including images of a plurality of packages 2 to which the identification code 4 is assigned is acquired, and the area of the package 2 is detected in the acquired image information. For the extraction of the area of the package 2, it is not necessary to extract the identification code assigned to the package 2, and it is sufficient if the position where the package 2 to which the identification code 4 is assigned exists can be specified on the image. The extraction of the area of the package 2 can be realized, for example, by detecting the differences and features from the periphery of the color and shape of the package 2. The area of the package 2 may be extracted using the measurement result in the distance measurement unit 13.

[0028] Also, in the acquired image information, it is sufficient if the area of the package 2 to which the identification code 4 is assigned is included, and other areas that are not the area of the package 2 may be detected as the area of the package 2. If an area to which the identification code 4 is not assigned is erroneously detected as the area of the package 2, since the identification code 4 is not detected in that area, such an area can be excluded when detecting the identification code.

[0029] <Generation of distance map> In the present embodiment, when detecting the code information of a plurality of identification codes 4 assigned to packages 2 placed at different distances, the distance between the imaging unit 11 and the package 2 is measured, and a distance map showing the relationship between the subject distance and the focusing range is generated using the measured distance. FIGS. 4 and 5 are diagrams for explaining an example of the distance map in the embodiment of the present invention.

[0030] The distance maps in FIGS. 4 and 5 are distance maps showing the relationship between the subject distance and the focusing range. The imaging unit 11 has a focusing range (depth of field) centered on the focusing position, and the imaging unit 11 has a focusing range (depth of field) corresponding to the focus drive position.

[0031] FIG. 4 is an example of a distance map having five focusing ranges (F1 - F5). The focus drive position of the imaging unit 11 is determined based on the focusing range in the distance map and the distance (L1 - L5) to the package 2.

[0032] In FIG. 4, among the five focusing ranges (F1 - F5), by setting the focus drive position of the imaging unit 11 to the focus positions D1 - D3 of the focusing ranges F3 - F5 that include the distances L1 - L5 of the identification code 4, the identification code 4 can be detected.

[0033] FIG. 5 is an example of a distance map in which two focusing ranges (F1, F2) are set according to the distances L1 - L5 of the identification code 4. The focus drive position of the imaging unit 11 is determined based on the focusing range in the distance map and the distance of the package 2.

[0034] In FIG. 5, by setting the focus drive position of the imaging unit 11 to the focus positions D1, D2 of the focusing ranges F1, F2 that include the distances L1 - L5, the identification code 4 can be detected.

[0035] <Detection of Identification Code> The identification code detection device 10 determines the focus drive position of the imaging unit 11 according to the focusing range in the generated distance map, and detects the code information of the identification code 4 using the image information of the identification code 4 acquired at the determined focus drive position.

[0036] In FIG. 4, the distance L3 of the identification code 4 is included in F3, the distance L5 of the identification code 4 is included in F4, and the distances L1, L2, L4 of the identification code 4 are included in F5. Therefore, by adjusting the focus drive position of the imaging unit 11 to D1, D2, D3, the identification code 4 arranged at the distances L1 - L5 can be detected.

[0037] Here, since the distances L1, L2, L4 of the identification code 4 are included in the focusing range F5, by adjusting the focus drive position of the imaging unit 11 to F5, three identification codes 4 can be detected.

[0038] In FIG. 5, since the distances L3 and L5 of the identification code 4 are included in F1 and the distances L1, L2, and L4 of the identification code 4 are included in F2, by adjusting the focus drive positions of the imaging unit 11 to D1 and D2, the identification code 4 arranged at the distances L1 - L5 can be detected.

[0039] Here, since the distances L3 and L5 of the identification code 4 are included in the in-focus range F1 and the distances L1, L2, and L4 of the identification code 4 are included in the in-focus range F2, by comparing with the distance map in FIG. 4, the five identification codes 4 can be detected with fewer focus drive positions.

[0040] In this way, by determining the focus drive position of the imaging unit 11 according to the in-focus range in the distance map created according to the distance between the imaging unit 11 and the package 2, an image of a plurality of identification codes 4 in a focused state included in one in-focus range can be obtained. Therefore, without performing a focus drive operation for each individual identification code 4, it is possible to detect the code information of a plurality of identification codes 4 at different positions with fewer focus drive operations.

[0041] <Operation Flow of Identification Code Detection Device> Using FIG. 6, the operation of the identification code detection method executed in the identification code detection device 10 will be described. FIG. 6 is an example of the operation flow of the identification code detection method according to an embodiment of the present invention.

[0042] Each step of the identification code detection method is executed in the identification code detection device 10 including an imaging unit 11 that acquires image information including an image of a package with an identification code, a distance measurement unit 13 that measures the distance from the imaging unit of the package area in the image information, a distance map generation unit 14 that generates a distance map showing the relationship between the subject distance and the in-focus range using the measurement result of the distance measurement unit, and an identification code detection unit 15 that detects the code information of the identification code using the image information acquired by the imaging unit 11 according to the in-focus range in the distance map.

[0043] The imaging unit 11 of the identification code detection device 10 acquires image information including an image of a package to which an identification code is attached (S1-1).

[0044] The distance measurement unit 13 of the identification code detection device 10 extracts the regions of the packages from the image information including a plurality of packages acquired by the imaging unit 11 (S1-2).

[0045] The distance measurement unit 13 of the identification code detection device 10 measures the distance from the imaging unit 11 for each of the extracted regions of the packages using the distance sensor unit 12 (S1-3).

[0046] The distance map generation unit 14 of the identification code detection device 10 generates a distance map showing the relationship between the subject distance and the in-focus range using the measurement results of the distance measurement unit 13 (S1-4).

[0047] The identification code detection unit 15 of the identification code detection device 10 determines the focus drive position based on the in-focus range of the distance map and the distance of the region of the package (S1-5).

[0048] The imaging unit 11 of the identification code detection device 10 acquires image information including the identification code in the in-focus range including the distance of the region of the package according to the determined focus drive position (S1-6).

[0049] The identification code detection unit 15 of the identification code detection device 10 detects the code information of the identification code using the image information acquired by the imaging unit 11 according to the in-focus range in the distance map (S1-7).

[0050] The focus drive and the detection of the identification code information are repeated until the identification code is detected at all the determined focus drive positions (S1-8).

[0051] In this embodiment, when detecting the code information of a plurality of identification codes 4 assigned to packages 2 placed at different positions, the imaging unit 11 acquires image information (first image information) including the plurality of packages 2, extracts the area of the package 2 to which the identification code 4 is assigned, measures the distance between the imaging unit 11 and the extracted area of the package, generates a distance map showing the relationship between the subject distance and the focusing range using the measured distance, determines the focus drive position of the imaging unit 11 according to the focusing range in the generated distance map, and detects the code information of the identification code 4 using the image information (second image information) of the identification code 4 acquired at the determined focus drive position.

[0052] According to this embodiment, by determining the focus drive position of the imaging unit 11 according to the focusing range in the distance map created according to the distance between the imaging unit 11 and the package 2, it is possible to acquire images of a plurality of identification codes in a focused state included in one focusing range. Therefore, it is possible to detect the code information of a plurality of identification codes 4 at positions with different distances with fewer focus drive operations without performing a focus drive operation for each individual identification code.

[0053] According to this embodiment, it is possible to provide an identification code detection device that can accurately detect the code information of a plurality of identification codes in a simple manner.

Explanation of Reference Numerals

[0054] 1... Identification code detection system, 2... Package, 3... Pallet, 4... Identification code, 10... Identification code detection device, 11... Imaging unit, 12... Distance sensor unit, 13... Distance measurement unit, 14... Distance map generation unit, 15... Identification code detection unit, 16... Storage unit, 17... Input unit, 18... Display unit, 19... Wireless unit, 20... Identification code management server.

Claims

1. an imaging unit that acquires image information including an image of a package to which an identification code has been assigned; a distance measurement unit that extracts areas of the luggage in first image information including the plurality of luggage acquired by the imaging unit, and measures a distance from the imaging unit to each of the extracted areas of the luggage; a distance map generating unit that generates a distance map indicating a relationship between a subject distance and a focusing range using a measurement result of the distance measuring unit; an identification code detection unit that detects code information of the identification code by using second image information acquired by the imaging unit according to the focusing range in the distance map; Equipped with The imaging unit includes: acquiring the second image information including at least one of the identification codes in the focus range including the distance of the baggage area according to a focus drive position determined based on the distance between the focus range and the identification code area; The identification code detection unit Detecting code information of the identification code in the second image information. Identification code detection device.

2. The distance map generation unit generating the distance map in which the focus ranges are set such that at least one of the focus ranges includes the distances of a plurality of the baggage areas; The imaging unit includes: The second image information including the plurality of identification codes is acquired within the focusing range set in the distance map.

2. The identification code detection device according to claim 1.

3. 1. An identification code detection method executed in an identification code detection device including an imaging unit that acquires image information including an image of a piece of luggage to which an identification code has been assigned, a distance measurement unit that measures a distance from the imaging unit to an area of ​​the piece of luggage in the image information, a distance map generation unit that generates a distance map indicating a relationship between a subject distance and a focusing range using a measurement result of the distance measurement unit, and an identification code detection unit that detects code information of the identification code using the image information acquired by the imaging unit in accordance with the focusing range in the distance map, acquiring, by the imaging unit, first image information including a package to which the identification code is assigned; a step in which the distance measurement unit extracts areas of the luggage in first image information including the luggage acquired by the imaging unit, and measures a distance from the imaging unit to each of the extracted areas of the luggage; a step of generating a distance map indicating a relationship between a subject distance and a focusing range by the distance map generating unit using a measurement result of the distance measuring unit; the identification code detection unit detects code information of the identification code by using second image information acquired by the imaging unit in accordance with the focusing range in the distance map; having The imaging unit includes: acquiring the second image information including at least one of the identification codes in the focus range including the distance of the baggage area according to a focus drive position determined based on the distance between the focus range and the identification code area; The identification code detection unit Detecting code information of the identification code in the second image information. Identification code detection method.

4. The distance map generation unit generating the distance map in which the focus ranges are set such that at least one of the focus ranges includes the distances of a plurality of the baggage areas; The imaging unit includes: The second image information including the plurality of identification codes is acquired within the focusing range set in the distance map.

4. The method of claim 3.

Images