System for reading two-dimensional code label, method of reading two-dimensional code label, and information processing system

Abstract

To provide a two-dimensional code label that utilizes an existing two-dimensional code in circulation while having an environmental detection region with its color varying in accordance with environmental change in a data region, and a reading system that accurately and simply determines the color of the environmental detection region.SOLUTION: A reading system for a two-dimensional code label in which an environmental detection region with a color varying in accordance with environmental change is provided, includes: an image acquisition device that acquires an image of the two-dimensional code label; and a data processing device that determines the change of the color of the environmental detection region from the acquired image. The data processing device includes: an actual measurement color determination unit for a reference region that acquires color information of the reference region where the color does not change from the image of the two-dimensional code label; an actual measurement color determination unit for the environmental detection region that acquires the color information of the environmental detection region from the image of the two-dimensional code label; a color information relation calculation unit that converts the color information of the reference region and the environmental detection region into a gray scale, and calculates a difference value between them; and a determination unit that determines the change of the color of the environmental detection region by comparing the difference value with a predetermined threshold value.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a two-dimensional code label reading system, a two-dimensional code label reading method, and an information processing system.

Background Art

[0002] Indicators for estimating the environment in which a two-dimensional code is exposed, and management systems that utilize these indicators are known. Patent Document 1 (Japanese Patent Application Laid-Open No. 2021-157213) describes a two-dimensional code composed of a cell made of a thermosensitive material and a cell made of the color during the discoloration of the thermosensitive material, and a mechanism for determining the degree of discoloration of the thermosensitive material by comparing the cell made of the thermosensitive material and the cell made of the color during the discoloration of the thermosensitive material.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the invention described in Patent Document 1, while the color tone of the thermosensitive material portion indicating the exposed environment can be obtained with high precision in terms of color density, it is necessary to provide a color for accurately determining by correcting or comparing the color of the thermosensitive material. As a result, even for a product with a two-dimensional code that is already generally printed in solid black, it is necessary to issue a unique two-dimensional code provided with a thermosensitive material portion indicating the environment in terms of color density. The coexistence of different two-dimensional codes has a problem of complicating the operation.

[0005] In addition, since a plurality of colors are provided in addition to the thermosensitive material, depending on the product, the two-dimensional code may be conspicuous, which may also impair the design.

[0006] In order to solve the above problems, the present invention provides a two-dimensional code label having an environment detection area that changes color according to environmental changes in a data area while utilizing an existing two-dimensional code that is circulated, and a reading system for accurately and simply determining the color of the environment detection area of the two-dimensional code label.

Means for Solving the Problems

[0007] The present invention for achieving the above object is a reading system for a two-dimensional code label provided with an environment detection area that changes color according to environmental changes, comprising an image acquisition device for acquiring an image of the two-dimensional code label, and a data processing device for determining a change in the color of the environment detection area from the acquired image. The data processing device includes an actually measured color determination unit for the reference area that acquires color information of the reference area that does not change color from the image of the two-dimensional code label, an actually measured color determination unit for the environment detection area that acquires color information of the environment detection area from the image of the two-dimensional code label, a calculation unit for the relationship of color information that converts the color information of the reference area and the environment detection area into grayscale and calculates the difference value between the two, and a determination unit for determining a change in the color of the environment detection area by comparing the difference value with a predetermined threshold value.

[0008] Other forms of the present invention will be described in the embodiments described later.

Effects of the Invention

[0009] According to the present invention, it is possible to provide a two-dimensional code label having an environment detection area that changes color according to environmental changes in a data area while utilizing an existing two-dimensional code that is circulated, and a reading system for accurately and simply determining the color of the environment detection area thereof.

Brief Description of the Drawings

[0010]

Figure 1A

Figure 1B

Figure 1C

Figure 2A

Figure 2B

Figure 2C

Figure 2D

Figure 2E

Figure 2F

Figure 3A

Figure 3B

Figure 3C

Figure 3D

Figure 3E

Figure 3F

Figure 4A

Figure 4B

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Best Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present invention will be described. However, the present invention is not limited to the following content and can be arbitrarily modified and implemented without significantly impairing the effects of the present invention. The present invention can be implemented by combining different embodiments. In the following description, the same members in different embodiments are denoted by the same reference numerals, and duplicate descriptions are omitted.

Embodiment

[0012] <Two-dimensional code> First, a label display object with a two-dimensional code arranged in Embodiment 1 of the present invention will be described. Although multiple two-dimensional codes can be considered for this reading system, hereinafter, a case using a QR code (registered trademark) as the two-dimensional code will be described as an example. The QR code is standardized by ISO / IEC 18004, etc. Note that, as the two-dimensional code, PDF417, DataMatrix, Maxicode, AztecCode, etc. can also be used under the condition that there is a fixed area.

[0013] FIG. 1A is a schematic diagram of a label display object 100 with a two-dimensional code 200 arranged according to this embodiment. The label display object 100 is composed of a two-dimensional code 200 and an environment detection area 600. The two-dimensional code 200 includes three finder patterns 300a, 300b, and 300c (positioning patterns) arranged at three corners of the two-dimensional code 200, cells 500 constituting a data area, and an alignment pattern 400 for correcting the positional deviation of the cells 500 caused by distortion.

[0014] The two-dimensional code 200 further includes an environment detection area 600 arranged so as to overlap with the data area composed of the cells 500. The environment detection area 600 is an area whose color changes due to environmental changes (for example, changes from black to red).

[0015] Here, the finder patterns 300a to 300c for position detection are also used as a reference area for obtaining the amount of color change in the environment detection area 600. This is because due to disturbances (external light noise) such as indoor lighting and external light, the observed amount of color change in the environment detection area 600 may be smaller (or larger) than the actual amount of color change. Therefore, simply observing the amount of color change in the environment detection area 600 alone may not be able to accurately obtain the amount of color change. By calculating the color difference component between the reference area, which is considered to have the same external light noise added, and the environment detection area (actually, as will be described later, the difference component of the values after gray-scale conversion of both), the added external light noise can be canceled and the accurate color change in the environment detection area 600 can be detected.

[0016] Therefore, the material applied to the environment detection area 600 is selected so that the color before discoloration is the same as or similar to the color of the area used as the reference area. Also, it is possible to make the color before color development in the environment detection area different from the color of the reference area. However, in that case, since the color development determination criteria are different, both the color of the area used as the reference area in advance and the color before color development in the environment detection area 600 are registered in the reading system 700 described later.

[0017] In this specification, when explaining the use of the finder patterns 300a, 300b, and 300c as reference areas, they will be described as the first reference area 301, the second reference area 302, and the third reference area 303, respectively.

[0018] In this way, by arranging all of the reference area (the first reference area 301, the second reference area 302, and the third reference area 303) and the environment detection area 600 within the two-dimensional code 200, in the reading of the two-dimensional code by the reading system 700 described later, the distortion of the two-dimensional code can be reduced compared to the case where they are arranged outside the two-dimensional code. Therefore, the two-dimensional code itself can be made smaller, and in addition, since the positions of the two-dimensional code, the reference area, and the environment detection area are close (because they are located inside), the reading speed can be increased.

[0019] In addition, the two-dimensional code is applicable as long as it has a pattern with a fixed position and a determined color inside, other than the QR code. For example, when using PDF417, the start pattern and stop pattern can be used; when using DataMatrix, the alignment pattern and clock pattern can be used; when using Maxicode or AztecCode, the central finder pattern can be placed as the reference area.

[0020] The label display item 100 can be used by being attached to other articles or the like in the form of a sticker. A sticker-type label is preferable in terms of ease of handling, installation, and cost, but it can also be in any form such as a tag or card type according to the product to be managed.

[0021] Note that the two-dimensional code 200 in Fig. 1A is, for example, a QR code of version 2 (25×25 cells). The cell configuration (version) of the QR code can be changed according to the content of the information to be input, but versions 2 or higher are preferable in that the alignment pattern 400 for distortion correction is arranged.

[0022] Also, the two-dimensional code 200 in Fig. 1A is, for example, a QR code with an error correction level of "H". The error correction level of the QR code can be lowered according to the amount of information and usage, but in order to prevent reading failures when the QR code is intentionally damaged or when stains, dirt, or damage occur during the logistics process, it is desirable to set the error correction level to "H" by arranging the environment detection area 600 inside the QR code.

[0023] The environment detection area 600 arranged inside the two-dimensional code 200 is not limited as long as it is a medium such as ink that changes color according to environmental changes, but it is preferably in the form of ink that can be printed on the two-dimensional code 200 in terms of the manufacturing process. Examples of the environment detection area 600 include cases where the results of detecting environmental conditions such as temperature, temperature history, humidity, light, gas concentration, vibration, etc., and the pH of liquids, various ion concentrations in liquids, various drug concentrations, various amino acid and protein concentrations, and the presence of viruses and bacteria are reflected as color changes.

[0024] In this embodiment, the RGB (Red, Green, Blue) model is adopted as the color model for explanation. In the RGB model, the colors that make up an image are represented by combinations of numerical values ranging from the darkest 0 to the brightest 255 for each of the three colors of R (red), G (green), and B (blue). Hereinafter, the RGB components are denoted by enclosing them in square brackets like [R, G, B]. For example, the color red is [255, 0, 0], the darkest black is [0, 0, 0], and the brightest white is [255, 255, 255]. Note that for the colors of the colored parts (for example, cells 500) that are not particularly mentioned regarding color within the two-dimensional code 200 of this embodiment, black or a color corresponding to black is used.

[0025] FIG. 1B is an enlarged view of the finder patterns 300a to 300c (the first reference area 301 to the third reference area 303) within the two-dimensional code 200. The finder patterns 300a to 300c are composed of a first finder pattern area 310, a second finder pattern area 320, and a third finder pattern area 330. The position of the two-dimensional code can be recognized by this finder pattern, enabling high-speed reading.

[0026] In this embodiment, the finder patterns 300a to 300c are also used as reference areas (the first reference area 301, the second reference area 302, and the third reference area 303). However, any of the first finder pattern area 310, the second finder pattern area 320, and the third finder pattern area 330 may be used as the reference area.

[0027] Also, as the finder pattern, it is necessary to retain the function of recognizing the position of the two-dimensional code. Therefore, the ratio of white (light color) cells to black (dark color) cells needs to be arranged as 1:1:3:1:1 from any position in the A direction, B direction, and C direction of the finder patterns 300a to 300c. However, any color scheme is possible as long as it is the said ratio.

[0028] In addition, the first finder pattern area 310, the second finder pattern area 320, and the third finder pattern area 330 as reference areas are not particularly limited as long as they can be read by a two-dimensional code reader. However, the colors used for the first finder pattern area 310 and the third finder pattern area 330 are preferably colors that are recognized in the same way as dark colors or colors with low brightness (e.g., black), and the color used for the second finder pattern area 320 is preferably a color that is recognized in the same way as light colors or colors with high brightness (e.g., white).

[0029] FIG. 1C is an enlarged view of the alignment pattern 400 within the two-dimensional code 200. The alignment pattern has a function of correcting the positional deviation of each cell caused by distortion. The alignment pattern is composed of a first alignment pattern area 410, a second alignment pattern area 420, and a third alignment pattern area 430.

[0030] Each of these alignment pattern areas can also be used as the aforementioned reference area. However, since it is necessary to maintain the function of correcting the positional deviation of the cells caused by distortion, it is not particularly limited as long as it can be read by a two-dimensional code reader. However, the colors used for the first alignment pattern area 410 and the third alignment pattern area 430 are preferably colors that are recognized in the same way as dark colors or colors with low brightness (e.g., black), and the color used for the second alignment pattern area 420 is preferably a color that is recognized in the same way as light colors or colors with high brightness (e.g., white).

[0031] Next, a configuration example of the environment detection area 600 within the two-dimensional code 200 is shown in FIGS. 2A to 2F.

[0032] FIG. 2A is the same as that shown in FIG. 1A, and is an example of the first label display object 101 before the environmental change and the second label display object 102 after the environmental change, in which the environmental detection area 600 is installed at the center inside the two-dimensional code 200, which is the basic form of the label display object. The color of the environmental detection area 600 changes from, for example, black to red according to the environmental change.

[0033] The third label display object 103 shown in FIG. 2B is an example in which an environment detection area 600 is installed at an arbitrary position that does not overlap with the finder pattern 300 and the alignment pattern 400 inside the two-dimensional code 200.

[0034] The fourth label display object 104 shown in FIG. 2C is an example in which an environment detection area 600 is installed at an arbitrary position outside the two-dimensional code 200.

[0035] The fifth label display object 105 shown in FIG. 2D is an example in which a first environment detection area 601 having a shape different from that of the environment detection area 600 is installed at an arbitrary position inside the two-dimensional code 200.

[0036] The sixth label display object 106 shown in FIG. 2E is an example in which a second environment detection area 602 having a shape different from that of the environment detection area 600 and having a hollow interior is installed at an arbitrary position inside the two-dimensional code 200.

[0037] The seventh label display object 107 shown in FIG. 2F is an example in which a third environment detection area 603 having an elongated shape from the inside to the outside of the two-dimensional code 200 is installed.

[0038] As shown in the configurations from FIG. 2A to FIG. 2F above, the shape and position of the environment detection area 600 can be arbitrarily arranged under the condition that the two-dimensional code can be read.

[0039] Next, another implementation method of the label display object having an environment detection area will be described. The above examples of the label display object are assumed to be newly created as a two-dimensional code label including an environment detection area. However, for an existing two-dimensional code label that does not have an environment detection area or is separately created, it is also possible to form a label display object having an environment detection area by adding a member having a separately prepared environment detection area.

[0040] Hereinafter, a specific method for installing the environment detection area 600 will be described with reference to FIGS. 3A to 3F.

[0041] The circular environment detection seal 110 shown in FIG. 3A is composed of an environment detection area 600 and a circular transparent film 610.

[0042] FIG. 3B is a cross-sectional view of FIG. 3A, and the circular environment detection seal 110 is installed in such a manner that the circular transparent film 610 covers the environment detection area 600. In FIG. 3B, for the purpose of explaining the structure, the environment detection area 600 and the circular transparent film 610 are shown separately, but in actuality, they are installed in contact with each other.

[0043] The circular transparent film 610 is not particularly limited as long as it is a transparent film that is transparent and difficult to permeate moisture. Representative general-purpose transparent films include PP (polypropylene), PET (polyethylene terephthalate), and PVC (polyvinyl chloride).

[0044] FIG. 3C shows a method of installing the circular environment detection seal 110 on an existing two-dimensional code 200, and it is installed by attaching the circular environment detection seal 110 to the surface of the two-dimensional code 200. At this time, a part of the pattern of the existing two-dimensional code 200 will be covered by the circular environment detection seal 110. However, if the covered area is within the upper limit that can be reproduced at its error correction level by the error correction function of the two-dimensional code 200 itself, it can be read without problem.

[0045] Also, the adhesive surface can be either the surface of the two-dimensional code 200 or the back surface of the circular environment detection seal 110. However, when the two-dimensional code 200 has already been installed on other products, etc., it is preferable that the circular environment detection seal 110 has an adhesive layer on its back surface.

[0046] The guided environment detection seal 120 shown in FIG. 3D is composed of an environment detection area 600 and a rectangular transparent film 620 with an alignment guide 630 installed thereon.

[0047] Figure 3E is a cross-sectional view of Figure 3D, and the guided environmental sensing seal 120 is installed in such a way that the rectangular transparent film 620 covers the environmental sensing area 600. In Figure 3E, for the purpose of explanation, the environmental sensing area 600 and the rectangular transparent film 620 are shown separated, but in reality, they are installed in contact. As the rectangular transparent film 620, a film of the same material as the circular transparent film 610 can be used.

[0048] Figure 3F shows the installation method of the guided environmental sensing seal 120 on the existing two-dimensional code 200, and it is installed by attaching the guided environmental sensing seal 120 to the surface of the two-dimensional code 200. At this time, the adhesive surface can be either the surface of the two-dimensional code 200 or the back surface of the round guided environmental sensing seal 120. However, when the two-dimensional code 200 has already been installed on other products, etc., it is preferable that the back surface of the guided environmental sensing seal 120 has an adhesive layer.

[0049] <Environmental sensing area> Next, the specifications of the environmental sensing area according to the embodiment of the present invention will be described. As the material used for the environmental sensing area 600, materials, inks, elements, etc. that change color in response to environmental changes are not particularly limited, but ink is preferable as an inexpensive and easily installable material.

[0050] Figures 4A and 4B show the color specifications of the environmental sensing area. The color determination in this embodiment is characterized in that the actually measured color data of the color of the acquired environmental sensing area can be used without correction (correction is also possible).

[0051] By using the gray scale value adopted in the color determination method described later (for example, the value converted using formulas such as [0.2989 * R + 0.5870 * G + 0.1140 * B] for the weighted average method or [0.21 * R + 0.72 * G + 0.07 * B] for the luminance method), the change in the color of the environmental sensing area is determined from the difference in the shade of the color between the reference area and the environmental sensing area.

[0052] Therefore, if the grayscale values are the same for the colors before and after color development in the environmental detection area, the color change cannot be determined. Thus, a color design with different vector directions in the RGB space is required. Desirably, if it is [0, 0, 0] (black) before color development and [255, 0, 0] (red) after color development, it is easy to obtain a difference in grayscale values, making it easy to ensure the determination accuracy.

[0053] <Reading System> Next, the reading system according to this embodiment will be described. FIG. 5 is a configuration diagram of a two-dimensional code reading system 700. The reading system 700 is used, for example, to read the two-dimensional code labels shown in FIGS. 1A, 2A to 2F, 3C, and 3F. The reading system 700 includes an image acquisition device 710 that acquires an image of the two-dimensional code, an input device 720, an output device 730, a data processing device 740, and a storage device 760, and can transmit and receive various data and signals through a signal line 780.

[0054] The image acquisition device 710 is an imaging device such as a camera and acquires an image of the label display object. If necessary, in addition to the label display object, it is also possible to acquire images of storage products, information related to the products, and the surrounding environment. When an image of the two-dimensional code is captured, it is stored in the image data storage unit 761 in the storage device 760. Also, the image acquisition device 710 may be a device having a camera such as a smartphone or a tablet, and in that case, it is connected to the reading system 700 by wire or wirelessly.

[0055] The input device 720 is a part that receives an operator's instruction and is composed of buttons, a touch panel, etc.

[0056] The output device 730 is a device that outputs (presents) instruction information, a read image, a read result, a determination result, etc. to the operator and is composed of a display and a communication device. This configuration is standard, and any one or all of the image acquisition device 710, the input device 720, and the output device 730 may be connected to the outside of the reading system 700.

[0057] <Memory device> The memory device 760 is a part for storing various data and is composed of the following memory parts. It exists.

[0058] The image data storage unit 761 is a part for storing a captured image including a two-dimensional code input from the image acquisition device 710.

[0059] The two-dimensional code position data storage unit 762 is a part for storing data representing the reference position of the two-dimensional code, which is recognized by the two-dimensional code position recognition unit 742 described later, from the image (captured image) stored in the image data storage unit 761.

[0060] The two-dimensional code data storage unit 763 is a part for storing the encoded character string data (data body), which is recognized by the two-dimensional code recognition unit 743 described later, from the image stored in the image data storage unit 761.

[0061] The position data storage unit 764 of the reference area is a part for pre-storing the relative position information of the reference area in the two-dimensional code (information indicating where the reference area is in the two-dimensional code).

[0062] The position data storage unit 765 of the environment detection area is a part for pre-storing the relative position information of the environment detection area in the two-dimensional code (information indicating where the environment detection area is in the two-dimensional code).

[0063] The measured color data storage unit 766 of the reference area is a part for storing the color information (RGB value, etc.) extracted by actually measuring the color of the reference area specified by the position data storage unit 764 of the reference area. It may also be possible to measure and register the color of the reference area in advance using other measuring devices, etc. When the reference area of the two-dimensional code is black, it is stored as [0,0,0] indicating black, and when the reference area of the two-dimensional code is white, it is stored as [255,255,255] indicating white.

[0064] The measured color data storage unit 767 of the environment detection area stores color information (such as RGB values) extracted by actually measuring the color of the environment detection area specified by the position data storage unit 765 of the environment detection area.

[0065] The conversion data storage unit 768 of the reference area stores the shade information of the color obtained by grayscale conversion of the color information (such as RGB values) stored in the measured color data storage unit 766 of the reference area.

[0066] The conversion data storage unit 769 of the environment detection area stores the value obtained by grayscale conversion of the color information (such as RGB values) stored in the measured color data storage unit 767 of the environment detection area.

[0067] The recording unit 770 of the relationship of color information records the difference in the shade information of the color between the conversion data storage unit 768 of the reference area and the conversion data storage unit 769 of the environment detection area calculated by the calculation unit 748 of the relationship of color information described later.

[0068] The determination criterion data storage unit 773 is based on the color information of the reference area (raw color information without noise such as external light), the color information before and after color development of materials, inks, etc. used in the environment detection area, and the difference in grayscale values between both the environment detection area and the reference area. For example, it stores the color information (grayscale value) of the threshold value that serves as a determination criterion for determining the presence or absence of temperature deviation, and the relationship between the amount of environmental change and the color information of the environment detection area (for example, information indicating what the ambient temperature corresponding to a certain color in the environment detection area is).

[0069] The determination result storage unit 771 stores the determination result (such as "NG" / "OK" or the marks used for the screen display described later) determined by the determination unit 749 described later.

[0070] The read data storage unit 772 is a part that stores parts other than the data processed by the data processing device 740 described later. Generally, in grasping the environmental change situation of a product, it is desirable to have information on when, where, and what happened. Therefore, in addition to the information related to the product stored in the two-dimensional code data storage unit 763 and the data such as temperature deviation from the environmental detection area stored in the determination result storage unit 771, it is preferable to store the date and time of the reading process, location information, the number of the reading device (for identifying the operator), the weather in cooperation with web information, etc. Note that as long as the same reading device is used, the number of the reading device does not change, so this may be added during the data output described later.

[0071] <Data processing device> The data processing device 740 processes the data input from the image acquisition device 710, the input device 720, and the data stored in the storage device 760, and outputs the result to the output device 730 or stores it in the storage device 760. It is composed of the following processing units. Note that the data processing device 740 is realized by, for example, an arithmetic processing unit (CPU), etc., and the following processing units are programs that realize them, and can be realized by the CPU executing those programs. Also, each processing unit may be realized by dedicated hardware.

[0072] The input control unit 741 is a part that classifies the data input from the image acquisition device 710 or the input device 720 into commands, data, etc., and performs the process of transferring them to each part of the storage device 760 and the data processing device 740. In particular, as the main data, the image data of the two-dimensional code including the reference area and the environmental detection area is transferred to the image data storage unit 761.

[0073] The two-dimensional code position recognition unit 742 is a part that recognizes the position where the code is included from the image data stored in the image data storage unit 761, and stores the recognition result in the two-dimensional code position data storage unit 762. The image data is usually composed of several hundred to several thousand dots both vertically and horizontally, and there is no data in the image itself indicating which part is the code.

[0074] Therefore, the color data of each dot is analyzed to recognize which part of the image data corresponds to the reference position of the code. The display form and number of the reference position vary depending on the code standard, but are not limited to those standards. Furthermore, even if there are a plurality of two-dimensional codes in the image stored in the image data storage unit 761, the positions of the plurality of two-dimensional codes can be recognized.

[0075] The two-dimensional code recognition unit 743 uses the position data stored in the two-dimensional code position data storage unit 762 to recognize the data body of the character string recorded by the code in the data area (cell 500) from the image stored in the image data storage unit 761, and stores it in the two-dimensional code data storage unit 763.

[0076] The positioning unit 744 of the reference area detects the coordinates (X, Y) of the four corners of the two-dimensional code from the position data stored in the two-dimensional code position data storage unit 762 and the acquired image including the two-dimensional code stored in the image data storage unit 761, and based on the detected coordinates of the four corners and the position information previously stored in the position data storage unit 764 of the reference area, determines the position of the reference area (the first reference area 301 to the third reference area 303).

[0077] The positioning unit 745 of the environment detection area detects the coordinates (X, Y) of the four corners of the two-dimensional code from the position data stored in the two-dimensional code position data storage unit 762 and the information stored in the two-dimensional code data storage unit 763, and based on the detected coordinates of the four corners and the position information previously stored in the position data storage unit 765 of the environment detection area, determines the position of the environment detection area 600.

[0078] The measured color determination unit 746 of the reference area determines the RGB values of the reference area in the acquired image from the image stored in the image data storage unit 761 and the position information of the reference area (the first reference area 301 to the third reference area 304) determined by the positioning unit 744 of the reference area.

[0079] The measured color determination unit 747 of the environment detection area determines the RGB values of the environment detection area 600 in the acquired image from the image stored in the image data storage unit 761 and the position information of the environment detection area 600 determined by the positioning unit 745 of the environment detection area.

[0080] The calculation unit 748 and the determination unit 749 of the color information relationship determine the change in the color of the environment detection area. Hereinafter, the specific method will be described with reference to FIG. 6.

[0081] The calculation unit 748 of the color information relationship converts the RGB values of the color of the reference area stored in the measured color data storage unit 766 of the reference area into grayscale, stores them in the conversion data storage unit 768 of the reference area, and converts the RGB values of the color of the environment detection area stored in the measured color data storage unit 767 of the environment detection area into grayscale, and stores them in the conversion data storage unit 769 of the environment detection area.

[0082] Subsequently, the calculation unit 748 of the color information relationship compares the grayscale information of the colors converted and stored in the conversion data storage unit 768 of the reference area and the conversion data storage unit 769 of the environment detection area, and records the difference information in the recording unit 770 of the color information relationship.

[0083] Then, the determination unit 749 determines the degree of change in the color of the environment detection area by comparing the difference information recorded in the recording unit 770 of the color information relationship with the threshold value recorded in the determination reference data storage unit 773, and stores the determination result in the determination result storage unit 771.

[0084] For example, when the colors before and after the color development of the environment detection area are black and red respectively, and the color of the reference area is black, when calculating the grayscale value using the formula of the aforementioned weighted average method, the grayscale values before and after the color development of the environment detection area are "0.00" and "76.22" respectively, and the grayscale value of the reference area (black color) is also "0.00", so the difference in the grayscale values between the reference area and the environment detection area is "before color development: 0.00", "after color development: -76.22".

[0085] Therefore, as the color development characteristics of the material used in the environmental detection area, if it is such that it starts to develop color (changes from black to red) only when the target temperature is exceeded, the difference value of the gray scale value after color development (here, "-76.22") can be directly used as the threshold value. In the case of color development characteristics where the color changes gradually from black to red according to the temperature, the difference value of the gray scale value corresponding to the target temperature can be used. For example, if the threshold condition is "-40 or more", the color development amount is within the allowable range and is "OK", and if it is less than "-40", the color development amount exceeds the allowable range and is "NG", and it can be determined in this way.

[0086] Also, the color of the reference area may be a color other than black. For example, if it is green [0, 255, 0], the gray scale value will be "149.69". Similarly, the difference in the gray scale values between the reference area and the environmental detection area is "before color development: 149.69" and "after color development: 73.47". Therefore, it can be determined by stipulating the threshold condition as, for example, "OK if it is 110 or more, NG if it is less than 110".

[0087] Note that in this embodiment, three reference areas, namely the first reference area 301, the second reference area 302, and the third reference area 303, are set. However, it may be compared with any one of them, or it may be compared with the average value of the gray scale values of these three. Alternatively, comparison may be performed for each of these three, and if the results are different, the final comparison result may be obtained by majority vote processing.

[0088] Also, in the above determination process, in addition to the threshold value, color information of the reference area, color information before and after color development of the environmental detection area, determination criteria, methods, etc. are required. All the information required for these determination processes is also stored in advance in the determination criterion data storage unit 773.

[0089] Returning to FIG. 5, the output control unit 750 controls the output of the information processed by the data processing device 740 to the output device 730. Specifically, it is the part that outputs information such as product information associated with the data body stored in the two-dimensional code data storage unit 763, information on the presence or absence of temperature deviation determined from the color information of the environment detection area stored in the determination result storage unit 771, or information stored in the read data storage unit 772 to the output device 730.

[0090] When the output destination is a screen or the like, it is preferable that the result be output each time a reading operation is performed. Also at this time, it is preferable to output the determination result stored in the determination result storage unit 771 of the environment detection area. When the output destination is a communication destination or the like, the output process may be performed each time a reading operation is performed, or it may be processed by collecting data several times or collecting it at predetermined time intervals.

[0091] <Processing Flow of the Reading System> FIG. 7 is a flowchart for explaining the processing flow of the reading system 700 according to the present embodiment. Hereinafter, in conjunction with FIG. 5, the processing flow (steps S800 to S810) will be described.

[0092] First, image data including a two-dimensional code having a reference area and an environment detection area is input from the image acquisition device 710. The input data is stored in the image data storage unit 761 (step S801).

[0093] Next, the two-dimensional code position recognition unit 742 recognizes the reference position of the two-dimensional code from the image recorded in the image data storage unit 761, and the recognized reference position is recorded in the two-dimensional code position data storage unit 762. The two-dimensional code recognition unit 743 uses the image recorded in the image data storage unit 761 and the position data recorded in the two-dimensional code position data storage unit 762 to identify the data area, decode the code represented by the data area, and extract the data body (character string data, etc.) of the two-dimensional code (step S802).

[0094] Next, the reference area positioning unit 744 and the environment detection area positioning unit 745 use the position data stored in the two-dimensional code position data storage unit 762 to detect the coordinates (X, Y) of the four corners of the two-dimensional code in the acquired image recorded in the image data storage unit 761, and use the position information of the reference area and the environment detection area pre-stored in the reference area position data storage unit 764 and the environment detection area position data storage unit 765 to identify the positions of the reference area and the environment detection area in the acquired image. (Step S803) Next, the measured color determination unit 746 for the reference area and the measured color determination unit 747 for the environment detection area acquire color information for the respective reference areas and the environment detection area from the acquired image based on the position information determined by the reference area positioning unit 744 and the environment detection area positioning unit 745. Here, the color information is, for example, an RGB value. The acquired color information is transferred to the measured color data storage unit 766 for the reference area and the measured color data storage unit 767 for the environment detection area, and the color information of the reference area and the environment detection area is stored respectively (Step S804).

[0095] At this time, when "white skip" occurs where the reference area or the environment detection area cannot be seen in the image due to reflected light when the illumination is strong, or when "extremely large illuminance differences" occur between multiple reference areas or between the reference area and the environment detection area, or when the two-dimensional code image is too small or too large, or when the shooting angle at the time of image acquisition is an acute angle and the two-dimensional code image is excessively distorted, etc., check whether there are any problems with the acquired image. If there is a problem, return to Step S801 and perform image reading again (Step S805).

[0096] In Step S805, if the measured color data of the reference area and the environment detection area can be acquired without problems, next, color analysis of the environment detection area is performed. The details are as described above. The calculation unit 748 for the relationship of the color information calculates the difference value between the grayscale color information of the reference area and the grayscale color information of the environment detection area by comparing them (Step S806).

[0097] Subsequently, the determination unit 749 determines the presence or absence of color development (color change) in the environment detection area, or the magnitude of the color development amount, based on whether or not the above-described difference value exceeds a preset threshold value. Then, thereby, the data processing device 740 can determine whether or not the ambient environment of the two-dimensional code exceeds a preset standard (such as the upper limit temperature). If the relationship between the amount of environmental change and the amount of color change in the environment detection area is known in advance, the ambient environment information of the two-dimensional code may be directly calculated from the amount of color change in the environment detection area (step S807).

[0098] The result determined by the above-described determination unit 749 is stored in the determination result storage unit 771. At the same time, the date and time when the reading process was performed, the position information, the number of the reading device (for identifying the operator), the weather in cooperation with the Web information, etc. are stored in the read data storage unit 772 (step S808).

[0099] Then, information such as product information associated with the character string stored in the two-dimensional code data storage unit 763, the presence or absence of temperature deviation determined from the color information of the environment detection area stored in the determination result storage unit 771, or information stored in the read data storage unit 772 is output to the output device 730. When a smartphone is used as the hardware of the reading system, the output device 730 outputs the reading result to the screen of the smartphone or the like (step S809).

[0100] FIG. 8 is a display example of the output result of the reading system 700 according to the present embodiment, and is an output display of the reading result on the display 901 of the smartphone 900. When there are a plurality of label display objects having two-dimensional codes to be read, they can be simultaneously acquired as images and analyzed in parallel for color changes and the like in their environment detection areas, and the results can be arranged and displayed on the display 901.

[0101] In addition, the result determined by step S807 in the flowchart of FIG. 7 is indicated by an "X mark" 902a meaning NG with temperature deviation in AR (Augmented Reality) on the display 901 or a "check mark" 902b meaning OK without temperature deviation in AR, enabling the operator to easily recognize the result.

[0102] Moreover, the smartphone 900 can be used not only as an output device for the determination result but also as an image acquisition device 710. In this case, after reading all the two-dimensional codes is completed, by touching the scan end button 903, the determination results for all the read two-dimensional codes can be viewed on the smartphone screen 901 or sent to a specified address.

[0103] Also, it is possible to configure the reading system 700 itself in this embodiment with a general-purpose smartphone 900 having a camera, a screen, and a communication device.

[0104] As described above, according to this embodiment, it is possible to provide a two-dimensional code label that utilizes an existing two-dimensional code circulated while having an environment detection area that changes color according to environmental changes in the data area, and a reading system for accurately and simply determining the color of the environment detection area of the two-dimensional code label. Furthermore, by using the two-dimensional code label that utilizes an existing two-dimensional code of the present invention and the two-dimensional code label, it becomes unnecessary to issue a unique two-dimensional code provided with a temperature indicating material portion that indicates the environment by color density, and it can also contribute to improving the design of the product.

Example

[0105] FIG. 9 is a diagram for explaining the outline of an information processing system 1000 that utilizes the reading system 700 as Example 2 in the present invention. The information processing system 1000 includes an information processing device 1100 and a smartphone 900 as the reading system 700, and the smartphone 900 is arranged at various locations in the product distribution process.

[0106] In the example of FIG. 9, the smartphone 900 is arranged at each of the collection point, export warehouse, customs warehouse, import warehouse, and consumer. The information processing apparatus 1100 that can determine the color change of the environment detection area included in the two-dimensional code is composed of an input unit 1110, a storage unit 1120, an information processing unit 1130, and an output unit 1140. The input unit 1110 is a part that inputs the information output from the smartphone 900. The storage unit 1120 is a part that accumulates and stores the information output from the smartphone 900. The storage unit 1120 is a non-temporary or temporary recording medium that stores various programs and data. Examples of the storage unit 1120 include ROM (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disk Drive), and flash memory.

[0107] The information processing unit 1130 is a part that organizes and analyzes the information stored in the storage unit 1120, and is realized by a CPU (Central Processing Unit) or the like. For example, by statistically analyzing the information from the smartphone 900 including the reading system 700, it is possible to know at what time, by what operator, and where the temperature deviation occurs, which can lead to business improvement.

[0108] The output unit 1140 is a part that transmits the information processed by the information processing unit 1130 to the place where the information is required. When the information processing apparatus 1100 is a device having a display, the processing result can be output to the display.

[0109] The following shows an example of applying the information processing system 1000 to the distribution from production to consumers. The information processing system 1000 enables a consumer who has received a product to grasp physical quantities such as the environmental temperature in the distribution process of a product such as wine. The two-dimensional code 200 is displayed, for example, on a label attached to the wine or on a box containing the wine if the product is wine.

[0110] The information processing system 1000 includes a smartphone 900 as a two-dimensional code 200 reading system 700 and an information processing apparatus 1100. The smartphone 900 (input / output device) uploads the information acquired and analyzed as the two-dimensional code 200 reading system 700 to the information processing apparatus 1100 during product distribution. FIG. 9 shows an example of the smartphone 900 (input / output device) capable of input and output with one terminal, but a dedicated input device and output device such as an image pickup device can also be used.

[0111] At the time of product collection, the person in charge of product transportation (for example, a driver) uses the smartphone 900 (input / output device) to image the two-dimensional code 200 displayed on the product. Thereby, the input information including the image of the two-dimensional code 200 is uploaded to the information processing apparatus 1100. The presence or absence of temperature deviation at the time of reading is determined by the two-dimensional code 200 and the reading system 700.

[0112] At this time, in addition to the product identification information (article identification information), the imaging time, the imaging position, etc. are also uploaded as input information. The article identification information is, for example, a GTIN (Global Trade Item Number), an EAN (European Article Number) code, or a U.P.C. (Universal Product Code). It is preferable that information regarding the article such as the manufacturer, the seller, the manufacturing date, the expiration date, etc. is associated with these article identification information.

[0113] Similarly, each person in charge at the export warehouse, the customs warehouse, and the import warehouse uses the smartphone 900 (input / output device) to image the two-dimensional code 200 displayed on the product. Thereby, the respective input information is uploaded to the information processing apparatus 1100. Then, the information processing apparatus 1100 determines the presence or absence of temperature deviation at the time of reading based on the uploaded input information.

[0114] On the other hand, the consumer (user) can access the URL (web) stored in the two-dimensional code 200 by reading the two-dimensional code 200 of the product using the smartphone 900 (input / output device). The reading can be performed, for example, using a dedicated application operating on the smartphone 900 (input / output device).

[0115] In this embodiment, the smartphone 900 is assumed to include the reading system 700, but it is not limited thereto. The smartphone 900 may be a dedicated reader as an input device and a personal computer or the like as an output device. As described above, according to this embodiment, it is possible to trace the environmental conditions in which the distributed product was placed during the distribution process from production to the consumer. When a defect is found in the distributed product at the stage where it reaches the consumer, it is possible to search for the cause, such as where the problem occurred in the distribution process.

Explanation of Signs

[0116] 100: Label display object 200: Two-dimensional code 300a: Finder pattern (positioning pattern) 300b: Finder pattern (positioning pattern) 300c: Finder pattern (positioning pattern) 301: First reference area 302: Second reference area 303: Third reference area 310: First finder pattern area 320: Second finder pattern area 330: Third finder pattern area 400: Alignment pattern 410: First alignment pattern area 420: Second alignment pattern area 430: Third alignment pattern area 500: Cell (data area) 600: Environment detection area 601: First environment detection area 602: Second environmental detection area 603: Third environmental detection area 700: Reading system (two-dimensional code reading system) 710: Image acquisition device 720: Input device 730: Output device 740: Data processing device 741: Input control unit 742: Two-dimensional code position recognition unit 743: Two-dimensional code recognition unit 744: Reference area positioning unit 745: Environmental detection area positioning unit 746: Measured color determination unit for reference area 747: Measured color determination unit for environmental detection area 748: Calculation unit for relationship of color information 749: Judgment unit 750: Output control unit 760: Storage device 761: Image data storage unit 762: Two-dimensional code position data storage unit 763: Two-dimensional code data storage unit 764: Reference area position data storage unit 765: Environmental detection area position data storage unit 766: Measured color data storage unit for reference area 767: Measured color data storage unit for environmental detection area 768: Conversion data storage unit for reference area 769: Conversion data storage unit for environmental detection area 770: Recording unit for relationship of color information 771: Judgment result storage unit 772: Read data storage unit 773: Judgment criterion data storage unit 780: Signal line 900: Smartphone (portable terminal) 1000: Information processing system 1100: Information processing device 1110: Input unit 1120: Storage unit 1130: Information processing unit 1140: Output unit

Claims

1. A two-dimensional code label reading system provided with an environment detection area that changes color according to environmental changes, comprising an image acquisition device that acquires an image of the two-dimensional code label, and a data processing device that determines a color change in the environment detection area from the acquired image, wherein the data processing device has a measured color determination unit for the reference area that acquires color information of a reference area that does not change color from the image of the two-dimensional code label, a measured color determination unit for the environment detection area that acquires color information of the environment detection area from the image of the two-dimensional code label, a calculation unit for the relationship of color information that converts the color information of the reference area and the environment detection area into grayscale and calculates a difference value between the two, and a determination unit that determines a color change in the environment detection area by comparing the difference value with a predetermined threshold value, characterized by having the above, a two-dimensional code label reading system.

2. The two-dimensional code label reading system according to claim 1, comprising a reference area position data storage unit that stores relative position information of the reference area in the two-dimensional code label, and an environment detection area position data storage unit that stores relative position information of the environment detection area in the two-dimensional code label, characterized by having a storage device including the above, a two-dimensional code label reading system.

3. The two-dimensional code label reading system according to claim 2, characterized by using a finder pattern for detecting the position of the two-dimensional code label as the reference area, a two-dimensional code label reading system.

4. The two-dimensional code label reading system according to claim 2, characterized by using an alignment pattern for correcting a positional shift of a data area caused by distortion as the reference area, a two-dimensional code label reading system.

5. The two-dimensional code label reading system according to claim 3 or 4, comprising an input device that receives an operator's instruction, and an output device that presents a determination result to the operator, characterized by having the above, a two-dimensional code label reading system.

6. The two-dimensional code label reading system according to claim 5, wherein the image acquisition device acquires an image including a plurality of the two-dimensional code labels, The two-dimensional code label reading system is characterized in that the data processing device concurrently performs processing for recognizing color changes in the environment detection regions in a plurality of the two-dimensional code labels.

7. The two-dimensional code label reading system according to claim 1, wherein the environment detection region of the two-dimensional code label is formed of ink that changes color according to an environmental change.

8. The two-dimensional code label reading system according to claim 1, wherein the two-dimensional code label is formed by adding a member having the environment detection region to an existing two-dimensional code label.

9. A method for reading a two-dimensional code label provided with an environment detection region that changes color according to an environmental change, acquiring an image of the two-dimensional code label, acquiring color information of a reference region that does not change color from the image of the two-dimensional code label, acquiring color information of the environment detection region from the image of the two-dimensional code label, converting the color information of the reference region and the environment detection region to grayscale and calculating a difference value between the two, determining a color change in the environment detection region by comparing the difference value with a predetermined threshold value. This is a method for reading a two-dimensional code label.

10. A smartphone as the two-dimensional code label reading system according to claim 1 is arranged at a plurality of locations in the distribution process of a predetermined product, and the plurality of smartphones detect the color change in the environment detection region of the two-dimensional code label of the distributed product in each respective distribution process, thereby determining the presence or absence of an environmental change in each distribution process of the distributed product, and an information processing system characterized by having an information processing device that collects information on the presence or absence of an environmental change in each distribution process of the distributed product by the plurality of smartphones and presents it to the user.

Images