Determination system, color determination method, program, data processing system, terminal, and labeled object

Abstract

To provide a determination system for highly accurately and easily determining the color of the environmental detection area of a code label utilizing an existing two-dimension code or bar code to be distributed without providing a reference area or the like for correcting the fluctuation of a color tone due to installation environments.SOLUTION: A data processing device that acquires color information of the color of the determination target and determines the color of the determination target from the color information, wherein the data processing device includes a color determination unit that calculates a vector length of the color information that is a feature amount related to brightness of the color information and a vector direction of the color information that is a feature amount related to saturation in a color space, and determines the color of the determination target by comparing the vector length and the vector direction with the determination line.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a determination system for determining the color of a predetermined area, a color determination method, a program, an information processing system, a terminal device, and a label display object. [Background technology]

[0002]

[0003] Indicators that estimate the environment to which a two-dimensional code is exposed, and management systems that utilize these indicators, are known. Patent Document 1 (JP 2024-10275 A) describes a two-dimensional code determination system that includes an image capture device that captures an image of a two-dimensional code having a positioning pattern colored with a reference color used to determine the amount of color change depending on the shooting environment, a data processing device, and a storage device that stores color information of the reference color and position information of the reference color and ink. The data processing device detects the coordinates of the four corners of the two-dimensional code from the image of the two-dimensional code to identify the position of an area where color information is to be detected, and detects the color information of the area, which includes a reference color area and an ink area. The reference color area and the ink area are determined based on the position information of the reference color stored in the storage device and the color information and position of the area, and the color information of the ink area is corrected using the relationship between the color information of the reference color stored in the storage device and the color information of the detected reference color area. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-10275 Summary of the Invention [Problem to be solved by the invention]

[0004] The invention described in Patent Document 1 improved the accuracy and reading speed of acquiring color information from the environment detection area, which changes color in response to environmental changes. However, in order to accurately determine the color of the thermosensitive material, it was necessary to set a standard color (reference color) to correct for differences in the read color information caused by differences in the imaging conditions. As a result, even for products that already have a two-dimensional code that is generally printed in solid black, it was necessary to issue a unique two-dimensional code with a reference color area outside the thermosensitive material area. The coexistence of different two-dimensional codes complicated operation and posed issues such as difficulty in applying it to barcodes printed in solid black.

[0005] In order to solve the above-mentioned problems, the present invention aims to provide a determination system that has an environmental detection area in the data area that changes color in response to environmental changes, and that can determine the color reading information of the environmental detection area of ​​code labels that utilize existing 2D codes or barcodes in circulation, without providing a reference color area or the like for correcting the information in response to the imaging conditions. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the present invention provides a judgment system for judging the color of an object to be judged, which includes a storage device that stores a judgment line that uses the lightness and saturation of the color of the object to be judged as parameters, and a data processing device that acquires color information of the color of the object to be judged and judges the color of the object to be judged from the color information, and the data processing device includes a color judgment unit that calculates the vector length of the color information, which is a feature related to the lightness of the color information in a color space, and the vector direction of the color information, which is a feature related to the saturation of the color information, and compares them with the judgment line to judge the color of the object to be judged.

[0007] Other aspects of the present invention will be described in the following embodiments. [Effects of the Invention]

[0008] According to the present invention, a determination system can be provided that has an environmental detection area in the data area that changes color in response to environmental changes, and can determine the color of the environmental detection area of ​​a code label that utilizes existing 2D codes or barcodes in circulation, without providing a reference area or the like to correct differences in color information caused by differences in shooting conditions. Problems, configurations, and effects other than those described above will become apparent from the following description of the preferred embodiments of the invention. [Brief explanation of the drawings]

[0009] [Figure 1A] 1 is a schematic diagram of a label display item according to Example 1. FIG. [Figure 1B] FIG. 2 is a schematic diagram of a finder pattern according to the first embodiment. [Figure 1C] FIG. 2 is a schematic diagram of an alignment pattern according to the first embodiment. [Figure 2A] 1A and 1B are schematic diagrams of the label product according to Example 1 before and after environmental changes. [Figure 2B] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2C] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2D] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2E] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2F] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2G] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2H] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2I] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2J] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2K] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2L] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2M] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2N] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 2O] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 3A] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 3B] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 3C] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 3D] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 3E] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 3F] 1 shows an example of setting up an environmental change area according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an RGB space of colors in an environment change area according to the first embodiment. [Figure 5] FIG. 3 is a flowchart showing an outline of a color judgment process according to the first embodiment. [Figure 6A] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 6B] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 6C] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 7] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 8A] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 8B] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 8C] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 9A] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 9B]10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 9C] 10A and 10B are diagrams illustrating a method for determining the color of an environment change area according to the first embodiment. [Figure 10] FIG. 1 is a configuration diagram of a determination system according to a first embodiment. [Figure 11] FIG. 2 is a process flow diagram of the determination system according to the first embodiment. [Figure 12] 10 is a display example of an output result of the determination system according to the first embodiment. [Figure 13] 10 is a display example of input information of the determination system according to the first embodiment. [Figure 14] FIG. 10 is a diagram illustrating an outline of an information processing system that utilizes a determination system according to a second embodiment. [Figure 15A] FIG. 10 is a diagram showing experimental results of the determination system according to the third embodiment. [Figure 15B] FIG. 10 is a diagram showing experimental results of the determination system according to the third embodiment. [Figure 15C] FIG. 10 is a diagram showing experimental results of the determination system according to the third embodiment. [Figure 15D] FIG. 10 is a diagram showing experimental results of the determination system according to the third embodiment. [Figure 16] FIG. 10 is a diagram showing experimental results of the determination system according to the fourth embodiment. [Figure 17A] FIG. 1 is a diagram showing an example of a label display item according to Example 1. [Figure 17B] FIG. 1 is a diagram showing an example of a label display item according to Example 1. [Figure 17C] FIG. 1 is a diagram showing an example of a label display item according to Example 1. DETAILED DESCRIPTION OF THE INVENTION

[0010] Examples of the present invention will be described below, but the present invention is not limited to the following content and can be modified as desired within the scope that does not significantly impair the effects of the present invention. The present invention can be implemented by combining different embodiments. In the following description, the same components in different examples are given the same reference numerals, and redundant explanations will be omitted.

[0011] In the following description, when describing processing by a program, the program, functional units, etc. may be described as the main components, but the main hardware components are a processor or an information processing device (computer) configured to include the processor, etc. The information processing device executes processing according to a program read into memory using resources such as memory and a communication interface as appropriate. The processor is not limited to a CPU, and a GPU (Graphical Processing Unit) or the like may also be used. Furthermore, processing to realize a function is not limited to software program processing, and can also be implemented by a dedicated circuit. The dedicated circuit may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or the like. [Example]

[0012] <Two-dimensional code> First, a label object on which a two-dimensional code is arranged in Example 1 of the present invention will be described. There are multiple possible two-dimensional codes that can be applied to this determination system, but the following description will be given using a QR Code (registered trademark) as an example of a two-dimensional code. QR Code is standardized by ISO / IEC18004 and the like. Note that PDF417, DataMatrix, Maxicode, AztecCode, and the like can also be used as two-dimensional codes, provided that they have a fixed area.

[0013] 1A is a schematic diagram of a label item 100 on which a two-dimensional code 200 according to this embodiment is arranged. The label item 100 is composed of the two-dimensional code 200 and an environment detection area 600. The two-dimensional code 200 includes three finder patterns 300a, 300b, and 300c (positioning patterns) for position detection arranged at three corners of the two-dimensional code 200, cells 500 that constitute the data area, and an alignment pattern 400 that corrects misalignment of the cells 500 caused by distortion.

[0014] The two-dimensional code 200 further includes an environment detection area 600 that is arranged so as to overlap with the data area made up of the cells 500. The environment detection area 600 is an area that changes color (for example, from black to red) depending on the environmental change.

[0015] Note that two-dimensional codes other than QR codes can also be used as long as they have a pattern with a fixed position and a predetermined color within them. For example, when PDF417 is used, a start pattern or stop pattern can be placed as the reference area, when DataMatrix is ​​used, an alignment pattern or clock pattern can be placed as the reference area, and when Maxicode or AztecCode is used, a central finder pattern can be placed as the reference area.

[0016] The label 100 is in the form of a sticker and can be attached to other items, etc. A sticker-type label is preferable in terms of ease of handling and installation and cost, but it can also be in any form, such as a tag or card, depending on the product to be managed.

[0017] 1A is, for example, a version 2 (25×25 cells) QR code. The cell configuration (version) of the QR code can be changed depending on the content of the information to be input, but version 2 or higher is preferred because it includes an alignment pattern 400 for distortion correction.

[0018] 1A is, for example, a QR code with an error correction level of "H." The error correction level of a QR code can be lowered depending on the amount of information and the application, but it is desirable to set the error correction level to "H" in order to prevent reading errors when the QR code is intentionally missing or when it becomes stained, dirty, or damaged during logistics by arranging an environment detection area 600 within the QR code.

[0019] The environmental detection area 600 disposed within the two-dimensional code 200 is not limited to a medium such as ink that changes color in response to environmental changes, but from a manufacturing process perspective, it is preferable that the medium be in the form of ink that can be printed on the two-dimensional code 200. Examples of the environmental detection area 600 include those that reflect, as color changes, the results of detecting environmental conditions such as temperature, temperature history, humidity, light, gas concentration, and vibration, as well as the pH of a liquid, the concentrations of various ions in a liquid, the concentrations of various pharmaceuticals, the concentrations of various amino acids and proteins, and the presence of viruses and bacteria. Furthermore, the information detected by these environmental detection areas 600 may be calculated as the amount of environmental change.

[0020] In this embodiment, the RGB (Red, Green, Blue) model is used as the color model for explanation. In the RGB model, the colors that make up an image are expressed as a combination of values ​​ranging from 0 (the darkest) to 255 (the brightest) for each of the three colors R (red), G (green), and B (blue). Hereinafter, RGB components are expressed in square brackets as [R, G, B], e.g., red [255, 0, 0], darkest black [0, 0, 0], and brightest white [255, 255, 255]. Note that in the two-dimensional code 200 of this embodiment, black or a color equivalent to black is used for colored portions (e.g., cell 500) for which no particular color is specified.

[0021] 1B is an enlarged view of finder patterns 300a-300c in two-dimensional code 200. Finder patterns 300a-300c are made up of first finder pattern region 310, second finder pattern region 320, and third finder pattern region 330. These finder patterns enable the position of the two-dimensional code to be recognized, enabling high-speed reading.

[0022] The finder pattern must also have the function of recognizing the position of the two-dimensional code. Therefore, the ratio of white (light color) cells to black (dark color) cells must be 1:1:3:1:1 from any position in the A, B, or C directions of finder patterns 300a to 300c, but any color arrangement is possible as long as the ratio is within this range.

[0023] Furthermore, the first finder pattern area 310, the second finder pattern area 320, and the third finder pattern area 330 are not particularly limited as long as they are colors that can be read by a two-dimensional code reader, but the colors used in the first finder pattern area 310 and the third finder pattern area 330 are preferably colors that are recognized as dark colors or low-brightness colors (for example, black), and the colors used in the second finder pattern area 320 are preferably colors that are recognized as light colors or high-brightness colors (for example, white).

[0024] 1C is an enlarged view of the alignment pattern 400 in the two-dimensional code 200. The alignment pattern has the function of correcting the positional deviation of each cell caused by distortion. The alignment pattern is composed of a first alignment pattern region 410, a second alignment pattern region 420, and a third alignment pattern region 430.

[0025] There are no particular restrictions on the colors of these alignment pattern areas as long as they can be read by a two-dimensional code reader, but the colors used in the first alignment pattern area 410 and the third alignment pattern area 430 are preferably colors that are recognized as dark or low-brightness colors (e.g., black), and the colors used in the second alignment pattern area 420 are preferably colors that are recognized as light or high-brightness colors (e.g., white).

[0026] Next, an example of the configuration of the environment detection area 600 when a QR code is used as the two-dimensional code 200 is shown in FIGS. 2A to 2F.

[0027] 2A is similar to that shown in FIG. 1A and shows an example of a first label object 101 before an environmental change and a second label object 102 after an environmental change, in which an environmental detection area 600 is placed in the center of a two-dimensional code 200, which is the basic form of a label object. The color of the environmental detection area 600 changes, for example, from black to red, in response to the environmental change.

[0028] The third label object 103 shown in FIG. 2B is an example in which an environment detection area 600 is set at an arbitrary position inside the two-dimensional code 200 that does not overlap with the finder pattern 300 or the alignment pattern 400.

[0029] The fourth label object 104 shown in FIG. 2C is an example in which an environment detection area 600 is set at an arbitrary position outside the two-dimensional code 200.

[0030] The fifth label object 105 shown in FIG. 2D is an example in which an environment detection area 600 having a different shape from that shown in FIG. 2A is provided at an arbitrary position inside the two-dimensional code 200.

[0031] The sixth label object 106 shown in FIG. 2E is an example in which an environment detection area 600 with a hollow interior is provided at an arbitrary position inside the two-dimensional code 200.

[0032] The seventh label object 107 shown in FIG. 2F is an example in which a long and narrow environment detection area 600 is provided from the inside to the outside of the two-dimensional code 200.

[0033] Next, an example of the configuration of the environment detection area 600 when the "Data Matrix" standard is used as the two-dimensional code 200 (201) is shown in FIGS. 2G to 2K.

[0034] The eighth label object 108 shown in FIG. 2G is an example in which an environment detection area 600 is provided in the center of the interior of the two-dimensional code 201.

[0035] The ninth label object 109 shown in FIG. 2H is an example in which a long and narrow environment detection area 600 is provided from the inside to the outside of the two-dimensional code 201.

[0036] The tenth label object 110 shown in FIG. 2I is an example in which the environment detection area 600 is set at an arbitrary position outside the two-dimensional code 201.

[0037] An eleventh label object 111 shown in FIG. 2J is an example in which a vertically long bar-shaped environment detection area 600 is provided outside the two-dimensional code 201.

[0038] The twelfth label object 112 shown in FIG. 2K is an example in which a rectangular environment detection area 600 is provided so as to surround the outside of the two-dimensional code 201.

[0039] The layout configurations of FIGS. 2G to 2K are applicable not only to the "Data Matrix" standard but also to other two-dimensional barcodes (Micro QR code, rMQR code, Aztec code, PDF417, MaxiCode, etc.).

[0040] Next, an example of the configuration of the environment detection area 600 when the "GS1-128" standard is used as the one-dimensional code (202) instead of the two-dimensional code 200 is shown in FIGS. 2L to 2O.

[0041] The thirteenth label object 113 shown in FIG. 2L is an example in which an environment detection area 600 is provided on the left side of the one-dimensional code 202.

[0042] The fourteenth label object 114 shown in FIG. 2M is an example in which an environment detection area 600 is provided on the right side of the one-dimensional code 202.

[0043] The fifteenth label object 115 shown in FIG. 2N is an example in which an environment detection area 600 is provided above the one-dimensional code 202.

[0044] The sixteenth label object 116 shown in FIG. 2O is an example in which an environment detection area 600 is provided in the center of the interior of the one-dimensional code 202.

[0045] The layout configurations of Figures 2L to 2O can be applied not only to "GS1-128" but also to other one-dimensional barcodes (GS1 DataBar standards, EAN / UPC standards, ISBN / ISMN / ISSN code standards, etc.).

[0046] As in the configurations shown in FIGS. 2A to 2O, the shape and position of the environment detection area 600 can be arbitrarily arranged under the conditions that allow two-dimensional codes and one-dimensional codes to be read.

[0047] Next, another method for realizing a label display having an environmental detection area will be described. The above-described example of a label display is intended to be newly created as a two-dimensional code label including an environmental detection area, but it is also possible to form a label display having an environmental detection area by adding a separately prepared member having an environmental detection area to an existing or separately created two-dimensional code label that does not have an environmental detection area.

[0048] A specific method for installing the environment detection area 600 will be described below with reference to FIGS. 3A to 3F.

[0049] The round environment sensing sticker 110 shown in FIG. 3A is composed of an environment sensing area 600 and a round transparent film 610.

[0050] 3B is a cross-sectional view of FIG. 3A, and the round environment sensing sticker 110 is installed in a manner that the round transparent film 610 covers the environment sensing area 600. In FIG. 3B, for the purpose of explaining the configuration, the environment sensing area 600 and the round transparent film 610 are shown separated from each other, but in reality they are installed in contact with each other.

[0051] There are no particular restrictions on the round transparent film 610, as long as it is transparent and does not easily transmit moisture. Typical general-purpose transparent films include PP (polypropylene), PET (polyethylene terephthalate), and PVC (polyvinyl chloride).

[0052] 3C shows a method of installing the round environment detection sticker 110 on an existing two-dimensional code 200, in which the round environment detection sticker 110 is attached to the surface of the two-dimensional code 200. At this time, the round environment detection sticker 110 covers up part of the pattern of the existing two-dimensional code 200, but the error correction function of the two-dimensional code 200 itself allows it to be read without any problems as long as the covered area is below the upper limit that can be reproduced at that error correction level.

[0053] Furthermore, the adhesive surface may be either the front surface of the two-dimensional code 200 or the back surface of the round environmental detection sticker 110, but if the two-dimensional code 200 is already attached to other products, etc., it is preferable for the adhesive layer to be on the back surface of the round environmental detection sticker 110.

[0054] The guided environment sensing sticker 120 shown in FIG. 3D is composed of an environment sensing area 600 and a rectangular transparent film 620 on which an alignment guide 630 is provided.

[0055] 3E is a cross-sectional view of FIG. 3D, in which the guided environmental sensing seal 120 is installed with the rectangular transparent film 620 covering the environmental sensing area 600. In FIG. 3E, the environmental sensing area 600 and the rectangular transparent film 620 are shown separated to explain the configuration, but in reality they are installed in contact with each other. The rectangular transparent film 620 can be made of the same material as the round transparent film 610.

[0056] 3F shows a method of installing the guided environment detection sticker 120 on an existing two-dimensional code 200, in which the guided environment detection sticker 120 is attached to the surface of the two-dimensional code 200. The adhesive surface in this case can be either the surface of the two-dimensional code 200 or the back surface of the round guided environment detection sticker 120, but if the two-dimensional code 200 has already been installed on another product, it is preferable that the guided environment detection sticker 120 has an adhesive layer on the back surface.

[0057] Although the configurations in the above-mentioned FIGS. 3A to 3F have been described using a two-dimensional code as an example, they can also be applied to one-dimensional codes such as barcodes.

[0058] In this way, as long as the code can be read, the location of the environmental detection area (temperature detection ink) is not limited to either inside or outside the code, and the shape of the environmental detection area (temperature detection ink) is also not limited.

[0059] <Color determination method for the environment detection area> First, a method for determining the color of the environment detection area in this embodiment will be described. In this embodiment, the color of the environment detection area 600, which includes changes in color (influence) due to the installation environment (external light, etc.), is acquired as color information using RGB values ​​in an RGB (Red / Green / Blue) space as shown in Fig. 4, and by using a method described later, the normal color of the environment detection area 600, from which influences due to the installation environment, etc. have been eliminated, is determined without performing color correction using a reference area, etc. This color determination determines which of two colors, the color before and the color after the change in the environment detection area 600, it determines, for example, whether the color is black before the change or red after the change (as will be described later, it is not limited to determining black / red, but determination of two other colors is also possible).

[0060] 5 shows the processing flow for color determination. First, in step S501, the RGB values ​​of the environment detection area 600 of the code label are obtained. Next, in step S502, a feature amount (Vector Length; VL) related to the vector length in color space and a feature amount (Saturation Length; SL) related to the vector direction are calculated from the obtained RGB values ​​(methods for calculating VL and SL will be described later). Then, in step S503, a determination is made as to whether the color is color 1 or color 2 using a determination line 603 for VL and SL as shown in FIG. 6A as a threshold (the definition formula and method for generating the determination line 603 will be described later).

[0061] That is, as shown in Fig. 6B, the color is determined based on the positional relationship between the calculated VL and SL plot point 610 and the judgment line 603. For example, if the plot point 620 is in a larger area 601 relative to the judgment line 603, it is determined not to be "color 2," and as shown in Fig. 6C, if the plot point 620 is in an area 602 smaller than the judgment line 603, it is determined to be "color 2." Furthermore, if the color in the larger area 601 is defined in advance as "color 1," the color in the larger area 601 in Fig. 6B may be determined to be "color 1."

[0062] Here, a method for calculating VL (vector length) and SL (saturation length), as well as a definition formula and a method for generating the judgment line will be described. (1) How to calculate VL (vector length) and SL (saturation length) (1-1) Conversion of (R, G, B) values ​​into three-dimensional polar coordinates (r, θ, φ) The following relationship holds between (R,G,B) and three-dimensional polar coordinates (r,θ,φ):

[0063]

number

[0064] Here, r (Equation 1-4) is the RGB vector length (VL), and (θ, φ) are parameters related to the RGB vector direction.

[0065] (1-2) Extraction of RGB vector length and RGB vector direction features We use r as the feature of RGB vector length. Using θ and φ as the feature of RGB vector direction, SL (saturation length) is defined by the following formula:

[0066]

number

[0067] However, (θr, φr) is the reference point (constant) where saturation is 0, and since (R=G=B) holds at saturation 0, θr and φr are the following values:

[0068]

number

[0069] FIG. 7 is a diagram that schematically shows the SL (saturation length) calculated as described above.

[0070] Note that lightness may be used instead of VL, and saturation may be used instead of SL. Here, lightness and saturation are generally calculated using the following formula:

[0071]

number

[0072] Figure 8A is an example in which the vertical and horizontal axes are replaced with saturation and lightness, respectively, in the example described in Figures 6A to 6C where the vertical axis is SL and the horizontal axis is VL. In Figure 8A, the vertical axis is saturation length (SL), but the horizontal axis is lightness instead of vector length (VL). In Figure 8B, the horizontal axis is vector length (VL), but the vertical axis is replaced with saturation. In Figure 8C, the vertical and horizontal axes are replaced with saturation and lightness, respectively.

[0073] (2) Definition of the judgment line and its generation method The color is determined based on its position relative to the judgment line, with SL on the vertical axis and VL on the horizontal axis. The definition of the judgment line f(VL) can be any formula, but for example, the following definition formula f(VL) can be used with a and b as adjustment parameters:

[0074]

number

[0075] To determine the adjustment parameters a and b in Equation 5, for two colors (for example, black and red) before and after the change in the actual environment detection area, the imaging conditions (presence or absence of external light, changes in brightness due to lighting conditions, the positional relationship between the object to be judged and the imaging camera or other device) and the imaging camera or other device conditions are changed in several types, and the RGB values ​​of the measured colors are converted into the above-mentioned VL and SL and plotted, and the adjustment parameters a and b are determined so as to form a judgment line that separates black and red.

[0076] For example, Figure 9A shows the RGB values ​​of black measured under several different possible environments, converted into vector length (VL) and saturation length (SL), and plotted with VL on the horizontal axis and SL on the vertical axis. Figure 9B shows the RGB values ​​of red obtained in a similar manner. From these figures, a judgment line 900 can be drawn that separates the black plotted points from the red plotted points. When the judgment line 900 is expressed by Equation 5, a and b that produce the most approximate curve can be selected. Note that in this example, the judgment line 900 may be 900a, as shown in Figure 9C.

[0077] The above describes the color determination method for the environment detection area. However, the determination of two colors is not limited to black and red; any two colors with clearly different saturations or brightnesses can be determined in a similar manner. For example, by adjusting the determination line, it is possible to determine blue and white, purple and white, red and white, black and white, green and white, brown and white, purple and pink, black and green, red and yellow, green and yellow, and orange and yellow. It is also possible to determine a color that has a predetermined range of SL relative to the reference point as color 2, and determine a color that does not fall within the predetermined range as not being color 2. Note that the color determined by this embodiment is not a color generally defined by wavelength, but rather a color calculated in this embodiment. Although color 2 is described here, it may also be defined as the first color or color (1).

[0078] Although the example of determining which of two colors the color to be determined is is described above, it is also possible to determine which of three or more colors the color is by setting multiple judgment lines using a similar method. In other words, when determining which of n colors the color is, it is sufficient to set (n-1) judgment lines using a similar method and make the judgment using those lines.

[0079] As a result, in the past, color information would change depending on changes in the imaging conditions, which could affect color judgment, but according to this embodiment, the degree to which the imaging conditions affect color judgment can be reduced, thereby improving the accuracy of color judgment.

[0080] <Judgment system> Next, a determination system according to this embodiment, which incorporates the above-described color determination method, will be described. Fig. 10 is a configuration diagram of a code label determination system 1000. The determination system 1000 is used to read, for example, the two-dimensional codes shown in Fig. 1A, 2A to 2K, 3C, and 3F and the barcodes shown in Fig. 2L to 2P, and includes an image capture device 1010 that captures an image of the code label, an input device 1020, an output device 1030, a data processing device 1040, and a storage device 1050, and can transmit and receive various data, signals, and the like via a signal line 10600.

[0081] The image capture device 1010 is an imaging device such as a camera, and captures an image of the label item including the code. In addition to the label item, it is also possible to capture images of the memorized product, information related to the product, the surrounding environment, etc., as needed. Once the image of the code is captured, it is stored in an image data storage unit 1051 in the storage device 1050. The image capture device 1010 may also be a terminal device or equipment with a camera, such as a smartphone or tablet, and in this case, it is connected to the determination system 1000 via a wired or wireless connection.

[0082] The input device 1020 is a part that receives instructions from an operator, and is composed of buttons, a touch panel, and the like.

[0083] The output device 1030 is a device that outputs (presents) instruction information, read images, read results, determination results, etc. to the operator, and is configured with a display and a communication device. This configuration is standard, and any or all of the image acquisition device 1010, input device 1020, and output device 1030 may be configured to be connected to the outside of the determination system 1000.

[0084] Next, the storage device 1050 and the data processing device 1040 will be described in detail. <<Storage device 1050>> The storage device 1050 is a part that stores various types of data, and is made up of the following storage units: The image data storage unit 1051 is a part that stores the captured image including the code label input from the image acquisition device 1010.

[0085] The code position data storage unit 1052 is a part that stores data indicating the reference position of the code recognized from the image (captured image) stored in the image data storage unit 1051 by the code position recognition unit 1042, which will be described later.

[0086] The code data storage unit 1053 is a unit that stores coded character string data (data body) recognized from the image stored in the image data storage unit 1051 by the code recognition unit 1043, which will be described later.

[0087] The environment detection area position data storage unit 1054 is a part that stores in advance relative position information of the environment detection area within the code (information indicating the position within the code where the environment detection area is located).

[0088] The environment detection area measured color data storage unit 1055 is a part that stores color information (RGB values, etc.) extracted by measuring the color of the environment detection area specified by the environment detection area position data storage unit 1054.

[0089] The judgment result memory unit 1056 is a part that stores the color judgment result of the environment detection area judged by the color judgment unit 1046 described later, and the judgment result of whether or not the environment detection area has discolored based on the color judgment result (such as ``NG'' if discolored, or ``OK'' if there is no discoloration, or a mark used for screen display described later).

[0090] The read data storage unit 1057 is a unit that stores data other than that processed by the data processing device 1040, which will be described later. In general, when grasping changes in the product environment, it is desirable to have all the information about when, where, and what happened. Therefore, in addition to the product-related information stored in the code data storage unit 1053 and data such as temperature deviation from the environment detection area stored in the determination result storage unit 1056, it is preferable to store the date and time when the read process was performed, location information, the number of the reading device (to identify the worker), weather information linked to web information, etc. Note that as long as the same reading device is used, the reading device number does not change, so it may be added when outputting data, which will be described later.

[0091] The criterion data storage unit 1058 stores color information about the materials, inks, etc. used in the environment detection area before and after color development, and the relationship between the amount of environmental change and the color information about the environment detection area (e.g., information indicating the ambient temperature corresponding to a certain color in the environment detection area). A judgment line used to determine a color is calculated based on the color information about the materials, inks, etc. used in the environment detection area before and after color development, and the relationship between the amount of environmental change and the color information about the environment detection area. The criterion data storage unit 1058 also stores a judgment line for each judgment color, and based on the judgment color received as input from the user, the judgment line corresponding to the judgment color is retrieved from the criterion data storage unit. If the storage device 1050 stores an ID associated with the color information used in the judgment target, the color information used in the judgment target may be obtained from the ID described in the judgment target acquired as an image, and the judgment color may be determined based on the color information.

[0092] <<Data processing device 1040>> The data processing device 1040 processes data input from the image acquisition device 1010 and the input device 1020 and data stored in the storage device 1050, and outputs the results to the output device 1030 or stores them in the storage device 1050, and is composed of the following processing units. Note that the data processing device 1040 is realized, for example, by a computer having a central processing unit (CPU) and memory, and the following processing units are programs stored in the memory for realizing them, and can be realized by the CPU executing those programs. Furthermore, each processing unit may be realized by dedicated hardware.

[0093] The input control unit 1041 is a part that classifies data input from the image acquisition device 1010 or the input device 1020 into commands, data, etc., and transfers them to the storage device 1050 and each part of the data processing device 1040. In particular, the main data that is transferred to the image data storage unit 1051 is image data of a code including an environment detection area.

[0094] The code position recognition unit 1042 recognizes the position of a code from the image data stored in the image data storage unit 1051, and stores the recognition result in the code position data storage unit 1052. Image data is usually made up of hundreds to thousands of dots both vertically and horizontally, and the image itself does not contain data indicating which parts are codes.

[0095] Therefore, the color data of each dot is analyzed to determine which part of the image data the reference position of the code corresponds to. The display format and number of reference positions vary depending on the code standard, but are not limited to these standards. Furthermore, even if the image stored in the image data storage unit 1051 contains multiple codes, the positions of the multiple codes can be determined.

[0096] The code recognition unit 1043 is a part that uses the position data stored in the code position data storage unit 1052 to recognize the data body of the character string recorded as a code in the data area (cell 500) from the image stored in the image data storage unit 1051, and stores it in the code data storage unit 1053.

[0097] The environment detection area position determination unit 1044 is a part that detects, for example, the coordinates (X, Y) of the four corners of the two-dimensional code from the position data stored in the code position data storage unit 1052 and the information stored in the code data storage unit 1053, and determines the position of the environment detection area 600 based on the coordinates of the detected four corners and the position information previously stored in the environment detection area position data storage unit 1054.

[0098] The environment detection area measured color determination unit 1045 is a part that determines the RGB values ​​of the environment detection area 600 in the acquired image from the image stored in the image data storage unit 1051 and the position information of the environment detection area 600 determined by the environment detection area position determination unit 1044.

[0099] The color determination unit 1046 determines which of two predetermined colors (color 1 or color 2) the color of the environment detection area is using the method described above in <Environment Detection Area Color Determination Method>. That is, based on the RGB values ​​of the color of the environment detection area stored in the environment detection area measured color data storage unit 767, the color determination unit 1046 calculates the vector length (VL) using equation (1-4) and the saturation length (SL) using equations (1-5, 1-6, 2, 3-1, 3-2). Then, based on the magnitude relationship between the determination line and SL as a function of VL shown in equation 5, it determines whether the environment detection area is color 1 or color 2. Note that the definition equation for the determination line (equation 5) is assumed to be generated in advance from experiments conducted under various environmental conditions and stored in the color determination unit 1046.

[0100] Furthermore, the color determination unit 1046 determines, from the color determination result of the environment detection area described above, whether the environment detection area has changed color due to an increase in the ambient temperature or the like and exceeded a predetermined upper limit temperature.

[0101] The output control unit 1047 controls the output of information processed by the data processing unit 1040 to the output device 1030. Specifically, this is a part that outputs to the output device 1030 product information linked to the data body stored in the code data storage unit 1053, information such as the presence or absence of temperature deviation determined from the color information of the environment detection area stored in the determination result storage unit 1056, or information stored in the read data storage unit 1057.

[0102] When the output destination is a screen or the like, it is preferable that the result be output each time a reading operation is performed. In this case, it is also preferable that the determination result stored in the environment detection area determination result storage unit 1056 be output. When the output destination is a communication destination or the like, the output process may be performed each time a reading operation is performed, or may be performed by aggregating data from several times or at predetermined intervals.

[0103] <Processing flow of the judgment system> FIG. 11 is a flowchart illustrating the processing flow of the determination system 1000 of this embodiment. First, image data including a code having an environment detection area is input from the image acquisition device 1010. The input data is stored in the image data storage unit 1051 (step S1101).

[0104] Next, the code position recognition unit 1042 recognizes the reference position of the code from the image recorded in the image data storage unit 1051, and the recognized reference position is recorded in the code position data storage unit 1052. The code recognition unit 1043 identifies the data area using the image recorded in the image data storage unit 1051 and the position data recorded in the code position data storage unit 1052, decodes the code represented by the data area, and extracts the data body of the code (character string data, etc.) (step S1102).

[0105] Next, the environment detection area position determination unit 1044 uses the position data stored in the code position data storage unit 1052 to detect, for example, the coordinates (X, Y) of the four corners of the two-dimensional code in the acquired image recorded in the image data storage unit 1051, and identifies the position of the environment detection area in the acquired image using the position information of the environment detection area previously stored in the environment detection area position data storage unit 1054 (step S1103). Next, the environment detection area measured color determination unit 1045 acquires RGB values ​​as color information for the environment detection area from the acquired image based on the position information determined by the environment detection area position determination unit 1044. The acquired color information (RGB values) is transferred to and stored in the environment detection area measured color data storage unit 1055 (step S1104).

[0106] At this time, the acquired image is checked for problems such as "whiteout" where the reference area or environment detection area becomes invisible in the image due to reflected light when the lighting is strong, or the code image being too small or too large, or the shooting angle when acquiring the image being acute and causing the code image to be excessively distorted.If there is a problem, the process returns to step S1101 and the image is read again (step S1105).

[0107] If the measured color data of the environment detection area can be acquired without any problems in step S1105, the color determination unit 1046 then calculates the color feature amount of the environment detection area and performs color determination based on the calculated feature amount. The details are as described above (steps S1106 and S1107).

[0108] Next, the color determination unit 1046 determines whether or not the environment detection area is colored (changed in color) or the amount of coloring based on the result of the color determination. Then, the data processing device 1040 determines whether or not the ambient environment of the code exceeds a preset standard (for example, an upper limit temperature) (step S1108).

[0109] The result of the determination made by the color determination unit 749 described above is stored in the determination result storage unit 1056. At the same time, the date and time when the reading process was performed, location information, the number of the reading device (for identifying the worker), weather information linked to web information, etc. are stored in the read data storage unit 1052 (step S1109).

[0110] Then, the product information linked to the character string stored in the code data storage unit 1053, information such as the presence or absence of temperature deviation determined from the color information of the environment detection area stored in the determination result storage unit 1056, or information stored in the read data storage unit 1057 are output to the output device 1030, and if a smartphone is used as hardware for the determination system, the output device 1030 outputs the read result to the smartphone screen or the like (step S1110).

[0111] 12 is an example of the display of the output result of the determination system 1000 of this embodiment, which is the output display of the reading result on the display 1201 of a smartphone 1200. When multiple labeled objects with two-dimensional codes to be read are lined up, it is possible to simultaneously acquire images of the multiple objects and perform analysis processing such as color changes in their environment detection areas in parallel, and then display the results side by side on the display 1201.

[0112] In addition, the result determined in step S1108 in the flowchart of FIG. 11 can be easily recognized by the operator by showing an "X mark" 1202a on the display 1201, which indicates NG when there is a temperature deviation in AR (Augmented Reality), or a "check mark" 1202b, which indicates OK when there is no temperature deviation in AR.

[0113] Furthermore, the smartphone 1200 can be used not only as an output device for the determination results but also as the image acquisition device 1010. In this case, by touching the end scan button 1203 after reading all the two-dimensional codes has been completed, the determination results for all the read two-dimensional codes can be viewed on the smartphone screen 1201, or can be sent to a specified address.

[0114] Furthermore, the determination system 1000 in this embodiment itself can be configured with a general-purpose smartphone 1200 having a camera, a screen, and a communication device. Furthermore, a terminal device or a wireless terminal such as the general-purpose smartphone 1200 may exist separately from the determination system 1000. In this case, an image acquired by the smartphone 1200 may be transmitted to the determination system 1000, and the smartphone 1200 may acquire the determination result of the determination system 1000, and the determination result may be output from the smartphone 1200.

[0115] 13 shows an example of the display of input information for the determination system 1000 of this embodiment. For example, the barcode to be determined may be acquired by photographing it, as shown in screen display 1301 of the smartphone 1200. Information acquired during photography may be acquired by the smartphone 1200, as shown in 1302, but is not limited to this, and may be input by the user, acquired in a pull-down format, or acquired according to the photography situation.

[0116] As described above, this embodiment provides a determination system that includes an environmental detection area in the data area that changes color in response to environmental changes, and that accurately determines the color of the environmental detection area of ​​a code label that utilizes a circulating two-dimensional code or barcode, without the need for a reference area or the like to correct for differences in color information due to imaging conditions. Furthermore, conventional barcodes with reference areas require a reference area of ​​a certain size to be read, and a configuration in which the reference area is arranged on three finder patterns 300a-300c, as shown in FIG. 17A, makes it difficult to reduce the size of the barcode. This embodiment enables color determination without a reference area, making it possible to provide a determination system for barcodes smaller than conventional barcodes. As shown in FIGS. 17B and 17C, the label size can be reduced to 1 / 4 to 1 / 3 of the conventional size. Labels such as barcodes may have a sum of the long and short sides of 40 mm or less, for example. Furthermore, while conventional reference areas require printing multiple colors of ink, this embodiment eliminates the need for a reference area, making it possible to provide a determination system for single-color barcodes. It is also possible to provide a reading system that allows for simple color determination.

[0117] These features make it possible to expand the range of products to which barcodes can be attached, and to properly manage the temperature of products during distribution. [Example]

[0118] 14 is a diagram illustrating an outline of an information processing system 1400 according to a second embodiment of the present invention, which utilizes the determination system 1000. The information processing system 1400 includes an information processing device 1410 and a smartphone 1200 serving as the determination system 1000 of the first embodiment, and the smartphone 1200 is placed at various locations in the distribution process of the product.

[0119] In the example of FIG. 14 , smartphones 1200 are placed at various locations, including collection locations, export warehouses, customs warehouses, import warehouses, and consumer locations. Information processing devices 1410 capable of determining color changes in environmental detection areas included in two-dimensional codes 1420 are configured with an input unit 1411, a storage unit 1412, an information processing unit 1413, and an output unit 1414. The input unit 1411 is a unit that inputs information output from the smartphone 1200. The storage unit 1412 is a unit that accumulates and stores information output from the smartphone 1200. The storage unit 1412 is a non-transitory or temporary recording medium that stores various programs and data. Examples of the storage unit 1412 include a read-only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), and a flash memory.

[0120] The information processing unit 1413 is a unit that organizes and analyzes the information stored in the storage unit 1412, and is realized by a CPU (Central Processing Unit) or the like. For example, by statistically analyzing the information from the smartphone 1200, it is possible to know when, what kind of worker, and in what place a temperature deviation occurred, which can lead to business improvements.

[0121] The output unit 1414 is a part that transmits the information processed by the information processing unit 1413 to a location that requires it. If the information processing device 1410 is a device that has a display, it can output the processing results to the display.

[0122] The following is an example of applying the information processing system 1400 to distribution from production to consumers. The information processing system 1400 enables consumers who receive a product, such as wine, to understand physical quantities such as the environmental temperature during the distribution process. If the product is wine, the two-dimensional code 1420 is displayed on the label attached to the wine, the box containing the wine, or the like.

[0123] The information processing system 1400 includes a smartphone 1200 as the determination system 1000 for a two-dimensional code 1420, and an information processing device 1410. The smartphone 1200 (input / output device) uploads information acquired and analyzed as the determination system 1000 for a two-dimensional code 1420 to the information processing device 1410 during product distribution. While Fig. 14 shows an example of a smartphone 1200 (input / output device) capable of input and output on a single terminal, dedicated input and output devices such as an image capturing device may also be used.

[0124] When collecting the product, the person in charge of transporting the product (for example, a driver) uses a smartphone 1200 (input / output device) to capture an image of the two-dimensional code 1420 displayed on the product. As a result, input information including the image of the two-dimensional code 1420 is uploaded to the information processing device 1410. The two-dimensional code 1420 and the determination system 1000 determine whether or not there is a temperature deviation at the time of reading.

[0125] At this time, in addition to product identification information (item identification information), the image capture time, image capture location, etc. are also uploaded as input information. The item identification information is, for example, a GTIN (Global Trade Item Number), an EAN (European Article Number) code, or a UPC (Universal Product Code). It is preferable that this item identification information be linked to information about the item, such as the manufacturer, seller, production date, and expiration date.

[0126] Similarly, each person in charge at the export warehouse, customs warehouse, and import warehouse uses a smartphone 1200 (input / output device) to capture an image of the two-dimensional code 1420 displayed on the product. This causes each piece of input information to be uploaded to the information processing device 1410. Then, based on the uploaded input information, the information processing device 1410 determines whether or not there is a temperature deviation at the time of reading.

[0127] On the other hand, a consumer (user) can access the URL (website) stored in the two-dimensional code 1420 by reading the two-dimensional code 1420 of the product using the smartphone 1200 (input / output device). Reading can be performed, for example, using a dedicated application running on the smartphone 1200 (input / output device).

[0128] In this embodiment, the smartphone 1200 includes the determination system 1000, but this is not limited to this, and the smartphone 1200 may be a dedicated reading reader as an input device and a personal computer as an output device.

[0129] As described above, according to this embodiment, it is possible to trace the environmental conditions in which a distributed product is placed throughout the distribution process from production to the consumer, and if a defect is found in the distributed product after it reaches the consumer, it is possible to search for the cause, such as where in the distribution process the problem occurred. [Example]

[0130] Figures 15A to 15D show the actual analysis results. A color judgment of black and red was performed under 12 imaging conditions for the black and red environment detection areas. The judgment line was set using equation 5, with a = 20 and b = 0.09. The imaging conditions at the time of judgment are as shown in Table 1.

[0131] [Table 1]

[0132] Here, Fig. 15A shows the judgment result when an image was taken using a mobile terminal manufactured by company A, Fig. 15B shows the judgment result when an image was taken using a mobile terminal manufactured by company B, Fig. 15C shows the judgment result when an image was taken using a mobile terminal manufactured by company C, and Fig. 15D shows the judgment result when an image was taken using a mobile terminal manufactured by company D. Also, * indicates a black judgment result, and ○ indicates a red judgment result.

[0133] Also, in the case of this embodiment, a region where SL≧a / VL+b holds with respect to the determination line is determined to be red, and a region where SL<a / VL+b holds is determined to be black. As a result, even when performed on four types of mobile terminals, black and red could be determined with an accuracy of 98%. From this, in this embodiment, colors can be accurately determined without having a reference region in the code.

Embodiment

[0134] FIG. 16 shows the actual analysis results. Color determination of white and blue was performed under 12 imaging conditions for the white environmental detection region and the blue environmental detection region. At this time, the determination line was set as y = ax + b, with a = 0.0012 and b = -0.22. Also, the imaging situation at the time of determination is as shown in Table 1. Also, in FIG. 16, it is the determination result when imaging is performed using a mobile terminal manufactured by Company C. Also, * indicates the determination result of blue, and ○ indicates the determination result of white.

[0135] [[ID=1(12)]]Also, in the case of this embodiment, a region where SL≧a×VL+b holds with respect to the determination line is determined to be blue, and a region where SL<a×VL+b holds is determined to be white. With this determination result, blue and white could be determined with an accuracy of 98% or more. From this, in this embodiment, even for colors other than black and red, colors can be accurately determined without having a reference region in the code.

Explanation of Signs

[0136] 100: Label display object 200: Two-dimensional code (QR code) [[ID=2(23)]]201: Two-dimensional code (Data Matrix code) 210: One-dimensional code 300a: Finder pattern (positioning pattern) (28)300b: Finder pattern (positioning pattern) 300c: Finder pattern (positioning pattern) 310: First finder pattern region Note: There seems to be a minor issue in the original text where the "1(12)" in the translation of line ID 12 is a bit unclear in terms of the intended meaning. It might be a small error in the original text or a non-standard notation. But following the translation rules as closely as possible, this is the resulting translation.320: Second finder pattern area 330: Third finder pattern area 400: Alignment pattern 410: First alignment pattern area 420: Second alignment pattern area 430: Third alignment pattern area 500: Cell (data area) 600: Environmental sensing area 1000: Judgment System 1010: Image acquisition device 1020: Input device 1030: Output device 1040: Data processing device 1041: Input control unit 1042: Code position recognition unit 1043: Code recognition unit 1044: Position determination unit for environment detection area 1045: Environmental detection area actual measurement color determination unit 1046: Color judgment section 1047: Output control section 1050: Storage device 1051: Image data storage unit 1052: Code position data storage unit 1053: Code data storage unit 1054: Environment detection area position data storage unit 1055: Storage unit for measured color data of the environment detection area 1056: Judgment result storage unit 1057: Read data storage unit 1058: Criteria data storage unit 1060: Signal line 1200: Smartphone (mobile device) 1400: Information Processing Systems 1410: Information processing equipment 1411: Input section 1412: Storage section 1413: Information Processing Department 1414: Output section

Claims

1. A determination system for determining the color of a determination object, a storage device that stores a judgment line having parameters of lightness and saturation of the color to be judged; a data processing device that acquires color information of the color to be determined and determines the color to be determined from the color information; The data processing device includes: a color determination unit that calculates a vector length of the color information, which is a feature amount related to the lightness of the color information, and a vector direction of the color information, which is a feature amount related to the saturation of the color information, in a color space, and compares the calculated vector length with the determination line to determine the color of the object to be determined; A determination system comprising:

2. The determination system according to claim 1, A determination system, characterized in that the color to be determined is a plurality of predetermined colors having different brightness or saturation.

3. The determination system according to claim 1, The determination system is characterized in that the data processing device includes an actual measurement color determination unit that acquires an image of the color of the determination target and acquires color information of the determination target from the image.

4. The determination system according to claim 3, the measured color determination unit acquires RGB values ​​as color information of the color to be determined; the color judgment unit calculates an RGB vector length (VL) and a direction of the RGB vector (SL) in three-dimensional polar coordinates from the acquired RGB values, plots the SL and the VL as the vertical and horizontal axes, respectively, and judges the color based on the positional relationship with the judgment line; A determination system comprising:

5. The determination system according to claim 4, The color judgment unit judges that the calculated VL and SL are a predetermined first color when they are located in a predetermined area relative to the judgment line, and judges that the calculated VL and SL are not a predetermined first color when they do not belong to a predetermined area relative to the judgment line.

6. The determination system according to claim 4, the color judgment unit uses lightness instead of the VL and saturation instead of the SL to judge the color; A determination system comprising:

7. The determination system according to any one of claims 1 to 6, A determination system comprising an image acquisition device for acquiring an image of the color of the object to be determined.

8. The determination system according to claim 7, The colors to be determined are black and red, or blue and white, or purple and white, or red and white, or black and white, or green and white, or brown and white, or purple and pink, or black and green, or red and yellow, or green and yellow, or orange and yellow, A determination system characterized by:

9. A color determination method for determining the color of a determination target, comprising: a color information acquisition step of acquiring color information of the color to be determined; a data processing step of determining the color of the object to be determined from the color information acquired in the color information acquisition step, The data processing step includes: a color determination step of calculating a vector length of the color information, which is a feature amount related to the lightness of the color information, and a vector direction of the color information, which is a feature amount related to the saturation of the color information, in a color space, and determining the color of the object to be determined by comparing the vector length and the vector direction with a determination line having the lightness and saturation of the object to be determined as parameters; A color determination method comprising:

10. 10. The color determination method according to claim 9, A color determination method, characterized in that the color to be determined is a plurality of predetermined colors having different lightness or saturation.

11. 10. The color determination method according to claim 9, The data processing step includes a measured color determination step of acquiring an image of the color of the object to be determined and acquiring color information of the object to be determined from the image. A color determination method comprising:

12. The color determination method according to claim 11, The actual color determination step includes a step of acquiring RGB values ​​as color information of the color to be determined; The color determination step calculates an RGB vector length (VL) and a direction of the RGB vector (SL) in three-dimensional polar coordinates from the RGB values ​​acquired in the actual color determination step, plots the SL and VL as the vertical and horizontal axes, respectively, and determines the color based on the positional relationship with a predetermined determination line. A color determination method comprising:

13. 13. The color determination method according to claim 12, the color determination step uses lightness instead of the VL and saturation instead of the SL to determine the color; A color determination method comprising:

14. The color determination method according to any one of claims 9 to 13, The colors to be determined are black and red, or blue and white, or purple and white, or red and white, or black and white, or green and white, or brown and white, or purple and pink, or black and green, or red and yellow, or green and yellow, or orange and yellow, A color determination method characterized by:

15. Computer, A program for causing a data processing device to acquire color information of a plurality of colors to be determined that have different lightness and saturation, and to determine the colors to be determined from the color information, The program a vector length of the color information, which is a feature related to the lightness of the color information, and a vector direction of the color information, which is a feature related to the saturation of the color information, in a color space; and a determination line having the lightness and saturation of the color to be determined as parameters, thereby determining the color to be determined. A program characterized by:

16. The determination system according to claim 1 includes a terminal device and an information processing device, The terminal device is disposed at a plurality of locations in the distribution process of a predetermined product, the plurality of terminal devices detect a color change in an environment detection area of ​​a code label of the distribution product during each distribution process, thereby determining whether or not there is an environmental change during each distribution process of the distribution product; The information processing system is characterized in that the information processing device collects information on the presence or absence of environmental changes in each distribution process of the distribution product from a plurality of the terminal devices and presents the information to a user.

17. A terminal device capable of communicating with the determination system according to claim 1, The terminal device is characterized in that it acquires an image of the color to be judged, transmits the image to the judgment system, receives the judgment result of the judgment system, and outputs the judgment result.

18. A label display object whose color can be determined by the determination system according to claim 1, The label has an environment detection area that changes color in response to an environmental change, The determination system acquires color information of the environment detection area.

19. The label according to claim 18, The labeling item has a sum of the long and short sides of 40 mm or less.

Images