Color determination system, method for determining color, and color determination program

Abstract

To provide a color determination system, a method for determining a color, and a color determination program for precisely determining a color.SOLUTION: A determination device 20 has a control unit 21 for acquiring an image from an imaging unit 201. The control unit 21 identifies detection regions of a plurality of color samples in an image taken of a scale including a plurality of color samples and an object, identifies non-detection regions of the color samples by using the detection regions and the arrangement pattern of the color samples of the scale 10, predicts the arrangement of the scale 10 by using the detection regions and the non-detection regions, and determines a color of the object by using the color samples in the scale 10 in the predicted arrangement.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a color judgment system, a color judgment method, and a color judgment program for judging a color using a color sample. [Background technology]

[0002] A color scale may be used to determine the color of an object. In the color scale, color samples of "colors" are arranged. Then, the color of the object is compared with the color samples to determine the color based on the color sample corresponding to the object. The state of the object may also be determined based on the color of the object (see, for example, Patent Document 1). The change degree derivation device described in this document accepts an image of the object photographed together with a position confirmation means for confirming the position where the object was photographed and a color known object having multiple color samples whose color values ​​are known. Next, a conversion rule is generated to convert the color samples included in the image into values ​​in a device-independent color space. Then, the color of the object included in the image is converted into values ​​in a device-independent color space according to the conversion rule. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-201251 A Summary of the Invention [Problem to be solved by the invention]

[0004] A photograph of a color scale contains multiple color samples. Depending on the shooting conditions, it may be difficult to distinguish between the color samples, making it difficult to judge the color. [Means for solving the problem]

[0005] A color judgment system that solves the above problem includes a control unit that acquires an image from an image capture unit, and the control unit identifies detection areas of the color samples in an image captured of a scale including a plurality of color samples together with an object, identifies undetected areas of the color samples using the detection areas and an arrangement pattern of the color samples of the scale, predicts an arrangement of the scale using the detection areas and the undetected areas, and judges the color of the object using the color samples of the scale in the predicted arrangement. Effect of the Invention

[0006] According to the present disclosure, color can be accurately determined. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is an explanatory diagram of a color determination system according to an embodiment. [Diagram 2] FIG. 2 is an explanatory diagram of a hardware configuration of the embodiment. [Diagram 3] FIG. 2 is an explanatory diagram of a processing procedure according to an embodiment. [Figure 4] 5A and 5B are explanatory diagrams of images according to an embodiment, in which (a) is a photographed image, (b) is a grayscale image, and (c) is an explanatory diagram of an edge extraction image. [Diagram 5] 5A is an explanatory diagram of an edge-emphasized image, FIG. 5B is an outline-extracted image, and FIG. 5C is an explanatory diagram of a superimposed image according to an embodiment. [Figure 6] 1A and 1B are explanatory diagrams of images according to an embodiment, in which (a) is a superimposed image, (b) is a layout, and (c) is an explanatory diagram of the superimposed image. [Figure 7] 5A and 5B are explanatory diagrams of a processing procedure according to an embodiment, in which FIG. 5A is an explanatory diagram for a case where the contour interval is small, and FIG. 5B is an explanatory diagram for a case where the contour interval is large. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] 1 to 7, specific embodiments of a color judgment system, a color judgment method, and a color judgment program will be described. 1, in this embodiment, a scale on which different colors are arranged is used for color evaluation of a concrete material. A determination device 20 as a color determination system determines the color using a scale 10 arranged near an object T1.

[0009] (Hardware configuration example) FIG. 2 shows an example of the hardware configuration of an information processing device H10 that functions as the determination device 20. As shown in FIG.

[0010] The information processing device H10 includes a communication device H11, an input device H12, a display device H13, a storage device H14, and a processor H 15. Note that this hardware configuration is an example, and the information processing device H10 may include other hardware.

[0011] The communication device H11 is an interface that establishes a communication path with another device and transmits and receives data, and is, for example, a network interface or a wireless interface.

[0012] The input device H12 is a device that accepts input from a user, etc., and is, for example, a mouse, a keyboard, etc. The display device H13 is, for example, a display or a touch panel that displays various information.

[0013] The storage device H14 is a storage device that stores data and various programs for executing various functions of the determination device 20. Examples of the storage device H14 include a ROM, a RAM, and a hard disk.

[0014] The processor H15 uses programs and data stored in the storage device H14 to control each process in the determination device 20 (for example, processes in the control unit 21 described below). Examples of the processor H15 include a CPU and an MPU. The processor H15 loads a program stored in a ROM or the like into a RAM and executes various processes corresponding to the various processes. For example, when an application program of the determination device 20 is started, the processor H15 operates a process that executes each process described below.

[0015] The processor H15 is not limited to a processor that performs software processing for all the processes it executes. For example, the processor H15 may include a dedicated hardware circuit (e.g., an application specific integrated circuit (ASIC)) that performs hardware processing for at least a part of the processes it executes. That is, the processor H15 may be configured as follows:

[0016] (1) One or more processors operating according to a computer program (software) (2) One or more dedicated hardware circuits that perform at least some of the processes; or (3) A circuit that includes a combination of these. The processor includes a CPU and memory, such as RAM and ROM, that stores program codes or instructions configured to cause the CPU to execute processes. Memory, i.e., computer-readable media, includes any available media that can be accessed by a general-purpose or special-purpose computer.

[0017] (Functions of each information processing device) The functions of the scale 10 and the determination device 20 will be described with reference to FIG. A plurality of color samples with different color schemes are arranged on the scale 10. The scale 10 of the present embodiment uses a color scale on which a plurality of color samples from white to black are arranged by sequentially changing the color attribute value of lightness as different color schemes.

[0018] The determination device 20 is a computer system that determines the color of an object in a captured image. The determination device 20 includes an image capture unit 201, a control unit 21, and a scale information storage unit 22.

[0019] The photographing unit 201 is a device for photographing a subject. In this embodiment, the photographing unit 201 is used to photograph the scale 10 together with the object T1 to be subjected to color judgment. The control unit 21 performs processes (including a management stage, an image processing stage, a prediction stage, etc.) described below. By executing a color determination program for this purpose, the control unit 21 functions as a management unit 210, an image processing unit 211, a prediction unit 212, etc.

[0020] The management unit 210 acquires captured images from the imaging unit 201 , and controls the image processing unit 211 and the prediction unit 212 . The image processing unit 211 executes image processing of the image captured by the image capturing unit 201 . The prediction unit 212 executes a process of determining a color using the image that has been subjected to the image processing.

[0021] The scale information storage unit 22 records scale management information related to the arrangement pattern (format) of the color samples of the scale 10. This scale management information is recorded when the scale 10 is registered. The scale management information records data related to the layout of the color samples and color information of each color sample.

[0022] (Color Judgment Processing) Next, the color judgment process will be described with reference to FIGS. 3, first, a scale is placed (step S10). Specifically, the scale 10 is placed near the object T1.

[0023] Next, the control unit 21 of the determination device 20 executes a process of acquiring a captured image (step S20). Specifically, the photographing unit 201 of the determination device 20 photographs the object T1 and the scale 10 as subjects. In this case, the management unit 210 of the control unit 21 generates a captured image including the object T1 and the scale 10. Note that the following image will be described using an image in which only the vicinity of the scale 10 is cut out. Specifically, as shown in FIG. 4(a), a color image 500 is captured by the imaging unit 201 and acquired.

[0024] Next, the control unit 21 of the determination device 20 executes a quadrangle detection process (step S30). Specifically, the image processing unit 211 of the control unit 21 specifies the arrangement of the color samples in the captured image. The quadrangle detection process (step S30) will be described in detail below.

[0025] First, the control unit 21 of the determination device 20 executes a grayscale process (step S31). Specifically, the image processing unit 211 of the control unit 21 converts pixel values ​​of the color shading of the image 500 into a grayscale image displayed in 256 gradations from white to black. An image 500 shown in FIG. 4(a) is converted into a grayscale image 510 as shown in FIG. 4(b).

[0026] Next, the control unit 21 of the determination device 20 executes an edge detection process (step S32). Specifically, the image processing unit 211 of the control unit 21 applies a filter to detect discontinuous portions in the grayscale image where pixel values ​​are equal to or greater than a threshold value, thereby generating an edge extraction image showing edges. An image 510 shown in FIG. 4(b) is converted into an image 520 in which edges are displayed, as shown in FIG. 4(c).

[0027] Next, the control unit 21 of the determination device 20 executes edge enhancement processing (step S33). Specifically, the image processing unit 211 of the control unit 21 applies a filter that enhances edges in the edge extraction image, thereby generating an edge-enhanced image. An image 520 shown in FIG. 4(c) is converted into an image 530 with enhanced edges as shown in FIG. 5(a).

[0028] Next, the control unit 21 of the determination device 20 executes a contour extraction process (step S34). Specifically, the image processing unit 211 of the control unit 21 extracts a contour in the edge-enhanced image.

[0029] Next, the control unit 21 of the determination device 20 executes a closed figure extraction process (step S35). Specifically, the image processing unit 211 of the control unit 21 generates a quadrangular outline extraction image that includes only closed figures from the extracted outlines. Here, only quadrangles (outlines that can be displayed by four points) are extracted. From image 530 shown in Fig. 5(a), image 540 is generated by extracting only the rectangle, as shown in Fig. 5(b). Image 540 includes contours 541 to 546. The arrangement of the color samples is identified by the above-described quadrangle detection process (step S30).

[0030] Next, the control unit 21 of the determination device 20 executes a position estimation process (step S40). Specifically, the prediction unit 212 of the control unit 21 estimates the position of the scale in the contour extraction image. The position estimation process (step S40) will be described in detail below.

[0031] First, the control unit 21 of the determination device 20 executes a prediction process for an undetected region (step S41). Specifically, the prediction unit 212 of the control unit 21 generates a superimposed image by superimposing a contour extraction image on a captured image.

[0032] As shown in FIG. 5(c), an image 550 is generated by superimposing the image 540 shown in FIG. 5(b) on the image 500. In this case, the prediction unit 212 of the control unit 21 checks the uniformity of color distribution within each contour in the image 550. Then, the prediction unit 212 removes contours with non-uniform color distribution. As shown in FIG. 6(a), in an image 550, a plurality of colors are distributed within a contour 541, so the contour 541 is deleted.

[0033] Next, the control unit 21 of the determination device 20 executes a scale arrangement determination process (step S42). Specifically, the prediction unit 212 of the control unit 21 applies the layout of the color samples (arrangement of the color samples) recorded in the scale information storage unit 22. Here, the layout 220 shown in FIG. 6(b) is used.

[0034] Next, the control unit 21 of the determination device 20 executes an undetected color sample estimation process (step S43). Specifically, the prediction unit 212 of the control unit 21 identifies the center of gravity of each contour. Then, the prediction unit 212 extends a line connecting the center of gravity positions to predict an undetected color sample area.

[0035] As shown in FIG. 7(a), when three contours F1 to F3 (detection areas) are identified, the lines connecting the center positions of the contours F1 to F3 are extended to identify possibly existing undetected areas Fx1, Fx2, etc. Here, since the contours F1 to F3 of adjacent color samples are detected, undetected regions Fx1 and Fx2 are identified in the region extending the interval between the centers of gravity. These undetected regions Fx1 and Fx2 are located in the region outside the contours F1 and F3. 7(b), when multiple edges are larger than the size (width) of the detection area, such as three edges F1 to F3, the number of undetected edges is determined by dividing the interval between the detected edges by the edge width. Here, an undetected edge Fx3 is further determined between edges F2 and F3.

[0036] The prediction unit 212 then checks the color distribution of the undetected regions Fx1, Fx2, etc., and if the color distribution is uniform, determines that the undetected regions are color sample regions. 6(c), a contour on which all the color samples are arranged is identified in the image 560. In this image 560, contours 561 and 562 are newly detected.

[0037] Next, the control unit 21 of the determination device 20 executes a color determination process (step S50). Specifically, the management unit 210 of the control unit 21 identifies a color sample corresponding to the color of the object T1 on the scale 10. Then, the management unit 210 determines the color of the identified color sample as the color of the object T1, and outputs it to the display device H13.

[0038] According to this embodiment, the following effects can be obtained. (1) In this embodiment, the control unit 21 of the determination device 20 executes a grayscale process (step S31). This makes it possible to predict the arrangement of the scale based on the shading of brightness.

[0039] (2) In this embodiment, the control unit 21 of the determination device 20 executes an edge detection process (step S32) and an edge enhancement process (step S33). As a result, since one color sample area is monochromatic, each color sample area can be extracted.

[0040] (3) In this embodiment, the control unit 21 of the determination device 20 executes a contour extraction process (step S34) and a closed figure extraction process (step S35), thereby making it possible to identify a color sample area surrounded by the contour of the closed figure.

[0041] (4) In this embodiment, the control unit 21 of the determination device 20 executes an undetected area prediction process (step S41), a scale arrangement determination process (step S42), and an undetected color sample estimation process (step S43). Even if the color sample area cannot be accurately identified depending on the shooting conditions, the undetected color sample area can be predicted from the color sample area to be detected.

[0042] (5) In this embodiment, the control unit 21 of the determination device 20 executes a color determination process (step S50), which makes it possible to determine the color of the object using a color sample of the scale.

[0043] This embodiment can be modified as follows: This embodiment, the following embodiment, and the following modified examples can be combined with each other to the extent that there is no technical contradiction.

[0044] In the above embodiment, the color of a concrete material is judged, but the object for which the color is to be judged is not limited to a concrete material. In the above embodiment, the determination device 20 is used. The hardware configuration is not limited to this. For example, the image capture unit 201 and the determination device 20 may be separated and realized in a client-server format. In the above embodiment, a grayscale in which color samples with different lightness are arranged is used as the scale 10. However, a color scale in which color samples with different color attribute values ​​of at least one of lightness, hue, and saturation are arranged may also be used.

[0045] In the above embodiment, the control unit 21 of the determination device 20 executes an undetected color sample estimation process (step S43). Specifically, the undetected color sample is estimated from the arrangement of the contours. In addition to this, a color gradient may be used. Here, the undetected area is identified based on the color attribute values ​​of the detection areas of multiple color samples and the arrangement pattern of the color samples of the scale. Specifically, the prediction unit 212 calculates a color gradient by comparing the colors of the multiple detected color sample areas. Then, the prediction unit 212 compares the calculated gradient with the color gradient according to the arrangement of the color samples of the scale recorded in the scale information storage unit 22 to predict the arrangement of the scale. [Explanation of symbols]

[0046] T1... object, 10... scale, 20... determination device, 201... imaging unit, 21... control unit, 210... management unit, 211... image processing unit, 212... prediction unit, 22... scale information storage unit.

Claims

1. A color judgment system including a control unit that acquires an image from an imaging unit, The control unit: Identifying detection areas of the plurality of color samples in an image obtained by photographing a scale including the plurality of color samples together with an object; Identifying an undetected area of ​​the color sample using the detected area and an arrangement pattern of the color sample of the scale; predicting a location of the scale using the detected region and the undetected region; A color judgment system comprising: a color sample of the scale in the predicted arrangement, and which judges the color of the object.

2. 2. The color judgment system according to claim 1, wherein the color sample is a sample of a color scheme in which at least one color attribute value of lightness, hue, and saturation is changed as a color attribute.

3. 3. The color judgment system according to claim 1, wherein the control unit identifies the undetected area based on color attribute values ​​of the detection areas of the plurality of color samples and an arrangement pattern of the color samples of the scale.

4. 3. The color judgment system according to claim 1, wherein the control unit specifies the detected area and the undetected area according to uniformity of color distribution contained in the image.

5. The control unit: Identifying an edge of a color sample of the scale in the image; 3. The color judgment system according to claim 1, wherein the edges are used to identify the arrangement of contours of a plurality of color samples.

6. The control unit: Identifying a center of gravity position of the detection area; 6. The color judgment system according to claim 5, wherein the undetected area is identified based on the position of the center of gravity and an arrangement pattern of the color samples on the scale.

7. 3. The color judgment system according to claim 1, wherein the scale includes a color sample for evaluating the color of concrete.

8. A method for determining a color of an object using a color determination system including a control unit that acquires an image from an imaging unit, comprising: The control unit: Identifying detection areas of the plurality of color samples in an image obtained by photographing a scale including the plurality of color samples together with an object; Identifying an undetected area of ​​the color sample using the detected area and an arrangement pattern of the color sample of the scale; predicting a location of the scale using the detected region and the undetected region; A color judging method comprising: judging the color of the object using a color sample of the scale in the predicted arrangement.

9. A program for determining the color of an object using a color determination system including a control unit that acquires an image from an imaging unit, The control unit, Identifying detection areas of the plurality of color samples in an image obtained by photographing a scale including the plurality of color samples together with an object; Identifying an undetected area of ​​the color sample using the detected area and an arrangement pattern of the color sample of the scale; predicting a location of the scale using the detected region and the undetected region; a color judgment program for functioning as a means for judging the color of the object using a color sample of the scale in the predicted arrangement.

Images