Diagnostic method, diagnostic device, and program
The diagnostic method quantitatively assesses TBC damage on turbine blades by calculating L*a*b* color differences, addressing inconsistencies in visual evaluation and reducing rework costs.
Patent Information
- Application Number
- JP2022019481
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-02-10
- Publication Date
- 2026-01-23
- Estimated Expiration
- 2042-02-10
AI Technical Summary
Current methods for diagnosing thermal barrier coating (TBC) damage on turbine blades rely on visual sensory evaluation, leading to inconsistent pass/fail judgments and increased costs due to rework.
A diagnostic method and device that quantitatively assess TBC damage by calculating L*a*b* color differences between a diagnostic target area and a reference area within an image, with distance adjustments to ensure accurate diagnosis.
Enables consistent and automated quantification of TBC damage, reducing inconsistencies and rework costs by eliminating inspector subjectivity.
Smart Images

Figure 0007805192000001 
Figure 0007805192000002 
Figure 0007805192000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a diagnostic method, a diagnostic device, and a program. [Background technology]
[0002] Thermal barrier coatings (TBCs) are applied to turbine blades, stationary blades, and other high-temperature components to improve their thermal insulation and durability. Products coated with TBCs can develop damage such as peeling, cracks, and chips for a variety of reasons. Because TBC damage can lead to deterioration of high-temperature components, TBC damage is inspected during the manufacturing process. For example, chipping of the TBC is determined by whether the undercoat is exposed. Currently, this is determined by visual sensory evaluation by inspectors. This results in inconsistencies in pass / fail judgments between inspectors and production sites, leading to inconsistencies and rework, which increases costs.
[0003] As a related technique, Patent Document 1 discloses a technique for quantifying and evaluating the roughness of a metal surface by using color differences calculated from an image of the metal surface. Patent Document 2 discloses a technique for irradiating a transparent conductive film with light, measuring the color evaluation value of the reflected light, and determining the film thickness corresponding to the measured color evaluation value by using film thickness characteristic information that associates the color evaluation value with the film thickness. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-128436 [Patent Document 2] Japanese Patent Application Laid-Open No. 2008-205188 Summary of the Invention [Problem to be solved by the invention]
[0005] There is a need for a quantitative method for diagnosing TBC damage that does not depend on the examiner's perception.
[0006] The present disclosure provides a diagnostic method, a diagnostic device, and a program that can solve the above problems. [Means for solving the problem]
[0007] The diagnostic method disclosed herein is a method for diagnosing a damage state of a coating material applied to the surface of a component, and includes the steps of: setting a diagnostic target portion, which is a portion for diagnosing the damage state, in an image of the surface of the component; specifying a reference portion, which is a portion in the image where the damage state does not exist; calculating L*a*b* values of the diagnostic target portion and the reference portion; calculating a color difference between the L*a*b* value of the diagnostic target portion and the L*a*b* value of the reference portion; and diagnosing the damage state of the diagnostic target portion from the color difference. The image in which the diagnostic target portion is set and the image in which the reference portion is specified are the same. According to another aspect, the diagnostic method of the present disclosure is a method for diagnosing a damage state of a coating material coated on the surface of a component, the method comprising the steps of: setting a diagnostic target area, where the damage state is to be diagnosed, in an image of the surface of the component; specifying a reference area, where the damage state is not present in the image; calculating a distance between the diagnostic target area and the reference area; if the distance exceeds a predetermined first threshold, resetting the reference area or the diagnostic target area; calculating L*a*b* values of the diagnostic target area and the reference area, respectively; calculating a color difference between the L*a*b* value of the diagnostic target area and the L*a*b* value of the reference area; and diagnosing the damage state of the diagnostic target area from the color difference, wherein in the step of calculating the distance, a distance on the image between a pixel included in the range specified as the reference area and a pixel included in the range specified as the diagnostic target area is converted to a distance on the component, and the converted distance is set to the distance between the diagnostic target area and the reference area.
[0008] The diagnostic device disclosed herein is a diagnostic device for diagnosing a damage state of a coating material coated on the surface of a component, and includes: means for setting a diagnostic target portion, which is a portion for diagnosing the damage state in an image of the surface of the component, means for specifying a reference portion, which is a portion in the image where the damage state does not exist; means for calculating L*a*b* values of the diagnostic target portion and the reference portion; means for calculating a color difference between the L*a*b* value of the diagnostic target portion and the L*a*b* value of the reference portion; and means for diagnosing the damage state of the diagnostic target portion from the color difference. The image in which the diagnostic target portion is set and the image in which the reference portion is specified are the same. According to another aspect, a diagnostic device of the present disclosure is a diagnostic device that diagnoses a damage state of a coating material coated on a surface of a component, and includes: means for setting a diagnostic target portion, which is a location where the damage state is to be diagnosed, in an image captured of the surface of the component; means for designating a reference portion, which is a location in the image where the damage state is not present; means for calculating a distance between the diagnostic target portion and the reference portion; means for resetting the reference portion or the diagnostic target portion if the distance exceeds a predetermined first threshold; means for calculating L*a*b* values of the diagnostic target portion and the reference portion, respectively; means for calculating a color difference between the L*a*b* value of the diagnostic target portion and the L*a*b* value of the reference portion; and means for diagnosing the damage state of the diagnostic target portion from the color difference, wherein the means for calculating the distance converts a distance on the image between a pixel included in a range designated as the reference portion and a pixel included in a range designated as the diagnostic target portion to a distance on the component, and sets the converted distance as the distance between the diagnostic target portion and the reference portion.
[0009] The program disclosed herein is a process for diagnosing a damage state of a coating material applied to the surface of a component, and includes the steps of: setting a diagnosis target portion, which is a portion for diagnosing the damage state, in an image of the surface of the component; specifying a reference portion, which is a portion in the image where the damage state does not exist; calculating L*a*b* values of the diagnosis target portion and the reference portion; calculating a color difference between the L*a*b* value of the diagnosis target portion and the L*a*b* value of the reference portion; and diagnosing the damage state of the diagnosis target portion from the color difference. The image in which the diagnostic target portion is set and the image in which the reference portion is specified are the same. A program that executes diagnostic processing is. According to another aspect, a program of the present disclosure causes a computer to execute a diagnostic process for diagnosing a damage state of a coating material applied to a surface of a component, the diagnostic process comprising the steps of: setting a diagnostic target portion, where the damage state is to be diagnosed, in an image of the surface of the component; specifying a reference portion, where the damage state is not present in the image; calculating a distance between the diagnostic target portion and the reference portion; resetting the reference portion or the diagnostic target portion if the distance exceeds a predetermined first threshold; calculating L*a*b* values of the diagnostic target portion and the reference portion, respectively; calculating a color difference between the L*a*b* value of the diagnostic target portion and the L*a*b* value of the reference portion; and diagnosing the damage state of the diagnostic target portion from the color difference, wherein in the distance calculation step, the computer converts a distance on the image between a pixel included in a range specified as the reference portion and a pixel included in a range specified as the diagnostic target portion to a distance on the component, and sets the converted distance as the distance between the diagnostic target portion and the reference portion. [Effects of the Invention]
[0010] According to the above-described diagnostic method, diagnostic device, and program, damage to a TBC can be quantitatively diagnosed. [Brief explanation of the drawings]
[0011] [Figure 1] 1 is a block diagram illustrating an example of a diagnostic system according to an embodiment. [Figure 2] FIG. 10 is a diagram showing an example of the overall flow of diagnostic processing according to the embodiment. [Figure 3] FIG. 10 is a diagram illustrating an example of a diagnosis screen according to the embodiment. [Figure 4] 10 is a flowchart illustrating an example of a TBC damage diagnosis process according to an embodiment. [Figure 5] FIG. 1 is a diagram illustrating an example of a hardware configuration of a diagnostic system according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0012] <Embodiment> The diagnostic system of the present disclosure will be described below with reference to Figures 1 to 5. In the following description, components having the same or similar functions will be assigned the same reference numerals, and redundant descriptions of those components may be omitted.
[0013] (System Configuration) FIG. 1 is a block diagram illustrating an example of a diagnostic system according to an embodiment. The diagnostic system 100 is a system that diagnoses the presence or absence of TBC damage (e.g., chipping of the TBC) in a TBC-installed product. As shown in the figure, the diagnostic system 100 includes a camera 6, a terminal device 10, and a diagnostic server 20. The camera 6 and the terminal device 10 are connected to each other so as to be able to communicate with each other, and the terminal device 10 and the diagnostic server 20 are connected to each other so as to be able to communicate with each other via a network NW.
[0014] The camera 6 captures an image of a component 1, such as a blade, on which a TBC has been applied. The image captured by the camera 6 is transmitted to a terminal device 10. For example, a groove 2 is formed in the component 1. When the TBC is applied to the entire surface of the component 1, TBC damage may occur, for example, near the edge of the groove 2. The damage candidate portion 3 shown in the figure is a location that is suspected of TBC damage, for example, by visual inspection by an inspector. Conventionally, whether the damage candidate portion 3 is TBC damage or not is determined by the inspector's evaluation. However, in this embodiment, whether the damage candidate portion 3 is TBC damage is determined by analyzing the image captured by the camera 6.
[0015] (Terminal device configuration and functions) The terminal device 10 is a terminal device such as a PC (personal computer), a smartphone, a tablet, etc. The terminal device 10 includes an input receiving unit 11 configured using input devices such as a keyboard, a mouse, a touch panel, and buttons, an image acquiring unit 12 configured using an image captured by the camera 6, a display unit 13 configured using a display device such as a liquid crystal display, a control unit 14 configured using an operation of the terminal device 10, a storage unit 15 configured using a storage device such as an HDD (hard disk drive) and a flash memory and storing various data, and a communication unit 16 configured using a communication module and communicating with other devices.
[0016] For example, the input receiving unit 11 receives settings of a reference portion 4 and a diagnosis target portion 5 by an inspector for an image of a component 1 displayed on a diagnosis screen 200 illustrated in FIG. 3. The reference portion 4 is a portion that is clearly free of TBC damage when viewed by the inspector. The diagnosis target portion 5 is a portion that is suspected of having TBC damage when viewed by the inspector, and is a portion that is to be subjected to judgment on TBC damage. For example, the inspector sets the diagnosis target portion 5 to include a damage candidate portion 3. The input receiving unit 11 also receives operations such as touching or selecting a diagnosis button 205 on the diagnosis screen 200 by the inspector. As will be described later, when the diagnosis button 205 is selected, a diagnosis is performed to determine whether TBC damage has occurred in the diagnosis target portion 5.
[0017] The control unit 14 communicates with the diagnostic server 20 using the communication unit 16 and executes a diagnosis process for TBC damage. For example, the control unit 14 transmits an image acquired by the image acquisition unit 12 to the diagnostic server 20 using the communication unit 16. The control unit 14 receives a diagnosis screen 200 displaying an image of the component 1 from the diagnostic server 20 using the communication unit 16 and displays it on the display unit 13. Furthermore, when the input receiving unit 11 receives settings for the reference portion 4 and the diagnosis target portion 5, the control unit 14 calculates their coordinate information and transmits the calculated coordinate information for the reference portion and the diagnosis target portion to the diagnostic server 20 using the communication unit 16. When the diagnosis button 205 is touched, for example, the control unit 14 requests the diagnostic server 20 to diagnose whether the diagnosis target portion 5 has TBC damage using the communication unit 16, receives the diagnosis screen 200 including the diagnosis results from the diagnostic server 20, and displays it on the display unit 13.
[0018] (Diagnosis server configuration and functions) The diagnostic server 20 is composed of one or more computers. The diagnostic server 20 includes a data acquisition unit 21, a control unit 22, a storage unit 23, and a communication unit 24. The data acquisition unit 21 acquires, from the terminal device 10, images of the component 1, coordinate information of the reference portion 4 and the diagnosis target portion 5, and the like, using the communication unit 24. The control unit 22 controls the operation of the diagnostic server 20. The control unit 22 includes a diagnosis unit 221. Prior to determining whether TBC damage has occurred, the diagnosis unit 221 determines whether the reference portion 4 and the diagnosis target portion 5 set by the inspector are appropriate. Based on the image of the component 1 acquired by the data acquisition unit 21, the diagnosis unit 221 calculates the color difference in the L*a*b* color space between the reference portion 4 and the diagnosis target portion 5. If the color difference is equal to or greater than a threshold, the diagnosis unit 221 determines that TBC damage has occurred in the diagnosis target portion 5. The control unit 22 uses the communication unit 24 to transmit to the terminal device 10 the determination result as to whether the reference portion 4 and the diagnosis target portion 5 are appropriate, and the diagnosis result as to whether TBC damage has occurred in the diagnosis target portion 5. For example, the control unit 22 has a web server function and may generate a diagnosis screen 200 in the form of a web screen, as shown in FIG. 3, and transmit it to the terminal device 10. The memory unit 23 is configured using a storage device such as an HDD (hard disk drive) or flash memory, and stores various data. The communication unit 24 is configured using a communication module and communicates with the terminal device 10.
[0019] (operation) Next, the overall flow of the diagnostic process for TBC damage by the diagnostic system 100 will be described with reference to FIGS. 2 and 3. FIG. 2 is a diagram showing an example of the overall flow of the diagnostic process according to the embodiment. First, an inspector operates the camera 6 to capture an image of the component 1 to which the TBC has been applied. The camera 6 transmits the captured image to the terminal device 10 (step S1). In the terminal device 10, the image acquisition unit 12 acquires the image (step S2), and the communication unit 16 transmits the acquired image to the diagnostic server 20 based on an instruction from the control unit 14 (step S3). In the diagnostic server 20, the data acquisition unit 21 acquires the image using the communication unit 24 and stores it in the memory unit 23. The control unit 22 then generates a diagnostic screen 200 including the acquired image (step S4). The control unit 22 transmits the diagnostic screen 200 to the terminal device 10 using the communication unit 24 (step S5). In the terminal device 10, the control unit 14 acquires the diagnostic screen 200 using the communication unit 16, and displays the diagnostic screen 200 on, for example, a browser (step S6). Referring now to FIG.
[0020] FIG. 3 is a diagram illustrating an example of a diagnosis screen according to an embodiment. The diagnosis screen 200 includes an image area 201, a reference area area 202, a diagnosis target area area 203, a diagnosis result area 204, and a diagnosis button 205. The image area 201 displays an image of the component 1 captured by the camera 6. The inspector sets the reference area 4 and the diagnosis target area 5 in the image area 201. For example, the inspector sets the reference area 4 by, for example, using a mouse to designate a location in the image area 201 that clearly does not contain TBC damage. The input receiving unit 11 receives this designation operation, and the control unit 14 calculates position information of the designated reference area 4 (e.g., coordinate information of the reference area 4 in the image captured by the camera 6). For example, the control unit 14 considers a range of multiple pixels (e.g., a total of four pixels including adjacent pixels) including the pixel designated by the user to be the reference area 4, and calculates coordinate information defining this range (e.g., coordinate information of each pixel). Similarly, the inspector sets the diagnosis target portion 5 by, for example, specifying with a mouse a location in the image area 201 where TBC damage is suspected (for example, a part of the damage candidate portion 3). The input receiving unit 11 receives this specifying operation, and the control unit 14 calculates position information of the specified diagnosis target portion 5 (for example, coordinate information of a total of four adjacent pixels including the specified pixel).
[0021] The reference part area 202 includes position information of the reference part 4 (for example, X and Y coordinates of the reference part 4 when the horizontal direction of the image captured by the camera 6 is the X axis and the vertical direction is the Y axis), RGB values of the reference part 4, L*a*b* The L*, a*, and b* values in the color space are displayed.
[0022] The diagnostic target area 203 displays the position information of the diagnostic target area 5 (for example, the X and Y coordinates of the diagnostic target area 5 when the horizontal direction of the image captured by the camera 6 is the X axis and the vertical direction is the Y axis), the RGB values of the diagnostic target area 5, and the L*, a*, and b* values in the L*a*b* color space.
[0023] The diagnosis result area 204 displays the color difference ΔE*ab in the L*a*b* color space between the reference portion 4 and the diagnosis target portion 5, and the diagnosis result. The diagnosis result indicates whether or not the diagnosis target portion 5 is a TBC damaged portion. If the diagnosis target portion 5 is not a TBC damaged portion, the diagnosis result area 204 displays "Pass," and if the diagnosis target portion 5 is a TBC damaged portion, the diagnosis result area 204 displays "Fail." When the diagnosis button 205 is selected, a diagnosis of the diagnosis target portion 5 is performed.
[0024] When the diagnostic screen 200 is displayed (step S6), the inspector sets the reference portion 4 and the diagnostic target portion 5 in the image area 201. The input receiving unit 11 receives these settings (step S7). For example, the first specified location may be the reference portion 4, and the second specified location may be the diagnostic target portion 5. The input receiving unit 11 may recognize the pixel clicked first with the mouse as the reference portion 4 and the pixel clicked next as the diagnostic target portion 5. The control unit 14 calculates coordinate information of the reference portion 4 and the diagnostic target portion 5 and transmits this information to the diagnostic server 20 (step S8). In the diagnostic server 20, the data acquisition unit 21 acquires the coordinate information of the reference portion 4 and the diagnostic target portion 5 using the communication unit 24, and the diagnostic unit 221 determines whether the coordinate information is appropriate (step S9). For example, if a location where TBC damage has occurred is selected as the reference portion 4, an error will occur in the diagnosis of the diagnostic target portion 5. Furthermore, if a location outside the TBC construction target area (such as the groove 2) is selected as the diagnosis target area 5, the TBC damage diagnosis becomes meaningless. Furthermore, if the distance between the reference area 4 and the diagnosis target area 5 is too great, differences in the way light hits the area may affect the diagnosis. Therefore, the diagnosis unit 221 determines whether the reference area 4 and the diagnosis target area 5 are appropriate locations or whether they are too far apart. If at least one of the reference area 4 and the diagnosis target area 5 is not appropriate or if the distance between them is too great, a warning is issued, and the processes of steps S7 to S9 are executed again. Furthermore, when the process of step S9 is executed, the diagnosis unit 221 calculates the RGB values and L*a*b* values of the reference area 4 and the diagnosis target area 5. Each time, the control unit 22 reflects these values in the reference area region 202 and the diagnosis target area region 203 on the diagnosis screen 200, thereby updating the display of the diagnosis screen 200. If both the reference area 4 and the diagnosis target area 5 are determined to be appropriate, the inspector selects the diagnosis button 205. The input receiving unit 11 receives this selection. The control unit 14 uses the communication unit 16 to request a diagnosis from the diagnostic server 20 (step S10). In the diagnostic server 20, the diagnosis unit 221 diagnoses whether or not TBC damage has occurred in the diagnosis target part 5 (step S11). The diagnostic server 20 transmits the diagnosis result to the terminal device 10 (step S12), and the terminal device 10 displays the diagnosis result (step S13).Specifically, in the diagnostic server 20, the control unit 22 updates the display of the diagnostic screen 200 by reflecting the diagnostic result by the diagnostic unit 221 in the diagnostic result area 204 of the diagnostic screen 200. In the terminal device 10, the control unit 14 receives the updated diagnostic screen 200 using the communication unit 16 and displays the diagnostic screen 200 including the diagnostic result on the display unit 13.
[0025] (Determination of suitability, details of TBC damage diagnosis) Next, with reference to FIG. 4, the processing of steps S9 and S11 in FIG. 2 will be described in detail. It is assumed that the area of the component 1 where the TBC is applied is white or yellow-green depending on the manufacturing process. First, the diagnosis unit 221 reads an image of the component 1 (step S21). Next, the diagnosis unit 221 identifies the diagnosis target area 5 based on the coordinate information of the diagnosis target area 5 (step S22). For example, the diagnosis unit 221 identifies multiple pixels included in the range of the diagnosis target area 5. Next, the diagnosis unit 221 calculates the RGB values of the pixels included in the diagnosis target area 5, further converts the RGB values to L*a*b* values, and calculates the color average of multiple pixels (for example, four pixels) (step S23). For example, if four pixels arranged in a square are identified as the diagnostic target area 5, and the L*a*b* values of each pixel are pixel 1 = (L1, a1, b1), pixel 2 = (L2, a2, b2), pixel 3 = (L3, a3, b3), and pixel 4 = (L4, a4, b4), the diagnostic unit 221 calculates the average of the L* values for L* by (L1 + L2 + L3 + L4) ÷ 4. The same applies to the a* and b* values. In this way, the diagnostic unit 221 calculates the average of the L*a*b* values for the diagnostic target area 5. Next, the diagnostic unit 221 calculates the average of the calculated L*a*b* values by dividing the average of the calculated L*a*b* values by L*<40 or a* >It is determined whether either of the conditions b*<-15 or b*<-20 is satisfied (step S24). Step S24 determines whether the diagnosis target portion 5 is appropriate. If either of the conditions is satisfied (step S24; Yes), the diagnosis unit 221 determines that the set diagnosis target portion 5 is inappropriate and requests resetting of the diagnosis target portion 5 (step S25). For example, the diagnosis unit 221 displays a message such as "The diagnosis target portion 5 is inappropriate. Please reset the diagnosis target portion 5" on the diagnosis screen 200. The inspector resets the diagnosis target portion 5. When the inspector resets the diagnosis target portion 5, the terminal device 10 calculates coordinate information of the diagnosis target portion 5 and transmits the coordinate information to the diagnosis server 20. The processes of steps S22 to S25 are repeatedly executed until the diagnosis target portion 5 is determined to be appropriate (until the determination of step S24 is No).
[0026] The averages of the L*a*b* values calculated for each pixel included in the range of the diagnostic target area 5 are all L*<40 or a* > If either the condition b*<-15 or b*<-20 is not satisfied (step S24: No), the diagnosis unit 221 determines that the diagnosis target portion 5 is appropriate and then identifies the reference portion 4 based on the coordinate information of the reference portion 4 (step S26). For example, the diagnosis unit 221 identifies pixels included in the range of the reference portion 4. Next, the diagnosis unit 221 calculates the distance between two points (the diagnosis target portion 5 identified in step S22 and the reference portion 4) (step S27). Next, the diagnosis unit 221 determines whether the calculated distance is less than a predetermined threshold (e.g., 50 mm) (step S28). If the distance is equal to or greater than the threshold (step S28; No), the diagnosis unit 221 requests resetting of the reference portion 4 (step S33). For example, the diagnosis unit 221 displays a message such as "The reference portion 4 is not appropriate. Please reset the reference portion 4" on the diagnosis screen 200.
[0027] When the distance is less than the threshold value (step S28; Yes), the diagnostic unit 221 calculates the RGB values of the pixels included in the reference unit 4, further converts the RGB values into L*a*b* values, and calculates the color average of a plurality of pixels (for example, 4 pixels) (step S29). The diagnostic unit 221 calculates the average of the L*a*b* values of each pixel included in the range of the reference unit 4 for each of the L*a*b* values, for example, in the same manner as in the case of the diagnostic target unit 5. Next, the diagnostic unit 221 determines whether the condition of L*≧67. 6 is satisfied (step S30). If this condition is not satisfied (step S30; No), the diagnostic unit 221 requests re - setting of the reference unit 4 (step S33).
[0028] L*≧67. 6 When the condition of L*≧67. is satisfied (step S30; Yes), next, the diagnostic unit 221 determines whether the average of the calculated L*a*b* values satisfies - 3.6 < a* < 1.1 and - 6.4 < b* < 8.6 (step S31). If this condition is satisfied (step S31; Yes), the diagnostic unit 221 sets the value for the case where the color of the TBC is white (threshold value for white) as the threshold value for the color difference for determining TBC damage (step S35).
[0029] If the condition of - 3.6 < a* < 1.1 and - 6.4 < b* < 8.6 is not satisfied (step S31; No), next, the diagnostic unit 221 determines whether the average of the calculated L*a*b* values satisfies - 28.3 < a* < - 3.6 and 8.6 < b* < 44.4 (step S32). If this condition is satisfied (step S32; Yes), the diagnostic unit 221 sets the value for the case where the color of the TBC is yellow - green (threshold value for yellow - green) as the threshold value for the color difference for determining TBC damage (step S34).
[0030] When the conditions of -28.3 < a* < -3.6 and 8.6 < b* < 44.4 are not satisfied (step S32; No), the diagnostic unit 221 requests the reset of the reference unit 4 (step S33). The inspector performs the reset of the reference unit 4. When the inspector resets the reference unit 4, the terminal device 10 calculates the coordinate information of the reference unit 4 and transmits the coordinate information to the diagnostic server 20. The processes of steps S26 to S33 are repeatedly executed until it is determined that the reference unit 4 is appropriate (until the determination in step S28 is Yes, the determination in step S30 is Yes, and the determination in step S31 or step S32 is Yes).
[0031] As described above, the determination process of the appropriateness of the reference unit 4 and the diagnostic target unit 5 is completed (corresponding to step S9 in FIG. 2). When an appropriate reference unit 4 and diagnostic target unit 5 are set, the diagnostic unit 221 determines whether the diagnostic target unit 5 is a TBC damaged location based on the color difference between the reference unit 4 and the diagnostic target unit 5, for example, based on the operation of the diagnostic button 205 by the inspector. The diagnostic unit 221 calculates the color difference between the average of the L*a*b* values of the reference unit 4 calculated in step S29 and the average of the L*a*b* values of the diagnostic target unit 5 calculated in step S23 (step S36). Since the calculation method of the color difference (Euclidean distance based on the difference in L*, the difference in a*, and the difference in b*) is well-known, it is omitted. Next, the diagnostic unit 221 compares the threshold value for the color difference set in step S34 or step S35 with the color difference calculated in step S36. If the calculated color difference is greater than or equal to the threshold value, it is determined that the diagnostic target unit 5 is a TBC damaged location (non-conforming), and otherwise, it is determined that the diagnostic target unit 5 is not a TBC damaged location (conforming) (step S37).
[0032] As described above, according to the present embodiment, it is possible to automatically and quantitatively determine the presence or absence of TBC damage based on the color difference between the reference unit 4 and the diagnostic target unit 5. Since the diagnosis can be performed without depending on the inspector's sense and subjectivity, it is possible to suppress the variation in pass / fail determination and the cost increase due to rework.
[0033] In the above explanation, the distance between the reference portion 4 and the diagnostic object portion 5 is calculated and it is determined whether the distance is appropriate (step S28), but this determination may be omitted. Also, although an example has been given in which the reference portion 4 is reset when the distance between the two points is equal to or greater than a threshold, the diagnostic object portion 5 may be reset instead of (or in addition to) the reference portion 4.
[0034] FIG. 5 is a diagram illustrating an example of a hardware configuration of the diagnostic system according to the embodiment. The computer 900 includes a CPU 901 , a main memory device 902 , an auxiliary memory device 903 , an input / output interface 904 , and a communication interface 905 . The terminal device 10 and the diagnostic server 20 are implemented in a computer 900. The above-described functions are stored in the auxiliary storage device 903 in the form of a program. The CPU 901 reads the program from the auxiliary storage device 903, loads it into the main storage device 902, and executes the above-described processing in accordance with the program. The CPU 901 also allocates a storage area in the main storage device 902 in accordance with the program. The CPU 901 also allocates a storage area in the auxiliary storage device 903 for storing data being processed in accordance with the program.
[0035] Alternatively, a program for implementing all or part of the functions of the terminal device 10 and the diagnostic server 20 may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed to perform processing by each functional unit. The term "computer system" herein includes hardware such as an OS and peripheral devices. Furthermore, if a WWW system is used, the term "computer system" also includes the homepage provision environment (or display environment). Furthermore, the term "computer-readable recording medium" refers to portable media such as CDs, DVDs, and USBs, as well as storage devices such as hard disks built into the computer system. Furthermore, if the program is distributed to the computer 900 via a communication line, the computer 900 may load the program into the main storage device 902 and execute the above-described processing. Furthermore, the program may be for implementing part of the above-described functions, or may be capable of implementing the above-described functions in combination with a program already stored in the computer system.
[0036] As described above, several embodiments according to the present disclosure have been described, but all of these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as defined in the claims, as well as in the scope and spirit of the invention.
[0037] <Additional Notes> The diagnostic method, diagnostic device, and program described in each embodiment can be understood, for example, as follows.
[0038] (1) A diagnostic method according to a first aspect is a method for diagnosing a damage state of a coating material (e.g., TBC) coated on the surface of a component, and includes the steps of setting a diagnostic target area, which is a location where the damage state is to be diagnosed, in an image of the surface of the component; specifying a reference area, which is a location in the image where the damage state is not present; calculating the L*a*b* values of the diagnostic target area and the reference area, respectively; calculating the color difference between the L*a*b* value of the diagnostic target area and the L*a*b* value of the reference area; and diagnosing the damage state of the diagnostic target area from the color difference. This allows quantitative diagnosis of damage to the coating material.
[0039] (2) A diagnostic method according to a second aspect is the diagnostic method of (1), further comprising the step of determining whether the diagnostic target part is appropriate or not based on the L*a*b* values of the diagnostic target part. This makes it possible to determine whether the position set as the diagnostic target portion is appropriate.
[0040] (3) A diagnostic method according to a third aspect is the diagnostic method of (1) to (2), further comprising a step of determining whether the reference part is appropriate or not from the L*a*b* values of the reference part. This makes it possible to determine whether the position set as the reference part is appropriate. By setting the reference part correctly, damage to the diagnosis target part can be diagnosed correctly.
[0041] (4) A diagnostic method according to a fourth aspect is a diagnostic method according to any one of (1) to (3), further comprising the steps of calculating the distance between the diagnostic target portion and the reference portion, and resetting the reference portion or the diagnostic target portion if the distance exceeds a predetermined first threshold. If the distance between the reference part and the diagnostic target part is too far, the diagnostic accuracy may decrease due to differences in how light hits them. Diagnostic accuracy can be maintained by determining the distance between the diagnostic target part and the reference part, and if it is too far, resetting the reference part to an appropriate distance.
[0042] (5) A diagnostic method according to a fifth aspect is a diagnostic method according to any one of (1) to (4), wherein in the diagnosing step, the color difference is compared with a predetermined second threshold value corresponding to the color of the coating material, and if the color difference is equal to or greater than the second threshold value, it is determined that the part to be diagnosed has damage to the coating material. For example, even for the same component, the coating material may be colored in various colors depending on the manufacturing process. By using a threshold value according to the color of the coating material, diagnostic accuracy can be maintained.
[0043] (6) A diagnostic device according to a sixth aspect is a diagnostic device for diagnosing a damage state of a coating material coated on the surface of a component, and includes: a means for setting a diagnostic target portion, which is a location for diagnosing the damage state in an image of the surface of the component; a means for specifying a reference portion, which is a location in the image where the damage state is not present; a means for calculating the L*a*b* values of the diagnostic target portion and the reference portion; a means for calculating the color difference between the L*a*b* value of the diagnostic target portion and the L*a*b* value of the reference portion; and a means for diagnosing the damage state of the diagnostic target portion from the color difference.
[0044] (7) A program according to a seventh aspect causes a computer to execute a diagnostic process for diagnosing a damage state of a coating material applied to the surface of a component, the diagnostic process comprising the steps of: setting a diagnostic target area, which is a location where the damage state is to be diagnosed, in an image of the surface of the component; specifying a reference area, which is a location where the damage state is not present in the image; calculating the L*a*b* values of the diagnostic target area and the reference area; calculating the color difference between the L*a*b* value of the diagnostic target area and the L*a*b* value of the reference area; and diagnosing the damage state of the diagnostic target area from the color difference. [Explanation of symbols]
[0045] 100 Diagnostic System 6. Camera 10. Terminal device 11 Input reception section 12. Image acquisition unit 13...Display section 14. Control section 15...Storage section 16. Communications Department 20 Diagnostic Server 21. Data acquisition section 22 Control section 221···Diagnostic Department 23...Storage section 24. Communications Department 900···Computer 901 CPU 902...Main memory 903...Auxiliary storage device 904 Input / Output Interface 905···Communication Interface
Claims
1. A method for diagnosing a damage state of a coating material coated on a surface of a member, comprising: A step of setting a diagnosis target portion, which is a portion for diagnosing the damage state, in an image obtained by photographing the surface of the component; designating a reference portion in the image where the damage condition is not present; calculating L*a*b* values of the diagnostic target portion and the reference portion, respectively; calculating a color difference between the L*a*b* values of the diagnostic object portion and the L*a*b* values of the reference portion; diagnosing a damage state of the diagnosis target part based on the color difference; and the image in which the diagnostic target portion is set and the image in which the reference portion is specified are the same; Diagnostic methods.
2. A method for diagnosing a damage state of a coating material coated on a surface of a member, comprising: A step of setting a diagnosis target portion, which is a portion for diagnosing the damage state, in an image obtained by photographing the surface of the component; designating a reference portion in the image where the damage condition is not present; calculating a distance between the diagnostic target portion and the reference portion; If the distance exceeds a predetermined first threshold, resetting the reference portion or the diagnosis target portion; calculating L*a*b* values of the diagnostic target portion and the reference portion, respectively; calculating a color difference between the L*a*b* values of the diagnostic object portion and the L*a*b* values of the reference portion; diagnosing a damage state of the diagnosis target part based on the color difference; and In the step of calculating the distance, a distance on the image between pixels included in the range designated as the reference portion and pixels included in the range designated as the diagnostic target portion is converted into a distance on the member, and the converted distance is set as the distance between the diagnostic target portion and the reference portion. Diagnostic methods.
3. a step of determining whether the diagnostic target portion is appropriate based on the L*a*b* values of the diagnostic target portion; The diagnostic method according to claim 1 or claim 2, further comprising:
4. a step of determining whether the reference portion is appropriate or not based on the L*a*b* values of the reference portion; and In the step of determining whether the reference portion is appropriate, an average value of L*a*b* values of a plurality of pixels included in the reference portion is calculated, and if the average value of L* is equal to or greater than a predetermined threshold value and the average values of a* and b* are each included in the color range of the area coated with the coating material, the reference portion is determined to be appropriate, and if not, the reference portion is determined to be inappropriate. The diagnostic method according to any one of claims 1 to 3.
5. calculating a distance between the diagnostic target portion and the reference portion; If the distance exceeds a predetermined first threshold, resetting the reference portion or the diagnosis target portion; and In the step of calculating the distance, a distance on the image between pixels included in the range designated as the reference portion and pixels included in the range designated as the diagnostic target portion is converted into a distance on the member, and the converted distance is set as the distance between the diagnostic target portion and the reference portion. The diagnostic method according to any one of claims 1 to 4.
6. In the diagnosing step, the color difference is compared with a predetermined second threshold value corresponding to the color of the coating material, and if the color difference is equal to or greater than the second threshold value, it is determined that the coating material of the diagnosis target portion is damaged. The diagnostic method according to any one of claims 1 to 5, further comprising:
7. A diagnostic device for diagnosing a damage state of a coating material coated on a surface of a member, comprising: a means for setting a diagnosis target portion, which is a portion for diagnosing the damage state, in an image obtained by photographing the surface of the component; a means for designating a reference portion, which is a portion of the image where the damaged state does not exist; means for calculating the L*a*b* values of the diagnostic target portion and the reference portion, respectively; means for calculating a color difference between the L*a*b* values of the diagnostic object portion and the L*a*b* values of the reference portion; a means for diagnosing a damage state of the diagnosis target part based on the color difference; and the image in which the diagnostic target portion is set and the image in which the reference portion is specified are the same; Diagnostic equipment.
8. A diagnostic device for diagnosing a damage state of a coating material coated on a surface of a member, comprising: a means for setting a diagnosis target portion, which is a portion for diagnosing the damage state, in an image obtained by photographing the surface of the component; a means for designating a reference portion, which is a portion of the image where the damaged state does not exist; a means for calculating a distance between the diagnostic object portion and the reference portion; a means for resetting the reference portion or the diagnostic object portion when the distance exceeds a predetermined first threshold; means for calculating the L*a*b* values of the diagnostic target portion and the reference portion, respectively; means for calculating a color difference between the L*a*b* values of the diagnostic object portion and the L*a*b* values of the reference portion; a means for diagnosing a damage state of the diagnosis target part based on the color difference; and the distance calculation means converts a distance on the image between pixels included in the range designated as the reference portion and pixels included in the range designated as the diagnostic target portion into a distance on the member, and sets the converted distance as the distance between the diagnostic target portion and the reference portion. Diagnostic equipment.
9. On the computer, A process for diagnosing a damage state of a coating material coated on a surface of a component, comprising: A step of setting a diagnosis target portion, which is a portion for diagnosing the damage state, in an image obtained by photographing the surface of the component; designating a reference portion in the image where the damage condition is not present; calculating L*a*b* values of the diagnostic target portion and the reference portion, respectively; calculating a color difference between the L*a*b* values of the diagnostic object portion and the L*a*b* values of the reference portion; diagnosing a damage state of the diagnosis target part based on the color difference; and a diagnostic process in which the image in which the diagnostic target portion is set and the image in which the reference portion is specified are identical;
10. On the computer, A process for diagnosing a damage state of a coating material coated on a surface of a component, comprising: A step of setting a diagnosis target portion, which is a portion for diagnosing the damage state, in an image obtained by photographing the surface of the component; designating a reference portion in the image where the damage condition is not present; calculating a distance between the diagnostic target portion and the reference portion; If the distance exceeds a predetermined first threshold, resetting the reference portion or the diagnosis target portion; calculating L*a*b* values of the diagnostic target portion and the reference portion, respectively; calculating a color difference between the L*a*b* values of the diagnostic object portion and the L*a*b* values of the reference portion; diagnosing a damage state of the diagnosis target part based on the color difference; and In the step of calculating the distance, a program is executed to execute a diagnostic process in which the distance on the image between the pixels included in the range designated as the reference part and the pixels included in the range designated as the diagnostic target part is converted into a distance on the component, and the converted distance is set as the distance between the diagnostic target part and the reference part.
Citation Information
Patent Citations
Method and apparatus for inspection of components
EP2607890A1
Film thickness measuring method and device thereof, and thin film producing system
JP2008205188A
Quantization method for scratch-induced surface damage on polymeric and coating materials
JP2011220995A
Image inspection device, printing system, and image inspection method and program
JP2012137481A
Device and method for inspecting material having coated surface
JP2015155895A