Image comparison system, image comparison method, and image comparison program

By designing an image comparison system, obtaining and comparing the images and test conditions of the plating test, the problem of relying on operators to visually judge in the plating test is solved, and more accurate and reliable detection results are achieved, which promotes the inheritance and application of technology. .

CN119452243APending Publication Date: 2025-02-14YAMAMOTO MS
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202380044230.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-06-30
Filing Date
2023-05-08
Publication Date
2025-02-14

AI Technical Summary

Technical Problem

In plating tests, the prior art relies on the operator's visual confirmation and judgment, which results in the accuracy of the detection results dependent on the operator's professional level and is difficult to effectively inherit and apply.

Method used

An image comparison system is designed that by acquiring the result images of the plating test, storing the test conditions, extracting other images under similar conditions, and displaying the newly acquired images and similar images in a comparable manner on the display section so as to The operator makes the judgment.

Benefits of technology

The system can effectively provide the judgment materials for plating tests, reduce dependence on the professional level of the operator, improve the accuracy and reliability of the test results, and help the inheritance and application of technology.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119452243A_ABST
    Figure CN119452243A_ABST
Patent Text Reader

Abstract

An image comparison system (300) is provided with: an acquisition unit (111) for acquiring a surface state image of a metal sheet indicating the result of a plating test; a condition acquisition unit (113) that acquires test conditions for the plating test with respect to the newly acquired surface state image; a storage unit (120) that stores the surface state image and test conditions; an extraction unit (114) that extracts, from the storage unit (120), another surface state image in which at least some of the test conditions match the test conditions of the newly acquired surface state image; and a display control unit (115) that causes a display unit (160) to display, in a comparable manner, the newly acquired surface state image and the other surface state image extracted by the extraction unit (114).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an image comparison system, an image comparison method and an image comparison program. Background Art

[0002] Conventionally, the Hall cell test has been performed as a test related to plating. The Hall cell test is widely used internationally as a basic test for process management in electroplating.

[0003] In the plating process, there are various factors that affect the coating state, so there are many unexpected causes. The Hall cell test can quickly find the cause of the appearance change that cannot be compensated by chemical analysis, so it is helpful.

[0004] However, in the Hall cell test, the operator visually confirms and judges the metal film generated by electrodeposition. Therefore, the Hall cell test has a part that depends on the operator's human ability. In particular, the number of technicians has also decreased, and the shortage of technicians is worrying in terms of technology inheritance and future-oriented technology application.

[0005] Here, as a technology related to the Hall slot test, a surface inspection device is disclosed in, for example, Patent Document 1. In the abstract of the surface inspection device in Patent Document 1, it is recorded that: "A surface inspection device 10 for inspecting defects on the surface of an inspection object comprises: an illumination device 20 having a planar light emitting area 20a, irradiating the surface of an inspection object 50 with diffuse light from the planar light emitting area 20a; a photographing device 30 photographing the surface of the inspection object 50 illuminated by the illumination device 20 to generate a photographed image; and a determination device 40 determining the presence or absence of defects on the surface of the inspection object 50 based on the photographed image 30. The illumination device 20 is configured so that the regular reflection direction of the optical axis of the photographing device 30 on the surface of the inspection object 50 coincides with the normal of the light emitting area at the center of the light emitting area."

[0006] Prior art literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2021-179331 Summary of the invention

[0009] Problem that the invention aims to solve

[0010] The surface inspection device described in Patent Document 1 uses a steel plate with an electroplated surface as an inspection object, and can appropriately detect dirt defects generated on the surface of the inspection object with a large surface roughness. In particular, in the surface inspection device of Patent Document 1, the light emitting area of ​​the lighting device is planar, thereby suppressing the formation of bright and dark parts even if there are unevenness on the surface of the inspection object.

[0011] However, even when the surface inspection device described in Patent Document 1 is used, an operator needs to visually check the test result of the inspection target surface and needs to judge the test result based on a captured image of the inspection target object.

[0012] Therefore, even if the contamination defect can be detected by the surface inspection device described in Patent Document 1, the detection of the contamination defect has no meaning unless the operator can judge whether the test result is good or bad. In particular, from the perspective of technology inheritance and future technology application, the operator cannot effectively use the technology accumulated by skilled workers to judge the test results.

[0013] Therefore, the present invention has been made in view of the above-mentioned problems, and an object of the present invention is to easily provide information serving as a judgment material with respect to the test results of a plating test.

[0014] The means used to solve the problem

[0015] That is, the above-mentioned problem of the present invention is solved by the following structure.

[0016] The image comparison system of the present invention is characterized in that it comprises: an acquisition unit, which acquires a surface state image of a metal sheet representing the result of a plating test; a condition acquisition unit, which acquires the test conditions of the plating test for the newly acquired surface state image; a storage unit, which stores the surface state image and the test conditions; an extraction unit, which extracts from the storage unit other surface state images whose at least part of the test conditions are consistent with the test conditions of the newly acquired surface state image; and a display control unit, which enables the display unit to display the newly acquired surface state image and other surface state images extracted by the extraction unit in a comparable manner.

[0017] Effects of the Invention

[0018] According to the present invention, it is possible to easily provide information serving as a judgment material with respect to the test results of the plating test. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1A : is an explanatory diagram showing the structure of the Hall cell test.

[0020] Figure 1B 1 is an explanatory diagram showing a Hall cell water tank.

[0021] Figure 2 : is an explanatory diagram showing the overall configuration of the image comparison system according to the present embodiment.

[0022] Figure 3 1 is an explanatory diagram showing the main hardware configuration of the image comparison system according to the present embodiment.

[0023] Figure 4 This is a functional block diagram showing the functions of the CPU of the information processing device according to the present embodiment.

[0024] Figure 5A This is a flowchart (part 1) showing the operation of the image comparison system according to the present embodiment.

[0025] Figure 5B This is a flowchart (part 2) showing the operation of the image comparison system according to the present embodiment.

[0026] Figure 5C This is a flowchart (part 3) showing the operation of the image comparison system according to the present embodiment.

[0027] Figure 6 1 is an explanatory diagram showing a display screen of the Hall cell test image comparison system.

[0028] Figure 7 It is an explanatory diagram showing a screen displaying a cover page.

[0029] Figure 8 This is a display screen showing a captured image of the surface state of a metal sheet.

[0030] Fig. 9 This is an input screen for inputting test conditions regarding the surface condition image of the metal sheet.

[0031] Fig. 10A It is an explanatory diagram showing the upper half of the entry items on the input screen.

[0032] Fig. 10B It is an explanatory diagram showing the lower half of the entry items on the input screen.

[0033] Fig.11 This is a display screen showing priority items when performing data comparison of surface state images.

[0034] Fig.12 On the right side, other surface status images are extracted in descending order of date.

[0035] Fig.13 This is a display screen in which other surface state images corresponding to the five areas are extracted.

[0036] Fig.14It is a display screen that compares the visible light image displayed in the area with the visible light image displayed in the area.

[0037] Fig.15 The display screen shows an overlapping display in which a visible light image and a visible light image are overlapped.

[0038] Fig.16 This is a display screen showing a graph indicating the degree of surface unevenness in a polarization image.

[0039] Fig.17 This is a display screen that calls up past data and displays the presence or absence of other surface status images on the calendar.

[0040] Fig.18A This is a diagram that defines terms regarding surface roughness when nickel is used.

[0041] Fig.18B This is a diagram about the color, luster, and definition terms when using nickel. DETAILED DESCRIPTION

[0042] Hereinafter, the mode for carrying out the present invention will be described in detail.

[0043] <Overview of this Embodiment>

[0044] The image comparison system of this embodiment captures the surface state of a metal sheet that has been subjected to a plating test by electroplating, and obtains a surface state image of the metal sheet. The operator observes the obtained surface state image and determines the state of the surface. As an example of a plating test, a Hall slot test is applied, with the precipitation state of the metal sheet under a continuous current density as the object. In addition, the image comparison system of this embodiment is not limited to the Hall slot test of the plating test, and can also be applied to tests such as uniformity tests and adhesion tests where the operator visually determines.

[0045] [Hall cell test]

[0046] First, the Hall cell test is described. The Hall cell test is a test method in which a cathode (test piece) is plated in a Hall cell water tank using a small amount of plating solution and the state of the plating bath is observed. The plating solution may be copper, nickel, zinc, or the like.

[0047] Figure 1A 1 is an explanatory diagram showing the structure of the Hall slot test. The Hall slot test 400 (plating device) is composed of a Hall slot water tank 401, an anode plate CP provided on a side wall 402 on the left side of the Hall slot water tank 401, a cathode plate (metal plate OB as a test piece) provided on a side wall 403 on the right side of the Hall slot water tank 401, a voltmeter 404, an ammeter 405, and a power supply device (rectifier) ​​406.

[0048] In the Hall slot test 400 of the present embodiment, the metal sheet OB is plated by using the Hall slot water tank 401, the power supply device 406, the anode plate CP and the cathode plate (metal sheet OB), and the surface state of the metal sheet OB after the plating (the state of the plating precipitated on the surface of the cathode plate) is observed. The anode plate CP can be made of oxygen-free copper, electrolytic nickel, etc., and the cathode plate (metal sheet OB) can be made of iron, brass, etc. The Hall slot test 400 is performed using a water tank called the Hall slot water tank 401 so that the bath state can be easily observed in a short time using a small amount of plating solution.

[0049] Figure 1B 1 is an explanatory diagram showing a Hall cell water tank. The Hall cell water tank 401 has a trapezoidal shape and has a structure in which the right side wall 403 is arranged obliquely relative to the left side wall 402. The Hall cell water tank 401 changes the inter-electrode distance between the anode plate CP and the cathode plate (metal sheet OB) by obliquely arranging the right side wall 403, so that the current distribution state has a gradient.

[0050] Therefore, in the Hall cell test 400, in the cathode plate (metal sheet OB) of the Hall cell water tank 401, the closer the inter-electrode distance between the side wall 402 and the side wall 403 on the upper side of the trapezoid, the higher the current density, and the farther the inter-electrode distance between the side wall 402 and the side wall 403 on the lower side of the trapezoid, the lower the current density. In this way, in the Hall cell test 400, a coating with a wide current density range can be obtained in the metal sheet OB constituting the cathode plate, so that a large current density area can be observed at one time.

[0051] <Overall Structure of Image Comparison System>

[0052] Figure 2 FIG. 2 is an explanatory diagram showing the overall configuration of the image comparison system of the present embodiment. Figure 2 As shown, the image comparison system 300 of the present embodiment includes an information processing device 100 and an imaging unit 200 .

[0053] The operator performs a plating test on the metal sheet OB constituting the cathode plate, and forms the result of the plating test on the surface of the metal sheet OB. The metal sheet OB is placed on the base FD, and the operator uses the imaging unit 200 to photograph the metal sheet OB placed on the base FD.

[0054] In addition, in the present embodiment, the process of generating a surface state image of the metal sheet OB by photographing the surface of the metal sheet OB by the photographing unit 200 is referred to as photographing. The plating test in the present embodiment is a Hall cell test, in which a current whose current density continuously changes within a prescribed range is passed through the metal sheet OB placed in the plating bath, and the result of depositing the plating layer is photographed.

[0055] The information processing device 100 acquires a plurality of surface state images captured by the imaging unit 200, and associates the test conditions or on-site phenomena with the surface state images of the metal sheet OB through software (application). Thus, the information processing device 100 can predict the current bath state of the metal sheet OB, possible plating defects in the future, and the like.

[0056] <Details of this embodiment>

[0057] [Hardware Structure of Image Comparison System]

[0058] Figure 3 1 is an explanatory diagram showing the main hardware configuration of the image comparison system according to the present embodiment.

[0059] The information processing device 100 includes a CPU (Central Processing Unit) 110, a storage unit 120, a ROM (Read Only Memory) 130, a RAM (Read Access Memory) 140, an input unit 150, a display unit 160, and an internal bus 195. The information processing device 100 includes, for example, but is not limited to, a notebook personal computer, a personal computer, or a tablet terminal.

[0060] The CPU 110 , the storage unit 120 , the ROM 130 , and the RAM 140 function as the application program 170 when the CPU 110 executes a control program (not shown) stored in the storage unit 120 or the ROM 130 .

[0061] CPU 110 is a central processing unit that executes a control program stored in storage unit 120 or ROM 130 to realize Figure 4 The processes shown.

[0062] The storage unit 120 is a large-capacity storage device, and is composed of, for example, a nonvolatile memory (so-called flash memory), a hard disk drive, etc. The storage unit 120 stores, for example, a control program, a surface state image of the metal piece OB, and test conditions of a Hall slot test.

[0063] RAM 140 reads control programs from ROM 130 during various processes executed and controlled by CPU 110 , and functions as a work area for temporarily storing various programs executable by CPU 110 , input data, output data, and parameters.

[0064] The input unit 150 is configured to include an input device including cursor keys, numeric input keys, and various function keys. The input unit 150 outputs a pressing signal or an operation signal of a pressed key as an input signal to the CPU 110. The CPU 110 executes various processes based on the pressing signal or the operation signal from the input unit 150.

[0065] The display unit 160 is constituted by, for example, a monitor of an LCD (Liquid Crystal Display). The display unit 160 displays the surface state image of the metal sheet OB according to the instruction of the display signal input from the CPU 110. In addition, the display unit 160 and the input unit 150 can also adopt a touch panel display.

[0066] The internal bus 195 electrically connects the components in the information processing device 100 to each other.

[0067] The imaging unit 200 includes a visible light camera 201 for imaging with visible light and a polarization camera 202 for imaging with predetermined polarized light. The visible light camera 201 and the polarization camera 202 each capture the surface state of the metal sheet OB and acquire a new surface state image.

[0068] The visible light camera 201 generates a visible light image, and thereby the operator determines, for example, the color tone of a coating on the metal sheet OB or the darkening of an eschar. The visible light image includes an optical image and a digital image.

[0069] The polarization camera 202 captures polarization information of light transmitted in a predetermined polarization direction through each polarizer having a predetermined polarization direction. The polarization camera 202 generates a polarization image, thereby allowing the operator to determine surface irregularities (about 0.1 mm) such as eschar, high-frequency vibration (swelling), and pits (macroscopic holes). In addition, the captured image captured by the imaging unit 200 includes a visible light image and a polarization image.

[0070] [Structure of Functional Blocks of Information Processing Device]

[0071] Next, we will use Figure 4 The processing of the CPU 110 of the information processing device 100 of this embodiment will be described. Hereinafter, the same components are denoted by the same reference numerals, and the description thereof will be appropriately omitted.

[0072] Figure 41 is a functional block diagram showing the functions of the CPU 110 of the information processing device 100 of the present embodiment. The CPU 110 implements the acquisition unit 111, the registration unit 112, the condition acquisition unit 113, the extraction unit 114, the display control unit 115, the detailed display reception unit 116, etc. by executing the control program stored in the storage unit 120.

[0073] The display control unit 115 includes a concavity and convexity degree analyzing unit 115a and a date calling unit 115b. The detailed display receiving unit 116 includes a detailed information extracting unit 116a.

[0074] Furthermore, the CPU 110 implements the appearance region dividing unit 117 , the current density display unit 118 , and the transmission image generating unit 119 by executing the control program stored in the storage unit 120 .

[0075] The acquisition unit 111 acquires a surface state image of the metal sheet OB indicating the result of the plating test from the imaging unit 200 . The acquisition unit 111 acquires a visible light image from the visible light camera 201 , and acquires a polarized light image from the polarized light camera 202 .

[0076] The registration unit 112 stores the surface state image of the metal sheet OB acquired by the acquisition unit 111 in the storage unit 120 .

[0077] The condition acquisition unit 113 acquires the test conditions of the plating test for the newly acquired surface state image. The condition acquisition unit 113 displays on the display unit 160: for example, as described later Fig. 9 The condition acquisition unit 113 associates the test conditions input from the input unit 150 with the newly acquired surface condition image and stores the associated test conditions in the storage unit 120 .

[0078] The extraction unit 114 refers to the test conditions of the newly acquired surface state image and extracts from the storage unit 120 other surface state images pre-stored in the storage unit 120, at least a portion of which has the same test conditions as the test conditions of the newly acquired surface state image. Fig. 10A In the Hall cell condition 551, the extraction unit 114 extracts from the storage unit 120: plating type, total current ([A]), test time ([minutes]), temperature ([°C]), stirring, and other surface state images in which at least part of the test conditions of the operator and the photographer are consistent. For example, the Hall cell condition 551 is: the type of plating is nickel [Ni], the total current is 5 [A], the test time is 5 minutes, the temperature of the plating solution is 50°C, and there is no stirring.

[0079] In addition, the extraction unit 114 may have a plurality of items with different reference and test conditions, and may receive a selection of one item from the plurality of items and preferentially extract other corresponding surface state images. Fig.11 The priority items accept a priority item and extract other surface state images, such as Fig.12 As shown in FIG. 1 , the other extracted surface state images are displayed by the display control unit 115 .

[0080] The display control unit 115 causes the display unit 160 to display the newly acquired surface state image and the other surface state images extracted by the extraction unit 114 in a comparable manner. In addition, the display control unit 115 can cause the display unit 160 to display the visible light image captured by the visible light camera 201 and / or the polarized light image captured by the polarized light camera 202 as the new surface state image. In this case, when any one of the visible light image and the polarized light image as the new surface state image is selected, the display control unit 115 causes the display unit 160 to display the corresponding image of the visible light image and the polarized light image as the other surface state image.

[0081] For example, as described below Fig.13 As shown, the display control unit 115 causes the display screen 590 to display the new surface state images, the visible light image 532 and the polarized light image 537. In this case, the display control unit 115 can display the visible light image or the polarized light image as other surface state images extracted by the extraction unit 114 in a comparable manner.

[0082] The concavo-convex degree analyzing unit 115a analyzes the degree of concavo-convexity on the surface of the metal sheet OB based on the distance from the end of the polarized light image or the end of the metal sheet, and displays it on the display unit 160. For example, as described later Fig.16 As shown in FIG. 621 , the concavity and convexity degree analysis unit 115 a analyzes the degree of concavity and convexity in the surface of the polarized light image 537 .

[0083] The date calling unit 115b works in conjunction with the extracting unit 114 to display on the calendar whether or not there are other surface state images based on the image shooting date extracted by the extracting unit 114. For example, the extracting unit 114 extracts other surface state images whose at least a part of the test conditions are consistent with the test conditions of the newly acquired surface state image based on the shooting date of the other surface state images. For example, as described later Fig.17As shown, the date calling unit 115b displays on the calendar 640 of the display unit 160 whether there are other surface state images based on the image shooting date extracted by the extraction unit 114. Thus, when a date having other surface state images displayed on the calendar is selected, the date calling unit 115b can cause the display unit 160 to display other surface state images shot on the selected date.

[0084] When the extraction unit 114 extracts a plurality of other surface state images, the detailed display receiving unit 116 receives a detailed display instruction for the state of another surface of any one of the plurality of other surface state images extracted by the extraction unit 114. Fig.12 As shown, when the extraction unit 114 extracts a plurality of other surface state images 580a to 585a, the detailed display receiving unit 116 receives a detailed display instruction of other surface state images to be compared with the newly acquired surface state image through the selection of the operator. Fig.14 As shown, the display control unit 115 can display the newly acquired surface state image and the selected other surface state images on the display unit 160 in a manner that allows comparison.

[0085] The detailed information extraction unit 116a extracts detailed information from the storage unit 120 for each of the other surface state images and the newly acquired surface state image. In the storage unit 120, detailed information including at least one of the state of the surface of the metal sheet OB, the test conditions, the treatment method, the treatment result, and the remarks column is associated with each of the other surface state images and the newly acquired surface state image. For example, Fig.14 As shown, the display control unit 115 is capable of displaying the input screen 542 of the visible light image 532 (detailed information of the newly acquired surface state image) extracted by the detailed information extraction unit 116a and the input screen 611 of the visible light image 572a (detailed information of other surface state images) in a comparable manner.

[0086] The appearance area division unit 117 divides the surface of the metal sheet OB into a plurality of areas. The appearance area division unit 117 receives a judgment on whether the test result is good or not in each of the divided areas. Therefore, the operator inputs a judgment on whether the test result is good or not in each divided area. For example, as described later Fig. 9 As shown in the regions 534 and 539, the appearance region dividing unit 117 divides the surface of the metal sheet OB into five regions. Fig. 10B As shown in the partition item 554 of the input screen 542, the operator can determine whether each of the five areas is qualified or not.

[0087] The current density display unit 118 obtains the position information of the newly obtained surface state image or other surface state images from the end of the image or the end of the metal sheet OB in the image, and displays the current density at the obtained position information on the display unit 160. Fig. 9 When the position of line 535 is specified on the surface state image, the current density display unit 118 displays the current density at that position. In addition, the current density can be calculated by, for example, a relational expression of a primary current distribution model of a Hall cell water tank or a Hall cell quick lookup table.

[0088] The display control unit 115 can overlap and display the newly acquired surface state image with any of the other surface state images extracted by the extraction unit 114. In this case, the display control unit 115 can overlap the other surface state images with a part of the newly acquired surface state image.

[0089] The transmission image generation unit 119 transmits one of the other surface state images and the newly acquired surface state image. Therefore, the display control unit 115 can display the transmitted captured image of one of the surfaces and the captured image of the other surface in an overlapping manner. For example, as described later Fig.15 As shown, the display control unit 115 can change any one of the visible light image 532 displayed in the area 571 and the visible light image 572a displayed in the area 572 to a transmissive image, and display them in an overlapping manner in a semi-transparent state.

[0090] <Operation of Image Comparison System>

[0091] FIG. 5A to FIG. 5C The operation of the image comparison system of this embodiment is shown in the flowchart. Figures 2 to 4 As well as the display screen Figures 7 to 18B Provide explanation.

[0092] In the information processing device 100 of the image comparison system 300, when the application program 170 is executed, the Hall slot test image comparison system starts ( Figure 5A Step S001 in Figure 6 ).

[0093] Figure 6 2 is an explanatory diagram showing a display screen of a Hall slot test image comparison system. Figure 6 As shown, selection buttons 501 and 502 are displayed on a display screen 500 of the image comparison system 300. The selection button 501 is a selection button for performing image comparison for Hall cell management, and the selection button 502 is a selection button for performing image comparison for use other than Hall cell.

[0094] When the image is used for Hall slot management ("Yes" in step S002), the operator selects the selection button 501 through the input unit 150, and a screen 510 showing the cover page is displayed on the display unit 160 (step S003, Figure 7 ).

[0095] On the other hand, when using the system for purposes other than the Hall cell test (No in step S002), the operator selects the selection button 502 via the input unit 150 to start another management application (step S004). The image comparison system 300 proceeds to step S003 in conjunction with the started other management application.

[0096] Figure 7 2 is an explanatory diagram showing a screen displaying a cover page. Figure 7 As shown, four operation buttons 511 to 514 are displayed on the screen 510 (step S003).

[0097] Operation button 511 is a button for executing photo shooting. Operation button 512 is a button for confirming past data. Operation button 513 is a button for changing registered information. Operation button 514 is a button for confirming the definition of a term.

[0098] return Figure 5A The image comparison system 300 waits for the operator's operation selection (step S003). If the operation button 511 for executing photo shooting is selected, the image comparison system 300 enters the Figure 5B Step S005.

[0099] In step S005, the operator places the metal sheet OB on the dedicated base FD and captures the visible light image and the polarized light image using the imaging unit 200. Alternatively, the operator may slide the base FD to capture the visible light image and the polarized light image separately.

[0100] Figure 8 The image of the surface state of the metal sheet is displayed (step S005). Figure 8 As shown, in a display screen 520 of the image comparison system 300, a surface state image of a metal sheet 522 is displayed in an area 521. A photographing button 523 is provided on the display screen 520, and the operator presses the photographing button 523 to photograph the surface state image of the metal sheet 522.

[0101] Fig. 9 This is an input screen for inputting test conditions with respect to the surface state image of the metal sheet (step S006). In the input screen 530, the surface state image of the metal sheet 522 is displayed in areas 531 and 536. The operator inputs the test details through the input screen 542.

[0102] A visible light image 532 of the metal piece 522 is displayed in the region 531. A switch 533 is provided in the region 531, and when the switch 533 is turned "on", the visible light image 532 is divided into five regions 534 A to E and displayed. The size of the visible light image 532 is, for example, 10×20 [mm].

[0103] A polarized light image 537 of the metal piece 522 is displayed in the region 536. A switch 538 is also provided in the region 536. By turning the switch 538 to “ON”, the polarized light image 537 is divided into five regions 539 from A to E and displayed. The polarized light image 537 has the same size as the visible light image 532, and the regions 534 and 539 are extracted and displayed in the region 541.

[0104] The five areas 534 and 539 are shown with frame lines between 25 [mm] and 35 [mm] from the bottom of the metal sheet 522 .

[0105] The operator operates the mouse to move the line 535 left and right on the visible light image 532. The line 535 displays on the scale 540: the distance from the left end of the visible light image 532 or the distance from the end of the metal sheet OB in the visible light image 532 and the current density at that position.

[0106] In this case, the current density display unit 118 obtains the position information of the end of the distance image or the end of the metal sheet OB in the image in the visible light image 532 or the polarized light image 537, and displays the current density (A / dm 2 ).

[0107] Fig. 10A , 10B This is an explanatory diagram showing entry items on the input screen. Fig. 10A Indicates the upper part of the input screen. Fig. 10B The lower half of the entry items on the input screen is displayed (step S006).

[0108] exist Fig. 10A The shooting conditions 550 of the input screen 542 shown include shooting date, day of the week, weather, temperature ([°C]), humidity ([%]), and other items. For example, the operator enters May 11, 2020, Tuesday, sunny, temperature 25[°C], humidity 60[%], etc. as the date of shooting the metal sheet 522.

[0109] In the Hall cell condition 551 of the input screen 542, the type of plating to be tested in the Hall cell, the total current ([A]), the test time ([minutes]), the temperature ([°C]), stirring, the operator, the photographer, etc. are input. For example, the operator inputs the type of plating as Ni (watt), the total current as 5 [A], the test time as 5 [minutes], the temperature as 50 [°C], the stirring as none, and the operator and the photographer as XYZ.

[0110] Thus, the extraction unit 114 extracts from the storage unit 120: for example, other surface state images that are consistent with at least some of the test conditions in the Hall slot conditions 551, including the plating type, total current ([A]), test time ([minutes]), temperature ([°C]), stirring, operator, and photographer.

[0111] In the pass / fail item 552 of the input screen 542, whether the test result is pass or not is inputted by a pull-down button. For example, the operator inputs pass.

[0112] In the overall item 553 of the input screen 542, fill in the overall state of the metal sheet 522, for example, input: good or bad, the presence or absence of gloss, the presence or absence of color tone, etc. In addition, as problem points, enter eschar, blur, pits, color tone, others, etc. In addition, as the cause of the defect, for the plating solution, enter the concentration of additives, bath composition, impurity mixing, others, etc. In addition, for the pretreatment of the defect cause, enter poor degreasing, poor pickling, poor water washing, others, etc. In terms of post-processing as the cause of the defect, enter poor water washing, poor drying, others, etc. In addition, the input in the overall item 553 is entered in the form of checking a box.

[0113] exist Fig. 10B In the partition item 554 of the input screen 542, Fig. 9 The current density range (ASD = A / dm 2 ), features, pass / fail, etc. Regarding current density, the current density can be automatically calculated by turning on the switch 533 of the visible light image 532 and automatically input into each area A to E.

[0114] The appearance region dividing unit 117 divides the surface of the metal sheet 522 into five regions (a plurality of regions), and receives determination of the test result in each of the five regions.

[0115] For example, for A, the current density range (ASD) is automatically input as 30-18, and "with eschar" is input by pulling down. For B, the current density range (ASD) is automatically input as 18-9, and "with gloss" is input by pulling down. For C, the current density range (ASD) is automatically input as 9-5, and "with pits" is input by pulling down. For D, the current density range (ASD) is automatically input as 5-1.8, and "without fuzziness" is input by pulling down. For E, the current density range (ASD) is automatically input as 1.8-0.2, and "without special features" is input by pulling down. In addition, for each area A to E, input whether it is qualified or not by pulling down.

[0116] In the input field 555a of the countermeasure on the input screen 542, the operator inputs the countermeasure, the result of the countermeasure, etc. When the operator presses the button 555b, the Hall slot technology set in which the Hall slot technology is integrated is displayed in a referenceable manner.

[0117] When a defect occurs in the Hall cell test, the operator inputs comments in the response result input field 556 of the input screen 542. In addition, the operator can add a product photo when the defect occurs or a photo of the metal sheet OB after treatment by pressing a button 558.

[0118] In the remark column 557 of the input screen 542, when a special result is obtained, the operator inputs a comment. When the operator presses the button 559, the surface state image taken in the past is displayed in a manner that allows comparison. In this case, the surface state image is displayed based on the items set by the operator, such as good examples (standard), bad examples, threshold examples, attention needs, and others.

[0119] return Figure 5B , and continue to explain. In step S006, when the input of the test conditions of the photographed photos is completed, the process proceeds to step S007 to wait for the selection of the data to be compared. Figure 5A In step S003, even when "confirmation of past data" is selected, the process proceeds to step S007.

[0120] Fig.11 This is a display screen showing the priority items when performing data comparison of the surface state images (step S007 ). On the display screen 560 of the image comparison system 300 , a selection button 568 for selecting the type of plating and item selection buttons 561 to 566 for selecting the priority items are displayed.

[0121] The selection button 568 is a button (input field) for selecting the type of plating by pulling down. In the present embodiment, Cu (copper sulfate) is selected as the type of plating by pulling down.

[0122] The item selection buttons 561 to 566 indicate a plurality of items having different reference and test conditions. The item selection buttons 561 to 566 allow the extraction unit 114 to accept selection of one item from the plurality of items and preferentially extract the corresponding other surface condition images.

[0123] Item selection button 561 extracts other surface state images according to date. Item selection button 562 extracts other surface state images according to the day of the week. Item selection button 563 extracts other surface state images according to area determination. Item selection button 564 extracts only the captured images of other surface state images determined to be good. Item selection button 565 extracts other surface state images according to the type of defect. Item selection button 566 extracts other surface state images according to other conditions.

[0124] return Figure 5B When a date is selected by the item selection button 561, the image comparison system 300 proceeds to Figure 5C In step S008, other surface state images are displayed.

[0125] Fig.12 The display screen 570 is a screen in which other surface state images are extracted in descending order of date (step S008). On the right side of the display screen 570, about 6 to 10 surface state images (photographed images) are displayed as past photographing results.

[0126] exist Fig.12 In the region 571 shown, a newly acquired visible light image 532 captured by the imaging unit 200 is displayed. In the region 572, a visible light image 572a is displayed. In addition, in the region 573, a surface state image 573a is displayed. In addition, when the type of plating is "Cu (copper sulfate)", for example, the region 572 and the region 573 display a preset surface state image.

[0127] Areas 572 and 573 display the surface state image preset by the operator, for example, the surface state image set each time is displayed according to the type of plating. Therefore, in areas 572 and 573, when the "type of plating" is "Cu (copper sulfate)", the same surface state image is displayed each time, so, for example, a color can be added to the column of the shooting date to indicate that a fixed image is displayed.

[0128] Thus, in area 572, a visible light image 572a set to be displayed each time according to the "type of plating" is displayed, and in the visible light image 572a, for example, a standard photo just after the bath is built is displayed. In addition, in area 573, as a reference for comparison, a surface state image 573a preset by the operator according to the "type of plating" is displayed each time, and the surface state image 573a, for example, displays a captured image that becomes a threshold for judging pass / fail or a captured image with a bad test result.

[0129] In area 580, in order of date from new to old, a surface condition image 580a taken last is displayed. In area 581, a surface condition image 581a taken the day before last is displayed. In areas 582 and 583, surface condition images 582a and 583a that should be noted when a defect occurs are displayed. In areas 584 and 585, surface condition images 584a and 585a that show a bad example when a defect occurs are displayed.

[0130] The priority displayed on the display screen 570 can be arbitrarily set by selecting Manual in the setting button 586, and the display is displayed in the priority set by the operator. The priority can be set, for example, to the order from new to old in date, photos of specific conditions recorded, photos before and after the bath, photos when the problem occurred, and photos before and after, etc. In addition, by selecting Automatic, artificial intelligence (AI: Artificial Intelligence) is used to automatically extract a captured image similar to the newly acquired visible light image 532.

[0131] return Figure 5B , the description continues. When the data comparison of "region determination" is selected by the item selection button 563 in step S007, the image comparison system 300 enters Figure 5C In step S009, other surface state images are displayed.

[0132] Fig.13 The other surface state images corresponding to the five regions are extracted and displayed (step S009). Fig.13 As shown, a visible light image 532 and a polarized light image 537 indicating a newly acquired surface state image are displayed on the left side of a display screen 590 , and surface state images 680 to 688 matching the five regions 534 and 539 are displayed on the right side.

[0133] In the area setting 591, it is possible to set an appropriate area in the five areas 534 and 539, and extract the number of qualified or unqualified items, the number of defective items, and the number of special items according to the judgment content. In the areas 600 to 608, visible light images of other surface state images 680 to 688 are displayed. When the polarized light image 537 is selected, the other surface state images 680 to 688 displayed in the areas 600 to 608 are switched from visible light images to polarized light images. In addition, when the visible light image 532 is selected, the corresponding visible light image is displayed in the areas 600 to 608.

[0134] return Figure 5C , and the description is continued. In step S008 ( Fig.12 ) or S009( Fig.13 ), when other surface state images are selected in the image processing, the newly acquired surface state image is directly compared with the other selected surface state images (step S010).

[0135] Fig.14 This is a display screen for comparing the visible light image 532 displayed in the area 571 with the visible light image 572a displayed in the area 572 (step S010). The visible light image 572a is another surface state image captured in the past and is a visible light image selected by the operator.

[0136] like Fig.14 As shown, the image comparison system 300 compares the visible light image 532 and the visible light image 572 a , and displays the input screen 542 of the visible light image 532 and the input screen 611 of the visible light image 572 a in a comparable manner.

[0137] In addition, the detailed information extraction unit 116a extracts the surface state of the metal sheet, the test conditions, the treatment method, the treatment result, and each piece of information in the remarks column from the storage unit 120 for each of the visible light image 572a and the visible light image 532. Thus, the display control unit 115 can cause the display screen 610 of the display unit 160 to display: the surface state of the metal sheet, the test conditions, the treatment method, the treatment result, and each piece of information in the remarks column extracted by the detailed information extraction unit 116a.

[0138] In addition, a part of other surface state images 680 to 683 and the like which are not selected by the operator are displayed on the right side of the display screen 610. In addition, the display screen 610 is provided with a superimposed display button 612 and graphic display buttons 613 and 614.

[0139] return Figure 5C, the description is continued. When the overlapping display button 612 is selected in step S011 (overlap display in step S011), the image comparison system 300 enters step S012 and displays the visible light image 532 and the visible light image 572a overlappingly. On the other hand, when the graphic display buttons 613 and 614 are selected (graphic display in step S011), the image comparison system 300 displays: a graphic representing the extent of the surface of the area 571 or the area 572 (step S013).

[0140] Fig.15 The display screen shows the overlapped display of the visible light image 532 and the visible light image 572a (step S012). The image comparison system 300 changes either the visible light image 532 displayed in the region 571 or the visible light image 572a displayed in the region 572 to a transmissive image and displays them in an overlapping manner in a semi-transparent state.

[0141] The transmission image generator 119 changes the visible light image 572a to a transmission image, for example, and the display controller 115 displays the transmitted visible light image 572a superimposed on the visible light image 532. Alternatively, the display controller 115 may perform superimposed display without changing the visible light image 572a to a transmission image.

[0142] The display screen 620 includes display mode change buttons 631 to 633. The display mode change buttons 631 to 633 can change the type of the surface state image of the region 571 and the surface state image of the region 572 and display them in an overlapping manner. For example, the display mode change button 631 displays the surface state image of the region 571 and the surface state image of the region 572 in an overlapping manner as an optical image representing a visible light image. In addition, the display mode change button 632 changes the surface state image of the region 571 and the surface state image of the region 572 to a polarized light image and displays them in an overlapping manner. In addition, the display mode change button 633 sets the surface state image of the region 571 to an optical image and changes the surface state image of the region 572 to a polarized light image and displays them in an overlapping manner.

[0143] Fig.16 The display screen shows a graph showing the degree of surface concavity and convexity in the polarized light image (step S013). Fig.16 In the example, the image 621 is displayed on the display screen 630 .

[0144] The concavity and convexity degree analyzing unit 115a analyzes the degree of concavity and convexity on the surface of the metal sheet OB, for example, based on the distance from the end of the polarized light image 537, and displays a graph 621 on the display screen 630. The graph 621 is a graph in which the color depth, the degree of RGB, the number of particles, etc. in the polarized light image 537 are measured and graphed. By displaying the graph 621 on the display screen 630, the concavity and convexity of the surface that is difficult to identify in the ordinary visible light image 532 can be determined. In particular, the polarized light image can detect a condition different from that seen by the naked eye on the surface of the metal sheet OB, so a more accurate determination can be made.

[0145] In addition, the number of particles can be input by visual counting or can be automatically determined. In addition, the horizontal axis of Figure 621 can be selected from the three areas of the five areas 534 and 539, the distance from the left end of each captured image, or the current density. Thus, Figure 621 can be selected by the operator to change the horizontal axis from the distance from the end of the polarized light image 537 or the end of the metal sheet OB or the current density (A / dm 2 ) are switched with each other. In addition, the horizontal axis and vertical axis of Figure 621 are examples and are not limited to this.

[0146] In this embodiment, the image comparison system 300 performs Figure 5C When the overlapping display (overlapping display) in step S012 or the graphic display in step S011 is completed, FIG. 5A to FIG. 5C processing.

[0147] <Processing of calling past data according to calendar date (optional)>

[0148] exist Fig.14 The display screen 610 and Fig.16 In the display screen 630, there is optionally provided a calendar display button 615 for executing a process of calling past data according to a calendar date.

[0149] Fig.17 The past data is called up to display the display screen of the other surface state images on the calendar (step S031). Fig.17 As shown, in the calendar 640, the dates on which other surface state images are accumulated are visually displayed with frame lines.

[0150] The extraction unit 114 extracts other surface state images whose at least a part of test conditions are consistent with the test conditions of the newly acquired surface state image based on the shooting date of the other surface state images. The date calling unit 115b displays on the calendar 640 whether there are other surface state images based on the shooting date extracted by the extraction unit 114.

[0151] Thus, when a date included in another surface condition image displayed on the calendar is selected, the date calling unit 115 b can display on the display unit 160 the other surface condition image captured on the selected date.

[0152] <Changes in registration information>

[0153] When Figure 7 When the operation button 513 for executing the change of the registered information is selected in the screen 510 showing the cover page ( Figure 5A The registration information of step S003 is changed), and the process goes to step S101.

[0154] In step S101, for example, Fig. 9 The operator can modify the data captured in the past or change the content on the input screen 530. Fig. 10A , 10B The input test conditions can be changed (or corrected) in the input screen 542. In addition, the image comparison system 300 can also change the registration information.

[0155] For example, in Fig. 10A , 10B In the input screen 542 shown, not only can the imaging condition 550 and the Hall slot condition 551 be changed or corrected, but also items to be filled in the overall item 553 and the sub-item 554 can be added. By adding the items selected in the overall item 553 and the items selected in the sub-item 554, the image comparison system 300 can reflect the test results in detail and update the registered information. When the image comparison system 300 inputs information in the input screen 542, the processing ends.

[0156] <Setting of term definitions>

[0157] exist Figure 7 In the screen 510 showing the cover page, when the operation button 514 for executing the term definition is selected ( Figure 5A ), proceed to step S201.

[0158] In step S201, a term definition table is displayed, and for example, the expression method (expression method) of the surface state is defined according to the type of plating.

[0159] Fig.18A This is a diagram that defines terms regarding surface roughness when using nickel. Fig.18B This is a diagram about the color, luster, and definition terms when using nickel.

[0160] exist Fig.18AThe term definition table 660 includes columns for the type of plating, term, evaluation criteria, coverage, numerical value, and reference photo. When nickel is used as the type of plating, for example, when the coating is "rough", the evaluation criteria are defined as: judging by the size of the particles, the particles with a diameter of 1 [mm] or more cover the entire surface (for example, 10×20 [mm 2 ]) or there are more than 100 states in the whole. In addition, by attaching a reference photo corresponding to "roughness", it is easy for the operator to imagine the state of "roughness".

[0161] In addition, this expression is an example and is not limited to this. In addition, the numerical value is set with an initial value, and a numerical value determined by the operator's self-judgment visually or automatically can also be input. In addition, when the operator selects a reference photo, other photos associated with the expression of "roughness" can also be displayed.

[0162] In addition, in the case of "peeling", the evaluation criteria are defined as: judging by the peeling area, the state of peeling of more than 50% of the area. In addition, by attaching a reference photo corresponding to "peeling", the operator can easily imagine the state of "peeling".

[0163] In addition, in the case of "pits", the evaluation criteria are defined as a state containing 5 or more pits representing macroscopic holes or depressions. In addition, by attaching a reference photo corresponding to the "pits", the operator can easily imagine the state of the "pits".

[0164] In addition, when the image is expressed as "burned", the evaluation criteria are determined by color tone. In this case, the operator refers to the reference photo and determines whether the color tone is the same or similar to the color tone of the reference photo.

[0165] In the case of "eschar", the evaluation criteria are color or gloss. The operator refers to the reference photo and determines that the eschar is covered by 60% or more.

[0166] exist Fig.18B In the term definition table 661, there are columns for: type of plating, term, evaluation criteria, coverage, visual inspection, and reference photos. As the type of plating, when nickel is used, for example, when the expression is "glossy", it is defined as: the coverage is 100 [%], and the state is very bright when visually inspected. In addition, by attaching a reference photo corresponding to "glossy", it is possible for the operator to easily imagine the state of the expression "glossy".

[0167] In addition, this expression is an example and is not limited to this. In addition, when the operator selects a reference photo, other photos related to the expression of "gloss" may be displayed.

[0168] In addition, when the expression is "semi-gloss", the evaluation criteria are defined as: the coverage is 90 [%], and the state is slightly bright when viewed visually. In addition, by attaching a reference photo corresponding to "semi-gloss", the operator can easily imagine the state of the expression of "semi-gloss".

[0169] In the case of "blurred" performance, the evaluation criteria are defined as: the coverage is 70% and the state of "fogging" appears when viewed visually. In addition, by attaching a reference photo corresponding to "blurred", the operator can easily imagine the state of "blurred" performance.

[0170] In addition, when the expression is "white", the evaluation standard is defined as: the coverage is 50 [%], and the state is white when viewed visually. In addition, by attaching a reference photo corresponding to "white", it is possible to make it easier for the operator to imagine the state of the expression "white". When the input or confirmation of the definition of the term is completed, the processing ends.

[0171] As described above, the image comparison system 300 is configured to include an acquisition unit 111, a condition acquisition unit 113, an extraction unit 114, and a display control unit 115. The acquisition unit 111 acquires a surface state image of the metal sheet OB indicating the result of the plating test. The extraction unit 114 extracts other surface state images whose at least a part of the test conditions are consistent with the test conditions of the newly acquired surface state image from the storage unit 120. The display control unit 115 causes the display unit 160 to display the newly acquired surface state image and the other surface state images extracted by the extraction unit 114 in a manner that allows comparison.

[0172] According to this configuration, the image comparison system 300 can extract other surface state images whose at least a part of the test conditions are consistent with the test conditions of the newly acquired surface state image through the extraction unit 114, and display the newly acquired surface state image of the metal sheet OB and other surface state images extracted by the extraction unit 114 in a comparable manner. For example, the Hall slot condition 551 of the Hall slot test is part of the test conditions. Therefore, an image matching the test conditions such as the plating type or the test time can be extracted, so that the test results of the plating test can be easily provided to the operator as information for judging the material.

[0173] In addition, the image comparison system 300 also includes: a detailed display receiving unit 116, which receives a detailed display instruction regarding the state of other surfaces of any one of the multiple other surface state images extracted by the extraction unit 114 when the extraction unit 114 extracts multiple other surface state images; and a display control unit 115, based on the received detailed display instruction, causes the display unit to display the newly acquired surface state image and the other surface state images in a comparable manner.

[0174] According to this configuration, the detailed display receiving unit 116 receives a detailed display instruction for one other surface state image to be compared with the newly acquired surface state image when a plurality of other surface state images are extracted by the extracting unit 114. The operator can display the newly acquired surface state image and the other surface state images in a comparable manner simply by selecting one other surface state image to be compared. Thus, the image comparison system 300 can easily compare the newly acquired surface state image with the selected other surface state images.

[0175] In addition, in the image comparison system 300, detailed information including at least one item in the state of the surface of the metal sheet OB, test conditions, treatment methods, treatment results, and remarks column is associated and stored in the storage unit 120 for each of the other surface state images and the newly acquired surface state image; the image comparison system 300 is further configured to include a detailed information extraction unit 116a, which extracts detailed information for each of the other surface state images and the newly acquired surface state image from the storage unit 120. The display control unit 115 causes the display unit 160 to display the detailed information of the other surface state images extracted by the detailed information extraction unit 116a and the detailed information of the newly acquired surface state image in a manner that allows comparison.

[0176] According to this configuration, the image comparison system 300 can extract detailed information from the storage unit 120 for each of the other surface state images and the newly acquired surface state image through the detailed information extraction unit 116a, and display detailed information including at least one item in the state of the surface of the metal sheet OB, test conditions, treatment methods, treatment results, and remarks column on the display unit 160 for each of the other surface state images and the newly acquired surface state image. Thus, the image comparison system 300 can easily compare the detailed information of the other surface state image with that of the newly acquired surface state image.

[0177] The image comparison system 300 includes a visible light camera 201 for capturing images using visible light and a polarized light camera 202 for capturing images using predetermined polarized light. The visible light camera 201 and the polarized light camera 202 capture the surface state of the metal sheet OB and acquire a new surface state image.

[0178] According to this configuration, the image comparison system 300 acquires the visible light image 532 from the visible light camera 201 and acquires the polarized light image 537 from the polarized light camera 202. Thus, the image comparison system 300 can display the visible light image 532 and the polarized light image 537 for the surface state image. Therefore, the operator can display the visible light image 532 and the polarized light image 537 for the surface state image and confirm the test result.

[0179] In addition, the image comparison system 300 causes the display unit 160 to display the visible light image 532 captured by the visible light camera 201 and / or the polarized light image 537 captured by the polarized light camera 202 as a new surface state image through the display control unit 115. When either the visible light image 532 or the polarized light image 537 as a new surface state image is selected, the image comparison system 300 causes the display unit 160 to display the corresponding image of the visible light image or the polarized light image as the other surface state image through the display control unit 115.

[0180] According to this configuration, the image comparison system 300 can display the visible light image 532 and the polarized light image 537 on the display screen 590 through the display control unit 115, and when either the visible light image 532 or the polarized light image 537 is selected, the corresponding image of the visible light image or the polarized light image as another surface state image is displayed. Thus, the operator can easily use the corresponding image of the visible light image or the polarized light image as a reference for the test result.

[0181] The image comparison system 300 further includes a concavity and convexity degree analyzing unit 115 a in the display control unit 115 , which analyzes the degree of concavity and convexity on the surface of the metal sheet OB based on the distance from the end of the polarized light image or the end of the metal sheet OB, and displays the result on the display unit 160 .

[0182] According to this configuration, the image comparison system 300 can analyze the degree of concavity and convexity on the surface of the metal sheet OB using the polarized light image through the concavity and convexity degree analysis unit 115a. Thus, the image comparison system 300 can visualize the state of the surface of the metal sheet OB that cannot be visually determined by the concavity and convexity degree analysis unit 115a through graphical or digital means.

[0183] In addition, the plating test of the image comparison system 300 can be set as a Hall cell test.

[0184] According to this configuration, the image comparison system 300 can display the continuous current density range in a gradient manner on the metal sheet OB as the surface state image. Thus, the image comparison system 300 can obtain various evaluation information such as confirmation of the optimal current density range in the Hall cell test, composition balance of the plating bath, excess or deficiency of brightener and additives, covering power, impurity mixing state and removal effect confirmation, and can be used for evaluation of plating solutions, management of plating solutions, and development of new plating baths.

[0185] The image comparison system 300 further includes an appearance region dividing unit 117 for dividing the surface of the metal sheet OB into a plurality of regions (A to E). The appearance region dividing unit 117 determines whether the test result is good or not in each of the plurality of divided regions (A to E).

[0186] According to this configuration, the image comparison system 300 divides the surface of the metal sheet OB by the appearance region dividing unit 117, so that the operator can input a judgment of whether the test result is good or not for each divided region. Thus, the image comparison system 300 can compare other surface state images with the test results for each region divided by the appearance region dividing unit 117.

[0187] In addition, the image comparison system 300 is also configured to include a current density display unit 118, which obtains position information of the end of the distance image or the end of the metal sheet OB in the image in a newly acquired surface state image or other surface state images, and causes the display unit 160 to display the current density at the acquired position information.

[0188] According to this configuration, the image comparison system 300 can display the current density at the position information on the display unit 160 simply by the operator designating on the surface state image using the mouse through the current density display unit 118. Thus, the operator can analyze the surface state image by referring to the current density of the current density display unit 118. Specifically, even if the state of the surface state image is the same, the influence of additives, the balance of the plating bath, etc. can be determined by the difference in current density.

[0189] In addition, the image comparison system 300 includes a plurality of items with different reference and test conditions in the extraction unit 114, accepts selection of one item from the plurality of items, and preferentially extracts other corresponding surface condition images.

[0190] According to this configuration, the image comparison system 300 can set a priority item through the extraction unit 114 and extract the surface state image corresponding to the priority item. In this case, the image comparison system 300 can set, for example, Figure 3The date, day of the week, and area determination shown are set as priority items. Thus, the image comparison system 300 can extract other surface state images that the operator wants to confirm through the priority items, and can easily display other surface state images that the operator wants to confirm.

[0191] In addition, the image comparison system 300 extracts, by the extraction unit 114, the other surface state image whose at least a part of the test conditions are consistent with the test conditions of the newly acquired surface state image based on the shooting date of the other surface state image. The display control unit 115 further includes: a date calling unit 115b, which displays on the calendar whether there is another surface state image based on the shooting date extracted by the extraction unit 114. When the date of the other surface state image displayed in the calendar is selected, the date calling unit 115b causes the display unit 160 to display: the other surface state image shot on the selected date.

[0192] According to this configuration, the image comparison system 300 can display the shooting date of other surface state images that have at least a portion of the same test conditions on the calendar 640 through the date calling unit 115b. As a result, the image comparison system 300 can display the presence or absence of other surface state images on the calendar 640, so that when searching for other surface state images, it can be searched from the calendar schedule. In this case, for example, after a long vacation in which the manufacturing equipment is stopped for a long time, defects are likely to occur in the Hall slot test. Therefore, the operator can easily select other surface state images that may be unqualified from the calendar 640 in consideration of the time interval.

[0193] Furthermore, the image comparison system 300 displays, through the display control unit 115 , any one of the other surface condition images extracted by the extraction unit 114 in an overlapping manner with the newly acquired surface condition image.

[0194] According to this configuration, the image comparison system 300 can display the captured images to be compared superimposed on each other regardless of whether they are visible light images or modified images through the display control unit 115. Thus, the image comparison system 300 can determine the test results in detail while the captured images to be compared are superimposed on each other.

[0195] The image comparison system 300 is further provided with a transmission image generation unit 119 , and the transmission image generation unit 119 transmits one of the other surface state image and the newly acquired surface state image when performing superimposed display.

[0196] According to this configuration, the image comparison system 300 can overlap and display the image of one of the transmitted images with the image of the other through the transmission image generation unit 119. Thus, the operator can use the transmitted images to confirm through the overlapping display, and can easily detect subtle differences that are difficult to judge in comparative observation.

[0197] In addition, the present invention is not limited to the above-mentioned embodiment, and various modifications can be made without departing from the gist of the present invention.

[0198] Description of Reference Numerals

[0199] 100 Information processing device

[0200] 111 Acquisition Department

[0201] 112 Registration Department

[0202] 113 Condition Acquisition Department

[0203] 114 Extraction Department

[0204] 115 Display control unit

[0205] 115a Concave and convex degree analysis section

[0206] 115b Date Calling Department

[0207] 116 Detailed display receiving unit

[0208] 116a Detailed information extraction unit

[0209] 117 Appearance Area Division

[0210] 118 Current density display unit

[0211] 119 Transmission image generation unit

[0212] 200 Photography Department

[0213] 201 Visible light camera

[0214] 202 Polarized light camera

[0215] 300 Image Comparison System

[0216] 400 Hall cell test (plating device).

Claims

1. An image comparison system, characterized in that have: an acquisition unit that acquires a surface state image of the metal sheet indicating a result of the plating test; a condition acquisition unit, for acquiring the test conditions of the plating test for the newly acquired surface state image; A storage unit for storing the surface state image and the test conditions; An extracting unit extracts, from the storage unit, other surface state images whose at least a part of test conditions are consistent with the test conditions of the newly acquired surface state image; and, The display control unit causes the display unit to display the newly acquired surface state image and the other surface state images extracted by the extraction unit in a comparable manner.

2. The image comparison system according to claim 1, characterized in that: The apparatus further comprises: a detailed display accepting unit for accepting a detailed display instruction on the state of the other surface of any one of the other surface state images extracted by the extracting unit, when the other surface state images are extracted by the extracting unit; The display control unit causes a display unit to display the newly acquired surface condition image and the other surface condition image in a comparable manner, based on the received detailed display instruction.

3. The image comparison system according to claim 1 or 2, characterized in that: The storage unit associates and stores, respectively, the other surface state images and the newly acquired surface state images with detailed information including at least one of the state of the surface of the metal sheet, the test conditions, the response method, the response result, and the remarks column; The image comparison system further comprises: a detailed information extraction unit that extracts the detailed information from the storage unit for each of the other surface state image and the newly acquired surface state image; The display control unit causes a display unit to display the detailed information of the other surface state image extracted by the detailed information extraction unit and the detailed information of the newly acquired surface state image in a manner that allows comparison.

4. The image comparison system according to claim 1 or 2, characterized in that: include: Visible light camera, which shoots with visible light; and Polarized light camera, which takes pictures using specified polarized light; The visible light camera and the polarized light camera photograph the surface state of the metal sheet to obtain the new surface state image.

5. The image comparison system according to claim 4, characterized in that: The display control unit causes the display unit to display: a visible light image captured by the visible light camera and / or a polarized light image captured by the polarized light camera as the new surface state image; When any one of the visible light image and the polarized light image as the new surface state image is selected, the display control unit causes the display unit to display a corresponding image of the visible light image and the polarized light image as the other surface state image.

6. The image comparison system according to claim 5, characterized in that: The display control unit further comprises: The concavity and convexity degree analyzing unit analyzes the degree of concavity and convexity on the surface of the metal sheet according to the distance from the end of the polarized light image or the end of the metal sheet, and causes the display unit to display the degree of concavity and convexity.

7. The image comparison system of claim 1, wherein the plating test is a Hall cell test.

8. The image comparison system according to claim 7, characterized in that: It also includes: an appearance area dividing unit, which divides the surface of the metal sheet into a plurality of areas; The appearance region dividing unit receives a determination as to whether the test result is good or not in each of the regions divided into the plurality of regions.

9. The image comparison system according to claim 7, characterized in that: Also available: The current density display unit obtains the position information of the end of the distance image or the end of the metal sheet in the image in the newly obtained surface state image or the other surface state image, and causes the display unit to display the current density at the obtained position information.

10. The image comparison system according to claim 1, wherein the extraction unit has a plurality of items whose references are different from the test conditions, and accepts selection of a priority item from among the plurality of items to preferentially extract the corresponding other surface state images.

11. The image comparison system according to claim 1, characterized in that: The extracting unit extracts the other surface state image whose at least a part of the test conditions is consistent with the test conditions of the newly acquired surface state image based on the shooting date of the other surface state image; The display control unit further includes: a date calling unit that displays on a calendar whether or not the other surface state image exists based on the shooting date extracted by the extraction unit; When a date included in the other surface state image displayed on the calendar is selected, the date calling unit causes the display unit to display the other surface state image captured on the selected date.

12. The image comparison system according to claim 1, characterized in that: The display control unit displays any one of the other surface condition images extracted by the extraction unit superimposed on the newly acquired surface condition image. 13 . The image comparison system according to claim 12 , further comprising: a transmission image generating unit that transmits an image of either one of the other surface state image and the newly acquired surface state image.

14. An image comparison method, characterized in that include: The acquisition unit acquires a surface state image of the metal sheet indicating a result of the plating test; The condition acquisition unit acquires the test conditions of the plating test for the newly acquired surface state image; The extracting unit extracts other surface state images whose at least a part of test conditions are consistent with the test conditions of the newly acquired surface state image from the storage unit; and, The display control unit causes the display unit to display the newly acquired surface state image and the other surface state image in a comparable manner.

15. An image comparison program, characterized in that Have your computer perform the following steps: acquiring a surface state image of the metal sheet indicating a result of the plating test; For the newly acquired surface state image, obtaining the test conditions of the plating test; extracting from the storage unit other surface state images whose at least a part of test conditions are consistent with the test conditions of the newly acquired surface state image; and, The newly acquired surface state image and the other surface state image are displayed on a display unit so as to be comparable.

Citation Information

Patent Citations

  • Surface inspection device and method for inspecting surface

    JP2021179331A