Method and test system for detecting defects in linear elements
The image evaluation algorithm for vehicle components addresses the limitations of existing methods by enabling position-tolerant detection of linear elements, effectively identifying defects in lighting and seam features through local thresholding and parameter analysis, enhancing efficiency and accuracy in vehicle component testing.
Patent Information
- Application Number
- PCT/EP2025/053221
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-02-14
- Filing Date
- 2025-02-07
- Publication Date
- 2025-08-21
AI Technical Summary
Existing image analysis algorithms for evaluating linear elements in vehicle components are limited by thresholding methods that fail to assess local image differences, leading to evaluation deviations and sensitivity to positional tolerances, especially when dealing with lighting elements and seams in interior components.
An image evaluation algorithm that captures the test specimen with a camera, defines a region of interest, and scans it along vertical sections to determine evaluation parameters using a local thresholding method, allowing for position-tolerant detection of linear elements by analyzing brightness, color, and thickness, with the ability to detect defects.
The algorithm provides simple, cost-effective, and position-tolerant evaluation of linear elements, capable of detecting defects in vehicle components such as lighting elements, seams, cables, and conductor tracks within milliseconds, optimizing cycle time in series testing.
Smart Images

Figure EP2025053221_21082025_PF_FP_ABST
Abstract
Description
[0001] METHOD AND TEST SYSTEM FOR DETECTING DEFECTS IN LINEAR ELEMENTS
[0002] Technical area
[0003] The present invention relates to a method and a testing system for detecting defects in linear elements of vehicle components. The invention particularly relates to an image evaluation algorithm for linear image elements.
[0004] State of the art
[0005] Image analysis algorithms very often use thresholding methods that are limited to evaluation regions. However, a further step of decomposing the image into subregions is usually not performed. This means that local image differences can be truncated by the thresholding method and therefore not assessed or assessed incorrectly. Another common method for evaluating linear image elements is to place a polygon along this line. These polygons are usually anchored as a fixed region in the image or can be tracked to the image element. The polygon can be implemented either as a "single-pixel line" or as a "multi-pixel band". With a "single-pixel line", only the pixel in the image that intersects the polygon is evaluated. This means that all other neighboring image regions are not evaluated.Inadequate component misalignment compensation (shown in the image) can lead to significant evaluation deviations. Furthermore, without additional smoothing techniques, this method is often subject to significant signal noise. This noise can be reduced with the "multi-pixel band," which uses not only a single intersection pixel but also a defined number of neighboring pixels. Therefore, at each individual point along the polyline, an average value of several pixels (which are usually perpendicular to the polyline) is obtained. The output values of this method are also somewhat more stable with positional tolerances—but can still react very sensitively to them. Description of the invention.
[0006] One object of the invention is therefore to create a concept for evaluating linear image elements that can be used in the testing of vehicle components. Such linear image elements are used, among other things, in the interior ambient lighting of vehicle components. In particular, one object is to create a corresponding algorithm that can detect the linear image element or the illuminated line in a position-tolerant manner and output defined evaluation parameters along this detected line, such as brightness, color, thickness, and position of the line. The values thus determined can then be checked against target or limit values.
[0007] The object is achieved by the subject matter of the independent claims. Advantageous developments of the invention are specified in the dependent claims, the description, and the accompanying figures.
[0008] The inventive solution is based on the idea of capturing the image of the test specimen to be assessed with a camera, for example, a single- or multi-channel color camera or a (single-channel) grayscale camera. A predefined area defines the region of interest (ROI) in the image. Within this region, the region of interest is scanned along its largest extent from left to right, divided into vertical sections, and the evaluation parameters are determined using a local thresholding method.
[0009] This image analysis algorithm can be applied to all linear image elements, which are very common in the product testing of vehicle components. It can be used to reliably identify, for example, lighting elements or seams in interior components. The position or shape of cables or conductor tracks is also possible, as are prints.
[0010] The solution presented in this disclosure offers the following advantages:
[0011] The algorithm's parameters are very simple. All that's required is a defined evaluation region in the image and a percentage threshold (0-100%), which is required for the thresholding process. This allows the algorithm to perform position-tolerant evaluations within an evaluation region. The local thresholding process also detects interruptions in the line being evaluated. The algorithm provides geometric information in addition to color and brightness information. Furthermore, a complete image evaluation can be performed in just a few milliseconds on modern PCs, offering an advantage in cycle time optimization in series testing systems.
[0012] The invention provides an evaluation using a flexible, position-tolerant evaluation method that determines color, brightness, and specimen geometry information in the form of lines that can be checked for defects.
[0013] According to a first aspect, the above-described object is achieved by a method for detecting defects in linear elements of vehicle components, the method comprising the following steps: providing a camera image of a vehicle component having a linear element; wherein the camera image comprises image elements with a respective brightness; determining an evaluation region in the camera image having a plurality of rows, wherein the evaluation region comprises at least a portion of the linear element; determining brightness values of the image elements of a respective row of the evaluation region; determining a number of image elements of the respective row of the evaluation region whose brightness values lie beyond a brightness threshold, wherein the determined number corresponds to a thickness of the linear element in the respective row of the evaluation region;and detecting a defect in the linear element of the vehicle component if the thickness of the linear element exhibits a fluctuation outside a tolerance range over the majority of the rows of the evaluation area;
[0014] Such a method enables a simple and cost-effective evaluation of linear elements or image elements, which can be used in the testing of vehicle components. The method is capable of detecting the linear image element or the light line in a position-tolerant manner and can efficiently check whether the thickness of the linear element is approximately constant along the longitudinal axis. If there is a corresponding fluctuation in the thickness, a defect is detected. In this case, the vehicle component can be sorted out as defective. According to an exemplary embodiment of the method, the evaluation region is a rectangular frame and is determined such that at least one part of the linear element is arranged in the frame along a longitudinal direction of the frame.
[0015] With such a rectangular frame, placed lengthwise over the linear element, it is easy to determine sections through the linear element, which can be used to determine the respective thickness of the linear element. Changes in thickness can be used to detect a defect in the linear element.
[0016] According to an exemplary embodiment of the method, the plurality of rows runs approximately perpendicular to the linear element and in particular represents sections through a longitudinal axis of the linear element.
[0017] This makes it possible to make cuts transverse to the longitudinal axis of the linear element and thus to determine the thickness of the linear element along its longitudinal axis and to detect defects in the event of variations in thickness.
[0018] In particular, a row comprises image elements arranged adjacent to one another within the respective row. Each image element can preferably be assigned a unique position within the respective row. The position can be assigned a unique position value.
[0019] According to an exemplary embodiment of the method, the camera image represents a gray image whose image elements are represented as gray tones, wherein the gray tones correspond to the respective brightnesses of the image elements of the camera image.
[0020] The simplest option here is to use a grayscale image that can be derived from the camera image. Based on the brightness values or gray tones of the grayscale image, a contour of the linear element can be easily determined. A black and white camera or a color camera, for example a 3-channel color camera, can be used for this purpose. In the latter case, the grayscale image can be determined from the 3 color channels. According to an exemplary embodiment of the method, the camera image is a 3-channel color image and the method comprises the following steps: decomposing the 3-channel color image into its three color channels; and generating a grayscale image based on a weighted superposition of the three color channels of the 3-channel color image; wherein the determination of the brightness values is applied to the grayscale image.
[0021] The grayscale image can be used to easily determine the brightness values of the camera image. With a 3-channel color image, the three color channels can be efficiently processed into a grayscale image. The advantage of the 3-channel color image is that it also contains color information, which can also be used to determine defects in the linear element, as described below.
[0022] According to an exemplary embodiment of the method, the method comprises the following steps: determining an average of the brightness values that lie beyond the brightness threshold, wherein the average corresponds to a gray intensity of the linear element in the respective row of the evaluation area; and detecting a defect in the linear element of the vehicle component if the gray intensity fluctuates outside a respective gray intensity tolerance range across the majority of the rows of the evaluation area.
[0023] These process steps allow the evaluated gray image to be displayed as a brightness line and thus to detect possible brightness manipulation or a brightness error.
[0024] According to an exemplary embodiment of the method, the determination of the mean value of the brightness values that lie beyond the brightness threshold is additionally applied to the three color channels, wherein the mean value corresponds to a respective color intensity of the linear element in the respective row of the evaluation area; and wherein the method further comprises the following step: detecting a defect in the linear element of the vehicle component if the respective color intensity fluctuates outside a respective color intensity tolerance range across the majority of the rows of the evaluation area. These method steps allow the evaluated color channels of the 3-channel color image to be represented as color lines and thus to detect possible color manipulation or an error in the color intensity.
[0025] According to an exemplary embodiment of the method, the method comprises the following steps: determining a center of gravity of the brightness values for the respective row of the evaluation area; and detecting a defect in the linear element of the vehicle component if the center of gravity fluctuates outside a center of gravity tolerance range across the majority of the rows of the evaluation area.
[0026] These process steps allow the position of the evaluated gray image to be identified based on the center of gravity and thus a possible offset in the linear element to be detected.
[0027] The center of gravity of the brightness values can depend on the brightness value of the respective image value and its position value in the respective row. In particular, the center of gravity of the brightness values can be calculated from the sum of the brightness values of all image elements in a row multiplied by the respective position value of the image element in the quotient divided by the sum of the brightness values of the respective row in the dividend.
[0028] According to an exemplary embodiment of the method, the weighted superposition of the three color channels of the 3-channel color image is carried out based on a brightness perception of the human eye and, in particular, weights a red channel of the 3-channel color image with a weight of 0.299, a green channel of the 3-channel color image with a weight of 0.587 and a blue channel of the 3-channel color image with a weight of 0.114.
[0029] This exemplary superposition corresponds to a weighting based on the brightness perception of the human eye and thus produces a highly recognizable, high-contrast gray image. According to an exemplary embodiment of the method, the linear element comprises the following: ambient lighting of an interior vehicle component; a luminous line in a vehicle component; a luminous element or a seam in an interior vehicle component; a cable in a vehicle component; a conductor track in a vehicle component; or an imprint in a vehicle component.
[0030] The method presented here can be applied to a variety of linear elements, whether self-luminous or illuminated by an ambient light source.
[0031] According to an exemplary embodiment of the method, the method comprises a position-tolerant detection of the linear element based on the determined thickness of the linear element over the majority of the rows of the evaluation area.
[0032] With such position-tolerant detection, the exact position of the evaluation area in the camera image is not important. The linear element can be located at different points within the evaluation area without affecting detection accuracy.
[0033] According to an exemplary embodiment of the method, the evaluation area in the camera image is predefined depending on a position of a camera for capturing the camera image with respect to the vehicle component and a known position of the linear element in the vehicle component.
[0034] With a predefined position of the evaluation area, the step of calculating the evaluation area within the camera image or searching for an optimal position within the camera image is eliminated. This simplifies the process.
[0035] According to a second aspect, the above-described object is achieved by a computer program comprising instructions that, when executed by a computer, cause the computer to execute the method according to the first aspect described above. Thus, the above-described method can be efficiently implemented as an algorithm that can run on a computer system.
[0036] According to a third aspect, the object described above is achieved by a testing system for detecting defects in linear elements of vehicle components, the testing system comprising: at least one camera configured to provide a camera image of a vehicle component having a linear element; the camera image comprising image elements with a respective brightness; and a testing computer system configured to: determine an evaluation region in the camera image having a plurality of rows, the evaluation region comprising at least a portion of the linear element; determine brightness values of the image elements of a respective row of the evaluation region;to determine a number of image elements of the respective row of the evaluation area whose brightness values lie beyond a brightness threshold, wherein the determined number corresponds to a thickness of the linear element in the respective row of the evaluation area; and to detect a defect in the linear element of the vehicle component if the thickness of the linear element exhibits a fluctuation outside a tolerance range across the majority of the rows of the evaluation area;
[0037] Such a testing system enables simple and cost-effective evaluation of linear elements or image elements and can be used as a testing system for vehicle component testing. The testing system allows for position-tolerant detection of linear image elements and efficient inspection for defects. The testing system can be used, for example, in the manufacturing process or in the final inspection of vehicle components, and can reject vehicle components identified as defective.
[0038] According to an exemplary embodiment of the inspection system, the inspection system comprises a plurality of cameras, wherein each camera is aligned with a section of the vehicle component and is configured to capture a corresponding part of the linear element.
[0039] This allows even very long linear image elements, such as LED strips running along a section of the vehicle body or interior, to be efficiently inspected for defects in a single step using multiple cameras. The images from the individual cameras can thus be captured more accurately than a single, large-area image from a single camera.
[0040] This disclosure describes linear image elements (or, for short, linear elements). These image elements have a certain contrast with the background, so they are recognizable as separate elements in the camera image. These are usually bright image elements on a dark background, such as lights, for example, with multiple LEDs. However, they can also be dark elements on a bright background. The linear image element, in particular its longitudinal axis, extends along a line. The line can be a straight line or a curved or arched line.
[0041] Short character description
[0042] The invention is described in more detail below using exemplary embodiments and the figures. They show:
[0043] Fig. 1 is a schematic representation of a method 100 according to the invention for detecting defects in linear elements of vehicle components;
[0044] Fig. 2a is a graphic representation of a camera image 200 with a linear element 203, which here is in the form of a partially manipulated test image with an evaluation area 204, according to an embodiment;
[0045] Fig. 2b is a graphical representation of the three color channels 211, 212, 213 of the camera image 200 from Figure 2a and a gray image 210 obtained therefrom according to an embodiment;
[0046] Fig. 2c is a graphical representation of the gray image 210 of Figure 2b, showing a vertical section 205 at the position 200 px according to one embodiment; Fig. 3 is a graphical representation of the gray values of the vertical section 205 through the gray image 210 of Figure 2c according to one embodiment;
[0047] Fig. 4 is a graphical representation of the evaluated line thickness of the linear element from the gray image 210 of Figure 2c;
[0048] Fig. 5a is a graphical representation of the evaluated color intensities of the camera image 200 from Figure 2a;
[0049] Fig. 5b is a graphical representation of the evaluated gray intensity of the gray image 210 from Figure 2c; and
[0050] Fig. 6 is a graphical representation of the evaluated centroids for the gray image 210 from Figure 2c.
[0051] The figures are merely schematic representations and serve only to illustrate the invention. Identical or equivalent elements are provided with the same reference numerals throughout.
[0052] In the following detailed description, reference is made to the accompanying drawings, which form a part hereof, and in which is shown by way of illustration specific embodiments in which the invention may be practiced. It is understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present invention. The following detailed description, therefore, is not to be taken in a limiting sense. Further, it is to be understood that the features of the various embodiments described herein may be combined with one another unless specifically indicated otherwise.
[0053] The aspects and embodiments are described with reference to the drawings, where like reference numerals generally refer to like elements. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects of the invention. However, it may be apparent to one skilled in the art that one or more aspects or embodiments may be practiced with a lesser level of specific detail. In other instances, well-known structures and elements are shown in schematic form to facilitate describing one or more aspects or embodiments. It is understood that other embodiments may be utilized and structural or logical changes may be made without departing from the concept of the present invention.
[0054] Fig. 1 shows a schematic representation of a method 100 according to the invention for detecting defects in linear elements of vehicle components.
[0055] The method 100 includes the following steps:
[0056] Providing 101 a camera image 200, for example as shown in Figure 2a, of a vehicle component having a linear element 203; wherein the camera image 200 comprises image elements with a respective brightness;
[0057] Determining 102 an evaluation area 204, as shown for example in Figure 2a, in the camera image 200 with a plurality 202 of rows 201, wherein the evaluation area 204 comprises at least a part of the linear element 203;
[0058] Determining 103 brightness values 301 of the image elements of a respective row 201 of the evaluation area 204, as shown for example in Figure 3;
[0059] Determining 104 a number 302 of image elements of the respective row 201 of the evaluation area 204 whose brightness values 301 lie beyond a brightness threshold value 303, as shown for example in Figure 3, wherein the determined number 302 corresponds to a thickness 401 of the linear element 203 in the respective row 201 of the evaluation area 204, as shown for example in Figure 4; and
[0060] Detecting 105 a defect 403 in the linear element 203 of the vehicle component, as shown, for example, in Figure 4, if the thickness 401 of the linear element 203 fluctuates outside a tolerance range 402 across the majority 202 of the rows 201 of the evaluation region 204. The evaluation region 204 can, for example, be a rectangular frame, as shown by way of example in Figure 2a, and can be determined such that at least a part of the linear element 203 is arranged in the frame along a longitudinal direction of the frame, as shown by way of example in Figure 2a.
[0061] The plurality 202 of rows 201 may extend approximately perpendicular to the linear element 203 and represent sections through a longitudinal axis of the linear element 203, as exemplified in Figure 2a.
[0062] The camera image 200 can, for example, represent a gray image 210 whose image elements are represented as shades of gray, wherein the shades of gray correspond to the respective brightnesses of the image elements of the camera image 200.
[0063] The camera image 200 may, for example, be a 3-channel color image, as exemplified in Figure 2b, and the method 100 may comprise the following steps: decomposing the 3-channel color image into its three color channels 211, 212, 213, as exemplified in Figure 2b; and generating a gray image 210 based on a weighted superposition of the three color channels 211, 212, 213 of the 3-channel color image, as exemplified in Figure 2b; wherein the determining 103 of the brightness values 301 may be applied to the gray image 210.
[0064] The method 100 may further include the following steps:
[0065] Determining an average value of the brightness values 301 which lie beyond the brightness threshold value 303, wherein the average value corresponds to a gray intensity of the linear element 203 in the respective row 201 of the evaluation area 204; and
[0066] Detecting a defect 510 in the linear element 203 of the vehicle component, as shown by way of example in Figure 5, if the gray intensity 504 across the majority 202 of the rows 201 of the evaluation area 204 exhibits a fluctuation outside a respective gray intensity tolerance range 512.
[0067] The determination of the mean value of the brightness values 301 which lie beyond the brightness threshold value 303 can additionally be applied to the three color channels 211, 212, 213, as shown by way of example in Figures 2a and 5a, wherein the mean value of a respective color intensity of the linear element 203 in the respective row 201 of the evaluation area 204.
[0068] The method 100 may further include the following step:
[0069] Detecting a defect 510 in the linear element 203 of the vehicle component, as shown by way of example in Figure 5, if the respective color intensity 501, 502, 503 across the majority 202 of the rows 201 of the evaluation area 204 exhibits a fluctuation outside a respective color intensity tolerance range.
[0070] The method 100 may further include the following steps:
[0071] Determining a center of gravity 601 of the brightness values 301 for the respective row 201 of the evaluation area 204, as shown by way of example in Figure 6; and
[0072] Detecting a defect 610 in the linear element 203 of the vehicle component if the center of gravity 601 exhibits a fluctuation outside a center of gravity tolerance range 612 over the majority 202 of the rows 201 of the evaluation area 204, as shown by way of example in Figure 6.
[0073] The weighted superposition of the three color channels 211, 212, 213 of the 3-channel color image can, for example, be based on a brightness perception of the human eye and, for example, weight a red channel of the 3-channel color image with a weight of 0.299, a green channel of the 3-channel color image with a weight of 0.587 and a blue channel of the 3-channel color image with a weight of 0.114.
[0074] The linear element 203 may, for example, comprise the following: ambient lighting of an interior vehicle component; a luminous line in a vehicle component; a luminous element or a seam in an interior vehicle component; a cable in a vehicle component; a conductor track in a vehicle component; or a print in a vehicle component.
[0075] The method 100 may further comprise the following step: position-tolerant detection of the linear element 203 based on the determined thickness 401 of the linear element 203 over the plurality 202 of the rows 201 of the evaluation region 204, as shown by way of example in Figure 4.
[0076] The evaluation area 204 can be predefined in the camera image 200 depending on a position of a camera for capturing the camera image 200 with respect to the vehicle component and a known position of the linear element in the vehicle component.
[0077] The invention further relates to a computer program or an algorithm comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method 100 described here.
[0078] The invention further relates to a testing system for detecting defects in linear elements of vehicle components. Such a testing system comprises the following:
[0079] At least one camera configured to provide a camera image 200 of a vehicle component having a linear element 203, as exemplified in Figures 2a, 2b, 2c; wherein the camera image 200 comprises image elements with a respective brightness; and a test computer system configured to: determine an evaluation region 204 in the camera image 200 having a plurality 202 of rows (201), wherein the evaluation region 204 comprises at least a portion of the linear element 203, as exemplified in Figures 2a, 2b, 2c;
[0080] To determine brightness values 301 of the image elements of a respective row 201 of the evaluation area 204, as shown by way of example in Figure 3; to determine a number 302 of image elements of the respective row 201 of the evaluation area 204 whose brightness values 301 lie beyond a brightness threshold value 303, as shown by way of example in Figures 3 and 4, wherein the determined number 302 corresponds to a thickness 401 of the linear element 203 in the respective row 201 of the evaluation area 204; and to detect a defect 403 in the linear element 203 of the vehicle component if the thickness 401 of the linear element 203 across the majority 202 of the rows 201 of the evaluation area 204 fluctuates outside a tolerance range 402, as shown by way of example in Figure 4.
[0081] The inspection system may comprise a plurality of cameras, wherein each camera may be directed to a section of the vehicle component and may be configured to capture a corresponding part of the linear element 203.
[0082] Fig. 2a shows a graphic representation of a camera image 200 with a linear element 203, which here is in the form of a partially manipulated test image with an evaluation area 204, according to an embodiment.
[0083] The evaluation algorithm for linear image elements 203, as described above for Figure 1, can be universally applied to all images. The procedure can be illustrated here using a test camera image 200. The right-hand area of image 200 was manually modified as follows to represent the different evaluation results. The left-hand area, from pixels 0 to 600, remains unchanged.
[0084] The following changes were manually inserted into the camera image 200 to describe the method 100 or algorithm described above: The algorithm was developed for a three-channel color image (RGB), but can also be applied to pure gray images. This eliminates the additional step of converting the RGB image to a gray image.
[0085] For conversion to a gray image, the 3-channel color image is decomposed into its three individual color channels 211, 212, 213, as shown in Figure 2b.
[0086] Fig. 2b shows a graphical representation of the three color channels 211, 212, 213 of the camera image 200 from Figure 2a as well as a gray image 210 obtained therefrom according to an embodiment.
[0087] The gray image 210 is created by weighted addition of the three color channels. The three color images or color channels 211, 212, 213 are added together in the following ratio:
[0088] Gray = 0.299 • Red + 0.587 • Green + 0.114 • Blue
[0089] The resulting color-weighted gray image 210 resembles the brightness perception of the human eye. Therefore, most operations are applied to this gray image 210 and then transferred to the three RGB color channels 211, 212, and 213.
[0090] To define the image area to be analyzed, an evaluation region (ROI) 204 is first defined in the image. In this example, it is the entire image. It measures 72 pixels high and 1000 pixels wide. However, partial areas can also be used.
[0091] Within the evaluation region 204, the gray image 210 is evaluated horizontally from left to right. For this purpose, a vertical slice 205 is created for each pixel, as shown in Figure 2c. In this example, this slice 205 has a length of 72 pixels, since the image, like the evaluation region, is 72 pixels high. This is illustrated by a slice 205 at the horizontal position 200 (see slice line in Figure 2c).
[0092] Figure 2c shows a graphical representation of the grayscale image 210 from Figure 2b, depicting the vertical slice 205 at the position 200 px according to one exemplary embodiment. The brightness values (grayscale values) of this slice 205 show the curve shown in Figure 3.
[0093] Fig. 3 shows a graphical representation of the gray values of the vertical section 205 through the gray image 210 from Figure 2c according to an embodiment.
[0094] To determine a unique value of this intersection curve 205, the maximum 304 of curve 301 is first determined in order to evaluate the extracted curve 301 similarly to other curve parameter determinations (e.g., FWHM - Full Width Half Maximum, Gaussian curve analysis standard deviation, laser spot size determination, etc.). A threshold value 303, also referred to here as the brightness threshold, is defined as a further criterion.
[0095] In this example, it is 50% of the maximum. However, any value between 0 and 100% can be chosen. When determining the spot size of monochromatic laser radiation, for example, 1 / e 2 = 0.135 is used.
[0096] For further calculation, all points 302 that have at least this threshold value 303 are used (here, pixels 27 to 41 in Figure 3). The distance from the starting pixel (here, pixel 27) to the ending pixel (here, pixel 41) forms the width of the line shape (here referred to as "thickness").
[0097] Fig. 4 shows a graphical representation of the evaluated line thickness of the linear element from the gray image 210 of Figure 2c.
[0098] The manipulated circular section in the range 650 to 700 (see Figure 2a) is displayed here as defect 403, which lies outside the tolerance range 402.
[0099] The pixels found by threshold or tolerance range 402 can also be evaluated according to their gray values in the gray image and the three individual color images (red, green, blue). For this purpose, the mean of the respective gray values is calculated. This results in one intensity line per image (red, green, blue, and gray image), as shown by way of example in Figure 5a for the three color channels 211, 212, 213 and in Figure 5b for the gray image 210. Figure 5a shows a graphical representation of the evaluated color intensities 501, 502, 503 of the camera image 200 from Figure 2a.
[0100] The red, green, and blue channels are evaluated. Color manipulation is clearly visible in the range of 850 to 1000 pixels, which can be identified by fluctuations outside the respective color intensity tolerance range.
[0101] Fig. 5b shows a graphical representation of the evaluated gray intensity of the gray image 210 from Figure 2c.
[0102] The evaluated gray image 210 is shown here as a brightness line with brightness intensities or gray intensities 504. In the range 750 to 850 px, the brightness manipulation 510 is clearly visible, which can be detected by a fluctuation outside a gray intensity tolerance range 512.
[0103] Likewise, the center of gravity 601 (Center of Gravity, CoG) of the pixels in the gray image 210 can be calculated as follows, as shown in Figure 6 as an example: J gray value j • line;)
[0104] CoG = - — - - - ,(gray value
[0105] Fig. 6 shows a graphical representation of the evaluated centroids for the gray image 210 from Figure 2c.
[0106] Thus, in addition to the line thickness, a statement can be made about the position of the linear element 203 under investigation. It should be noted here that during image processing, the lines (or rows) are counted from top to bottom, instead of the usual right-handed coordinate system from bottom to top. This explains the drop 610 of the center of gravity line 601 in the range from pixels 700 to 750.
[0107] Clearly visible in Figure 6 is the offset of line 601 in the range from 700 to 750 pixels and the cutout in the range from 650 to 700 pixels. This offset can be identified as a defect 610 in the linear element 203 due to a fluctuation of line 601 outside a center of gravity tolerance range 612.
[0108] LIST OF REFERENCE SYMBOLS
[0109] 100 methods for detecting defects in linear elements
[0110] 101 Providing a camera image
[0111] 102 Determining an evaluation range
[0112] 103 Determining brightness values
[0113] 104 Determining a number of image elements
[0114] 105 Detecting a defect
[0115] 200 camera image
[0116] 201 rows of the camera image
[0117] 202 majority of rows
[0118] 203 linear element
[0119] 204 Evaluation area
[0120] 205 vertical section through the evaluation area
[0121] 210 Grayscale
[0122] 211 first color channel or red channel of the 3-channel color image
[0123] 212 second color channel or green channel of the 3-channel color image
[0124] 213 third color channel or blue channel of the 3-channel color image
[0125] 300 Diagram of the progression of brightness values or gray values
[0126] 301 brightness values or gray values
[0127] 302 determined number of brightness values beyond the brightness threshold
[0128] 303 Brightness threshold
[0129] 304 Maximum of the curve 301
[0130] 400 Diagram of the line thickness progression
[0131] 401 Thickness of the linear element
[0132] 402 Tolerance range for the thickness of the linear element
[0133] 403 Defect in the linear element
[0134] 501 Color intensity of the red channel
[0135] 502 Color intensity of the green channel
[0136] 503 Color intensity of the blue channel 504 Gray intensity
[0137] 510 Defect in the linear element
[0138] 512 Gray intensity tolerance range 601 Center of gravity of brightness values
[0139] 610 Defect in the linear element
[0140] 612 Center of gravity tolerance range
Claims
PATENT CLAIMS 1. A method (100) for detecting defects in linear elements of vehicle components, the method (100) comprising the following steps: Providing (101) a camera image (200) of a vehicle component having a linear element (203); wherein the camera image (200) comprises image elements with a respective brightness; Determining (102) an evaluation area (204) in the camera image (200) with a plurality (202) of rows (201), wherein the evaluation area (204) comprises at least a part of the linear element (203); Determining (103) brightness values (301) of the image elements of a respective row (201) of the evaluation area (204); Determining (104) a number (302) of image elements of the respective row (201) of the evaluation area (204) whose brightness values (301) lie beyond a brightness threshold value (303), wherein the determined number (302) corresponds to a thickness (401) of the linear element (203) in the respective row (201) of the evaluation area (204); and Detecting (105) a defect (403) in the linear element (203) of the vehicle component if the thickness (401) of the linear element (203) exhibits a fluctuation outside a tolerance range (402) over the majority (202) of the rows (201) of the evaluation area (204).
2. The method (100) according to claim 1, wherein the evaluation region (204) is a rectangular frame and is determined such that the at least part of the linear element (203) is arranged in the frame along a longitudinal direction of the frame.
3. The method (100) according to claim 2, wherein the plurality (202) of rows (201) extends approximately perpendicular to the linear element (203) and in particular represents sections through a longitudinal axis of the linear element (203).
4. Method (100) according to one of the preceding claims, wherein the camera image (200) represents a gray image (210) whose image elements are represented as gray tones, the gray tones corresponding to the respective brightnesses of the image elements of the camera image (200).
5. Method (100) according to one of the preceding claims, wherein the camera image (200) is a 3-channel color image and the method (100) comprises the following steps: Decomposing the 3-channel color image into its three color channels (211, 212, 213); and Generating a gray image (210) based on a weighted superposition of the three color channels (211, 212, 213) of the 3-channel color image; wherein the determination (103) of the brightness values (301) is applied to the gray image (210).
6. Method (100) according to claim 5, comprising the following steps: Determining an average value of the brightness values (301) which lie beyond the brightness threshold value (303), wherein the average value corresponds to a gray intensity of the linear element (203) in the respective row (201) of the evaluation area (204); and Detecting a defect (510) in the linear element (203) of the vehicle component if the gray intensity (504) over the majority (202) of the rows (201) of the evaluation area (204) has a fluctuation outside a respective gray intensity tolerance range (512).
7. The method (100) according to claim 6, wherein the determination of the mean value of the brightness values (301) that lie beyond the brightness threshold value (303) is additionally applied to the three color channels (211, 212, 213), wherein the mean value corresponds to a respective color intensity of the linear element (203) in the respective row (201) of the evaluation area (204); and wherein the method further comprises the following step: Detecting a defect (510) in the linear element (203) of the vehicle component if the respective color intensity (501, 502, 503) over the majority (202) of the rows (201) of the evaluation area (204) exhibits a fluctuation outside a respective color intensity tolerance range.
8. Method (100) according to one of claims 5 to 7, comprising the following steps: Determining a center of gravity (601) of the brightness values (301) for the respective Row (201) of the evaluation area (204); and Detecting a defect (610) in the linear element (203) of the vehicle component if the center of gravity (601) exhibits a fluctuation outside a center of gravity tolerance range (612) over the majority (202) of the rows (201) of the evaluation area (204).
9. The method (100) according to any one of claims 5 to 8, wherein the weighted superposition of the three color channels (211, 212, 213) of the 3-channel color image is based on a brightness perception of the human eye and in particular weights a red channel of the 3-channel color image with a weight of 0.299, a green channel of the 3-channel color image with a weight of 0.587 and a blue channel of the 3-channel color image with a weight of 0.
114.
10. The method (100) according to any one of the preceding claims, wherein the linear element comprises: ambient lighting of an interior vehicle component; a luminous line in a vehicle component; a luminous element or a seam in an interior vehicle component; a cable in a vehicle component; a conductor track in a vehicle component; or a print in a vehicle component.
11. Method (100) according to one of the preceding claims, comprising: position-tolerant detection of the linear element (203) based on the determined thickness (401) of the linear element (203) over the plurality (202) of rows (201) of the evaluation area (204).
12. Method (100) according to one of the preceding claims, wherein the evaluation region (204) in the camera image (200) is predefined depending on a position of a camera for capturing the camera image (200) with respect to the vehicle component and a known position of the linear element in the vehicle component.
13. A computer program comprising instructions which, when executed by a computer, cause the computer to carry out the method according to any one of the preceding claims.
14. A test system for detecting defects in linear elements of vehicle components, the test system comprising: at least one camera configured to provide a camera image (200) of a vehicle component having a linear element (203); wherein the camera image (200) comprises image elements with a respective brightness; and a test computer system configured to: determine an evaluation region (204) in the camera image (200) having a plurality (202) of rows (201), wherein the evaluation region (204) comprises at least a portion of the linear element (203); to determine brightness values (301) of the image elements of a respective row (201) of the evaluation area (204); to determine a number (302) of image elements of the respective row (201) of the evaluation area (204) whose brightness values (301) lie beyond a brightness threshold value (303), wherein the determined number (302) corresponds to a thickness (401) of the linear element (203) in the respective row (201) of the evaluation area (204); and to detect a defect (403) in the linear element (203) of the vehicle component if the thickness (401) of the linear element (203) exhibits a fluctuation outside a tolerance range (402) across the majority (202) of the rows (201) of the evaluation area (204).
15. The inspection system of claim 14, comprising: a plurality of cameras, each camera being directed toward a portion of the vehicle component and configured to capture a corresponding portion of the linear element (203).
Citation Information
Patent Citations
In-vehicle atmosphere lamp control method and device, storage medium and vehicle
CN116761301A
Line width measuring apparatus
JP1988133005A
Method for measuring sharpness of coating surface
JP1990031138A
Method and apparatus for evaluating line width uniformity, and recording medium containing a line width uniformity evaluation program.
JP4232940B2
Cited By
Device for optical analysis of a component surface
DE102025142397A1