Method for checking calibration of image processing system of sheet metal working machine

By using a calibration plate of predetermined shape in the removal area of ​​the sheet metal processing machine to calibrate the image processing system, the problem of difficulty in calibration of the image processing system is solved, the accuracy of workpiece recognition and system reliability are improved, and the workpiece is ensured Correct sorting and processing.

CN119096268APending Publication Date: 2024-12-06TRUMPF WERKZEUGMASCHINEN GMBH & CO KG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380036338.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-27
Filing Date
2023-03-30
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The existing image processing system is difficult to be calibrated simply and effectively in sheet metal processing machines, resulting in unstable workpiece recognition function and affecting the correct sorting and processing of workpieces.

Method used

By arranging a calibration plate of a predetermined shape in the removal area, taking an image of it, and comparing it with the stored properties, the inspection results are output to determine the calibration status of the image processing system to ensure its reliable operation.

Benefits of technology

The calibration process of the image processing system is simplified, the accuracy of workpiece recognition and the reliability of the system are improved, and the operator can correctly sort the workpieces in processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119096268A_ABST
    Figure CN119096268A_ABST
Patent Text Reader

Abstract

The invention relates to a method for checking an image processing system (18). The calibration plates (24) are arranged at different points in a removal area (14) of the sheet metal working machine (10). Images are respectively captured and a check is made as to whether the properties extracted from the images correspond to known reference values.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a method for checking the calibration of an image processing system of a sheet metal working machine, wherein a camera device of the image processing system detects a removal area for a machined workpiece. Background Art

[0002] It is known from WO 2018 / 073418 A1 or WO 2018 / 073419 A1 to orient a camera device at a sorting table of a flatbed machine for sheet metal processing. After calibrating the camera device to the sheet metal surface or the sorting table, image processing algorithms can be used for part recognition. For example, an optimal sorting strategy can be suggested to the operator via the projection surface of the data source.

[0003] In order to assist the operator in sorting the processed workpieces from the removal area, the image processing system must be able to correctly identify the workpieces. This cannot be guaranteed if the image processing system is not calibrated accurately enough.

[0004] WO 2016 / 005159 A2 describes a method for processing a flat workpiece, in particular a sheet metal or a three-dimensional workpiece, on a processing machine. Here, an image detection device for detecting a two-dimensional image is used to detect a real-time image of the workpiece to be processed. To this end, the two-dimensional real-time image of the image detection device must be calibrated to a three-dimensional machine coordinate system. By calibrating at least three real-time image coordinates (reference image points) to known machine reference points, the processing contour (e.g., laser cutting to be performed) can be displayed in a superimposed manner in the real-time image just at the position where the contour is to be processed. This means that the reference points in the machine processing space are clearly assigned to the reference image points in the real-time image, thereby calibrating the camera device. Advantageously, one of the machine reference points can be formed by a movable machine part (e.g., formed by a laser processing head of a laser processing machine), which has been moved to a known position in the machine coordinate system before detecting at least one reference real-time image. Alternatively, the machine reference point can be added to the workpiece by a processing operation, for example, by marking or freely cutting out a hole circumference. In this method, the image detection device is calibrated, in particular manually, by aligning the CAD representation with the displayed image of the workpiece. Summary of the invention

[0005] Purpose of the Invention

[0006] The object of the present invention is to be able to check the functionality of an image processing system for workpiece recognition in a simple manner.

[0007] Description of the invention

[0008] According to the invention, this object is achieved by a method according to claim 1. The dependent claims and the description specify advantageous variants of the invention.

[0009] According to the invention, a method for checking the calibration of an image processing system of a sheet metal working machine is provided. The sheet metal working machine is in particular a flatbed machine. The sheet metal working machine may be a punching machine. The sheet metal working machine is preferably a laser cutting machine.

[0010] At least one camera device of the image processing system detects a removal area for the machined workpiece. The camera device can be attached to a housing of the sheet metal processing machine. The removal area can be formed on a pallet changer of the sheet metal processing system. The pallet changer in particular simplifies the removal of the machined workpiece and preferably also the insertion of the blank to be machined. The removal area is usually designed to be flat. The removal area can have an extension of more than one meter, in particular more than two meters in the plane in which it extends.

[0011] According to the present invention, the method comprises the following steps:

[0012] A) Arranging a calibration plate of a predetermined shape in the removal area,

[0013] B) Take an image of the calibration plate,

[0014] C) Verifying whether the properties of the image in the different verified parts of the removed area correspond to the stored properties of the calibration plate and outputting the result of the verification.

[0015] The predetermined shape of the calibration plate enables a standard for comparison with the image processing system. The calibration plate can have a predetermined geometry, in particular with regard to shape and / or size. Alternatively or additionally, the calibration plate can have a predetermined surface quality. Especially regarding the surface quality of the color and / or pattern.

[0016] Step A) enables the image processing system to take an image of the calibration plate in step B). The image is then analyzed by the image processing system. In particular, the properties of the inspection plate are extracted from the image taken. The exact nature of these properties depends on the previous calibration of the image processing system. By comparing the stored properties of the calibration plate, it can be checked in step C) whether the image processing system is correctly calibrated so that it operates reliably and can be used in particular for workpiece identification. In particular, it can be checked whether the properties extracted from the image are within a predetermined tolerance range of a predetermined reference value for the calibration plate. By taking into account different inspection parts in step C), the calibration can be advantageously checked for the entire removal area. For example, the inspection parts can be located in the corners of the removal area and in its center.

[0017] The result of the inspection is output, for example, stored in a memory of the processing device and / or preferably transmitted to the operator by displaying the inspection result on a display device. If the inspection in step C) shows that the image processing system is correctly calibrated, the operator can assume that the image processing system works as expected. The image processing system can then be used for sheet metal processing, in particular for supporting the operator in sorting the workpieces being processed.

[0018] A plurality of measuring sections of a predetermined shape can be formed on the calibration plate. The measuring sections can each have a predetermined geometry, in particular with respect to shape and / or size. Alternatively or additionally, the measuring sections can each have a predetermined surface quality, in particular with respect to color and / or pattern. In step C), it can be checked for different inspection parts whether the properties of the image correspond to the stored properties of the corresponding measuring sections of the calibration plate assigned to one of the inspection parts. By using a calibration plate with several measuring sections, a larger part of the removal area, preferably the entire removal area, can be prepared for checking the calibration by arranging the calibration plate once in the removal area.

[0019] Preferably, however, the calibration plate is arranged successively in different inspection sections and steps B) and C) are repeated for the different inspection sections, respectively. In other words, a single (smaller) calibration plate is used multiple times to check the calibration of the image processing system over the entire removal area. This simplifies the handling of the calibration plate and may in particular allow the calibration plate to be arranged manually (without mechanical assistance) in the respective inspection section.

[0020] Preferably, the image processing system displays the test sections. This makes it easier to arrange the calibration plates in different test sections.

[0021] The image processing system may include a display device for displaying the image captured by the camera. Preferably, the transformation of the image to the plan view of the removed area is displayed on the display device. This makes it easier to compare the situation in the removed area with the information displayed on the display device.

[0022] It is particularly preferred that the image processing system displays the test portion (together with the image or a transformation of the removed area) on a display device. The test portion or its border can be placed above the displayed image. By looking at the display device, it can be seen whether the calibration plate is positioned correctly.

[0023] Alternatively or additionally, the image processing system may display the inspection part in the removed area. For example, the following lines may be used: the lines mark the boundaries of the inspection part in which the removed area is projected. This further simplifies the correct positioning of the calibration plate.

[0024] Typically, if the check in step C) shows that the properties of the image do not correspond to the stored properties of the calibration plate, the image processing system is recalibrated. In this respect, the invention also relates to a method for calibrating an image processing system of a sheet metal working machine. Insufficient calibration is thereby corrected. A routine for calibrating the image processing system can be stored in a control device of the sheet metal working machine or the image processing system. The image processing system can be calibrated, for example, as described in WO 2016 / 005159A2. In particular, the CAD data of the calibration plate can be aligned with the detected image. This can be done manually by comparing it with the displayed image. Alternatively, this can be done automatically; then there is no need to display the image.

[0025] Preferably, the calibration plate is measured by the image processing system. In this method variant, the calibration plate or the measuring section has predetermined dimensions. To measure the calibration plate, the edges can be extracted from the recorded image and their distance in the image can be determined. Correct determination of the dimensions in the entire removed area is particularly important for the functioning of the image processing system.

[0026] In an advantageous variant of the method, a brightness value is determined for each of the different test sections in the captured image of the calibration plate. Preferably, it is checked whether the maximum deviation of the brightness values ​​for the different test sections exceeds a predetermined limit value. The limit value can be specified absolutely or preferably as a relative deviation between the individual brightness values ​​(e.g. a maximum value of 10%). The test result can be output, for example, stored in a memory of the processing device and / or preferably transmitted to the operator by displaying it on a display device. This method variant allows the detection and evaluation of the lighting conditions perceptible to the image processing system. In particular, due to the arrangement of the camera device at the side of the removal area, the effective brightness for the image processing system or the camera device can be different from the brightness that can be measured at various points in the removal area by means of a conventional brightness measuring device. Therefore, it is generally not possible to use a separate brightness measuring device to assess whether the lighting conditions allow reliable use of the image processing system.

[0027] It is particularly preferred to change the lighting of the removal area if the maximum deviation of the brightness values ​​is above a limit value. In particular, the lighting is adjusted such that the deviation of the brightness values ​​perceived by the image processing system is below the limit value. This makes it possible to configure a uniform brightness for the image processing system over the entire removal area. This increases the reliability of the image processing system.

[0028] Further features and advantages of the present invention can be found in the description, claims and drawings. According to the present invention, the above-mentioned features and the features yet to be further described can be used alone or together in any desired advantageous combination. The embodiments shown and described should not be understood as an exhaustive enumeration, but should be understood as having exemplary characteristics for describing the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The invention is illustrated in the drawings and described with the aid of exemplary embodiments. In the drawings:

[0030] Figure 1 A sheet metal processing machine with an image processing system for detecting removal areas for a processed workpiece is shown in a schematic perspective view;

[0031] Figure 2 A schematic flow chart of a method for inspecting an image processing system according to the present invention is shown;

[0032] Figure 3 shows a schematic representation of an image of a removal area displayed on a display device of an image processing system, wherein a calibration plate is arranged in a first inspection section;

[0033] Figure 4 Shows Figure 3 an image of the calibration plate, wherein the properties indicating the calibration plate are correctly identified;

[0034] Figure 5 shows a schematic representation of an image of a removed area displayed on a display device of an image processing system, wherein the calibration plate is arranged in a second inspection portion whose properties have not been correctly identified;

[0035] Figure 6 A schematic representation of an image of a removed area displayed on a display device of an image processing system is shown, indicating that the properties of the calibration plate are correctly identified in the respective inspection portions and indicating that the brightness perceived by the image processing system in these inspection portions meets predetermined criteria. DETAILED DESCRIPTION

[0036] Figure 1 A sheet metal processing machine 10, here a flat-bed laser cutting machine, is shown. The sheet metal processing machine 10 has a pallet changer 12 in which a removal area 14 is formed for processed workpieces 16. In particular, the workpieces 16 can be removed (sorted) manually from the removal area 14 and forwarded for further processing or use.

[0037] The sheet metal working machine 10 further comprises an image processing system 18. The image processing system 18 comprises at least one camera 20 and a display device 22. In addition, the image processing system 18 or the sheet metal working machine 10 may comprise a control device, which is not shown in detail. The camera 20 is directed towards the removal area 14, as can be seen from the dashed line emanating from the camera 20. Here, the camera 20 detects the removal area 14 from an angle above. The image of the removal area 14 captured by the camera 20 can be displayed on the display device 22, wherein, in particular, for display purposes, the image is transformed into a plan view (bird's eye view) in which the removal area 14 is observed vertically from above.

[0038] The image processing system 18 is used to support the manual sorting of the processed workpieces 16. For this purpose, the workpieces 16 are identified in the images captured by the camera device 20 and instructions for processing the individual workpieces can be displayed on a display device 22. Workpiece identification requires that the image processing system 18 is correctly calibrated.

[0039] The calibration plate 24 is used to check the image processing system 18, in particular to verify its calibration. 24. The calibration plate 24 has a predetermined shape. Here, the calibration plate 24 is designed as a rectangular parallelepiped with known dimensions. In addition, the calibration plate 24 has a color and possibly a pattern on its surface ( Figure 1 not shown in detail).

[0040] In order to check the calibration of the image processing system 18, in step 102 (see Figure 2 ), the calibration plate 24 is moved in the first inspection portion of the removal area 14. The camera device 20 captures an image of the removal area 14 with the calibration plate 24, see step 104. In step 105, the captured image can be displayed on the display device 22, see Figure 3 Preferably, the border 26 of the inspection portion 28 is also superimposed in the displayed image.

[0041] In step 106, it is checked, for example by a suitably programmed control device, whether the properties of the calibration plate 24 extracted from the captured image correspond to stored reference values ​​of these properties within predetermined tolerances. For example, the calibration plate 24 can be measured via image analysis, and the result of this measurement can be compared with the known dimensions of the calibration plate 24. In step 108, the result of the check can be output. In particular, the result of the check can be displayed on the display device 22. Figure 4 In FIG. 2 , a (preferably green) check mark indicates that the properties of the calibration plate 24 are correctly identified in the first inspection portion 28 .

[0042] For the calibration plates 24 arranged in the respective inspection section 28 , brightness values ​​can be determined in step 112 from the recorded images.

[0043] After the image of the removal area 14 with the calibration plate 24 arranged in the first test section 28 has been recorded and evaluated, the calibration plate 24 is arranged in a further test section 28. The steps described above are repeated accordingly. In this way, all test sections 28 are processed successively.

[0044] For example, the test in step 106 can show for the second test part 28 that the properties extracted from the captured image do not correspond accurately enough to the reference values ​​of the calibration plate 24. This is output in step 108. Figure 5 Incorrect identification of the properties of the calibration plate in the second verification portion 28 is indicated by a (preferably red) cross.

[0045] Since the inspection of the image processing system 18 in the second inspection section 28 identified a lack of functionality, the image processing system 18 is recalibrated in step 110. After a successful calibration, the properties of the calibration plate 24 are correctly identified in all inspection sections 28. Figure 6 This is indicated by a check mark in each inspection section 28.

[0046] In step 114, the brightness values ​​of the calibration plate 24 in the different inspection sections 28 can be checked for deviations from one another. In a given step 116, the inspection result is determined. Figure 6 An example of a brightness symbol 30 displayed in the form of a sun is shown, wherein a check mark indicates sufficiently small deviations between brightness values; however, unacceptably large deviations may be indicated by a cross. If the captured image is not sufficiently uniformly illuminated throughout the removal area 14, the illumination of the removal area must be corrected in step 118.

[0047] In summary, the invention relates to a method for testing an image processing system. Calibration plates are arranged at different positions in the removal area of ​​a sheet metal processing machine. Images are taken in each case and it is checked whether the properties extracted from the images correspond to known reference values.

[0048] Reference numerals list

[0049] Sheet metal processing machines 10

[0050] Pallet changer 12

[0051] Removed area 14

[0052] Artifact 16

[0053] Image processing system 18

[0054] Camera device 20

[0055] Display device 22

[0056] Calibration board 24

[0057] Boundary 26

[0058] Inspection section 28

[0059] Brightness symbol 30

[0060] Arrange 102 calibration plate in the inspection section

[0061] Take 104 images

[0062] Display 105 images

[0063] Check 106 whether the properties of the calibration plate extracted from the image correspond to known reference values

[0064] Output 108 the test result from step 106

[0065] Calibrate 110 Image Processing System

[0066] Determine the brightness value of 112

[0067] Check 114 brightness values ​​for deviation from each other

[0068] Output 116 the test result from step 114

[0069] Change 118 removed lighting from area

Claims

1. A method for checking the calibration of an image processing system (18) of a sheet metal working machine (10), in particular a flatbed machine, preferably a laser cutting machine, in, At least one camera device (20) of the image processing system (18) detects a removal area (14) for a processed workpiece (16), The method comprises the following steps: A) arranging (102) a calibration plate (24) of a predetermined shape in the removal area (14), B) taking (104) an image of the calibration plate (24), C) verifying (106) whether the properties of the image in different verification portions (28) of the removal area (14) correspond to the stored properties of the calibration plate (24) and outputting (108) the result of the verification.

2. The method according to claim 1, characterized in that forming a plurality of measuring sections of predetermined shapes on the calibration plate (24); And in step C), it is checked for the different test sections (28) whether the properties of the image correspond to the stored properties of the corresponding measurement section of the calibration plate (24) assigned to one of the test sections (28).

3. The method according to claim 1, characterized in that The calibration plates (24) are arranged successively in the different test sections (28), and steps B) and C) are repeated for the different test sections (28), respectively.

4. The method according to any one of the preceding claims, characterized in that The image processing system (18) displays the inspection portion (28).

5. The method according to any one of the preceding claims, characterized in that The image processing system (18) has a display device (22) for displaying the image captured by the camera device (20).

6. The method according to claim 5, characterized in that A transformation of the image to a plan view of the removed area (14) is displayed on the display device (22).

7. The method according to claim 4 and claim 5 or 6, characterized in that The image processing system (18) displays the inspection portion (28) on the display device (22).

8. The method according to claim 4 or 7, characterized in that: The image processing system (18) displays the inspection portion (28) in the removal area (14).

9. The method according to any one of the preceding claims, characterized in that If the check in step C) shows that the properties of the image do not correspond to the stored properties of the calibration plate (24), the image processing system (18) is recalibrated.

10. The method according to any one of the preceding claims, characterized in that The calibration plate (24) is measured by the image processing system (18).

11. The method according to any one of the preceding claims, characterized in that A brightness value is determined for each of the different test sections (28) in the recorded image of the calibration plate (24).

12. The method according to claim 11, characterized in that It is checked whether the maximum deviation of the brightness values ​​for the different test parts (28) exceeds a predetermined limit value, and the result of the check is output.

13. The method according to claim 12, characterized in that If the maximum deviation of the brightness values ​​is above the limit value, the illumination of the removal area (14) is changed.

14. The method according to any one of the preceding claims, characterized in that The removal area (14) is formed on a pallet changer (12) of the sheet metal processing system (10).