Method and system for assisting in distinguishing between sheet-metal workpieces
Patent Information
- Application Number
- EP2023730511
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-06-28
- Filing Date
- 2023-06-05
- Publication Date
- 2025-05-07
AI Technical Summary
Existing methods fail to efficiently differentiate and distinguish sheet metal workpieces, particularly in large quantities, making it difficult for operators to identify and compare their geometric differences effectively.
A system and method that utilizes a computing unit to retrieve and compare geometric workpiece information from memory, highlighting differences in drawings output via an output unit, using graphics algorithms and artificial intelligence to select and display the most visible differences, such as size, hole arrangement, and outer contours, with the option to select workpiece information via images or lists.
Facilitates efficient differentiation of sheet metal workpieces by highlighting key differences in graphical outputs, aiding operators in distinguishing between workpieces, even when they vary in size or configuration, thereby improving sorting and processing efficiency.
Smart Images

Figure 1.1
Abstract
Description
[0001] Method and system to assist in the differentiation of sheet metal workpieces
[0002] The invention relates to a method and system for assisting in the differentiation of sheet metal workpieces.
[0003] Furthermore, the invention relates to a system for assisting in the differentiation of sheet metal workpieces.
[0004] A system for detecting an object is known from DE 10 2018 215 538 Al.
[0005] The invention is based on the object of providing a method and a system as mentioned above which supports the operator in distinguishing workpieces made from a sheet metal.
[0006] This object is achieved according to the invention in the method mentioned at the outset in that a memory contains a respective piece of geometric workpiece information for a plurality of workpieces, at least one first piece of workpiece information of a first workpiece and one second piece of workpiece information of a second workpiece being selected, the selected workpiece information being retrieved from the memory by a computing unit and compared with one another, the computing unit determining at least one difference between the selected workpiece information, the workpiece information each containing a drawing of the respective workpiece or a drawing being created from the workpiece information, the drawings of the selected workpiece information being output graphically via an output unit and the difference being highlighted in at least one drawing.
[0007] The geometric workpiece information is stored in the memory in machine-readable form. This can be, for example, CAD data, NC data, or even drawings. The two or more workpiece information items can be selected in various ways, which will be discussed in more detail later.
[0008] The selected workpiece information is preferably compared based on the drawings. This allows the use of well-known graphics algorithms. Alternatively, the workpiece information can be compared based on existing data, such as CAD data or NC data.
[0009] If several differences are found during the comparison, only the difference that is most easily recognizable for the operator is displayed.
[0010] The highlighting in the drawing can be done, for example, by arrows, borders, colored backgrounds or similar.
[0011] Preferably, the difference is a different size of the workpieces, and the drawings are scaled to a uniform size. The scaled output makes the difference in size immediately apparent.
[0012] Preferably, the distinction is a different number and / or arrangement of holes in the respective workpieces, and at least one hole is highlighted in a drawing. By highlighting the hole, the operator can immediately see which hole to pay attention to.
[0013] Preferably, the difference is a different outer contour of the workpieces, and the drawings are rotated and / or mirrored so that the superimposed drawings have the greatest possible surface overlap. The drawings are output in this rotation and / or mirrored orientation. The rotation and / or mirroring makes comparing the drawings particularly easy for the operator.
[0014] Preferably, the drawings are displayed overlaid or side by side.
[0015] Preferably, an image of a workpiece is taken, and the first piece of workpiece information is selected based on the image. When selecting workpiece information based on an image, the operator can take an image of a workpiece with a camera and select the corresponding workpiece information. This is a particularly simple method for selecting the workpiece information associated with a given workpiece.
[0016] Particularly preferably, component information is generated from the image, and the first piece of workpiece information that is most similar to the component information is automatically selected. The component information is preferably available at least partially in the same format as the workpiece information. For example, an outer contour of the workpiece can be recognized from the image and compared with the drawing from the workpiece information. Optionally, the workpiece information with the second greatest similarity can be selected as the second piece of workpiece information.
[0017] The similarity of the workpieces can be determined, for example, using artificial intelligence, in particular a neural network. An example of such artificial intelligence is described in DE 10 2018 215 538 A1.
[0018] In an alternative embodiment, a first piece of workpiece information is selected by an operator, and the piece of workpiece information that is most similar to the first piece of workpiece information is automatically selected as the second piece of workpiece information. The first piece of workpiece information can be selected by the operator from the plurality of workpiece information items, for example, via a user interface. By automatically comparing the workpiece information, the piece of workpiece information that is most similar to the first piece of workpiece information selected by the operator is selected as the second piece of workpiece information from the unselected pieces of workpiece information.
[0019] Preferably, at least one piece of workpiece information is selected by artificial intelligence. Artificial intelligence can preferably be used in the above-mentioned selection based on similarity. In an alternative embodiment, at least a first workpiece is automatically recognized by its position in a sheet metal, and the first piece of workpiece information belonging to the workpiece is selected. Recognition by the position in the sheet metal is particularly advantageous when a plurality of workpieces have been cut from a sheet metal by a machine tool, in particular a flatbed laser cutting machine, and the remaining sheet metal is present together with the workpieces. Such recognition is known from WO 2018 / 073418 A1.
[0020] The invention also relates to a system for assisting in the differentiation of workpieces, comprising a memory, a computing unit and an output unit, wherein a plurality of geometric workpiece information items are present on the memory, wherein the workpiece information each contains a drawing of the respective workpiece or the computing unit can create a drawing from the workpiece information, wherein the computing unit is provided and configured to retrieve at least a first piece of workpiece information of a first workpiece and a second piece of workpiece information of a second workpiece from the memory, to determine at least one difference between the workpiece information items, and to output the drawings of the selected workpiece information graphically via an output unit and to highlight the difference in at least one output drawing.
[0021] The system assists the operator in distinguishing workpieces by outputting drawings of the workpieces and highlighting the difference in at least one drawing.
[0022] Preferably, the system comprises a camera for creating an image, and the computing unit is provided and configured to select at least a first piece of workpiece information based on the image. For example, the camera can capture an image of a workpiece, and the workpiece information associated with the workpiece can be selected based on the image. Alternatively, the camera can capture an image of a sheet containing a plurality of workpieces, identify a workpiece at the position in the sheet, and select the workpiece information associated with the workpiece.
[0023] Preferably, a trained artificial intelligence model is present in the memory, and the computing unit is designed and configured to use the model to select at least one piece of workpiece information. The artificial intelligence can, in particular, determine the similarity of workpiece information to one another.
[0024] Preferably, the system comprises an input unit, and the computing unit is provided and configured to receive a selection of first workpiece information from an operator via the input unit. Particularly preferably, the computing unit is provided and configured to display the selectable workpiece information to the operator via the output unit.
[0025] Preferably, the system is intended and configured to carry out a method as described above.
[0026] The following description of preferred embodiments, taken in conjunction with the drawings, serves to further explain the invention. They show:
[0027] Fig. 1 shows a flow chart of a method;
[0028] Fig. 2 shows a sketch for selecting workpiece information from an image of a sheet metal workpiece;
[0029] Fig. 3 shows a sketch for selecting workpiece information via a workpiece list;
[0030] Fig. 4 is a diagram showing the selection of workpiece information by detecting a position of the workpiece;
[0031] Fig. 5 shows an output of a plurality of workpiece information; Fig. 6 shows an output of workpiece information in standardized scaling;
[0032] Fig. 7 an output of workpiece information with different holes;
[0033] Fig. 8 an output of workpiece information with different
[0034] Outer contours.
[0035] Identical or functionally equivalent elements are designated by the same reference numerals in all embodiments.
[0036] Fig. 1 shows an embodiment of a flow chart 100. In a first step 110, a first piece of workpiece information is selected. In a second step 120, a second piece of workpiece information is selected. Several options for selecting the first and second pieces of workpiece information are described later in connection with Figures 2, 3 and 4. The workpiece information each contains a drawing, or a drawing can be created from the workpiece information. In a third step 130, the selected pieces of workpiece information are compared. For this purpose, it can be advantageous to convert the workpiece information into the same format. In particular, it can be advantageous to create a drawing of the corresponding workpiece from the workpiece information. In a fourth step 140, at least one difference between the selected pieces of workpiece information is determined.In a fifth step 150, the drawings are output. The difference is highlighted in at least one drawing.
[0037] Fig. 2 shows a sketch for selecting workpiece information using an image of a sheet metal workpiece 1. A first workpiece 11 is held by an operator 8 in the field of view of a camera 9. The camera 9 can be attached to a machine tool, e.g., a laser cutting machine. Preferably, the camera 9 is part of a mobile device, e.g., a smartphone. The camera 9 takes an image 91 of the first workpiece 11 and transmits the image 91 to a computing unit 5. The computing unit 5 is connected to a memory 3. The memory 3 contains a piece of geometric workpiece information for each of a plurality of workpieces 1. The computing unit 5 selects the workpiece information matching the image 91 as the first piece of workpiece information. The selection can be made, for example, based on the similarity of the workpiece information to the image. The similarity can be determined, for example, using artificial intelligence, in particular a neural network.A corresponding artificial intelligence can be stored in the memory 3 and executed by the computing unit 5 to determine the similarity. The second piece of workpiece information can be selected in the same way by creating an image 91 of a second workpiece. Alternatively, the workpiece information that is second most similar to the image 91 is selected as the second piece of workpiece information. The computing unit 5 compares the selected workpiece information and determines at least one difference 6 between the selected workpiece information. The computing unit 5 is connected to an output unit 7, here a monitor, and outputs the drawings of the workpiece information via the output unit 7. During the output, difference 6 is highlighted, here by a border of different drill holes.
[0038] Fig. 3 shows a sketch for selecting workpiece information via a workpiece list. A large number of geometric tool information items are stored in a memory 3. A computing unit 5 is connected to the memory 3 and an output unit 7, in this case a monitor. The computing unit loads several pieces of tool information from the memory 3 and outputs them via the output unit 7. In this example, the workpiece information is output as drawings, but it is also possible to output the information as text, e.g. as a component number or order number. The operator 8 now selects a first piece of workpiece information from the output workpiece information. In this example, the selection is made via a touchscreen in the output unit. The second piece of workpiece information can be selected in the same way.Alternatively, the workpiece information that is most similar to the first workpiece information is selected as the second piece of workpiece information. For this purpose, the workpiece information can be compared using artificial intelligence. Computing unit 5 compares the selected workpiece information and determines at least one difference 6 between the selected workpiece information. Computing unit 5 outputs the drawings of the workpiece information via output unit 7. Difference 6 is highlighted in the output.
[0039] Fig. 4 shows a sketch for selecting workpiece information via the detection of a workpiece position. A machine tool 200, here a laser cutting machine, produces sheet metal workpieces 1 from a sheet metal. The sheet metal workpieces 1 are output from the machine tool 200 together with the remaining sheet metal on a pallet 201. An operator 8 removes the sheet metal workpieces 1 from the remaining sheet metal and sorts the sheet metal workpieces 1 onto a transport trolley 202. A camera 9 is aimed at the pallet 201 and creates images of the sheet metal workpieces 1 and the remaining sheet metal. A computing unit 5 is connected to the camera 9 and a memory 3. The memory 3 stores workpiece information and information about the respective position of the workpieces 1 in the remaining sheet metal. The computing unit 5 compares the images from the camera 9 with the information about the respective position of the workpieces 1 and thus determines which workpiece 1 the operator 8 has removed.The workpiece information belonging to the removed workpiece 1 is selected as the first piece of workpiece information. The second piece of workpiece information can be selected in the same way for a second removed workpiece. Alternatively, the workpiece information that is most similar to the first piece of workpiece information is selected as the second piece of workpiece information. For this purpose, the workpiece information can be compared using artificial intelligence. The computing unit 5 compares the selected workpiece information and determines at least one difference 6 between the selected workpiece information. The computing unit 5 outputs the drawings of the workpiece information via an output unit 7. Difference 6 is highlighted in the output.
[0040] Fig. 5 shows an output of a large number of workpiece information items. Such a display can, for example, be output via the output unit to the operator of a machine tool shown in Fig. 4. On the right-hand side, a large number of drawings 4 from the workpiece information are shown. In this example, the area intended to display a single drawing is always the same size. This enables details to be recognized while simultaneously displaying workpieces of different sizes. For each drawing, it is indicated how often the corresponding component was manufactured from the sheet metal and how many have already been removed. In this example, each row shows the workpieces of a customer. In the middle, each customer is assigned a color, shown here as hatching. On the left-hand side, the drawings are shown with their respective positions in the remaining sheet metal.The display on the left allows the operator to see where each workpiece is located on the pallet. The color or shading helps assign workpieces to customers, allowing the components to be sorted according to customer requirements if necessary. The operator can then select workpiece information by removing workpieces, as described in connection with Fig. 4.
[0041] Fig. 6 shows an output of workpiece information 21, 22 in standardized scaling. The workpiece information 21, 22 selected in this example describe identical geometries with the same aspect ratios but different absolute sizes. On the left-hand side, the drawings 4 from the workpiece information are shown with the same absolute side lengths, as they would be shown on the right-hand side in Fig. 5. The computing unit identifies the different absolute sizes as the difference between the two selected pieces of workpiece information 21, 22. For easier differentiation, the drawings 4 are output via the output unit 7 in the same scaling. In addition, the drawings 4 are rotated so that an overlay of the drawings 4 has the greatest possible area overlap. To emphasize the difference 6, the length information is marked, here by a border.
[0042] Fig. 7 shows an output of workpiece information 21, 22 with different holes 61. The workpiece information 21, 22 selected in this example describe identical geometries with different holes. The processing unit recognizes the different holes as the difference between the two selected workpiece information items. For output, the drawings are rotated so that an overlay of the drawings has the greatest possible surface overlap. To highlight the difference 6, the holes are marked, here with a border.
[0043] Fig. 8 shows an output of workpiece information with different outer contours. The workpiece information selected in this example describes approximately circular workpieces. However, the respective outer contours of the workpieces have recesses of different sizes. The processing unit recognizes the different recesses as the difference between the two selected workpiece information items. For output, the drawings are rotated so that an overlay of the drawings has the greatest possible surface overlap. To emphasize the difference 6, the recesses are marked, here with a border.
[0044] List of reference symbols
[0045] Sheet metal workpiece first workpiece second workpiece
[0046] Workpiece information first workpiece information second workpiece information
[0047] memory
[0048] drawing
[0049] Computing unit
[0050] Difference
[0051] holes
[0052] Output unit
[0053] operator
[0054] camera
[0055] Picture
[0056] Schedule
[0057] First step
[0058] Second step
[0059] Third step fourth step
[0060] Fifth step
[0061] machine tool
[0062] range
[0063] Transport trolley
Claims
Patent claims Method for assisting in the differentiation of sheet metal workpieces (1), wherein for a plurality of the workpieces (1) there is in a memory (3) a respective piece of geometric workpiece information (2), wherein at least a first piece of workpiece information (21) of a first workpiece (11) is selected (110) and a second piece of workpiece information (22) of a second workpiece (12) is selected (120), wherein the selected workpiece information (21, 22) is retrieved from the memory (3) by a computing unit (5) and compared with one another (130), wherein at least one difference (6) between the selected workpiece information (21, 22) is determined (140) by the computing unit (5), wherein the workpiece information (21, 22) each contains a drawing (4) of the respective workpiece (11, 12) or a drawing (4) is created from the workpiece information (21, 22), wherein the drawings (4) of the selected workpiece information (21,22) are output graphically via an output unit (7) (150), and the difference (6) is highlighted in at least one output drawing (4). The method according to claim 1, wherein the difference (6) is a different size of the workpieces (21, 22), and the drawings (4) are output scaled to a uniform size. The method according to one of the preceding claims, wherein the difference (6) is a different number and / or arrangement of holes (61) in the respective workpieces (21, 22), and at least one hole (61) is highlighted in a drawing (4). Method according to one of the preceding claims, wherein the difference (6) is a different outer contour of the workpieces (21, 22), and wherein the drawings are rotated and / or mirrored such that a superimposition of the drawings (4) has the greatest possible area overlap, and the drawings (4) are output in this rotation. Method according to one of the preceding claims, wherein the drawings (4) are output superimposed or side by side. Method according to one of the preceding claims, wherein an image (91) of a workpiece (1) is created, and the first piece of workpiece information (21, 22) is selected based on the image (91). Method according to claim 6, wherein component information is generated from the image (91), and the first piece of workpiece information (21) that is most similar to the component information is automatically selected.Method according to one of claims 1 to 5, wherein a first piece of workpiece information (21) is selected by an operator (8), and the workpiece information that is most similar to the first piece of workpiece information (21) is automatically selected as the second piece of workpiece information (22). Method according to one of the preceding claims, wherein at least one piece of workpiece information (21, 22) is selected by artificial intelligence. Method according to one of claims 1 to 5, wherein at least one first workpiece is automatically recognized by its position in a sheet metal, and the first piece of workpiece information (21, 22) belonging to the workpiece is selected. System for assisting in the differentiation of sheet metal workpieces (1), comprising a memory (3), a computing unit (5) and an output unit (7), wherein a plurality of geometric workpiece information items are present in the memory, wherein the workpiece information each contains a drawing (4) of the respective workpiece (1) or the computing unit (5) can create a drawing (4) from the workpiece information, wherein the computing unit (5) is provided and configured to retrieve at least a first piece of workpiece information of a first workpiece and a second piece of workpiece information of a second workpiece from the memory, to determine at least one difference (6) between the workpiece information items and to output the drawings (4) of the selected workpiece information (21, 22) graphically via an output unit (7), thereby highlighting the difference (6) in at least one output drawing (4).System according to claim 11, wherein the system comprises a camera (9) for creating an image (91), and the computing unit (5) is provided and configured to select at least one first piece of workpiece information based on the image (91). System according to one of claims 11 to 12, wherein a trained artificial intelligence model is present on the memory (3), and the computing unit (5) is provided and configured to use the model to select at least one piece of workpiece information. System according to one of claims 11 to 13, wherein the system has an input unit, and the computing unit (5) is provided and configured to receive a selection of first piece of workpiece information (21) from an operator (8) via the input unit. System according to one of claims 11 to 14, wherein the system is provided and configured to carry out a method according to one of claims 1 to 10.