METHOD FOR LINKING INFORMATION TO A WORKPIECE DATA SET AND FLATBED TOOL MACHINE

Description

[0001] The present invention relates to methods for linking information with a workpiece data set of a workpiece in an arrangement of workpieces located in a support plane of a sorting table, in particular for integrating a manual sorting process into the operation of flatbed machine tools. Furthermore, the invention relates to correspondingly designed flatbed machine tools.

[0002] When sorting parts on machine tools, especially laser-cut parts or punched workpieces such as sheet metal parts, an operator typically visually compares each cut part with a job drawing for the respective part. Incorrectly cut or punched sheet metal parts are marked as scrap and sorted out. If an operator, for example, recognizes a scrap part on the sorting table, they can make the corresponding entry at an operator terminal. However, this requires switching to the location of the operator terminal. Alternatively, the operator could make several / all correction entries at once. However, multiple entries are prone to errors.

[0003] A method for assisting an operator in a sorting process of workpieces arranged on a sorting table, also called part separation, is described in WO 2018 / 073420 A1 of the applicant, wherein in particular positioning systems are used to locate the operator's hand.

[0004] A method for automatic process control is known from DE 102 15 885 A1. Furthermore, intelligent gloves for industrial use, particularly for supporting workflows in industrial manufacturing, are known, for example, from DE 10 2015 111 506 A1 and DE 10 2011 002 952 A1.

[0005] From DE 10 2017 107 357 A1 an absorption support method on a flatbed machine is known.

[0006] A touch control for a processing machine is known from DE 10 2017 004 926 A1.

[0007] A gesture control of a robot is known from US 2018 / 0319024 A1.

[0008] US 2018 / 0349373 A1 discloses a gesture control system for an industrial process. One aspect of this disclosure is based on the objective of reducing walking distances between the sorting table and the operator terminal, particularly when booking reject parts, and preventing errors. A further objective is to facilitate the assignment of information to data records of produced workpieces and / or to reduce errors in the assignment of information to the data records.

[0009] At least one of these objects is achieved by a method for linking information with a workpiece data record of a workpiece of an arrangement of workpieces lying in a support plane of a sorting table according to claim 1 and by a flatbed machine tool according to claim 13. Further developments are specified in the subclaims.

[0010] One aspect of this invention relates to a method for gesture-based recording of a workpiece-specific sorting process for workpieces arranged on a sorting table, which were produced with a flatbed machine tool, in particular a laser cutting or punching flatbed machine tool, according to a processing plan. The method comprises the steps: Detecting a selection gesture of an operator for identifying one of the arranged workpieces, wherein the selection gesture is in spatial relation to the workpiece to be identified, and detecting a booking gesture for the identified workpiece.

[0011] In a further aspect, a method for linking information to a workpiece data set of a workpiece in an arrangement of workpieces located in a support plane of a sorting table is disclosed. The workpieces were produced from a plate-shaped material using a flatbed machine tool, in particular a laser cutting or punching flatbed machine tool, according to a machining plan stored in a control unit of the flatbed machine tool. The machining plan comprises workpiece data sets in which the positions and contours of the workpieces in the arrangement of workpieces are stored. The method comprises the following steps: Detecting a selection time by a first action of an operator that is spatially related to a workpiece to be selected, determining a position of a hand of the operator in space above the arrangement of workpieces using a positioning system at the time of selection, deriving a selection position in the support plane from the determined position of the hand, selecting a workpiece data set from the workpiece data sets by comparing the selection position with the positions and contours of the workpieces as a workpiece data set selected by the first action, detecting a second action in which the operator performs a gesture movement, wherein information to be booked is assigned to the gesture movement in a database, reading the information to be booked from the database and linking the information to be booked with the selected workpiece data set.

[0012] In a further aspect, a flatbed machine tool, in particular a laser cutting or punching flatbed machine tool, comprises a processing unit, in particular a laser cutting or punching processing unit, and a control unit in which a processing plan is stored for controlling the processing unit to produce workpieces arranged spatially next to one another. Furthermore, the flatbed machine tool comprises a sorting table for providing the produced workpieces arranged next to one another in a support plane for sorting by an operator, and a positioning system for determining the spatial position of a hand of the operator. The control unit is designed to carry out the methods disclosed herein.

[0013] In some embodiments, the first action can be a selection gesture movement that the operator performs with their hand over the arrangement of workpieces, and which is detected using an accelerometer worn on the hand or the positioning system. For example, the selection gesture movement can be a tapping movement toward the workpiece to be selected. The tapping movement can optionally be detected using the positioning system and output as position data from lined-up positions of the hand. A position in the support plane that lies in extension of the lined-up positions can be derived as the selection position.

[0014] In some embodiments, the operator can wear a selection support unit, in particular a glove, a wristband, or a stylus, close to hand for determining the position of the operator's hand. The selection support unit can optionally comprise an acceleration sensor and / or an active transmitter of a positioning system and / or a passive transmitter of a positioning system and / or be configured as part of the positioning system.

[0015] In some embodiments, the positioning system can detect the position of a hand-held stylus to determine the position of the operator's hand. The first action can comprise tapping the stylus on the workpiece to be selected, and position data of a tip of the stylus in or near the support plane can be derived as the selection position. The stylus can comprise a pressure-sensitive pressure sensor, in particular in a tip of the stylus, and can further be configured to output a trigger signal upon activation of the pressure sensor. The first action can comprise pressing the stylus on the workpiece to be selected to activate the pressure sensor and output a trigger signal by the stylus.The method may then further comprise the following steps: detecting the trigger signal and determining the selection time as the time of detection of the trigger signal; and limiting the positions of the hand detected by the positioning system to the selection time or to a time window around the selection time.

[0016] In some embodiments, the positioning system can be configured to evaluate image data from one or more cameras for image-assisted determination of the position of the operator's hand. Alternatively, the positioning system can be based on ultra-wideband positioning of a mobile unit worn close to the hand, and the spatial determination of the position of an operator's hand, in particular a gesture movement, can be performed by evaluating the position data of the mobile unit obtained with the positioning system (using the positioning system).

[0017] In some further developments of the process, the alignment of the selection position with the positions and contours of the workpieces can include the following steps: Capturing the position of the arrangement of workpieces in the support plane with a camera, generating transformed data of the positions and contours of the workpieces by transforming the positions and contours of the workpieces into the support plane based on the captured position of the arrangement of workpieces and comparing the selection position with the transformed data of the positions and contours of the workpieces.

[0018] According to the invention, a plurality of selection positions are derived for a plurality of successively recorded first actions, for which a plurality of selected workpiece data records are selected. The plurality of selected workpiece data records are uniformly linked to the information to be recorded by recording the second action.

[0019] In some embodiments, the information to be recorded may include a classification as a scrap part and the method may further include the step of including the selected workpiece data record in a scrap list.

[0020] In some further developments, the method may further comprise, as a method step, displaying workpiece-specific information relating to the workpiece data set selected by the first action on a display unit. The workpiece-specific information may optionally include customer data, information relating to the subsequent process step, a number of additional identical parts, an assigned workpiece collection point, or an order number for the workpiece belonging to the selected workpiece data set. Furthermore, the method may optionally include expanding the displayed workpiece-specific information with the information to be posted that is linked to the selected workpiece data set.

[0021] In some embodiments, the method may further include, as a step, outputting feedback to the operator after the link has been established. The feedback may optionally be provided via vibration, visual, or acoustic feedback.

[0022] In some developments of the flatbed machine tool, it further comprises a hand-held acceleration sensor and / or a stylus to facilitate location. The stylus can optionally be designed as a pressure-sensitive stylus with a pressure sensor that, when the stylus is pressed against a workpiece, triggers a trigger signal to limit the hand positions detected by the location system for detecting a gesture movement to a time window around the detection of the trigger signal. Alternatively or additionally, the stylus can optionally have an active transmitter and / or a passive transmitter, the position of which can be detected by the location system as the position of the operator's hand.

[0023] In general, the positioning system may comprise at least one antenna for receiving signals from a selection support unit worn near the hand. Alternatively or additionally, the positioning system may comprise one or more cameras for capturing images of the position of the operator's hand and / or a selection support unit.

[0024] In general, the concepts disclosed herein can enable increased process reliability, optimized throughput times, and thus optimized production costs. In particular, the concepts disclosed herein can result in significant time savings in the allocation of reject parts.

[0025] Concepts are disclosed herein that allow aspects of the prior art to be improved, at least in part. In particular, further features and their usefulness will become apparent from the following description of embodiments with reference to the figures. The figures show: Fig. 1 a schematic spatial representation of a section of an intelligent factory with a laser cutting or punching flatbed machine tool, Fig. 2 a schematic representation for illustrating by way of example a selection of reject workpieces at an absorption table of a flatbed machine tool, Fig. 3 a schematic representation of an exemplary nesting of workpieces, as can be the basis of a machining plan for a flatbed machine tool, Fig. 4 a schematic representation of a camera image of a top view of a pallet during a tipping movement onto a workpiece of an arrangement of workpieces, as in accordance with the Fig. 3 shown machining plan and are ready for separation, and Fig. 5 a flow chart to illustrate an exemplary process sequence for linking information with a workpiece data set.

[0026] The aspects described herein are partly based on the finding that specific actions such as gesture control during an absorption process for cut material produced with laser cutting (or punching) flatbed machine tools according to a processing plan can simplify the sorting process. In particular, it is proposed to use an initial action of the operator to evaluate a continuous location process of an operator's hand for the selection of a workpiece. The selection is required so that specific information can be digitally linked to one or more selected workpieces, for example by storing the information with a corresponding workpiece data record. For example, a workpiece can be linked to workpiece-specific process information such as miscuts or scrap.Furthermore, a workpiece can be linked to information created by an operator, for example, quality information obtained through manual measurement or visual inspection of the workpieces. This manually recorded information can be entered using gesture-controlled input.

[0027] To locate the operator's hand, which is necessary for this purpose, it is proposed to equip a flatbed machine tool, in particular a sorting table, with a positioning system. The positioning system can be, for example, an ultra-wideband (UWB) positioning system or an image-based positioning system. Furthermore, acceleration sensors, for example, in a wristband or smartwatch, can be used to record the operator's movements and actions.

[0028] A UWB positioning system, for example, comprises several stationary units ("anchors") and at least one mobile unit on the operator's hand (e.g., a "tag" or position sensor). It obtains position data from the mobile unit by exchanging UWB signals. A tag can be worn close to the operator's hand, for example, with a data glove or other medium such as a ring, a bracelet, a watch (smartwatch), or a thimble (also commonly referred to as wearables). Acceleration sensors can be integrated, for example, into the tags, and are suitable for interaction via movement detection. An exemplary UWB positioning system is described in PCT application PCT / FR2019 / 000057 by BeSpoon SAS, entitled "ULTRA-WIDEBAND LOCATION SYSTEMS AND METHODS," filed on April 19, 2019.

[0029] An image-based positioning system can comprise one or more permanently installed cameras for acquiring image data of the sorting table with the workpieces resting on it. Image recognition / image processing can also be enhanced by a visually striking wearable or by a hand-held element such as a stylus (referred to herein as a selection support unit). Image data can be additionally or alternatively acquired using data glasses worn by the operator. For example, data glasses, with their integrated camera, can essentially enable hand tracking via image processing. In addition to the actual image of the surroundings, information relating to a selected workpiece, for example, can be displayed in the field of view of the data glasses.

[0030] By evaluating camera images and / or the position data of the mobile unit, the position and, in particular, the movement of the operator's hand can be recorded.

[0031] The correct selection of the workpiece is crucial for the correct assignment of information to a workpiece data set. According to the invention, this is made possible by a specific action performed by the operator.

[0032] In other words, the concepts described herein allow an underlying production control system to be controlled via specific actions. For example, a gesture can be performed as a "first action" by an operator during sorting. For this purpose, a gripping action of a workpiece to be selected can be accompanied by a specific gesture movement, such as repeatedly lowering the hand (tapping) or pointing a finger as a "first action." Alternatively or in addition to a gesture-based first action, the use of a foot switch or a switch sensor on the finger, hand, or arm, as well as voice control, is possible.

[0033] If such a first action is detected, this determines the point in time (hereafter also referred to as the selection point in time) for which the tracking system should derive and output the position of the hand (hereafter also referred to as the selection position at the selection point in time). Based on the selection position and the knowledge of the positions of the workpieces, the workpiece to be selected is then determined; for example, the workpiece picked up with the gripping action is selected by the preceding tap.

[0034] The concepts described herein also utilize a mapping of defined gestures to specific information. Thus, when the operator performs one of the defined gestures in a second action, it can be captured, and the information associated with the gesture can be linked to the workpiece data of the selected workpiece.

[0035] The procedure according to the invention is explained below by way of example with reference to the figures.

[0036] Fig. 1 shows an overview of an intelligent factory 1 ("smart factory"), which includes production resources, such as an exemplary laser cutting or punching flatbed machine tool 3, and a manufacturing execution system (MES) 5. In general, a flatbed machine tool can be a laser cutting or punching flatbed machine tool that separates only by laser or only by punching. Furthermore, a flatbed machine tool can be a combination machine that implements both separation processes. Further processing steps such as deburring, bending, folding, welding, drilling, thread cutting, etc. can also be performed on the flatbed machine tool. For such laser cutting or punching flatbed machine tools, a processing plan (e.g., cutting plan) is stored in the machine control system. The positions and contours of the workpieces to be produced can be recorded in a machine-readable manner in the processing plan.

[0037] The virtual and physical production elements and production steps, in particular the information about workpieces 9 (required number, shape, material, type, etc.), converge in the MES 5 via a network 7. A control unit 8, such as a PC, computing node, or similar suitable hardware, serves to control, for example, the flatbed machine tool 3. The control unit can be implemented as part of the MES 5 or locally as a separate unit on the flatbed machine tool 3. The control unit 8 is particularly configured to support the sorting of workpieces 9 and the sorting out of missing parts by an operator 11, for example, at workpiece collection points 13, during real-time operation of the intelligent factory 1.For this purpose, the underlying computing system comprises, for example, digital processor systems with microprocessor circuits having data inputs and control outputs, as well as databases 8A, which operate according to computer-readable instructions stored on a computer-readable medium. The control unit (the MES 5) provides high computing power for real-time support. It also comprises a long-term (non-volatile) memory for storing the program instructions, as well as a very fast short-term (volatile) memory for storing acquired data and the link between the selected workpiece data set and the information generated according to the method.

[0038] The workpieces 9 are output from the flatbed machine tool 3 lying on a pallet 15 as a sheet 17. The pallet 15 forms a sorting table 21 for part separation. The operator 11 removes the workpieces from the scrap skeleton and sorts them to the workpiece collection units 13 for further processing or classifies them as scrap. Using the methods proposed herein, relevant information during the sorting process can be linked to a workpiece data record for a workpiece.

[0039] During the sorting of the workpieces 9, stored information and, in particular, newly linked information can be displayed to the operator on a workpiece-specific display 19.

[0040] In Fig. 1 Also shown are a carriage 23 and a bridge 25 movable above the sorting table 21, which has a plurality of workpiece collection point units 13. After the required number of sorted workpieces have been deposited in a workpiece collection point unit 13', this is transported, for example, by an operator 11' (or automatically by a robot system) to a subsequent processing step. Reject parts can also be collected or they remain in the scrap skeleton. It is crucial for digitalized order support that the MES 5 is informed accordingly. In other words, it is desirable that corresponding information for correctly and incorrectly produced workpieces be linked to the workpiece data records and stored in the MES 5.

[0041] In order to be able to detect the required position of the removing hand, a positioning system 31 is provided in the area of ​​the workstation, which allows the location of the operator's hand, optionally also of a selection support unit 33. The selection support unit 33 is located near the hand / arm of the operator 11. Fig. 1 For example, it is worn as a glove by operator 11. The selection support unit 33 is, for example, a mobile unit 33B in the form of a radio frequency identification (RFID) transmitter, whose actual position can be detected in real time. Direction-finding transponder systems, for example, operate in the 2.45 GHz range with a spatial resolution of a few centimeters. In general, the selection support unit 33 can carry an active transmitter and / or a passive transmitter of a positioning system.

[0042] As in Fig. 1 As shown by way of example, the positioning system 31 has four antennas 35, which are provided close to the sorting table 21. Radio waves detected via the antennas 35 are transmitted as data to a position calculation section 37 of the positioning system 31, which, for example, determines the position of the selection support unit 33 from the different signal propagation times and optionally derives a movement trajectory. The position can also be defined as the position of the hand, for which a position in a support plane 41 of the pallet 15 can be derived (for example, by projecting the position of the hand onto the support plane 41).

[0043] Using the data for workpiece production stored in the machining plan, the position of the parts awaiting removal can also be determined in the coordinate system of the storage plane 41. As already mentioned, the position of the selection support unit 33 can be used to determine which workpiece 9 the hand is located over.

[0044] The selection support unit 33 can further comprise one or more sensors (e.g., an acceleration sensor 33A) configured to detect gestures. The recognition of specific gestures can be further supported, alternatively or additionally, by an environmental camera 45 mounted above the sorting table 21 and / or the positioning system 31. To transmit sensor data, the selection support unit can be wirelessly connected to the MES 5. The detected gestures can trigger specific processes in the MES 3.

[0045] Fig. 2 shows an example of a joint selection of several workpieces 61 as rejects. As in Fig. 1 The flatbed machine tool has 3 workpieces 9 lying on a pallet 15 in a storage level 41. Fig. 2 illustrates schematically how the machine control / MES 5 controls the flatbed machine tool 3 in order to carry out a machining process according to a machining plan 65 and to produce workpieces 9.

[0046] The machining plan 65 is stored in the machine control system in machine-readable format. For example, the machining plan 65 provides geometric contours and positions (reference points) of the workpieces in workpiece position data sets 67. The workpiece position data sets 67 together define an arrangement of workpieces (nesting arrangement) in a plane, i.e., the relative position of the workpieces to one another. The nesting arrangement and the workpiece position data of the workpieces to be produced can be transferred both for production in sheet coordinates of a "planned material sheet to be processed" (generally a plate-shaped material) and for sorting after production in coordinates of the support plane 41 of the pallet 15.

[0047] Fig. 3 shows a schematic machining plan 65' for generating an arrangement of workpieces. Three types of workpieces a, b, c, as well as reference points P1, P2 (e.g., centroids or penetration points) are indicated as examples. The reference points P1, P2 can represent workpiece position data as coordinates of a reference point of a workpiece in a reference plane. Furthermore, workpiece position data can include a shape of a workpiece (e.g., the outer contour defined by the cutting path).

[0048] Referring again to Fig. 2 The machining plan 65 further includes workpiece information on the workpieces 9 to be manufactured. The workpiece information can include order-specific information (order characteristics) on the individual workpieces, such as a job number, a required number of the various types of workpieces, and possibly further subsequent machining steps for the workpieces. In addition, the workpiece information in the machining plan can include workpiece image data 69 of the workpieces to be manufactured (e.g., digital views or technical drawings) as well as a digital view of the nesting arrangement generated from the workpiece image data.

[0049] For production, the machining plan is transformed into machine coordinates of the flatbed machine tool 3. The machine tool control system 5 can, for example, control the movement of a laser cutting head across the material sheet along the contours of the planned workpieces at the planned positions within the workpiece arrangement, as well as adjust the laser cutting parameters. To execute a machining process, the machine tool control system 5 outputs a control signal Sw to the machining unit 3.

[0050] In Fig. 2 After processing, the cut workpieces 9 are present on the pallet 15 in the overall shape of the original material sheet as "cuttings" and are arranged in a plate-like manner relative to one another on the support plane 41. The workpieces 9 are surrounded by a so-called residual skeleton, i.e., the material of the sheet that could not be used for workpieces 9. The workpieces 9 can still be detachably connected to the residual skeleton via so-called microjoints.

[0051] Returning to the selection of reject parts, the operator 11 identifies several workpieces as rejects one after the other using a gesture in the form of a tapping movement with an input pen 63. This means that the operator taps on each workpiece 61 identified as a reject part. In the example of the Fig. 2 The positioning system 31 detects the position of the selection support unit (here, the tip of the input pen 63) as the position of the hand (through image processing or a mobile unit 33A of a UWB positioning system). Each tapping movement defines a selection time for an "assigned" workpiece. In order to be able to determine the position of the selection support unit and thus of the hand above, for example, the cut sheet metal on the pallet, the positioning system 31, here the images from the camera 45, is calibrated to the coordinate system of the sorting table. At the various selection times, selection positions in the support plane 41 are derived, and the corresponding workpieces are detected together. For example, position data of the tip of the input pen 63 in or near the support plane 41 can be derived as the selection position.

[0052] The tapping movement can be detected, for example, with a camera system for capturing two-dimensional or three-dimensional images of a sorting table with the workpieces 9. For multi-dimensional images, several cameras can be used, or images from several cameras can be combined to form a two-dimensional image. Fig. 2 For example, the camera 45 is mounted centrally with respect to the pallet 15 on the machine tool 3 and is aligned to capture the pallet 15 / sorting table. The tapping motion can be output as position data from lined-up positions of the input pen 63 (or a finger, generally the hand), which are accordingly evaluated as a gesture. The lined-up positions can also be used to determine the selection position in the support plane 41. The selection position can be derived, for example, as being in line with the lined-up positions.

[0053] For the concepts disclosed herein, for example, a camera system for image capture can be used, as described in the above-mentioned WO 2018 / 073419 A1 for assisting in the sorting of workpieces or in the applicant's not yet published German patent application DE 10 2018 133 524.5 with filing date December 21, 2018, with regard to the processing of residual skeletons.

[0054] Fig. 4 shows a picture 71 of the pallet 15, on which lies a material sheet 73, which is produced according to the Fig. 3 shown machining plan 65'. In addition to the indicated workpieces, a hand 75 of the operator 11 can be seen touching or tapping a workpiece 61 with an input pen 63. Furthermore, an image coordinate system (XK, YK) and a reference point P3 of the hand 75 (here the tip of the input pen 63 as an example of hand position data) are drawn in the image 71.

[0055] For example, hand position data may include coordinates of a reference point of the detected hand and / or an extent of the detected hand / detected stylus in a plane parallel to the material sheet. Fig. 4 The tip of the input pen 63 is calculated from the image data as the reference point P3. Alternatively, the reference point can be the position of a mark on a glove worn on the hand (see Fig. 1 ), on a wristband or other wearable device.

[0056] As in Fig. 2 Indicated by a (camera) signal connection SK, the camera 45 sends image data from image 71 to the machine control / MES 5, where an image processing algorithm is executed to track the position of the hand and optionally capture gestures. Using a (spatially calibrated) image from the camera 45 of the output material sheet (the cut material in the scrap skeleton), the workpiece position data 67 of the workpieces 9 produced according to the processing plan 65 can be transformed into a coordinate system of the positioning system 31.

[0057] Following the selection of the workpieces, the information to be recorded, which is assigned to the gesture movement in a database, is then selected using a gesture. For example, a gesture representing a scrap part can be performed for the recorded workpieces, so that the workpiece records of the selected workpieces are linked to the "scrap" information. For example, the information to be recorded can represent a classification as a scrap part, and optionally, the selected workpiece record can be included in a scrap list.

[0058] In Fig. 2 It is further clarified that order information for a selected workpiece can be displayed on the display 19 (monitor connection SM). Furthermore, the shape of the workpiece can be displayed to support a visual inspection by the operator 11.

[0059] In summary, Fig. 5 A flowchart illustrating an exemplary method sequence for linking information to a workpiece data record of a workpiece. It is assumed that workpieces produced with a flatbed machine tool, in particular a laser cutting or punching flatbed machine tool, based on a machining plan are arranged on a sorting table (step 101).

[0060] In the next step, a selection time is recorded through a first action of an operator (step 103). The first action is spatially related to the workpiece to be selected. For example, the operator selects a workpiece with a first (specific) gesture (selection gesture movement). This first gesture is, for example, a quick tap on the workpiece. The tap movement can be recorded with a camera or a tracking system. Alternatively or additionally, the operator can wear an acceleration sensor on their wrist that is wirelessly linked to one or more receivers. As part of the MES, the receiver can evaluate the data and determine the position as well as recognize the selection gesture movement. Another alternative for recognizing the selection gesture movement is the activation of a pressure-sensitive pen as the first action.This can be precisely located and tapping directly on a workpiece cannot lead to confusion, even when parts are close together, because the position determination is triggered by the pressure sensor.

[0061] The pressure-sensitive stylus can have a pressure-sensitive pressure sensor, particularly in a tip of the stylus, and can also be configured to output a trigger signal upon activation of the pressure sensor. Thus, pressing the stylus against the workpiece to be selected (as an example of a first action) can lead to the activation of the pressure sensor and thus to the output of a trigger signal by the stylus. If the trigger signal is detected, the selection time can be defined as the time of detection of the trigger signal.

[0062] At the selection time, the position of the operator's hand in the space above the arrangement of workpieces is determined using a positioning system (step 105). In general, the hand positions detected by the positioning system can be limited to the selection time or to a time window around the selection time. For example, the position of the wrist wearing the wristband with the acceleration sensor can be determined either via indoor localization or via the camera system alone, or via a combination of both.

[0063] From the determined position of the hand, a selection position in the support plane can be determined (step 107). A workpiece data record can be selected from the workpiece data records by comparing the selection position with the positions and contours of the workpieces (step 109) and marked as a workpiece data record selected by the first action. If the system registers, for example, the first gesture / triggering of the pressure-sensitive pen, the gesture can be linked to the workpiece using the position of the hand in the image at that time and / or by localizing the hand inside the system at that time. For this purpose, the current sheet metal position and thus the position of the parts on the pallet / sorting table can be determined using the camera system.An (image processing / evaluation) algorithm can now interpret the image data and the position data of the operator's wrist as well as the data on the tool position and the recognized action (first gesture) for a correct selection of the workpiece.

[0064] Step 109 may include capturing the position of the arrangement of workpieces in the support plane with a camera (step 109A). Furthermore, step 109 may include generating transformed data of the positions and contours of the workpieces by transforming the positions and contours of the workpieces into the support plane based on the captured position of the arrangement of workpieces (step 109B) and comparing the selection position with the transformed data of the positions and contours of the workpieces (step 109C).

[0065] After the workpiece has been selected, another gesture is performed as a second action (step 111). The gesture was assigned, for example, the instruction to book the workpiece as scrap (step 112) and, in particular, to place it on a scrap list. The basis for at least the second action is thus gesture recognition, which can be performed, for example, using acceleration sensors on a wristband. The algorithm can now correctly interpret the selected workpiece data records and the recognized second gesture, or the information associated with it, for the user input, so that the information to be booked can be read from an MES database (step 113).

[0066] The information to be posted can now be linked to the selected workpiece data record (step 115).

[0067] Further user interaction is obsolete for linking the information to be recorded with the selected workpiece data record (user input). The user input made can be displayed on a monitor, e.g., attached to the rear wall of the machine (step 117A). This can be displayed, in particular, together with workpiece-specific information relating to the workpiece data record selected by the first action. The workpiece-specific information can optionally include customer data, information on the subsequent process step, a number of additional identical parts, an assigned workpiece collection point, or a job number for the workpiece belonging to the selected workpiece data record.

[0068] Furthermore, feedback such as vibration feedback, visual feedback, or acoustic (sound / voice) feedback may be provided (step 117B). The operator can thus monitor and / or verify the execution of the input into the system.

[0069] For identified reject parts, a supplementary production signal can be issued to the MES (step 119). There, for example, production parameters of the removed workpiece are compared with a subsequent machining plan. If the production parameters match the subsequent machining plan and a new production of the removed workpiece is available, the subsequent machining plan can be supplemented with a production step for creating a replacement workpiece for the reject part. The creation of a replacement workpiece can also be scheduled in subsequent machining plans.

[0070] Referring to the Figuren 1 and2 In the steps explained above by way of example, communication can be based on a data connection between the positioning system (e.g., for position transmission) and the selection support unit (e.g., for sensor signal transmission) with the control unit of the flatbed machine tool 3 and / or the MES 5. Data exchange can generally take place via data cable with standard data connections, e.g., CAN, Profibus, RS232, RS485, USB, LAN, etc. However, it can also take place via infrared or radio (WLAN, WiFi, etc.).

[0071] In other words, one goal of the concepts presented here is to link user input in the form of gestures to a selected component (workpiece), whereby the selection of a component is supported by a preceding gesture. The operator can make component-related entries or execute commands without further input. This eliminates the need for the operator to manually assign information to a component. For example, a posting as scrap does not have to be manually assigned to a specific component, and input at an input console is no longer necessary.

[0072] It is explicitly emphasized that all features disclosed in the description and / or the claims are to be considered separate and independent of each other for the purpose of the original disclosure as well as for the purpose of limiting the claimed invention, regardless of the feature combinations in the embodiments and / or the claims. It is explicitly stated that all range specifications or specifications of groups of units disclose every possible intermediate value or subgroup of units for the purpose of the original disclosure as well as for the purpose of limiting the claimed invention, in particular also as a limit of a range specification.

Claims

1. A method for linking information with a workpiece data record of a workpiece (9) of an arrangement of workpieces (9) lying in a support plane (41) of a sorting table (21), wherein the workpieces (9) were produced from a planar material using a flatbed machine tool (3), in particular a laser cutting or punching flatbed machine tool, according to a processing plan (65) stored in a control unit (8) of the flatbed machine tool (3), and the processing plan (65) comprises workpiece data records in which relative positions and contours of the workpieces (9) in the arrangement of workpieces (9) are stored, the method having the following steps: registering (step 103) a selection time by way of a first action of a user (11), the action being in a spatial relationship to a workpiece (61) to be selected, determining (step 105), using a locating system (31), a position of a hand (75) of the user (11) in the space above the arrangement of workpieces at the selection time, deriving (step 107) a selection position in the support plane (41) from the determined position of the hand (75), selecting (step 109) a workpiece data record from the workpiece data records by comparing the selection position with the positions and contours of the workpieces (9) as a workpiece data record selected by the first action, registering (step 111) a second action in which the user (11) makes a gesturing motion, wherein an information item to be logged in a database (8A) is assigned to the gesturing motion, reading out (step 113) the information item to be logged from the database (8A), and linking (step 115) the information item to be logged with the selected workpiece data record, characterized in that a plurality of selection positions is derived for a plurality of successively registered first actions, a plurality of selected workpiece data records being selected for the selection positions, and the plurality of selected workpiece data records being linked uniformly with the information item to be logged by registering the second action.

2. The method according to claim 1, wherein the first action is a selection gesturing motion that the user (11) makes with the hand (75) above the arrangement of workpieces (9), the selection gesturing motion being registered using an acceleration sensor (33A) worn on the hand (75) or using the locating system (31).

3. The method according to claim 2, wherein the selection gesturing motion is a tapping motion on the workpiece (61) to be selected and the tapping motion is registered using the locating system (31) and is output as position data from a row of positions of the hand (75), wherein a position in the support plane (41) lying in the extension of the row of positions is derived as the selection position.

4. The method according to one of the preceding claims, wherein the user wears a selection assistance unit (33), in particular a glove, an arm band or a stylus, for the determination of the position of the hand (75) of the user (11), and wherein the selection assistance unit (33) is designed as part of the locating system (31) and / or has one or more of the following: an acceleration sensor (33A), an active transmitter and / or a passive transmitter of a locating system (31).

5. The method according to one of the preceding claims, wherein the locating system (31) for the determination of the position of the hand (75) of the user (11) registers a position of a stylus (63) held in the hand, and wherein the first action comprises the stylus (63) being tapped onto the workpiece (61) to be selected, and position data of a tip of the stylus (63) in the support plane (41) are derived as the selection position.

6. The method according to claim 5, wherein the stylus (63) comprises a pressure-sensitive pressure sensor, in particular in a tip of the stylus (63), and is further designed to output a trigger signal when the pressure sensor is activated, and wherein the first action comprises pressing the stylus (63) onto the workpiece (61) to be selected in order to activate the pressure sensor and to output a trigger signal by the stylus (63), the method comprising the steps of: registering the trigger signal and determining the selection time as the time of registration of the trigger signal and restricting the positions of the hand (75) registered by the locating system (31) to the selection time or to a time window around the selection time.

7. The method according to one of the preceding claims, wherein the locating system (31) is designed to evaluate image data (71) from one or more cameras (45) for the image-assisted determination of the position of the hand of the user (11), or wherein the locating system (31) is based on an ultra-wideband locating of a worn mobile unit (33B), and the determination of a position of a hand (75) of the user (11), in particular a gesturing motion, in space is carried out by evaluating the position data of the mobile unit (33B) obtained by the locating system (31).

8. The method according to one of the previous claims, wherein the comparing of the selection position with the positions and contours of the workpieces (9) comprises: registering (step 109A) the position of the arrangement of workpieces (9) in the support plane (41) using a camera (45), generating (step 109B) transformed data of the positions and the contours of the workpieces (9) by transforming the positions and the contours of the workpieces (9) into the support plane (45) on the basis of the registered position of the arrangement of workpieces (9), and comparing (step 109C) the selection position with the transformed data of the positions and the contours of the workpieces (9).

9. The method according to one of the preceding claims, wherein the information item to be logged is a classification as a rejected part, comprising the step of: including the selected workpiece data record in a reject list.

10. The method according to one of the preceding claims, comprising the step of: displaying (step 117A), on a display unit (19), workpiece-specific information concerning the workpiece data record selected by the first action, wherein the workpiece-specific information comprises customer data, information concerning the subsequent process step, a number of further parts that are the same, an assigned workpiece collection location or an order number for the workpiece (61) belonging to the selected workpiece data record.

11. The method according to claim 10, comprising the step: supplementing the displayed workpiece-specific information with the information item to be logged that is linked with the selected workpiece data record (61).

12. The method according to one of the preceding claims, comprising the step of: outputting (step 1178) feedback to the user (11) after linking, wherein the feedback is accomplished using vibration feedback, visual feedback or acoustic feedback.

13. A flatbed machine tool (3), in particular a laser cutting or punching flatbed machine tool (3), comprising a processing unit, in particular a laser cutting or punching processing unit, a control unit (8) in which a processing plan (65) is stored, the control unit driving the processing unit to produce workpieces (9) spatially arranged next to one another, a sorting table (21) for providing the produced workpieces (9), which are arranged next to one another in a support plane (45), for sorting out by a user (11), and a locating system (31) for determining a position of a hand (75) of the user (11) in space, wherein the control unit (8) is designed to carry out a method according to one of the preceding claims.

14. The flatbed machine tool (3) according to claim 13, having an acceleration sensor (33B) worn on the hand (75) and / or a stylus (63) for simplifying locating, wherein the stylus (63) is designed as a pressure-sensitive stylus having a pressure sensor, the stylus (63), when it is pressed on a workpiece (61), issuing a trigger signal for restricting the positions of the hand (75) for registering a gesturing motion, registered using the locating system (31), to a time window around the registration of the trigger signal, and / or wherein the stylus (63) has an active transmitter and / or passive transmitter, the position of which is able to be registered by the locating system (31) as the position of the hand of the user (11).

15. The flatbed machine tool (3) according to claim 13 or 14, wherein the locating system (31) has at least one antenna (35) for receiving signals from a selection assistance unit (33) worn near the hand (75), and / or wherein the locating system (31) has one or more cameras (45) for capturing images of the position of the hand (75) of the user (11) and / or of a selection assistance unit (33).