Video inspection system of a fabric cutting operation
Patent Information
- Application Number
- PCT/EP2024/050633
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-01-11
- Filing Date
- 2024-01-11
- Publication Date
- 2024-11-14
AI Technical Summary
The existing template-based evaluation method for textile cutting in the automotive industry is prone to significant errors due to the human factor, leading to faulty parts being introduced into production, and is a slow process, which can result in defective products endangering safety and increasing costs.
An automated video inspection system that integrates multiple subsystems, including video inspection, defect marking, and pick-up mechanisms, using cameras, graphic accelerators, and PLC control to quickly and accurately validate cut pieces against CAD file tolerances, and sort them for quality control and traceability.
Substantially reduces defects, improves quality, and enhances traceability, allowing for faster analysis and optimization of the production process, with automatic measurement accuracy superior to human operators and reduced production costs.
Smart Images

Figure EP2024050633_14112024_PF_FP_ABST
Abstract
Description
[0001] Video inspection system of the fabric cutting operation
[0002] The invention relates to a system for video inspection of the textile cutting operation, video inspection of the textile material before cutting and selective collection of the finished products.
[0003] From W02004030876A1 is known a cutting plant designed to stack pieces of textile material, taking into account the particular distortions of the individual pieces of textile material, so that the positions of the predefined marking points on the pieces of material are aligned one above the other. This operation is carried out by recording the particular distortions of the pieces of fabric and stacking said pieces. The pieces of fabric which have been stacked one on top of the other in the correct position shall be cut in groups, the average distortion present in the stack being determined with one or more cameras or other devices for inspecting the strip of fabric as it is pulled from the bale. The camera(s) form a sensing device for marking the points provided on the web of material, the corresponding camera images or measurement data being subsequently supplied to a control device which controls the cutting system.
[0004] It is well known that in the automotive industry the quality and performance requirements are much more stringent as they are directly involved in the safety systems in vehicles, which can prevent serious accidents and even death.
[0005] The invention describes an application for textile parts that measures identifies each part in real time and selects good parts for scrap. In the industrial production process of textile parts for road vehicles, one of the steps is the use of laser / knife equipment for automatic cutting of components from certain types of textile materials. The shapes of these components are saved in specific CAD files, which also specify a set of strict tolerances that the component must meet in order to be used. Of all the performance criteria needed to ensure product quality, two are critical: validation of the correct cutting of parts to file tolerances and traceability of these parts in the production process, i.e. storing the information needed to quickly and accurately identify problems when they occur.
[0006] Although quality is an important indicator for these products and the cost needs to be kept as competitive as possible, which is why we have also developed an automatic textile unloading system.
[0007] The implemented system is currently being used on a production line, with results as expected. The proposed system also automates the collection process of textile pieces cut with laser / cutting machines, so that their quality check is done automatically and with the highest accuracy, and finally the correct and incorrect parts are collected separately.
[0008] Auxiliary systems are also used in the video inspection system of the textile cutting operation and the selective collection of finished products, in the sense that they are not the purpose of the present invention, but are necessary and mandatory for the operation of the system, such as the traceability system and the database.
[0009] The main problem with the template-based evaluation method is on the one hand that it has significant errors, which result in faulty parts being introduced into subsequent production processes, and on the other hand that it is an extremely slow process, which depends on the number of measurement dimensions defined in the CAD file. If the part is validated in error, there are three scenarios:
[0010] - in the most favorable case, it is detected during subsequent processes in the company and taken out of production;
[0011] - the product is detected as faulty and returned by the customer;
[0012] - in the worst case, the defective product is installed in a vehicle and endangers the safety of passengers.
[0013] The invention proposed for patent aims at automating the video inspection of the textile cutting operation and the selective collection of the products resulting from the cutting process, which is carried out to eliminate the source of errors due to the human factor and to improve the traceability information, by means of a fast and efficient analysis of the process information, in order to determine and eliminate the sources of errors as well as to produce relevant statistics for further optimization.
[0014] The technical problem that the present invention solves is to eliminate the source of errors due to the human factor and to improve traceability information in order to quickly and efficiently analyze process information to determine and eliminate sources of errors and to produce relevant statistics for further optimization.
[0015] The system according to the invention consists of a first subsystem for video inspection of the textile material which transmits information to a defect marking assembly which is arranged at the top of the conveyor. Downstream of the cutting machine is provided a second subsystem for video inspection of the cutting operation of the textile material into cut pieces and a defect marking assembly. After the second video inspection and defect marking, cut pieces are transported to a cut piece pick-up and gripping assembly. The cut textile pieces are picked up by a pulling assembly and then transported to collection bins or a waste material collection assembly. The cut piece pick-up and gripping assembly has a modular configuration and consists of pistons and suction cups, distributed over the width of the conveyor, so that the cut pieces are picked up and released into collection bins. These are part of a storage sub-system for crates for cut pieces under which a storage sub-system for waiting crates is arranged. The positioning of the cut-piece collection crates on each level is done by a crate handling device and the level change by a crate transfer device between levels / crate lift. A crate positioning and locking device on the lift checks and corrects the position of each crate before it is picked up by a crate handling device.
[0016] The system according to the invention further comprises image pick-up equipment consisting of one or more cameras, processing equipment with graphic accelerator, an encoder, user authentication equipment and equipment for reading traceability data.
[0017] The advantages of this system are:
[0018] - is functional and is used in production;
[0019] - can be used for the detection of material defects and for the detection of cutting defects;
[0020] - the possibility of being applied globally to other types of products;
[0021] - reducing production costs;
[0022] - substantial reduction in the number of defects and therefore improvement in quality;
[0023] - automatic measurement with accuracy far superior to a human operator; the measuring process does not impact the cutting process in terms of time required to perform the inspection, the inspection of the material is performed during the movement of the belt, thus only the alignment and measuring steps need to fit into the time budget in order not to slow down the conveyor movement
[0024] The following is an embodiment of the invention in connection with Figures 1 to 14 representing :
[0025] Fig 1 System overview
[0026] Fig 2 Integrated information flow using ancillary subsystems
[0027] Fig 3 Textile cutting equipment Fig 4 Template for checking the dimensions of a part
[0028] Fig 5 Block diagram of the recognition and measurement engine
[0029] Fig 6 Graphical representation of identified defects
[0030] Fig 7 3D system representation
[0031] Fig 8 Cut piece clamping subsystem
[0032] Fig 9 Detail of subsystem in Fig 8
[0033] Fig 10 Cut piece pulling subsystem
[0034] Fig 11 Cuttings collection box
[0035] Fig 12 Storage subsystem for textile pieces from cutting and storage subsystem for crates level crates on stand-by
[0036] Fig 13 Crate handling device and crate positioning and locking device on lift
[0037] Fig 14 Hardware-Software interaction scheme
[0038] The system for video inspection of the textile cutting operation, video inspection and selective collection of finished products according to the present invention is mounted on an automatic laser / knife cutting coordinate cutting equipment.
[0039] For the automation of the textile cutting process by laser or knife, a solution is presented that integrates several subsystems that ensure the quality of the cut pieces, but also their sorting and selective packaging.
[0040] In some situations, the fabric is loaded into the cutting machine assembly and from a stack.
[0041] The textile is usually delivered in the form of a roll 1. This is loaded into the cutting machine assembly 2. The textile material is unwound and passed through a stretching assembly 3 and transported via a conveyor 5 to a first textile material inspection subsystem 4.
[0042] The decisions of the fabric video inspection subsystem 4 are transmitted to a fabric defect marking assembly 6, which is arranged at the top of the conveyor 5.
[0043] Further, the system includes the laser cutting equipment 7 and downstream of the cutting area, a second subsystem for video inspection of the textile cutting operation 9 is installed.
[0044] In other embodiments, video inspection subsystems can also be positioned under or next to the conveyor.
[0045] In the description below, the video inspection subsystem refers to the entire hardwaresoftware assembly that aims to inspect laser or knife cut parts for the purpose of validating the cut and measurement of dimensions extracted from the CAD file, as well as saving inspection information for traceability purposes.
[0046] The system according to the invention further comprises image pick-up equipment consisting of one or more cameras, processing equipment with graphic accelerator, an encoder, user authentication equipment and equipment for reading traceability data.
[0047] In the description below, the mechanism downstream of the video inspection subsystem refers to the entire electro-mechanical assembly used to sort components according to the information from the video inspection subsystem.
[0048] In the description below, the PLC refers to the programmable logic controller that receives information from the video inspection subsystem in order to control the pick-and-place mechanism for sorting components.
[0049] The video inspection subsystem communicates with the PLC programmable logic controller via a high-speed interface. Periodically, the video inspection system reads a signal called a heartbeat signal from the PLC registers to validate the connection between the two systems.
[0050] The conveyor 5 is mechanically connected to an encoder which is further read in real time by the PLC programmable logic controller, the position of the encoder being used to calculate in real time the conveyor belt position of the conveyor 5.
[0051] The video inspection subsystems constitute the central control part of the entire system according to the invention and have the following functional components:
[0052] 1. CAD file loading and interpretation equipment. A. which, depending on the contours defined on the layers in the drawing, defines both the measurement dimensions (dimensions on the X and Y axes) between the cutting contours and the measurement tolerances. This equipment also identifies the number of columns under which the pieces will run on the conveyor belt and defines the number of suction cups of the pick-and- place mechanism to be used for each column.
[0053] 2. acquisition equipment B. which is responsible for acquiring images from multiple cameras and stitching them together to form the overall picture.
[0054] 3. C image pre-processing equipment, handles the transformations needed to increase contrast and remove noise from images.
[0055] 4. the D material detection equipment, is designed to detect the edge of the fabric on the conveyor belt. This detection has a dual purpose: a) the metal strip to the left and right of the material is cut out of the image so that only the material remains in the image, b) the information about the positioning of the material on the belt together with information extracted from the CAD describing the number of columns and the distance between them is compiled by the video inspection system to decide which of the pick-and-place system's suction cups will be used to pick up each component on the belt.
[0056] 5. Column segmentation equipment E. is used to segment each column according to their positions in the CAD file. The images on each column can then be processed in parallel.
[0057] 6. The component segmentation equipment F. is designed to identify the component in the image according to the start-cut signal provided by the PLC programmable logic controller. This signal is transmitted from the laser / cutting machine to the PLC which then transmits it to the video inspection system. This signal is transmitted at the beginning of each cutting cycle with a fixed period. Depending on the physical distance between the laser / cutting machine and the video cameras, and the displacement between the columns in the CAD, the encoder position can be calculated when a component has completely passed the camera, so the image is completely acquired.
[0058] 7. The validation and measurement equipment G. has the role of identifying the cutting contours in the segmented component, making measurements and validating the outer contour according to the information extracted from the CAD. In addition, this equipment transmits to the PLC programmable logic controller the results of the component validation (OK / NOK), which are then used by the PLC programmable logic controller to control the cut piece clamping assembly 12 that sorts the components.
[0059] 8. The H material verification equipment is designed to identify and report material defects using artificial intelligence techniques.
[0060] 9. Results Reporting and Traceability Equipment I. has the role of storing all information related to the validation, inspection and measurement of components and material, as well as integrating with industrial traceability systems to transmit this information. In addition, the subsystem provides the operator with a real-time view of the components being measured and their results.
[0061] Depending on the decisions of the textile video inspection system 4, the laser cutting machine 7 can avoid cutting defective pieces. An advantageous solution is the integration of the textile video inspection subsystem 4 with the laser cutting machine 7 to eliminate the marking process. After the textile material has been cut into pieces 8 and has passed through the video inspection subsystem 9 of the cutting operation, it is conveyed to a cutting defect marking assembly 10 of the textile material, and a modular pick-up and gripping assembly 12 of the cut pieces 8 and then to a pulling system 14 of the cut piece 8.
[0062] Depending on the decisions of the textile video inspection subsystem 4, the textile defect marking assembly 6 and the textile cutting defect marking assembly 10 mark the affected piece and / or for a more advantageous solution, mark the affected area.
[0063] Following the marking operation, the cut pieces 8 that meet the quality requirements are picked up by a cut piece pulling assembly 14 and transported to the cut piece collection box 15, and the cut pieces 8 that do not meet the quality requirements are gravitationally transferred to the waste material collection assembly 13.
[0064] In an advantageous embodiment, the technological scrap 11, i.e. the cut pieces which do not meet the quality requirements, is dropped by gravity into the waste material collection assembly 13 or taken up by a roller assembly installed above the conveyor 5.
[0065] In order to achieve the pick-up of the cut pieces 8 which have been validated by the second fabric cutting video inspection subsystem 9 and / or by the first fabric video inspection system 4, the cut piece clamping assembly 12 is provided with a modular configuration consisting of several pistons 12a and suction cups 12b distributed over the width of the conveyor 5. Each piston-suction cup pair is individually controlled, depending on the position of the cut piece 8 and the video inspection result.
[0066] The individual control of each piston-suction cup pair reduces the need for spare parts for the suction cups, as only the suction cups required to lift the workpiece are operated, which reduces air consumption and provides increased flexibility to the workpiece pick-up process 8. The role of the workpiece gripper assembly 12 is to sort workpieces 8 that meet the quality requirements from workpieces 8 that do not meet the quality requirements.
[0067] Another role is to pick up the cut pieces 8 that meet the quality requirements, and to lift them off the conveyor 5, so that the pulling assembly 14 can execute its pick-up.
[0068] In another advantageous embodiment, the cut piece clamping assembly 12 may be designed such that the lowering of the suction cups 12b is carried out integrally but the actuation thereof individually.
[0069] The cut piece pick-up and gripping assembly may have other configurations or components, not including pistons and suction cups. After picking up and sorting the cut pieces 8, the cut piece pulling assembly 14 moves from the standby position to the pick-up position and the cut piece gripping assembly 12 is actuated, which disengages the suction cups.
[0070] From the pick-up position, the cut piece pulling assembly 14 starts moving to the cut piece release position 8, then releases the cut piece 8 into the collection crate 15, part of the storage subsystem 16 of the textile pieces resulting from cutting.
[0071] After performing the cut piece release step 8, the 14 cut piece pulling assembly returns to the standby position.
[0072] The travel speeds when placing 8 cut pieces in the 15 cut piece collection box are configurable for each individual project to eliminate the sail effect.
[0073] The 14 cut piece pulling assembly is equipped with 8 cut piece presence sensors and monitors the number of pieces in each 15 cut piece collection bin, and whether the pieces have been taken from the 12 cut piece clamping assembly.
[0074] Each 15-piece cut case is equipped with 15a RFID tags to manage the flow of full or empty cases in process. To avoid crate deformation during use and / or transport and to increase their positioning accuracy, they are made of aluminium profiles and compact polycarbonate.
[0075] Labels 15a are attached to each crate 15. They are recorded in the system database in order to monitor the position of the crate within the storage subsystem 16 of the textile pieces resulting from cutting and the storage subsystem of the crates 17 level of the crates in waiting.
[0076] With RFID technology integrated on the collection crate 15, the required traceability data of the cut pieces 8 are ensured. This information can be transmitted to a centralised ERP / ERP / SAP IT subsystem for accurate material availability data.
[0077] In an advantageous embodiment, to optimize space, the storage subsystem for pieces
[0078] 16 of textile material resulting from cutting is arranged above the storage subsystem for crates
[0079] 17 at the level of waiting crates.
[0080] In another advantageous embodiment for reducing the changeover time of the cut piece collection crate 15, the crate storage subsystem 17 level crates on standby can be used for storing full crates.
[0081] The positioning of the cut piece collection crates 15 on each level is performed by the crate handling device 18 and the level change is performed by the crate transfer device between levels / crate lift 19s and 19d. The role of the crate handling device 18 is to move one cut piece collection crate 15 loaded with cut pieces 8 meeting the quality requirements from the cut piece storage subsystem 16 to the platform of the crate transfer device 19d between levels / right crate lift.
[0082] A crate positioning and locking device on lift 20 locks crate 15 for lowering. When the crate position verification procedure confirms the position of the crate, the crate is lowered by the device 19d. Once at the lower limit, the positioning device 20 releases the crate and the crate is picked up by the handling device 18 and loaded into the crate storage subsystem 17.
[0083] In another embodiment, the crate handler 18, in turn, unloads an empty cut piece collection crate 15 from the pending crate storage subsystem 17. This is pushed onto the platform of the interlevel crate transfer device / crate lift - left 19s. The platform 19s is raised to the level of the cut piece storage subsystem 16 and then the cut piece collection crate 15 is transferred to the subsystem 16 by the handling device 18.
[0084] In another mode of use, only part of the crate transfer device can be used between levels / crate lift 19s and 19d.
[0085] A great advantage from a work safety point of view is the crate positioning and locking device on the lift 20 which checks and corrects the position of each crate before it is picked up by the crate handling device 18.
[0086] A guard 21 when loading and unloading the crate is intended to protect the operator from moving parts when transferring the crate between levels.
[0087] The system has two modes of operation:
[0088] - Automatic: the configuration of the 8 cut piece pickup and suction cup activation dimensions is taken from the video system.
[0089] - Manual: the above configuration is set up manually by a technician.
[0090] The application itself is complex because it incorporates multiple subsystems that require complex control logic, both on the image acquisition side, pre-processing for contour sharpening, CAD file processing and on the side of extracting dimension definitions, recognizing the CAD associated with the part in the image and actually measuring the defined dimensions.
[0091] The general scheme of this chain is shown in Figures 2 and 14.
[0092] The system according to the invention can be used with only the first video inspection subsystem 4, with or without the defect marking assembly 6, or with both video inspection subsystems 4 and 9 and only with or without the second defect marking assembly 10. In another embodiment, the system may have only the second video inspection subsystem 9 and with or without the defect marking assembly 10.
Claims
AMENDED CLAIMS received by the International Bureau on 26 September 2024 (26.09.2024)13AMENDED SHEET (ARTICLE 19)AMENDED SHEET (ARTICLE 19)
