Printing and dyeing factory intelligent carrying system and method based on mechanical arm
By adopting an intelligent handling system based on robotic arms in the printing and dyeing industry, using vision modules and deep learning algorithms to realize the identification and classification of original fabrics, combined with the accelerated global positioning method to optimize the robotic arm path, the problems of low manual operation efficiency and risk are solved. It realizes efficient and safe handling and classification of raw materials, reducing production costs and labor costs.
Patent Information
- Application Number
- CN202411489060.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-24
- Publication Date
- 2024-12-06
AI Technical Summary
In the existing printing and dyeing industry, the preparation and classification of raw materials mainly relies on manual operations, resulting in inefficiency, frequent errors, and operating risks. The inherent program control of the robot arm cannot achieve intelligent handling.
Design an intelligent handling system based on robotic arms, including vision module, motion module, automatic posture interaction and monitoring module and safety alarm module, and dynamic identification, positioning and classification of original fabrics are realized through RGB-D cameras and deep learning algorithms. It also combines the acceleration global positioning method to optimize the working path of the robotic arm, and monitor and alert abnormal operations in real time.
It realizes intelligent handling, classification and sorting of robotic arms in printing and dyeing factories, significantly reduces production costs and labor costs, improves the safety and production efficiency of the working environment, and enhances the market competitiveness of the enterprise.
Smart Images

Figure CN119079537A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of intelligent printing and dyeing factories, and specifically relates to an intelligent handling system and method for printing and dyeing factories based on a robotic arm. Background Art
[0002] The printing and dyeing industry occupies an important position in my country's national economy. It is connected to the textile manufacturing industry and the clothing and home textile industry, and plays a connecting role in the entire textile industry chain. Its production process faces operations such as the preparation, classification and use of raw materials, which involves a large amount of material handling, workpiece transfer, and production process control. Traditional methods are mostly manual operations, which are prone to fatigue, errors, and low efficiency after long-term manual operation. At the same time, the printing and dyeing process involves dyes, chemicals, or certain operations that pose risks to the operator's health.
[0003] With the development of smart factory technology in recent years, it is particularly important to use modern intelligent technology to transform the printing and dyeing industry into an intelligent and automated one. Among them, robotic arms are widely used in smart factories. In the printing and dyeing process, robotic arms often perform various complex actions and operations, such as extracting, transporting, and mixing dyes.
[0004] The inventors have found that in the existing printing and dyeing industry, the raw material preparation stage is carried out manually, such as handling and sorting, or a fixed single operation is performed by a robotic arm. The robotic arm is mechanized by a pre-written program and cannot achieve intelligent handling. Therefore, it is an urgent problem for those skilled in the art to design an intelligent handling system with visual positioning, autonomous identification, and accurate handling and sorting of raw cloth. Summary of the invention
[0005] In order to solve the above problems, the present invention proposes a printing and dyeing factory intelligent handling system and method based on a robotic arm.
[0006] In order to achieve the above-mentioned purpose, the technical solution adopted by the present invention is as follows: A printing and dyeing factory intelligent handling system based on a robotic arm, comprising:
[0007] A visual module, which collects and analyzes key feature information of the original cloth in real time to achieve dynamic recognition and positioning operations of the original cloth;
[0008] A motion module, which controls the movement of the robot arm through the key feature information and position of the original cloth provided by the vision module, controls the robot arm to reach the specified position of the original cloth, and grabs the original cloth and moves it to the specified position;
[0009] An automatic posture interaction and monitoring module, which performs fusion processing on the data collected in static and dynamic environments, and controls and optimizes the working path of the robot arm in combination with an accelerated global positioning method;
[0010] A safety alarm module monitors the operation of the robotic arm in real time, identifies and warns of illegal operations of the robotic arm.
[0011] Further, the visual module includes a positioning unit and a recognition unit;
[0012] The positioning unit collects the real spatial position of the original cloth in real time, and converts its real spatial position into the spatial coordinate position when the robot arm is working;
[0013] The identification unit identifies and collects the type and properties of the original cloth in real time.
[0014] Furthermore, the positioning unit includes an RGB-D camera.
[0015] Furthermore, the posture automatic interaction and monitoring module includes a data acquisition unit, an information processing unit, a human-computer interaction unit, and an output control unit.
[0016] Furthermore, the security alarm module includes an alarm unit, a display unit, an external control unit, and an analysis unit.
[0017] Furthermore, the alarm unit includes a speaker and an LED light; the display unit includes a high-definition display; and the external control unit includes an external keyboard and a mouse.
[0018] An intelligent handling method for a printing and dyeing factory based on a robotic arm, comprising the following steps: Step 1, data collection and preprocessing: a visual module recognizes and collects the type and attributes of the original cloth in real time, and recognizes and analyzes the real spatial position of the original cloth in real time;
[0019] Step 2: Data fusion and analysis: The data collected in static and dynamic environments are fused and processed, and the working path of the robot is controlled and optimized by combining the accelerated global positioning method;
[0020] Step 3: Real-time control and adjustment: Based on the key feature information collected by the visual module from the original cloth in step 1 and the data fusion processing in step 2, the working path of the robot arm is controlled in real time;
[0021] Step 4. Safety monitoring and alarm: monitor the working status of the robotic arm in real time, identify abnormal conditions of the robotic arm and issue an alarm in time.
[0022] Furthermore, in step one, the visual module includes an RGB-D camera, which acquires a color image and a depth image of the original cloth, and aligns the color image and the depth image to obtain three-dimensional pixel coordinates; and the position feature information of the original cloth is realized by cooperating with the RGB-D camera through the Faster R-CNN algorithm.
[0023] Furthermore, in the step 2,
[0024] In the static environment, the position and posture of the robot arm are quickly positioned and controlled by using fuzzy Kalman fusion and particle filtering methods;
[0025] In the dynamic environment, a credibility model of the robot arm control is established through credibility parameters, and adaptive adjustment is achieved in the robot arm positioning process through target posture parameter adjustment.
[0026] Furthermore, when faced with map scenes and / or possible interference, the distribution set method is used to automatically monitor and adjust the position information of the robot arm.
[0027] Compared with the prior art, the present invention has the following beneficial effects:
[0028] (1) The system mainly includes the ideas and methods of the robot arm's recognition, positioning, and classification of the original cloth, as well as the automatic interaction and monitoring of the robot arm's posture during the working process; the recognition and positioning obtains the color information and depth information of the original cloth through the depth camera, and recognizes and classifies the original cloth through the deep learning algorithm Faster R-CNN; the robot arm receives the information processed by the camera and performs loading and unloading, cloth turning, automatic sorting and boxing operations on the original cloth; in this process, sensors such as photoelectric sensors and pressure sensors will collect the position and posture parameters of the robot arm during the working process, and perform fusion processing to realize the automatic interaction and monitoring of the robot arm's posture, which can continuously optimize the working process of the robot arm; when a robot arm fails or does not operate according to the planned route under high-intensity use or high-force, the safety alarm module will work to terminate the illegal operation of the robot arm in time to ensure the safety of personnel and property.
[0029] (2) The robotic arm intelligent handling system can significantly reduce the production and labor costs of the printing and dyeing industry. Especially in areas with high labor costs, robotic arms can replace most of the heavy and repetitive manual work, reducing dependence on human resources. This not only saves labor costs, but also reduces the errors and scrap rates that may be introduced by manual operations, thereby further saving production costs.
[0030] (3) The application of robotic arms has improved the safety of the working environment in the printing and dyeing industry. Certain operations may pose risks to the health of operators, such as carrying heavy objects for a long time or contacting hazardous substances. Robotic arms can replace manual labor to perform these potentially dangerous tasks, reducing the risk of workplace accidents and improving the safety and stability of the working environment.
[0031] (4) The flexibility of the robot arm intelligent handling system enables printing and dyeing companies to adjust production lines and production plans more quickly. They can reprogram and optimize tasks as needed to adapt to different production requirements and changing market demands. This flexibility not only improves the production efficiency of the company, but also enhances the company's responsiveness in market competition. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 It is the flow chart of the intelligent handling system of the robotic arm in this application document;
[0033] Figure 2 It is a flow chart of dynamic recognition and positioning of the original cloth based on the RGB-D camera in this application document;
[0034] Figure 3 It is a flowchart based on Faster R-CNN in this application document;
[0035] Figure 4 It is a flow chart of automatic interaction and monitoring based on posture in this application document. DETAILED DESCRIPTION
[0036] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0037] like Figure 1-Figure 4 As shown, the technical solution adopted by the present invention is as follows: This embodiment provides an intelligent handling system for a printing and dyeing factory based on a mechanical arm, including a visual module, a motion module, an automatic posture interaction and monitoring module, and a safety alarm module. The visual module collects and analyzes the key feature information of the original cloth in real time to realize the dynamic identification and positioning operation of the original cloth; the motion module controls the action of the mechanical arm through the key feature information and position of the original cloth provided by the visual module, controls the mechanical arm to reach the specified position of the original cloth, and grabs the original cloth and transports it to the specified position; the automatic posture interaction and monitoring module performs fusion processing through the data collected in the static environment and the dynamic environment, and controls and optimizes the working path of the mechanical arm in combination with the accelerated global positioning method; the safety alarm module monitors the operation of the mechanical arm in real time, identifies and alarms the mechanical arm for illegal operations. First, the position and posture of the mechanical arm are initially calibrated. After starting, the depth camera will take pictures of the surrounding environment for identification and positioning. After the information is processed, it is transmitted to the mechanical arm for grabbing, handling, stacking and sorting. In this way, the preparation of the original cloth in the printing and dyeing process is completed.
[0038] In this embodiment, the visual module includes a positioning unit and a recognition unit; the positioning unit collects the real spatial position of the original cloth in real time and converts its real spatial position into the spatial coordinate position when the robot arm is working; the recognition unit recognizes and collects the type and attributes of the original cloth in real time. The positioning unit includes an RGB-D camera.
[0039] In this embodiment, the posture automatic interaction and monitoring module includes a data acquisition unit, an information processing unit, a human-computer interaction unit, and an output control unit.
[0040] In this embodiment, the safety alarm module includes an alarm unit, a display unit, an external control unit, and an analysis unit. The alarm unit includes a speaker and an LED light; the display unit includes a high-definition display; and the external control unit includes an external keyboard and a mouse. When the robotic arm is used intensively or with high force, a malfunction may occur or the operation is not performed according to the planned route. The speaker and LED light will give an alarm prompt, and then the control unit will directly power off the robotic arm and shut it down.
[0041] This embodiment also provides a printing and dyeing factory intelligent handling method based on a robotic arm, the steps comprising:
[0042] Step 1: Data collection and preprocessing: The visual module recognizes and collects the type and properties of the original cloth in real time, and recognizes and analyzes the real spatial position of the original cloth in real time;
[0043] Step 2: Data fusion and analysis: The data collected in static and dynamic environments are fused and processed, and the working path of the robot is controlled and optimized by combining the accelerated global positioning method;
[0044] Step 3: Real-time control and adjustment: Based on the key feature information collected by the visual module from the original cloth in step 1 and the data fusion processing in step 2, the working path of the robot arm is controlled in real time;
[0045] Step 4. Safety monitoring and alarm: monitor the working status of the robotic arm in real time, identify abnormal conditions of the robotic arm and issue an alarm in time.
[0046] like Figure 2As shown, in this embodiment, in step 1, the visual module includes an RGB-D camera. First, the RGB-D camera is installed in a fixed position to cover the working area of the loom. The RGB-D camera obtains the color image and depth image of the original cloth, and aligns the color image and the depth image to obtain the three-dimensional pixel coordinates of each pixel in the camera coordinate system. Then, the aligned RGB image is recognized by the Faster R-CNN algorithm to obtain the two-dimensional pixel coordinates of the original cloth in the color image. After that, the depth information is obtained in combination with the aligned depth image to calculate the three-dimensional coordinates of the original cloth relative to the camera coordinate system. Finally, with the help of the camera intrinsic parameters and the conversion relationship between the camera coordinate system and the world coordinate system, the three-dimensional coordinates in the camera coordinate system are mapped to the world coordinate system based on the robot arm. After obtaining the three-dimensional space coordinates of the world coordinate system of the original cloth based on the optical center of the camera, the control system will dynamically correct the coordinates according to the processing time of the deep learning algorithm and the system time delay to reduce the coordinate error caused by the interference of its own system. The control system transmits the coordinates in the world coordinate system based on the coordinate origin of the robot arm to the robot arm through serial communication. The robot arm receives the coordinate information and moves to the specified position of the original cloth to complete the identification and positioning operation.
[0047] like Figure 3 As shown, this embodiment provides a flow chart of Faster R-CNN. First, the input image is processed by the feature extraction network VGG16 to obtain a feature map, which is input into the RPN, and the foreground and background classification of the image and the generation of candidate regions are completed in the RPN. Then, in the ROIPooling stage, the candidate regions generated in the RPN are collected, and their feature maps are extracted for category classification and bounding box regression in the fully connected layer. Finally, Faster R-CNN uses the fully connected layer and the Softmax function to predict the category of the candidate target region generated in the RoI, and obtains a more accurate target recognition frame through bounding box regression calculation.
[0048] like Figure 4 As shown, in step 2:
[0049] In a static environment, the fuzzy Kalman fusion and particle filter method is used to quickly position and control the position of the robot. This method combines the advantages of fuzzy logic and Kalman filtering, and can effectively handle the uncertainty and error in the positioning process to ensure the accurate positioning of the robot.
[0050] In a known dynamic environment, the credibility parameters are introduced to establish a credibility model for the robot arm control. The adaptive adjustment of the robot arm positioning process is achieved through the target posture parameter adjustment technology. This method can flexibly adjust the posture of the robot arm according to the changes in the real-time scene to ensure that the task can be completed accurately and stably in a dynamic environment; for the unknown load parameters and inertia characteristics of the robot arm system, a flexible control strategy is adopted. This method allows the system to adjust the movement of the robot arm while taking into account the changes in load and inertia to maintain the stability and accuracy of the system.
[0051] In the face of map scenes and / or possible interference, the distribution set method is used to automatically monitor and adjust the position and posture information of the robot. This strategy can effectively identify and respond to changes in the environment, ensuring the reliable operation of the robot in complex scenes. Taking into account the characteristics of static and dynamic environments, an accelerated global positioning method is designed, and the posture fusion matrix of the robot is optimized. This method improves the positioning accuracy and response speed of the robot in various complex environments through efficient global positioning technology. Finally, an adaptive posture tracking method is introduced to realize automatic posture monitoring of the robot. This method combines the dynamic positioning control model of the manipulator's human-computer interaction, and realizes intelligent monitoring and flexible response of the robot's posture by capturing the quality characteristic parameters of unknown targets, providing a reliable automation solution for complex tasks.
[0052] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. An intelligent handling system for printing and dyeing factories based on a robotic arm, characterized in that: include: A visual module, which collects and analyzes key feature information of the original cloth in real time to achieve dynamic recognition and positioning operations of the original cloth; A motion module, which controls the movement of the robot arm through the key feature information and position information of the original cloth provided by the vision module, controls the robot arm to reach the specified position of the original cloth, and grabs the original cloth and moves it to the specified position; An automatic posture interaction and monitoring module, which performs fusion processing on the data collected in static and dynamic environments, and controls and optimizes the working path of the robot arm in combination with an accelerated global positioning method; A safety alarm module monitors the operation of the robotic arm in real time, identifies and warns of illegal operations of the robotic arm.
2. The printing and dyeing factory intelligent handling system based on a robotic arm according to claim 1 is characterized by: The visual module includes a positioning unit and a recognition unit; The positioning unit collects the real spatial position of the original cloth in real time, and converts its real spatial position into the spatial coordinate position when the robot arm is working; The identification unit identifies and collects the type and properties of the original cloth in real time.
3. The printing and dyeing factory intelligent handling system based on a robotic arm according to claim 2 is characterized in that: The positioning unit includes an RGB-D camera.
4. The printing and dyeing factory intelligent handling system based on a robotic arm according to claim 1 is characterized in that: The posture automatic interaction and monitoring module includes a data acquisition unit, an information processing unit, a human-computer interaction unit, and an output control unit.
5. The printing and dyeing factory intelligent handling system based on a robotic arm according to claim 1 is characterized in that: The safety alarm module includes an alarm unit, a display unit, an external control unit, and an analysis unit.
6. The printing and dyeing factory intelligent handling system based on a robotic arm according to claim 5 is characterized in that: The alarm unit includes a speaker and an LED light; the display unit includes a high-definition display; and the external control unit includes an external keyboard and a mouse.
7. A printing and dyeing factory intelligent handling method based on a robotic arm, which is implemented based on the printing and dyeing factory intelligent handling system based on a robotic arm according to any one of claims 1 to 6, and the steps include: Step 1: Data collection and preprocessing: The visual module recognizes and collects the type and properties of the original cloth in real time, and recognizes and analyzes the real spatial position of the original cloth in real time; Step 2: Data fusion and analysis: The data collected in static and dynamic environments are fused and processed, and the working path of the robot is controlled and optimized by combining the accelerated global positioning method; Step 3: Real-time control and adjustment: Based on the key feature information collected by the visual module from the original cloth in step 1 and the data fusion processing in step 2, the working path of the robot arm is controlled in real time; Step 4. Safety monitoring and alarm: monitor the working status of the robotic arm in real time, identify abnormal conditions of the robotic arm and issue an alarm in time.
8. The intelligent handling method for a printing and dyeing factory based on a robotic arm according to claim 7 is characterized in that: In the step 1, the visual module includes an RGB-D camera, which acquires a color image and a depth image of the original cloth, and aligns the color image and the depth image to obtain three-dimensional pixel coordinates; the position feature information of the original cloth is realized by cooperating with the RGB-D camera through the Faster R-CNN algorithm.
9. The intelligent handling method for printing and dyeing factories based on a robotic arm according to claim 7, characterized in that: In the step 2, in the static environment, the position and posture of the robot arm are quickly positioned and controlled by using a fuzzy Kalman fusion and particle filtering method; In the dynamic environment, a credibility model of the robot arm control is established through credibility parameters, and adaptive adjustment is achieved in the robot arm positioning process through target posture parameter adjustment.
10. The intelligent handling method for printing and dyeing factories based on a robotic arm according to claim 9, characterized in that: When faced with map scenes and / or possible interference, the distribution set method is used to automatically monitor and adjust the position information of the robot arm.
Citation Information
Patent Citations
Robot dynamic grabbing method and system based on global and local visual semantics
CN109483554A
Industrial part intelligent identification and sorting system based on computer vision
CN111421539A
Real-time three-dimensional reconstruction method for object grabbed by mechanical arm
CN113313815A
Mechanical arm intelligent grabbing method and system based on Faster R-CNN and GRCNN
CN116673962A
Transfer robot material visual detection method and system based on edge cloud collaboration
CN116863210A
Cited By
Intelligent control system for gray fabric carrying and stacking manipulator
CN119460760A
