An automated equipment material import and export monitoring system

Abstract

The present invention discloses an automated equipment material import and export monitoring system, which relates to the field of mechanical automation technology, and includes: an image acquisition module, an accumulation assessment module, an abnormality assessment module, and an intelligent management module. The image acquisition module collects image data in real time and stores it in a material machine operation database through monitoring equipment deployed in the import and export area of ​​the automated equipment. The accumulation assessment module analyzes the image data in the material machine operation database to evaluate the accumulation state of the material. The abnormality assessment module analyzes the image data in the material machine operation database to identify the abnormal state. The intelligent management module connects the other three modules, and intelligently analyzes and regulates the operation rules of the automated equipment material machine according to the accumulation and abnormal state of the automated equipment materials, optimizes and adjusts the production strategy, and improves production efficiency and production safety.

Description

Technical Field

[0001] The present invention relates to the technical field of mechanical automation, and in particular to an automated equipment material import and export monitoring system. Background Art

[0002] Automation equipment materials often refer to various materials used in automated production lines or automated warehouses. These materials may include raw materials, semi-finished products, finished products, tools, spare parts, and various equipment and facilities used to produce or store these materials. These materials are transported, processed, stored, or combined into final products through automated equipment such as robots, conveyor belts, and automated warehouse systems.

[0003] Existing automated equipment for material transportation lacks intelligent control capabilities, autonomous adaptability and efficient operation modes, resulting in reduced production efficiency; in addition, due to the lack of effective monitoring and protection mechanisms, it may pose safety risks to operators or equipment. Summary of the invention

[0004] In order to solve the above-mentioned technical problems, an automated equipment material import and export monitoring system is provided. This technical solution solves the problem that the existing automated equipment material transportation has insufficient intelligent control capabilities, lacks autonomous adaptability and efficient operation mode, resulting in reduced production efficiency; in addition, due to the lack of effective monitoring and protection mechanisms, it may cause safety risks to operators or equipment.

[0005] In order to achieve the above purpose, the technical solution adopted by the present invention is:

[0006] An automated equipment material import and export monitoring system, comprising:

[0007] An image acquisition module is connected to the material machine operation database by wire. The image acquisition module is used to deploy monitoring equipment at several angles based on the material import and export areas of the automation equipment, collect real-time image data of the material import and export areas of the automation equipment, and store them in the material machine operation database;

[0008] The accumulation assessment module is electrically connected to the material machine operation database. The accumulation assessment module is used to analyze the real-time image data in the material machine database based on the material machine operation database to evaluate the material accumulation state in the import and export area of ​​the automated material machine;

[0009] An abnormality assessment module, the abnormality assessment module is electrically connected to the material machine operation database, and the abnormality assessment module is used to identify the real-time image data in the material machine database based on the material machine operation database, and mark the abnormal state in the material import and export area of ​​the automation equipment;

[0010] The intelligent management module is electrically connected to the accumulation assessment module and the abnormality assessment module. The intelligent management module is used to intelligently analyze and regulate the operating rules of the automated material machine based on the material accumulation status in the import and export areas of the automated material machine and the abnormal status in the material import and export areas of the automated equipment.

[0011] Preferably, the stacking assessment module internally includes:

[0012] An inlet accumulation state evaluation unit, which is used to evaluate the inlet material accumulation state based on the inlet area image data of the automation equipment materials in the material machine operation database;

[0013] The outlet accumulation state evaluation unit is used to evaluate the outlet material accumulation state based on the outlet area image data of the automation equipment material in the material machine operation database.

[0014] Preferably, the inlet accumulation state assessment unit includes:

[0015] The occupancy rate evaluation subunit is used to determine the occupancy rate of the imported materials based on the ratio of the space occupied by the materials existing in the available area of ​​the material import of the automation equipment to the available space;

[0016] The material density assessment subunit is used to segment and extract the size and shape of the materials in the image based on the real-time image data of the material inlet area of ​​the automation equipment, and assess the material density within the available area of ​​the material inlet of the automation equipment;

[0017] The material flow evaluation subunit is used to calculate the material flow based on the tasks to be completed of the automation equipment materials and the cycle time of the tasks to be transported materials, record the number of materials passing through the import area within a fixed cycle time;

[0018] The accumulation time evaluation subunit is used to analyze whether the materials to be transported in the import area of ​​the current automation equipment materials are greater than the basic transportation performance of the automation equipment materials based on the average value of the basic material transportation performance of the automation equipment materials. If so, it is recorded as the accumulation moment and the accumulation time is obtained;

[0019] The accumulation growth rate evaluation subunit is used to analyze the material accumulation growth rate of the real-time image data of the material inlet area of ​​the automation equipment under the accumulation time based on the accumulation time, and evaluate the accumulation growth rate;

[0020] The import pile-up index evaluation subunit is electrically connected to the occupancy evaluation subunit, the material density evaluation subunit, the material flow evaluation subunit, the pile-up time evaluation subunit and the pile-up growth rate evaluation subunit. The import pile-up index evaluation subunit is used to evaluate the import pile-up index of the automation equipment material based on the import material occupancy rate, material density, material flow, pile-up time and pile-up growth rate of the automation equipment material through the pile-up evaluation formula.

[0021] Preferably, the stacking evaluation formula is:

[0022] ;

[0023] In the formula, is the import accumulation index of automation equipment materials, is the occupancy rate of imported materials, is the material density, is the material flow rate, For the accumulation time, is the accumulation growth rate, , , , , They are the weight of imported material occupancy rate, material density, material flow, stacking time and stacking growth rate, respectively.

[0024] Preferably, the outlet accumulation state assessment unit includes:

[0025] The material output subunit is used to evaluate the material output rate based on the expected material transportation volume and the actual material transportation volume of the automation equipment materials combined with the total amount of materials to be transported;

[0026] The exit blocking subunit is applied to the basic handling capacity of the material outlet of the automation equipment. The moment when the material to be transported is greater than the basic handling capacity is marked as the blocking moment. The exit blocking rate is calculated based on the ratio of the duration of the blocking moment to the cycle duration of the material task to be transported.

[0027] Output speed subunit: The output speed subunit is used to evaluate the material output speed based on the basic handling capacity of the material outlet of the automation equipment and the basic handling capacity at each moment;

[0028] The material occupancy subunit is used to determine the exit material occupancy rate based on the ratio of the space occupied by the materials existing in the available area of ​​the material exit of the automation equipment to the available space;

[0029] The export accumulation index evaluation subunit is electrically connected to the material output subunit, the export blockage subunit, the output speed subunit and the material occupancy subunit. The export accumulation index evaluation subunit is used to evaluate the export accumulation index of the automation equipment material based on the export material output rate, export blockage rate, material output speed and export material occupancy rate of the automation equipment material through the accumulation evaluation formula.

[0030] Preferably, the stacking evaluation formula is:

[0031] ;

[0032] Where P is the export accumulation index of automation equipment materials, is the material output rate, is the outlet blockage rate, is the material output speed, is the export material occupancy rate, , , , They represent the material output rate weight, the outlet blockage rate weight, the material output speed weight and the outlet material occupancy rate weight respectively.

[0033] Preferably, the abnormal assessment module internally includes:

[0034] The data set unit is used to crop and mark the appearance image of each transport material based on the import area image data of the automation equipment material in the material machine operation database, and combine them into a reference image data set;

[0035] A training unit, the training unit is electrically connected to the data set unit, and the training unit is used to actively add several types of abnormal object images to the reference image data set based on the reference image data set, and train an abnormality recognition model. The abnormality recognition model uses the real-time image data of the automated entrance and exit as input, and marks the abnormal materials to be confirmed in the real-time image as output;

[0036] A feature vector unit, the feature vector unit is electrically connected to the training unit, and the feature vector unit is used to perform feature marking based on the abnormal material to be confirmed, obtain several features of the abnormal material to be confirmed, and combine them into a feature vector of the abnormal material to be confirmed;

[0037] The comparison unit is electrically connected to the feature vector unit, and is used to calculate the distance between the two feature vectors based on the feature vector of the abnormal material to be confirmed and the feature vector of the transportation task material through a distance measurement algorithm, and determine the similarity between the abnormal material to be confirmed and the transportation task material; and determine whether it is an abnormal material according to a similarity threshold;

[0038] Among them, the distance measurement algorithm expression is:

[0039] ;

[0040] In the formula, S is the similarity between the abnormal material to be confirmed and the transportation task material, is the i-th feature vector of the abnormal material to be confirmed, is the i-th feature vector of the transport task material, and n is the total number of feature vectors.

[0041] Preferably, the intelligent management module includes:

[0042] The abnormality management unit is used to stop the operation of the automation equipment material when the abnormal material to be confirmed in the real-time image is marked as a confirmed abnormal material based on the automation equipment material;

[0043] The transmission acceleration unit is used to increase the transmission speed of materials of the automated equipment when the import congestion index of the automated logistics equipment is less than the production lower threshold or the export congestion index is less than the production lower threshold;

[0044] The transmission deceleration unit is used to slow down the transmission speed of materials of the automated equipment when the import congestion index of the automated logistics equipment is greater than the production upper threshold or the export congestion index is greater than the production upper threshold;

[0045] The material machine management unit is electrically connected to the abnormal management unit, the transmission acceleration unit and the transmission deceleration unit. The material machine management unit is used to intelligently analyze the current state of automated materials based on the management strategies of the abnormal management unit, the transmission acceleration unit and the transmission deceleration unit, and to intelligently regulate the materials of automated equipment.

[0046] Compared with the prior art, the present invention has the following beneficial effects:

[0047] The present invention proposes a monitoring scheme for the import and export of materials in automated equipment. The scheme collects real-time image data of the import and export areas through multi-angle monitoring equipment, and uses intelligent algorithms to evaluate and identify the material accumulation status and abnormal conditions, thereby realizing intelligent monitoring and optimized management of materials in automated equipment. The scheme can monitor and adjust equipment operation rules in real time to improve production efficiency, ensure product quality and safety, and optimize resource allocation. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 This is a framework diagram of an automated equipment material import and export monitoring system;

[0049] Figure 2 This is the internal structure framework diagram of the stacking assessment module;

[0050] Figure 3 This is the internal structure framework diagram of the abnormal assessment module;

[0051] Figure 4 This is the internal structure framework diagram of the intelligent management module. DETAILED DESCRIPTION

[0052] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art may think of other obvious variations.

[0053] Reference Figure 1 As shown, an automated equipment material import and export monitoring system includes:

[0054] An image acquisition module is connected to the material machine operation database by wire. The image acquisition module is used to deploy monitoring equipment at several angles based on the material import and export areas of the automation equipment, collect real-time image data of the material import and export areas of the automation equipment, and store them in the material machine operation database;

[0055] The accumulation assessment module is electrically connected to the material machine operation database. The accumulation assessment module is used to analyze the real-time image data in the material machine database based on the material machine operation database to evaluate the material accumulation state in the import and export area of ​​the automated material machine;

[0056] An abnormality assessment module, the abnormality assessment module is electrically connected to the material machine operation database, and the abnormality assessment module is used to identify the real-time image data in the material machine database based on the material machine operation database, and mark the abnormal state in the material import and export area of ​​the automation equipment;

[0057] The intelligent management module is electrically connected to the accumulation assessment module and the abnormality assessment module. The intelligent management module is used to intelligently analyze and regulate the operating rules of the automated material machine based on the material accumulation status in the import and export areas of the automated material machine and the abnormal status in the material import and export areas of the automated equipment.

[0058] This solution uses monitoring equipment deployed in the material import and export areas of automated equipment to collect real-time image data, evaluates material accumulation status and abnormal conditions through database storage and analysis, and uses intelligent analysis to regulate the operating rules of automated equipment material machines, thereby improving production efficiency and production safety.

[0059] Reference Figure 2 As shown, the stacking assessment module includes:

[0060] An inlet accumulation state evaluation unit, which is used to evaluate the inlet material accumulation state based on the inlet area image data of the automation equipment materials in the material machine operation database;

[0061] An outlet accumulation state evaluation unit, which is used to evaluate the outlet material accumulation state based on the outlet area image data of the automation equipment material in the material machine operation database;

[0062] The import accumulation status assessment unit includes:

[0063] The occupancy rate evaluation subunit is used to determine the occupancy rate of the imported materials based on the ratio of the space occupied by the materials existing in the available area of ​​the material import of the automation equipment to the available space;

[0064] The material density assessment subunit is used to segment and extract the size and shape of the materials in the image based on the real-time image data of the material inlet area of ​​the automation equipment, and assess the material density within the available area of ​​the material inlet of the automation equipment;

[0065] The material flow evaluation subunit is used to calculate the material flow based on the tasks to be completed of the automation equipment materials and the cycle time of the tasks to be transported materials, record the number of materials passing through the import area within a fixed cycle time;

[0066] The accumulation time evaluation subunit is used to analyze whether the materials to be transported in the import area of ​​the current automation equipment materials are greater than the basic transportation performance of the automation equipment materials based on the average value of the basic material transportation performance of the automation equipment materials. If so, it is recorded as the accumulation moment and the accumulation time is obtained;

[0067] The accumulation growth rate evaluation subunit is used to analyze the material accumulation growth rate of the real-time image data of the material inlet area of ​​the automation equipment under the accumulation time based on the accumulation time, and evaluate the accumulation growth rate;

[0068] The import accumulation index evaluation subunit is electrically connected to the occupancy evaluation subunit, the material density evaluation subunit, the material flow evaluation subunit, the accumulation time evaluation subunit and the accumulation growth rate evaluation subunit. The import accumulation index evaluation subunit is used to evaluate the import accumulation index of the automation equipment material based on the imported material occupancy rate, material density, material flow, accumulation time and accumulation growth rate of the automation equipment material through the accumulation evaluation formula;

[0069] The stacking evaluation formula is:

[0070] ;

[0071] In the formula, is the import accumulation index of automation equipment materials, is the occupancy rate of imported materials, is the material density, is the material flow rate, For the accumulation time, is the accumulation growth rate, , , , , They are the weight of imported material occupancy rate, material density, material flow, stacking time and stacking growth rate, respectively.

[0072] Among them, the export accumulation status assessment unit includes:

[0073] The material output subunit is used to evaluate the material output rate based on the expected material transportation volume and the actual material transportation volume of the automation equipment materials combined with the total amount of materials to be transported;

[0074] The exit blocking subunit is applied to the basic handling capacity of the material outlet of the automation equipment. The moment when the material to be transported is greater than the basic handling capacity is marked as the blocking moment. The exit blocking rate is calculated based on the ratio of the duration of the blocking moment to the cycle duration of the material task to be transported.

[0075] Output speed subunit: The output speed subunit is used to evaluate the material output speed based on the basic handling capacity of the material outlet of the automation equipment and the basic handling capacity at each moment;

[0076] The material occupancy subunit is used to determine the exit material occupancy rate based on the ratio of the space occupied by the materials existing in the available area of ​​the material exit of the automation equipment to the available space;

[0077] The outlet accumulation index evaluation subunit is electrically connected to the material output subunit, the outlet blocking subunit, the output speed subunit and the material occupancy subunit. The outlet accumulation index evaluation subunit is used to evaluate the outlet accumulation index of the automation equipment material based on the outlet material output rate, outlet blocking rate, material output speed and outlet material occupancy rate of the automation equipment material through an accumulation evaluation formula;

[0078] Among them, the stacking evaluation formula is:

[0079] ;

[0080] Where P is the export accumulation index of automation equipment materials, is the material output rate, is the outlet blockage rate, is the material output speed, is the export material occupancy rate, , , , They represent the material output rate weight, the outlet blockage rate weight, the material output speed weight and the outlet material occupancy rate weight respectively.

[0081] It should be noted that the weights of the various indicators in the above scheme can be adjusted according to the importance of the impact on the stacking state in the actual situation. For example, if the occupancy rate has the greatest impact on the stacking state, then the weight of the occupancy rate can be set larger; if the material density is the key factor in the growth of the stacking index, then the weight value of the material density can be increased. In this way, the quantitative indicators of the stacking state of the imported materials of the automated material machine can be obtained, which can then be used to analyze and adjust the operating state of the material machine.

[0082] Reference Figure 3 As shown, the abnormal assessment module includes:

[0083] The data set unit is used to crop and mark the appearance image of each transport material based on the import area image data of the automation equipment material in the material machine operation database, and combine them into a reference image data set;

[0084] A training unit, the training unit is electrically connected to the data set unit, and the training unit is used to actively add several types of abnormal object images to the reference image data set based on the reference image data set, and train an abnormality recognition model. The abnormality recognition model uses the real-time image data of the automated entrance and exit as input, and marks the abnormal materials to be confirmed in the real-time image as output;

[0085] A feature vector unit, the feature vector unit is electrically connected to the training unit, and the feature vector unit is used to perform feature marking based on the abnormal material to be confirmed, obtain several features of the abnormal material to be confirmed, and combine them into a feature vector of the abnormal material to be confirmed;

[0086] The comparison unit is electrically connected to the feature vector unit, and is used to calculate the distance between the two feature vectors based on the feature vector of the abnormal material to be confirmed and the feature vector of the transportation task material through a distance measurement algorithm, and determine the similarity between the abnormal material to be confirmed and the transportation task material; and determine whether it is an abnormal material according to a similarity threshold;

[0087] Among them, the distance measurement algorithm expression is:

[0088] ;

[0089] In the formula, S is the similarity between the abnormal material to be confirmed and the transportation task material, is the i-th feature vector of the abnormal material to be confirmed, is the i-th feature vector of the transport task material, and n is the total number of feature vectors.

[0090] This solution constructs a comprehensive reference image dataset, which contains images of various types of normal transportation task materials and some typical abnormal object images. By training the anomaly recognition model, the solution can accurately mark the abnormal materials to be confirmed from the real-time image data. Then, by calculating the distance between the feature vector of the abnormal material to be confirmed and the feature vector of the normal transportation task material, the solution can evaluate the similarity between the two in a quantitative way. Finally, according to the set similarity threshold, it can be accurately judged whether the abnormal material to be confirmed is really abnormal. This method not only makes full use of the efficiency of deep learning technology, but also ensures the accuracy of judgment through similarity calculation, thereby realizing an efficient and reliable abnormal material identification solution at the technical level.

[0091] It should be noted that since the anomaly recognition model requires a large amount of image data in the initial stage of training, material images of transportation tasks are actively collected for feature flipping and combined into a massive image data set to support the initial stage training of the anomaly recognition model.

[0092] Reference Figure 4 As shown, the intelligent management module includes:

[0093] The abnormality management unit is used to stop the operation of the automation equipment material when the abnormal material to be confirmed in the real-time image is marked as a confirmed abnormal material based on the automation equipment material;

[0094] The transmission acceleration unit is used to increase the transmission speed of materials of the automated equipment when the import congestion index of the automated logistics equipment is less than the production lower threshold or the export congestion index is less than the production lower threshold;

[0095] The transmission deceleration unit is used to slow down the transmission speed of materials of the automated equipment when the import congestion index of the automated logistics equipment is greater than the production upper threshold or the export congestion index is greater than the production upper threshold;

[0096] The material machine management unit is electrically connected to the abnormal management unit, the transmission acceleration unit and the transmission deceleration unit. The material machine management unit is used to intelligently analyze the current state of automated materials based on the management strategies of the abnormal management unit, the transmission acceleration unit and the transmission deceleration unit, and to intelligently control the materials of the automated equipment.

[0097] This solution effectively improves the operating efficiency and safety of automated material equipment through the abnormal management unit marking and stopping abnormal materials, the transmission acceleration unit increasing the transmission speed, the transmission deceleration unit slowing down the transmission speed, and the intelligent regulation of the material machine management unit. Such an intelligent regulation system can respond to abnormal situations in a timely manner and optimize the transmission speed of materials, thereby ensuring the smooth operation of the equipment to the greatest extent and improving production efficiency and production safety.

[0098] The use process of an automated equipment material import and export monitoring system is as follows:

[0099] Step 1: Based on the material import and export area of ​​the automation equipment, deploy monitoring equipment at several angles to collect real-time image data of the material import and export area of ​​the automation equipment and store it in the material machine operation database;

[0100] Step 2: Determine the import material occupancy rate based on the ratio of the space occupied by the materials existing in the available area of ​​the automation equipment material import to the available space;

[0101] Step 3: Based on the real-time image data of the material import and export area of ​​the automation equipment, the size and shape of the materials in the image are segmented and extracted to evaluate the material density within the available area of ​​the material import of the automation equipment;

[0102] Step 4: Based on the tasks to be completed of the automation equipment materials and the cycle time of the tasks to be transported, record the number of materials passing through the import area within a fixed cycle time and calculate the material flow rate;

[0103] Step 5: Based on the average value of the basic material transportation performance of the automation equipment material, analyze whether the materials to be transported in the import area of ​​the current automation equipment material are greater than the basic transportation performance of the automation equipment material. If so, record it as the accumulation time and obtain the accumulation time;

[0104] Step 6: Based on the accumulation time, analyze the material accumulation growth rate of the real-time image data of the material inlet area of ​​the automation equipment under the accumulation time, and evaluate the accumulation growth rate;

[0105] Step 7: Based on the imported material occupancy rate, material density, material flow rate, stacking time and stacking growth rate of the automation equipment materials, the imported stacking index of the automation equipment materials is evaluated through the stacking evaluation formula;

[0106] Step 8: Evaluate the material output rate based on the expected material transport volume and the actual material transport volume of the automation equipment materials combined with the total amount of materials to be transported;

[0107] Step 9: Based on the basic handling capacity of the material outlet of the automation equipment, mark the moment when the material to be transported is greater than the basic handling capacity, record it as the blocking moment, and calculate the outlet blocking rate according to the ratio of the duration of the blocking moment to the cycle duration of the material to be transported task;

[0108] Step 10: Based on the basic handling capacity of the material outlet of the automation equipment, evaluate the material output speed according to the basic handling capacity at each moment;

[0109] Step 11: Determine the exit material occupancy rate based on the ratio of the space occupied by the materials existing in the available area of ​​the automation equipment material exit to the available space;

[0110] Step 12: Based on the outlet material output rate, outlet blocking rate, material output speed and outlet material occupancy rate of the automation equipment material, the outlet accumulation index of the automation equipment material is evaluated through the accumulation evaluation formula;

[0111] Step 13: Based on the import area image data of the automation equipment materials in the material machine operation database, the appearance image of each transport material is cropped and marked, and combined into a reference image data set;

[0112] Step 14: Based on the reference image data set, several types of abnormal object images are actively added to the reference image data set to train an abnormality recognition model. The abnormality recognition model uses the real-time image data of the automated entrance and exit as input and marks the abnormal materials to be confirmed in the real-time image as output;

[0113] Step 15: Based on the abnormal material to be confirmed, feature marking is performed to obtain several features of the abnormal material to be confirmed, and the features are combined into a feature vector of the abnormal material to be confirmed;

[0114] Step 16: Based on the feature vector of the abnormal material to be confirmed and the feature vector of the transportation task material, the distance between the two feature vectors is calculated by a distance measurement algorithm to determine the similarity between the abnormal material to be confirmed and the transportation task material; and whether it is an abnormal material is determined according to the similarity threshold;

[0115] Step 17: When the abnormal material to be confirmed in the real-time image is marked as a confirmed abnormal material based on the automated equipment material, the operation of the automated equipment material is stopped;

[0116] Step 18: When the import congestion index of the automated logistics equipment is less than the production lower threshold or the export congestion index is less than the production lower threshold, the transmission speed of the automated equipment materials is increased;

[0117] Step 19: When the import congestion index of the automated logistics equipment is greater than the upper production threshold or the export congestion index is greater than the upper production threshold, the transmission speed of the automated equipment materials is slowed down;

[0118] Step 20: Based on the management strategies of the abnormal management unit, the transmission acceleration unit and the transmission deceleration unit, the current automation material status is intelligently analyzed, and the automation equipment materials are intelligently regulated.

[0119] In summary, the advantages of the present invention are: by collecting real-time image data of the import and export areas through multi-angle monitoring equipment, and using intelligent algorithms to evaluate and identify material accumulation status and abnormal conditions, the intelligent monitoring and optimization management of automated equipment materials is realized. The solution can monitor and adjust equipment operation rules in real time to improve production efficiency, ensure product quality and safety, and optimize resource allocation.

[0120] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The above embodiments and descriptions only describe the principles of the present invention. The present invention may be subject to various changes and improvements without departing from the spirit and scope of the present invention. These changes and improvements fall within the scope of the present invention. The scope of protection claimed by the present invention is defined by the attached claims and their equivalents.

Claims

1. An automated equipment material import and export monitoring system, characterized in that: include: An image acquisition module is connected to the material machine operation database by wire. The image acquisition module is used to deploy monitoring equipment at several angles based on the material import and export areas of the automation equipment, collect real-time image data of the material import and export areas of the automation equipment, and store them in the material machine operation database; The accumulation assessment module is electrically connected to the material machine operation database. The accumulation assessment module is used to analyze the real-time image data in the material machine database based on the material machine operation database to evaluate the material accumulation state in the import and export area of ​​the automated material machine; An abnormality assessment module, the abnormality assessment module is electrically connected to the material machine operation database, and the abnormality assessment module is used to identify the real-time image data in the material machine database based on the material machine operation database, and mark the abnormal state in the material import and export area of ​​the automation equipment; The intelligent management module is electrically connected to the accumulation assessment module and the abnormality assessment module. The intelligent management module is used to intelligently analyze and regulate the operating rules of the automated material machine based on the material accumulation status in the import and export areas of the automated material machine and the abnormal status in the material import and export areas of the automated equipment.

2. The automated equipment material import and export monitoring system according to claim 1, characterized in that: The stacking assessment module includes: An inlet accumulation state evaluation unit, which is used to evaluate the inlet material accumulation state based on the inlet area image data of the automation equipment materials in the material machine operation database; The outlet accumulation state evaluation unit is used to evaluate the outlet material accumulation state based on the outlet area image data of the automation equipment material in the material machine operation database.

3. The material import and export monitoring system of automated equipment according to claim 2, characterized in that: The import accumulation status assessment unit includes: The occupancy rate evaluation subunit is used to determine the occupancy rate of the imported materials based on the ratio of the space occupied by the materials existing in the available area of ​​the material import of the automation equipment to the available space; The material density assessment subunit is used to segment and extract the size and shape of the materials in the image based on the real-time image data of the material inlet area of ​​the automation equipment, and assess the material density within the available area of ​​the material inlet of the automation equipment; The material flow evaluation subunit is used to calculate the material flow based on the tasks to be completed of the automation equipment materials and the cycle time of the tasks to be transported materials, record the number of materials passing through the import area within a fixed cycle time; The accumulation time evaluation subunit is used to analyze whether the materials to be transported in the import area of ​​the current automation equipment materials are greater than the basic transportation performance of the automation equipment materials based on the average value of the basic material transportation performance of the automation equipment materials. If so, it is recorded as the accumulation moment and the accumulation time is obtained; The accumulation growth rate evaluation subunit is used to analyze the material accumulation growth rate of the real-time image data of the material inlet area of ​​the automation equipment under the accumulation time based on the accumulation time, and evaluate the accumulation growth rate; The import pile-up index evaluation subunit is electrically connected to the occupancy evaluation subunit, the material density evaluation subunit, the material flow evaluation subunit, the pile-up time evaluation subunit and the pile-up growth rate evaluation subunit. The import pile-up index evaluation subunit is used to evaluate the import pile-up index of the automation equipment material based on the import material occupancy rate, material density, material flow, pile-up time and pile-up growth rate of the automation equipment material through the pile-up evaluation formula.

4. The automated equipment material import and export monitoring system according to claim 3, characterized in that: The stacking evaluation formula is: ； In the formula, is the import accumulation index of automation equipment materials, is the occupancy rate of imported materials, is the material density, is the material flow rate, For the accumulation time, is the accumulation growth rate, , , , , They are the weight of imported material occupancy rate, material density, material flow, stacking time and stacking growth rate, respectively.

5. The automated equipment material import and export monitoring system according to claim 2, characterized in that: The outlet accumulation status assessment unit includes: The material output subunit is used to evaluate the material output rate based on the expected material transportation volume and the actual material transportation volume of the automation equipment materials combined with the total amount of materials to be transported; The exit blocking subunit is applied to the basic handling capacity of the material outlet of the automation equipment. The moment when the material to be transported is greater than the basic handling capacity is marked as the blocking moment. The exit blocking rate is calculated based on the ratio of the duration of the blocking moment to the cycle duration of the material task to be transported. Output speed subunit: The output speed subunit is used to evaluate the material output speed based on the basic handling capacity of the material outlet of the automation equipment and the basic handling capacity at each moment; The material occupancy subunit is used to determine the exit material occupancy rate based on the ratio of the space occupied by the materials existing in the available area of ​​the material exit of the automation equipment to the available space; The export accumulation index evaluation subunit is electrically connected to the material output subunit, the export blockage subunit, the output speed subunit and the material occupancy subunit. The export accumulation index evaluation subunit is used to evaluate the export accumulation index of the automation equipment material based on the export material output rate, export blockage rate, material output speed and export material occupancy rate of the automation equipment material through the accumulation evaluation formula.

6. The automated equipment material import and export monitoring system according to claim 5, characterized in that: The stacking evaluation formula is: ； Where P is the export accumulation index of automation equipment materials, is the material output rate, is the outlet blockage rate, is the material output speed, is the export material occupancy rate, , , , They represent the material output rate weight, the outlet blockage rate weight, the material output speed weight and the outlet material occupancy rate weight respectively.

7. The automated equipment material import and export monitoring system according to claim 1, characterized in that: The anomaly assessment module includes: The data set unit is used to crop and mark the appearance image of each transport material based on the import area image data of the automation equipment material in the material machine operation database, and combine them into a reference image data set; A training unit, the training unit is electrically connected to the data set unit, and the training unit is used to actively add several types of abnormal object images to the reference image data set based on the reference image data set, and train an abnormality recognition model. The abnormality recognition model uses the real-time image data of the automated entrance and exit as input, and marks the abnormal materials to be confirmed in the real-time image as output; A feature vector unit, the feature vector unit is electrically connected to the training unit, and the feature vector unit is used to perform feature marking based on the abnormal material to be confirmed, obtain several features of the abnormal material to be confirmed, and combine them into a feature vector of the abnormal material to be confirmed; The comparison unit is electrically connected to the feature vector unit, and is used to calculate the distance between the two feature vectors based on the feature vector of the abnormal material to be confirmed and the feature vector of the transportation task material through a distance measurement algorithm, and determine the similarity between the abnormal material to be confirmed and the transportation task material; and determine whether it is an abnormal material according to a similarity threshold; Among them, the distance measurement algorithm expression is: ； In the formula, S is the similarity between the abnormal material to be confirmed and the transportation task material, is the i-th feature vector of the abnormal material to be confirmed, is the i-th feature vector of the transport task material, and n is the total number of feature vectors.

8. The automated equipment material import and export monitoring system according to claim 1, characterized in that: The intelligent management module includes: The abnormality management unit is used to stop the operation of the automation equipment material when the abnormal material to be confirmed in the real-time image is marked as a confirmed abnormal material based on the automation equipment material; The transmission acceleration unit is used to increase the transmission speed of materials of the automated equipment when the import congestion index of the automated logistics equipment is less than the production lower threshold or the export congestion index is less than the production lower threshold; The transmission deceleration unit is used to slow down the transmission speed of materials of the automated equipment when the import congestion index of the automated logistics equipment is greater than the production upper threshold or the export congestion index is greater than the production upper threshold; The material machine management unit is electrically connected to the abnormal management unit, the transmission acceleration unit and the transmission deceleration unit. The material machine management unit is used to intelligently analyze the current state of automated materials based on the management strategies of the abnormal management unit, the transmission acceleration unit and the transmission deceleration unit, and to intelligently control the materials of the automated equipment.

Images