Coal logistics park production management and control method and system based on video recognition

Abstract

The invention is suitable for the technical field of coal logistics park production management and control, and provides a video identification-based coal logistics park production management and control method and system. According to the invention, equipment operation videos and production field videos are collected in real time; analyzing the equipment operation video and the production field video to generate a video analysis result; displaying the equipment operation state and the production process information, and generating an early warning signal and a decision suggestion when there is an abnormality; intelligent alarm is carried out according to the early warning signal, and remote control is carried out according to decision suggestions. The system can realize comprehensive, real-time and accurate monitoring of the equipment operation state and the production process in the coal logistics park, improves the accuracy and integrity of data acquisition, improves the production management and control efficiency, quickly responds to equipment faults and production abnormalities through intelligent analysis and decision support, optimizes the production process and resource allocation, enhances the safety management capability, and improves the safety management efficiency. Illegal operation and potential safety hazards of personnel can be found and warned in time, and the accident risk is reduced.

Description

Technical Field

[0001] The present invention belongs to the technical field of production control in coal logistics parks, and in particular, relates to a method and system for production control in coal logistics parks based on video recognition. Background Art

[0002] Traditional coal logistics park production control has the following technical defects:

[0003] (1) Data collection is incomplete and inaccurate: It mainly relies on manual records and some sensor data. Manual records are prone to omissions and errors, and cannot obtain real-time and comprehensive information on equipment operating status and production processes. For example, subtle equipment failure hazards or workers' irregular operation behaviors may not be detected and recorded in time. Sensors can only collect data at specific locations and types, and have limited monitoring of some complex working conditions and the overall operation of equipment. The lack of an effective multi-source data fusion mechanism makes it impossible for data to verify and supplement each other, making it difficult to form an accurate understanding of the production process.

[0004] (2) Low management and control efficiency: Manual analysis of massive production data is difficult and time-consuming, and it is difficult to make scientific decisions quickly. When faced with sudden equipment failures or abnormal production processes, timely responses and adjustments cannot be made. Information flow between production links is not smooth, and there is a lack of collaborative management and control capabilities. For example, the transportation link and the loading and unloading link cannot share information in real time, which can easily cause equipment idleness or congestion, reducing overall production efficiency.

[0005] (3) Safety management loopholes: There is a lack of real-time and accurate monitoring methods for personnel violations (such as walking illegally in the equipment operation area, not operating the equipment according to regulations, etc.) and safety hazards (such as coal stacking too high may collapse, aging equipment parts not replaced in time, etc.), making it difficult to timely warn and prevent accidents. The effectiveness of safety training and emergency drills is difficult to effectively evaluate, and it is impossible to improve safety management measures in a targeted manner. Summary of the invention

[0006] The purpose of the embodiments of the present invention is to provide a method and system for coal logistics park production control based on video recognition, aiming to solve the technical problems existing in the prior art mentioned in the background technology.

[0007] The embodiment of the present invention is implemented as follows:

[0008] A method for production control of a coal logistics park based on video recognition, the method specifically comprising the following steps:

[0009] Collecting equipment operation videos and production site videos in real time, and transmitting the equipment operation videos and the production site videos;

[0010] Analyze the equipment operation video and the production site video to generate video analysis results;

[0011] Based on the video analysis results, the equipment operation status and production process information are displayed to determine whether there are any abnormalities, and if there are any abnormalities, an early warning signal and decision-making suggestions are generated;

[0012] Intelligent alarm is performed according to the early warning signal, and remote control is performed according to the decision suggestion.

[0013] As a further limitation of the technical solution of the embodiment of the present invention, the real-time acquisition of the device operation video and the production site video, and the transmission of the device operation video and the production site video specifically include the following steps:

[0014] Determine multiple key monitoring locations, and conduct monitoring and filming at the multiple key monitoring locations to collect equipment operation videos and production site videos in real time;

[0015] Transmit equipment operation videos and production site videos to the data processing center.

[0016] As a further limitation of the technical solution of the embodiment of the present invention, the multiple key monitoring locations include equipment operation areas, transportation channels and storage areas; the equipment operation video and production site video are transmitted to the data processing center, and a combination of wired and wireless communication methods are used for data transmission.

[0017] As a further limitation of the technical solution of the embodiment of the present invention, the analyzing the equipment operation video and the production site video to generate the video analysis result specifically includes the following steps:

[0018] Analyze the equipment operation video and the production site video by using a preset deep learning video recognition algorithm to identify equipment targets, component targets, and personnel targets;

[0019] Perform video dynamic analysis on the equipment target, the component target and the personnel target to generate video analysis results.

[0020] As a further limitation of the technical solution of the embodiment of the present invention, the display of the equipment operation status and production process information according to the video analysis results, judging whether there is an abnormality, and generating a warning signal and decision-making suggestion when there is an abnormality specifically includes the following steps:

[0021] Runs on the server and provides a visual interface;

[0022] In the visualization interface, the equipment operation status and production process information are displayed according to the video analysis results;

[0023] Determine whether there is an abnormality;

[0024] When there are anomalies, early warning signals and decision suggestions are generated.

[0025] As a further limitation of the technical solution of the embodiment of the present invention, the intelligent alarm according to the early warning signal and the remote control according to the decision suggestion specifically include the following steps:

[0026] Perform intelligent alarm according to the early warning signal;

[0027] According to the decision suggestion, a plurality of control devices are determined;

[0028] A plurality of the control devices are remotely controlled.

[0029] As a further limitation of the technical solution of the embodiment of the present invention, the intelligent alarm according to the early warning signal includes visual and auditory alarms; the remote control of the multiple control devices includes emergency shutdown and adjustment of operating parameters.

[0030] A video recognition coal logistics park production control system, the system includes a video acquisition and transmission unit, a data processing center, an intelligent control platform and an early warning and execution unit, wherein:

[0031] A video acquisition and transmission unit, used for acquiring equipment operation videos and production site videos in real time, and transmitting the equipment operation videos and the production site videos;

[0032] A data processing center is used to analyze the equipment operation video and the production site video to generate video analysis results;

[0033] An intelligent management and control platform is used to display the equipment operation status and production process information based on the video analysis results, determine whether there are any abnormalities, and generate early warning signals and decision-making suggestions when there are abnormalities;

[0034] The early warning and execution unit is used to make intelligent alarms according to the early warning signals and to perform remote control according to the decision suggestions.

[0035] As a further limitation of the technical solution of the embodiment of the present invention, the video acquisition and transmission unit specifically includes:

[0036] A video acquisition module is used to determine multiple key monitoring locations, and to perform monitoring and shooting at the multiple key monitoring locations, and to collect equipment operation videos and production site videos in real time;

[0037] The data transmission module is used to transmit equipment operation videos and production site videos to the data processing center.

[0038] Compared with the prior art, the present invention has the following beneficial effects:

[0039] The embodiment of the present invention collects equipment operation videos and production site videos in real time; analyzes equipment operation videos and production site videos to generate video analysis results; displays equipment operation status and production process information, and generates warning signals and decision suggestions when there are abnormalities; performs intelligent alarms according to warning signals, and performs remote control according to decision suggestions. It can achieve comprehensive, real-time, and accurate monitoring of equipment operation status and production processes in coal logistics parks, improve the accuracy and completeness of data collection, improve production management efficiency, and quickly respond to equipment failures and production anomalies through intelligent analysis and decision support, optimize production processes and resource allocation, and enhance safety management capabilities, timely discover and warn personnel of illegal operations and safety hazards, and reduce accident risks. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A flow chart of a method for coal logistics park production control based on video recognition provided by an embodiment of the present invention is shown;

[0041] Figure 2 An application architecture diagram of a coal logistics park production control system based on video recognition provided by an embodiment of the present invention is shown;

[0042] Figure 3 A schematic diagram of real-time acquisition of equipment operation video and production site video provided by an embodiment of the present invention is shown;

[0043] Figure 4 A schematic diagram showing the operating status of a display device and production process information provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0045] It is understandable that the production control of traditional coal logistics parks has the following technical defects: (1) Incomplete and inaccurate data collection: It mainly relies on manual records and some sensor data. Manual records are prone to omissions and errors, and cannot obtain real-time and comprehensive information on equipment operation status and production process. For example, it may not be possible to detect and record subtle equipment failures or workers' irregular operations in a timely manner. Sensors can only collect data at specific locations and types, and have limited monitoring of some complex working conditions and the overall operation of equipment. The lack of an effective multi-source data fusion mechanism makes it impossible for data to verify and supplement each other, making it difficult to form an accurate understanding of the production process. (2) Low control efficiency: Manual analysis of massive production data is difficult and time-consuming, and it is difficult to make scientific decisions quickly. When faced with sudden equipment failures or abnormal production processes, it is impossible to respond and adjust in a timely manner. Information flow between production links is not smooth, and there is a lack of collaborative control capabilities. For example, the transportation link and the loading and unloading link cannot share information in real time, which can easily cause equipment idleness or congestion, reducing overall production efficiency. (3) Safety management loopholes: There is a lack of real-time and accurate monitoring methods for personnel violations (such as walking illegally in the equipment operation area, not operating the equipment according to regulations, etc.) and safety hazards (such as coal stacking too high may collapse, aging equipment parts not replaced in time, etc.), making it difficult to timely warn and prevent accidents. The effectiveness of safety training and emergency drills is difficult to effectively evaluate, and it is impossible to improve safety management measures in a targeted manner.

[0046] To solve the above problems, the embodiment of the present invention discloses a method and system for production control of a coal logistics park based on video recognition, which collects equipment operation videos and production site videos in real time, and transmits equipment operation videos and production site videos; analyzes equipment operation videos and production site videos to generate video analysis results; displays equipment operation status and production process information based on video analysis results, determines whether there are abnormalities, and generates early warning signals and decision suggestions when there are abnormalities; performs intelligent alarms according to early warning signals, and performs remote control according to decision suggestions. It can achieve comprehensive, real-time, and accurate monitoring of the equipment operation status and production process of the coal logistics park, improve the accuracy and completeness of data collection, improve production control efficiency, quickly respond to equipment failures and production anomalies through intelligent analysis and decision support, optimize production processes and resource allocation, and enhance safety management capabilities, timely discover and warn personnel of illegal operations and safety hazards, and reduce accident risks.

[0047] Specifically, Figure 1 A flow chart of a coal logistics park production control method based on video recognition provided by an embodiment of the present invention is shown.

[0048] In a preferred embodiment of the present invention, a method for production control of a coal logistics park based on video recognition is provided, and the method specifically comprises the following steps:

[0049] Step S101: collect equipment operation video and production site video in real time, and transmit the equipment operation video and the production site video.

[0050] In the embodiment of the present invention, Figure 3 A schematic diagram of real-time acquisition of equipment operation video and production site video provided by an embodiment of the present invention is shown. By determining multiple key monitoring positions and performing monitoring and shooting at multiple key monitoring positions, equipment operation video and production site video are acquired in real time, and then the equipment operation video and production site video are transmitted to a data processing center. Specifically, the multiple key monitoring positions include equipment operation areas, transportation channels, and storage areas; data transmission is achieved by a communication method that combines wired (such as Ethernet cable) and wireless (such as Wi-Fi, 5G, etc.).

[0051] Step S102: Analyze the equipment operation video and the production site video to generate video analysis results.

[0052] In an embodiment of the present invention, a preset deep learning video recognition algorithm is used to analyze equipment operation videos and production site videos to identify equipment targets, component targets and personnel targets, and then video dynamic analysis of the equipment targets, component targets and personnel targets is performed to generate video analysis results.

[0053] It can be understood that the deep learning video recognition algorithm is used to analyze the video, for example, the target detection algorithm is used to identify targets such as equipment parts and personnel, and the behavior recognition algorithm is used to determine whether the personnel operation is standardized and whether the equipment is running normally, etc., to generate video analysis results, and the generated video analysis results are transmitted.

[0054] Step S103: Based on the video analysis results, display the equipment operation status and production process information, determine whether there are any abnormalities, and generate warning signals and decision suggestions when there are abnormalities.

[0055] In the embodiment of the present invention, Figure 4 A schematic diagram of displaying equipment operating status and production process information provided by an embodiment of the present invention is shown, which runs on a server to provide a visualization interface. In the visualization interface, the equipment operating status and production process information are displayed based on the video analysis results, and it is determined whether there are any abnormalities. In the event of an abnormality, an early warning signal and decision-making suggestion are generated.

[0056] It is understandable that by displaying the equipment operating status and production process information, functions such as production planning, equipment scheduling, and personnel management can be realized, and early warning signals and decision-making recommendations can be issued based on the analysis results.

[0057] It is understandable that for the display of equipment operation status and production process information, intelligent management and control platform clients under different operating systems (such as Windows, Linux, Android, iOS, etc.) can be developed to facilitate different users to use different devices for operation and management. For example, Windows desktop applications are provided for park managers to achieve comprehensive functional operations; Android mobile applications are provided for on-site inspection personnel to facilitate viewing of equipment status and receiving early warning information at any time.

[0058] Step S104: intelligently alarm according to the early warning signal, and perform remote control according to the decision suggestion.

[0059] In an embodiment of the present invention, visual and auditory intelligent alarms are performed according to the early warning signals to remind staff members to pay attention to abnormal situations, and according to the decision suggestions, multiple control devices are determined, and different remote controls such as emergency shutdown and operation parameter adjustment are performed on the multiple control devices.

[0060] Furthermore, Figure 2 An application architecture diagram of a coal logistics park production control system based on video recognition provided by an embodiment of the present invention is shown.

[0061] Among them, in another preferred embodiment provided by the present invention, a video recognition coal logistics park production control system includes:

[0062] The video acquisition and transmission unit 101 is used to acquire the device operation video and the production site video in real time, and transmit the device operation video and the production site video.

[0063] In an embodiment of the present invention, the video acquisition and transmission unit 101 determines multiple key monitoring positions, performs monitoring and shooting at multiple key monitoring positions, acquires equipment operation videos and production site videos in real time, and then transmits the equipment operation videos and production site videos to a data processing center. Specifically, the multiple key monitoring positions include equipment operation areas, transportation channels, and storage areas; data transmission is achieved by a communication method that combines wired (such as Ethernet cables) and wireless (such as Wi-Fi, 5G, etc.).

[0064] Specifically, in another preferred implementation manner provided by the present invention, the video acquisition and transmission unit 101 further includes:

[0065] A video acquisition module is used to determine multiple key monitoring locations, and to perform monitoring and shooting at the multiple key monitoring locations, and to collect equipment operation videos and production site videos in real time;

[0066] The data transmission module is used to transmit equipment operation videos and production site videos to the data processing center.

[0067] Furthermore, the video recognition coal logistics park production control system also includes:

[0068] The data processing center 102 is used to analyze the equipment operation video and the production site video to generate video analysis results.

[0069] In an embodiment of the present invention, the data processing center 102 uses a preset deep learning video recognition algorithm to analyze equipment operation videos and production site videos, identify equipment targets, component targets and personnel targets, and then performs video dynamic analysis on the equipment targets, component targets and personnel targets to generate video analysis results.

[0070] It is understandable that the data processing center 102 is in the form of a server cluster, including hardware such as high-performance processors and large-capacity storage. Its function is to receive and store video data and equipment operation data, analyze and process the video using a video recognition algorithm, and monitor the equipment operation status in real time.

[0071] The intelligent management and control platform 103 is used to display the equipment operation status and production process information according to the video analysis results, determine whether there are any abnormalities, and generate early warning signals and decision suggestions when there are abnormalities.

[0072] In an embodiment of the present invention, the intelligent management and control platform 103 runs on a server and provides a visualization interface. In the visualization interface, the equipment operation status and production process information are displayed according to the video analysis results, and it is determined whether there are any abnormalities. In the event of an abnormality, an early warning signal and decision-making recommendation are generated.

[0073] The early warning and execution unit 104 is used to perform intelligent alarm according to the early warning signal and perform remote control according to the decision suggestion.

[0074] In an embodiment of the present invention, the early warning and execution unit 104 performs visual and auditory intelligent alarms according to the early warning signals to remind staff members to pay attention to abnormal situations, and determines multiple control devices according to decision suggestions, and performs different remote controls such as emergency shutdown and operating parameter adjustment on the multiple control devices.

[0075] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0076] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0077] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A method for production control of a coal logistics park based on video recognition, characterized in that: The method specifically comprises the following steps: Collecting equipment operation videos and production site videos in real time, and transmitting the equipment operation videos and the production site videos; Analyze the equipment operation video and the production site video to generate video analysis results; Based on the video analysis results, the equipment operation status and production process information are displayed to determine whether there are any abnormalities, and if there are any abnormalities, an early warning signal and decision-making suggestions are generated; Intelligent alarm is performed according to the early warning signal, and remote control is performed according to the decision suggestion.

2. The method for coal logistics park production control based on video recognition according to claim 1 is characterized in that: The real-time acquisition of the device operation video and the production site video, and the transmission of the device operation video and the production site video specifically include the following steps: Determine multiple key monitoring locations, and conduct monitoring and filming at the multiple key monitoring locations to collect equipment operation videos and production site videos in real time; Transmit equipment operation videos and production site videos to the data processing center.

3. The method for production control of coal logistics park based on video recognition according to claim 2 is characterized in that: The multiple key monitoring locations include equipment operation areas, transportation channels and storage areas; the equipment operation videos and production site videos are transmitted to the data processing center, and a combination of wired and wireless communication methods are used for data transmission.

4. The method for production control of coal logistics park based on video recognition according to claim 1 is characterized in that: The analyzing the equipment operation video and the production site video to generate the video analysis result specifically comprises the following steps: Analyze the equipment operation video and the production site video by using a preset deep learning video recognition algorithm to identify equipment targets, component targets, and personnel targets; Perform video dynamic analysis on the equipment target, the component target and the personnel target to generate video analysis results.

5. The method for production control of coal logistics park based on video recognition according to claim 1 is characterized in that: The method of displaying the equipment operation status and production process information according to the video analysis results, judging whether there is an abnormality, and generating an early warning signal and decision-making suggestion when there is an abnormality specifically includes the following steps: Runs on the server and provides a visual interface; In the visualization interface, the equipment operation status and production process information are displayed according to the video analysis results; Determine whether there is an abnormality; When there are anomalies, early warning signals and decision suggestions are generated.

6. The method for production control of coal logistics park based on video recognition according to claim 1 is characterized in that: The intelligent alarm according to the early warning signal and the remote control according to the decision suggestion specifically include the following steps: Perform intelligent alarm according to the early warning signal; According to the decision suggestion, a plurality of control devices are determined; A plurality of the control devices are remotely controlled.

7. The method for production control of coal logistics park based on video recognition according to claim 6 is characterized in that: The intelligent alarm according to the early warning signal includes visual and auditory alarms; the remote control of the multiple control devices includes emergency shutdown and operation parameter adjustment.

8. A video recognition coal logistics park production control system, characterized in that: The system includes a video acquisition and transmission unit, a data processing center, an intelligent management and control platform, and an early warning and execution unit, wherein: A video acquisition and transmission unit, used for acquiring equipment operation videos and production site videos in real time, and transmitting the equipment operation videos and the production site videos; A data processing center is used to analyze the equipment operation video and the production site video to generate video analysis results; An intelligent management and control platform is used to display the equipment operation status and production process information based on the video analysis results, determine whether there are any abnormalities, and generate early warning signals and decision-making suggestions when there are abnormalities; The early warning and execution unit is used to make intelligent alarms according to the early warning signals and to perform remote control according to the decision suggestions.

9. The video recognition coal logistics park production control system according to claim 8 is characterized in that: The video acquisition and transmission unit specifically includes: A video acquisition module is used to determine multiple key monitoring locations, and to perform monitoring and shooting at the multiple key monitoring locations, and to collect equipment operation videos and production site videos in real time; The data transmission module is used to transmit equipment operation videos and production site videos to the data processing center.

Images