Anti-collision control method for hydraulic support face guard and face guard control system

By image prediction and control of the status of the guard plate, the problem of measurement error of the hydraulic support sensor is solved, and the timely recycling and expansion of the guard plate is realized, which avoids the collision between the coal miner and the guard plate, and improves the work safety .

CN119021738APending Publication Date: 2024-11-26CHINA ENERGY GRP NINGXIA COAL IND CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411213643.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-30
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

In the prior art, the height of the guard plate is measured by adding sensors at the front end of the hydraulic support to estimate whether it is collided. Due to the inclination angle of the hydraulic support, there is an error in the measurement results, and the recycling and expansion of the guard plate cannot be controlled in time and effectively.

Method used

The image is used to estimate the status of the guard board. By acquiring real-time images and performing debounce processing, the recovery status and confidence of the guard board are identified, and control instructions are generated to control the recycling and expansion of the guard board, and when automatic control fails Issue an alarm and speed down adjustment to prevent the guard plate from colliding with the coal miner.

Benefits of technology

By image prediction and control of the status of the guard plate, the problem of sensor measurement error is solved, timely and effective guard plate control is achieved, the collision between the coal miner and guard plate is avoided, and the work safety is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119021738A_ABST
    Figure CN119021738A_ABST
Patent Text Reader

Abstract

The invention provides an anti-collision control method for a hydraulic support face guard and a face guard control system. The method comprises the steps that a first target image is acquired; intercepting the first target image according to the target direction and carrying out de-jittering processing to obtain a second target image; performing classification according to the second target image to determine a first recovery state, and calculating the confidence of the first recovery state; under the condition that the target confidence coefficient of the first recovery state is larger than a preset threshold value, a first control instruction is generated according to the first recovery state of each face guard; controlling each face guard according to the first control instruction to obtain a second recovery state; and acquiring a third recovery state, and sending out target alarm information under the condition that the third recovery state is inconsistent with the second recovery state. The method solves the problem that in the prior art, a sensor is additionally arranged at the front end of the hydraulic support to measure the height of the face guard and estimate whether collision occurs or not, and errors exist in the measurement result due to the inclination angle of the hydraulic support.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of guard plate control, and in particular to an anti-collision control method for a hydraulic support guard plate, a control device, a computer-readable storage medium and a guard plate control system. Background Art

[0002] In the process of coal mining, especially in the fully mechanized mining face of medium and thick coal seams, the stability of the coal wall is crucial to ensure the safety of the working face. In order to prevent the coal wall from spalling, that is, the edge of the coal seam slips or breaks due to pressure, the front of the hydraulic support is equipped with a guard plate, which plays a key role in maintaining the stability of the coal wall. The guard plate is hinged with the guard jack to achieve a swinging motion with the hinge axis of the front beam component as the rotation center, so that it can adapt to the different needs and changes of the working face. The guard jack not only supports the pressure from the coal wall, but also needs to have sufficient strength and stability to resist ground pressure and dynamic loads.

[0003] In actual work, the use of the side guard plate needs to be closely coordinated with the operation of the coal mining machine. When the coal mining machine is cutting coal, the side guard plate of the hydraulic support needs to be retracted to avoid the front roller of the coal mining machine colliding with the side guard plate or the front beam, causing equipment damage or work interruption. Once the coal mining machine passes through a specific area, the side guard plate needs to be immediately extended to fit closely to the coal wall to ensure the stability of the coal wall and prevent the occurrence of side spalling.

[0004] In the prior art, it is usually necessary to install an additional sensor at the front end of the hydraulic support to measure the height of the guard plate and estimate the distance between the guard plate and the coal machine drum. During the production process, the hydraulic support has a pitch tilt, which causes errors in the calculation results of the installed sensor device, so that the guard plate cannot be controlled in time. Summary of the invention

[0005] The main purpose of the present application is to provide an anti-collision control method, a control device, a computer-readable storage medium and a guard plate control system for a hydraulic support, so as to at least solve the problem in the prior art that a sensor is added to the front end of the hydraulic support to measure the height of the guard plate to estimate whether there is a collision, but the measurement result has errors due to the inclination angle of the hydraulic support.

[0006] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a collision prevention control method for a hydraulic support guard plate is provided, comprising: acquiring a first target image, the first target image being a real-time image within a first preset range centered on a coal mining machine; acquiring a target direction, intercepting the first target image according to the target direction and performing a de-jittering process to obtain a second target image, the target direction being the direction of travel of the coal mining machine; classifying and determining a first recovery state according to the second target image, and calculating a confidence level of the first recovery state to obtain a target confidence level, the first recovery state being the recovery state of each of the guard plates obtained by identifying the second target image; in the first recovery state When the target confidence of the state is greater than a preset threshold, a first control instruction is generated according to the first recovery state of each of the guard plates, and the first control instruction is used to control the guard plates to be recovered; each of the guard plates is controlled according to the first control instruction to obtain a second recovery state, and the second recovery state is the actual recovery state of each of the guard plates after the first control instruction takes effect; a third recovery state is obtained, and when the third recovery state is inconsistent with the second recovery state, a target alarm message is issued, and the target alarm message is used to prompt the staff that the guard plate recovery has failed, and the third recovery state is the expected recovery state of each of the guard plates after the first control instruction takes effect.

[0007] Optionally, the first target image is intercepted and de-jittered according to the target direction to obtain a second target image, including: taking the front drum of the coal mining machine as the starting position, intercepting the first target image corresponding to a preset distance along the target direction to obtain a third target image; filtering the third target image by Gaussian filtering to remove high-frequency noise in the third target image to obtain a fourth target image, and filtering the fourth target image by median filtering or average filtering to smooth the image to obtain the second target image.

[0008] Optionally, the first recovery state of each of the guard plates in the second target image is determined by classification according to the second target image, and the method further includes: inputting the second target image into a first target model to obtain a fourth target image, and the first target model is used to segment the first target image to obtain the area corresponding to the guard plate in the second target image; inputting the fourth target image into the second target model to obtain the first recovery state, and the second target model is used to classify according to the fourth target image to determine the current posture of the guard plate.

[0009] Optionally, calculating the confidence of the first recycling state to obtain a target confidence includes: performing calculations based on the first recycling state through a softmax function to obtain the target confidence.

[0010] Optionally, after issuing the target alarm information, the method also includes: when the recovery state of the first guard plate corresponding to the second recovery state is inconsistent with the third recovery state, controlling the coal mining machine to stop moving, and the first guard plate is the guard plate that is less than a first preset distance from the front roller of the coal mining machine.

[0011] Optionally, after issuing the target alarm information, it includes: when the recovery state of the second recovery state corresponding to the second guard plate in the third recovery state is inconsistent, controlling the travel speed of the coal mining machine to be reduced to a first preset value, and the second guard plate is the guard plate whose distance from the front drum of the coal mining machine is less than the second preset distance and greater than or equal to the first preset distance.

[0012] Optionally, after issuing the target alarm information, it includes: when the recovery state of the third guard plate corresponding to the second recovery state is inconsistent with the third recovery state, controlling the travel speed of the coal mining machine to be reduced to a second preset value, and the third guard plate is the guard plate whose distance from the front drum of the coal mining machine is greater than or equal to the second preset distance.

[0013] According to another aspect of the present application, there is provided an anti-collision control device for a hydraulic support guard plate, the device comprising: a first acquisition unit, for acquiring a first target image, the first target image being a real-time image within a first preset range centered on a coal mining machine; a second acquisition unit, for acquiring a target direction, intercepting the first target image according to the target direction and performing a de-jittering process to obtain a second target image, the target direction being the direction of travel of the coal mining machine; a first determination unit, for classifying and determining a first recovery state according to the second target image, and calculating the confidence of the first recovery state to obtain a target confidence, the first recovery state being the recovery state of each of the guard plates identified according to the second target image; a generation unit, for generating a first recovery state according to the second target image; When the target confidence of the first recycling state is greater than a preset threshold, a first control instruction is generated according to the first recycling state of each of the guard plates, and the first control instruction is used to control the guard plates for recycling; a first control unit is used to control each of the guard plates according to the first control instruction to obtain a second recycling state, and the second recycling state is the actual recycling state of each of the guard plates after the first control instruction takes effect; an alarm unit is used to obtain a third recycling state, and when the third recycling state is inconsistent with the second recycling state, a target alarm message is issued, and the target alarm message is used to prompt the staff that the guard plate recycling has failed, and the third recycling state is the expected recycling state of each of the guard plates after the first control instruction takes effect.

[0014] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium includes a stored program, wherein when the program is executed, the method described in any one of the devices where the computer-readable storage medium is located is controlled.

[0015] According to another aspect of the present application, a guard plate control system is provided, comprising: one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs include methods for executing any one of the described methods.

[0016] By applying the technical solution of the present application, in the above-mentioned anti-collision control method for the side guard of a hydraulic support, first, a first target image is obtained, and the above-mentioned first target image is a real-time image within a first preset range centered on the coal mining machine; then, a target direction is obtained, and the above-mentioned first target image is intercepted and de-jittered according to the above-mentioned target direction to obtain a second target image, and the above-mentioned target direction is the travel direction of the above-mentioned coal mining machine; then, a first recovery state is determined by classification according to the above-mentioned second target image, and the confidence of the above-mentioned first recovery state is calculated to obtain a target confidence, and the above-mentioned first recovery state is the recovery state of each of the above-mentioned side guards obtained by identifying the above-mentioned second target image; then, in the above-mentioned first recovery state, When the target confidence is greater than the preset threshold, a first control instruction is generated according to the first recovery state of each of the guard plates, and the first control instruction is used to control the guard plates to be recovered; then, each of the guard plates is controlled according to the first control instruction to obtain a second recovery state, and the second recovery state is the actual recovery state of each of the guard plates after the first control instruction takes effect; finally, a third recovery state is obtained, and when the third recovery state is inconsistent with the second recovery state, a target alarm message is issued, and the target alarm message is used to remind the staff that the guard plate recovery fails, and the third recovery state is the expected recovery state of each of the guard plates after the first control instruction takes effect. The present application estimates the state of the guard plate through images for control, and determines whether the adjustment is successful in combination with the telescopic state of the guard plate. In the case of automatic control failure, an alarm is issued, and the speed is reduced to prevent the guard plate from colliding with the coal mining machine. This method solves the problem in the prior art that a sensor is added to the front end of the hydraulic support to measure the height of the guard plate to estimate whether there is a collision, and the measurement result has errors due to the inclination angle of the hydraulic support. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A hardware structure block diagram of a mobile terminal according to an anti-collision control method for a hydraulic support guard plate provided in an embodiment of the present application is shown;

[0018] Figure 2 A schematic flow chart of an anti-collision control method for a hydraulic support guard plate provided in accordance with an embodiment of the present application is shown;

[0019] Figure 3 A structural block diagram of an anti-collision control device for a hydraulic support guard plate provided according to an embodiment of the present application is shown.

[0020] The above drawings include the following reference numerals:

[0021] 102, processor; 104, memory; 106, transmission device; 108, input and output devices. DETAILED DESCRIPTION

[0022] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0023] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0024] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0025] As introduced in the background technology, in the prior art, an additional sensor is installed at the front end of the hydraulic support to measure the height of the guard plate and estimate the distance between the guard plate and the coal machine drum. During the production process, the hydraulic support has a pitch tilt, which causes errors in the calculation results of the installed sensor device. In order to solve the problem that a sensor is added to the front end of the hydraulic support to measure the height of the guard plate and estimate whether there is a collision, but the measurement result has errors due to the inclination angle of the hydraulic support, the embodiments of the present application provide an anti-collision control method, a control device, a computer-readable storage medium and a guard plate control system for the guard plate of the hydraulic support.

[0026] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0027] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 FIG. 1 is a hardware structure block diagram of a mobile terminal of an anti-collision control method for a hydraulic support guard plate according to an embodiment of the present invention. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is for illustration only and does not limit the structure of the mobile terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0028] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the display method of device information in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, the above method is implemented. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories can be connected to the mobile terminal via a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof. The transmission device 106 is used to receive or send data via a network. The above-mentioned specific examples of the network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0029] In this embodiment, a collision prevention control method for a hydraulic support guard plate running on a mobile terminal, a computer terminal or a similar computing device is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0030] Figure 2 1 is a flow chart of the anti-collision control method of the hydraulic support guard plate according to the embodiment of the present application. Figure 2 As shown, the method comprises the following steps:

[0031] Step S201, obtaining a first target image, wherein the first target image is a real-time image within a first preset range centered on the coal mining machine;

[0032] Specifically, video acquisition is used to collect images within the working range of the coal mining machine in real time when the coal mining machine is working. The collected image coverage at least completely includes the three side guard plates in front of the coal mining machine's travel direction and the working status of the coal mining machine. The collected images are used for subsequent analysis and detection of whether there is a collision risk between the front drum of the coal mining machine and the side guard plates.

[0033] Step S202, obtaining a target direction, intercepting the first target image according to the target direction and performing a de-jittering process to obtain a second target image, wherein the target direction is the traveling direction of the coal mining machine;

[0034] Specifically, the travel direction of the coal mining machine is determined based on the collected first target image, and the image is captured. The captured image includes at least the front drum of the coal mining machine and three guard plates in front of its travel direction. In order to eliminate factors such as mechanical vibration in the actual coal mining working environment, the captured image is de-jittered to obtain a clearer and more targeted image, namely the second target image, which is used for subsequent image analysis and recognition tasks.

[0035] Step S203, classifying and determining a first recycling state according to the second target image, and calculating the confidence of the first recycling state to obtain a target confidence, wherein the first recycling state is the recycling state of each of the guard plates obtained by identifying the second target image;

[0036] Specifically, the image is classified according to the recovery status of the first three side guards in the traveling direction of the coal mining machine in the above-mentioned second target image, the recovery status of each side guard is determined, and the confidence of the classification result is calculated to judge the credibility of the classification result.

[0037] Step S204, when the target confidence of the first recycling state is greater than a preset threshold, generating a first control instruction according to the first recycling state of each of the guard plates, the first control instruction being used to control the guard plates to be recycled;

[0038] Specifically, whether to generate the first control instruction is determined based on the confidence level of the first recycling state calculated by the system. When the target confidence level is greater than a preset threshold, it indicates that the system has a high certainty in judging the current state of the guard plate. In this case, the system generates the first control instruction to control the guard plate for recycling. The confidence threshold can be continuously optimized according to the actual working scenario and modified manually.

[0039] Step S205, controlling each of the above-mentioned side guard plates according to the above-mentioned first control instruction to obtain a second recovery state, wherein the above-mentioned second recovery state is the actual recovery state of each of the above-mentioned side guard plates after the above-mentioned first control instruction takes effect;

[0040] Specifically, the system controls the recovery action of the guard plates according to the first control instruction. After the guard plates execute the first control instruction, the system obtains the second recovery state of the actual state of each guard plate after executing the first control instruction.

[0041] Step S206, obtaining a third recovery state, and issuing a target alarm message when the third recovery state is inconsistent with the second recovery state, wherein the target alarm message is used to remind the staff that the recovery of the side guard plates has failed, and the third recovery state is the expected recovery state of each side guard plate after the first control instruction takes effect.

[0042] Specifically, the system predicts the ideal state or position that each guard plate should reach after executing the above-mentioned first control instruction, that is, the above-mentioned third recovery state, and compares the third recovery state and the second recovery state. If the two are inconsistent, that is, the actual recovery state is inconsistent with the actual operating state, the system will issue an alarm message to prompt on-site staff that there is a problem with the recovery of the guard plates, indicating that the recovery action of the guard plates has not been successfully executed or has not achieved the expected effect.

[0043] Through this embodiment, first, a first target image is obtained, and the first target image is a real-time image within a first preset range centered on the coal mining machine; then, a target direction is obtained, and the first target image is intercepted and de-jittered according to the target direction to obtain a second target image, and the target direction is the travel direction of the coal mining machine; then, the first recovery state is determined by classification according to the second target image, and the confidence of the first recovery state is calculated to obtain the target confidence, and the first recovery state is the recovery state of each of the guard plates obtained by identifying the second target image; then, when the target confidence of the first recovery state is greater than a preset threshold In the case of a failure, a first control instruction is generated according to the first recovery state of each of the guard plates, and the first control instruction is used to control the guard plates to be recovered; then, each of the guard plates is controlled according to the first control instruction to obtain a second recovery state, and the second recovery state is the actual recovery state of each of the guard plates after the first control instruction takes effect; finally, a third recovery state is obtained, and when the third recovery state is inconsistent with the second recovery state, a target alarm message is issued, and the target alarm message is used to remind the staff that the guard plate recovery has failed, and the third recovery state is the expected recovery state of each of the guard plates after the first control instruction takes effect. The present application estimates the state of the guard plate through images for control, and determines whether the adjustment is successful in combination with the telescopic state of the guard plate. In the case of failure of automatic control, an alarm is issued, and the speed is reduced to prevent the guard plate from colliding with the coal mining machine. This method solves the problem in the prior art that a sensor is added to the front end of the hydraulic support to measure the height of the guard plate to estimate whether there is a collision, and the measurement result has errors due to the inclination angle of the hydraulic support.

[0044] In order to obtain the second target image, in an optional implementation, the above step S202 includes:

[0045] Step S2021, taking the front drum of the coal mining machine as the starting position, intercepting the first target image corresponding to a preset distance along the target direction to obtain a third target image;

[0046] Specifically, along the forward direction of the coal mining machine, the first target image is intercepted with the front drum of the coal mining machine as the starting position. The preset distance for interception is to ensure that the range of the three side guard plates in front of the front drum of the coal mining machine can be completely included. The intercepted image focuses on the area in front of the front drum of the coal mining machine, which improves the efficiency and accuracy of image processing and also reduces unnecessary data processing.

[0047] Step S2022, filtering the third target image by Gaussian filtering to remove high-frequency noise in the third target image to obtain a fourth target image, filtering the fourth target image by median filtering or average filtering to smooth the image to obtain the second target image.

[0048] Specifically, the captured image is processed by Gaussian filtering to reduce the noise in the image and highlight the main features in the image to obtain a fourth target image. The fourth target image is processed by median filtering or average filtering to smooth the image and reduce any residual noise or incoherence that may exist in the image, thereby improving the uniformity and clarity of the image to obtain the above-mentioned second target image for image recognition and analysis.

[0049] In order to determine the current posture of the guard plate, in an optional implementation, the above step S203 includes:

[0050] Step S20301, inputting the second target image into the first target model to obtain a fourth target image, wherein the first target model is used to segment the first target image to obtain the area corresponding to the support plate in the second target image;

[0051] Specifically, the second target image obtained after noise removal and smoothing is input into the first target model, the image is analyzed by the first target model, the exact position and outline of the guard plate in the image are identified, and the relevant area is segmented to obtain the fourth target image, which highlights the relevant area of ​​the guard plate in the original image.

[0052] Step S20302: input the fourth target image into the second target model to obtain the first recovery state. The second target model is used to classify according to the fourth target image to determine the current posture of the guard plate.

[0053] Specifically, the filtered and smoothed image is input into the second target model, and the guard plate is classified and position recognized according to the image to determine whether the guard plate is retracted, unfolded, tilted or in other possible positions, thereby obtaining the above-mentioned first retracted state.

[0054] In order to calculate the target confidence, in an optional implementation, the above step 203 includes:

[0055] Step S20311, based on the first recycling state, a softmax function is used to calculate to obtain the target confidence.

[0056] Specifically, according to the classification result of the current posture of the guard plate identified by the system, the softmax function is used to calculate the model's confidence level in the classification result of the guard plate posture, so as to obtain the certainty of the model's classification decision.

[0057] In order to avoid sending collision, in an optional implementation manner, after sending the target warning information, the method further includes:

[0058] Step S301, when the recovery states of the first guard plate corresponding to the second recovery state and the third recovery state are inconsistent, the coal mining machine is controlled to stop moving, and the first guard plate is the guard plate that is less than a first preset distance from the front drum of the coal mining machine.

[0059] Specifically, the system monitors the actual state of the guard plate after the coal mining machine control command actually takes effect, and compares it with the expected recovery state. If the second recovery state and the third recovery state of the first guard plate are inconsistent, the system will automatically control the coal mining machine to stop moving to avoid possible collision or damage. The first guard plate is the first guard plate that is ahead of the front roller in the forward direction of the coal mining machine, that is, the guard plate that is less than the first preset distance.

[0060] For the safe operation of the coal mining machine, in an optional implementation, the above step S206 includes:

[0061] Step S20601, when the recovery states of the second recovery state and the second side guard plate corresponding to the third recovery state are inconsistent, the travel speed of the coal mining machine is controlled to be reduced to a first preset value, and the second side guard plate is the side guard plate whose distance from the front roller of the coal mining machine is less than the second preset distance and greater than or equal to the first preset distance.

[0062] Specifically, if the second recovery state and the third recovery state of the second guard plate are inconsistent, the system will automatically control the coal mining machine to reduce the travel speed to 80%, that is, the first preset value. The second guard plate is the second guard plate ahead of the front roller in the forward direction of the coal mining machine.

[0063] For the safe operation of the coal mining machine, in an optional implementation, the above step S206 includes:

[0064] Step S20602, when the recovery states of the third guard plate corresponding to the second recovery state and the third recovery state are inconsistent, the travel speed of the coal mining machine is controlled to be reduced to a second preset value, and the third guard plate is the guard plate whose distance from the front roller of the coal mining machine is greater than or equal to the second preset distance.

[0065] Specifically, if the second recovery state and the third recovery state of the third guard plate are inconsistent, the system will automatically control the coal mining machine to reduce the travel speed to 50%, that is, the second preset value. The third guard plate is the third guard plate ahead of the front roller in the forward direction of the coal mining machine.

[0066] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0067] The embodiment of the present application also provides an anti-collision control device for a hydraulic support guard plate. It should be noted that the anti-collision control device for a hydraulic support guard plate of the embodiment of the present application can be used to execute the anti-collision control method for a hydraulic support guard plate provided in the embodiment of the present application. The device is used to implement the above-mentioned embodiments and preferred implementation modes, and those that have been explained will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0068] The anti-collision control device for the hydraulic support guard plate provided in the embodiment of the present application is introduced below.

[0069] Figure 3 1 is a structural block diagram of the anti-collision control device of the hydraulic support guard plate according to the embodiment of the present application. Figure 3 As shown, the device comprises:

[0070] A first acquisition unit 10 is used to acquire a first target image, wherein the first target image is a real-time image within a first preset range centered on the coal mining machine;

[0071] Specifically, video acquisition is used to collect images within the working range of the coal mining machine in real time when the coal mining machine is working. The collected image coverage at least completely includes the three side guard plates in front of the coal mining machine's travel direction and the working status of the coal mining machine. The collected images are used for subsequent analysis and detection of whether there is a collision risk between the front drum of the coal mining machine and the side guard plates.

[0072] The second acquisition unit 20 is used to acquire a target direction, and to intercept the first target image according to the target direction and perform a de-jittering process to obtain a second target image, wherein the target direction is a moving direction of the coal mining machine;

[0073] Specifically, the travel direction of the coal mining machine is determined based on the collected first target image, and the image is captured. The captured image includes at least the front drum of the coal mining machine and three guard plates in front of its travel direction. In order to eliminate factors such as mechanical vibration in the actual coal mining working environment, the captured image is de-jittered to obtain a clearer and more targeted image, namely the second target image, which is used for subsequent image analysis and recognition tasks.

[0074] A first determination unit 30 is used to classify and determine a first recycling state according to the second target image, and calculate the confidence of the first recycling state to obtain a target confidence, wherein the first recycling state is the recycling state of each of the guard plates obtained by identifying the second target image;

[0075] Specifically, the image is classified according to the recovery status of the first three side guards in the traveling direction of the coal mining machine in the above-mentioned second target image, the recovery status of each side guard is determined, and the confidence of the classification result is calculated to judge the credibility of the classification result.

[0076] A generating unit 40, configured to generate a first control instruction according to the first recycling state of each of the guard plates when the target confidence of the first recycling state is greater than a preset threshold, wherein the first control instruction is used to control the guard plates to be recycled;

[0077] Specifically, whether to generate the first control instruction is determined based on the confidence level of the first recycling state calculated by the system. When the target confidence level is greater than a preset threshold, it indicates that the system has a high certainty in judging the current state of the guard plate. In this case, the system generates the first control instruction to control the guard plate for recycling. The confidence threshold can be continuously optimized according to the actual working scenario and modified manually.

[0078] A first control unit 50 is used to control each of the above-mentioned side guard plates according to the above-mentioned first control instruction to obtain a second recovery state, and the above-mentioned second recovery state is the actual recovery state of each of the above-mentioned side guard plates after the above-mentioned first control instruction takes effect;

[0079] Specifically, the system controls the recovery action of the guard plates according to the first control instruction. After the guard plates execute the first control instruction, the system obtains the second recovery state of the actual state of each guard plate after executing the first control instruction.

[0080] The alarm unit 60 is used to obtain a third recovery state. When the third recovery state is inconsistent with the second recovery state, a target alarm message is issued. The target alarm message is used to remind the staff that there is a failure in the recovery of the guard plates. The third recovery state is the expected recovery state of each of the guard plates after the first control instruction takes effect.

[0081] Specifically, the system predicts the ideal state or position that each guard plate should reach after executing the above-mentioned first control instruction, that is, the above-mentioned third recovery state, and compares the third recovery state and the second recovery state. If the two are inconsistent, that is, the actual recovery state is inconsistent with the actual operating state, the system will issue an alarm message to prompt on-site staff that there is a problem with the recovery of the guard plates, indicating that the recovery action of the guard plates has not been successfully executed or has not achieved the expected effect.

[0082] Through this embodiment, the first acquisition unit acquires the first target image, and the above-mentioned first target image is a real-time image within a first preset range centered on the coal mining machine; the second acquisition unit acquires the target direction, and intercepts the above-mentioned first target image according to the above-mentioned target direction and performs de-jittering processing to obtain the second target image, and the above-mentioned target direction is the travel direction of the above-mentioned coal mining machine; the first determination unit classifies and determines the first recovery state according to the above-mentioned second target image, and calculates the confidence of the above-mentioned first recovery state to obtain the target confidence, and the above-mentioned first recovery state is the recovery state of each of the above-mentioned guard plates obtained by identifying the above-mentioned second target image; the generation unit generates the above-mentioned target confidence when the above-mentioned target confidence of the above-mentioned first recovery state is greater than the preset When a threshold is set, a first control instruction is generated according to the first recovery state of each of the guard plates, and the first control instruction is used to control the guard plates to be recovered; the first control unit controls each of the guard plates according to the first control instruction to obtain a second recovery state, and the second recovery state is the actual recovery state of each of the guard plates after the first control instruction takes effect; the alarm unit obtains a third recovery state, and when the third recovery state is inconsistent with the second recovery state, a target alarm message is issued, and the target alarm message is used to remind the staff that the guard plate recovery fails, and the third recovery state is the expected recovery state of each of the guard plates after the first control instruction takes effect. The present application estimates the state of the guard plate through an image for control, and determines whether the adjustment is successful in combination with the telescopic state of the guard plate. In the case of failure of automatic control, an alarm is issued, and the speed is reduced to prevent the guard plate from colliding with the coal mining machine. This method solves the problem in the prior art that a sensor is added to the front end of the hydraulic support to measure the height of the guard plate to estimate whether there is a collision, and the measurement result has errors due to the inclination angle of the hydraulic support.

[0083] In order to obtain the second target image, in an optional implementation manner, the second acquisition unit includes:

[0084] An interception subunit is used to intercept the first target image corresponding to a preset distance along the target direction to obtain a third target image, taking the front drum of the coal mining machine as a starting position;

[0085] Specifically, along the forward direction of the coal mining machine, the first target image is intercepted with the front drum of the coal mining machine as the starting position. The preset distance for interception is to ensure that the range of the three side guard plates in front of the front drum of the coal mining machine can be completely included. The intercepted image focuses on the area in front of the front drum of the coal mining machine, which improves the efficiency and accuracy of image processing and also reduces unnecessary data processing.

[0086] The image processing subunit is used to filter the third target image by Gaussian filtering to remove high-frequency noise in the third target image to obtain a fourth target image, and filter the fourth target image by median filtering or average filtering to smooth the image to obtain the second target image.

[0087] Specifically, the captured image is processed by Gaussian filtering to reduce the noise in the image and highlight the main features in the image to obtain a fourth target image. The fourth target image is processed by median filtering or average filtering to smooth the image and reduce any residual noise or incoherence that may exist in the image, thereby improving the uniformity and clarity of the image to obtain the above-mentioned second target image for image recognition and analysis.

[0088] In order to determine the current posture of the guard plate, in an optional implementation, the first determination unit includes:

[0089] A first determining subunit is used to input the second target image into a first target model to obtain a fourth target image, wherein the first target model is used to segment the first target image to obtain a region corresponding to the support plate in the second target image;

[0090] Specifically, the second target image obtained after noise removal and smoothing is input into the first target model, the image is analyzed by the first target model, the exact position and outline of the guard plate in the image are identified, and the relevant area is segmented to obtain the fourth target image, which highlights the relevant area of ​​the guard plate in the original image.

[0091] The second determination subunit is used to input the fourth target image into a second target model to obtain the first recovery state. The second target model is used to classify according to the fourth target image to determine the current posture of the guard plate.

[0092] Specifically, the filtered and smoothed image is input into the second target model, and the guard plate is classified and position recognized according to the image to determine whether the guard plate is retracted, unfolded, tilted or in other possible positions, thereby obtaining the above-mentioned first retracted state.

[0093] In order to calculate the target confidence, in an optional implementation, the first determination unit includes:

[0094] The calculation subunit is used to calculate the target confidence by using a softmax function based on the first recycling state.

[0095] Specifically, according to the classification result of the current posture of the guard plate identified by the system, the softmax function is used to calculate the model's confidence level in the classification result of the guard plate posture, so as to obtain the certainty of the model's classification decision.

[0096] In order to avoid sending collision, in an optional implementation manner, after sending the target alarm information, the above-mentioned device further includes:

[0097] The second control unit is used to control the above-mentioned coal mining machine to stop moving when the recovery state of the first guard plate corresponding to the above-mentioned second recovery state is inconsistent with the recovery state of the above-mentioned third recovery state. The above-mentioned first guard plate is the above-mentioned guard plate that is less than the first preset distance from the front roller of the above-mentioned coal mining machine.

[0098] Specifically, the system monitors the actual state of the guard plate after the coal mining machine control command actually takes effect, and compares it with the expected recovery state. If the second recovery state and the third recovery state of the first guard plate are inconsistent, the system will automatically control the coal mining machine to stop moving to avoid possible collision or damage. The first guard plate is the first guard plate that is ahead of the front roller in the forward direction of the coal mining machine, that is, the guard plate that is less than the first preset distance.

[0099] For the safe operation of the coal mining machine, in an optional embodiment, the alarm unit includes:

[0100] The first control subunit is used for controlling the travel speed of the above-mentioned coal mining machine to be reduced to a first preset value when the recovery states of the second guard plate corresponding to the above-mentioned second recovery state are inconsistent with the above-mentioned third recovery state. The above-mentioned second guard plate is the above-mentioned guard plate which is less than the second preset distance and greater than or equal to the first preset distance from the front roller of the above-mentioned coal mining machine.

[0101] Specifically, if the second recovery state and the third recovery state of the second guard plate are inconsistent, the system will automatically control the coal mining machine to reduce the travel speed to 80%, that is, the first preset value. The second guard plate is the second guard plate ahead of the front roller in the forward direction of the coal mining machine.

[0102] For the safe operation of the coal mining machine, in an optional embodiment, the alarm unit includes:

[0103] The second control subunit is used to control the travel speed of the above-mentioned coal mining machine to be reduced to a second preset value when the recovery state of the third guard plate corresponding to the above-mentioned second recovery state is inconsistent with the recovery state of the third recovery state. The above-mentioned third guard plate is the above-mentioned guard plate whose distance from the front roller of the above-mentioned coal mining machine is greater than or equal to the second preset distance.

[0104] Specifically, if the second recovery state and the third recovery state of the third guard plate are inconsistent, the system will automatically control the coal mining machine to reduce the travel speed to 50%, that is, the second preset value. The third guard plate is the third guard plate ahead of the front roller in the forward direction of the coal mining machine.

[0105] The anti-collision control device for the hydraulic support guard plate includes a processor and a memory. The first acquisition unit, the second acquisition unit, the first determination unit, the generation unit, the first control unit, the alarm unit, etc. are all stored in the memory as program units, and the processor executes the program units stored in the memory to implement corresponding functions. The modules are all located in the same processor; or, the modules are located in different processors in any combination.

[0106] The processor includes a kernel, which retrieves the corresponding program unit from the memory. One or more kernels can be set, and the collision of the hydraulic support guard plate can be avoided by adjusting the kernel parameters.

[0107] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0108] An embodiment of the present invention provides a computer-readable storage medium, which includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute the anti-collision control method of the hydraulic support guard plate.

[0109] Specifically, the anti-collision control method of the hydraulic support guard plate includes:

[0110] Step S201, obtaining a first target image, wherein the first target image is a real-time image within a first preset range centered on the coal mining machine;

[0111] Specifically, video acquisition is used to collect images within the working range of the coal mining machine in real time when the coal mining machine is working. The collected image coverage at least completely includes the three side guard plates in front of the coal mining machine's travel direction and the working status of the coal mining machine. The collected images are used for subsequent analysis and detection of whether there is a collision risk between the front drum of the coal mining machine and the side guard plates.

[0112] Step S202, obtaining a target direction, intercepting the first target image according to the target direction and performing a de-jittering process to obtain a second target image, wherein the target direction is the traveling direction of the coal mining machine;

[0113] Specifically, the travel direction of the coal mining machine is determined based on the collected first target image, and the image is captured. The captured image includes at least the front drum of the coal mining machine and three guard plates in front of its travel direction. In order to eliminate factors such as mechanical vibration in the actual coal mining working environment, the captured image is de-jittered to obtain a clearer and more targeted image, namely the second target image, which is used for subsequent image analysis and recognition tasks.

[0114] Step S203, classifying and determining a first recycling state according to the second target image, and calculating the confidence of the first recycling state to obtain a target confidence, wherein the first recycling state is the recycling state of each of the guard plates obtained by identifying the second target image;

[0115] Specifically, the image is classified according to the recovery status of the first three side guards in the traveling direction of the coal mining machine in the above-mentioned second target image, the recovery status of each side guard is determined, and the confidence of the classification result is calculated to judge the credibility of the classification result.

[0116] Step S204, when the target confidence of the first recycling state is greater than a preset threshold, generating a first control instruction according to the first recycling state of each of the guard plates, the first control instruction being used to control the guard plates to be recycled;

[0117] Specifically, whether to generate the first control instruction is determined based on the confidence level of the first recycling state calculated by the system. When the target confidence level is greater than a preset threshold, it indicates that the system has a high certainty in judging the current state of the guard plate. In this case, the system generates the first control instruction to control the guard plate for recycling. The confidence threshold can be continuously optimized according to the actual working scenario and modified manually.

[0118] Step S205, controlling each of the above-mentioned side guard plates according to the above-mentioned first control instruction to obtain a second recovery state, wherein the above-mentioned second recovery state is the actual recovery state of each of the above-mentioned side guard plates after the above-mentioned first control instruction takes effect;

[0119] Specifically, the system controls the recovery action of the guard plates according to the first control instruction. After the guard plates execute the first control instruction, the system obtains the second recovery state of the actual state of each guard plate after executing the first control instruction.

[0120] Step S206, obtaining a third recovery state, and issuing a target alarm message when the third recovery state is inconsistent with the second recovery state, wherein the target alarm message is used to remind the staff that the recovery of the side guard plates has failed, and the third recovery state is the expected recovery state of each side guard plate after the first control instruction takes effect.

[0121] Specifically, the system predicts the ideal state or position that each guard plate should reach after executing the above-mentioned first control instruction, that is, the above-mentioned third recovery state, and compares the third recovery state and the second recovery state. If the two are inconsistent, that is, the actual recovery state is inconsistent with the actual operating state, the system will issue an alarm message to prompt on-site staff that there is a problem with the recovery of the guard plates, indicating that the recovery action of the guard plates has not been successfully executed or has not achieved the expected effect.

[0122] An embodiment of the present invention provides a processor, which is used to run a program, wherein the anti-collision control method of the hydraulic support guard plate is executed when the program is running.

[0123] Specifically, the anti-collision control method of the hydraulic support guard plate includes:

[0124] Step S201, obtaining a first target image, wherein the first target image is a real-time image within a first preset range centered on the coal mining machine;

[0125] Specifically, video acquisition is used to collect images within the working range of the coal mining machine in real time when the coal mining machine is working. The collected image coverage at least completely includes the three side guard plates in front of the coal mining machine's travel direction and the working status of the coal mining machine. The collected images are used for subsequent analysis and detection of whether there is a collision risk between the front drum of the coal mining machine and the side guard plates.

[0126] Step S202, obtaining a target direction, intercepting the first target image according to the target direction and performing a de-jittering process to obtain a second target image, wherein the target direction is the traveling direction of the coal mining machine;

[0127] Specifically, the travel direction of the coal mining machine is determined based on the collected first target image, and the image is captured. The captured image includes at least the front drum of the coal mining machine and three guard plates in front of its travel direction. In order to eliminate factors such as mechanical vibration in the actual coal mining working environment, the captured image is de-jittered to obtain a clearer and more targeted image, namely the second target image, which is used for subsequent image analysis and recognition tasks.

[0128] Step S203, classifying and determining a first recycling state according to the second target image, and calculating the confidence of the first recycling state to obtain a target confidence, wherein the first recycling state is the recycling state of each of the guard plates obtained by identifying the second target image;

[0129] Specifically, the image is classified according to the recovery status of the first three side guards in the traveling direction of the coal mining machine in the above-mentioned second target image, the recovery status of each side guard is determined, and the confidence of the classification result is calculated to judge the credibility of the classification result.

[0130] Step S204, when the target confidence of the first recycling state is greater than a preset threshold, generating a first control instruction according to the first recycling state of each of the guard plates, the first control instruction being used to control the guard plates to be recycled;

[0131] Specifically, whether to generate the first control instruction is determined based on the confidence level of the first recycling state calculated by the system. When the target confidence level is greater than a preset threshold, it indicates that the system has a high certainty in judging the current state of the guard plate. In this case, the system generates the first control instruction to control the guard plate for recycling. The confidence threshold can be continuously optimized according to the actual working scenario and modified manually.

[0132] Step S205, controlling each of the above-mentioned side guard plates according to the above-mentioned first control instruction to obtain a second recovery state, wherein the above-mentioned second recovery state is the actual recovery state of each of the above-mentioned side guard plates after the above-mentioned first control instruction takes effect;

[0133] Specifically, the system controls the recovery action of the guard plates according to the first control instruction. After the guard plates execute the first control instruction, the system obtains the second recovery state of the actual state of each guard plate after executing the first control instruction.

[0134] Step S206, obtaining a third recovery state, and issuing a target alarm message when the third recovery state is inconsistent with the second recovery state, wherein the target alarm message is used to remind the staff that the recovery of the side guard plates has failed, and the third recovery state is the expected recovery state of each side guard plate after the first control instruction takes effect.

[0135] Specifically, the system predicts the ideal state or position that each guard plate should reach after executing the above-mentioned first control instruction, that is, the above-mentioned third recovery state, and compares the third recovery state and the second recovery state. If the two are inconsistent, that is, the actual recovery state is inconsistent with the actual operating state, the system will issue an alarm message to prompt on-site staff that there is a problem with the recovery of the guard plates, indicating that the recovery action of the guard plates has not been successfully executed or has not achieved the expected effect.

[0136] An embodiment of the present invention provides a guard plate control system, which includes a processor, a memory, and a program stored in the memory and executable on the processor. When the processor executes the program, at least the following steps are implemented:

[0137] Step S201, obtaining a first target image, wherein the first target image is a real-time image within a first preset range centered on the coal mining machine;

[0138] Specifically, video acquisition is used to collect images within the working range of the coal mining machine in real time when the coal mining machine is working. The collected image coverage at least completely includes the three side guard plates in front of the coal mining machine's travel direction and the working status of the coal mining machine. The collected images are used for subsequent analysis and detection of whether there is a collision risk between the front drum of the coal mining machine and the side guard plates.

[0139] Step S202, obtaining a target direction, intercepting the first target image according to the target direction and performing a de-jittering process to obtain a second target image, wherein the target direction is the traveling direction of the coal mining machine;

[0140] Specifically, the travel direction of the coal mining machine is determined based on the collected first target image, and the image is captured. The captured image includes at least the front drum of the coal mining machine and three guard plates in front of its travel direction. In order to eliminate factors such as mechanical vibration in the actual coal mining working environment, the captured image is de-jittered to obtain a clearer and more targeted image, namely the second target image, which is used for subsequent image analysis and recognition tasks.

[0141] Step S203, classifying and determining a first recycling state according to the second target image, and calculating the confidence of the first recycling state to obtain a target confidence, wherein the first recycling state is the recycling state of each of the guard plates obtained by identifying the second target image;

[0142] Specifically, the image is classified according to the recovery status of the first three side guards in the traveling direction of the coal mining machine in the above-mentioned second target image, the recovery status of each side guard is determined, and the confidence of the classification result is calculated to judge the credibility of the classification result.

[0143] Step S204, when the target confidence of the first recycling state is greater than a preset threshold, generating a first control instruction according to the first recycling state of each of the guard plates, the first control instruction being used to control the guard plates to be recycled;

[0144] Specifically, whether to generate the first control instruction is determined based on the confidence level of the first recycling state calculated by the system. When the target confidence level is greater than a preset threshold, it indicates that the system has a high certainty in judging the current state of the guard plate. In this case, the system generates the first control instruction to control the guard plate for recycling. The confidence threshold can be continuously optimized according to the actual working scenario and modified manually.

[0145] Step S205, controlling each of the above-mentioned side guard plates according to the above-mentioned first control instruction to obtain a second recovery state, wherein the above-mentioned second recovery state is the actual recovery state of each of the above-mentioned side guard plates after the above-mentioned first control instruction takes effect;

[0146] Specifically, the system controls the recovery action of the guard plates according to the first control instruction. After the guard plates execute the first control instruction, the system obtains the second recovery state of the actual state of each guard plate after executing the first control instruction.

[0147] Step S206, obtaining a third recovery state, and issuing a target alarm message when the third recovery state is inconsistent with the second recovery state, wherein the target alarm message is used to remind the staff that the recovery of the side guard plates has failed, and the third recovery state is the expected recovery state of each side guard plate after the first control instruction takes effect.

[0148] Specifically, the system predicts the ideal state or position that each guard plate should reach after executing the above-mentioned first control instruction, that is, the above-mentioned third recovery state, and compares the third recovery state and the second recovery state. If the two are inconsistent, that is, the actual recovery state is inconsistent with the actual operating state, the system will issue an alarm message to prompt on-site staff that there is a problem with the recovery of the guard plates, indicating that the recovery action of the guard plates has not been successfully executed or has not achieved the expected effect.

[0149] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program for initializing at least the following method steps:

[0150] Step S201, obtaining a first target image, wherein the first target image is a real-time image within a first preset range centered on the coal mining machine;

[0151] Specifically, video acquisition is used to collect images within the working range of the coal mining machine in real time when the coal mining machine is working. The collected image coverage at least completely includes the three side guard plates in front of the coal mining machine's travel direction and the working status of the coal mining machine. The collected images are used for subsequent analysis and detection of whether there is a collision risk between the front drum of the coal mining machine and the side guard plates.

[0152] Step S202, obtaining a target direction, intercepting the first target image according to the target direction and performing a de-jittering process to obtain a second target image, wherein the target direction is the traveling direction of the coal mining machine;

[0153] Specifically, the travel direction of the coal mining machine is determined based on the collected first target image, and the image is captured. The captured image includes at least the front drum of the coal mining machine and three guard plates in front of its travel direction. In order to eliminate factors such as mechanical vibration in the actual coal mining working environment, the captured image is de-jittered to obtain a clearer and more targeted image, namely the second target image, which is used for subsequent image analysis and recognition tasks.

[0154] Step S203, classifying and determining a first recycling state according to the second target image, and calculating the confidence of the first recycling state to obtain a target confidence, wherein the first recycling state is the recycling state of each of the guard plates obtained by identifying the second target image;

[0155] Specifically, the image is classified according to the recovery status of the first three side guards in the traveling direction of the coal mining machine in the above-mentioned second target image, the recovery status of each side guard is determined, and the confidence of the classification result is calculated to judge the credibility of the classification result.

[0156] Step S204, when the target confidence of the first recycling state is greater than a preset threshold, generating a first control instruction according to the first recycling state of each of the guard plates, the first control instruction being used to control the guard plates to be recycled;

[0157] Specifically, whether to generate the first control instruction is determined based on the confidence level of the first recycling state calculated by the system. When the target confidence level is greater than a preset threshold, it indicates that the system has a high certainty in judging the current state of the guard plate. In this case, the system generates the first control instruction to control the guard plate for recycling. The confidence threshold can be continuously optimized according to the actual working scenario and modified manually.

[0158] Step S205, controlling each of the above-mentioned side guard plates according to the above-mentioned first control instruction to obtain a second recovery state, wherein the above-mentioned second recovery state is the actual recovery state of each of the above-mentioned side guard plates after the above-mentioned first control instruction takes effect;

[0159] Specifically, the system controls the recovery action of the guard plates according to the first control instruction. After the guard plates execute the first control instruction, the system obtains the second recovery state of the actual state of each guard plate after executing the first control instruction.

[0160] Step S206, obtaining a third recovery state, and issuing a target alarm message when the third recovery state is inconsistent with the second recovery state, wherein the target alarm message is used to remind the staff that the recovery of the side guard plates has failed, and the third recovery state is the expected recovery state of each side guard plate after the first control instruction takes effect.

[0161] Specifically, the system predicts the ideal state or position that each guard plate should reach after executing the above-mentioned first control instruction, that is, the above-mentioned third recovery state, and compares the third recovery state and the second recovery state. If the two are inconsistent, that is, the actual recovery state is inconsistent with the actual operating state, the system will issue an alarm message to prompt on-site staff that there is a problem with the recovery of the guard plates, indicating that the recovery action of the guard plates has not been successfully executed or has not achieved the expected effect.

[0162] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0163] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0164] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1A device that provides the functions specified in a block or multiple blocks.

[0165] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0166] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0167] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0168] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0169] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0170] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0171] From the above description, it can be seen that the above embodiments of the present application achieve the following technical effects:

[0172] 1) The anti-collision control method of the hydraulic support guard plate of the present application first obtains a first target image, which is a real-time image within a first preset range centered on the coal mining machine; then, the target direction is obtained, and the first target image is intercepted and de-jittered according to the target direction to obtain a second target image, and the target direction is the travel direction of the coal mining machine; then, the first recovery state is determined by classification according to the second target image, and the confidence of the first recovery state is calculated to obtain the target confidence, and the first recovery state is the recovery state of each of the guard plates obtained by identifying the second target image; then, the target position of the first recovery state is determined according to the target position of the first recovery state. When the confidence is greater than a preset threshold, a first control instruction is generated according to the first recovery state of each of the guard plates, and the first control instruction is used to control the guard plates to recover; then, each of the guard plates is controlled according to the first control instruction to obtain a second recovery state, and the second recovery state is the actual recovery state of each of the guard plates after the first control instruction takes effect; finally, a third recovery state is obtained, and when the third recovery state is inconsistent with the second recovery state, a target alarm message is issued, and the target alarm message is used to remind the staff that the guard plate recovery fails, and the third recovery state is the expected recovery state of each of the guard plates after the first control instruction takes effect. The present application estimates the state of the guard plate through images for control, and determines whether the adjustment is successful in combination with the telescopic state of the guard plate. In the case of automatic control failure, an alarm is issued, and the speed is reduced to prevent the guard plate from colliding with the coal mining machine. This method solves the problem in the prior art that a sensor is added to the front end of the hydraulic support to measure the height of the guard plate to estimate whether there is a collision, and the measurement result has errors due to the inclination angle of the hydraulic support.

[0173] 2) The anti-collision control device for the hydraulic support guard plate of the present application, the first acquisition unit acquires a first target image, the first target image is a real-time image within a first preset range centered on the coal mining machine; the second acquisition unit acquires a target direction, intercepts the first target image according to the target direction and performs a de-jittering process to obtain a second target image, the target direction is the travel direction of the coal mining machine; the first determination unit classifies and determines a first recovery state according to the second target image, and calculates the confidence of the first recovery state to obtain a target confidence, the first recovery state is the recovery state of each of the guard plates obtained by identifying the second target image; the generation unit generates the first recovery state in the first recovery state. When the target confidence is greater than the preset threshold, a first control instruction is generated according to the first recovery state of each of the above-mentioned guard plates, and the first control instruction is used to control the above-mentioned guard plates to be recovered; the first control unit controls each of the above-mentioned guard plates according to the first control instruction to obtain a second recovery state, and the second recovery state is the actual recovery state of each of the above-mentioned guard plates after the first control instruction takes effect; the alarm unit obtains a third recovery state, and when the third recovery state is inconsistent with the second recovery state, a target alarm message is issued, and the target alarm message is used to remind the staff that there is a failure in the recovery of the guard plates, and the third recovery state is the expected recovery state of each of the above-mentioned guard plates after the first control instruction takes effect. The present application estimates the state of the guard plates through images for control, and at the same time determines whether the adjustment is successful in combination with the telescopic state of the guard plates. In the case of failure of automatic control, an alarm is issued, and the speed is reduced to prevent the guard plates from colliding with the coal mining machine. This method solves the problem in the prior art that a sensor is added to the front end of the hydraulic support to measure the height of the guard plates to estimate whether there is a collision, and the measurement result has errors due to the inclination angle of the hydraulic support.

[0174] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A method for controlling the anti-collision of a hydraulic support guard plate, characterized in that: include: Acquire a first target image, where the first target image is a real-time image within a first preset range centered on the coal mining machine; Acquire a target direction, intercept the first target image according to the target direction and perform a de-jittering process to obtain a second target image, wherein the target direction is the traveling direction of the coal mining machine; Determine a first recycling state by classifying the second target image, and calculate the confidence of the first recycling state to obtain a target confidence, wherein the first recycling state is the recycling state of each of the side guard plates obtained by identifying the second target image; When the target confidence of the first recycling state is greater than a preset threshold, a first control instruction is generated according to the first recycling state of each of the side guards, and the first control instruction is used to control the side guards to be recycled; Control each of the side guard plates according to the first control instruction to obtain a second recovery state, wherein the second recovery state is an actual recovery state of each of the side guard plates after the first control instruction takes effect; Obtain a third recovery state. If the third recovery state is inconsistent with the second recovery state, issue a target alarm message, wherein the target alarm message is used to remind the staff that there is a failure in the recovery of the side guard plates. The third recovery state is the expected recovery state of each side guard plate after the first control instruction takes effect.

2. The method according to claim 1, characterized in that The first target image is intercepted according to the target direction and de-jittered to obtain a second target image, including: Taking the front drum of the coal mining machine as the starting position, intercepting the first target image corresponding to a preset distance along the target direction to obtain a third target image; The third target image is filtered by Gaussian filtering to remove high-frequency noise in the third target image to obtain a fourth target image, and the fourth target image is filtered by median filtering or average filtering to smooth the image to obtain the second target image.

3. The method according to claim 1, characterized in that Determining a first recycling state of each of the side guards in the second target image by classifying the second target image, the method further includes: Inputting the second target image into the first target model to obtain a fourth target image, wherein the first target model is used to segment the first target image to obtain a region corresponding to the support plate in the second target image; The fourth target image is input into the second target model to obtain the first recovery state, and the second target model is used to classify according to the fourth target image to determine the current posture of the guard plate.

4. The method according to claim 1, characterized in that: Calculating the confidence of the first recycling state to obtain a target confidence includes: The target confidence is obtained by calculating through a softmax function based on the first recycling state.

5. The method according to claim 1, characterized in that After issuing the target alarm information, the method further includes: When the recovery states of the first guard plate corresponding to the second recovery state and the third recovery state are inconsistent, the coal mining machine is controlled to stop moving, and the first guard plate is the guard plate that is less than a first preset distance from the front drum of the coal mining machine.

6. The method according to claim 1, characterized in that After the target alarm information is issued, including: When the recovery states of the second guard plate corresponding to the second recovery state are inconsistent with the third recovery state, the travel speed of the coal mining machine is controlled to be reduced to a first preset value, and the second guard plate is a guard plate whose distance from the front drum of the coal mining machine is less than the second preset distance and greater than or equal to the first preset distance.

7. The method according to claim 1, characterized in that After the target alarm information is issued, including: When the recovery states of the third guard plate corresponding to the second recovery state are inconsistent with the third recovery state, the travel speed of the coal mining machine is controlled to be reduced to a second preset value, and the third guard plate is the guard plate whose distance from the front roller of the coal mining machine is greater than or equal to the second preset distance.

8. An anti-collision control device for a hydraulic support guard plate, characterized in that: The device comprises: A first acquisition unit is used to acquire a first target image, where the first target image is a real-time image within a first preset range centered on the coal mining machine; a second acquisition unit, configured to acquire a target direction, intercept the first target image according to the target direction and perform a de-jittering process on the first target image to obtain a second target image, wherein the target direction is a moving direction of the coal mining machine; a first determining unit, configured to classify and determine a first recycling state according to the second target image, and calculate a confidence of the first recycling state to obtain a target confidence, wherein the first recycling state is a recycling state of each of the side guards obtained by identifying the second target image; a generating unit, configured to generate a first control instruction according to the first recycling state of each of the side guard plates when the target confidence of the first recycling state is greater than a preset threshold, wherein the first control instruction is used to control the side guard plates to be recycled; a first control unit, configured to control each of the side guards according to the first control instruction to obtain a second recovery state, wherein the second recovery state is an actual recovery state of each of the side guards after the first control instruction takes effect; The alarm unit is used to obtain a third recovery state. When the third recovery state is inconsistent with the second recovery state, a target alarm message is issued. The target alarm message is used to remind the staff that there is a failure in the recovery of the guard plates. The third recovery state is the expected recovery state of each guard plate after the first control instruction takes effect.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 7.

10. A guard plate control system, characterized in that: include: One or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs include methods for executing any one of claims 1 to 7.