A method and system for online monitoring of coal mine equipment operating status

Abstract

The present invention is applicable to the technical field of coal mine equipment status monitoring, and provides an online monitoring method for the operating status of coal mine equipment, which obtains vehicle information of a target coal mine truck and obtains a predetermined transportation route of the target coal mine truck based on the vehicle information; obtains real-time monitoring video on the predetermined transportation route, and uses the target coal mine truck traveling on the predetermined transportation route as a designated monitoring object; based on the real-time monitoring video, during the transportation process of the coal mine truck, when encountering a real-time road condition with a certain slope, the speed of the coal mine truck can be remotely limited so that the speed of the coal mine truck can be maintained at a safe speed and in a safe driving condition, thereby greatly reducing the probability of an accident occurring when the target coal mine truck is fully loaded on a sloped road within a mining area.

Description

Technical Field

[0001] The present invention belongs to the technical field of coal mine equipment status monitoring, and in particular relates to an online monitoring method and system for the operating status of coal mine equipment. Background Art

[0002] Coal mining equipment refers to various types of machinery and equipment used for coal mining, transportation, processing, and safety protection. Coal mining transportation equipment refers to the machinery used to transport materials such as coal, ore, and rock within a coal mine or between a coal mine and the outside world. Common transportation equipment includes belt conveyors, mining locomotives, and mining trucks. Mining trucks are primarily used for material transportation in open-pit mines, transporting mined coal or rock from the mining site to the material storage area or loading location, and are therefore used very frequently.

[0003] Mining areas generally have harsh natural environments and varied topography, which means that mining trucks will encounter a large number of uphill and downhill sections during transportation. Since mining trucks are loaded with heavy coal resources, if the driver does not pay attention to speed control during the uphill and downhill process, it is easy for the vehicle to lose control and cause a safety accident. However, in the existing technology, it is impossible to ensure that coal mine trucks are driving at a safe speed when entering a coal mine road with a certain slope. Summary of the Invention

[0004] The purpose of the present invention is to provide a method and system for online monitoring of the operating status of coal mine equipment, aiming to solve the problems raised in the background technology.

[0005] The present invention is implemented as follows: a method for online monitoring of the operating status of coal mine equipment, the method comprising:

[0006] Obtaining vehicle information of a target coal mine hauling truck, and obtaining a predetermined transportation route of the target coal mine hauling truck based on the vehicle information;

[0007] Acquire real-time monitoring video on the scheduled transportation route, and designate the target coal mine truck traveling on the scheduled transportation route as the designated monitoring object;

[0008] Analyze the real-time road conditions of the target coal mine truck based on real-time monitoring video to see if the road surface has a certain slope;

[0009] When it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope, vehicle speed control information is generated and sent to the target coal mine hauling truck vehicle system;

[0010] Determine whether the target coal mine haul truck responds to the vehicle speed control information.

[0011] As a further limitation of the technical solution of the embodiment of the present invention, the step of obtaining real-time monitoring video on the predetermined transportation route and specifying the target coal mine truck traveling on the predetermined transportation route as the designated monitoring object includes:

[0012] Obtain real-time surveillance video on the scheduled transportation route;

[0013] Obtaining identification information of the target coal mine hauling truck according to the vehicle information of the target coal mine hauling truck;

[0014] Identify the real-time monitoring video, and when the identification information of the target coal mine hauling truck is identified in the real-time monitoring video within a preset time, stop the identification and determine that the target coal mine hauling truck enters the predetermined transportation route;

[0015] The target coal mine trucks traveling on the predetermined transportation route are designated as monitoring objects.

[0016] As a further limitation of the technical solution of the embodiment of the present invention, in the process of identifying real-time monitoring video, if the identification information of the target coal mine hauling truck cannot be identified in the real-time monitoring video within a preset time, it is determined that the target coal mine hauling truck is not traveling according to the predetermined transportation route, and first illegal driving information is generated, and then the first illegal driving information is sent to the mine management personnel intelligent terminal.

[0017] As a further limitation of the technical solution of the embodiment of the present invention, the step of analyzing whether the target coal mine truck is in a real-time road condition where the road surface has a certain slope based on the real-time monitoring video includes:

[0018] Analyze the real-time monitoring video and determine whether there is a preset slope road image in the real-time monitoring video;

[0019] When it is determined that there is a preset slope road image in the real-time monitoring video, and when the target coal mine hauling truck image is close to the preset slope road image, it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope.

[0020] As a further limitation of the technical solution of the embodiment of the present invention, when it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope, the step of generating vehicle speed control information and sending it to the vehicle computer system of the target coal mine hauling truck includes:

[0021] When it is determined that the target coal mine truck is in a real-time road condition where the road surface has a certain slope, the slope speed comparison table stored in the database is retrieved;

[0022] Searching the slope speed comparison table for a safe speed corresponding to a preset slope road image close to the target coal mine truck image;

[0023] Generate vehicle speed control information based on the safe speed and send it to the target coal mine mining truck system.

[0024] As a further limitation of the technical solution of the embodiment of the present invention, the step of determining whether the target coal mine truck responds to the vehicle speed control information includes:

[0025] After the vehicle speed control information is sent to the target coal mine truck system, the speed of the target coal mine truck is monitored in real time;

[0026] Analyze real-time monitoring video and determine whether the target coal mine truck's speed exceeds the safe speed when the target coal mine truck's image overlaps with the preset slope road image;

[0027] When it is determined that the speed of the target coal mine truck is greater than the safe speed, it is determined that the target coal mine truck does not respond to the speed control information, and a second driving violation information is generated, and then the second driving violation information is sent to the mine manager's intelligent terminal.

[0028] An online monitoring system for the operation status of coal mine equipment, comprising: a vehicle information acquisition unit, a real-time monitoring video acquisition unit, a real-time road condition judgment unit, a vehicle speed control information generation unit, and a response judgment unit, wherein:

[0029] A vehicle information acquisition unit is used to acquire vehicle information of a target coal mine hauling truck and acquire a predetermined transport route of the target coal mine hauling truck based on the vehicle information;

[0030] A real-time monitoring video acquisition unit is used to acquire real-time monitoring video on the predetermined transportation route and to designate the target coal mine hauling truck traveling on the predetermined transportation route as a designated monitoring object;

[0031] The real-time road condition judgment unit is used to analyze whether the target coal mine truck is in a real-time road condition where the road surface has a certain slope based on the real-time monitoring video;

[0032] A vehicle speed control information generating unit is used to generate vehicle speed control information when it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope, and send the vehicle speed control information to the target coal mine hauling truck vehicle computer system;

[0033] The response judgment unit is used to judge whether the target coal mine transport truck responds to the vehicle speed control information.

[0034] As a further limitation of the technical solution of the embodiment of the present invention, the real-time monitoring video acquisition unit specifically includes:

[0035] A real-time monitoring video acquisition module is used to obtain real-time monitoring videos on the scheduled transportation route;

[0036] An identification information acquisition module is used to obtain identification information of a target coal mine hauling truck based on the vehicle information of the target coal mine hauling truck;

[0037] A real-time monitoring video recognition module is used to recognize the real-time monitoring video. When the identification information of the target coal mine hauling truck is recognized in the real-time monitoring video within a preset time, the recognition is stopped and the target coal mine hauling truck is determined to enter the predetermined transportation route;

[0038] The designated monitoring object determination module is used to set the target coal mine hauling truck traveling on the predetermined transportation route as the designated monitoring object.

[0039] As a further limitation of the technical solution of the embodiment of the present invention, the real-time road condition judgment unit specifically includes:

[0040] A real-time monitoring video analysis module is used to analyze the real-time monitoring video and determine whether there is a preset slope road image in the real-time monitoring video;

[0041] The real-time road condition determination module is used to determine that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope when it is determined that there is a preset slope road surface image in the real-time monitoring video and when the image of the target coal mine hauling truck is close to the preset slope road surface image.

[0042] As a further limitation of the technical solution of the embodiment of the present invention, the vehicle speed control information generating unit specifically includes:

[0043] The slope speed comparison table retrieval module is used to retrieve the slope speed comparison table stored in the database when it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope;

[0044] A safe speed determination module is used to search the slope speed comparison table for a safe speed corresponding to a preset slope road image close to the target coal mine truck image;

[0045] The vehicle speed control information generation module is used to generate vehicle speed control information according to the safe speed and send it to the target coal mine mining truck system.

[0046] Compared with the prior art, the present invention obtains vehicle information of a target coal mining truck and obtains a predetermined transportation route of the target coal mining truck based on the vehicle information; obtains real-time monitoring video on the predetermined transportation route, and designates the target coal mining truck traveling on the predetermined transportation route as a designated monitoring object; analyzes whether the target coal mining truck is in a real-time road condition where the road surface has a certain slope based on the real-time monitoring video; when it is determined that the target coal mining truck is in a real-time road condition where the road surface has a certain slope, generates vehicle speed control information and sends it to the vehicle computer system of the target coal mining truck; and determines whether the target coal mining truck responds to the vehicle speed control information. During the transportation process of the coal mining truck, when encountering a real-time road condition where the road surface has a certain slope, the speed of the coal mining truck can be remotely limited so that the speed of the coal mining truck can be maintained at a safe speed and in a safe driving condition, thereby greatly reducing the probability of accidents occurring when the target coal mining truck is fully loaded on a sloped road in a mining area. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A flowchart of a method provided by an embodiment of the present invention;

[0048] Figure 2 A flowchart of obtaining and identifying real-time surveillance video in the method provided in an embodiment of the present invention;

[0049] Figure 3 A flowchart of the real-time road condition of determining whether a target coal mine truck is on a road with a certain slope in the method provided by an embodiment of the present invention;

[0050] Figure 4 A flow chart of generating vehicle speed control information in the method provided in an embodiment of the present invention;

[0051] Figure 5 A flow chart of determining whether a target coal mine truck responds to vehicle speed control information in a method provided by an embodiment of the present invention;

[0052] Figure 6 An application architecture diagram of the system provided by an embodiment of the present invention;

[0053] Figure 7 A structural block diagram of a real-time monitoring video acquisition unit in a system provided by an embodiment of the present invention;

[0054] Figure 8 This is a structural block diagram of a real-time road condition judgment unit in a system provided by an embodiment of the present invention;

[0055] Figure 9 This is a structural block diagram of a vehicle speed control information generating unit in a system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0057] It is understood that the terms "first," "second," etc., used herein may be used to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script without departing from the scope of this application.

[0058] Figure 1 A flow chart of a method provided by an embodiment of the present invention is shown.

[0059] Specifically, a method for online monitoring of the operating status of coal mine equipment includes the following steps:

[0060] Step S100: obtaining vehicle information of a target coal mine hauling truck, and obtaining a predetermined transportation route of the target coal mine hauling truck according to the vehicle information.

[0061] In an embodiment of the present invention, a QR code or barcode image is affixed to the outer surface of the coal mining trucks used in the coal mining area, and a standing automatic code scanner is installed at the mining site of the coal mining area. The automatic code scanner is connected to the background processing cloud through a wireless network. When the target coal mining truck enters the mining site to load coal resources, the automatic code scanner at the mining site will automatically scan the QR code or barcode image on the target coal mining truck and obtain the vehicle information of the target coal mining truck. Then the automatic code scanner uploads the vehicle information of the target coal mining truck to the background processing cloud. After the background processing cloud receives the vehicle information of the target coal mining truck, it analyzes the vehicle information and obtains the scheduled transportation route of the target coal mining truck.

[0062] It is understandable that there are many dedicated transportation routes for coal mining trucks in the coal mining area, and several standing smart high-definition cameras are installed on these dedicated transportation routes. Each smart high-definition camera is connected to the background processing cloud via a wireless network.

[0063] Furthermore, the method for online monitoring of the operating status of coal mine equipment further comprises the following steps:

[0064] Step S200: acquiring real-time monitoring video on a predetermined transportation route, and taking a target coal mine truck traveling on the predetermined transportation route as a designated monitoring object.

[0065] Specifically, Figure 2 A flowchart of acquiring and identifying real-time surveillance video is shown.

[0066] The process of obtaining real-time monitoring video on a predetermined transport route and specifying a target coal mine truck traveling on the predetermined transport route as a designated monitoring object specifically includes the following steps:

[0067] Step S201, obtaining real-time monitoring video on the scheduled transportation route;

[0068] Step S202, obtaining identification information of the target coal mine hauling truck according to the vehicle information of the target coal mine hauling truck;

[0069] Step S203: identifying the real-time monitoring video. When identification information of the target coal mine hauling truck is identified in the real-time monitoring video within a preset time, the identification is stopped and it is determined that the target coal mine hauling truck has entered the predetermined transportation route.

[0070] Step S204: The target coal mining truck traveling on the predetermined transportation route is designated as a monitoring object.

[0071] In an embodiment of the present invention, after the backend processing cloud determines the scheduled transportation route of the target coal mining truck, the backend processing cloud retrieves the real-time monitoring video data of all intelligent high-definition cameras installed on the scheduled transportation route. The backend processing cloud then interprets the vehicle information of the target coal mining truck and obtains the identification information of the target coal mining truck. It can be understood that the identification information refers to a feature that can distinguish the target coal mining truck from other vehicles or objects. For example, the identification information can be the license plate of the coal mining truck. After the backend processing cloud obtains the vehicle information of the target coal mining truck, a real-time analysis operation can be started on the real-time monitoring video on the scheduled transportation route. The purpose of the real-time analysis operation is to identify whether the identification information of the target coal mining truck appears in the video. When the identification information of the target coal mining truck is identified within a preset time, it indicates that the target coal mining truck is traveling according to the scheduled transportation route. The backend processing cloud then uses the target coal mining truck traveling on the scheduled transportation route as the designated monitoring object. It can be understood that the backend processing cloud now tracks and monitors the target coal mining truck.

[0072] It is understandable that several smart high-definition cameras on the scheduled transportation route all have corresponding numbers. When the backend processing cloud analyzes the real-time monitoring videos recorded by the smart high-definition cameras, it does not analyze all the real-time monitoring videos uploaded by multiple smart high-definition cameras at the same time, but analyzes them one by one according to the numbers corresponding to each smart high-definition camera. For example, the first real-time monitoring video analyzed by the backend processing cloud is from the smart high-definition camera No. 1, and the position of the smart high-definition camera No. 1 set in the scheduled transportation route is closest to the coal mining area. Then, when the backend processing cloud recognizes the identification information of the target coal mine mining truck and tracks and monitors the target coal mine mining truck, if the target coal mine mining truck disappears from the real-time monitoring video recorded by the smart high-definition camera No. 1, the real-time monitoring video recorded by the smart high-definition camera No. 2 is immediately analyzed;

[0073] During the analysis process of the real-time monitoring videos recorded by the above-mentioned smart high-definition cameras one by one, if the identification information of the target coal mine truck is not identified in the real-time monitoring video recorded by the next numbered smart high-definition camera within a preset time after the target coal mine truck leaves the real-time monitoring video recorded by the previous numbered smart high-definition camera, it is determined that the target coal mine truck is not traveling according to the predetermined transportation route, and the first illegal driving information is generated, and then the first illegal driving information is sent to the mine management personnel smart terminal. The purpose of this step is to monitor online whether the coal mine trucks operating in the coal mine area are traveling according to the planned predetermined transportation route, so as to avoid some coal mine truck drivers from choosing other unknown routes to speed up transportation or to obtain higher performance, resulting in potential transportation risks, and the first illegal driving information should include the vehicle information and driver information of the target coal mine truck.

[0074] Furthermore, the method for online monitoring of the operating status of coal mine equipment further comprises the following steps:

[0075] Step S300: Analyze the real-time road condition of the target coal mine hauling truck based on the real-time monitoring video to see whether the road surface has a certain slope.

[0076] Specifically, Figure 3 A flow chart for determining whether a target coal mine truck is in a real-time road condition where the road surface has a certain slope is shown.

[0077] The following steps are specifically used to analyze whether the target coal mine truck is on a road with a certain slope based on the real-time monitoring video:

[0078] Step S301: Analyze the real-time monitoring video and determine whether there is a road surface image with a preset slope in the real-time monitoring video;

[0079] Step S302: When it is determined that there is a preset slope road image in the real-time monitoring video, and when the target coal mine hauling truck image is close to the preset slope road image, it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope.

[0080] In an embodiment of the present invention, a database is established in the background processing cloud, and a plurality of preset slope road surface images are stored in the database. The above-mentioned preset slope road surface image refers to an image of a road surface with a certain slope taken by an intelligent high-definition camera on a predetermined transportation route, and each preset slope road surface image corresponds to an intelligent high-definition camera with a designated number. After the target coal mine mining truck enters the real-time monitoring video recorded by a certain numbered intelligent high-definition camera, it should first be analyzed whether the intelligent high-definition camera with the designated number has a corresponding preset slope road surface image. After determining that there is, the background processing cloud tracks and monitors the image of the target coal mine mining truck in the real-time monitoring video, and when the image of the target coal mine mining truck is close to the preset slope road surface image, it is determined that the target coal mine mining truck is in the real-time road condition where the road surface has a certain slope.

[0081] Furthermore, the method for online monitoring of the operating status of coal mine equipment further comprises the following steps:

[0082] Step S400: When it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope, vehicle speed control information is generated and sent to the vehicle computer system of the target coal mine hauling truck.

[0083] Specifically, Figure 4 A flow chart for generating vehicle speed control information is shown.

[0084] When it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope, generating vehicle speed control information and sending it to the target coal mine hauling truck vehicle computer system specifically includes the following steps:

[0085] Step S401: when it is determined that the target coal mine truck is in a real-time road condition where the road surface has a certain slope, a slope speed comparison table stored in a database is retrieved;

[0086] Step S402, searching the slope speed comparison table for a safe speed corresponding to a preset slope road image close to the target coal mine truck image;

[0087] Step S403: generating vehicle speed control information according to the safe speed and sending the information to the target coal mine mining truck system.

[0088] In an embodiment of the present invention, a slope-speed comparison table is further stored in the database of the backend processing cloud. The slope-speed comparison table records all preset slope road surface images and the safe speed corresponding to each preset slope road surface image. That is, different preset slope road surface images will be set with different safe speeds according to the slope conditions of the corresponding actual road surface. It can be understood that the more severe the slope conditions of the actual road surface, the lower the corresponding safe speed. The above-mentioned safe speed can be set manually by the mine safety management personnel according to the slope conditions of the actual road surface after arriving at the actual road surface contained in the preset slope road surface image.

[0089] Searching the slope speed comparison table for a safe speed corresponding to a preset slope road image close to the target coal mine hauling truck image in the real-time monitoring video, and using the safe speed as the maximum speed that the target coal mine hauling truck can travel in the real-time road conditions corresponding to the preset slope road image;

[0090] It is understandable that mine safety managers should regularly count and inspect the sloped roads on the mine truck transportation routes, reset the safe speed of mine trucks going downhill based on the latest slope road conditions, and also update the preset slope road images in the database.

[0091] Furthermore, the method for online monitoring of the operating status of coal mine equipment further comprises the following steps:

[0092] Step S500: determining whether the target coal mine transport truck responds to the vehicle speed control information.

[0093] Specifically, Figure 5 A flow chart for determining whether a target coal mine haul truck responds to vehicle speed control information is shown.

[0094] The process of determining whether the target coal mine truck responds to the speed control information specifically includes the following steps:

[0095] Step S501: After the vehicle speed control information is sent to the target coal mine hauling truck system, the speed of the target coal mine hauling truck is monitored in real time;

[0096] Step S502: analyzing the real-time monitoring video, and determining whether the speed of the target coal mine truck is greater than a safe speed when the image of the target coal mine truck overlaps with the image of the road surface with a preset slope;

[0097] Step S503: When it is determined that the speed of the target coal mine hauling truck is greater than the safe speed, it is determined that the target coal mine hauling truck does not respond to the speed control information, and a second driving violation information is generated, and then the second driving violation information is sent to the mine manager's intelligent terminal.

[0098] In an embodiment of the present invention, after the vehicle speed control information is sent to the target coal mine mining truck on-board system, the real-time vehicle speed of the target coal mine mining truck is obtained according to the target coal mine mining truck on-board system, and it is monitored in real time. Then, the background processing cloud continues to analyze the real-time monitoring video containing the target coal mine mining truck image, and in the process of the target coal mine mining truck image overlapping with the preset slope road image, it is judged whether the speed of the target coal mine mining truck in the process is greater than the safe speed. If so, it is determined that the target coal mine mining truck does not respond to the vehicle speed control information, and a second illegal driving information is generated. Then, the second illegal driving information is sent to the mine manager's smart terminal. The above-mentioned second illegal driving information should include the vehicle information of the target coal mine mining truck and the driver information of the target coal mine mining truck, so that when the driver of the target coal mine mining truck has a driving situation with safety risks, the mine safety manager can be informed in time, so that the mine safety manager can conduct safety persuasion operations on the driver.

[0099] It is understandable that the speed of the target coal mining truck is only analyzed when the target coal mining truck image coincides with the preset slope road image (the target coal mining truck enters the slope road). In this way, when the target coal mining truck is traveling on a normal road, its speed is not restricted, and thus the transportation efficiency of the target coal mining truck is not affected.

[0100] It can be understood that after the target coal mine truck system receives the speed control information including the safe speed, the target coal mine truck system can forcibly limit the speed of the target coal mine truck so that the speed of the target coal mine truck can be kept below the safe speed.

[0101] Through the above technical solution, during the transportation process of coal mine hauling trucks, when encountering real-time road conditions with a certain slope, the speed of the coal mine hauling trucks can be remotely limited so that the speed of the coal mine hauling trucks can be maintained at a safe speed and in a safe driving condition, thereby greatly reducing the probability of accidents occurring when the target coal mine hauling trucks are fully loaded on the sloped road surface within the mining area.

[0102] Further, Figure 6 The application architecture diagram of the system provided by the embodiment of the present invention is shown.

[0103] In another preferred embodiment of the present invention, a coal mine equipment operating status online monitoring system includes:

[0104] The vehicle information acquisition unit 100 is used to acquire vehicle information of a target coal mine hauling truck, and acquire a predetermined transportation route of the target coal mine hauling truck according to the vehicle information.

[0105] In an embodiment of the present invention, a QR code or barcode image is affixed to the outer surface of the coal mining trucks used in the coal mining area, and a standing automatic code scanner is installed at the mining site of the coal mining area. The automatic code scanner is connected to the background processing cloud through a wireless network. When the target coal mining truck enters the mining site to load coal resources, the automatic code scanner at the mining site will automatically scan the QR code or barcode image on the target coal mining truck and obtain the vehicle information of the target coal mining truck. The automatic code scanner then uploads the vehicle information of the target coal mining truck to the background processing cloud. After the vehicle information acquisition unit 100 receives the vehicle information of the target coal mining truck, it parses the vehicle information and obtains the scheduled transportation route of the target coal mining truck.

[0106] It is understandable that there are many dedicated transportation routes for coal mining trucks in the coal mining area, and several standing smart high-definition cameras are installed on these dedicated transportation routes. Each smart high-definition camera is connected to the background processing cloud via a wireless network.

[0107] Furthermore, the coal mine equipment operating status online monitoring system also includes:

[0108] The real-time monitoring video acquisition unit 200 is used to acquire the real-time monitoring video on the predetermined transportation route, and take the target coal mine hauling truck traveling on the predetermined transportation route as the designated monitoring object.

[0109] Specifically, Figure 7 The structure block diagram of the real-time monitoring video acquisition unit 200 in the system provided by the embodiment of the present invention is shown.

[0110] In a preferred embodiment of the present invention, the real-time monitoring video acquisition unit 200 specifically includes:

[0111] A real-time monitoring video acquisition module 201 is used to acquire real-time monitoring video on a predetermined transportation route;

[0112] The identification information acquisition module 202 is used to obtain the identification information of the target coal mine hauling truck according to the vehicle information of the target coal mine hauling truck;

[0113] The real-time monitoring video recognition module 203 is used to recognize the real-time monitoring video. When the identification information of the target coal mine hauling truck is recognized in the real-time monitoring video within a preset time, the recognition is stopped and the target coal mine hauling truck is determined to have entered the predetermined transportation route.

[0114] The designated monitoring object determination module 204 is configured to set the target coal mining truck traveling on the predetermined transportation route as the designated monitoring object.

[0115] In an embodiment of the present invention, after the scheduled transportation route of the target coal mine truck is determined in the background processing cloud, the real-time monitoring video acquisition module 201 retrieves the real-time monitoring video data of all intelligent high-definition cameras installed on the scheduled transportation route, and then the identification information acquisition module 202 interprets the vehicle information of the target coal mine truck and obtains the identification information of the target coal mine truck from it. It can be understood that the identification information refers to the feature that can distinguish the target coal mine truck from other vehicles or objects. For example, the identification information can be the license plate of the coal mine truck. After obtaining the vehicle information of the transport truck, the real-time monitoring video recognition module 203 can start real-time analysis of the real-time monitoring video on the scheduled transport route. The purpose of the real-time analysis operation is to identify whether the identification information of the target coal mine transport truck appears in the video. When the identification information of the target coal mine transport truck is identified within the preset time, it means that the target coal mine transport truck is traveling according to the scheduled transport route. Then, the designated monitoring object determination module 204 uses the target coal mine transport truck traveling on the scheduled transport route as the designated monitoring object. It can be understood that at this time, the background processing cloud tracks and monitors the target coal mine transport truck;

[0116] It can be understood that several smart high-definition cameras on the scheduled transportation route all have corresponding numbers. When analyzing the real-time monitoring videos recorded by the smart high-definition cameras, the real-time monitoring video recognition module 203 does not analyze all the real-time monitoring videos uploaded by multiple smart high-definition cameras at the same time, but analyzes them one by one according to the numbers corresponding to each smart high-definition camera. For example, the real-time monitoring video analyzed first by the real-time monitoring video recognition module 203 is from the smart high-definition camera numbered 1, and the position of the smart high-definition camera numbered 1 set in the scheduled transportation route is closest to the coal mining area. Then, when the backend processing cloud recognizes the identification information of the target coal mine mining truck and tracks and monitors the target coal mine mining truck, if the target coal mine mining truck disappears from the real-time monitoring video recorded by the smart high-definition camera numbered 1, the real-time monitoring video recorded by the smart high-definition camera numbered 2 is immediately analyzed;

[0117] During the analysis process of the real-time monitoring videos recorded by the above-mentioned smart high-definition cameras one by one, if the identification information of the target coal mine truck is not identified in the real-time monitoring video recorded by the next numbered smart high-definition camera within a preset time after the target coal mine truck leaves the real-time monitoring video recorded by the previous numbered smart high-definition camera, it is determined that the target coal mine truck is not traveling according to the predetermined transportation route, and the first illegal driving information is generated, and then the first illegal driving information is sent to the mine management personnel smart terminal. The purpose of this step is to monitor online whether the coal mine trucks operating in the coal mine area are traveling according to the planned predetermined transportation route, so as to avoid some coal mine truck drivers from choosing other unknown routes to speed up transportation or to obtain higher performance, resulting in potential transportation risks, and the first illegal driving information should include the vehicle information and driver information of the target coal mine truck.

[0118] Furthermore, the coal mine equipment operating status online monitoring system also includes:

[0119] The real-time road condition judgment unit 300 is used to analyze whether the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope based on the real-time monitoring video.

[0120] Specifically, Figure 8 FIG. 3 is a structural block diagram of a real-time road condition judgment unit 300 in a system provided by an embodiment of the present invention.

[0121] In a preferred embodiment of the present invention, the real-time road condition judgment unit 300 specifically includes:

[0122] The real-time monitoring video analysis module 301 is used to analyze the real-time monitoring video and determine whether there is a preset slope road image in the real-time monitoring video;

[0123] The real-time road condition determination module 302 is used to determine that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope when it is determined that there is a preset slope road surface image in the real-time monitoring video and when the target coal mine hauling truck image is close to the preset slope road surface image.

[0124] In an embodiment of the present invention, a database is established in the background processing cloud, and a plurality of preset slope road surface images are stored in the database. The above-mentioned preset slope road surface image refers to an image of a road surface with a certain slope taken by an intelligent high-definition camera on a predetermined transportation route, and each preset slope road surface image corresponds to an intelligent high-definition camera with a designated number. After the target coal mine mining truck enters the real-time monitoring video recorded by a certain numbered intelligent high-definition camera, the real-time monitoring video analysis module 301 should first analyze whether the intelligent high-definition camera with the number has a corresponding preset slope road surface image. After determining that there is, the background processing cloud tracks and monitors the image of the target coal mine mining truck in the real-time monitoring video, and when the image of the target coal mine mining truck is close to the preset slope road surface image, the real-time road condition determination module 302 determines that the target coal mine mining truck is in a real-time road condition where the road surface has a certain slope.

[0125] Furthermore, the coal mine equipment operating status online monitoring system also includes:

[0126] The vehicle speed control information generating unit 400 is used to generate vehicle speed control information when it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope, and send the vehicle speed control information to the target coal mine hauling truck vehicle computer system;

[0127] The response determination unit 500 is used to determine whether the target coal mine transport truck responds to the vehicle speed control information.

[0128] Specifically, Figure 9 FIG. 4 is a structural block diagram of the vehicle speed control information generating unit 400 in the system provided by an embodiment of the present invention.

[0129] In a preferred embodiment of the present invention, the vehicle speed control information generating unit 400 specifically includes:

[0130] The slope speed comparison table retrieval module 401 is used to retrieve the slope speed comparison table stored in the database when it is determined that the target coal mine hauling truck is in a real-time road condition with a certain slope;

[0131] The safe speed determination module 402 is configured to search the slope speed comparison table for a safe speed corresponding to a road surface image with a preset slope close to the target coal mine truck image;

[0132] The vehicle speed control information generating module 403 is used to generate vehicle speed control information according to the safe speed and send it to the target coal mine mining truck system.

[0133] In an embodiment of the present invention, a slope-speed comparison table is further stored in the database of the backend processing cloud. The slope-speed comparison table records all preset slope road surface images and the safe speed corresponding to each preset slope road surface image. That is, different preset slope road surface images will be set with different safe speeds according to the slope conditions of the corresponding actual road surface. It can be understood that the more severe the slope conditions of the actual road surface, the lower the corresponding safe speed. The above-mentioned safe speed can be set manually by the mine safety management personnel according to the slope conditions of the actual road surface after arriving at the actual road surface contained in the preset slope road surface image.

[0134] Searching the slope speed comparison table for a safe speed corresponding to a preset slope road image close to the target coal mine hauling truck image in the real-time monitoring video, and using the safe speed as the maximum speed that the target coal mine hauling truck can travel in the real-time road conditions corresponding to the preset slope road image;

[0135] It is understandable that mine safety management personnel should regularly count and inspect the road surfaces with a certain slope on the mine truck transportation route, and reset the safe speed of the mine truck downhill according to the latest slope road conditions, and can also update the preset slope road images in the database;

[0136] After the speed control information is sent to the target coal mine mining truck on-board system, the real-time speed of the target coal mine mining truck is obtained according to the target coal mine mining truck on-board system and monitored in real time. Then, the response judgment unit 500 continues to analyze the real-time monitoring video containing the target coal mine mining truck image, and in the process of the target coal mine mining truck image overlapping with the preset slope road image, it is judged whether the speed of the target coal mine mining truck in the process is greater than the safe speed. If so, it is determined that the target coal mine mining truck does not respond to the speed control information, and a second illegal driving information is generated. Then, the second illegal driving information is sent to the mine management personnel intelligent terminal. The above-mentioned second illegal driving information should include the vehicle information of the target coal mine mining truck and the driver information of the target coal mine mining truck, so that when the driver of the target coal mine mining truck has a driving situation with safety risks, the mine safety management personnel can be informed in time, so that the mine safety management personnel can conduct safety persuasion operations on the driver.

[0137] It is understandable that the speed of the target coal mining truck is only analyzed when the target coal mining truck image coincides with the preset slope road image (the target coal mining truck enters the slope road). In this way, when the target coal mining truck is traveling on a normal road, its speed is not restricted, and thus the transportation efficiency of the target coal mining truck is not affected.

[0138] It can be understood that after the target coal mine truck system receives the speed control information including the safe speed, the target coal mine truck system can forcibly limit the speed of the target coal mine truck so that the speed of the target coal mine truck can be kept below the safe speed.

[0139] It should be understood that, although the various steps in the flow chart of each embodiment of the present invention are shown in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless otherwise specified herein, the execution of these steps is not strictly limited in order, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0140] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing the relevant hardware through a computer program. The program can be stored in a non-volatile computer-readable storage medium. When executed, the program can include the processes of the above-described method embodiments. Any reference to memory, storage, database, or other media used in the various embodiments provided herein may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct RAMbus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM).

[0141] The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above-mentioned embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0142] The above-described embodiments merely illustrate several implementations of the present invention, and while their descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art would be able to make numerous variations and improvements without departing from the spirit of the present invention, all of which fall within the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be determined by the appended claims.

[0143] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for online monitoring of the operating status of coal mine equipment, characterized in that: The method comprises: Obtaining vehicle information of a target coal mine hauling truck, and obtaining a predetermined transportation route of the target coal mine hauling truck based on the vehicle information; Acquire real-time monitoring video on the scheduled transportation route, and designate the target coal mine truck traveling on the scheduled transportation route as the designated monitoring object; The steps of obtaining real-time monitoring video on the predetermined transportation route and taking the target coal mine truck traveling on the predetermined transportation route as the designated monitoring object include: Obtain real-time surveillance video on the scheduled transportation route; Obtaining identification information of the target coal mine hauling truck according to the vehicle information of the target coal mine hauling truck; Identify the real-time monitoring video, and when the identification information of the target coal mine hauling truck is identified in the real-time monitoring video within a preset time, stop the identification and determine that the target coal mine hauling truck enters the predetermined transportation route; The target coal mine trucks traveling on the predetermined transportation route are designated as monitoring objects; Analyze the real-time road conditions of the target coal mine truck based on real-time monitoring video to see if the road surface has a certain slope; When it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope, vehicle speed control information is generated and sent to the target coal mine hauling truck vehicle system; Determine whether the target coal mine truck responds to the speed control information; The step of analyzing whether the target coal mine truck is in a real-time road condition with a certain slope based on the real-time monitoring video includes: Analyze the real-time monitoring video and determine whether there is a preset slope road image in the real-time monitoring video; When it is determined that there is a preset slope road image in the real-time monitoring video, and when the target coal mine hauling truck image is close to the preset slope road image, it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope; The step of generating vehicle speed control information and sending it to the vehicle computer system of the target coal mine hauling truck when determining that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope includes: When it is determined that the target coal mine truck is in a real-time road condition where the road surface has a certain slope, the slope speed comparison table stored in the database is retrieved; Searching the slope speed comparison table for a safe speed corresponding to a preset slope road image close to the target coal mine truck image; Generate vehicle speed control information based on the safe speed and send it to the target coal mine truck system; The step of determining whether the target coal mine truck responds to the vehicle speed control information includes: After the vehicle speed control information is sent to the target coal mine truck system, the speed of the target coal mine truck is monitored in real time; Analyze real-time monitoring video and determine whether the target coal mine truck's speed exceeds the safe speed when the target coal mine truck's image overlaps with the preset slope road image; When it is determined that the speed of the target coal mine truck is greater than the safe speed, it is determined that the target coal mine truck does not respond to the speed control information, and a second driving violation information is generated, and then the second driving violation information is sent to the mine manager's intelligent terminal.

2. The method for online monitoring of the operating status of coal mine equipment according to claim 1, characterized in that: During the process of identifying real-time monitoring videos, if the identification information of the target coal mine truck cannot be identified in the real-time monitoring video within a preset time, it is determined that the target coal mine truck is not traveling according to the predetermined transportation route, and the first illegal driving information is generated, and then the first illegal driving information is sent to the mine manager's intelligent terminal.

3. An online monitoring system for the operation status of coal mine equipment, characterized in that: The system includes: a vehicle information acquisition unit, a real-time monitoring video acquisition unit, a real-time road condition judgment unit, a vehicle speed control information generation unit, and a response judgment unit, wherein: A vehicle information acquisition unit is used to acquire vehicle information of a target coal mine hauling truck and acquire a predetermined transport route of the target coal mine hauling truck based on the vehicle information; A real-time monitoring video acquisition unit is used to acquire real-time monitoring video on the predetermined transportation route and to designate the target coal mine hauling truck traveling on the predetermined transportation route as a designated monitoring object; The real-time monitoring video acquisition unit specifically includes: A real-time monitoring video acquisition module is used to obtain real-time monitoring videos on the scheduled transportation route; An identification information acquisition module is used to obtain identification information of a target coal mine hauling truck based on the vehicle information of the target coal mine hauling truck; A real-time monitoring video recognition module is used to recognize the real-time monitoring video. When the identification information of the target coal mine hauling truck is recognized in the real-time monitoring video within a preset time, the recognition is stopped and the target coal mine hauling truck is determined to enter the predetermined transportation route; A designated monitoring object determination module is used to designate a target coal mine truck traveling on a predetermined transportation route as a designated monitoring object; The real-time road condition judgment unit is used to analyze whether the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope based on the real-time monitoring video; A vehicle speed control information generating unit is used to generate vehicle speed control information when it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope, and send the vehicle speed control information to the target coal mine hauling truck vehicle computer system; a response judgment unit, used to judge whether the target coal mine transport truck responds to the vehicle speed control information; The real-time road condition judgment unit specifically includes: A real-time monitoring video analysis module is used to analyze the real-time monitoring video and determine whether there is a preset slope road image in the real-time monitoring video; The module for determining the real-time road condition encountered is used to determine that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope when it is determined that there is a preset slope road surface image in the real-time monitoring video and when the image of the target coal mine hauling truck is close to the preset slope road surface image; The vehicle speed control information generating unit specifically includes: The slope speed comparison table retrieval module is used to retrieve the slope speed comparison table stored in the database when it is determined that the target coal mine hauling truck is in a real-time road condition where the road surface has a certain slope; A safe speed determination module is used to search the slope speed comparison table for a safe speed corresponding to a preset slope road image close to the target coal mine truck image; The vehicle speed control information generation module is used to generate vehicle speed control information according to the safe speed and send it to the target coal mine mining truck system.

Images