Method and device for performing safety management on mining area through panoramic compound eye array imaging

Abstract

The invention discloses a method and device for performing safety management on a mining area through panoramic compound eye array imaging, and the method comprises the steps: responding to a starting instruction of mining area slope safety management in an interactive interface, and displaying the panoramic compound eye array imaging in the interactive interface, the panoramic compound eye array imaging comprising radar information and GNSS information of a plurality of point locations; performing region division on the panoramic compound eye array image through the radar information and the GNSS information to obtain a plurality of slope protection regions, and configuring functional components corresponding to the slope protection regions in the interactive interface; displaying target slope monitoring information in response to a click operation on the functional component or the point location of the panoramic compound eye array imaging; and judging whether an early warning signal exists in the target slope monitoring information or not, and if yes, generating an emergency plan based on the early warning signal so as to realize safety management of the mining area slope. The mining area is monitored through panoramic compound eye array imaging, and efficient and safe management of the mining area is ensured.

Description

Technical Field

[0001] The present invention relates to the field of computer vision technology, and in particular, to a method and device for safety management of a mining area through panoramic compound eye array imaging. Background Art

[0002] With the rapid development of China's social economy, the state has paid more and more attention to production safety and environmental protection, and has successively issued a series of laws and regulations such as the "Opinions on Further Strengthening the Work of Mine Safety Production", and implemented major measures such as building green mines and smart mines.

[0003] At present, there are basically no video monitoring devices deployed in the excavation working face of the open-pit coal mine production area, or the video monitoring is fragmented. The monitoring effect has great limitations and low pixel density. Managers cannot effectively control the production operation status of the excavation site in the main production operation area, and are even less able to conduct real-time monitoring of the details of the concerned points. Due to the lack of video coverage in the main production area of the excavation site, safety incidents in the area cannot be traced back through video to understand the ins and outs of the concerned events, which brings great inconvenience to the all-round backtracking, truth query and accountability of the concerned events, brings many problems to production scheduling and safety management, and also poses huge safety hazards.

[0004] In view of the technical problem that the fragmentation of monitoring devices in the open-pit coal mine production area in the prior art leads to the inability to achieve effective safety management of the mining area, there is currently no effective solution. Summary of the Invention

[0005] The purpose of the present invention is to provide a method and device for safety management of a mining area through panoramic compound eye array imaging, which can solve the technical problem that the fragmentation of monitoring devices in the open-pit coal mine production area leads to the inability to achieve effective safety management of the mining area.

[0006] One aspect of the present invention provides a method for safety management of a mining area through panoramic compound eye array imaging. The method includes: in response to a start instruction for slope safety management in an interactive interface, displaying panoramic compound eye array imaging in the interactive interface, where the panoramic compound eye array imaging includes radar information and GNSS information of multiple points; dividing the panoramic compound eye array imaging into multiple slope protection areas through the radar information and the GNSS information, and configuring function components corresponding to the slope protection areas in the interactive interface; in response to a click operation on the function component or a point of the panoramic compound eye array imaging, displaying target slope monitoring information; and determining whether there is a warning signal in the target slope monitoring information. If so, generating an emergency plan based on the warning signal to achieve safety management of the slopes in the mining area.

[0007] Optionally, partitioning the panoramic compound eye array imaging based on the radar information and the GNSS information to obtain multiple slope protection regions includes: calculating the distances between all points, and arbitrarily extracting one point as the center of the initial region; traversing other points, determining the points whose distances from the central point are less than a first preset threshold, partitioning them into the initial region, and updating the coordinate mean of the points in the initial region as the central point of the initial region; during the process of region expansion, determining whether each newly added point in the region will cause the density of the region to exceed a second preset threshold; if it exceeds, removing the newly added point from the region, and updating the coordinate mean of the points in the region as the central point of the region; arbitrarily extracting one point from the remaining unpartitioned points as the center of the next region, determining the points among the remaining points whose distances from the central point are less than the first preset threshold, and partitioning them into the current region; repeating the previous step until all points are partitioned into corresponding regions to obtain multiple slope protection regions.

[0008] Optionally, responding to a click operation on the functional component to display target slope monitoring information includes: responding to a click operation on the functional component, marking the slope protection region of the functional component in the panoramic compound eye array imaging; displaying the target slope monitoring information of the marked slope protection region in a scrolling floating window, where the target slope monitoring information includes slope radar scanning information and equipment health information, GNSS data information and equipment health information, personnel and vehicle information.

[0009] Optionally, responding to a click operation on a point in the panoramic compound eye array imaging to display target slope monitoring information includes: responding to a click operation on the radar scanning plane or GNSS data of any point in the panoramic compound eye array imaging, and displaying a real-time data floating window of the clicked point; calculating the optimal angle monitoring video of the point by calculating the compound eye data in the real-time data floating window, and using the optimal angle monitoring video of the point as the target slope monitoring information.

[0010] Optionally, generating an emergency plan based on the warning signal includes: when there is a warning signal in the target slope monitoring information, marking the point where the warning signal belongs in the panoramic compound eye array imaging as an alarm point; calling the optimal video monitoring image of this point to display the personnel and vehicle information of the alarm point, and determining the slope alarm level through the displayed information; generating a danger warning area of the alarm point in the panoramic compound eye array imaging based on the slope alarm level; continuously monitoring whether there are any personnel or vehicles straying into the danger warning area of the alarm point, and if so, performing positioning identification and video tracking on the straying personnel or vehicles, and notifying the straying personnel or vehicles to evacuate.

[0011] Optionally, determining whether there is a warning signal in the target slope monitoring information includes: comparing the slope position information obtained by monitoring at the current moment with the slope position information obtained by monitoring at a historical moment to determine whether there is a lateral displacement or a longitudinal displacement of the slope monitored at the current moment. If so, generating a slope displacement warning signal; determining whether the slope precipitation information obtained by monitoring at the current moment exceeds a preset water level value. If so, generating a slope precipitation warning signal; determining whether there is a blasting point, a blasting area, a blasting sensor or a blasting charge in the target slope monitoring information. If so, generating a slope blasting warning signal.

[0012] Optionally, after displaying the panoramic compound eye array imaging formed based on compound eye imaging on the interaction interface, the method further includes: adding type labels to the scene data of the panoramic compound eye array imaging respectively, where the type labels include fixed-point labels, vector labels and area labels; establishing an association relationship between the type labels and the layers of the panoramic compound eye array imaging to realize controlling the display of the corresponding type labels of the panoramic compound eye array imaging by selecting the layers.

[0013] Another aspect of the present invention provides a device for safety management of a mining area through panoramic compound eye array imaging. The device includes: a first display module, configured to respond to a start instruction for safety management of a slope in a mining area in an interaction interface and display panoramic compound eye array imaging on the interaction interface, where the panoramic compound eye array imaging includes radar information and GNSS information of multiple points; a division module, configured to divide the panoramic compound eye array imaging into multiple slope protection areas through the radar information and the GNSS information, and configure function components corresponding to the slope protection areas on the interaction interface; a second display module, configured to display target slope monitoring information in response to a click operation on the function component or a point of the panoramic compound eye array imaging; a warning module, configured to determine whether there is a warning signal in the target slope monitoring information. If so, generating an emergency plan based on the warning signal to realize safety management of slopes in a mining area.

[0014] Another aspect of the present invention provides a computer device, which includes: a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that when the processor executes the computer program, it implements the method for safety management of a mining area through panoramic compound eye array imaging in any of the above embodiments.

[0015] Another aspect of the present invention provides a computer storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the method for safety management of a mining area through panoramic compound eye array imaging in any of the above embodiments. Further, the computer-readable storage medium may mainly include a program storage area and a data storage area. Among them, the program storage area may store an operating system, application programs required for at least one function, etc.; the data storage area may store data created according to the use of blockchain nodes, etc.

[0016] The present invention uses panoramic compound eye array imaging as the basis for monitoring data in the production site of a mining area, ensuring the continuity and integrity of the production data in the mining area; then, the panoramic compound eye array imaging is divided into regions to achieve targeted processing of sub-region data, and timely responses can be given to the sub-region data that generates warning signals, ensuring the efficient and safe management of the mining area. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] By reading the following detailed description of the preferred embodiments, various other advantages and benefits will become clear to those of ordinary skill in the art. The drawings are only for the purpose of showing the preferred embodiments and are not considered to be a limitation of the present invention. Moreover, throughout the drawings, the same reference numerals are used to represent the same components. In the drawings: Figure 1 An optional flowchart of the method for safety management of a mining area through panoramic compound eye array imaging provided in Embodiment 1 of the present invention is shown; Figure 2 A structural block diagram of the device for safety management of a mining area through panoramic compound eye array imaging provided in Embodiment 2 of the present invention is shown; and Figure 3 A block diagram of a computer device suitable for implementing the method for safety management of a mining area through panoramic compound eye array imaging provided in Embodiment 3 of the present invention is shown. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0018] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0019] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0020] Example 1 This embodiment provides a method for safety management of mining areas through panoramic compound eye array imaging. Figure 1 The flowchart of the method for safety management of mining areas by panoramic compound eye array imaging is shown as follows: Figure 1 As shown, the method for safety management of a mining area through panoramic compound eye array imaging may include steps S101 to S104, wherein: Step S101, in response to a start instruction for mining slope safety management in an interactive interface, displaying a panoramic compound eye array image on the interactive interface, wherein the panoramic compound eye array image includes radar information and GNSS information of multiple points; GNSS (Global Navigation Satellite System) is a space-based radio navigation and positioning system that can provide users with all-weather three-dimensional coordinates, speed, and time information at any location on the Earth's surface or in near-Earth space.

[0021] Panoramic compound eye array imaging utilizes compound eye imaging technology to monitor production data from different areas of the open-pit mine in real time, using information about the length, width, and elevation of the mining area. The system then fuses the data from these areas at the pixel level to generate a panoramic compound eye video image with a resolution of 100 million pixels. Specifically, the monitoring data for each area is obtained by integrating radar and GNSS information from pre-set locations.

[0022] Panoramic compound eye array imaging features ultra-large range, ultra-high resolution, and zero distortion, with properties such as integrity and continuity. Panoramic video surveillance images provide managers with a panoramic view of the entire production site's video surveillance area, enabling a bird's-eye view of the entire production site. This allows managers to gain a macro-level overview of open-pit mine production operations, monitor on-site operations in real time, identify potential problems promptly, and quickly resolve them. This helps ensure production safety and reduce accident risks.

[0023] Step S102: Divide the panoramic compound eye array imaging area based on the radar information and the GNSS information to obtain multiple slope protection areas, and configure function components corresponding to the slope protection areas on the interaction interface; Dividing the production site of the entire open-pit mine into areas and configuring corresponding function components for each sub-area can achieve the effect of displaying a local area by triggering the function component, strengthening the systematic management of the monitoring data of the production site of the entire mining area by the management personnel.

[0024] The function components can be area name controls arranged in sequence on one side of the panoramic compound eye array imaging. For example, Mining Area 1, Mining Area 2, Waste Dumping Area 1, Waste Dumping Area 2. The function components can be hidden, and the specific display form is determined according to user needs.

[0025] Step S103: In response to a click operation on the function component or a point position of the panoramic compound eye array imaging, display the target slope monitoring information; In the divided panoramic video image, a close-up video image of any local area can be presented in the form of a floating window, enabling the management personnel to not only have a macroscopic view of the whole but also have a microscopic insight into the local area, achieving a perfect monitoring experience of both panoramic and detailed views, and realizing the functions of on-site command and dispatch and emergency rescue command.

[0026] Step S104: Determine whether there is a warning signal in the target slope monitoring information. If so, generate an emergency plan based on the warning signal to achieve the safety management of the slopes in the mining area.

[0027] By determining whether there is a warning signal in the local area, it avoids the situation of low data processing efficiency caused by traversing all point position data. This method can ensure a quick view of the production area where the warning signal occurs and make a timely response plan, realizing the efficient and safe management of the mining area.

[0028] In this embodiment, the panoramic compound eye array imaging is used as the basis for the monitoring data of the production site of the mining area, ensuring the continuity and integrity of the production data of the mining area. Then, the area of the panoramic compound eye array imaging is divided to achieve targeted processing of the sub-area data, and timely responses can be given to the sub-area data with warning signals, ensuring the efficient and safe management of the mining area.

[0029] Preferably, step S102 may include steps S1021 to S1025, where: Step S1021: Calculate the distances between all point positions, and arbitrarily extract one point position as the center of the initial area; Step S1022: Traverse other points, determine the points whose distance from the central point is less than the first preset threshold, divide them into the initial area, and update the coordinate mean of the points in the initial area to the central point of the initial area; Step S1023: During the area expansion process, determine whether each newly added point in the area will cause the density of the area to exceed the second preset threshold; if it exceeds, remove the newly added point from the area, and update the coordinate mean of the points in the area to the central point of the area; Step S1024: Arbitrarily extract a point from the remaining unassigned points as the center of the next area, determine the points among the remaining points whose distance from the central point is less than the first preset threshold, and divide them into the current area; Step S1025: Repeat the previous step until all points are divided into corresponding areas, obtaining multiple slope protection areas.

[0030] Specifically, before calculating the distances between all points, if the coordinate ranges of different points vary greatly, standardization processing can be performed first to make all coordinate values at the same order of magnitude. Then calculate the distances between each pair of points, and randomly select a point from all points as the center of the initial area. For the initial center, traverse other points. If the distance is less than the first preset threshold, add it to the current area, and update the center of the current area to the geometric center of all points in the area. Then, select a point from the remaining unassigned data points as the initial center of the next area, and use the same method as the initial area division to expand the current area. During the expansion process, check whether each newly added point will cause the area density to exceed the second preset threshold. If so, stop expanding this point and its subsequent points, and remove them from the candidate points. Recalculate the central point of the current area until all data points are divided into a certain area. Calculate the distances between all adjacent areas (such as the distance between the central points of the areas). If the distance between two adjacent areas is less than a certain merging threshold, and the density after merging does not exceed the second preset threshold, then merge the two areas. Until there are no areas that can be merged, output the divided areas to obtain multiple slope protection areas. Among them, the first preset threshold, the second preset threshold, and the merging threshold are all set according to the scenario requirements and are not limited here.

[0031] Particularly, the division of the slope protection area can also be delimited by the management personnel based on experience, which is not limited here.

[0032] Preferably, step S103 may include steps S1031 to S1032, where: Step S1031: In response to a click operation on the functional component, mark the slope protection area of the functional component in the panoramic compound eye array imaging; Step S1032, display the target slope monitoring information of the marked slope protection area in a scrolling floating window, where the target slope monitoring information includes slope radar scan information and equipment health information, GNSS data information and equipment health information, and personnel and vehicle information.

[0033] Specifically, after clicking the function component, the radar scan area and GNSS sensor points of the slope protection area will be displayed in the panoramic compound eye array imaging, which can be displayed separately in zones or in the form of multiple zones (in the case of selecting multiple function components at the same time). At the same time, a floating window for slope radar scan information and equipment health information can be displayed on the upper layer of the panoramic compound eye array imaging based on the operation of the manager clicking on the radar scan area or after a preset time; a floating window for GNSS information and equipment health information can be displayed on the upper layer of the panoramic compound eye array imaging based on the operation of the manager clicking on the GNSS sensor point or after a preset time; a floating window for personnel and vehicle data information in this area can be popped up on the upper layer of the panoramic compound eye array imaging after clicking the function component or after a preset time.

[0034] Preferably, step S103 may include step S1031' to step S1032', where: Step S1031', in response to a click operation on the radar scan plane or GNSS data of any point in the panoramic compound eye array imaging, display a real-time data floating window of the clicked point; Step S1032', calculate the optimal angle monitoring video of the point by calculating the compound eye data in the real-time data floating window, and use the optimal angle monitoring video of the point as the target slope monitoring information.

[0035] In the panoramic compound eye array imaging, clicking on any radar scan plane or GNSS point can display a real-time data floating window of the corresponding point. The real-time data can be the number of online working devices, the number of offline devices, the number of personnel and vehicles in the production area corresponding to the point, warning devices, and alarm descriptions, etc. In the floating window, through the system's self-judgment (using the comprehensive data of compound eye details, compound eye dome cameras, and other third-party camera devices as the judgment conditions), the optimal angle video of this point can be called out, and operations such as switching videos one by one for each area, video zooming, and direction adjustment can be performed to achieve remote video inspection.

[0036] Particularly, the thumbnail of the slope protection area can also be displayed on the upper layer of the panoramic compound eye array imaging. Clicking on any slope protection area (an area not covered by the panoramic image) on the thumbnail can display the GIS point map of the slope protection area in the panoramic compound eye array imaging. Clicking on any GNSS point icon can pop up the GNSS point information display window. Clicking the video button in the window, the system can automatically call out the optimal video resource matching this point.

[0037] Preferably, step S104 may include steps S1041 to S1044, where: Step S1041, when there is a warning signal in the target slope monitoring information, mark the point where the warning signal belongs in the panoramic compound eye array imaging as an alarm point; Step S1042, call the optimal video monitoring image of this point to display the personnel and vehicle information of the alarm point, and determine the slope alarm level through the displayed information; Different numbers of personnel or vehicles correspond to different slope alarm levels. Judging which interval of the preset alarm rule the personnel and vehicle information displayed in the monitoring image is in can quickly determine the specific slope alarm level.

[0038] Step S1043, generate a dangerous warning area for the alarm point in the panoramic compound eye array imaging based on the slope alarm level; If the slope alarm level is low, determine the area centered on this alarm point with a first preset distance as the radius as the dangerous warning area; if the slope alarm level is medium, determine the slope protection area to which this alarm point belongs as the dangerous warning area; if the slope alarm level is high, determine the area centered on this alarm point with a second preset distance as the radius as the dangerous warning area.

[0039] Step S1044, continuously monitor whether there are any personnel or vehicles straying into the dangerous warning area of the alarm point. If so, perform positioning identification and video tracking on the straying personnel or vehicles, and notify the straying personnel or vehicles to evacuate.

[0040] After confirming the alarm, according to the corresponding alarm level, the system automatically generates a dangerous warning area based on the slope alarm, that is, activates the electronic fence, to visualize the management of the mining area, enabling managers to respond quickly in case of an alarm situation.

[0041] For example, the system supports setting an "electronic fence" for the prohibited area in the panoramic video screen, and can automatically detect the behavior of vehicles illegally entering the prohibited area in real time. When a working vehicle breaks in, the system will generate alarm information in real time and push the information of the illegal vehicle to the administrator, providing a decision-making basis for the administrator.

[0042] When it is detected that a person or vehicle has strayed into the dangerous warning area, a floating window of the dangerous warning area will automatically pop up on the upper layer of the panoramic compound eye array imaging, and the movement trajectory of the person or vehicle will be displayed in the floating window. The system background will automatically calculate the distance between the real-time position of the person or vehicle and the edge line of the dangerous warning area, and use the nearest edge line as the evacuation direction of the person and vehicle, and transmit the edge line to the client to quickly provide an emergency route. This method provides a more intuitive safety management solution and is convenient for effectively coping with slope warnings in mining areas.

[0043] Preferably, determining whether there is a warning signal in the target slope monitoring information may include steps A1 to A3, where: Step A1: Compare the slope position information obtained by monitoring at the current moment with the slope position information obtained by monitoring at the historical moment, and determine whether there is a lateral displacement or a longitudinal displacement in the slope monitored at the current moment. If so, generate a slope displacement warning signal; Step A2: Determine whether the slope precipitation information obtained by monitoring at the current moment exceeds the preset water level value. If so, generate a slope precipitation warning signal; Step A3: Determine whether there are blasting points, blasting areas, blasting sensors or explosive charges in the target slope monitoring information. If so, generate a slope blasting warning signal.

[0044] It should be noted that the generation of warning signals is not limited to the above three situations. For example, it also includes whether the slope has subsided, cracked, etc.

[0045] It should be noted that after a warning signal is generated, the system background can quickly calculate the corresponding points, and a floating window of the optimal video image / real-time data of the corresponding points will pop up on the upper layer of the panoramic compound eye array imaging. That is, there is no strict order of occurrence between the generation time of the warning signal and the pop-up time of the floating window of the optimal video image / real-time data.

[0046] Preferably, after the panoramic compound eye array imaging formed based on compound eye imaging is displayed on the interaction interface, the method further includes steps B1 to B2, where: Step B1: Add type tags to the scene data of the panoramic compound eye array imaging respectively, where the type tags include fixed-point tags, vector tags and area tags; The fixed-point tags are mainly used to mark the points of concern, such as the stope slope, the perimeter of the stope, the sewage discharge port information, etc. in the panoramic video scene; the vector tags are mainly applied to the scenes with obvious direction features, such as the blind corners of the stope transportation roads, etc.; the area tags mainly focus on the key monitoring areas, key attention areas, etc.

[0047] Step B2: Establish an association relationship between the type tags and the layers of the panoramic compound eye array imaging, so as to realize the display of the corresponding type tags of the panoramic compound eye array imaging by selecting the layers.

[0048] Manage the data of the panoramic compound eye array imaging in layers according to different categories of tags, and different layers can be selected to control the display of different tags in the panoramic picture, improving the usage experience of the management personnel.

[0049] In this embodiment, the panoramic compound eye array imaging is used as the basis for monitoring data of the mining area production site, ensuring the continuity and integrity of the mining area production data; then, the panoramic compound eye array imaging is divided into regions to realize targeted processing of sub-region data, and timely responses can be given to the sub-region data generating warning signals, ensuring the efficient and safe management of the mining area.

[0050] Embodiment 2 Embodiment 2 of the present invention also provides a device for safety management of a mining area through panoramic compound eye array imaging. The device for safety management of a mining area through panoramic compound eye array imaging corresponds to the method for safety management of a mining area through panoramic compound eye array imaging provided in Embodiment 1 above. The corresponding technical features and technical effects will not be described in detail in this embodiment, and the relevant parts can refer to Embodiment 1 above. Specifically, Figure 2 The structural block diagram of the device for safety management of a mining area through panoramic compound eye array imaging is shown. As Figure 2 shown, the device 200 for safety management of a mining area through panoramic compound eye array imaging includes a first display module 201, a division module 202, a second display module 203, and a warning module 204, where: The first display module 201 is configured to display the panoramic compound eye array imaging on the interaction interface in response to a start instruction for slope safety management in the interaction interface, where the panoramic compound eye array imaging includes radar information and GNSS information of multiple points. The division module 202 is connected to the first display module 201 and is configured to divide the panoramic compound eye array imaging into multiple slope protection areas through the radar information and the GNSS information, and configure function components corresponding to the slope protection areas on the interaction interface. The second display module 203 is connected to the division module 202 and is configured to display target slope monitoring information in response to a click operation on the function component or a point of the panoramic compound eye array imaging. The warning module 204 is connected to the second display module 203 and is configured to determine whether there is a warning signal in the target slope monitoring information. If so, generate an emergency plan based on the warning signal to realize the safety management of the mining area slope.

[0051] Optionally, the partitioning module is further configured to: calculate the distances between all points, and arbitrarily extract one point as the center of the initial area; traverse the other points, determine the points whose distances from the center point are less than the first preset threshold, partition them into the initial area, and update the coordinate mean of the points in the initial area as the center point of the initial area; during the area expansion process, determine whether each newly added point in the area will cause the density of the area to exceed the second preset threshold; if it exceeds, remove the newly added point from the area, and update the coordinate mean of the points in the area as the center point of the area; arbitrarily extract one point from the remaining unpartitioned points as the center of the next area, determine the points among the remaining points whose distances from the center point are less than the first preset threshold, and partition them into the current area; repeat the previous step until all points are partitioned into corresponding areas, obtaining multiple slope protection areas.

[0052] Optionally, the second display module is further configured to: in response to a click operation on the functional component, mark the slope protection area of the functional component in the panoramic compound eye array imaging; display the target slope monitoring information of the marked slope protection area in a scrolling floating window, where the target slope monitoring information includes slope radar scanning information and equipment health information, GNSS data information and equipment health information, personnel and vehicle information.

[0053] Optionally, the second display module is further configured to: in response to a click operation on the radar scanning plane or GNSS data of any point in the panoramic compound eye array imaging, display a real-time data floating window of the clicked point; calculate the optimal angle monitoring video of the point by calculating the compound eye data in the real-time data floating window, and use the optimal angle monitoring video of the point as the target slope monitoring information.

[0054] Optionally, the warning module is further configured to: when there is a warning signal in the target slope monitoring information, mark the point where the warning signal belongs in the panoramic compound eye array imaging as an alarm point; call the optimal video monitoring image of the point to display the personnel and vehicle information of the alarm point, and determine the slope alarm level through the displayed information; generate a danger warning area of the alarm point in the panoramic compound eye array imaging based on the slope alarm level; continuously monitor whether there are any personnel or vehicles entering the danger warning area of the alarm point. If so, perform positioning identification and video tracking on the entering personnel or vehicles, and notify the entering personnel or vehicles to evacuate.

[0055] Optionally, the early warning module is further configured to: compare the slope position information monitored at the current moment with the slope position information monitored at the historical moment to determine whether there is a lateral displacement or a longitudinal displacement of the slope monitored at the current moment. If so, generate a slope displacement early warning signal; determine whether the slope precipitation information monitored at the current moment exceeds a preset water level value. If so, generate a slope precipitation early warning signal; determine whether there is a blasting point, a blasting area, a blasting sensor or a blasting charge in the target slope monitoring information. If so, generate a slope blasting early warning signal.

[0056] Optionally, the device further includes a marking module, configured to: add type tags to the scene data of the panoramic compound eye array imaging respectively, where the type tags include fixed-point tags, vector tags and area tags; establish an association relationship between the type tags and the layers of the panoramic compound eye array imaging, so as to realize the display of the corresponding type tags of the panoramic compound eye array imaging by selecting the layers.

[0057] Embodiment III Figure 3 The block diagram of the computer device suitable for implementing the method for safely managing a mining area through panoramic compound eye array imaging provided in Embodiment III of the present invention is shown. In this embodiment, the computer device 300 may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a rack server, a blade server, a tower server or a cabinet server (including an independent server or a server cluster composed of multiple servers) that executes a program. As Figure 3 shown, the computer device 300 of this embodiment at least includes, but is not limited to: a memory 301, a processor 302, and a network interface 303 that can communicate with each other through a system bus. It should be noted that Figure 3 only the computer device 300 with components 301-303 is shown, but it should be understood that it is not required to implement all the shown components, and more or fewer components can be alternatively implemented.

[0058] In this embodiment, the memory 303 includes at least one type of computer-readable storage medium. The readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 301 may be an internal storage unit of the computer device 300, such as the hard disk or memory of the computer device 300. In other embodiments, the memory 301 may also be an external storage device of the computer device 300, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc., equipped on the computer device 300. Of course, the memory 301 may also include both the internal storage unit and the external storage device of the computer device 300. In this embodiment, the memory 301 is generally used to store the operating system installed in the computer device 300 and various application software, such as the program code of the method for security management of the mining area through panoramic compound eye array imaging, etc.

[0059] In some embodiments, the processor 302 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips. The processor 302 is generally used to control the overall operation of the computer device 300. For example, it performs control and processing related to data interaction or communication with the computer device 300. In this embodiment, the processor 302 is used to run the program code of the steps of the method for security management of the mining area through panoramic compound eye array imaging stored in the memory 301.

[0060] In this embodiment, the method for security management of the mining area through panoramic compound eye array imaging stored in the memory 301 may also be divided into one or more program modules and executed by one or more processors (in this embodiment, the processor 302) to complete the present invention.

[0061] The network interface 303 may include a wireless network interface or a wired network interface, which is generally used to establish a communication link between the computer device 300 and other computer devices. For example, the network interface 303 is used to connect the computer device 300 to an external terminal through a network, and establish a data transmission channel and a communication link between the computer device 300 and the external terminal. The network may be an enterprise intranet (Intranet), the Internet, the Global System of Mobile communication (abbreviated as GSM), Wideband Code Division Multiple Access (abbreviated as WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi or other wireless or wired networks.

[0062] Embodiment 4 This embodiment also provides a computer-readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, server, App application mall, etc., on which a computer program is stored, and when the computer program is executed by a processor, it realizes the steps of the method for safely managing a mining area through panoramic compound eye array imaging.

[0063] Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the embodiments of the present invention can be implemented by a general-purpose computing device. They can be concentrated on a single computing device or distributed on a network composed of multiple computing devices. Optionally, they can be implemented by program codes executable by the computing device, so that they can be stored in a storage device and executed by the computing device. And in some cases, the steps shown or described can be executed in a different order from here, or they can be separately made into individual integrated circuit modules, or multiple modules or steps among them can be made into a single integrated circuit module to implement. In this way, the embodiments of the present invention are not limited to any specific combination of hardware and software.

[0064] It should be noted that the serial numbers of the embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0065] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general-purpose hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method.

[0066] The above are only the preferred embodiments of the present invention, and do not limit the patent scope of the present invention accordingly. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present invention, or directly or indirectly applied in other related technical fields, shall be similarly included in the patent protection scope of the present invention.

Claims

1. A method for safety management of a mining area through panoramic compound eye array imaging, characterized in that, The method includes: In response to a start instruction for slope safety management in a mining area in an interactive interface, a panoramic compound eye array imaging is displayed in the interactive interface, where the panoramic compound eye array imaging includes radar information and GNSS information at multiple points; The panoramic compound eye array imaging is divided into regions through the radar information and the GNSS information to obtain multiple slope protection regions, and function components corresponding to the slope protection regions are configured in the interactive interface; In response to a click operation on the function component or a point in the panoramic compound eye array imaging, target slope monitoring information is displayed; It is determined whether there is a warning signal in the target slope monitoring information. If so, an emergency plan is generated based on the warning signal to achieve safety management of the mining area slope.

2. The method according to claim 1, wherein The step of dividing the panoramic compound eye array imaging into regions through the radar information and the GNSS information to obtain multiple slope protection regions includes: Calculate the distances between all points, and arbitrarily extract one point as the center of the initial region; Traverse other points, determine the points whose distances from the central point are less than a first preset threshold, divide them into the initial region, and update the coordinate mean of the points in the initial region to the central point of the initial region; During the process of region expansion, it is determined whether each newly added point in the region will cause the density of the region to exceed a second preset threshold; if it exceeds, the newly added point is removed from the region, and the coordinate mean of the points in the region is updated to the central point of the region; Arbitrarily extract one point from the remaining undivided points as the center of the next region, determine the points among the remaining points whose distances from the central point are less than the first preset threshold, and divide them into the current region; Repeat the previous step until all points are divided into corresponding regions to obtain multiple slope protection regions.

3. The method according to claim 1, characterized in that, The step of displaying target slope monitoring information in response to a click operation on the function component includes: In response to a click operation on the function component, mark the slope protection region of the function component in the panoramic compound eye array imaging; Display the target slope monitoring information of the marked slope protection region in a scrolling floating window, where the target slope monitoring information includes slope radar scanning information and equipment health information, GNSS data information and equipment health information, personnel and vehicle information.

4. The method according to claim 1, characterized in that, The step of displaying target slope monitoring information in response to a click operation on a point in the panoramic compound eye array imaging includes: In response to a click operation on the radar scanning plane or GNSS data of any point in the panoramic compound eye array imaging, display a real-time data floating window of the clicked point; Calculate the optimal angle monitoring video of the point by calculating the compound eye data in the real-time data floating window, and use the optimal angle monitoring video of the point as the target slope monitoring information.

5. The method according to claim 1, characterized in that The step of generating an emergency plan based on the warning signal includes: When there is a warning signal in the target slope monitoring information, mark the point to which the warning signal belongs in the panoramic compound eye array imaging as an alarm point; Call the personnel and vehicle information of the optimal video surveillance image display alarm point at this position, and determine the slope alarm level through the displayed information; Generate a dangerous warning area for the alarm point in the panoramic compound eye array imaging based on the slope alarm level; Real-time monitor whether there are people or vehicles straying into the dangerous warning area of the alarm point. If so, locate and identify the straying people or vehicles and conduct video tracking, and notify the straying people or vehicles to evacuate.

6. The method according to claim 5, wherein The judging whether there is a warning signal in the target slope monitoring information includes: Compare the slope position information obtained by monitoring at the current moment with the slope position information obtained by monitoring at the historical moment, and judge whether there is a lateral displacement or a longitudinal displacement of the slope monitored at the current moment. If so, generate a slope displacement warning signal; Judge whether the slope precipitation information obtained by monitoring at the current moment exceeds the preset water level value. If so, generate a slope precipitation warning signal; Judge whether there are blasting points, blasting areas, blasting sensors or explosive charges in the target slope monitoring information. If so, generate a slope blasting warning signal.

7. The method according to any one of claims 1-6, characterized in that, After displaying the panoramic compound eye array imaging formed based on compound eye imaging on the interaction interface, the method further includes: Add type tags to the scene data of the panoramic compound eye array imaging respectively, where the type tags include fixed-point tags, vector tags and area tags; Establish an association relationship between the type tags and the layers of the panoramic compound eye array imaging to realize controlling the display of the corresponding type tags of the panoramic compound eye array imaging by selecting the layers.

8. A device for safety management of mining areas through panoramic compound eye array imaging, characterized in that, The device includes: A first display module, configured to display a panoramic compound eye array imaging on the interaction interface in response to a start instruction for the safety management of the mining area slope in the interaction interface, where the panoramic compound eye array imaging includes radar information and GNSS information of multiple positions; A division module, configured to divide the panoramic compound eye array imaging through the radar information and the GNSS information to obtain multiple slope protection areas, and configure function components corresponding to the slope protection areas on the interaction interface; A second display module, configured to display target slope monitoring information in response to a click operation on the function component or a position of the panoramic compound eye array imaging; A warning module, configured to judge whether there is a warning signal in the target slope monitoring information. If so, generate an emergency plan based on the warning signal to realize the safety management of the mining area slope.

9. A computer device, the computer device comprising:

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, A memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 7 when executing the computer program. The computer program, when executed by the processor, implements the method according to any one of claims 1 to 7.

Images