Method and device for safety management of mining areas through panoramic compound eye array imaging

Abstract

The present invention discloses a method and device for mining area safety management using panoramic compound eye array imaging. In response to a startup instruction for mining area slope safety management in an interactive interface, a panoramic compound eye array image is displayed on the interactive interface. The panoramic compound eye array image includes radar information and GNSS information from multiple points. The panoramic compound eye array image is divided into regions using the radar information and the GNSS information to obtain multiple slope protection areas, and functional components corresponding to the slope protection areas are configured on the interactive interface. In response to a click on the functional component or a point imaged by the panoramic compound eye array, target slope monitoring information is displayed. It is determined whether there is an early warning signal in the target slope monitoring information. If so, an emergency plan is generated based on the early warning signal to achieve safe management of the mining area slope. The present invention monitors the mining area using panoramic compound eye array imaging, ensuring efficient and safe management of the mining area.

Description

Technical Field

[0001] The present invention relates to the field of computer vision technology, and in particular to a method and device for performing safety management of a mining area through panoramic compound eye array imaging. Background Art

[0002] With the rapid development of my country's social economy, the country has attached increasing importance to production safety and environmental protection, and has successively issued a series of laws and regulations such as the "Opinions on Further Strengthening Mine Safety Production Work", and implemented major measures such as building green mines and smart mines.

[0003] Currently, open-pit coal mines lack video surveillance equipment at their working faces, or video surveillance is fragmented. This severely limits monitoring effectiveness and results in low pixel counts, preventing managers from effectively monitoring the production and operation status of key production areas, much less monitoring key locations in real time. Without video coverage of key production areas, security incidents within the region cannot be fully documented through video review. This significantly hinders comprehensive review, investigation, and accountability, creating numerous challenges for production scheduling and safety management, and presents significant safety risks.

[0004] There is currently no effective solution to the technical problem that the fragmentation of monitoring equipment in the production area of ​​open-pit coal mines in the existing technology makes it impossible to achieve effective mine safety management. Summary of the Invention

[0005] The purpose of the present invention is to provide a method and device for safety management of mining areas through panoramic compound eye array imaging, which can solve the technical problem that the fragmentation of monitoring equipment in the production area of ​​open-pit coal mines makes it impossible to achieve effective mine safety management.

[0006] One aspect of the present invention provides a method for safety management of a mining area through panoramic compound eye array imaging, the method comprising: in response to a start instruction for mine slope safety management in an interactive interface, displaying the panoramic compound eye array imaging on the interactive interface, wherein the panoramic compound eye array imaging includes radar information and GNSS information of multiple points; dividing the panoramic compound eye array imaging into regions through the radar information and the GNSS information to obtain multiple slope protection areas, and configuring functional components corresponding to the slope protection areas on the interactive interface; in response to a click operation on the functional component or the point of the panoramic compound eye array imaging, displaying target slope monitoring information; judging whether there is a warning signal in the target slope monitoring information, and if so, generating an emergency plan based on the warning signal to achieve safety management of the mining slope.

[0007] Optionally, the panoramic compound eye array imaging is divided into regions using the radar information and the GNSS information to obtain multiple slope protection regions, including: calculating the distances between all points, and arbitrarily extracting a point as the center of the initial region; traversing other points, determining the points whose distance from the center point is less than a first preset threshold, dividing them into the initial region, and updating the coordinate mean of the points in the initial region to the center point of the initial region; during the region expansion process, determining whether each newly added point in the region will cause the density of the region to exceed a second preset threshold; if so, removing the newly added point from the region, and updating the coordinate mean of the points in the region to the center point of the region; arbitrarily extracting a point from the remaining undivided points as the center of the next region, determining the points in the remaining points whose distance from the center point is less than the first preset threshold, and dividing them into the current region; repeating the previous step until all points are divided into corresponding regions to obtain multiple slope protection regions.

[0008] Optionally, the display of target slope monitoring information in response to a click operation on the functional component includes: marking the slope protection area of ​​the functional component in the panoramic compound eye array imaging in response to a click operation on the functional component; and displaying the target slope monitoring information of the marked slope protection area in a scrolling floating window, wherein the target slope monitoring information includes slope radar scanning information and equipment health information, GNSS data information and equipment health information, and personnel and vehicle information.

[0009] Optionally, the response to a click operation on a point imaged by the panoramic compound eye array to display target slope monitoring information includes: in response to a click operation on the radar scanning surface or GNSS data of any point in the panoramic compound eye array imaging, displaying a real-time data floating window of the clicked point; obtaining the optimal angle monitoring video of the point by calculating the compound eye data in the real-time data floating window, and using the optimal angle monitoring video of the point as the target slope monitoring information.

[0010] Optionally, the generation of an emergency plan based on the warning signal includes: when there is a warning signal in the target slope monitoring information, marking the point to which the warning signal belongs in the panoramic compound eye array imaging as an alarm point; calling the optimal video surveillance image of the point to display the personnel and vehicle information of the alarm point, and determining the slope alarm level by displaying the information; generating a danger warning area of ​​the alarm point in the panoramic compound eye array imaging based on the slope alarm level; real-time monitoring of whether there are people or vehicles that mistakenly enter the danger warning area of ​​the alarm point, and if so, locating and identifying the people or vehicles that have mistakenly entered, and tracking them by video, and notifying the people or vehicles that have mistakenly entered to evacuate.

[0011] Optionally, the determination of whether there is a warning signal in the target slope monitoring information includes: comparing the slope position information obtained by monitoring at the current moment with the slope position information obtained by monitoring at historical moments, and determining whether there is lateral displacement or longitudinal displacement of the slope monitored at the current moment, and if so, generating a slope displacement warning signal; determining whether the slope precipitation information obtained by monitoring at the current moment exceeds a preset water level value, and if so, generating a slope precipitation warning signal; and determining whether there is a blasting point, blasting area, blasting sensor or explosive quantity in the target slope monitoring information, and if so, generating a slope blasting warning signal.

[0012] Optionally, after the interactive interface displays the panoramic compound eye array imaging formed based on compound eye imaging, the method further includes: adding type labels to the scene data of the panoramic compound eye array imaging respectively, wherein the type labels include fixed point labels, vector labels and area labels; establishing an association relationship between the type labels and the layers of the panoramic compound eye array imaging, so as to realize the display of the corresponding type labels of the panoramic compound eye array imaging by selecting the layer.

[0013] Another aspect of the present invention provides a device for safely managing a mining area through panoramic compound eye array imaging, the device comprising: a first display module, for displaying the panoramic compound eye array imaging on the interactive interface in response to a start-up instruction for mining slope safety management in the interactive interface, wherein the panoramic compound eye array imaging includes radar information and GNSS information of multiple points; a division module, for dividing the panoramic compound eye array imaging into regions through the radar information and the GNSS information to obtain multiple slope protection areas, and configuring functional components corresponding to the slope protection areas on the interactive interface; a second display module, for displaying target slope monitoring information in response to a click operation on the functional component or the point of the panoramic compound eye array imaging; an early warning module, for determining whether there is an early warning signal in the target slope monitoring information, and if so, generating an emergency plan based on the early warning signal to achieve safe management of the mining slope.

[0014] Another aspect of the present invention provides a computer device, which includes: a memory, a processor, and a computer program stored in the memory and runnable on the processor, and is characterized in that when the processor executes the computer program, it implements the method of safe management of mining areas through panoramic compound eye array imaging of any of the above embodiments.

[0015] Another aspect of the present invention provides a computer storage medium storing a computer program. When executed by a processor, the computer program implements the method for safety management of a mining area through panoramic compound eye array imaging according to any of the aforementioned embodiments. Furthermore, the computer-readable storage medium may primarily include a program storage area and a data storage area. The program storage area may store an operating system, applications required for at least one function, and the data storage area may store data generated based on the use of blockchain nodes.

[0016] The present invention uses panoramic compound eye array imaging as the basis for on-site monitoring data of mining production, ensuring the continuity and integrity of mining production data; then, the panoramic compound eye array imaging is divided into regions to achieve targeted processing of sub-region data, and timely response can be given to sub-region data that generates early warning signals, ensuring efficient and safe management of the mining area. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the preferred embodiment below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the present invention. The same reference symbols are used throughout the drawings to represent the same components. In the drawings:

[0018] Figure 1 An optional flow chart of a method for performing safety management of a mining area through panoramic compound eye array imaging provided in the first embodiment of the present invention is shown;

[0019] Figure 2 A structural block diagram of an apparatus for performing safety management on a mining area through panoramic compound eye array imaging provided by a second embodiment of the present invention is shown; and

[0020] Figure 3 A block diagram of a computer device suitable for implementing a method for safety management of a mining area through panoramic compound eye array imaging provided in a third embodiment of the present invention is shown. DETAILED DESCRIPTION

[0021] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0022] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0023] Example 1

[0024] This embodiment provides a method for safety management of mining areas through panoramic compound eye array imaging. Figure 1 The flowchart of the method for safety management of mining areas by panoramic compound eye array imaging is shown as follows: Figure 1 As shown, the method for safety management of a mining area through panoramic compound eye array imaging may include steps S101 to S104, wherein:

[0025] Step S101, in response to a start instruction for mining slope safety management in an interactive interface, displaying a panoramic compound eye array image on the interactive interface, wherein the panoramic compound eye array image includes radar information and GNSS information of multiple points;

[0026] GNSS (Global Navigation Satellite System) is a space-based radio navigation and positioning system that can provide users with all-weather three-dimensional coordinates, speed, and time information at any location on the Earth's surface or in near-Earth space.

[0027] Panoramic compound eye array imaging utilizes compound eye imaging technology to monitor production data from different areas of the open-pit mine in real time, using information about the length, width, and elevation of the mining area. The system then fuses the data from these areas at the pixel level to generate a panoramic compound eye video image with a resolution of 100 million pixels. Specifically, the monitoring data for each area is obtained by integrating radar and GNSS information from pre-set locations.

[0028] Panoramic compound eye array imaging features ultra-large range, ultra-high resolution, and zero distortion, with properties such as integrity and continuity. Panoramic video surveillance images provide managers with a panoramic view of the entire production site's video surveillance area, enabling a bird's-eye view of the entire production site. This allows managers to gain a macro-level overview of open-pit mine production operations, monitor on-site operations in real time, identify potential problems promptly, and quickly resolve them. This helps ensure production safety and reduce accident risks.

[0029] Step S102: dividing the panoramic compound eye array imaging into regions using the radar information and the GNSS information to obtain a plurality of slope protection regions, and configuring functional components corresponding to the slope protection regions on the interactive interface;

[0030] The entire open-pit mine production site is divided into areas, and corresponding functional components are configured for each sub-area. By triggering the functional components, the local area can be displayed, which strengthens the management personnel's systematic management of the monitoring data of the entire mine production site.

[0031] Functional components can be area name controls arranged sequentially on the imaging side of the panoramic compound eye array, such as Excavation Area 1, Excavation Area 2, Drainage Area 1, and Drainage Area 2. Functional components can be hidden, and the specific display format is determined by user needs.

[0032] Step S103, in response to a click operation on the functional component or the point imaged by the panoramic compound eye array, displaying target slope monitoring information;

[0033] In the divided panoramic video images, close-up video images of any local area can be displayed in the form of a floating window, allowing managers to have a macro-control of the overall situation and a micro-insight into the details, achieving a perfect monitoring experience with both panorama and details, and realizing real-time command and dispatch, as well as emergency rescue command functions.

[0034] Step S104 , determining whether there is an early warning signal in the target slope monitoring information, and if so, generating an emergency plan based on the early warning signal to achieve safety management of the mining slope.

[0035] By determining whether there are early warning signals in a local area, the situation of traversing all point data and resulting in low data processing efficiency is avoided. This method can ensure that the production area where the early warning signal is generated can be quickly checked and timely response plans can be made, realizing efficient and safe management of the mining area.

[0036] This embodiment uses panoramic compound eye array imaging as the basis for on-site monitoring data of mine production, ensuring the continuity and integrity of the mine production data; then, the panoramic compound eye array imaging is divided into regions to achieve targeted processing of sub-region data, and timely response can be given to sub-region data that generates early warning signals, ensuring efficient and safe management of the mine area.

[0037] Preferably, step S102 may include steps S1021 to S1025, wherein:

[0038] Step S1021, calculating the distances between all points, and arbitrarily extracting a point as the center of the initial area;

[0039] Step S1022: traverse other points, determine points whose distance from the center point is less than a first preset threshold, divide them into an initial area, and update the coordinate mean of the points in the initial area to the center point of the initial area;

[0040] Step S1023: During the region expansion process, determine whether each newly added point in the region causes the density of the region to exceed a second preset threshold; if so, remove the newly added point from the region, and update the coordinate mean of the points in the region to the center point of the region;

[0041] Step S1024: randomly extract a point from the remaining undivided points as the center of the next area, determine the points among the remaining points whose distance to the center point is less than a first preset threshold, and divide them into the current area;

[0042] Step S1025, repeat the previous step until all points are divided into corresponding areas, and multiple slope protection areas are obtained.

[0043] Specifically, before calculating the distances between all points, if the coordinate ranges of different points vary significantly, normalization can be performed to ensure that all coordinate values ​​are of the same order of magnitude. The distances between each pair of points are then calculated, and a random point is selected from all points as the center of the initial region. For this initial center, the remaining points are traversed. If the distance between them is less than a first preset threshold, the point is added to the current region, and the center of the current region is updated to the geometric center of all points in the region. Next, a point is selected from the remaining undivided data points as the initial center of the next region. The current region is expanded using the same method as the initial region division. During the expansion process, each newly added point is checked to see if it causes the region density to exceed a second preset threshold. If so, the expansion of that point and subsequent points is stopped and removed from the candidate points. The center of the current region is recalculated until all data points are divided into a region. The distances between all adjacent regions (such as the distance between region centers) are calculated. If the distance between two adjacent regions is less than a merging threshold and the density of the merged region does not exceed the second preset threshold, the two regions are merged. This process continues until no more regions can be merged. The divided regions are output, resulting in multiple slope protection regions. Among them, the first preset threshold, the second preset threshold and the combined threshold are all set according to scene requirements and are not limited here.

[0044] In particular, the division of slope protection areas can also be determined by management personnel based on experience, which is not restricted here.

[0045] Preferably, step S103 may include steps S1031 to S1032, wherein:

[0046] Step S1031, in response to a click operation on the functional component, marking a slope protection area of ​​the functional component in the panoramic compound eye array imaging;

[0047] Step S1032: Display the target slope monitoring information of the marked slope protection area in a scrolling floating window, wherein the target slope monitoring information includes slope radar scanning information and equipment health information, GNSS data information and equipment health information, and personnel and vehicle information.

[0048] Specifically, after clicking a functional component, the panoramic compound eye array imaging will display the radar scan area and GNSS sensor points for the slope protection area. These can be displayed in separate partitions or in multiple partitions (when multiple functional components are selected at the same time). At the same time, a floating window of slope radar scan information and equipment health information can be displayed on the upper layer of the panoramic compound eye array imaging based on the administrator's selection of a radar scan area or after a preset time. A floating window of GNSS information and equipment health information can be displayed on the upper layer of the panoramic compound eye array imaging based on the administrator's selection of a GNSS sensor point or after a preset time. A floating window of personnel and vehicle data information in the area can pop up on the upper layer of the panoramic compound eye array imaging after clicking a functional component or after a preset time.

[0049] Preferably, step S103 may include steps S1031' to S1032', wherein:

[0050] Step S1031′: in response to a click operation on the radar scanning surface or GNSS data of any point in the panoramic compound-eye array imaging, displaying a real-time data floating window of the clicked point;

[0051] Step S1032 ′: Calculate the compound eye data in the real-time data floating window to obtain the optimal angle monitoring video of the point, and use the optimal angle monitoring video of the point as the target slope monitoring information.

[0052] In the panoramic compound eye array imaging, clicking on any radar scan area or GNSS point will display a floating window with real-time data for that point. This real-time data can include the number of online and offline devices, the number of personnel and vehicles in the corresponding production area, warning equipment, and a description of the alert. In this floating window, the system automatically determines (based on compound eye details, combined data from the compound eye camera, and other third-party cameras) the optimal angle for that point. Users can switch between video views, zoom in and out, and adjust the direction of each area, enabling remote video inspections.

[0053] In particular, the thumbnail of the slope protection area can also be displayed on the upper layer of the panoramic compound eye array imaging. Clicking on any slope protection area on the thumbnail (the area not covered by the panoramic image) can display the GIS point map of the slope protection area in the panoramic compound eye array imaging. Clicking on any GNSS point icon can pop up the GNSS point information display window. Clicking the window video button will automatically call out the optimal video resource matching the point.

[0054] Preferably, step S104 may include steps S1041 to S1044, wherein:

[0055] Step S1041: When there is a warning signal in the target slope monitoring information, the point to which the warning signal belongs in the panoramic compound eye array imaging is marked as an alarm point;

[0056] Step S1042: Calling the optimal video surveillance image of the point to display the personnel and vehicle information of the alarm point, and determining the slope alarm level based on the displayed information;

[0057] Different numbers of people or vehicles correspond to different slope alarm levels. By judging which range of the preset alarm rules the people and vehicle information displayed in the monitoring image falls within, the specific slope alarm level can be quickly determined.

[0058] Step S1043, generating a danger warning area of ​​the alarm point in the panoramic compound-eye array imaging based on the slope alarm level;

[0059] If the slope alarm level is low, the area with the alarm point as the center and the first preset distance as the radius will be determined as the danger warning area; if the slope alarm level is medium, the slope protection area to which the alarm point belongs will be determined as the danger warning area; if the slope alarm level is high, the area with the alarm point as the center and the second preset distance as the radius will be determined as the danger warning area.

[0060] Step S1044: monitor in real time whether there are people or vehicles that have mistakenly entered the dangerous warning area of ​​the alarm point. If so, locate and identify the people or vehicles that have mistakenly entered, and track them through video, and notify them to evacuate.

[0061] After confirming the alarm, the system automatically generates a dangerous warning area based on the slope alarm according to the corresponding alarm level, that is, activates the electronic fence to visualize the management of the mining area, so that managers can respond quickly when an alarm situation occurs.

[0062] For example, the system supports setting up "electronic fences" for prohibited areas in mining areas in panoramic video images, and can automatically detect vehicles illegally entering prohibited areas in real time. When an operating vehicle breaks in, the system will generate alarm information in real time and push the illegal vehicle information to the administrator, providing the administrator with a basis for decision-making.

[0063] When a person or vehicle strays into a danger zone, a pop-up window automatically displays the person's or vehicle's movement trajectory on the panoramic compound eye array's imaging layer. The system automatically calculates the distance between the person or vehicle's real-time location and the danger zone's edge, using the nearest edge as the escape direction. This edge is then transmitted to the client, quickly providing an emergency route. This approach provides a more intuitive safety management solution and facilitates effective response to mining slope warnings.

[0064] Preferably, determining whether there is a warning signal in the target slope monitoring information may include steps A1 to A3, wherein:

[0065] Step A1: Compare the slope position information obtained from current monitoring with the slope position information obtained from historical monitoring to determine whether the slope currently monitored has lateral or longitudinal displacement. If so, generate a slope displacement warning signal;

[0066] Step A2: determining whether the slope precipitation information currently monitored exceeds a preset water level value; if so, generating a slope precipitation warning signal;

[0067] Step A3: determine whether the target slope monitoring information contains blasting points, blasting areas, blasting sensors or explosive quantities. If so, generate a slope blasting warning signal.

[0068] It should be noted that the generation of early warning signals is not limited to the above three situations, for example, it also includes whether there is subsidence or cracks on the slope.

[0069] It should be noted that after the warning signal is generated, the system background can quickly calculate the corresponding point and pop up the optimal video image / real-time data floating window for that point on the upper layer of the panoramic compound eye array imaging. In other words, there is no strict order between the generation of the warning signal and the pop-up of the optimal video image / real-time data floating window.

[0070] Preferably, after the interactive interface displays the panoramic compound eye array imaging formed based on the compound eye imaging, the method further includes steps B1 and B2, wherein:

[0071] Step B1, adding type labels to the scene data imaged by the panoramic compound eye array, wherein the type labels include fixed point labels, vector labels, and area labels;

[0072] Fixed-point labels are mainly used to mark points of interest, such as mine slopes, mining perimeters, and sewage outlet information in panoramic video scenes; vector labels are mainly used in scenes with obvious directional characteristics, such as blind spots at corners of mine transportation roads; and regional labels mainly focus on key monitoring areas and key focus areas.

[0073] Step B2: establishing an association relationship between a type label and a layer of the panoramic compound eye array imaging, so as to control the display of a type label corresponding to the panoramic compound eye array imaging by selecting a layer.

[0074] The data of panoramic compound eye array imaging is hierarchically managed according to different categories of tags. Different layers can be selected to control the display of different tags in the panoramic image, improving the user experience of managers.

[0075] This embodiment uses panoramic compound eye array imaging as the basis for on-site monitoring data of mine production, ensuring the continuity and integrity of the mine production data; then, the panoramic compound eye array imaging is divided into regions to achieve targeted processing of sub-region data, and timely response can be given to sub-region data that generates early warning signals, ensuring efficient and safe management of the mine area.

[0076] Example 2

[0077] The second embodiment of the present invention further provides a device for safety management of a mining area through panoramic compound eye array imaging. The device for safety management of a mining area through panoramic compound eye array imaging corresponds to the method for safety management of a mining area through panoramic compound eye array imaging provided in the first embodiment above. The corresponding technical features and technical effects will not be described in detail in this embodiment. For relevant details, please refer to the first embodiment above. Specifically, Figure 2 The structural block diagram of the device for safety management of mining areas through panoramic compound eye array imaging is shown. Figure 2 As shown, the device 200 for safety management of a mining area through panoramic compound eye array imaging includes a first display module 201, a division module 202, a second display module 203 and an early warning module 204, wherein:

[0078] A first display module 201 is configured to respond to a start instruction for mining slope safety management in an interactive interface and display a panoramic compound eye array image on the interactive interface, wherein the panoramic compound eye array image includes radar information and GNSS information of multiple points;

[0079] a division module 202 connected to the first display module 201, configured to divide the panoramic compound eye array imaging into regions based on the radar information and the GNSS information, obtain multiple slope protection regions, and configure functional components corresponding to the slope protection regions on the interactive interface;

[0080] A second display module 203 is connected to the division module 202 and is used to display target slope monitoring information in response to a click operation on the functional component or the point imaged by the panoramic compound eye array;

[0081] The early warning module 204 is connected to the second display module 203 and is used to determine whether there is an early warning signal in the target slope monitoring information. If so, an emergency plan is generated based on the early warning signal to achieve safe management of the mining slope.

[0082] Optionally, the division module is also used to: calculate the distance between all points, and arbitrarily extract a point as the center of the initial area; traverse other points, determine the points whose distance from the center point is less than a first preset threshold, divide them into the initial area, and update the coordinate mean of the points in the initial area to the center point of the initial area; during the area expansion process, determine whether each newly added point in the area will cause the density of the area to exceed a second preset threshold; if exceeded, remove the newly added point from the area, and update the coordinate mean of the points in the area to the center point of the area; arbitrarily extract a point from the remaining undivided points as the center of the next area, determine the points in the remaining points whose distance from the center point is less than the first preset threshold, and divide them into the current area; repeat the previous step until all points are divided into corresponding areas to obtain multiple slope protection areas.

[0083] Optionally, the second display module is also used to: mark the slope protection area of ​​the functional component in the panoramic compound eye array imaging in response to a click operation on the functional component; and display the target slope monitoring information of the marked slope protection area in a scrolling floating window, wherein the target slope monitoring information includes slope radar scanning information and equipment health information, GNSS data information and equipment health information, personnel and vehicle information.

[0084] Optionally, the second display module is also used to: in response to a click operation on the radar scanning surface or GNSS data of any point in the panoramic compound eye array imaging, display a real-time data floating window of the clicked point; by calculating the compound eye data in the real-time data floating window, obtain the optimal angle monitoring video of the point, and use the optimal angle monitoring video of the point as the target slope monitoring information.

[0085] Optionally, the early warning module is also used to: when there is an early warning signal in the target slope monitoring information, mark the point to which the early warning signal belongs in the panoramic compound eye array imaging as an alarm point; call the optimal video surveillance image of the point to display the personnel and vehicle information of the alarm point, and determine the slope alarm level by displaying the information; generate a danger warning area of ​​the alarm point in the panoramic compound eye array imaging based on the slope alarm level; monitor in real time whether there are people or vehicles that mistakenly enter the danger warning area of ​​the alarm point, and if so, locate and identify the people or vehicles that have mistakenly entered, and track them through video, and notify the people or vehicles that have mistakenly entered to evacuate.

[0086] Optionally, the early warning module is also used to: compare the slope position information obtained by monitoring at the current moment with the slope position information obtained by monitoring at historical moments, to determine whether the slope monitored at the current moment has lateral displacement or longitudinal displacement, and if so, to generate a slope displacement early warning signal; to determine whether the slope precipitation information obtained by monitoring at the current moment exceeds a preset water level value, and if so, to generate a slope precipitation early warning signal; to determine whether the target slope monitoring information contains a blasting point, blasting area, blasting sensor or explosive quantity, and if so, to generate a slope blasting early warning signal.

[0087] Optionally, the device also includes a marking module, which is used to: add type labels to the scene data of the panoramic compound eye array imaging, wherein the type labels include fixed point labels, vector labels and area labels; establish an association relationship between the type labels and the layers of the panoramic compound eye array imaging, so as to realize the display of the corresponding type labels of the panoramic compound eye array imaging by selecting the layer.

[0088] Example 3

[0089] Figure 3 The block diagram of a computer device suitable for implementing a method for safety management of a mining area through panoramic compound eye array imaging provided by the third embodiment of the present invention is shown. In this embodiment, the computer device 300 can be a smartphone, tablet computer, laptop computer, desktop computer, rack server, blade server, tower server or cabinet server (including an independent server or a server cluster composed of multiple servers) that executes a program. Figure 3 As shown, the computer device 300 of this embodiment includes at least but not limited to: a memory 301, a processor 302, and a network interface 303 that can be interconnected via a system bus. It should be noted that Figure 3 Computer device 300 is shown having only components 301 - 303 , but it should be understood that implementing all of the illustrated components is not a requirement, and more or fewer components may alternatively be implemented.

[0090] In this embodiment, memory 303 includes at least one type of computer-readable storage medium, including flash memory, a hard disk, a multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, a magnetic disk, an optical disk, etc. In some embodiments, memory 301 may be an internal storage unit of computer device 300, such as a hard disk or memory of computer device 300. In other embodiments, memory 301 may also be an external storage device of computer device 300, such as a plug-in hard disk equipped on computer device 300, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. Of course, memory 301 may also include both internal storage units and external storage devices of computer device 300. In this embodiment, the memory 301 is generally used to store an operating system and various application software installed on the computer device 300, such as program code of a method for safety management of a mining area through panoramic compound eye array imaging.

[0091] In some embodiments, processor 302 can be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip. Processor 302 is typically used to control the overall operation of computer device 300. For example, it performs control and processing related to data exchange or communication with computer device 300. In this embodiment, processor 302 is used to execute the program code stored in memory 301 for the steps of a method for safety management of a mining area using panoramic compound-eye array imaging.

[0092] In this embodiment, the method for safety management of mining areas through panoramic compound eye array imaging stored in the memory 301 can also be divided into one or more program modules and executed by one or more processors (processor 302 in this embodiment) to complete the present invention.

[0093] Network interface 303 may include a wireless network interface or a wired network interface. Network interface 303 is typically used to establish a communication link between computer device 300 and other computer devices. For example, network interface 303 is used to connect computer device 300 to an external terminal via a network, establishing a data transmission channel and a communication link between computer device 300 and the external terminal. The network may be a wireless or wired network, such as an intranet, the Internet, the Global System of Mobile Communications (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth, or Wi-Fi.

[0094] Example 4

[0095] This embodiment also provides a computer-readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, server, App application store, etc., on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for safe management of a mining area through panoramic compound eye array imaging are implemented.

[0096] Obviously, those skilled in the art should understand that the various modules or steps of the above-mentioned embodiments of the present invention can be implemented using a general-purpose computing device, they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices. Alternatively, they can be implemented using program code executable by the computing device, so that they can be stored in a storage device and executed by the computing device. In some cases, the steps shown or described can be performed in a different order than herein, or they can be made into separate integrated circuit modules, or multiple modules or steps can be made into a single integrated circuit module for implementation. Thus, the embodiments of the present invention are not limited to any specific combination of hardware and software.

[0097] It should be noted that the serial numbers of the embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0098] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method.

[0099] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for safety management of mining areas through panoramic compound eye array imaging, characterized in that: The method comprises: In response to a start instruction for mining slope safety management in the interactive interface, a panoramic compound eye array image is displayed on the interactive interface, wherein the panoramic compound eye array image includes radar information and GNSS information of multiple points; Divide the panoramic compound eye array imaging into regions using the radar information and the GNSS information to obtain multiple slope protection regions, and configure functional components corresponding to the slope protection regions on the interactive interface; In response to a click operation on the functional component or the point imaged by the panoramic compound eye array, target slope monitoring information is displayed; Determining whether there is an early warning signal in the target slope monitoring information, and if so, generating an emergency plan based on the early warning signal to achieve safety management of the mining slope; The panoramic compound eye array imaging is divided into regions using the radar information and the GNSS information to obtain multiple slope protection regions, including: Calculate the distance between all points and arbitrarily select a point as the center of the initial area; Traversing other points, determining points whose distance from the center point is less than a first preset threshold, dividing them into an initial area, and updating the coordinate mean of the points in the initial area to the center point of the initial area; During the region expansion process, it is determined whether each newly added point in the region causes the density of the region to exceed a second preset threshold; if so, the newly added point is removed from the region, and the coordinate mean of the points in the region is updated to the center point of the region; From the remaining undivided points, randomly select a point as the center of the next area, determine the points among the remaining points whose distance to the center point is less than a first preset threshold, and divide them into the current area; Repeat the previous step until all points are divided into corresponding areas, and obtain multiple slope protection areas.

2. The method according to claim 1, characterized in that The step of displaying target slope monitoring information in response to a click operation on the functional component includes: In response to a click operation on the functional component, marking a slope protection area of ​​the functional component in the panoramic compound eye array imaging; The target slope monitoring information of the marked slope protection area is displayed in a scrolling floating window, wherein the target slope monitoring information includes slope radar scanning information and equipment health information, GNSS data information and equipment health information, personnel and vehicle information.

3. The method according to claim 1, characterized in that The method of displaying target slope monitoring information in response to a click operation on a point imaged by the panoramic compound eye array comprises: In response to a click operation on the radar scan surface or GNSS data of any point in the panoramic compound eye array imaging, a real-time data floating window of the clicked point is displayed; By calculating the compound eye data in the real-time data floating window, the optimal angle monitoring video of the point is obtained, and the optimal angle monitoring video of the point is used as the target slope monitoring information.

4. The method according to claim 1, wherein Generating an emergency plan based on the early warning signal includes: When there is a warning signal in the target slope monitoring information, the point to which the warning signal belongs in the panoramic compound eye array imaging is marked as an alarm point; The optimal video surveillance image of the point is called to display the personnel and vehicle information of the alarm point, and the slope alarm level is determined by the displayed information; Generating a danger warning area of ​​the alarm point in the panoramic compound eye array imaging based on the slope alarm level; Real-time monitoring is performed to determine whether any person or vehicle has mistakenly entered the danger warning area of ​​the alarm point. If so, the person or vehicle that has mistakenly entered is located and identified, and video tracking is performed, and the person or vehicle that has mistakenly entered is notified to evacuate.

5. The method according to claim 4, characterized in that The determining whether there is a warning signal in the target slope monitoring information includes: Compare the slope position information obtained by monitoring at the current moment with the slope position information obtained by monitoring at historical moments to determine whether the slope monitored at the current moment has lateral or longitudinal displacement. If so, generate a slope displacement warning signal; Determine whether the slope precipitation information obtained by monitoring at the current moment exceeds the preset water level value. If so, generate a slope precipitation warning signal; Determine whether the target slope monitoring information contains a blasting point, a blasting area, a blasting sensor, or an amount of explosives; if so, generate a slope blasting warning signal.

6. The method according to any one of claims 1 to 5, characterized in that After the interactive interface displays the panoramic compound eye array imaging formed based on the compound eye imaging, the method further includes: Adding type labels to the scene data imaged by the panoramic compound eye array respectively, wherein the type labels include fixed point labels, vector labels and area labels; An association relationship between the type label and the layer of the panoramic compound eye array imaging is established to control the display of the type label corresponding to the panoramic compound eye array imaging by selecting the layer.

7. A device for safety management of mining areas through panoramic compound eye array imaging, characterized in that: The device comprises: A first display module is configured to respond to a start instruction for mining slope safety management in an interactive interface and display a panoramic compound eye array image on the interactive interface, wherein the panoramic compound eye array image includes radar information and GNSS information of multiple points; a division module, configured to divide the panoramic compound eye array imaging into regions using the radar information and the GNSS information to obtain a plurality of slope protection regions, and configure functional components corresponding to the slope protection regions on the interactive interface; A second display module is configured to display target slope monitoring information in response to a click operation on the functional component or the point imaged by the panoramic compound eye array; An early warning module is used to determine whether there is an early warning signal in the target slope monitoring information, and if so, to generate an emergency plan based on the early warning signal to achieve safe management of the mining slope; Wherein, the division module is used to: Calculate the distance between all points and arbitrarily select a point as the center of the initial area; Traversing other points, determining points whose distance from the center point is less than a first preset threshold, dividing them into an initial area, and updating the coordinate mean of the points in the initial area to the center point of the initial area; During the region expansion process, it is determined whether each newly added point in the region causes the density of the region to exceed a second preset threshold; if so, the newly added point is removed from the region, and the coordinate mean of the points in the region is updated to the center point of the region; From the remaining undivided points, randomly select a point as the center of the next area, determine the points among the remaining points whose distance to the center point is less than a first preset threshold, and divide them into the current area; Repeat the previous step until all points are divided into corresponding areas, and obtain multiple slope protection areas.

8. A computer device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 6 when executing the computer program.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images