Compound eye panoramic perception system

Abstract

The utility model discloses a compound eye panorama perception system which comprises a comprehensive management platform and a plurality of compound eye panorama perception subsystems. Wherein the compound eye panoramic sensing subsystem comprises a compound eye sensor, a compound eye image reconstruction server and a compound eye image storage server; the input end of the compound eye image reconstruction server is connected with the compound eye sensor, and the output end of the compound eye image reconstruction server is connected with the compound eye image storage server; the comprehensive management platform comprises a platform management server, a display management server and a display screen; the platform management server is respectively connected with the compound eye sensor, the compound eye image reconstruction server, the compound eye image storage server and the display management server; the display management server is also connected with the display screen, and the display management server is used for obtaining the image information from the platform management server and sending the image information to the display screen for visual display; according to the utility model, image monitoring can be carried out comprehensively and efficiently in real time, so that the safety of mining work is guaranteed.

Description

Technical Field

[0001] This utility model relates to the field of sensing equipment technology, specifically to a compound eye panoramic sensing system. Background Technology

[0002] Currently, most open-pit mine production areas lack video surveillance equipment at the working faces. Management personnel cannot effectively control the production operations in key areas, let alone monitor details of points of interest in real time. The absence of video surveillance in major production areas prevents the retrieval of video footage to understand the sequence of events, significantly hindering comprehensive event review, investigation, and accountability. This creates numerous problems for production scheduling and safety management, and poses significant safety hazards.

[0003] Therefore, how to effectively monitor the open-pit mine operation area in real time and comprehensively has become a technical problem that urgently needs to be solved by those skilled in the art. Utility Model Content

[0004] The purpose of this invention is to provide a compound eye panoramic perception system that can perform real-time, comprehensive, and efficient image monitoring for open-pit mines, thereby ensuring the safety of mining operations.

[0005] One aspect of this utility model provides a compound eye panoramic perception system, the system comprising:

[0006] An integrated management platform, and multiple compound-eye panoramic perception subsystems connected to the integrated management platform;

[0007] The compound eye panoramic perception subsystem includes: a compound eye sensor for collecting image information within a designated area of ​​an open-pit mine, a compound eye image reconstruction server, and a compound eye image storage server; the input end of the compound eye image reconstruction server is connected to the compound eye sensor, and the output end of the compound eye image reconstruction server is connected to the compound eye image storage server.

[0008] The integrated management platform includes: a platform management server, a display management server, and a display screen; the platform management server is connected to the compound eye sensor, the compound eye image reconstruction server, the compound eye image storage server, and the display management server respectively; the display management server is also connected to the display screen, and the display management server is used to obtain image information from the platform management server and send it to the display screen for visualization display;

[0009] The multiple compound eye sensors in the multiple compound eye panoramic perception subsystem can collect image information of the entire open-pit mine area.

[0010] Optionally, the compound eye sensor has no fewer than 50 lenses, and each lens module has no fewer than 8 million pixels.

[0011] Optionally, the compound eye panoramic perception subsystem further includes: a high-speed PTZ camera;

[0012] The high-speed PTZ camera is connected to the input terminal of the compound eye image reconstruction server.

[0013] Optionally, the high-speed PTZ camera has 4 million pixels, a focal length of 6.7 mm to 400 mm, and an optical zoom of 60x.

[0014] Optionally, the compound eye sensor is mounted on a support platform via an adjustable bracket, and the support platform is mounted on the iron tower;

[0015] The adjustable support is used to adjust the pitch and tilt angles of the compound eye sensor.

[0016] Optionally, the compound eye image storage server includes: a storage module, a data hard disk, and a processing module;

[0017] The storage module is connected to both the compound eye image reconstruction server and the data hard disk, and is used to store the image information received from the compound eye image reconstruction server into the data hard disk.

[0018] The processing module is connected to the data hard drive and the platform management server respectively, and the processing module is used to send the image information from the data hard drive to the platform management server.

[0019] Optionally, the integrated management platform may further include: a real-time streaming media gateway;

[0020] The real-time streaming media gateway is used to allow multiple user accounts to use the integrated management platform simultaneously.

[0021] Optionally, the integrated management platform may further include a speaker connected to the platform management server.

[0022] Optionally, the integrated management platform and the compound eye panoramic perception subsystem transmit data via a communication optical cable and a local area Ethernet.

[0023] The compound-eye panoramic perception system provided by this utility model mainly completes panoramic video coverage of open-pit mines, outputting panoramic video streams and detail streams. This system can output a complete panoramic video monitoring image of the production site from a relatively high point perspective. The panoramic video image has the characteristics of ultra-large range, ultra-high resolution, and no distortion, possessing attributes such as integrity and continuity. Through the panoramic video monitoring image, managers can have a complete view of the entire production site video monitoring area, achieving a high-altitude overview of the entire production site. This allows managers to have macro-level control over the open-pit mine's production operations, monitor on-site operations in real time, promptly identify potential problems, and quickly take measures to resolve them. This helps ensure safe production operations and reduce the risk of accidents. This system is reasonably designed, simple in structure, and fully functional, practical, and can effectively improve work efficiency, meeting the needs of video monitoring work. It can transmit images and data from the scene of emergencies to the monitoring center in a timely manner, facilitating command and dispatch. Attached Figure Description

[0024] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the scope of the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0025] Figure 1 A schematic diagram of a compound eye panoramic perception system provided in Embodiment 1 of this utility model;

[0026] Figure 2 A schematic diagram of the structure of the compound eye panoramic perception subsystem provided in Embodiment 1 of this utility model;

[0027] Figure 3 This is a schematic diagram of the arrangement of compound eye sensors in an open-pit mine, provided as an embodiment of the present invention.

[0028] Figure 4 This is a schematic diagram of a structure for installing a compound eye sensor according to Embodiment 1 of this utility model. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of this utility model clearer, the present utility model will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present utility model and are not intended to limit the present utility model. All other embodiments obtained by those skilled in the art based on the embodiments of this utility model without inventive effort are within the scope of protection of this utility model.

[0030] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, article, or apparatus. Without further limitations, an element defined by the phrase "comprising a..." does not exclude the presence of other identical elements in the process, article, or apparatus that includes that element.

[0031] Example 1

[0032] This invention provides a compound eye panoramic perception system, such as Figure 1 As shown, the compound eye panoramic perception system specifically includes the following components: an integrated management platform 10, and multiple compound eye panoramic perception subsystems 20 connected to the integrated management platform 10;

[0033] The compound eye panoramic perception subsystem 20 includes: a compound eye sensor 201 for collecting image information of a set area in an open-pit mine, a compound eye image reconstruction server 202, and a compound eye image storage server 203.

[0034] The input end of the compound eye image reconstruction server 202 is connected to the compound eye sensor 201, and the output end of the compound eye image reconstruction server 202 is connected to the compound eye image storage server 203.

[0035] The multiple compound eye sensors 201 in the multiple compound eye panoramic perception subsystem 20 can collect image information of the entire open-pit mine area;

[0036] The integrated management platform 10 includes: a platform management server 101, a display management server 102, and a display screen 103;

[0037] The platform management server 101 is connected to the compound eye sensor 201, the compound eye image reconstruction server 202, the compound eye image storage server 203, and the display management server 102, respectively. The platform management server 101 is used to control the opening and closing of the compound eye sensor 201, the compound eye image reconstruction server 202, and the compound eye image storage server 203. The display management server 102 is also connected to the display screen 103, and the display management server 102 is used to obtain image information from the platform management server 101 and send it to the display screen 103 for visualization.

[0038] In this embodiment, the display screen 103 may be composed of multiple splicing screens. The platform management server 101 is used to merge the image images acquired by each compound-eye panoramic perception subsystem 20 into a single panoramic image. The display management server 102 is used to split the panoramic image into N sub-images according to the number N splicing screens in the display screen 103, so as to display the N sub-images through the N splicing screens. The multiple compound-eye panoramic perception subsystems 20 are used to perform real-time image monitoring of the panoramic view of the working area of ​​the open-pit mine, and send the real-time acquired image information to the integrated management platform 10, so that the manager can grasp the panoramic image information of the open-pit mine in real time through the integrated management platform 10, and can visualize it through the display screen 103. Specifically, the compound eye sensor 201 is used to collect image data within a designated area of ​​the open-pit mine and send it to the compound eye image reconstruction server 202. The compound eye image reconstruction server 202 is used to parse the image data to reconstruct the image (video or image) and send it to the compound eye image storage server 203. The compound eye image storage server 203 is used to store the image. The platform management server 101 is used to query the image from the compound eye image storage server 203 according to a query command triggered by the user and send it to the display management server 102. The display management server 102 is used to send the queried image to the display screen 103 for visualization.

[0039] In this embodiment, as Figure 2 As shown, the compound eye panoramic perception subsystem 20 consists of a compound eye sensor 201, a compound eye image reconstruction server 202, and a compound eye image storage server 203. The compound eye panoramic perception subsystem 20 may also include a user terminal 204 for user control of the subsystem. The compound eye panoramic perception subsystem 20 completes the full-range image data acquisition, analysis, reconstruction, and panoramic image data output of the open-pit mine. The integrated management platform 10 is a multi-service integrated management platform with integrated management functions encompassing multiple services, multiple systems, and highly visualized visualization. It should also be noted that the integrated management platform 10 and the compound eye panoramic perception subsystem 20 transmit data via a communication optical cable line and a local area network (LAN) Ethernet.

[0040] Specifically, the compound eye sensor 201 is a customized M×N compound eye sensor based on compound eye imaging technology, designed and developed according to the basic information of the open-pit mine and the mine's requirements for imaging clarity. The basic information of the open-pit mine includes at least one of the following: the area of ​​the existing working area, the area of ​​the working area to be expanded in the future, the length, width and elevation of the open-pit mine opening, information on the surrounding natural conditions, and requirements for visualized production and safety management.

[0041] Preferably, the compound eye sensor 201 has no fewer than 50 lenses (10*5 array or 13*4 array), and each lens module has no fewer than 8 million pixels. In addition, the total number of pixels acquired by the compound eye sensor 201 is no less than 400 million pixels, and the panoramic aspect ratio is 7:1 or 4:1.

[0042] In addition, the lens module of the compound eye sensor 201 adopts a customized non-uniform focal length design, with a focal length of 4mm in the central area and 12mm in the edge area, forming a gradual field of view coverage. The module integrates a variable aperture driven by a micro stepper motor, with an aperture range from F1.6 to F8, which can automatically adjust according to the ambient light intensity to ensure all-weather imaging quality.

[0043] like Figure 3 In this embodiment, multiple compound eye sensors 201 are deployed in the open-pit mine based on its basic information to collect image information of the entire open-pit mine area. For example, the compound eye panoramic perception system specifically includes three compound eye panoramic perception subsystems, and the compound eye sensors in each subsystem are deployed at different locations in the open-pit mine.

[0044] Furthermore, the compound eye panoramic perception subsystem 20 also includes: a high-speed PTZ camera;

[0045] The high-speed PTZ camera is connected to the input terminal of the compound eye image reconstruction server.

[0046] Preferably, the high-speed PTZ camera has 4 million pixels, a focal length of 6.7 mm to 400 mm, and an optical zoom of 60x. Additionally, the high-speed PTZ camera has the following field-of-view parameters: a horizontal range of 360° and a vertical range of -20° to 90°.

[0047] In addition, the high-speed PTZ camera can also be equipped with a dual-spectrum fusion lens, with visible light and infrared optical channels within the lens assembly. A stepper motor switches filters to achieve adaptive day / night imaging modes. The high-altitude PTZ camera and the compound eye sensor are mechanically linked via a gear set. When the compound eye system detects an abnormal temperature area, the high-speed PTZ camera can quickly turn and activate infrared enhancement mode for close-up monitoring.

[0048] In this embodiment, a high-speed PTZ camera is configured for each compound eye sensor to acquire image information of a specific local area. Therefore, the compound eye panoramic perception system also supports managers to identify detailed information of a certain point in the whole picture, such as the appearance of people entering and leaving, the license plate of vehicles entering and leaving, etc. At this time, the manager can use the mouse to start the high-speed intelligent PTZ camera of this system, and then select the point to be identified. The identification details (ultra-high definition) image of the point of interest is then presented in another floating window above the panoramic video.

[0049] Furthermore, such as Figure 4 As shown, the compound eye sensor 201 is mounted on the support platform 302 via the adjustable support 301, and the support platform 302 is mounted on the iron tower 303;

[0050] The adjustable support 301 is used to adjust the elevation and depression angles of the compound eye sensor. Additionally, the height of the tower 303 can be between 5 and 15 meters.

[0051] Furthermore, in this embodiment, the compound eye image reconstruction server 202 is used to encode, reconstruct, and perform pixel-level video fusion on the M×N sub-field-of-view video acquired by the compound eye sensor 201; the compound eye image reconstruction server 202 is embedded with video reconstruction management software customized for different acquisition arrays. The compound eye image storage server 203 is used to store the M×N sub-field-of-view video acquired by the compound eye sensor 201 and synchronously output the video stream to the integrated management platform 10; the compound eye image storage server 203 is embedded with video storage management software customized for different acquisition arrays.

[0052] Specifically, the compound eye image storage server 203 includes: a storage module, a data hard disk, and a processing module;

[0053] The storage module is connected to the compound eye image reconstruction server 202 and the data hard disk, respectively. The storage module is used to store the image information received from the compound eye image reconstruction server 202 into the data hard disk.

[0054] The processing module is connected to the data hard disk and the platform management server 101 respectively. The processing module is used to send the image information retrieved from the data hard disk to the platform management server 101.

[0055] In this embodiment, the compound eye image storage server 203 performs synchronous storage, cyclic overlay, data redundancy backup, event image archiving, and historical data query and retrieval functions for video data from compound eye sensors (including high-speed PTZ cameras), high-low linkage video surveillance, and other devices. The compound eye image storage server 203 also has the function of real-time recording of video data and alarm event screenshots, as well as query and retrieval of historical data. Furthermore, for the supporting data storage subsystem of the billion-pixel compound eye panoramic perception system, the compound eye image storage server 203 can achieve high-bandwidth concurrent writing of multiple high-definition video streams, concurrent retrieval of multiple streams by multiple users at different time periods, and strict synchronization of the timing of each video stream under the condition of multiple retrievals by the same user, thus providing a dedicated compound eye storage server independent of other general-purpose video storage systems.

[0056] Furthermore, the integrated management platform 10 also includes: a real-time streaming media gateway;

[0057] The real-time streaming media gateway is used to allow multiple user accounts to use the integrated management platform 10 simultaneously.

[0058] Furthermore, in this embodiment, the display screen 103 can be a video wall, a PC terminal display screen, or a mobile terminal display screen, and can support up to 20 users to independently view panoramic image information through a real-time streaming media gateway.

[0059] Preferably, when the display screen 103 is a video wall, the display screen 103 is 18 (arranged in 3*6) 65-inch 4K high-definition LCD ultra-narrow bezel splicing screens; wherein, the double-sided splicing bezel is 3.5mm, the physical resolution is 3840*2160, the contrast ratio is 4500:1, and the single screen size is 1433.4*808.4mm.

[0060] When the display screen 103 is a video wall, it includes: a resource module, a configuration module, a video visualization module, a service module, and a network module. The resource module is used to obtain image images from the display management server; the configuration module is used to configure the video wall locally; the video visualization module is used to display image images; the service module is used for scene management and window operations; and the network module is used to handle HTTP / HTTPS message requests and responses. Window operations include: opening a window (creating a new layer on the window), window roaming (dragging the window to change its position and size), and window splitting or splicing.

[0061] Furthermore, the integrated management platform 10 also includes a speaker connected to the platform management server 101.

[0062] In this embodiment, when an abnormal situation is detected, a warning voice can be played through a speaker to achieve the effect of warning and reminder.

[0063] The compound-eye panoramic perception system provided in this embodiment can output a complete panoramic video monitoring image of the production site from a relatively high vantage point. The panoramic video image features ultra-large range, ultra-high resolution, and distortion-free characteristics, possessing attributes such as integrity and continuity. Through the panoramic video monitoring image, managers can have a complete view of the entire production site, achieving a high-altitude overview of the entire production site. This allows managers to have macro-level control over the open-pit mine's production operations, monitor on-site operations in real time, promptly identify potential problems, and quickly take measures to resolve them. This helps ensure safe production operations and reduce the risk of accidents. This system is rationally designed, simple in structure, and fully functional, meeting practical needs and effectively improving work efficiency to satisfy the requirements of video monitoring. It can also transmit images and data from the scene of emergencies to the monitoring center in a timely manner, facilitating command and dispatch.

[0064] The above are merely preferred embodiments of this utility model and do not limit the patent scope of this utility model. Any equivalent structural or procedural transformations made based on the description and drawings of this utility model, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this utility model.

Claims

1. A compound eye panoramic perception system, characterized in that, The system includes: an integrated management platform, and multiple compound eye panoramic perception subsystems connected to the integrated management platform; The compound eye panoramic perception subsystem includes: a compound eye sensor for collecting image information within a designated area of ​​an open-pit mine, a compound eye image reconstruction server, and a compound eye image storage server; the input end of the compound eye image reconstruction server is connected to the compound eye sensor, and the output end of the compound eye image reconstruction server is connected to the compound eye image storage server. The integrated management platform includes: a platform management server, a display management server, and a display screen; the platform management server is connected to the compound eye sensor, the compound eye image reconstruction server, the compound eye image storage server, and the display management server respectively; the display management server is also connected to the display screen, and the display management server is used to obtain image information from the platform management server and send it to the display screen for visualization display; The multiple compound eye sensors in the multiple compound eye panoramic perception subsystem can collect image information of the entire open-pit mine area.

2. The compound eye panoramic perception system according to claim 1, characterized in that, The compound eye sensor has no fewer than 50 lenses, and each lens module has no fewer than 8 million pixels.

3. The compound eye panoramic perception system according to claim 1, characterized in that, The compound eye panoramic perception subsystem also includes: a high-speed PTZ camera; The high-speed PTZ camera is connected to the input terminal of the compound eye image reconstruction server.

4. The compound eye panoramic perception system according to claim 3, characterized in that, The high-speed PTZ camera has 4 million pixels, a focal length of 6.7 mm to 400 mm, and an optical zoom of 60x.

5. The compound eye panoramic perception system according to claim 1, characterized in that, The compound eye sensor is mounted on a support platform via an adjustable bracket, and the support platform is mounted on the iron tower. The adjustable support is used to adjust the pitch and tilt angles of the compound eye sensor.

6. The compound eye panoramic perception system according to claim 1, characterized in that, The compound eye image storage server includes: a storage module, a data hard disk, and a processing module; The storage module is connected to both the compound eye image reconstruction server and the data hard disk, and is used to store the image information received from the compound eye image reconstruction server into the data hard disk. The processing module is connected to the data hard drive and the platform management server respectively, and the processing module is used to send the image information from the data hard drive to the platform management server.

7. The compound eye panoramic perception system according to claim 1, characterized in that, The integrated management platform also includes: a real-time streaming media gateway; The real-time streaming media gateway is used to allow multiple user accounts to use the integrated management platform simultaneously.

8. The compound eye panoramic perception system according to claim 1, characterized in that, The integrated management platform also includes a speaker connected to the platform management server.

9. The compound eye panoramic perception system according to claim 1, characterized in that, The integrated management platform and the compound eye panoramic perception subsystem transmit data via a communication optical cable and a local area Ethernet.

Images