Light imaging monitoring processing method and monitoring processing system based on regional dimension

Abstract

The application relates to the technical field of light imaging monitoring, and discloses a light imaging monitoring processing method and a monitoring processing system based on a region dimension, which comprises the following steps: for a determined target region to be monitored, analyzing an image collection device set capable of collecting a region image of the target region according to light imaging monitoring requirements; obtaining a region image set obtained by the image collection device set in the image collection device set collecting the region image of the target region; performing a matching analysis and processing operation on the region image set according to pre-determined light imaging monitoring requirements to obtain a light imaging monitoring result corresponding to the target region; wherein the light imaging monitoring result comprises at least one light parameter matched with the light imaging monitoring requirements. It can be seen that the application can realize intelligent light imaging monitoring in the region dimension according to the image collection result of the image collection device matched with the region to be monitored, and is beneficial to improving the light imaging monitoring efficiency and monitoring accuracy.

Description

Technical Field

[0001] This invention relates to the field of optical imaging monitoring technology, and in particular to an optical imaging monitoring and processing method and system based on region dimension. Background Technology

[0002] Optical imaging monitoring has wide-ranging application value and significance in various fields. In practical applications, it enables intelligent monitoring and analysis of optical imaging results to obtain the required target parameters. These parameters can then be further analyzed intelligently or used as an important basis for actual decision-making. For example, in agriculture, optical imaging monitoring can be used to monitor crop growth, enabling timely detection of abnormal crop growth and / or targeted control of crop growth.

[0003] Practice has shown that remote sensing satellite monitoring technology is relatively mature, enabling the effective monitoring of many parameters at the Earth level (such as light, sound, climate, and gas composition). However, remote sensing satellite monitoring technology only monitors relevant light parameters at the intensity level of sky light, lacking precise surface-level light imaging monitoring methods. Furthermore, traditional monitoring methods, such as illuminance meters, luminance meters, imaging luminance meters, and hyperspectral analyzers, while capable of performing light imaging monitoring of certain areas at the Earth's surface, suffer from low efficiency and low accuracy.

[0004] It is evident that improving the efficiency and accuracy of regional-level optical imaging monitoring is a pressing technical issue that needs to be addressed. Summary of the Invention

[0005] This invention provides a region-based optical imaging monitoring and processing method and system, which can realize intelligent optical imaging monitoring in the region dimension, and is conducive to improving the efficiency and accuracy of optical imaging monitoring.

[0006] To address the aforementioned technical problems, a first aspect of the present invention discloses a region-dimensional optical imaging monitoring and processing method, the method comprising:

[0007] For the identified target area to be monitored, an image acquisition device set that can acquire regional images of the target area is analyzed based on the pre-determined optical imaging monitoring requirements. The image acquisition device set includes at least one type of image acquisition device subset, and each type of image acquisition device subset includes at least one image acquisition device.

[0008] Obtain the set of regional images obtained by the image acquisition devices in the image acquisition device set performing regional image acquisition on the target area;

[0009] According to the optical imaging monitoring requirements, the set of regional images is subjected to matching analysis and processing operations to obtain the optical imaging monitoring results corresponding to the target region; wherein, the optical imaging monitoring results include at least one optical parameter that matches the optical imaging monitoring requirements.

[0010] As an optional implementation, in the first aspect of the present invention, the step of performing a matching analysis and processing operation on the set of regional images according to the optical imaging monitoring requirements to obtain the optical imaging monitoring result corresponding to the target region includes:

[0011] Based on the optical imaging monitoring requirements, determine the type of performance characteristic information that matches the optical imaging monitoring requirements;

[0012] Based on the performance characteristic information type, a matching analysis and processing operation is performed on the set of regional images to obtain the light imaging monitoring result corresponding to the target region.

[0013] As an optional implementation, in the first aspect of the present invention, the method further includes:

[0014] After obtaining the optical imaging monitoring results, the optical parameters in the optical imaging monitoring results are fused into the three-dimensional spatial distribution corresponding to the target area to obtain the three-dimensional optical information spatial distribution corresponding to the target area, and the three-dimensional optical information spatial distribution is output to the visualization interface, and / or, an optical information application model for diagnosis and / or evaluation is constructed based on the three-dimensional optical information spatial distribution;

[0015] And / or,

[0016] After obtaining the optical imaging monitoring results, a surface-level optical information detection result is generated based on the optical imaging monitoring results corresponding to the target area, and a mapping relationship is constructed between at least two of the surface-level optical information detection results, remote sensing satellite optical information detection results, and low-altitude optical information detection results.

[0017] And / or,

[0018] After obtaining the optical imaging monitoring results, a mapping relationship is constructed between the optical parameters in the optical imaging monitoring results and the application requirements corresponding to the optical imaging monitoring requirements; wherein, the optical imaging monitoring requirements include one or more combinations of environmental monitoring requirements, agricultural monitoring requirements, low-altitude economic monitoring requirements, and industrial monitoring requirements.

[0019] The optical parameters in the optical imaging monitoring results include at least one of brightness, color distribution, characteristic spectrum, reflectance, and illuminance.

[0020] As an optional implementation, in the first aspect of the present invention, outputting the spatial distribution of the three-dimensional light information to a visualization interface includes:

[0021] Based on the predetermined visualization requirements, the output control parameters corresponding to the spatial distribution of the three-dimensional light information are determined. The output control parameters include at least one or more of the following: target visualization dimension, target visualization viewpoint, visualization dimension switching attribute, visualization viewpoint switching attribute, and variable information display attribute.

[0022] Based on the output control parameters, the spatial distribution of the three-dimensional light information is output to the visualization interface.

[0023] As an optional implementation, in the first aspect of the present invention, after obtaining the set of regional images obtained by the image acquisition devices in the image acquisition device set from the regional image acquisition devices in the target area, and before performing a matching analysis and processing operation on the regional image set according to the optical imaging monitoring requirements to obtain the optical imaging monitoring result corresponding to the target area, the method further includes:

[0024] After obtaining the set of regional images, the regional images in the set of regional images are classified according to the device information corresponding to the image acquisition device of each regional image in the set of regional images, resulting in multiple regional image subsets.

[0025] For each region image in the region image subset, a matching preprocessing operation is performed on the region image in the region image subset according to a predetermined preprocessing method;

[0026] After performing matching preprocessing operations on the region images in all the region image subsets, all the preprocessed region images are determined as the region image set that needs to be analyzed and processed.

[0027] As an optional implementation, in the first aspect of the present invention, the set of image acquisition devices capable of acquiring regional images of the target area, based on a predetermined optical imaging monitoring requirement analysis, for a determined target area to be monitored, includes:

[0028] For the identified target area to be monitored, the first type of image acquisition resources are determined based on the installation status of image acquisition devices within the target area;

[0029] Based on the target mobile image acquisition device corresponding to the target area and the inspection schedule of the target mobile image acquisition device, the second type of image acquisition resources are determined;

[0030] The third type of image acquisition resource is determined based on the mobile image acquisition device appearing in the target area and the movement of the mobile image acquisition device in the target area;

[0031] Based on the first type of image acquisition resources, the second type of image acquisition resources, the third type of image acquisition resources, and the predetermined optical imaging monitoring requirements, analyze the set of image acquisition devices capable of acquiring regional images of the target area;

[0032] The target mobile image acquisition device includes a mobile image acquisition device applied to the target area and / or a schedulable mobile image acquisition device applied to the adjacent area of ​​the target area.

[0033] As an optional implementation, in the first aspect of the present invention, after analyzing a set of image acquisition devices capable of acquiring regional images of the target area based on a pre-determined optical imaging monitoring requirement for the identified target area, the method further includes:

[0034] Based on the predetermined optical imaging monitoring requirements, a matching image acquisition parameter calibration operation is performed on each target image acquisition device in the image acquisition device set that does not belong to the third type of image acquisition resources. The image acquisition parameter calibration operation is used to calibrate the imaging effect of the target image acquisition device.

[0035] And / or,

[0036] Based on the predetermined optical imaging monitoring requirements, for each target image acquisition device in the image acquisition device set that does not belong to the third type of image acquisition resources, image acquisition control parameters matching the target image acquisition device are generated; wherein, for a target image acquisition device belonging to the first type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least the image acquisition angle and / or the image acquisition range; for a target image acquisition device belonging to the second type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least one of the following: image acquisition path, multiple image acquisition points on the image acquisition path, maximum dwell time at each image acquisition point, image acquisition angle at each image acquisition point, image acquisition range at each image acquisition point, and image acquisition height at each image acquisition point.

[0037] As an optional implementation, in the first aspect of the present invention, the optical imaging monitoring result corresponding to the target area specifically includes at least one optical parameter in a plurality of sub-detection areas; wherein, the plurality of sub-detection areas are divided into the target area according to the target detection parameters corresponding to the image acquisition devices in the image acquisition device set, and the target detection parameters include at least one of detection spectrum, imaging intensity and imaging resolution;

[0038] The method further includes:

[0039] Based on the target detection parameters corresponding to the image acquisition device of each sub-detection region and at least one optical parameter in each sub-detection region, a coverage and mapping relationship between the optical parameters of multiple sub-detection regions is constructed.

[0040] As an optional implementation, in the first aspect of the present invention, the application requirements corresponding to the environmental monitoring requirements include one or more combinations of water quality monitoring requirements, atmospheric composition monitoring requirements, and ecological environment monitoring requirements.

[0041] The agricultural monitoring needs include one or more combinations of crop growth monitoring needs, pest and disease monitoring needs, and precision agricultural management needs.

[0042] The low-altitude economic monitoring needs include one or more combinations of low-altitude economic lighting monitoring needs, low-altitude economic light pollution monitoring needs, and low-altitude economic flight needs.

[0043] The industrial monitoring needs include energy consumption analysis needs and / or object recognition needs.

[0044] A second aspect of the present invention discloses a monitoring and processing system, the monitoring and processing system comprising:

[0045] The resource acquisition and analysis module is used to analyze, based on the predetermined optical imaging monitoring requirements, a set of image acquisition devices capable of acquiring regional images of the target area, for a determined target area to be monitored. The set of image acquisition devices includes at least one type of image acquisition device subset, and each type of image acquisition device subset includes at least one image acquisition device.

[0046] The region image acquisition module is used to acquire a set of region images obtained by the image acquisition devices in the image acquisition device set when they acquire region images of the target region.

[0047] The optical imaging monitoring module is used to perform matching analysis and processing operations on the set of regional images according to the optical imaging monitoring requirements, so as to obtain the optical imaging monitoring results corresponding to the target region; wherein, the optical imaging monitoring results include at least one optical parameter that matches the optical imaging monitoring requirements.

[0048] As an optional implementation, in the second aspect of the present invention, the optical imaging monitoring module performs matching analysis and processing operations on the region image set according to the optical imaging monitoring requirements to obtain the optical imaging monitoring result corresponding to the target region in the following specific ways:

[0049] Based on the optical imaging monitoring requirements, determine the type of performance characteristic information that matches the optical imaging monitoring requirements;

[0050] Based on the performance characteristic information type, a matching analysis and processing operation is performed on the set of regional images to obtain the light imaging monitoring result corresponding to the target region.

[0051] As an optional implementation, in a second aspect of the invention, the monitoring and processing system further includes:

[0052] The optical information processing module is configured to, after obtaining the optical imaging monitoring results, fuse the optical parameters in the optical imaging monitoring results into the three-dimensional spatial distribution corresponding to the target area to obtain the three-dimensional optical information spatial distribution corresponding to the target area, and output the three-dimensional optical information spatial distribution to a visualization interface; and / or, construct an optical information application model for diagnosis and / or evaluation based on the three-dimensional optical information spatial distribution; and / or, after obtaining the optical imaging monitoring results, generate surface-level optical information detection results based on the optical imaging monitoring results corresponding to the target area, and construct a mapping relationship between at least two of the surface-level optical information detection results, remote sensing satellite optical information detection results, and low-altitude optical information detection results; and / or, after obtaining the optical imaging monitoring results, construct a mapping relationship between the optical parameters in the optical imaging monitoring results and the application requirements corresponding to the optical imaging monitoring requirements; wherein, the optical imaging monitoring requirements include one or more combinations of environmental monitoring requirements, agricultural monitoring requirements, low-altitude economic monitoring requirements, and industrial monitoring requirements;

[0053] The optical parameters in the optical imaging monitoring results include at least one of brightness, color distribution, characteristic spectrum, reflectance, and illuminance.

[0054] As an optional implementation, in the second aspect of the present invention, the optical information processing module outputs the three-dimensional optical information spatial distribution to the visualization interface in the following specific ways:

[0055] Based on the predetermined visualization requirements, the output control parameters corresponding to the spatial distribution of the three-dimensional light information are determined. The output control parameters include at least one or more of the following: target visualization dimension, target visualization viewpoint, visualization dimension switching attribute, visualization viewpoint switching attribute, and variable information display attribute.

[0056] Based on the output control parameters, the spatial distribution of the three-dimensional light information is output to the visualization interface.

[0057] As an optional implementation, in a second aspect of the invention, the monitoring and processing system further includes:

[0058] The image classification preprocessing module is used to, after acquiring the set of regional images, classify the regional images in the set of regional images according to the device information corresponding to the image acquisition device of each regional image in the set of regional images, and obtain multiple regional image subsets; for each regional image in the regional image subset, perform a matching preprocessing operation on the regional images in the regional image subset according to a predetermined preprocessing method; after performing the matching preprocessing operation on the regional images in all the regional image subsets, determine all the preprocessed regional images as the set of regional images that need to be analyzed and processed.

[0059] As an optional implementation, in the second aspect of the present invention, for a determined target area to be monitored, the resource acquisition module analyzes the set of image acquisition devices capable of acquiring regional images of the target area based on pre-determined optical imaging monitoring requirements, including the following specific methods:

[0060] For the identified target area to be monitored, the first type of image acquisition resources are determined based on the installation status of image acquisition devices within the target area;

[0061] Based on the target mobile image acquisition device corresponding to the target area and the inspection schedule of the target mobile image acquisition device, the second type of image acquisition resources are determined;

[0062] The third type of image acquisition resource is determined based on the mobile image acquisition device appearing in the target area and the movement of the mobile image acquisition device in the target area;

[0063] Based on the first type of image acquisition resources, the second type of image acquisition resources, the third type of image acquisition resources, and the predetermined optical imaging monitoring requirements, analyze the set of image acquisition devices capable of acquiring regional images of the target area;

[0064] The target mobile image acquisition device includes a mobile image acquisition device applied to the target area and / or a schedulable mobile image acquisition device applied to the adjacent area of ​​the target area.

[0065] As an optional implementation, in a second aspect of the invention, the monitoring and processing system further includes:

[0066] The acquisition device control module is configured to perform a matching image acquisition parameter calibration operation on each target image acquisition device in the image acquisition device set that does not belong to the third type of image acquisition resources, based on predetermined optical imaging monitoring requirements. The image acquisition parameter calibration operation is used to calibrate the imaging effect of the target image acquisition device. And / or, based on predetermined optical imaging monitoring requirements, it generates image acquisition control parameters matching each target image acquisition device in the image acquisition device set that does not belong to the third type of image acquisition resources. For a target image acquisition device belonging to the first type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least an image acquisition angle and / or an image acquisition range. For a target image acquisition device belonging to the second type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least one of the following: an image acquisition path, multiple image acquisition points on the image acquisition path, a maximum dwell time at each image acquisition point, an image acquisition angle at each image acquisition point, an image acquisition range at each image acquisition point, and an image acquisition height at each image acquisition point.

[0067] As an optional implementation, in the second aspect of the present invention, the optical imaging monitoring result corresponding to the target area specifically includes at least one optical parameter in a plurality of sub-detection areas; wherein, the plurality of sub-detection areas are divided into the target area according to the target detection parameters corresponding to the image acquisition devices in the image acquisition device set, and the target detection parameters include at least one of detection spectrum, imaging intensity and imaging resolution;

[0068] The optical imaging monitoring module is further configured to construct a coverage and mapping relationship between the optical parameters of multiple sub-detection regions based on the target detection parameters corresponding to the image acquisition device corresponding to each sub-detection region and at least one optical parameter in each sub-detection region.

[0069] As an optional implementation, in the second aspect of the present invention, the application requirements corresponding to the environmental monitoring requirements include one or more combinations of water quality monitoring requirements, atmospheric composition monitoring requirements, and ecological environment monitoring requirements.

[0070] The agricultural monitoring needs include one or more combinations of crop growth monitoring needs, pest and disease monitoring needs, and precision agricultural management needs.

[0071] The low-altitude economic monitoring needs include one or more combinations of low-altitude economic lighting monitoring needs, low-altitude economic light pollution monitoring needs, and low-altitude economic flight needs.

[0072] The industrial monitoring requirements include energy consumption analysis and / or object identification.

[0073] A third aspect of the present invention discloses a monitoring and processing system, the monitoring and processing system comprising:

[0074] Memory containing executable program code;

[0075] A processor coupled to the memory;

[0076] The processor calls the executable program code stored in the memory to execute some or all of the steps in the region-dimensional optical imaging monitoring processing method according to any of the first aspects of the present invention.

[0077] The fourth aspect of the present invention discloses a computer storage medium storing computer instructions, which, when invoked, are used to execute some or all of the steps in the region-dimensional optical imaging monitoring processing method described in any of the first aspects of the present invention.

[0078] Compared with the prior art, the present invention has the following beneficial effects:

[0079] In this embodiment of the invention, after determining the target area to be monitored (such as a city-level target area), the set of image acquisition devices capable of acquiring regional images of the target area is first analyzed according to the optical imaging monitoring requirements. Then, the set of regional images obtained by the image acquisition devices in the set of image acquisition devices acquiring regional images of the target area is obtained. Based on the pre-determined optical imaging monitoring requirements, the set of regional images is subjected to matching analysis and processing operations to obtain the optical imaging monitoring results corresponding to the target area. It is evident that this invention can achieve intelligent optical imaging monitoring based on the image acquisition results of image acquisition devices matching the area to be monitored. Compared to remote sensing satellites, it achieves surface-level optical imaging monitoring, which is beneficial for improving the accuracy of optical imaging monitoring. Furthermore, compared to manual acquisition using relevant optical parameter acquisition devices, it is also beneficial for improving the efficiency and reliability of optical imaging monitoring, thereby providing reliable and effective analytical / decision-making basis for actual analytical needs. Attached Figure Description

[0080] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0081] Figure 1 This is a schematic flowchart of a region-dimensional optical imaging monitoring and processing method disclosed in an embodiment of the present invention;

[0082] Figure 2 This is a schematic flowchart of another region-dimensional optical imaging monitoring and processing method disclosed in an embodiment of the present invention;

[0083] Figure 3 This is a schematic flowchart of another region-dimensional optical imaging monitoring and processing method disclosed in an embodiment of the present invention;

[0084] Figure 4 This is a schematic diagram of an urban road network optical environment detection and diagnosis based on an unmanned aerial vehicle (UAV) disclosed in an embodiment of the present invention;

[0085] Figure 5 This is a schematic diagram of a camera-based urban road network light environment detection and diagnosis disclosed in an embodiment of the present invention;

[0086] Figure 6 This is a schematic diagram of the structure of a monitoring and processing system disclosed in an embodiment of the present invention;

[0087] Figure 7 This is a schematic diagram of another monitoring and processing system disclosed in an embodiment of the present invention;

[0088] Figure 8 This is a schematic diagram of the structure of another monitoring and processing system disclosed in an embodiment of the present invention. Detailed Implementation

[0089] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0090] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or end that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or ends.

[0091] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0092] This invention discloses a region-based optical imaging monitoring and processing method and system. It enables intelligent optical imaging monitoring based on image acquisition results from image acquisition devices matched to the monitored area. Compared to remote sensing satellites, it achieves surface-level optical imaging monitoring, which improves the accuracy of optical imaging monitoring. Furthermore, compared to manual acquisition using relevant optical parameter acquisition devices, it also improves the efficiency and reliability of optical imaging monitoring, thus providing reliable and effective analytical / decision-making basis for actual analytical needs. Detailed descriptions follow.

[0093] Example 1

[0094] Please see Figure 1 , Figure 1 This is a schematic flowchart of a region-dimensional optical imaging monitoring and processing method disclosed in an embodiment of the present invention. Figure 1 The described method is used at least to achieve surface-level optical imaging monitoring and is applied to a monitoring and processing system, which can be integrated into a cloud server or a local device; this embodiment of the invention does not limit this. Figure 1 As shown, this region-dimensional optical imaging monitoring processing method may include the following operations:

[0095] 101. For the identified target area to be monitored, analyze the set of image acquisition devices that can collect regional images of the target area based on the pre-determined optical imaging monitoring requirements.

[0096] In this embodiment of the invention, the target area to be monitored can be determined manually, or it can be intelligently determined from a given large area or a given number of candidate areas according to actual needs. This embodiment of the invention does not impose any limitations. For example, if it is necessary to analyze the impact of light on crop growth, the target area to be monitored can be an area with extensive crop coverage.

[0097] In this embodiment of the invention, after determining the target area to be monitored, the set of image acquisition devices capable of acquiring regional images of the target area is further analyzed. This set of image acquisition devices can also be understood as the image acquisition resources required for optical imaging monitoring of the target area. Preferably, the primary condition that the image acquisition devices in the set must meet is that the comprehensive acquisition range corresponding to the set must be able to cover the key areas and / or key features of the target area. If the comprehensive acquisition range corresponding to the initially analyzed set of image acquisition devices cannot cover the key areas and / or key features of the target area, the required image acquisition resources need to be re-analyzed to ensure the comprehensiveness of regional image acquisition, thereby improving the accuracy of optical imaging analysis. Furthermore, the analyzed set of image acquisition devices may include at least one type of image acquisition device subset, and each type of image acquisition device subset includes at least one image acquisition device.

[0098] Furthermore, according to type, the image acquisition device set can include fixedly installed cameras and / or mobile image acquisition drones (such as inspection drones, transport drones, and operational drones). It can also include auxiliary image acquisition devices such as mobile phones, cameras, and dashcams that appear in the target area to acquire images; this embodiment of the invention does not limit this. It should be specifically noted that the monitoring and processing system can determine whether a mobile phone, camera, or dashcam appears in the target area based on its location data. It can further determine whether a mobile phone, camera, or dashcam appears in the target area based on the location information carried in the image / video data acquired by the mobile phone, camera, or dashcam. It can also further identify the frequency and duration of the mobile phone, camera, or dashcam's presence in the target area, which can be used as the basis for analyzing whether it can be used as an image acquisition device in the image acquisition device set. It should be specifically noted that mobile phones, cameras, and dashcams are private property of individuals or groups. Before using them as image acquisition resources for optical imaging monitoring, priority should be given to obtaining authorization from the authorized user, or accessing publicly available image / video data acquired by them for the target area that meets the requirements of optical imaging monitoring.

[0099] 102. Obtain the set of regional images obtained by the image acquisition devices in the image acquisition device set when they perform regional image acquisition on the target area.

[0100] In this embodiment of the invention, the regional image set includes multiple regional images of the target region. Optionally, for image acquisition resources capable of real-time image acquisition control (such as surveillance cameras or drones), when optical imaging monitoring is required, they can be controlled to perform image acquisition operations on the target region; for image acquisition resources that cannot perform real-time image acquisition control (which can also be understood as image acquisition auxiliary resources, such as mobile phones, cameras, dashcams, etc.), when optical imaging monitoring is required, the latest historical image of the target region that can be authorized for use can be obtained. This embodiment of the invention does not impose any limitations.

[0101] 103. Based on the requirements of optical imaging monitoring, perform matching analysis and processing operations on the regional image set to obtain the optical imaging monitoring results corresponding to the target region.

[0102] In this embodiment of the invention, the optical imaging monitoring result includes at least one optical parameter matching the optical imaging monitoring requirements. The optical parameters in the optical imaging monitoring result may include, but are not limited to, one or more combinations of relevant optical parameters such as brightness, color distribution, characteristic spectrum, reflectance, and illuminance, specifically determined according to the optical imaging monitoring requirements. Brightness and color information represent the characteristics of the human eye's viewing angle (observation angle). Before image acquisition, the image acquisition angle and / or image acquisition trajectory of the image acquisition device need to be set according to the requirements. More specifically, when testing the brightness of a downward viewing angle, the image acquisition angle of the image acquisition device is set to be aligned with the ground, i.e., perpendicular to the ground at a 90-degree angle; when testing the brightness of a vertical surface, the image acquisition angle of the image acquisition device needs to be set to be aligned with the vertical surface (i.e., the wall), i.e., perpendicular to the vertical surface at a 90-degree angle and parallel to the ground. Image acquisition is performed based on the set image acquisition device to simulate the brightness and color distribution of a moving observation angle.

[0103] Optionally, optical imaging monitoring needs include, but are not limited to, one or more combinations of environmental monitoring needs, agricultural monitoring needs, low-altitude economic monitoring needs, and industrial monitoring needs. Further, environmental monitoring needs may include one or more combinations of water quality monitoring needs, atmospheric composition monitoring needs, and ecological environment monitoring needs; agricultural monitoring needs may include one or more combinations of crop growth monitoring needs, pest and disease monitoring needs, and precision agriculture management needs; low-altitude economic monitoring needs may include one or more combinations of low-altitude economic lighting monitoring needs, low-altitude economic light pollution monitoring needs, and low-altitude economic flight needs; and industrial monitoring needs may include energy consumption analysis needs and / or object recognition needs.

[0104] Furthermore, for ecological environment monitoring needs within environmental monitoring requirements, the required light parameters can include one or more combinations of object reflectance, horizontal illuminance, and vertical illuminance. Object reflectance is calculated based on the solar spectrum and object color information obtained during daytime monitoring. Horizontal and vertical illuminance are calculated from brightness and object reflectance. The relevant light parameters obtained from optical imaging monitoring can be fused or mapped to the three-dimensional spatial distribution corresponding to the target area to construct a three-dimensional spatial distribution-based light environment diagnostic model and light pollution assessment model. Furthermore, brightness is obtained through conventional image analysis of the area image. Even further, the ability to fuse or map the relevant light parameters obtained from optical imaging monitoring to the three-dimensional spatial distribution corresponding to the target area to construct a three-dimensional spatial distribution-based light environment diagnostic model and light pollution assessment model can specifically include:

[0105] After obtaining the optical imaging monitoring results, the optical parameters in the optical imaging monitoring results are fused into the three-dimensional spatial distribution corresponding to the target area to obtain the three-dimensional optical information spatial distribution corresponding to the target area. Then, an optical information application model for diagnosis and / or evaluation is constructed based on the three-dimensional optical information spatial distribution.

[0106] Furthermore, regarding the monitoring needs of the low-altitude economy, the system can detect and evaluate the functional lighting requirements of the low-altitude economy based on the relevant light parameters in the optical imaging monitoring results, and then use this as a basis for functional lighting control; or, it can detect and evaluate the light pollution requirements of the low-altitude economy based on the relevant light parameters in the optical imaging monitoring results; or, it can detect and evaluate the flight route planning requirements of the low-altitude economy based on the relevant light parameters in the optical imaging monitoring results, and then use this as a basis for flight route planning.

[0107] Furthermore, for agricultural monitoring needs, it is possible to analyze the reflection characteristics, color characteristics, and morphological characteristics of relevant crops based on the light parameters in the light imaging monitoring results, and then analyze the spectral characteristics of relevant crops at different stages, and perform mapping between relevant parameters such as color and brightness and the spectral characteristics at different stages.

[0108] Furthermore, for atmospheric composition monitoring needs, the spectral characteristics of the gas of interest, including reflection and absorption characteristics, can be obtained based on the optical parameters in the optical imaging monitoring results. Then, the spectral characteristics of the gas of interest can be analyzed, and the mapping between relevant parameters such as color and brightness and the spectral characteristics of the gas of interest can be performed.

[0109] As can be seen, the method described in the embodiments of the present invention can realize intelligent optical imaging monitoring based on the image acquisition results of the image acquisition device that matches the area to be monitored. Compared with remote sensing satellites, it realizes ground-level optical imaging monitoring, which is conducive to improving the accuracy of optical imaging monitoring. In addition, compared with manual acquisition using relevant optical parameter acquisition equipment, it is also conducive to improving the efficiency and reliability of optical imaging monitoring, thereby providing reliable and effective analysis basis / decision basis for actual analysis needs.

[0110] In an optional embodiment, the aforementioned set of image acquisition devices capable of acquiring regional images of the determined target area, based on pre-determined optical imaging monitoring requirements, may include:

[0111] For the identified target area to be monitored, the first type of image acquisition resources are determined based on the installation status of image acquisition equipment within the target area. The first type of image acquisition resources can be understood as the installed camera resources.

[0112] Based on the target mobile image acquisition equipment corresponding to the target area and the inspection schedule of the target mobile image acquisition equipment, the second type of image acquisition resources are determined. The second type of image acquisition resources can be understood as the already deployed drone resources equipped with cameras, and may further include one or more combinations of inspection drone resources, transport drone resources, and other operational drone resources.

[0113] Based on the mobile image acquisition devices appearing in the target area and the movement of these devices within the target area, a third type of image acquisition resource is identified, such as mobile phones, cameras, and dashcams moving within the target area.

[0114] Based on the first type of image acquisition resources, the second type of image acquisition resources, the third type of image acquisition resources, and the predetermined optical imaging monitoring requirements, we analyze the set of image acquisition devices that can acquire regional images of the target area.

[0115] Optionally, the target mobile image acquisition device includes a mobile image acquisition device operating in the target area and / or a schedulable mobile image acquisition device operating in the adjacent area of ​​the target area.

[0116] In this embodiment of the invention, different categories of image acquisition resources have corresponding selection priorities. Furthermore, different categories of image acquisition resources have different selection priorities at different image acquisition times. For example, during peak periods of pedestrian and vehicle traffic, cameras may need to prioritize security monitoring, and their selection priority may be lower than that of drones; during off-peak periods of pedestrian and vehicle traffic, cameras may have a higher selection priority than drones. Furthermore, for each category of image acquisition resource, when multiple image acquisition devices are available, priority is given to image acquisition resources whose inherent application of area image acquisition for optical imaging monitoring is less than or equal to a preset impact threshold. For example, for an inspection drone, its inherent application is to perform inspection operations.

[0117] The schematic diagram of the work on urban road network light environment detection and diagnosis based on drones can be found in the attached diagram. Figure 4 A schematic diagram of camera-based urban road network optical environment detection and diagnosis can be found in [reference needed]. Figure 5 .

[0118] As can be seen, this optional embodiment can integrate and analyze the image acquisition resources that match the target area after determining the target area, so as to make full use of the appropriate image acquisition resources for regional image acquisition. This not only helps to improve the matching degree between the determined set of image acquisition devices and the actual needs, but also enables the rational use of image acquisition resources, thereby improving the utilization rate of image acquisition resources.

[0119] In another optional embodiment, the optical imaging monitoring result corresponding to the target region specifically includes at least one optical parameter within multiple sub-detection regions; wherein, the multiple sub-detection regions are divided into target regions based on the target detection parameters corresponding to the image acquisition devices in the image acquisition device set. Optionally, the aforementioned target detection parameters may include at least one of detection spectral band, imaging intensity, and imaging resolution. In this optional embodiment, the method may further include the following operations:

[0120] Based on the target detection parameters of the image acquisition device corresponding to each sub-detection area and at least one optical parameter in each sub-detection area, a coverage and mapping relationship between the optical parameters of multiple sub-detection areas is constructed.

[0121] As can be seen, this optional embodiment can also achieve fine division of the target area based on the target detection parameters corresponding to image acquisition devices with different acquisition ranges, dividing it into multiple sub-detection areas. Then, based on the target detection parameters of the image acquisition devices corresponding to the multiple sub-detection areas, a coverage and mapping relationship between the optical parameters of the multiple sub-detection areas can be constructed. This not only enables the calibration of optical parameters based on the aforementioned coverage and mapping relationship, which is beneficial to improving the accuracy and reliability of optical parameters, but also enables the mapping derivation of optical parameters based on the aforementioned coverage and mapping relationship, which is beneficial to improving the comprehensiveness of optical parameters.

[0122] Example 2

[0123] Please see Figure 2 , Figure 2 This is a schematic flowchart of another region-based optical imaging monitoring and processing method disclosed in an embodiment of the present invention. Figure 2 The described method is at least used to achieve surface-level optical imaging monitoring and is applied to a monitoring and processing system, which can be integrated into a cloud server or a local device; this embodiment of the invention does not limit this. Figure 2 As shown, this region-dimensional optical imaging monitoring processing method may include the following operations:

[0124] 201. For the identified target area to be monitored, analyze the set of image acquisition devices that can collect regional images of the target area based on the pre-determined optical imaging monitoring requirements.

[0125] 202. Based on the above-mentioned optical imaging monitoring requirements, perform image acquisition parameter calibration operations on the above-mentioned image acquisition device set and / or generate image acquisition control parameters corresponding to the above-mentioned image acquisition device set.

[0126] In this embodiment of the invention, the image acquisition parameter calibration operation is used to calibrate the imaging effect of the image acquisition device until the imaging effect of the image acquisition device meets the preset imaging requirements, such as making the brightness of the image acquired by the image acquisition device as close as possible to the true brightness. Preferably, the image acquisition device performing the image acquisition parameter calibration operation includes at least the first type of image acquisition resource and / or the second type of image acquisition resource mentioned in Embodiment 1. Further, performing the image acquisition parameter calibration operation on the above-mentioned set of image acquisition devices may include:

[0127] The method acquires multi-dimensional information corresponding to the image acquisition device and inputs this information into a pre-trained and converged acquisition parameter generation model to obtain the target acquisition parameters output by the model. Based on these target acquisition parameters, a matching acquisition parameter calibration operation is performed on the corresponding image acquisition device. Optionally, the multi-dimensional information corresponding to the image acquisition device includes one or more of the following: the area range corresponding to the image acquisition region of the image acquisition device, the device parameters corresponding to the image acquisition device, and the distribution of buildings within the image acquisition region. Therefore, this embodiment of the invention can calibrate the acquisition parameters of the image acquisition device by combining the multi-dimensional information corresponding to the image acquisition region with the target acquisition parameters generated by the acquisition parameter generation model. This not only improves the calibration efficiency of the acquisition parameters but also enhances their reliability, thereby improving the reliability of the acquired regional images.

[0128] In this embodiment of the invention, image acquisition control parameters are used to actually control the image acquisition device to perform regional image acquisition operations. When generating image acquisition control parameters, the first type of image acquisition resources and / or the second type of image acquisition resources mentioned in Embodiment 1 are given priority. Further, for an image acquisition device belonging to the first type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least the image acquisition angle and / or the image acquisition range; for a target image acquisition device belonging to the second type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least one of the following: image acquisition path, multiple image acquisition points on the image acquisition path, maximum dwell time at each image acquisition point, image acquisition angle at each image acquisition point, image acquisition range at each image acquisition point, and image acquisition height at each image acquisition point.

[0129] It should be noted that, preferably, both the image acquisition calibration operation and the generation of corresponding image acquisition control parameters should be performed in a way that minimizes the impact on the inherent applications required to execute the image acquisition resources.

[0130] 203. Obtain the set of regional images obtained by the image acquisition devices in the image acquisition device set when they perform regional image acquisition on the target area.

[0131] 204. Based on the device information corresponding to the image acquisition device of each regional image in the regional image set, classify the regional images in the regional image set to obtain multiple regional image subsets.

[0132] In this embodiment of the invention, the device information corresponding to the image acquisition device may include the device type and / or device model and / or device imaging parameters of the image acquisition device, and the regional images acquired by image acquisition devices with the same or similar device information are classified into the same regional image subset.

[0133] 205. For each region image in a region image subset, perform a matching preprocessing operation on the region images in that region image subset according to a predetermined preprocessing method.

[0134] In this embodiment of the invention, for regional images belonging to the same regional image subset, the same preprocessing method (such as image calibration function and / or image calibration coefficient) can be used for unified preprocessing, and multiple regional image subsets can be preprocessed in parallel, which is beneficial to improving the preprocessing efficiency, convenience and reliability of regional images.

[0135] 206. After performing matching preprocessing operations on the region images in all region image subsets, determine all preprocessed region images as the region image set that needs to be analyzed and processed.

[0136] 207. Based on the requirements of optical imaging monitoring, perform matching analysis and processing operations on the regional image set to obtain the optical imaging monitoring results corresponding to the target region.

[0137] In this embodiment of the invention, it should be specifically noted that steps 204-206 can be understood as image preprocessing before the actual analysis and processing of the region image set. In other optional embodiments, after completing step 203, the preprocessing procedures involved in steps 204-206 can be omitted, and step 207 can be executed directly. It should be specifically noted that for other descriptions of the region-dimensional optical imaging monitoring processing method involved in this embodiment of the invention, please refer to the relevant descriptions in Embodiment 1, which will not be repeated in this embodiment of the invention.

[0138] As can be seen, the method described in the embodiments of the present invention can achieve intelligent optical imaging monitoring based on the image acquisition results of image acquisition devices matched with the area to be monitored. Compared with remote sensing satellites, it achieves surface-level optical imaging monitoring, which is beneficial to improving the accuracy of optical imaging monitoring. In addition, compared with manual acquisition using relevant optical parameter acquisition devices, it is also beneficial to improve the efficiency and reliability of optical imaging monitoring, thereby providing reliable and effective analytical / decision-making basis for actual analysis needs. Furthermore, after acquiring the regional image set, the regional images in the regional image set can be preprocessed by classification. This not only improves the efficiency and convenience of preprocessing for regional images, but also improves the efficiency and reliability of subsequent actual analysis and processing of regional images. Moreover, after determining the set of image acquisition devices for regional image acquisition in the area to be monitored, the acquisition parameters of the image acquisition devices can be calibrated and / or intelligently generated to match the image acquisition control parameters. This not only improves the efficiency and reliability of image acquisition, but also improves the efficiency and reliability of optical imaging monitoring.

[0139] Example 3

[0140] Please see Figure 3 , Figure 3 This is a schematic flowchart of another region-based optical imaging monitoring and processing method disclosed in an embodiment of the present invention. Figure 3 The described method is at least used to achieve surface-level optical imaging monitoring and is applied to a monitoring and processing system, which can be integrated into a cloud server or a local device; this embodiment of the invention does not limit this. Figure 3 As shown, this region-dimensional optical imaging monitoring processing method may include the following operations:

[0141] 301. For the identified target area to be monitored, analyze the set of image acquisition devices that can acquire regional images of the target area based on the pre-determined optical imaging monitoring requirements.

[0142] 302. Obtain the set of regional images obtained by the image acquisition devices in the image acquisition device set when they perform regional image acquisition on the target area.

[0143] 303. Based on the requirements of optical imaging monitoring, perform matching analysis and processing operations on the regional image set to obtain the optical imaging monitoring results corresponding to the target region.

[0144] It should be noted that after completing step 303, steps 304 and / or 305 can be selectively executed according to actual needs.

[0145] 304. After obtaining the optical imaging monitoring results, the optical parameters in the optical imaging monitoring results are fused into the three-dimensional spatial distribution corresponding to the target area to obtain the three-dimensional optical information spatial distribution corresponding to the target area, and the three-dimensional optical information spatial distribution is output to the visualization interface.

[0146] In this embodiment of the invention, the three-dimensional spatial distribution corresponding to the target area can be constructed by combining a GIS system, or it can be intelligently constructed by inputting the key information corresponding to the target area into a three-dimensional spatial construction model that has been trained and converged. It includes the road conditions, building conditions, camera distribution, street light distribution, etc. of the target area. This embodiment of the invention does not limit the scope of the invention.

[0147] 305. After obtaining the optical imaging monitoring results, generate the surface-level optical information detection results based on the optical imaging monitoring results corresponding to the target area, and construct a mapping relationship between at least two of the detection results among the surface-level optical information detection results, remote sensing satellite optical information detection results, and low-altitude optical information detection results.

[0148] As can be seen, the embodiments of the present invention can also construct mapping relationships between optical information in different spatial dimensions. This not only improves the accuracy of the required optical information based on multi-dimensional optical information, but also allows the derivation of optical information in other dimensions based on optical information in one dimension. This is beneficial for improving the complementarity of optical information between different dimensions, and thus for improving the comprehensiveness and accuracy of optical information in different dimensions.

[0149] Furthermore, constructing a mapping relationship between surface-level optical information detection results and remote sensing satellite optical information detection results can include:

[0150] Construct a mapping relationship between light information such as sky brightness and color detected by hyperspectral imaging from remote sensing satellites and light information such as horizontal and vertical brightness and color at the Earth's surface; and / or,

[0151] Construct a mapping relationship between agricultural-related information obtained from remote sensing satellite hyperspectral detection and land-based photoagricultural detection information; and / or,

[0152] Establish a mapping relationship between gas-related information detected by remote sensing satellites using hyperspectral imaging and gas detection information at the Earth's surface.

[0153] In this optional embodiment, an overall three-dimensional spatial distribution of optical information can also be constructed based on the surface-level optical information detection results, the remote sensing satellite optical information detection results, and the three-dimensional spatial distribution of the target area.

[0154] It should be noted that for other descriptions of the region-dimensional optical imaging monitoring and processing method involved in the embodiments of the present invention, please refer to the relevant descriptions in Embodiment 1 and Embodiment 2. The embodiments of the present invention will not repeat them.

[0155] As can be seen, the method described in this embodiment of the invention can achieve intelligent optical imaging monitoring based on the image acquisition results of an image acquisition device matched to the area to be monitored. Compared with remote sensing satellites, it achieves surface-level optical imaging monitoring, which is beneficial to improving the accuracy of optical imaging monitoring. In addition, compared with manual acquisition using relevant optical parameter acquisition equipment, it is also beneficial to improve the efficiency and reliability of optical imaging monitoring, thereby providing reliable and effective analytical / decision-making basis for actual analysis needs. Furthermore, it can also fuse the optical parameters in the optical imaging monitoring results into the three-dimensional spatial distribution corresponding to the target area and display it on a visualization interface. This visualization method helps relevant personnel to understand the light distribution in the target area more intuitively. Moreover, it can intelligently construct the mapping relationship between surface-level optical information detection results and remote sensing satellite optical information detection results, thereby forming a complete three-dimensional optical information spatial distribution, which is beneficial to expanding the application scenarios of optical imaging monitoring and providing more comprehensive and accurate analytical / decision-making basis for practical applications.

[0156] In an optional embodiment, the above-described analysis and processing operation, which matches the region image set according to the optical imaging monitoring requirements, to obtain the optical imaging monitoring result corresponding to the target region, may include:

[0157] Based on the requirements of optical imaging monitoring, determine the type of performance characteristic information that matches the requirements of optical imaging monitoring;

[0158] Based on the type of performance characteristic information, the regional image set is subjected to matching analysis and processing operations to obtain the light imaging monitoring results corresponding to the target region.

[0159] As can be seen, this optional embodiment can also analyze the type of performance characteristic information required for optical imaging monitoring before analyzing and processing regional images, and then perform matching analysis and processing operations based on the type of performance characteristic information, which helps to improve the reliability of regional image analysis and processing operations.

[0160] In another optional embodiment, the above-described output of the spatial distribution of three-dimensional light information to a visualization interface may include:

[0161] Based on the predetermined visualization requirements, determine the output control parameters corresponding to the spatial distribution of three-dimensional light information. The output control parameters include at least one or more of the following: target visualization dimension, target visualization viewpoint, visualization dimension switching attribute, visualization viewpoint switching attribute, and variable information display attribute.

[0162] Based on the output control parameters, the spatial distribution of three-dimensional light information is output to the visualization interface.

[0163] In this embodiment of the invention, the target visualization dimension may include two-dimensional and / or three-dimensional dimensions, and the target visualization viewpoint may include any one of the following: eye-level viewpoint, top-down viewpoint, bottom-up viewpoint, and other angle viewpoints; the visualization dimension switching attribute is used to indicate whether the visualization dimension can be switched, and, if it can be switched, the specific target dimension to which it can be switched; the visualization viewpoint switching attribute is used to indicate whether the visualization viewpoint can be switched, and, if it can be switched, the specific target viewpoint to which it can be switched; the variable information display attribute is used to indicate whether the variable information is displayed statically or dynamically.

[0164] As can be seen, this optional embodiment can also generate visual output control parameters based on actual needs, and then output the three-dimensional light information spatial distribution to the visual interface based on the visual output control parameters. This is beneficial to improving the convenience for relevant personnel to view the three-dimensional light information spatial distribution, and can also improve the efficiency and accuracy of relevant personnel to obtain the required information based on the three-dimensional light information spatial distribution.

[0165] In yet another optional embodiment, after obtaining the optical imaging monitoring results, the method may further include the following operations:

[0166] The optical parameters in the optical imaging monitoring results are fused into the three-dimensional spatial distribution corresponding to the target area to obtain the three-dimensional optical information spatial distribution corresponding to the target area. Based on the three-dimensional optical information spatial distribution, an optical information application model for diagnosis and / or evaluation is constructed.

[0167] It is evident that this optional embodiment can also construct an optical information application model based on the optical imaging monitoring results, thereby improving the reliability and accuracy of the optical information application model and facilitating the effective application of the optical imaging monitoring results.

[0168] In yet another optional embodiment, after obtaining the optical imaging monitoring results, the method may further include the following operations:

[0169] After obtaining the optical imaging monitoring results, a mapping relationship is constructed between the optical parameters in the optical imaging monitoring results and the application requirements corresponding to the optical imaging monitoring needs; among which, the optical imaging monitoring needs include one or more combinations of environmental monitoring needs, agricultural monitoring needs, low-altitude economic monitoring needs, and industrial monitoring needs.

[0170] Further optionally, the application requirements corresponding to environmental monitoring needs include one or more combinations of water quality monitoring needs, atmospheric composition monitoring needs, and ecological environment monitoring needs; agricultural monitoring needs include one or more combinations of crop growth monitoring needs, pest and disease monitoring needs, and precision agriculture management needs; low-altitude economic monitoring needs include one or more combinations of low-altitude economic lighting monitoring needs, low-altitude economic light pollution monitoring needs, and low-altitude economic flight needs; and industrial monitoring needs include energy consumption analysis needs and / or object identification needs.

[0171] As can be seen, this optional embodiment can also construct a mapping relationship between the multiple optical parameters monitored and at least one application requirement corresponding to the optical imaging monitoring requirement after obtaining the optical imaging monitoring results including multiple optical parameters based on the optical imaging monitoring requirements. This is beneficial to expanding the practical application scenarios of the optical imaging monitoring results and thus providing an effective and reliable analytical basis for practical application scenarios.

[0172] Example 4

[0173] Please see Figure 6 , Figure 6 This is a schematic diagram of the structure of a monitoring and processing system disclosed in an embodiment of the present invention. Figure 6 The described monitoring and processing system is at least used to achieve surface-level optical imaging monitoring. This system can be integrated into a cloud server or a local device; this embodiment of the invention does not limit this. Figure 6 As shown, the monitoring and processing system may include:

[0174] The resource acquisition and analysis module 401 is used to analyze the set of image acquisition devices that can acquire regional images of the target area based on the predetermined optical imaging monitoring requirements for the determined target area. The set of image acquisition devices includes at least one type of image acquisition device subset, and each type of image acquisition device subset includes at least one image acquisition device.

[0175] The region image acquisition module 402 is used to acquire a set of region images obtained by the image acquisition devices in the image acquisition device set when they acquire region images of the target region.

[0176] The optical imaging monitoring module 403 is used to perform matching analysis and processing operations on the regional image set according to the optical imaging monitoring requirements, so as to obtain the optical imaging monitoring results corresponding to the target region; wherein, the optical imaging monitoring results include at least one optical parameter that matches the optical imaging monitoring requirements.

[0177] It is evident that implementation Figure 6The described monitoring and control system can achieve intelligent optical imaging monitoring based on the image acquisition results of image acquisition equipment that matches the area to be monitored. Compared with remote sensing satellites, it realizes ground-level optical imaging monitoring, which is conducive to improving the accuracy of optical imaging monitoring. In addition, compared with manual acquisition using relevant optical parameter acquisition equipment, it is also conducive to improving the efficiency and reliability of optical imaging monitoring, thereby providing reliable and effective analysis basis / decision basis for actual analysis needs.

[0178] In an optional embodiment, the optical imaging monitoring module 403 performs matching analysis and processing operations on the regional image set according to the optical imaging monitoring requirements, and the specific method for obtaining the optical imaging monitoring result corresponding to the target region may include:

[0179] Based on the requirements of optical imaging monitoring, determine the type of performance characteristic information that matches the requirements of optical imaging monitoring;

[0180] Based on the type of performance characteristic information, the regional image set is subjected to matching analysis and processing operations to obtain the light imaging monitoring results corresponding to the target region.

[0181] As can be seen, this optional embodiment can also analyze the type of performance characteristic information required for optical imaging monitoring before analyzing and processing regional images, and then perform matching analysis and processing operations based on the type of performance characteristic information, which helps to improve the reliability of regional image analysis and processing operations.

[0182] In another alternative embodiment, such as Figure 7 As shown, the monitoring and processing system also includes:

[0183] The optical information processing module 404 is used to, after obtaining the optical imaging monitoring results, fuse the optical parameters in the optical imaging monitoring results into the three-dimensional spatial distribution corresponding to the target area to obtain the three-dimensional optical information spatial distribution corresponding to the target area, and output the three-dimensional optical information spatial distribution to the visualization interface, and / or, construct an optical information application model for diagnosis and / or evaluation based on the three-dimensional optical information spatial distribution; and / or, after obtaining the optical imaging monitoring results, generate surface-level optical information detection results based on the optical imaging monitoring results corresponding to the target area, and construct a mapping relationship between at least two of the detection results among surface-level optical information detection results, remote sensing satellite optical information detection results, and low-altitude optical information detection results; and / or, after obtaining the optical imaging monitoring results, construct a mapping relationship between the optical parameters in the optical imaging monitoring results and the application requirements corresponding to the optical imaging monitoring requirements. Optionally, the optical imaging monitoring requirements include one or more combinations of environmental monitoring requirements, agricultural monitoring requirements, low-altitude economic monitoring requirements, and industrial monitoring requirements.

[0184] Further optionally, the application requirements corresponding to environmental monitoring needs include one or more combinations of water quality monitoring needs, atmospheric composition monitoring needs, and ecological environment monitoring needs; agricultural monitoring needs include one or more combinations of crop growth monitoring needs, pest and disease monitoring needs, and precision agriculture management needs; low-altitude economic monitoring needs include one or more combinations of low-altitude economic lighting monitoring needs, low-altitude economic light pollution monitoring needs, and low-altitude economic flight needs; and industrial monitoring needs include energy consumption analysis needs and / or object identification needs.

[0185] As can be seen, this optional embodiment can also fuse the optical parameters in the optical imaging monitoring results into the three-dimensional spatial distribution corresponding to the target area and display it on a visualization interface. This visualization method helps relevant personnel to understand the light distribution in the target area more intuitively. Furthermore, it can intelligently construct a mapping relationship between surface-level optical information detection results and remote sensing satellite optical information detection results, thereby forming a complete three-dimensional optical information spatial distribution. This is beneficial for expanding the application scenarios of optical imaging monitoring and can provide more comprehensive and accurate analytical / decision-making basis for practical applications. In addition, it can construct mapping relationships between optical information in different spatial dimensions. This not only improves the accuracy of the required optical information based on multi-dimensional optical information but also allows the derivation of other-dimensional optical information based on one-dimensional optical information, which is beneficial for improving the complementarity of optical information between different dimensions, thereby improving the comprehensiveness and accuracy of optical information in different dimensions. Furthermore, after obtaining optical imaging monitoring results including multiple optical parameters based on optical imaging monitoring needs, it can construct a mapping relationship between the monitored multiple optical parameters and at least one application requirement corresponding to the optical imaging monitoring needs. This is beneficial for expanding the practical application scenarios of optical imaging monitoring results and providing effective and reliable analytical basis for practical application scenarios.

[0186] In yet another optional embodiment, the specific method by which the optical information processing module 404 outputs the spatial distribution of three-dimensional optical information to the visualization interface may include:

[0187] Based on the predetermined visualization requirements, determine the output control parameters corresponding to the spatial distribution of three-dimensional light information. The output control parameters include at least one or more of the following: target visualization dimension, target visualization viewpoint, visualization dimension switching attribute, visualization viewpoint switching attribute, and variable information display attribute.

[0188] Based on the output control parameters, the spatial distribution of three-dimensional light information is output to the visualization interface.

[0189] As can be seen, this optional embodiment can also generate visual output control parameters based on actual needs, and then output the three-dimensional light information spatial distribution to the visual interface based on the visual output control parameters. This is beneficial to improving the convenience for relevant personnel to view the three-dimensional light information spatial distribution, and can also improve the efficiency and accuracy of relevant personnel to obtain the required information based on the three-dimensional light information spatial distribution.

[0190] In yet another alternative embodiment, such as Figure 7 As shown, the monitoring and processing system also includes:

[0191] The image classification preprocessing module 405 is used to classify the regional images in the regional image set according to the device information corresponding to the image acquisition device of each regional image in the regional image set after acquiring the regional image set, so as to obtain multiple regional image subsets; for the regional images in each regional image subset, a matching preprocessing operation is performed on the regional images in the regional image subset according to a predetermined preprocessing method; after performing the matching preprocessing operation on the regional images in all regional image subsets, all the preprocessed regional images are determined as the regional image set that needs to be analyzed and processed.

[0192] As can be seen, this optional embodiment can also perform classification preprocessing on the regional images in the regional image set after obtaining the regional image set. This not only helps to improve the preprocessing efficiency and convenience of regional appearance, but also improves the efficiency and reliability of subsequent actual analysis and processing of regional images by preprocessing regional images.

[0193] In another optional embodiment, for the determined target area to be monitored, the resource acquisition analysis module 401 analyzes the set of image acquisition devices capable of acquiring regional images of the target area based on the pre-determined optical imaging monitoring requirements, including the following specific methods:

[0194] For the identified target area to be monitored, the first type of image acquisition resources are determined based on the installation status of image acquisition equipment within the target area;

[0195] Based on the target mobile image acquisition equipment corresponding to the target area and the inspection schedule of the target mobile image acquisition equipment, the second type of image acquisition resources are determined;

[0196] The third type of image acquisition resources are determined based on the mobile image acquisition devices that appear in the target area and the movement of the mobile image acquisition devices in the target area.

[0197] Based on the first type of image acquisition resources, the second type of image acquisition resources, the third type of image acquisition resources, and the predetermined optical imaging monitoring requirements, analyze the set of image acquisition devices that can acquire regional images of the target area;

[0198] Among them, the target mobile image acquisition device includes a mobile image acquisition device applied to the target area and / or a schedulable mobile image acquisition device applied to the adjacent area of ​​the target area.

[0199] As can be seen, this optional embodiment can integrate and analyze the image acquisition resources that match the target area after determining the target area, so as to make full use of the appropriate image acquisition resources for regional image acquisition. This not only helps to improve the matching degree between the determined set of image acquisition devices and the actual needs, but also enables the rational use of image acquisition resources, thereby improving the utilization rate of image acquisition resources.

[0200] In yet another alternative embodiment, such as Figure 7 As shown, the monitoring and processing system also includes:

[0201] The acquisition device control module 406 is used to perform a matching image acquisition parameter calibration operation on each target image acquisition device in the image acquisition device set that does not belong to the third type of image acquisition resources, according to the predetermined optical imaging monitoring requirements. The image acquisition parameter calibration operation is used to calibrate the imaging effect of the target image acquisition device. And / or, according to the predetermined optical imaging monitoring requirements, for each target image acquisition device in the image acquisition device set that does not belong to the third type of image acquisition resources, it generates image acquisition control parameters matching the target image acquisition device. Wherein, for a target image acquisition device belonging to the first type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least the image acquisition angle and / or the image acquisition range. For a target image acquisition device belonging to the second type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least one of the following: image acquisition path, multiple image acquisition points on the image acquisition path, maximum dwell time at each image acquisition point, image acquisition angle at each image acquisition point, image acquisition range at each image acquisition point, and image acquisition height at each image acquisition point.

[0202] As can be seen, after determining the set of image acquisition devices for regional image acquisition in the area to be monitored, this optional embodiment can also calibrate the acquisition parameters of the image acquisition devices and / or intelligently generate matching image acquisition control parameters. This not only helps to improve the efficiency and reliability of image acquisition, but also helps to improve the efficiency and reliability of optical imaging monitoring.

[0203] In another optional embodiment, the optical imaging monitoring result corresponding to the target area specifically includes at least one optical parameter within multiple sub-detection areas; wherein, the multiple sub-detection areas are divided into target areas based on the target detection parameters corresponding to the image acquisition devices in the image acquisition device set. Optionally, the aforementioned target detection parameters may include at least one of detection spectral band, imaging intensity, and imaging resolution. In this optional embodiment, the optical imaging monitoring module 403 is further configured to construct a coverage and mapping relationship between the optical parameters of the multiple sub-detection areas based on the target detection parameters corresponding to the image acquisition devices corresponding to each sub-detection area and at least one optical parameter within each sub-detection area.

[0204] As can be seen, this optional embodiment can also achieve fine division of the target area based on the target detection parameters corresponding to image acquisition devices with different acquisition ranges, dividing it into multiple sub-detection areas. Then, based on the target detection parameters of the image acquisition devices corresponding to the multiple sub-detection areas, a coverage and mapping relationship between the optical parameters of the multiple sub-detection areas can be constructed. This not only enables the calibration of optical parameters based on the aforementioned coverage and mapping relationship, which is beneficial to improving the accuracy and reliability of optical parameters, but also enables the mapping derivation of optical parameters based on the coverage and mapping relationship, which is beneficial to improving the comprehensiveness of optical parameters.

[0205] It should be noted that the monitoring and processing system described in Embodiment 4 is specifically used to implement any of the region-dimensional optical imaging monitoring and processing methods described in Embodiments 1, 2 and 3. For other related descriptions of the monitoring and processing system in Embodiment 4, please refer to the relevant descriptions in Embodiments 1, 2 and 3. Embodiment 4 of the present invention will not repeat the descriptions.

[0206] Example 5

[0207] Please see Figure 8 , Figure 8 This is a schematic diagram of the structure of another monitoring and processing system disclosed in an embodiment of the present invention. Figure 8 The described monitoring and processing system is at least used to achieve surface-level optical imaging monitoring. This system can be integrated into a cloud server or a local device; this embodiment of the invention does not limit this. Figure 8 As shown, the monitoring and processing system may include:

[0208] Memory 501 storing executable program code;

[0209] Processor 502 coupled to memory;

[0210] The processor 502 calls the executable program code stored in the memory 501 to execute some or all of the steps in the region-dimensional optical imaging monitoring processing method described in any of the embodiments 1 to 3 of the present invention.

[0211] Example 6

[0212] This invention discloses a computer storage medium storing computer instructions. When these computer instructions are invoked, they are used to execute some or all of the steps in the region-dimensional optical imaging monitoring processing method described in any of embodiments one to three of this invention.

[0213] Example 7

[0214] This invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps in the region-dimensional optical imaging monitoring processing method described in any of embodiments one to three of this invention.

[0215] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0216] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0217] Finally, it should be noted that the optical imaging monitoring and processing method and system based on region dimension disclosed in the embodiments of the present invention are merely preferred embodiments of the present invention, and are only used to illustrate the technical solutions of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A region-dimensional optical imaging monitoring and processing method, characterized in that, The method includes: For the identified target area to be monitored, an image acquisition device set that can acquire regional images of the target area is analyzed based on the pre-determined optical imaging monitoring requirements. The image acquisition device set includes at least one type of image acquisition device subset, and each type of image acquisition device subset includes at least one image acquisition device. Obtain the set of regional images obtained by the image acquisition devices in the image acquisition device set performing regional image acquisition on the target area; According to the optical imaging monitoring requirements, the set of regional images is subjected to matching analysis and processing operations to obtain the optical imaging monitoring results corresponding to the target region; wherein, the optical imaging monitoring results include at least one optical parameter that matches the optical imaging monitoring requirements.

2. The region-dimensional optical imaging monitoring and processing method according to claim 1, characterized in that, The step of performing matching analysis and processing operations on the set of regional images according to the optical imaging monitoring requirements to obtain the optical imaging monitoring results corresponding to the target region includes: Based on the optical imaging monitoring requirements, determine the type of performance characteristic information that matches the optical imaging monitoring requirements; Based on the performance characteristic information type, a matching analysis and processing operation is performed on the set of regional images to obtain the light imaging monitoring result corresponding to the target region.

3. The region-dimensional optical imaging monitoring and processing method according to claim 2, characterized in that, The method further includes: After obtaining the optical imaging monitoring results, the optical parameters in the optical imaging monitoring results are fused into the three-dimensional spatial distribution corresponding to the target area to obtain the three-dimensional optical information spatial distribution corresponding to the target area, and the three-dimensional optical information spatial distribution is output to the visualization interface, and / or, an optical information application model for diagnosis and / or evaluation is constructed based on the three-dimensional optical information spatial distribution; And / or, After obtaining the optical imaging monitoring results, a surface-level optical information detection result is generated based on the optical imaging monitoring results corresponding to the target area, and a mapping relationship is constructed between at least two of the surface-level optical information detection results, remote sensing satellite optical information detection results, and low-altitude optical information detection results. And / or, After obtaining the optical imaging monitoring results, a mapping relationship is constructed between the optical parameters in the optical imaging monitoring results and the application requirements corresponding to the optical imaging monitoring requirements; wherein, the optical imaging monitoring requirements include one or more combinations of environmental monitoring requirements, agricultural monitoring requirements, low-altitude economic monitoring requirements, and industrial monitoring requirements. The optical parameters in the optical imaging monitoring results include at least one of brightness, color distribution, characteristic spectrum, reflectance, and illuminance.

4. The region-dimensional optical imaging monitoring and processing method according to claim 3, characterized in that, The process of outputting the spatial distribution of the three-dimensional light information to a visualization interface includes: Based on the predetermined visualization requirements, the output control parameters corresponding to the spatial distribution of the three-dimensional light information are determined. The output control parameters include at least one or more of the following: target visualization dimension, target visualization viewpoint, visualization dimension switching attribute, visualization viewpoint switching attribute, and variable information display attribute. Based on the output control parameters, the spatial distribution of the three-dimensional light information is output to the visualization interface.

5. The region-dimensional optical imaging monitoring and processing method according to any one of claims 1-4, characterized in that, After acquiring the set of regional images obtained by the image acquisition devices in the image acquisition device set from the target area, and before performing matching analysis and processing operations on the set of regional images according to the optical imaging monitoring requirements to obtain the optical imaging monitoring result corresponding to the target area, the method further includes: After obtaining the set of regional images, the regional images in the set of regional images are classified according to the device information corresponding to the image acquisition device of each regional image in the set of regional images, resulting in multiple regional image subsets. For each region image in the region image subset, a matching preprocessing operation is performed on the region image in the region image subset according to a predetermined preprocessing method; After performing matching preprocessing operations on the region images in all the region image subsets, all the preprocessed region images are determined as the region image set that needs to be analyzed and processed.

6. The region-dimensional optical imaging monitoring and processing method according to claim 1, characterized in that, The aforementioned set of image acquisition devices capable of acquiring regional images of the identified target area, based on pre-determined optical imaging monitoring requirements, includes: For the identified target area to be monitored, the first type of image acquisition resources are determined based on the installation status of image acquisition devices within the target area; Based on the target mobile image acquisition device corresponding to the target area and the inspection schedule of the target mobile image acquisition device, the second type of image acquisition resources are determined; The third type of image acquisition resource is determined based on the mobile image acquisition device appearing in the target area and the movement of the mobile image acquisition device in the target area; Based on the first type of image acquisition resources, the second type of image acquisition resources, the third type of image acquisition resources, and the predetermined optical imaging monitoring requirements, analyze the set of image acquisition devices capable of acquiring regional images of the target area; The target mobile image acquisition device includes a mobile image acquisition device applied to the target area and / or a schedulable mobile image acquisition device applied to the adjacent area of ​​the target area.

7. The region-dimensional optical imaging monitoring and processing method according to claim 6, characterized in that, After analyzing the set of image acquisition devices capable of acquiring regional images of the identified target area based on pre-determined optical imaging monitoring requirements, the method further includes: Based on the predetermined optical imaging monitoring requirements, a matching image acquisition parameter calibration operation is performed on each target image acquisition device in the image acquisition device set that does not belong to the third type of image acquisition resources. The image acquisition parameter calibration operation is used to calibrate the imaging effect of the target image acquisition device. And / or, Based on the predetermined optical imaging monitoring requirements, for each target image acquisition device in the image acquisition device set that does not belong to the third type of image acquisition resources, image acquisition control parameters matching the target image acquisition device are generated; wherein, for a target image acquisition device belonging to the first type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least the image acquisition angle and / or the image acquisition range; for a target image acquisition device belonging to the second type of image acquisition resources, the image acquisition control parameters matching the target image acquisition device include at least one of the following: image acquisition path, multiple image acquisition points on the image acquisition path, maximum dwell time at each image acquisition point, image acquisition angle at each image acquisition point, image acquisition range at each image acquisition point, and image acquisition height at each image acquisition point.

8. The region-dimensional optical imaging monitoring and processing method according to any one of claims 1-4, characterized in that, The optical imaging monitoring result corresponding to the target area specifically includes at least one optical parameter in multiple sub-detection areas; wherein, the multiple sub-detection areas are divided into the target area according to the target detection parameters corresponding to the image acquisition devices in the image acquisition device set, and the target detection parameters include at least one of detection spectrum, imaging intensity and imaging resolution; The method further includes: Based on the target detection parameters corresponding to the image acquisition device of each sub-detection region and at least one optical parameter in each sub-detection region, a coverage and mapping relationship between the optical parameters of multiple sub-detection regions is constructed.

9. The region-dimensional optical imaging monitoring and processing method according to claim 3, characterized in that, The application requirements corresponding to the environmental monitoring needs include one or more combinations of water quality monitoring needs, atmospheric composition monitoring needs, and ecological environment monitoring needs. The agricultural monitoring needs include one or more combinations of crop growth monitoring needs, pest and disease monitoring needs, and precision agricultural management needs. The low-altitude economic monitoring needs include one or more combinations of low-altitude economic lighting monitoring needs, low-altitude economic light pollution monitoring needs, and low-altitude economic flight needs. The industrial monitoring requirements include energy consumption analysis and / or object identification.

10. A monitoring and processing system, characterized in that, The monitoring and processing system includes: The resource acquisition and analysis module is used to analyze, based on the predetermined optical imaging monitoring requirements, a set of image acquisition devices capable of acquiring regional images of the target area, for a determined target area to be monitored. The set of image acquisition devices includes at least one type of image acquisition device subset, and each type of image acquisition device subset includes at least one image acquisition device. The region image acquisition module is used to acquire a set of region images obtained by the image acquisition devices in the image acquisition device set when they acquire region images of the target region. The optical imaging monitoring module is used to perform matching analysis and processing operations on the set of regional images according to the optical imaging monitoring requirements, so as to obtain the optical imaging monitoring results corresponding to the target region; wherein, the optical imaging monitoring results include at least one optical parameter that matches the optical imaging monitoring requirements.

11. A monitoring and processing system, characterized in that, The monitoring and processing system includes: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the region-dimensional optical imaging monitoring processing method as described in any one of claims 1-9.

12. A computer storage medium, characterized in that, The computer storage medium stores computer instructions, which, when invoked, are used to execute the region-dimensional optical imaging monitoring processing method as described in any one of claims 1-9.

Images