Remote supervision and inspection method and device for special equipment
By employing differentiated processing of master-slave image acquisition devices and neural network models, the problem of high data transmission costs in remote supervision and inspection has been solved, enabling efficient and accurate remote supervision and inspection of special equipment.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-01-13
- Publication Date
- 2026-04-14
AI Technical Summary
In remote supervision and inspection of special equipment, the massive amount of image data leads to high data transmission costs and long delays, which cannot meet actual needs.
A master-slave image acquisition device is used, where the image acquired by the master image acquisition device has higher resolution than that acquired by the slave image acquisition device. By adjusting the image information of the slave image acquisition device, it is made to meet the standard image information. This is then combined with a trained neural network model for remote supervision and verification.
It reduces data transmission costs during remote monitoring and inspection, while improving the accuracy and reliability of monitoring and inspection.
Smart Images
Figure CN121864945A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of remote monitoring and inspection technology, and more specifically, relates to a method and device for remote monitoring and inspection of special equipment. Background Technology
[0002] In the field of safety management and supervision of special equipment, ensuring the safety and compliance of equipment operation is of paramount importance. With the development of information technology, remote supervision and inspection technology has gradually become a research hotspot and application trend in the field of special equipment supervision and inspection. By utilizing equipment such as image acquisition devices, image information of special equipment can be acquired remotely, enabling remote monitoring and inspection of the equipment, thus improving inspection efficiency and convenience.
[0003] In practical applications, in order to acquire image information of special equipment in a comprehensive and detailed manner, it is often necessary to deploy multiple image acquisition devices. However, due to the large amount of image data, data acquisition and transmission not only consume a lot of network bandwidth resources and increase data transmission costs, but also cause large remote delays, which cannot meet actual needs. Summary of the Invention
[0004] The purpose of this application is to provide a method and apparatus for remote supervision and inspection of special equipment, so as to reduce the data transmission cost in the remote supervision and inspection process.
[0005] A first aspect of this application provides a method for remote monitoring and inspection of special equipment, comprising: Image information of a target inspection area containing special equipment is acquired. The target inspection area includes at least one repeated image acquisition area and a single image acquisition area. The device for acquiring image information of the repeated image acquisition area includes a main image acquisition device and a secondary image acquisition device. The image information acquired by the main image acquisition device has higher clarity than the image information acquired by the secondary image acquisition device. For each repeated image acquisition area, the following processing is performed: Based on the first image information of the repeated image acquisition area acquired by the main image acquisition device, the second image information of the repeated image acquisition area acquired by the image acquisition device is adjusted to obtain the standard image information corresponding to the repeated image acquisition area. Based on the image information of a single image acquisition area and the standard image information corresponding to each repeated image acquisition area, remote supervision and inspection of special equipment is carried out on the target monitoring area.
[0006] A second aspect of this application provides a remote monitoring and inspection device for special equipment, comprising: The image acquisition module is used to acquire image information of a target inspection area containing special equipment. The target inspection area includes at least one repeated image acquisition area and a single image acquisition area. The device for acquiring image information of the repeated image acquisition area includes a main image acquisition device and a secondary image acquisition device. The image information acquired by the main image acquisition device has a higher clarity than the image information acquired by the secondary image acquisition device. The image adjustment module is used to adjust the second image information of the repeated image acquisition area acquired by the image acquisition device based on the first image information of the repeated image acquisition area acquired by the main image acquisition device, so as to obtain the standard image information corresponding to the repeated image acquisition area. The remote monitoring module is used to remotely monitor and inspect special equipment in the target monitoring area based on the image information of the single image acquisition area and the standard image information corresponding to each repeated image acquisition area.
[0007] A third aspect of this application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program to implement the steps of the above-described remote supervision and inspection method for special equipment.
[0008] A fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described remote supervision and inspection method for special equipment.
[0009] The beneficial effects of the remote monitoring and inspection method and apparatus for special equipment provided in this application are as follows: In this embodiment, the image clarity acquired by the image acquisition device is lower than that acquired by the main image acquisition device, which reduces the overall image data volume. At the same time, in order to ensure the reliability of remote supervision and inspection of special equipment, in this embodiment, for areas with repeated image acquisition, the image information acquired by the image acquisition device with lower clarity is adjusted based on the image information acquired by the main image acquisition device with higher clarity. This not only reduces the data transmission cost in the remote supervision and inspection process, but also improves the accuracy of supervision and inspection as much as possible. Attached Figure Description
[0010] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0011] Figure 1A flowchart illustrating a remote monitoring and inspection method for special equipment provided in an embodiment of this application; Figure 2 A structural block diagram of a remote monitoring and inspection device for special equipment provided in an embodiment of this application; Figure 3 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation
[0012] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.
[0013] It is understood that in the embodiments of this application, data such as user information are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with relevant laws, regulations and standards.
[0014] It should be noted that the terms "first," "second," etc., used in the specification, claims, and drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in sequences other than those illustrated or described herein.
[0015] To make the objectives, technical solutions, and advantages of this application clearer, the following description will be provided in conjunction with the accompanying drawings and specific embodiments.
[0016] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating a remote supervision and inspection method for special equipment provided in an embodiment of this application. The method can be executed by an electronic device and may include steps S101-S103.
[0017] S101: Obtain image information of the target inspection area containing special equipment.
[0018] In this embodiment, the target monitoring area contains special equipment, such as a workshop that produces special equipment, a workshop that uses special equipment for production, a workshop that tests the performance of special equipment, or the actual area where special equipment is put into use.
[0019] In this embodiment, the target monitoring area includes at least one repeated image acquisition area and a single image acquisition area. The repeated image acquisition area refers to an area simultaneously covered and captured by multiple image acquisition devices, while the single image acquisition area refers to an area covered and captured by only one image acquisition device.
[0020] In this embodiment, the device for acquiring image information of a repeated image acquisition area includes a main image acquisition device and a secondary image acquisition device. For the same repeated image acquisition area, the repeated image acquisition area corresponds to one main image acquisition device and at least one secondary image acquisition device. The image information acquired by the main image acquisition device has a higher clarity than the image information acquired by the secondary image acquisition device.
[0021] S102: For each repeated image acquisition area, perform the following processing: Based on the first image information of the repeated image acquisition area acquired by the main image acquisition device, adjust the second image information of the repeated image acquisition area acquired by the image acquisition device to obtain the standard image information corresponding to the repeated image acquisition area.
[0022] In this embodiment, for each repeated image acquisition area, the second image information acquired by the acquisition device corresponding to the repeated image acquisition area can be adjusted based on the first image information acquired by the main image acquisition device corresponding to the repeated image acquisition area. Specifically, the second image information can be calibrated in terms of perspective, space, or color to compensate for the low clarity of the second image information acquired by the image acquisition device.
[0023] S103: Based on the image information of the single image acquisition area and the standard image information corresponding to each repeated image acquisition area, conduct remote supervision and inspection of special equipment in the target monitoring area.
[0024] In this embodiment, only one image acquisition device acquires images in a single image acquisition area, so there is no need to adjust the single image acquisition area. Therefore, special equipment remote supervision and inspection can be carried out on the target monitoring area based on the image information of the single image acquisition area and the standard image information corresponding to each repeated image acquisition area. Specifically, a trained neural network model can be used to carry out remote supervision and inspection of feature equipment. The training dataset of the neural network model contains a large number of image samples, each image sample contains special equipment, and each image sample is also pre-labeled with label information indicating whether an anomaly has occurred.
[0025] As can be seen from the above, the image clarity acquired by the image acquisition device in this embodiment is lower than that acquired by the main image acquisition device, which reduces the overall image data volume. At the same time, in order to ensure the reliability of remote supervision and inspection of special equipment, in this embodiment, for repeated image acquisition areas, the image information acquired by the image acquisition device with lower clarity is adjusted based on the image information acquired by the main image acquisition device with higher clarity. This not only reduces the data transmission cost in the remote supervision and inspection process, but also improves the accuracy of supervision and inspection as much as possible.
[0026] In one embodiment of this application, the remote supervision and inspection method for special equipment further includes: determining the master image acquisition device and slave image acquisition device corresponding to each repeated image acquisition area. In this embodiment, this step is performed before S101, and this step may specifically include: For each image acquisition device that acquires image information of repeated image acquisition areas, a coverage score is determined based on the acquisition coverage parameters of the image acquisition device, and a distance score is determined based on the distance between the image acquisition device and the center of the repeated acquisition area. The total score of the image acquisition device is determined based on the coverage score and the distance score. Among the image acquisition devices that have acquired image information from the repeated image acquisition area, the image acquisition device with the highest total score is designated as the master image acquisition device, and the remaining image acquisition devices among those that have acquired image information from the repeated image acquisition area are designated as slave image acquisition devices.
[0027] In this embodiment, the coverage parameter can refer to the coverage area percentage. The coverage area percentage of each image acquisition device can be obtained as follows: the ratio of the number of pixels in the repeated image acquisition area within the acquisition field of view of the image acquisition device to the total number of pixels is used as the coverage area percentage of the image acquisition device. The larger the coverage area percentage, the higher the coverage score. The smaller the distance between the image acquisition device and the center of the repeated acquisition area, the higher the distance score.
[0028] In this embodiment, the specific calculation process for determining the coverage score based on the acquisition coverage parameters, and the specific calculation process for determining the distance score based on the distance between the image acquisition device and the center of the repeatedly acquired area, can be set by the user. For example, when the acquisition coverage parameter is the coverage area percentage, it can be converted into a decimal as a fraction, or the decimal can be multiplied by 100 as a fraction. The correspondence between the distance between the image acquisition device and the center of the repeatedly acquired area and the distance score can be a simple linear relationship, and the intercept and slope of the linear relationship can be set by the user. In the above calculation process, it is necessary to ensure that the total scores of the calculated coverage score and distance score are the same, for example, both are out of 100.
[0029] In this embodiment, the coverage score and distance score can be weighted to obtain a total score. The weights for the weighting calculation can be evenly distributed or set by the user. In this embodiment, the image acquisition device with the highest total score is designated as the master image acquisition device, and the remaining image acquisition devices are designated as slave image acquisition devices.
[0030] As can be seen from the above, the embodiments of this application calculate the coverage score and distance score respectively through two core indicators: coverage ratio and distance from the center of the area. The total score is obtained through weighted quantization, thereby determining the main image acquisition device. This ensures that the selected main device has both high coverage of the repeated acquisition area and is in a better acquisition position, thereby outputting first image information with higher clarity and more complete information, providing a high-quality benchmark for subsequent adjustment of the device image.
[0031] In one embodiment of this application, a remote supervision and inspection method for special equipment further includes: a process for configuring each image acquisition device, which is performed before S101. Specifically, this process may include: Set the image acquisition area of the main image acquisition device as the region of interest of the main image acquisition device; From the image acquisition area of the image acquisition device, the acquisition area that belongs to the repeated acquisition area is set as the region of non-interest, and the area that does not belong to the repeated acquisition area is set as the region of interest. The region of interest and region of non-interest are used to set the clarity of the image information acquired by the corresponding image acquisition device.
[0032] In this embodiment, if an image acquisition device is the primary image acquisition device, its entire image acquisition area can be set as a Region of Interest (ROI), allowing the primary image acquisition device to output full-field high-definition images, ensuring image integrity and high clarity. In this embodiment, the ROI is the priority area for the image acquisition device, which automatically allocates higher encoding resources to this area, ultimately outputting a high-definition image.
[0033] If an image acquisition device is a slave image acquisition device, the repeatedly acquired area can be set as the non-interest area, and the remaining area (the area of a single image acquisition) can be set as the interest area. The purpose is to reduce the amount of data transmitted in the repeatedly acquired area and reduce the wireless bandwidth usage.
[0034] In one embodiment of this application, the second image information of the repeated image acquisition area acquired by the image acquisition device is adjusted based on the first image information of the repeated image acquisition area acquired by the main image acquisition device to obtain the standard image information corresponding to the repeated image acquisition area, including: Calculate the viewpoint transformation matrix of the main image acquisition device and the slave image acquisition device based on the spatial calibration parameters of the main image acquisition device and the slave image acquisition device; The first image information acquired by the main image acquisition device is corrected according to the viewpoint transformation matrix to obtain the viewpoint-corrected image information. The second image information acquired from the image acquisition device is adjusted based on the image information after perspective correction to obtain the standard image information corresponding to the repeated image acquisition area.
[0035] In this embodiment, the spatial calibration parameters refer to the intrinsic and extrinsic parameters of the image acquisition device. The viewpoint transformation matrix between the main image acquisition device and the slave image acquisition device can be determined based on the following method: The intrinsic parameter matrix of the main image acquisition device is represented as follows: The extrinsic parameters of the main image acquisition device are expressed as follows: (Rotation matrix) and (Translation vector), which will be represented from the intrinsic parameter matrix of the image acquisition device as The extrinsic parameters of the image acquisition device are expressed as follows: and .
[0036] Calculate the rotation matrix from the image acquisition device relative to the main image acquisition device. Calculate the translation vector from the image acquisition device relative to the main image acquisition device. Construct the intermediate matrix ,in express The first column, express The second column. Finally, substitute into the formula. The view transformation matrix is obtained. In this embodiment, the viewpoint transformation matrix should also be included. The last element is normalized to 1 to ensure the uniqueness of the matrix.
[0037] In this embodiment, the process of performing viewpoint correction on the first image information can be as follows: For each pixel in the first image information Convert it to homogeneous coordinates Using the viewpoint transformation matrix Calculate the transformed homogeneous coordinates: Where s is the scale factor, it is finally converted into pixel coordinates. This gives the new position of the pixel in the corrected image.
[0038] In this embodiment, due to the changed Coordinates may be decimals and cannot be directly mapped to pixels, so interpolation algorithms can be used to fill them. Interpolation algorithms such as bilinear interpolation or nearest neighbor interpolation can be used.
[0039] In one embodiment of this application, adjusting the second image information acquired from the image acquisition device based on the image information after viewpoint correction to obtain standard image information corresponding to the repeated image acquisition area includes: For each pixel in the second image information acquired from the image acquisition device, the pixel value of that pixel and the pixel value of the corresponding pixel in the viewpoint-corrected image information are extracted. The pixel value of that pixel is adjusted by taking the average of the pixel value of that pixel and the pixel value of the corresponding pixel in the viewpoint-corrected image information. This process continues until the pixel values of all pixels in the second image information acquired from the image acquisition device are adjusted, thus obtaining the standard image information corresponding to the repeated image acquisition area.
[0040] In this embodiment, for the repeated image acquisition area, since the clarity of the image acquisition device is lower than that of the main image acquisition device, it is necessary to adjust the second image information acquired by the image acquisition device. Simultaneously, to ensure that some information from the original image is still preserved, in this embodiment, for each pixel, the pixel value is adjusted using the average of the pixel value of that pixel and the pixel values of the corresponding pixels in the viewpoint-corrected image information. The adjustment method can be direct overlay.
[0041] As can be seen from the above, this embodiment achieves precise scheduling of encoding resources by configuring differentiated Regions of Interest (ROIs) for the master and slave image acquisition devices. The master image acquisition device sets the entire field of view as the ROI, ensuring the output of high-definition reference images. The slave image acquisition device only sets the single-acquisition area as the ROI, and the repeated image acquisition areas as non-ROIs, allocating only a small amount of encoding resources to output low-resolution images with low data volume, thus reducing network bandwidth usage and data transmission costs. This embodiment calculates the perspective transformation matrix using the intrinsic and extrinsic parameters of the master and slave devices, and completes the perspective correction of the master image through an interpolation algorithm, effectively solving the problem of perspective differences caused by different installation positions and angles of the master and slave devices. The corrected perspective of the master image matches the acquisition perspective of the slave device, avoiding image adjustment errors caused by inconsistent perspectives, making the benchmark for subsequent pixel-level adjustments more unified, and improving the perspective consistency and scene reproduction of the standard images in repeatedly acquired areas.
[0042] In one embodiment of this application, remote monitoring and inspection of a target monitoring area is performed using a special device based on image information of a single image acquisition area and standard image information corresponding to each repeated image acquisition area, including: The image information of a single image acquisition area is identified and compared with the standard image information corresponding to each repeated image acquisition area to obtain the remote supervision and inspection results. In response to the remote supervision and inspection results indicating that the special equipment has an abnormality, the system identifies the target abnormal area contained in the target supervision and inspection area, and when the target abnormal area is a repeated image acquisition area, the image acquisition device that acquires the image information of the target abnormal area performs secondary region of interest configuration. The image information sent by the image acquisition device after the secondary region of interest configuration is identified to obtain the second remote supervision test result; If the image information from the image acquisition device after the secondary region of interest configuration indicates that the target abnormal region is an abnormal region, an alarm will be issued.
[0043] In this embodiment, a trained neural network model can be used to identify the image information of a single image acquisition area and the standard image information corresponding to each repeated image acquisition area, thereby generating remote supervision and inspection results. The training dataset for this neural network model is constructed according to the following standards: it contains a large number of image samples of special equipment, and each image sample is pre-annotated. The annotation information at least covers whether the special equipment corresponding to the sample has an abnormality. If it is necessary to further improve the recognition accuracy, additional detailed information such as the type of abnormality (e.g., weld cracking, component deformation, missing safety accessories, etc.) and the location of the abnormality can be annotated.
[0044] In this embodiment, if the remote monitoring and inspection results indicate that the special equipment has malfunctioned, and the area where the malfunction occurred (the target malfunction area) is a repeatedly acquired image area, then the image acquisition device acquiring the image information of the target malfunction area can be configured with a secondary region of interest. This ensures that all image acquisition devices acquiring the image information of the target malfunction area acquire images at the highest resolution, thereby determining whether an malfunction has occurred. If an malfunction is still detected, an alarm is triggered. If the malfunctioning area (the target malfunction area) is a single-image acquisition area, an alarm is triggered directly.
[0045] In this embodiment, the image acquisition device for acquiring image information of the target abnormal area performs secondary region of interest configuration, including: Extract the global spatial coordinates of the target anomaly region; the global spatial coordinates are determined based on a unified coordinate system of the target monitoring area. Based on the spatial calibration parameters of the image acquisition device for acquiring image information of the target abnormal region, the global spatial coordinates of the target abnormal region are converted into pixel coordinates in the acquisition field of view of the image acquisition device for acquiring image information of the target abnormal region, so as to determine the area to be focused in the image acquisition device for acquiring image information of the target abnormal region corresponding to the target abnormal region; The image acquisition device performs secondary region of interest configuration based on the image information of the abnormal area of the target acquisition area.
[0046] In this embodiment, global spatial coordinates refer to physical coordinates based on a unified coordinate system of the target inspection area. The unified coordinate system refers to a common three-dimensional spatial reference system established for the target inspection area (such as a production workshop or equipment operating site). All key parts of image acquisition devices and special equipment must be pre-calibrated in this coordinate system. Its function is to eliminate coordinate differences between different devices and different areas.
[0047] In this embodiment, the pixel coordinates in the field of view refer to the pixel position and range of the target abnormal area in the image of a certain image acquisition device. The same physical abnormal area will have different pixel coordinates in the field of view of cameras at different installation positions. The area to be focused refers to the pixel range of the abnormal area within the field of view of the image acquisition device after conversion. It is the precise target range of the secondary ROI configuration. It is only necessary to set this area as the region of interest, without the need for high-definition acquisition of the entire field of view of the camera.
[0048] In this embodiment, coordinate transformation is performed on each of the image acquisition devices covering the abnormal area, and the global spatial coordinates of the target abnormal area are input. The intrinsic parameter matrix of the image acquisition device and external references .
[0049] Convert global physical coordinates to camera pixel coordinates: ,in Here, 's' represents the pixel coordinates, and 's' represents the scale factor. Next, the pixel coordinates corresponding to the boundary points of the abnormal region's global coordinates are calculated to obtain the pixel range of the abnormal region within the camera's field of view, i.e., the region to be focused. Finally, the region to be focused is set as the region of interest, completing the secondary region of interest configuration.
[0050] As can be seen from the above, this embodiment uses a well-annotated neural network model to perform initial anomaly identification on image information, ensuring basic identification efficiency. At the same time, for suspected anomalies in repeated image acquisition areas, a secondary region of interest configuration mechanism is designed, setting only the target anomaly area as the region of interest, driving the corresponding image acquisition device to focus on the area and output a high-definition image, and then performing secondary identification and verification to avoid misjudgment problems caused by insufficient image clarity and viewing angle deviation, significantly improving the accuracy of anomaly identification of special equipment and ensuring the reliability of remote monitoring results.
[0051] Corresponding to the remote supervision and inspection method for special equipment in the above embodiment, Figure 2This is a structural block diagram of a remote monitoring and inspection device for special equipment provided in one embodiment of this application. For ease of explanation, only the parts relevant to the embodiment of this application are shown. References Figure 2 The special equipment remote supervision and inspection device 20 includes: an image acquisition module 21, an image adjustment module 22, and a remote monitoring module 23.
[0052] The image acquisition module 21 is used to acquire image information of the target inspection area containing special equipment. The target inspection area includes at least one repeated image acquisition area and a single image acquisition area. The device for acquiring image information of the repeated image acquisition area includes a main image acquisition device and a secondary image acquisition device. The image information acquired by the main image acquisition device has a higher clarity than the image information acquired by the secondary image acquisition device. The image adjustment module 22 is used to adjust the second image information of the repeated image acquisition area acquired from the image acquisition device based on the first image information of the repeated image acquisition area acquired by the main image acquisition device, so as to obtain the standard image information corresponding to the repeated image acquisition area. The remote monitoring module 23 is used to conduct remote monitoring and inspection of special equipment in the target monitoring area based on the image information of the single image acquisition area and the standard image information corresponding to each repeated image acquisition area.
[0053] In one embodiment of this application, the special equipment remote supervision and inspection device 20 further includes: a master-slave image acquisition device determination module, which is used to determine a coverage score based on the acquisition coverage parameters of each image acquisition device that has acquired image information of the repeated image acquisition area, and to determine a distance score based on the distance between the image acquisition device and the center of the repeated acquisition area, and to determine the total score of the image acquisition device based on the coverage score and the distance score. Among the image acquisition devices that have acquired image information from the repeated image acquisition area, the image acquisition device with the highest total score is designated as the master image acquisition device, and the remaining image acquisition devices among those that have acquired image information from the repeated image acquisition area are designated as slave image acquisition devices.
[0054] In one embodiment of this application, the special equipment remote supervision and inspection device 20 further includes: a configuration module, used to set the image acquisition area of the main image acquisition device as the region of interest of the main image acquisition device; From the image acquisition area of the image acquisition device, the acquisition area that belongs to the repeated acquisition area is set as the region of non-interest, and the area that does not belong to the repeated acquisition area is set as the region of interest. The region of interest and region of non-interest are used to set the clarity of the image information acquired by the corresponding image acquisition device.
[0055] In one embodiment of this application, the image adjustment module 22 is specifically used to calculate the perspective transformation matrix of the main image acquisition device and the slave image acquisition device based on the spatial calibration parameters of the main image acquisition device and the spatial calibration parameters of the slave image acquisition device. The first image information acquired by the main image acquisition device is corrected according to the viewpoint transformation matrix to obtain the viewpoint-corrected image information. The second image information acquired from the image acquisition device is adjusted based on the image information after perspective correction to obtain the standard image information corresponding to the repeated image acquisition area.
[0056] In one embodiment of this application, the image adjustment module 22 is further configured to extract the pixel value of each pixel in the second image information acquired from the image acquisition device, and the pixel value of the corresponding pixel in the image information after viewpoint correction; adjust the pixel value of the pixel by taking the average of the pixel value of the pixel and the pixel value of the corresponding pixel in the image information after viewpoint correction; until the pixel values of all pixels in the second image information acquired from the image acquisition device are adjusted, and obtain the standard image information corresponding to the repeated image acquisition area.
[0057] In one embodiment of this application, the remote monitoring module 23 is specifically used to identify the image information of a single image acquisition area and the standard image information corresponding to each repeated image acquisition area to obtain the remote monitoring and inspection result; In response to the remote supervision and inspection results indicating that the special equipment has an abnormality, the system identifies the target abnormal area contained in the target supervision and inspection area, and when the target abnormal area is a repeated image acquisition area, the image acquisition device that acquires the image information of the target abnormal area performs secondary region of interest configuration. The image information sent by the image acquisition device after the secondary region of interest configuration is identified to obtain the second remote supervision test result; If the image information from the image acquisition device after the secondary region of interest configuration indicates that the target abnormal region is an abnormal region, an alarm will be issued.
[0058] In one embodiment of this application, the remote monitoring module 23 is further used to extract the global spatial coordinates of the target abnormal area; the global spatial coordinates are determined based on a unified coordinate system of the target monitoring area; Based on the spatial calibration parameters of the image acquisition device for acquiring image information of the target abnormal region, the global spatial coordinates of the target abnormal region are converted into pixel coordinates in the acquisition field of view of the image acquisition device for acquiring image information of the target abnormal region, so as to determine the area to be focused in the image acquisition device for acquiring image information of the target abnormal region corresponding to the target abnormal region; The image acquisition device performs secondary region of interest configuration based on the image information of the abnormal area of the target acquisition area.
[0059] See Figure 3 , Figure 3 This is a schematic block diagram of an electronic device provided according to an embodiment of this application. Figure 3 The electronic device 300 in this embodiment may include one or more processors 301, one or more input devices 302, one or more output devices 303, and one or more memories 304. The processors 301, input devices 302, output devices 303, and memories 304 communicate with each other via a communication bus 305. The memories 304 store computer programs, including program instructions. The processors 301 execute the program instructions stored in the memories 304. Specifically, the processors 301 are configured to invoke the program instructions to perform the functions of each module / unit in the above-described device embodiments, for example... Figure 2 The functions of the image acquisition module 21, image adjustment module 22, and remote monitoring module 23 are shown.
[0060] It should be understood that, in the embodiments of this application, the processor 301 may be a central processing unit (CPU), but it may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.
[0061] Input device 302 may include a touchpad, a fingerprint sensor (for collecting the user's fingerprint information and fingerprint orientation information), a microphone, etc., and output device 303 may include a display (LCD, etc.), a speaker, etc.
[0062] The memory 304 may include read-only memory and random access memory, and provides instructions and data to the processor 301. A portion of the memory 304 may also include non-volatile random access memory. For example, the memory 304 may also store device type information.
[0063] In specific implementations, the processor 301, input device 302, and output device 303 described in the embodiments of this application can execute the implementation method described in the remote supervision and inspection method for special equipment provided in the embodiments of this application, or they can execute the implementation method of the electronic equipment described in the embodiments of this application, which will not be repeated here.
[0064] In another embodiment of this application, a computer-readable storage medium is provided. This computer-readable storage medium stores a computer program, which includes program instructions. When executed by a processor, the program instructions implement all or part of the processes in the methods described above. Alternatively, the computer program can instruct related hardware to complete the process. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include any entity or device capable of carrying computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.
[0065] The computer-readable storage medium can be an internal storage unit of the electronic device in any of the foregoing embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium can also be an external storage device of the electronic device, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD), flash card, etc., provided on the electronic device. Furthermore, the computer-readable storage medium can include both internal and external storage units of the electronic device. The computer-readable storage medium is used to store computer programs and other programs and data required by the electronic device. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.
[0066] Those skilled in the art will recognize that the modules / units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.
[0067] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the electronic devices and units described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0068] In the several embodiments provided in this application, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of modules / units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules, units, or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces or modules / units, or it may be an electrical, mechanical, or other form of connection.
[0069] The modules / units described as separate components may or may not be physically separate. Similarly, the components shown as modules / units may or may not be physical modules / units; they may be located in one place or distributed across multiple network modules / units. Some or all of the modules / units can be selected to achieve the purpose of the embodiments of this application, depending on actual needs.
[0070] Furthermore, the functional modules / units in the various embodiments of this application can be integrated into one processing module / unit, or each module / unit can exist physically separately, or two or more modules / units can be integrated into one module / unit. The integrated modules / units described above can be implemented in hardware or in the form of software functional modules / units.
[0071] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A method for remote supervision and inspection of special equipment, characterized in that, include: Image information of a target inspection area containing special equipment is acquired. The target inspection area includes at least one repeated image acquisition area and a single image acquisition area. The device for acquiring image information of the repeated image acquisition area includes a main image acquisition device and a secondary image acquisition device. The image information acquired by the main image acquisition device has higher clarity than the image information acquired by the secondary image acquisition device. For each repeated image acquisition area, the following processing is performed: Based on the first image information of the repeated image acquisition area acquired by the main image acquisition device, the second image information of the repeated image acquisition area acquired by the image acquisition device is adjusted to obtain the standard image information corresponding to the repeated image acquisition area; Based on the image information of the single image acquisition area and the standard image information corresponding to each repeated image acquisition area, the target monitoring area is subjected to remote monitoring and inspection of special equipment.
2. The remote supervision and inspection method for special equipment as described in claim 1, characterized in that, The method further includes: For each image acquisition device that has acquired image information of the repeated image acquisition area, a coverage score is determined based on the acquisition coverage parameters of the image acquisition device, and a distance score is determined based on the distance between the image acquisition device and the center of the repeated acquisition area. The total score of the image acquisition device is determined based on the coverage score and the distance score. The image acquisition device with the highest total score among the image acquisition devices that have acquired image information in the repeated image acquisition area is designated as the master image acquisition device, and the remaining image acquisition devices among the image acquisition devices that have acquired image information in the repeated image acquisition area are designated as slave image acquisition devices.
3. The remote supervision and inspection method for special equipment as described in claim 1, characterized in that, The method further includes: Set the image acquisition area of the main image acquisition device as the region of interest of the main image acquisition device; In the image acquisition area from the image acquisition device, the acquisition area that belongs to the repeated acquisition area is set as the region of non-interest, and the area that does not belong to the repeated acquisition area is set as the region of interest. The region of interest and the region of non-interest are used to set the clarity of the image information acquired by the corresponding image acquisition device.
4. The remote supervision and inspection method for special equipment as described in claim 1, characterized in that, The step of adjusting the second image information of the repeated image acquisition area acquired from the image acquisition device based on the first image information of the repeated image acquisition area acquired by the main image acquisition device to obtain the standard image information corresponding to the repeated image acquisition area includes: Calculate the perspective transformation matrix of the main image acquisition device and the slave image acquisition device based on the spatial calibration parameters of the main image acquisition device and the slave image acquisition device; The first image information acquired by the main image acquisition device is corrected according to the viewpoint transformation matrix to obtain the viewpoint-corrected image information. The second image information acquired from the image acquisition device is adjusted based on the image information after the perspective correction to obtain the standard image information corresponding to the repeated image acquisition area.
5. The remote supervision and inspection method for special equipment as described in claim 4, characterized in that, The step of adjusting the second image information acquired from the image acquisition device based on the perspective-corrected image information to obtain the standard image information corresponding to the repeated image acquisition area includes: For each pixel in the second image information acquired from the image acquisition device, the pixel value of that pixel and the pixel value of the corresponding pixel in the viewpoint-corrected image information are extracted. The pixel value of that pixel is adjusted by taking the average of the pixel value of that pixel and the pixel value of the corresponding pixel in the viewpoint-corrected image information. This process continues until the pixel values of all pixels in the second image information acquired from the image acquisition device are adjusted, thereby obtaining the standard image information corresponding to the repeated image acquisition area.
6. The method for remote supervision and inspection of special equipment as described in claim 1, characterized in that, The step of performing remote monitoring and inspection of the target inspection area using special devices based on the image information of the single image acquisition area and the standard image information corresponding to each repeated image acquisition area includes: The image information of the single image acquisition area is identified with the standard image information corresponding to each repeated image acquisition area to obtain the remote supervision and inspection result; In response to the remote monitoring and inspection result indicating that the special equipment has malfunctioned, the target abnormal region contained in the target monitoring and inspection area is identified, and when the target abnormal region is a repeated image acquisition area, the image acquisition device that acquires the image information of the target abnormal region is configured with a secondary region of interest. The image information sent by the image acquisition device after the secondary region of interest configuration is identified to obtain the second remote supervision test result; If the image information from the image acquisition device after the secondary region of interest configuration indicates that the target abnormal region is an abnormal region, an alarm is issued.
7. The remote supervision and inspection method for special equipment as described in claim 6, characterized in that, The image acquisition device for acquiring image information of the target anomaly region performs secondary region of interest configuration, including: Extract the global spatial coordinates of the target anomaly region; the global spatial coordinates are determined based on a unified coordinate system of the target monitoring region. Based on the spatial calibration parameters of the image acquisition device that acquires image information of the target abnormal region, the global spatial coordinates of the target abnormal region are converted into pixel coordinates in the acquisition field of view of the image acquisition device that acquires image information of the target abnormal region, so as to determine the area to be focused on in the image acquisition device that acquires image information of the target abnormal region corresponding to the target abnormal region; The image acquisition device performs secondary region of interest configuration based on the area to be focused on to acquire image information of the target abnormal area.
8. A remote monitoring and inspection device for special equipment, characterized in that, include: The image acquisition module is used to acquire image information of a target inspection area containing special equipment. The target inspection area includes at least one repeated image acquisition area and a single image acquisition area. The device for acquiring image information of the repeated image acquisition area includes a main image acquisition device and a secondary image acquisition device. The image information acquired by the main image acquisition device has a higher clarity than the image information acquired by the secondary image acquisition device. The image adjustment module is used to adjust the second image information of the repeated image acquisition area acquired by the image acquisition device based on the first image information of the repeated image acquisition area acquired by the main image acquisition device, so as to obtain the standard image information corresponding to the repeated image acquisition area. The remote monitoring module is used to perform remote monitoring and inspection of the target monitoring area based on the image information of the single image acquisition area and the standard image information corresponding to each repeated image acquisition area.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 7.
10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 7.