Monitoring point configuration method and device, electronic equipment and storage medium

Through visual annotation and parameter configuration of panoramic images, the monitoring point configuration is automated, which solves the problems of inefficiency and human errors of traditional manual configuration, and realizes efficient and accurate monitoring point configuration.

CN119228880APending Publication Date: 2024-12-31FUJIAN HUICHUAN DIGITAL TECH
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411241262.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-05
Publication Date
2024-12-31

AI Technical Summary

Technical Problem

The traditional monitoring point configuration method requires manual operation, which leads to inefficiency and prone to human errors, affecting the accuracy of monitoring data and the reliability of environmental monitoring.

Method used

By obtaining the original panoramic image of the monitored area, visually labeling and parameter configuration of the target object, automatically determine the monitoring parameters, and realize automatic monitoring point configuration.

Benefits of technology

It improves the automation and accuracy of monitoring point configuration, reduces human errors, and improves configuration efficiency and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119228880A_ABST
    Figure CN119228880A_ABST
Patent Text Reader

Abstract

The invention provides a monitoring point configuration method and device, electronic equipment and a storage medium. The configuration method comprises the steps that an original panoramic image of a monitored area is acquired; performing visual labeling on a target object in the original panoramic image, and displaying the labeled target panoramic image; and in response to a parameter configuration operation of a user on each target object in the target panoramic image, determining a monitoring parameter of a monitoring item corresponding to each target object in the panoramic image, and completing configuration. Thus, through the technical scheme of the invention, automatic and intelligent monitoring point configuration can be realized, and according to panoramic image display and target object visual labeling, the configuration efficiency and the configuration accuracy can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of monitoring technology, and in particular to a configuration method, device, electronic device and storage medium for monitoring points. Background Art

[0002] In modern monitoring systems, the configuration of monitoring points is a key link to ensure data collection and environmental monitoring. However, the traditional configuration of monitoring points has some significant limitations, which may affect the accuracy and efficiency of monitoring.

[0003] Among them, the limitations include: the existing monitoring point configuration process requires manual intervention by the user. Before starting the configuration, the user needs to manually move the device to the area where the monitoring point is located. In order to obtain a clear image of the monitoring point, the user also needs to manually adjust the focus of the device camera and perform further manual configuration according to the different attributes of the monitoring point (such as target type, monitoring target, etc.).

[0004] However, this manual configuration method is extremely cumbersome and inefficient, especially when multiple monitoring points need to be configured. Manual configuration is difficult to meet the needs of efficient operation, and human errors are prone to occur during the configuration process, which may cause the collected data to be invalid, thus causing the failure of monitoring work. Invalid data not only wastes resources, but may also have a negative impact on environmental monitoring and decision-making.

[0005] Therefore, a more automated and intelligent monitoring point configuration method is needed to improve configuration efficiency, reduce the possibility of human errors, and ensure the reliability of monitoring work and the accuracy of data. Summary of the invention

[0006] In view of this, the purpose of this application is to provide a monitoring point configuration method, device, electronic device and storage medium, which can realize automatic and intelligent monitoring point configuration, and based on panoramic image display and target object visual annotation, it is conducive to improving configuration efficiency and configuration accuracy.

[0007] The present application provides a configuration method for monitoring points, the configuration method comprising:

[0008] Obtaining the original panoramic image of the monitored area;

[0009] Visually annotating the target object in the original panoramic image, and displaying the annotated target panoramic image;

[0010] In response to the user's parameter configuration operation on each target object in the target panoramic image, the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image are determined to complete the configuration.

[0011] Optionally, after determining the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image, the configuration method further includes:

[0012] According to the monitoring parameters of the corresponding monitoring items of all target objects, the working parameters of the monitoring equipment are configured to automatically monitor all target objects.

[0013] Optionally, the original panoramic image of the monitored area is determined by the following steps:

[0014] Acquire multiple source images of the monitored area collected by the monitoring device in different postures;

[0015] The plurality of source images are stitched together using a panoramic mosaic technique to determine the original panoramic image.

[0016] Optionally, visually marking the target object in the original panoramic image includes:

[0017] Identify the target objects in the original panoramic image, and determine the object type of each target object and the pixel coordinates of each target object in the original panoramic image;

[0018] For each target object, determining a marked area according to pixel coordinates of the target object located in the original panoramic image;

[0019] Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

[0020] Optionally, visually marking the target object in the original panoramic image includes:

[0021] Recognize and deduplicate the target objects in each source image, determine the object type of each target object and the pixel coordinates of each target object in the corresponding source image;

[0022] Determining pixel coordinates of each target object in the original panoramic image according to a mapping relationship between the source image and the original panoramic image;

[0023] For each target object, determining a marked area according to pixel coordinates of the target object located in the original panoramic image;

[0024] Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

[0025] Optionally, in response to a user's parameter configuration operation on each target object in the target panoramic image, determining a monitoring parameter of a monitoring item corresponding to each target object in the panoramic image includes:

[0026] In response to the user's selection operation on any target object, a parameter configuration box of the monitoring item corresponding to the target object is displayed;

[0027] The configuration operation of the user in the parameter configuration box is identified, and the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image are determined.

[0028] Optionally, the monitoring items include at least one of the following: monitoring point name, monitoring activation status, monitoring cycle, monitoring time period and monitoring point type.

[0029] The present application also provides a configuration device for a monitoring point, the configuration device comprising:

[0030] An acquisition module is used to acquire an original panoramic image of the monitored area;

[0031] A labeling module, used to visually label the target object in the original panoramic image and display the labeled target panoramic image;

[0032] The configuration module is used to determine the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image in response to the user's parameter configuration operation on each target object in the panoramic image, and complete the configuration.

[0033] Optionally, the configuration device further includes a monitoring module, and the monitoring module is used to:

[0034] After determining the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image, the monitoring equipment is configured with working parameters according to the monitoring parameters of the monitoring items corresponding to all target objects, so as to automatically monitor all target objects.

[0035] Optionally, the configuration device further includes a splicing module, and the splicing module is used to:

[0036] Acquire multiple source images of the monitored area collected by the monitoring device in different postures;

[0037] The plurality of source images are stitched together using a panoramic mosaic technique to determine the original panoramic image.

[0038] Optionally, when the annotation module is used to visually annotate the target object in the original panoramic image, the annotation module is used to:

[0039] Identify the target objects in the original panoramic image, and determine the object type of each target object and the pixel coordinates of each target object in the original panoramic image;

[0040] For each target object, determining a marked area according to pixel coordinates of the target object located in the original panoramic image;

[0041] Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

[0042] Optionally, when the annotation module is used to visually annotate the target object in the original panoramic image, the annotation module is used to:

[0043] Recognize and deduplicate the target objects in each source image, determine the object type of each target object and the pixel coordinates of each target object in the corresponding source image;

[0044] Determining pixel coordinates of each target object in the original panoramic image according to a mapping relationship between the source image and the original panoramic image;

[0045] For each target object, determining a marked area according to pixel coordinates of the target object located in the original panoramic image;

[0046] Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

[0047] Optionally, when the configuration module is used to determine the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image in response to the user's parameter configuration operation on each target object in the target panoramic image, the configuration module is used to:

[0048] In response to the user's selection operation on any target object, a parameter configuration box of the monitoring item corresponding to the target object is displayed;

[0049] The configuration operation of the user in the parameter configuration box is identified, and the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image are determined.

[0050] Optionally, the monitoring items include at least one of the following: monitoring point name, monitoring activation status, monitoring cycle, monitoring time period and monitoring point type.

[0051] An embodiment of the present application also provides an electronic device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the steps of the configuration method as described above are performed.

[0052] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the configuration method described above are executed.

[0053] An embodiment of the present application provides a configuration method, device, electronic device and storage medium for monitoring points. The configuration method includes: acquiring an original panoramic image of a monitored area; visually annotating target objects in the original panoramic image, and displaying the annotated target panoramic image; in response to a user's parameter configuration operation on each target object in the target panoramic image, determining monitoring parameters of monitoring items corresponding to each target object in the panoramic image, and completing the configuration.

[0054] In this way, by obtaining the original panoramic image of the monitored area and visually annotating the target object, the user can intuitively perform parameter configuration operations on the panoramic image, reducing the tediousness of manual operation and improving configuration efficiency. By directly annotating and configuring on the image, the accuracy of the configuration is significantly improved; and after completing the parameter configuration of the target object, the system can automatically adjust the working parameters of the monitoring equipment according to the configured monitoring parameters, thereby realizing automatic monitoring of all target objects. Compared with the traditional method of manually setting the parameters of each monitoring device, this automated process reduces manual intervention and reduces the risk of human operation errors. Therefore, the monitoring point configuration method in this solution significantly optimizes the monitoring point configuration process, reduces the complexity of manual operation, improves the accuracy and efficiency of configuration, and also enhances the intelligence of the system and user experience.

[0055] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0057] Figure 1A flow chart of a monitoring point configuration method provided in an embodiment of the present application;

[0058] Figure 2 One of the structural schematic diagrams of a monitoring point configuration device provided in an embodiment of the present application;

[0059] Figure 3 A second structural diagram of a monitoring point configuration device provided in an embodiment of the present application;

[0060] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work belongs to the scope of protection of the present application.

[0062] In modern monitoring systems, the configuration of monitoring points is a key link to ensure data collection and environmental monitoring. However, the traditional configuration of monitoring points has some significant limitations, which may affect the accuracy and efficiency of monitoring.

[0063] Among them, the limitations include: the existing monitoring point configuration process requires manual intervention by the user. Before starting the configuration, the user needs to manually move the device to the area where the monitoring point is located. In order to obtain a clear image of the monitoring point, the user also needs to manually adjust the focus of the device camera and perform further manual configuration according to the different attributes of the monitoring point (such as target type, monitoring target, etc.).

[0064] However, this manual configuration method is extremely cumbersome and inefficient, especially when multiple monitoring points need to be configured. Manual configuration is difficult to meet the needs of efficient operation, and human errors are prone to occur during the configuration process, which may cause the collected data to be invalid, thus causing the failure of monitoring work. Invalid data not only wastes resources, but may also have a negative impact on environmental monitoring and decision-making.

[0065] Therefore, a more automated and intelligent monitoring point configuration method is needed to improve configuration efficiency, reduce the possibility of human errors, and ensure the reliability of monitoring work and the accuracy of data.

[0066] Based on this, the embodiments of the present application provide a monitoring point configuration method, device, electronic device and storage medium, which can realize automatic and intelligent monitoring point configuration, and is conducive to improving configuration efficiency and configuration accuracy based on panoramic image display and target object visual annotation.

[0067] See also Figure 1 , Figure 1 This is a flow chart of a method for configuring monitoring points provided in an embodiment of the present application. Figure 1 As shown in , the configuration method provided in the embodiment of the present application includes:

[0068] S101: Acquire an original panoramic image of a monitored area.

[0069] S102: Visually annotate the target object in the original panoramic image, and display the annotated target panoramic image.

[0070] S103: In response to the user's parameter configuration operation on each target object in the target panoramic image, determine the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image, and complete the configuration.

[0071] An embodiment of the present application provides a method for configuring monitoring points. First, a complete image of the monitored area (i.e., the original panoramic image) is obtained, which covers the entire area to be monitored and provides a basis for subsequent target object identification and configuration; then, the target objects of interest (such as monitoring points) are automatically identified in the original panoramic image, and these objects are visually annotated. In this way, these annotations may include graphic marks (such as rectangular boxes) and text labels to help users intuitively identify the position and attributes of each target object in the panoramic image; then, the annotated target panoramic image is displayed, so that the user can view all annotated target objects on this intuitive image interface, and the user can perform parameter configuration operations by clicking or selecting the target object in the panoramic image. Finally, according to the user's configuration operation, the monitoring parameters of each target object are determined, and the configuration of the monitoring point is completed, so that each target object now has corresponding monitoring parameters and can perform monitoring operations based on these parameters.

[0072] Therefore, this monitoring point configuration method significantly improves the degree of automation, operational efficiency and accuracy of monitoring point configuration, while also optimizing the user experience, reducing the possibility of human error, and has significant technical advantages.

[0073] For step S101, for example, the monitored area includes but is not limited to the following scene areas: industrial facilities (factory workshops, storage tank areas, production lines, etc.), building structures (bridges, high-rise buildings, tunnels, etc.), transportation facilities (roads and highways, rail transit, airport runways), natural environment (rivers and dams, mountains and landslide areas, forests and ecological protection areas), energy facilities (wind farms, solar power stations, power substations, etc.), water conservancy projects (reservoirs, irrigation canals), public safety facilities (subway stations and underground passages, stadiums, nuclear power plants), etc.

[0074] In an implementation manner provided in the present application, the original panoramic image of the monitored area is determined by the following steps:

[0075] S201. Acquire multiple source images of a monitored area captured by a monitoring device in different postures.

[0076] S202: Use panoramic mosaic technology to stitch the multiple source images to determine the original panoramic image.

[0077] With respect to step S201, the monitoring device is a device for collecting images, such as a camera, a laser radar, etc.

[0078] Different postures refer to different orientations or angles of the monitoring device, such as rotation, tilt, elevation, etc. These changes allow the device to capture multiple images of the monitored area from different angles.

[0079] The multiple source images collected are multiple images taken by the device in different postures, and these images contain different parts of the monitored area or the same part seen from different angles.

[0080] For example, the remote video monitoring equipment includes a dual-axis electric pan-tilt head, a zoom camera and a laser rangefinder installed in parallel on the electric pan-tilt head. The dual-axis electric pan-tilt head is rotated to different pan-tilt angles, and the zoom camera is used to capture multiple source images of the monitored area.

[0081] With respect to step S202, in this step, the plurality of source images are stitched together using panoramic mosaic technology to determine the original panoramic image, including: aligning and fusing the source images according to their overlapping parts, removing duplicate parts, and correcting the geometric distortion of the images to generate a complete image covering the entire monitored area.

[0082] Here, taking the landslide monitoring scene as an example, the process of determining the original panoramic image is explained:

[0083] Multiple source images acquired: A fixed monitoring camera takes multiple images of the mountain from different angles (such as the left side, the right side, and the front), and each image shows a part of the mountain.

[0084] Image registration: Align overlapping areas (such as specific mountain features) in each source image so that images from different angles are seamlessly connected.

[0085] Image fusion: fuse the edge parts of the image to eliminate the stitching gaps, making the stitched mountain look natural and continuous.

[0086] Geometric Correction: Corrects distortions and deformations in the image so that the shape of the mountains remains consistent across the panorama.

[0087] The original panoramic image is obtained, and the stitched panorama shows the entire mountain, seamlessly connected from different angles, providing a complete view for monitoring landslides.

[0088] In this way, a wide and complete view (original panoramic image) is created by synthesizing multiple source images, so that the overall situation of the monitored area is clear at a glance, which is conducive to further analysis and processing.

[0089] The present application provides two annotation methods. In one implementation of the present application, the visual annotation of the target object in the original panoramic image includes:

[0090] S10211. Identify target objects in the original panoramic image, and determine the object type of each target object and the pixel coordinates of each target object in the original panoramic image.

[0091] S10212: For each target object, determine a marked area according to the pixel coordinates of the target object located in the original panoramic image.

[0092] S10213. Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

[0093] For step S10211, for example, different target objects in the original panoramic image can be located and identified through a target detection algorithm (such as YOLO, SSD, Faster R-CNN, etc.) or a pre-trained target detection model.

[0094] Determining the object type may include: after identifying the target object, comparing the identified object with a predefined category to determine the object type of each target object. For example, when the monitored area is a foundation pit and a high and steep slope, the target object may include: a checkerboard, a circular target, a square target, a total reflection prism, a crack, etc.

[0095] Determining the pixel coordinate location may include calculating the location of the target object in the image in the form of pixel coordinates, such as (x, y) coordinates.

[0096] Regarding step S10212, here, a region is determined based on the pixel coordinates of the target object. This region surrounds the target object in the image and is called a marked region.

[0097] The range and shape of the marking area depends on the application requirements, and may be an area within a certain distance around the target object, or a rectangular or circular area of ​​a specific size. In this example, the marking area may be set to the smallest rectangle including the target object.

[0098] With respect to step S10213, here, graphic annotations are added in each marked area, which may be borders, circles, arrows, etc. These graphic annotations are used to highlight or emphasize the position and range of the target object.

[0099] A text label is added to each marked area to provide specific information about the target object. The content of the text label is determined according to the object type of the target object. For example, if the target object is a "chessboard", the text label can be "chessboard"; if it is a "crack", the text label can be "crack".

[0100] In this way, by identifying the target objects, determining their pixel coordinates, setting the marked areas, and adding graphic annotations and text labels in these areas, users can more easily see and understand the location and type of different target objects in the image. This visual annotation method plays an important role in image analysis, data recording and subsequent processing.

[0101] Continuing with step S102, in another implementation manner provided in the present application, visually marking the target object in the original panoramic image includes:

[0102] S10221. Perform recognition processing and deduplication processing on the target objects in each source image respectively, and determine the object type of each target object and the pixel coordinates of each target object in the corresponding source image.

[0103] S10222. Determine pixel coordinates of each target object in the original panoramic image according to a mapping relationship between the source image and the original panoramic image.

[0104] S10223. For each target object, determine a marked area according to the pixel coordinates of the target object located in the original panoramic image.

[0105] S10224. Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

[0106] For step S10221, when identifying the target object in each source image, for example, it may include: applying a target detection algorithm in each source image to identify the target object. These algorithms may include deep learning models (such as YOLO, SSD, Faster R-CNN, etc.), which analyze the image and detect the presence of the target object. The recognition result includes the specific location of each target object (the location in the source image) and its object type.

[0107] De-duplication processing includes: in multiple source images, the target object may be detected multiple times, and the purpose of de-duplication processing is to eliminate these repeated target objects to ensure that each target object is only calculated once when synthesizing a panoramic image.

[0108] Deduplication is usually performed by comparing the location and type of target objects in different images. Common methods include location-based matching (such as overlapping area detection) and feature-based matching (such as comparison using feature descriptors).

[0109] In this way, the target object finally determined is calculated only once when synthesizing the panoramic image.

[0110] For step S10222, the mapping relationship between the source image and the panoramic image refers to how to convert the pixel coordinates in the source image to the corresponding positions in the panoramic image. This mapping relationship is usually determined based on the geometric transformation (such as perspective transformation, affine transformation, etc.) used in the image stitching technology.

[0111] Thus, once the mapping relationship is determined, the relationship can be used to convert the pixel coordinates of the target object in the source image into the pixel coordinates in the panoramic image.

[0112] For example, the conversion method includes: using a transformation matrix or a mapping function in a mapping relationship to convert the coordinates of the target object in the source image into the coordinates in the panoramic image.

[0113] Steps S10223-S10224 are the same as the above steps S10212-S10213 and will not be repeated here.

[0114] In this way, through these steps, comprehensive visual annotation of target objects in the original panoramic image is achieved. This process ensures the accurate identification and positioning of target objects, clearly displays the type and location of target objects, and the addition of graphic annotations and text labels makes image information more intuitive and easy to understand, providing strong support for subsequent analysis, decision-making and application.

[0115] Moreover, identifying target objects from source images can provide significant advantages in terms of accuracy, speed, computational complexity, and annotation accuracy.

[0116] With respect to step S103, in an implementation manner provided in the present application, in response to the user's parameter configuration operation on each target object in the target panoramic image, determining the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image includes:

[0117] S1031. In response to a user's selection operation on any target object, a parameter configuration box of a monitoring item corresponding to the target object is displayed.

[0118] S1032: Identify the configuration operation of the user in the parameter configuration box, and determine the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image.

[0119] With respect to step S1031 , here, the user interacts with the target panoramic image, selects the visual annotation result of the target object by clicking, touching or other means, and selects a specific target object.

[0120] A parameter configuration box is a user interface component used to display settings or parameters related to a selected target object. For example, this parameter configuration box may generally contain input fields, drop-down menus, buttons, etc., allowing users to view and modify configuration parameters of the target object.

[0121] The content of the parameter configuration box varies according to the type of target object and monitoring requirements. The display condition includes: only after the user selects a target object, the corresponding parameter configuration box will be displayed so that the user can further operate or adjust the target object.

[0122] With respect to step S1032, the monitoring parameters of the monitoring item include at least one of the following: a monitoring point name, a monitoring activation state, a monitoring cycle, a monitoring time period, and a monitoring point type.

[0123] In this step, the user's operation in each parameter configuration box is identified and understood (the user may set some parameters or options in this configuration box). Based on the user's configuration, the monitoring parameters required for the monitoring items of each target object in the panoramic image are determined. These parameters are used to guide the specific details and requirements of monitoring.

[0124] Here, the monitoring point name is the identification name of the monitoring point, which is used to distinguish different monitoring objects;

[0125] The monitoring enable state indicates whether the monitoring item is enabled, usually a switch state (enabled or disabled).

[0126] The monitoring cycle can be set to a monitoring time interval, such as every hour, every day, etc.

[0127] The monitoring time period defines the specific time range for monitoring, such as a certain time period every day.

[0128] Monitoring point type: describes the type or type of monitoring point, such as chessboard displacement monitoring, prism displacement monitoring, target displacement monitoring, crack visual monitoring, etc.

[0129] After executing step S103, in an embodiment provided in the present application, the configuration method further includes: configuring working parameters of the monitoring equipment according to monitoring parameters of corresponding monitoring items of all target objects to automatically monitor all target objects.

[0130] The purpose of this step is to apply the monitoring parameters of each target object in the panoramic image to the monitoring devices to ensure that these devices can perform the monitoring tasks in a predetermined manner.

[0131] For example, the configuration process may include the following:

[0132] First, collect monitoring parameters, for example, including the monitoring point name of the target object, monitoring activation status, monitoring cycle, monitoring time period, and monitoring point type.

[0133] Then, configure the monitoring equipment, including selecting the equipment type, setting the working mode, setting the monitoring cycle, defining the monitoring time period, and configuring other parameters (if necessary, other related parameters can also be set, such as data storage method, alarm threshold, data transmission method, etc.).

[0134] Finally, automatic monitoring. After the configuration is complete, start the device for automatic monitoring. The device will automatically collect data, perform monitoring tasks, and record the results according to the configured parameters.

[0135] In this way, the monitoring data of the equipment can be collected and analyzed to evaluate the status of the target object or discover potential problems. And according to the actual monitoring results and needs, it may be necessary to adjust the monitoring parameters and reconfigure the equipment.

[0136] Therefore, according to the technical solution disclosed in the present application, by acquiring the original panoramic image of the monitored area and visually marking the target object, the user can intuitively perform parameter configuration operations on the panoramic image; the tediousness of manual operations is reduced, the configuration efficiency is improved, and the accuracy of the configuration is significantly improved by directly marking and configuring on the image.

[0137] After completing the parameter configuration of the target object, the working parameters of the monitoring equipment can be automatically adjusted according to the configured monitoring parameters, thereby realizing automatic monitoring of all target objects. Compared with the traditional method of manually setting the parameters of each monitoring device, this automated process reduces manual intervention and reduces the risk of human operational errors.

[0138] By collecting multiple source images in different postures and stitching them together using panoramic mosaic technology, an accurate original panoramic image can be generated, ensuring the integrity and accuracy of the panoramic image, and providing a reliable basis for subsequent target object annotation and configuration.

[0139] It can also automatically identify target objects in panoramic images, determine their types and pixel coordinates, and then add corresponding graphic and text annotations to the image. This approach not only improves the accuracy of annotations, but also allows users to understand and configure each monitoring point more intuitively.

[0140] When the user selects a target object, the system automatically displays the parameter configuration box of the corresponding monitoring item and responds to the user's configuration operation in real time, allowing the user to easily adjust the monitoring parameters and optimize the user experience. It also supports the configuration of multiple monitoring parameters, such as monitoring point name, enabled status, monitoring cycle, monitoring time period and type, etc. Users can flexibly adjust these parameters according to actual needs to ensure the personalization and accuracy of monitoring work.

[0141] In summary, the monitoring point configuration method of the present application significantly optimizes the monitoring point configuration process, reduces the complexity of manual operations, improves the accuracy and efficiency of configuration, and also enhances intelligence and user experience.

[0142] In addition, the present application also provides several implementation plans for automatic monitoring after the monitoring points are configured.

[0143] Example 1: When the monitoring point type is chessboard displacement monitoring:

[0144] S11, calculating the pixel coordinates of the center point of the rectangular area according to the pixel coordinates of the rectangular area containing the target chessboard corresponding to the monitoring point;

[0145] S12, according to the mapping relationship between the center point pixel coordinates, the panoramic image and the source image pixel coordinates, calculate the source image serial number corresponding to the center point and the mapping pixel coordinates of the center point pixel coordinates in the source image;

[0146] S13. Calculate the target angle according to the initial pan / tilt angle, laser distance, device calibration parameters and mapped pixel coordinates corresponding to the source image; the target angle is the pan / tilt angle required to align the laser spot landing point of the monitoring device with the spatial point represented by the mapped pixel coordinates. The device calibration parameters include the coordinates of the laser emission point of the laser rangefinder in the camera imaging coordinate system; the device calibration parameters also include the camera intrinsic parameters of the camera and the camera extrinsic parameters of the camera relative to the electric pan / tilt (rotation angle, translation amount);

[0147] S14, rotating the electric pan / tilt head according to the target angle so that the target chessboard is included in the camera image;

[0148] S15. Monitor the chessboard displacement according to the displacement measurement method, measure the three-dimensional spatial coordinates of the specified corner points of the chessboard, and calculate the displacement based on the spatial coordinates measured multiple times.

[0149] Example 2, when the monitoring point type is prism displacement monitoring:

[0150] S21, calculating the pixel coordinates of the center point of the rectangular area according to the pixel coordinates of the rectangular area containing the target prism corresponding to the monitoring point;

[0151] S22, according to the mapping relationship between the center point pixel coordinates, the panoramic image and the source image pixel coordinates, calculate the source image serial number corresponding to the center point and the mapping pixel coordinates of the center point pixel coordinates in the source image;

[0152] S23, calculating the target angle according to the pan / tilt angle, laser distance, device calibration parameters and mapping pixel coordinates corresponding to the source image;

[0153] S24, rotating the electric pan / tilt head according to the target angle so that the target prism is included in the camera image;

[0154] S25. Based on the existing total station automatic search and prism centering method (such as light intensity method, etc.), the laser rangefinder is automatically centered on the prism center point, the three-dimensional spatial coordinates of the prism center point are measured, and the displacement is calculated based on the spatial coordinates measured multiple times.

[0155] Embodiment 3, when the monitoring point type is crack visual monitoring:

[0156] S31, calculating the pixel coordinates of the center point of the rectangular area according to the pixel coordinates of the rectangular area containing the target crack corresponding to the monitoring point;

[0157] S32, according to the center point pixel coordinates, the mapping relationship between the panoramic image and the source image pixel coordinates, calculate the source image serial number corresponding to the center point and the mapping pixel coordinates of the center point pixel coordinates in the source image;

[0158] S33, calculating the target angle according to the pan / tilt angle, laser distance, device calibration parameters and mapping pixel coordinates corresponding to the source image;

[0159] S34, rotating the electric pan / tilt head according to the target angle so that the target crack is included in the camera image;

[0160] S35. Using the crack size measurement technology, the crack size in the image is measured. By comparing the crack sizes measured multiple times, the development trend of the crack is calculated.

[0161] Based on the same inventive concept, the embodiment of the present application also provides a configuration device for monitoring points corresponding to the configuration method for monitoring points. Since the principle of solving the problem by the device in the embodiment of the present application is similar to the configuration method for monitoring points in the embodiment of the present application, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0162] See also Figure 2 , Figure 3 , Figure 2 This is one of the structural schematic diagrams of a monitoring point configuration device provided in an embodiment of the present application. Figure 3 This is a second structural diagram of a monitoring point configuration device provided in an embodiment of the present application. Figure 2 As shown in , the configuration device 200 includes:

[0163] An acquisition module 210 is used to acquire an original panoramic image of the monitored area;

[0164] The annotation module 220 is used to visually annotate the target object in the original panoramic image and display the annotated target panoramic image;

[0165] The configuration module 230 is used to determine the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image in response to the user's parameter configuration operation on each target object in the panoramic image, and complete the configuration.

[0166] Optional, such as Figure 3 As shown, the configuration device 200 further includes a monitoring module 240, and the monitoring module 240 is used to:

[0167] After determining the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image, the monitoring equipment is configured with working parameters according to the monitoring parameters of the monitoring items corresponding to all target objects, so as to automatically monitor all target objects.

[0168] Optionally, the configuration device 200 further includes a splicing module 250, and the splicing module 250 is used to:

[0169] Acquire multiple source images of the monitored area collected by the monitoring device in different postures;

[0170] The plurality of source images are stitched together using a panoramic mosaic technique to determine the original panoramic image.

[0171] Optionally, when the annotation module 220 is used to visually annotate the target object in the original panoramic image, the annotation module 220 is used to:

[0172] Identify the target objects in the original panoramic image, and determine the object type of each target object and the pixel coordinates of each target object in the original panoramic image;

[0173] For each target object, determining a marked area according to pixel coordinates of the target object located in the original panoramic image;

[0174] Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

[0175] Optionally, when the annotation module 220 is used to visually annotate the target object in the original panoramic image, the annotation module 220 is used to:

[0176] Recognize and deduplicate the target objects in each source image, determine the object type of each target object and the pixel coordinates of each target object in the corresponding source image;

[0177] Determining pixel coordinates of each target object in the original panoramic image according to a mapping relationship between the source image and the original panoramic image;

[0178] For each target object, determining a marked area according to pixel coordinates of the target object located in the original panoramic image;

[0179] Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

[0180] Optionally, when the configuration module 230 is used to determine the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image in response to the user's parameter configuration operation on each target object in the target panoramic image, the configuration module 230 is used to:

[0181] In response to the user's selection operation on any target object, a parameter configuration box of the monitoring item corresponding to the target object is displayed;

[0182] The configuration operation of the user in the parameter configuration box is identified, and the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image are determined.

[0183] Optionally, the monitoring items include at least one of the following: monitoring point name, monitoring activation status, monitoring cycle, monitoring time period and monitoring point type.

[0184] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown in , the electronic device 400 includes a processor 410 , a memory 420 and a bus 430 .

[0185] The memory 420 stores machine-readable instructions executable by the processor 410. When the electronic device 400 is running, the processor 410 communicates with the memory 420 via the bus 430. When the machine-readable instructions are executed by the processor 410, the above-mentioned Figure 1 The specific implementation of the steps in the method embodiment shown can be found in the method embodiment, and will not be repeated here.

[0186] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 1 The specific implementation of the steps in the method embodiment shown can be found in the method embodiment, and will not be repeated here.

[0187] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0188] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0189] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0190] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0191] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application can essentially be embodied in the form of a software product, or in other words, the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0192] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for configuring monitoring points, characterized in that: The configuration method comprises: Obtaining the original panoramic image of the monitored area; Visually annotating the target object in the original panoramic image, and displaying the annotated target panoramic image; In response to the user's parameter configuration operation on each target object in the target panoramic image, the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image are determined to complete the configuration.

2. The configuration method according to claim 1, characterized in that: After determining the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image, the configuration method further includes: According to the monitoring parameters of the corresponding monitoring items of all target objects, the working parameters of the monitoring equipment are configured to automatically monitor all target objects.

3. The configuration method according to claim 1, characterized in that: The original panoramic image of the monitored area is determined by the following steps: Acquire multiple source images of the monitored area collected by the monitoring device in different postures; The plurality of source images are stitched together using a panoramic mosaic technique to determine the original panoramic image.

4. The configuration method according to claim 1, characterized in that: The visually marking the target object in the original panoramic image includes: Identify the target objects in the original panoramic image, and determine the object type of each target object and the pixel coordinates of each target object in the original panoramic image; For each target object, determining a marked area according to pixel coordinates of the target object located in the original panoramic image; Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

5. The configuration method according to claim 3, characterized in that: The visually marking the target object in the original panoramic image includes: Recognize and deduplicate the target objects in each source image, determine the object type of each target object and the pixel coordinates of each target object in the corresponding source image; Determining pixel coordinates of each target object in the original panoramic image according to a mapping relationship between the source image and the original panoramic image; For each target object, determining a marked area according to pixel coordinates of the target object located in the original panoramic image; Add graphic annotations and text labels to each marked area respectively; wherein the text label is determined according to the object type of the corresponding target object.

6. The configuration method according to claim 1, characterized in that: The step of determining the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image in response to the user's parameter configuration operation on each target object in the panoramic image includes: In response to the user's selection operation on any target object, a parameter configuration box of the monitoring item corresponding to the target object is displayed; The configuration operation of the user in the parameter configuration box is identified, and the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image are determined.

7. The configuration method according to claim 6, characterized in that: The monitoring items include at least one of the following: monitoring point name, monitoring activation status, monitoring cycle, monitoring time period and monitoring point type.

8. A monitoring point configuration device, characterized in that: The configuration device comprises: An acquisition module is used to acquire an original panoramic image of the monitored area; A labeling module, used to visually label the target object in the original panoramic image and display the labeled target panoramic image; The configuration module is used to determine the monitoring parameters of the monitoring items corresponding to each target object in the panoramic image in response to the user's parameter configuration operation on each target object in the panoramic image, and complete the configuration.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and the machine-readable instructions are executed by the processor to execute the steps of the configuration method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the configuration method according to any one of claims 1 to 7 are executed.

Citation Information

Cited By

  • Control method and device of track monitoring equipment and track monitoring system

    CN120735823A