Three-dimensional model modeling system based on image registration
Through a three-dimensional model modeling system based on image registration, a three-dimensional model of the internal equipment of the substation is constructed and real-time changes are mapped, which solves the problem of cumbersome inspection operations in the existing technology, and achieves a more efficient and intelligent inspection process.
Patent Information
- Application Number
- CN202411005610.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-25
- Publication Date
- 2024-12-06
AI Technical Summary
The existing technology is cumbersome during internal inspection of substations, and requires continuous switching of camera images and enlarging local features, which is inefficient.
Using a three-dimensional model modeling system based on image registration, multiple sets of gimbal cameras capture multi-angle images of internal devices of the substation. The image upload module transmits the images to the model building module, builds a three-dimensional model and maps the real-time changes of the equipment, simplifying patrols Inspection operation.
It reduces the complexity of inspection personnel, improves inspection efficiency and intelligence, and is simple and more efficient in operation.
Smart Images

Figure CN119091034A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of image registration, and in particular to a three-dimensional modeling system based on image registration. Background Art
[0002] In order to ensure the stable and reliable operation of the power grid system inside the substation, it is necessary to conduct regular inspections inside the substation, including equipment parameters, operating status, etc.
[0003] At present, with the continuous upgrading and iteration of intelligent inspection, multiple PTZ cameras are generally used to conduct background observation inspections inside the substation, and the images captured by the PTZ cameras are diagnosed in the background. This method can effectively improve the inspection efficiency. However, this method still requires constant switching of the camera screen and constant magnification of local features, which is cumbersome to operate.
[0004] The inventors of the present application discovered during the process of implementing the present invention that the above-mentioned solution in the prior art has the defect of complicated inspection operation. Summary of the invention
[0005] The purpose of the embodiment of the present invention is to provide a three-dimensional model building system based on image registration, which has simple operation and intelligent functions.
[0006] In order to achieve the above object, an embodiment of the present invention provides a three-dimensional modeling system based on image registration, comprising:
[0007] Multiple groups of PTZ cameras are arranged inside the substation to capture real-time images of the substation's internal equipment from multiple angles;
[0008] An image uploading module, connected to the plurality of groups of the PTZ cameras for uploading images captured by the PTZ cameras;
[0009] The model building module is connected to the image uploading module for building and displaying a three-dimensional model of the substation according to the image uploading module.
[0010] Optionally, the model building module includes a controller, wherein the controller is configured to execute:
[0011] Constructing a three-dimensional model of the substation;
[0012] Acquire images of each device at two moments at a preset time interval;
[0013] Acquire a change area corresponding to the device according to the two images;
[0014] The changed area is mapped to the corresponding device.
[0015] Optionally, constructing the three-dimensional model of the substation includes:
[0016] Obtaining dimension parameters of each device in the substation;
[0017] Constructing a three-dimensional model of each of the devices according to the size parameters of each of the devices;
[0018] Obtaining the relative position relationship of each of the devices in the substation;
[0019] The spacing of the three-dimensional models of each of the devices is adjusted according to the relative position relationship of each of the devices.
[0020] Optionally, acquiring images of each device at two moments at a preset time interval includes:
[0021] Obtain the device image captured by each of the PTZ cameras at the current moment;
[0022] Wait for a preset time interval;
[0023] Returns the device image captured by each of the PTZ cameras at the current moment.
[0024] Optionally, acquiring a changed area corresponding to the device according to the two images includes:
[0025] grayscale the two images;
[0026] Comparing the grayscale of the two images to obtain a grayscale change area;
[0027] The grayscale change region is optimized to obtain the change region of the device.
[0028] Optionally, performing grayscale comparison on the two images to obtain a grayscale change region includes:
[0029] Constructing a window of a preset size, wherein the window includes an outer ring area and an inner ring area;
[0030] The grayscale reference value of the outer ring area is calculated according to formula (1):
[0031]
[0032] Among them, α1 is the grayscale reference value of the outer ring area, I i is the grayscale value of the i-th pixel in the outer ring area, i is an integer number, and n is the number of pixels in the outer ring area;
[0033] The bit string of the outer ring area is calculated according to formula (2):
[0034]
[0035] Wherein, ρ1 is the bit string of the outer ring area;
[0036] Comparing the bit strings of the outer ring areas in the two images;
[0037] Determine whether the similarity of the bit strings of the two outer ring areas is greater than or equal to a preset threshold;
[0038] When it is determined that the similarity between the bit strings of the two outer ring areas is greater than or equal to a preset threshold, it is determined that the positions corresponding to the two outer ring areas are the same.
[0039] Optionally, performing grayscale comparison on the two images to obtain the grayscale change area further includes:
[0040] The grayscale reference value of the inner ring area is calculated according to formula (3):
[0041]
[0042] Among them, α2 is the grayscale reference value of the inner ring area, I j is the grayscale value of the jth pixel in the inner ring area, j is an integer number, and m is the number of pixels in the inner ring area;
[0043] The bit string of the inner loop region is calculated according to formula (4):
[0044]
[0045] Wherein, ρ2 is the bit string of the inner ring area;
[0046] Comparing the bit strings of the inner ring areas in the two images;
[0047] Determine whether the similarity of the bit strings of the two inner ring areas is less than a preset threshold;
[0048] When it is determined that the similarity between the bit strings of the two inner ring areas is less than a preset threshold, the two inner ring areas are determined to be grayscale change areas.
[0049] Optionally, optimizing the grayscale change region to obtain the change region of the device includes:
[0050] Presetting a pixel change interval of the window;
[0051] Shrinking the inner ring area in the window according to the pixel change interval;
[0052] Return to the step of calculating the grayscale reference value of the outer ring area according to formula (1).
[0053] Optionally, optimizing the grayscale change region to obtain the change region of the device further includes:
[0054] Determine whether the similarity between the bit strings of the two outer ring areas is less than a preset threshold;
[0055] When it is determined that the similarity between the bit strings of the two current outer ring areas is less than a preset threshold, the inner ring area corresponding to the previous outer ring area is used as the changed area of the device.
[0056] Through the above technical scheme, the three-dimensional modeling system based on image registration provided by the present invention captures multi-angle images of internal equipment of the substation through multiple cameras, and transmits them to the model construction module through the image upload module. The model construction module constructs a three-dimensional model according to the image of the substation and maps the real-time changes of the equipment, thereby facilitating patrol personnel to conduct real-time inspections. The use of three-dimensional models to map the real-time characteristics of equipment can effectively reduce the complexity of patrol personnel's inspections, and the operation is simple, and the inspection is more intelligent and efficient.
[0057] Other features and advantages of the embodiments of the present invention will be described in detail in the subsequent detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0058] The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the following specific implementations, they are used to explain the embodiments of the present invention, but do not constitute a limitation on the embodiments of the present invention. In the accompanying drawings:
[0059] Figure 1 is a structural block diagram of a three-dimensional model building system based on image registration according to an embodiment of the present invention;
[0060] Figure 2 is a flow chart of inspection in a three-dimensional modeling system based on image registration according to an embodiment of the present invention;
[0061] Figure 3 is a flow chart of constructing a three-dimensional model in a three-dimensional modeling system based on image registration according to an embodiment of the present invention;
[0062] Figure 4 is a flow chart of acquiring device images in a three-dimensional modeling system based on image registration according to an embodiment of the present invention;
[0063] Figure 5 is a flow chart of obtaining a change area in a three-dimensional modeling system based on image registration according to an embodiment of the present invention;
[0064] Figure 6is a flow chart of obtaining a grayscale change area in a three-dimensional modeling system based on image registration according to an embodiment of the present invention;
[0065] Figure 7 The present invention is a flowchart of obtaining a changed area of a device in a three-dimensional modeling system based on image registration according to an embodiment of the present invention. DETAILED DESCRIPTION
[0066] The specific implementation of the embodiment of the present invention is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described here is only used to illustrate and explain the embodiment of the present invention, and is not used to limit the embodiment of the present invention.
[0067] Figure 1 FIG. 1 is a structural block diagram of a three-dimensional modeling system based on image registration according to an embodiment of the present invention. Figure 1 In the present invention, the three-dimensional model building system may include multiple groups of pan-tilt cameras, an image uploading module and a model building module.
[0068] Multiple groups of PTZ cameras are arranged inside the substation to capture real-time images of the substation's internal equipment from multiple angles. The image upload module is connected to the multiple groups of PTZ cameras for uploading images captured by the PTZ cameras. The model building module is connected to the image upload module for building and displaying a three-dimensional model of the substation based on the image upload module.
[0069] When it is necessary to build a three-dimensional model for substation inspection, first obtain the parameters such as the size and location of the internal equipment of the substation, and then build a three-dimensional model of the substation equipment. After the three-dimensional model is built, multiple groups of pan-tilt cameras obtain real-time images of substation equipment from multiple angles, and upload the real-time images to the model construction module through the image upload module, and map them, so that the substation can be inspected according to the three-dimensional model.
[0070] Traditional substation inspections generally use multiple PTZ cameras to conduct background observation inspections of the substation interior, and diagnose the images captured by the PTZ cameras in the background. This method can effectively improve inspection efficiency. However, this method still requires constant switching of camera images and constant magnification of local features, which is cumbersome to operate. In this embodiment of the present invention, the use of a three-dimensional model to map the real-time features of the equipment can effectively reduce the complexity of inspections by inspectors, making the operation simple and the inspection more intelligent and efficient.
[0071] In this embodiment of the invention, the model building module may include a controller for executing Figure 2 Specifically, Figure 2 In the controller, the following is done:
[0072] In step S10, a three-dimensional model of the substation is constructed. The three-dimensional model of the substation can be constructed based on parameters such as the image, size, and location of the substation equipment.
[0073] In step S11, images of each device at two moments at a preset time interval are obtained. Wherein, the PTZ camera captures video, and a preset time interval can be used to obtain images at multiple moments for mapping.
[0074] In step S12, the changed region of the corresponding device is obtained according to the two images, wherein the changed region can be obtained by comparing the images at two adjacent moments.
[0075] In step S13, the changed area is mapped to the corresponding equipment. Mapping the changed area to the equipment can facilitate inspection personnel to give priority to inspection of the changed area such as equipment parameters, further improving the convenience of substation inspection.
[0076] In step S10 to step S13, a three-dimensional model of the substation is first constructed, and then image selection is performed on the video of the pan-tilt camera. By comparing the images at adjacent moments, local features such as instrument parameters in the constantly changing areas can be obtained, and the changing areas can be mapped, which can effectively improve the inspection efficiency and convenience.
[0077] In this embodiment of the present invention, the steps for constructing the three-dimensional model of the substation can be as follows: Figure 3 Specifically, Figure 3 The controller is also used to perform:
[0078] In step S20, the size parameters of each device in the substation are obtained.
[0079] In step S21, a three-dimensional model of each device is constructed according to the size parameters of each device.
[0080] In step S22, the relative position relationship of each device in the substation is obtained, wherein a coordinate system can be constructed to coordinately locate each device respectively.
[0081] In step S23, the spacing of the three-dimensional model of each device is adjusted according to the relative position relationship of each device.
[0082] In this embodiment of the present invention, in order to obtain the changed area, it is also necessary to capture the video of the PTZ camera. The specific capture step can be as follows: Figure 4 Specifically, Figure 4 The controller is also used to perform:
[0083] In step S30, the device image captured by each PTZ camera at the current moment is obtained.
[0084] In step S31, wait for a preset time interval.
[0085] In step S32, the device image captured by each PTZ camera at the current moment is returned and obtained.
[0086] In step S30 to step S32, the device images are repeatedly captured at preset time intervals to update the status of the device in the three-dimensional model in real time.
[0087] In this embodiment of the present invention, after acquiring images at two adjacent moments, it is necessary to perform pixel comparison on the two images. Specifically, the comparison step can be as follows: Figure 5 Specifically, Figure 5 The controller is also used to perform:
[0088] In step S40, the two images are grayscaled.
[0089] In step S41, the grayscale of the two images is compared to obtain a grayscale change area.
[0090] In step S42, the grayscale change region is optimized to obtain the change region of the device.
[0091] In this embodiment of the present invention, the specific steps of performing grayscale comparison on two images to obtain the grayscale change area can be as follows: Figure 6 As shown, specifically, in Figure 6 The controller is also used to perform:
[0092] In step S50, a window of a preset size is constructed, wherein the window includes an outer ring area and an inner ring area.
[0093] In step S51, the grayscale reference value of the outer ring area is calculated according to formula (1):
[0094]
[0095] Among them, α1 is the grayscale reference value of the outer ring area, I i is the grayscale value of the i-th pixel in the outer ring area, i is an integer number, and n is the number of pixels in the outer ring area.
[0096] In step S52, the bit string of the outer ring area is calculated according to formula (2):
[0097]
[0098] Among them, ρ1 is the bit string of the outer ring area.
[0099] In step S53, the bit strings of the outer ring areas in the two images are compared.
[0100] In step S54, it is determined whether the similarity between the bit strings of the two outer ring regions is greater than or equal to a preset threshold.
[0101] In step S55, when it is determined that the similarity between the bit strings of the two outer ring regions is greater than or equal to a preset threshold, it is determined that the positions corresponding to the two outer ring regions are the same.
[0102] In step S56, the grayscale reference value of the inner ring area is calculated according to formula (3):
[0103]
[0104] Among them, α2 is the grayscale reference value of the inner ring area, I j is the gray value of the jth pixel in the inner ring area, j is an integer number, and m is the number of pixels in the inner ring area.
[0105] In step S57, the bit string of the inner ring area is calculated according to formula (4):
[0106]
[0107] Among them, ρ2 is the bit string of the inner ring area.
[0108] In step S58, the bit strings of the inner ring areas in the two images are compared.
[0109] In step S59, it is determined whether the similarity between the bit strings of the two inner ring regions is less than a preset threshold.
[0110] In step S60, when it is determined that the similarity between the bit strings of the two inner ring regions is less than a preset threshold, the two inner ring regions are determined to be grayscale change regions.
[0111] In step S50 to step S60, a window including an outer ring area and an inner ring area is first constructed, and then the grayscale reference values of the outer ring area and the inner ring area in the two images are calculated respectively. According to the grayscale reference value, the outer ring area and the inner ring area in the two images are converted into bit strings, and the bit strings of the corresponding areas in the two images are calculated. If the similarity of the bit strings of the corresponding areas of the two images is greater than or equal to a preset threshold, it means that the corresponding areas are the same. Specifically, the similarity of the bit strings can be calculated by comparing the bit strings one by one to obtain the bit string similarity, that is, the number of equal bit strings divided by the number of lengths of the bit strings.
[0112] In this embodiment of the present invention, in order to obtain the change area of the device, it is also necessary to transform the grayscale transformation area. The specific transformation step can be as follows: Figure 7 Specifically, Figure 7 The controller is also used to perform:
[0113] In step S61, a pixel change interval of a window is preset.
[0114] In step S62, the inner ring area in the window is reduced according to the pixel change interval. The inner ring area of the window can be reduced in an irregular manner, for example, only the pixels on one side are reduced at equal intervals.
[0115] In step S63, the process returns to the step of calculating the grayscale reference value of the outer ring area according to formula (1).
[0116] In step S64, it is determined whether the similarity between the bit strings of the two outer ring regions is less than a preset threshold.
[0117] In step S65, when it is determined that the similarity between the bit strings of the two current outer ring areas is less than a preset threshold, the inner ring area corresponding to the previous outer ring area is used as the changed area of the device.
[0118] In step S61 to step S65, after the grayscale change area is found, the inner ring area needs to be further reduced, and the bit string of the outer ring area needs to be calculated again, and the similarity of the bit strings corresponding to the outer ring areas in the two images is further determined until the bit strings corresponding to the outer ring areas in the two images are less than the preset threshold. If the bit strings corresponding to the outer ring areas in the two images are less than the preset threshold, it means that the outer ring areas are different, so the inner ring area corresponding to the previous outer ring area is selected as the change area of the device.
[0119] Through the above technical scheme, the three-dimensional modeling system based on image registration provided by the present invention captures multi-angle images of internal equipment of the substation through multiple cameras, and transmits them to the model construction module through the image upload module. The model construction module constructs a three-dimensional model according to the image of the substation and maps the real-time changes of the equipment, thereby facilitating patrol personnel to conduct real-time inspections. The use of three-dimensional models to map the real-time characteristics of equipment can effectively reduce the complexity of patrol personnel's inspections, and the operation is simple, and the inspection is more intelligent and efficient.
[0120] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.
[0121] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0122] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0123] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0124] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0125] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0126] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0127] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0128] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.
Claims
1. A three-dimensional modeling system based on image registration, characterized in that: include: Multiple groups of PTZ cameras are arranged inside the substation to capture real-time images of the substation's internal equipment from multiple angles; An image uploading module, which is connected to the plurality of groups of the PTZ cameras for uploading images captured by the PTZ cameras; The model building module is connected to the image uploading module for building and displaying a three-dimensional model of the substation according to the image uploading module.
2. The three-dimensional modeling system according to claim 1, characterized in that: The model building module includes a controller, which is used to execute: Constructing a three-dimensional model of the substation; Acquire images of each device at two moments at a preset time interval; Acquire a change area corresponding to the device according to the two images; The changed area is mapped to the corresponding device.
3. The three-dimensional modeling system according to claim 2, characterized in that: Constructing the three-dimensional model of the substation includes: Obtaining dimension parameters of each device in the substation; Constructing a three-dimensional model of each of the devices according to the size parameters of each of the devices; Obtaining the relative position relationship of each of the devices in the substation; The spacing of the three-dimensional models of each of the devices is adjusted according to the relative position relationship of each of the devices.
4. The three-dimensional modeling system according to claim 2, characterized in that: Acquiring images of each device at two moments at a preset time interval includes: Obtain the device image captured by each of the PTZ cameras at the current moment; Wait for a preset time interval; Returns the device image captured by each of the PTZ cameras at the current moment.
5. The three-dimensional modeling system according to claim 2, characterized in that: Acquiring a change area corresponding to the device according to the two images comprises: grayscale the two images; Comparing the grayscale of the two images to obtain a grayscale change area; The grayscale change region is optimized to obtain the change region of the device.
6. The three-dimensional modeling system according to claim 5, characterized in that: The grayscale comparison of the two images is performed to obtain the grayscale change area including: Constructing a window of a preset size, wherein the window includes an outer ring area and an inner ring area; The grayscale reference value of the outer ring area is calculated according to formula (1): Among them, α1 is the grayscale reference value of the outer ring area, I i is the grayscale value of the i-th pixel in the outer ring area, i is an integer number, and n is the number of pixels in the outer ring area; The bit string of the outer ring area is calculated according to formula (2): Wherein, ρ1 is the bit string of the outer ring area; Comparing the bit strings of the outer ring areas in the two images; Determine whether the similarity of the bit strings of the two outer ring areas is greater than or equal to a preset threshold; When it is determined that the similarity between the bit strings of the two outer ring areas is greater than or equal to a preset threshold, it is determined that the positions corresponding to the two outer ring areas are the same.
7. The three-dimensional modeling system according to claim 6, characterized in that: Comparing the grayscale of the two images to obtain the grayscale change area also includes: The grayscale reference value of the inner ring area is calculated according to formula (3): Among them, α2 is the grayscale reference value of the inner ring area, I j is the grayscale value of the jth pixel in the inner ring area, j is an integer number, and m is the number of pixels in the inner ring area; The bit string of the inner loop region is calculated according to formula (4): Wherein, ρ2 is the bit string of the inner ring area; Comparing the bit strings of the inner ring areas in the two images; Determine whether the similarity of the bit strings of the two inner ring areas is less than a preset threshold; When it is determined that the similarity between the bit strings of the two inner ring areas is less than a preset threshold, the two inner ring areas are determined to be grayscale change areas.
8. The three-dimensional modeling system according to claim 7, characterized in that: Optimizing the grayscale change region to obtain the change region of the device includes: Presetting a pixel change interval of the window; Shrinking the inner ring area in the window according to the pixel change interval; Return to the step of calculating the grayscale reference value of the outer ring area according to formula (1).
9. The three-dimensional modeling system according to claim 8, characterized in that: Optimizing the grayscale change region to obtain the change region of the device further includes: Determine whether the similarity between the bit strings of the two outer ring areas is less than a preset threshold; When it is determined that the similarity between the bit strings of the two current outer ring areas is less than a preset threshold, the inner ring area corresponding to the previous outer ring area is used as the changed area of the device.
