A Method and System for Pipeline Defect Identification Based on VR Panoramic Video
By installing back-to-back or up-down-left-right dual fisheye lenses on a pipeline inspection robot, and stitching image data in real time to construct a VR pipeline environment, the problems of blind spots and low inspection efficiency in existing technologies are solved, and efficient and accurate pipeline defect identification is achieved.
Patent Information
- Application Number
- CN202611421022.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-09-14
- Publication Date
- 2026-11-17
AI Technical Summary
Existing pipe endoscopy inspection technology has blind spots, cannot achieve instantaneous panoramic coverage, has low inspection efficiency, and cannot rotate the video screen to view the side view during subsequent video analysis.
Using two fisheye lenses mounted on the same axis, either back-to-back or top-bottom-left-right, image data is stitched together in real time to construct a VR pipeline environment and provide panoramic images for interpretation.
It enables panoramic image acquisition of the inner wall of the pipeline without blind spots, improving detection efficiency and the convenience and accuracy of defect interpretation, and eliminating the time and image blurring problems of mechanical rotation scanning.
Smart Images

Figure CN123118583A_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of pipeline inspection and evaluation, specifically relating to a method and system for pipeline defect identification based on VR panoramic video. Background Technology
[0002] Pipeline endoscopic inspection technology has mainly evolved from traditional closed-circuit television (CCTV) systems to panoramic imaging systems.
[0003] Traditional planar video inspection technology utilizes a pipeline crawling robot equipped with one or more fixed-focus or zoom planar cameras at its front end to capture two-dimensional video of the inner wall along the pipeline's axis. Inspectors then manually identify defects such as cracks, corrosion, and deposits by reviewing the returned planar video. This method can only obtain localized images of the pipeline's inner wall.
[0004] To expand the field of view in a single frame, some technical solutions use wide-angle or fisheye lenses with a field of view of approximately 180° instead of ordinary lenses. However, this solution still acquires a hemispherical field of view radiating forward from the lens's optical axis, failing to capture a complete 360° image of the pipe's circumference in one shot. When observing the side walls, it is still necessary to rotate the lens or the robot itself, making instantaneous panoramic coverage impossible.
[0005] Therefore, existing pipe endoscopy inspection technologies all have blind spots. To inspect the entire circumference of a pipe, the camera must be mechanically rotated to scan the entire inner wall, a process that is extremely time-consuming. Furthermore, during subsequent video analysis, it is impossible to rotate the video feed to view the pipe's sides. Summary of the Invention
[0006] In view of the above-mentioned defects or improvement needs of the existing technology, the present invention proposes a pipeline defect identification method and system based on VR panoramic video.
[0007] To achieve the above objectives, in a first aspect, the present invention provides a method for identifying pipeline defects based on VR panoramic video, comprising the following steps: Acquire image data of the inner wall of the pipe from two fisheye lenses; The image data is stitched together in real time to form a complete panoramic image of the inner wall of the pipe; The panoramic images are used to construct and present a VR pipeline environment for the identification of pipeline defects.
[0008] In some embodiments, the two fisheye lenses are mounted on the same mounting shaft and mounted back to back.
[0009] In some embodiments, the two fisheye lenses are positioned on the central axis of the pipe at the installation location of the pipe inspection robot.
[0010] In some embodiments, the two fisheye lenses are mounted vertically or horizontally.
[0011] Secondly, the present invention provides a pipeline defect identification system based on VR panoramic video, comprising: The image acquisition module is used to acquire image data of the inner wall of the pipe obtained by two fisheye lenses; The image stitching module is used to stitch the image data in real time to form a complete panoramic image of the inner wall of the pipe; The VR construction module is used to construct a VR pipeline environment using the panoramic images. The VR rendering module is used to present the constructed VR pipeline environment for the identification of pipeline defects.
[0012] Thirdly, the present invention provides a pipeline defect identification device based on VR panoramic video, comprising: The double fisheye lens is mounted on a pipeline inspection robot and is used to collect image data of the inner wall of the pipeline as the pipeline inspection robot moves. The data processor is connected to the dual fisheye lenses to acquire image data of the inner wall of the pipe collected by the two fisheye lenses. The image data is stitched together in real time to form a complete panoramic image of the inner wall of the pipe, and the panoramic image is used to build a VR pipe environment. The VR display unit, connected to the data processor, is used to present the VR pipeline environment for the wearer to interpret pipeline defects.
[0013] In some embodiments, the two fisheye lenses are mounted on the same mounting shaft and mounted back to back.
[0014] In some embodiments, the two fisheye lenses are mounted vertically or horizontally.
[0015] In some embodiments, the two fisheye lenses are positioned on the central axis of the pipe at the installation location of the pipe inspection robot.
[0016] In some embodiments, the mounting shaft is connected to the pipeline inspection robot via a height adjustment mechanism.
[0017] In summary, compared with the prior art, the above-described technical solutions conceived by this invention can achieve the following beneficial effects: By stitching together image data collected from dual fisheye lenses in real time, an instantaneous and complete panoramic image of the pipe's inner wall is obtained, eliminating blind spots. Using VR to present panoramic images enables more intuitive human-computer interaction, improving the convenience and accuracy of defect identification. Attached Figure Description
[0018] Figure 1This is a flowchart of a method provided in an embodiment of the present invention.
[0019] Figure 2 This is a schematic diagram of a system structure provided in an embodiment of the present invention.
[0020] Figure 3 This is a schematic diagram of a VR panoramic image presentation provided by an embodiment of the present invention. Detailed Implementation
[0021] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention. Furthermore, the technical features involved in the various embodiments of this invention described below can be combined with each other as long as they do not conflict with each other.
[0022] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.
[0023] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.
[0024] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components, unless otherwise explicitly limited. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.
[0025] In this invention, unless otherwise explicitly specified and limited, "above" or "below" the second feature can mean that the first feature is in direct contact with the second feature, or that the first feature is in indirect contact with the second feature through an intermediate medium. Furthermore, "above," "over," and "on top" of the second feature can mean that the first feature is directly above or diagonally above the second feature, or simply that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature can mean that the first feature is directly below or diagonally below the second feature, or simply that the first feature is at a lower horizontal level than the second feature.
[0026] This invention aims to solve the problems of limited field of vision and low inspection efficiency in the field of pipeline inspection.
[0027] To achieve the above objectives, as a first aspect of the present invention, this embodiment provides a method for identifying pipeline defects based on VR panoramic video, such as... Figure 1 As shown, it includes the following steps: S1. Acquire image data of the inner wall of the pipe from two fisheye lenses.
[0028] In some embodiments, two fisheye lenses are mounted on the same mounting axis and back to back, thereby enabling a more comprehensive view of the pipe's inner wall and facilitating subsequent splicing.
[0029] In some embodiments, the two fisheye lenses are positioned on the central axis of the pipe in the pipe inspection robot, which is beneficial for the viewing angle during identification.
[0030] S2. The image data is stitched together in real time to form a complete panoramic image of the inner wall of the pipe; S3. Construct and present a VR pipeline environment using the panoramic image for pipeline defect identification. This identification can be done through manual observation of the VR pipeline environment or by using image processing algorithms.
[0031] As a second aspect of the present invention, this embodiment provides a pipeline defect identification system based on VR panoramic video, such as... Figure 2 As shown, the system includes an image acquisition module, an image stitching module, a VR construction module, and a VR presentation module. The image acquisition module acquires image data of the pipe's inner wall from two fisheye lenses; the image stitching module stitches the image data in real time to create a complete panoramic image of the pipe's inner wall; the VR construction module uses the panoramic image to construct a VR pipe environment; and the VR presentation module presents the constructed VR pipe environment for the identification of pipe defects.
[0032] As a third aspect of the present invention, this embodiment provides a pipeline defect identification device based on VR panoramic video, including a dual fisheye lens, a data processor and a VR display unit.
[0033] The double fisheye lens is mounted on a pipeline inspection robot and is used to collect image data of the inner wall of the pipeline as the robot moves.
[0034] In some embodiments, the two fisheye lenses are mounted on the same mounting axis, back to back, to facilitate subsequent image stitching. More specifically, during image acquisition, the two fisheye lenses are mounted vertically or horizontally. Vertically, vertically, horizontally, and left to right represent the field of view of the fisheye lens; vertically, vertically, horizontally, and left to right indicate the field of view facing the top of the pipe; vertically, vertically, horizontally, and left to right indicate the field of view facing the bottom of the pipe; left to right indicate the field of view facing the left side of the pipe; and right to right indicate the field of view facing the right side of the pipe. To facilitate more intuitive defect identification later, the two fisheye lenses are mounted on the pipe inspection robot so that they are located near the central axis of the pipe.
[0035] In some embodiments, the mounting shaft is connected to the pipe inspection robot via a height adjustment mechanism, allowing the position of the fisheye lens to be adjusted for different pipe inner diameters.
[0036] The data processor is connected to a dual fisheye lens to acquire image data of the inner wall of the pipe collected by the two fisheye lenses. The image data is stitched together in real time to form a complete panoramic image of the inner wall of the pipe, and the panoramic image is used to construct a VR pipe environment.
[0037] In some embodiments, the data processor is located outside the pipeline and connected to the pipeline inspection robot via wired or wireless means. Data collected by the fisheye lens is transmitted to the data processor outside the pipeline after being relayed through the data processing unit of the pipeline inspection robot. Alternatively, the data processor can be directly connected to the fisheye lens via wired or wireless means for data transmission.
[0038] In other embodiments, the data processor is divided into two parts. One part is located on the pipeline inspection robot and connected to a fisheye lens. It stitches together the 4K high-resolution (3920×1960 pixels) raw spherical panoramic image data of the pipeline's inner wall acquired by the fisheye lens to generate a continuous 360°×180° spherical panoramic video stream in real time, which is then transmitted to the outside of the pipeline or stored locally. The other part is located outside the pipeline to be inspected and performs VR construction on the 360°×180° spherical panoramic video stream to form a VR pipeline environment.
[0039] The VR display unit is located outside the pipe, storing and displaying a continuous 360°×180° spherical panoramic video stream, allowing for immersive 360° viewing of the pipe and defect identification. Viewing modes include free panoramic viewing or axial movement.
[0040] In some embodiments, VR glasses may also be provided and connected to a data processor to present a VR pipeline environment for the wearer to interpret pipeline defects.
[0041] The invention will be further illustrated below with specific examples.
[0042] The pipeline inspection robot moves inside the pipeline to be inspected. The dual fisheye lenses mounted on the pipeline inspection robot simultaneously acquire 4K high-resolution (3920×1960 pixels) original spherical panoramic image data of the inner wall of the pipeline. After synchronous image stitching processing, a continuous 360°×180° spherical panoramic video stream is generated in real time, and is simultaneously saved and transmitted to the outside of the pipeline in real time.
[0043] The VR display unit located outside the pipe to be inspected displays a continuous 360°×180° spherical panoramic video stream in real time, such as... Figure 3 As shown, the video footage can be rotated for viewing, allowing for on-site assessment of pipeline defects.
[0044] This invention utilizes a double fisheye lens to acquire a continuous 360°×180° spherical panoramic video of the inner wall of a pipe in a single, blind-spot-free manner, eliminating the limited field-of-view image caused by mechanical scanning. This represents a revolutionary improvement in detection efficiency. Specifically, this invention requires only a single acquisition to cover the entire pipe wall, completely eliminating the time required for mechanical rotation scanning. Real-world testing shows that for a full circumference inspection of a 100-meter pipe, the video acquisition time required by this method is equivalent to the time it takes for a robot to travel 100 meters at a constant speed (e.g., approximately 11 minutes at 0.15 m / s), while traditional methods requiring rotation scanning require at least 1.5-3 times the scanning time (totaling over 16.5 minutes), improving efficiency by over 150%. It also avoids the image blurring problem caused by rotation scanning.
[0045] This invention constructs an immersive VR pipeline environment that supports natural interaction (free panoramic view + axial movement) that conforms to the geometric characteristics of the pipeline, rather than watching a fixed-view flat video. Interpreters can observe any area in the virtual environment without blind spots; defects on the side walls and top are particularly clear, avoiding missed defects caused by the limited perspective of a flat video, thus significantly enhancing the accuracy and intuitiveness of the interpretation.
[0046] Therefore, this invention realizes a paradigm shift in pipeline inspection from "local, passive observation" to "global, active exploration," bringing significant improvements in inspection efficiency, interpretation accuracy, and user experience.
[0047] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0048] It should be noted that, depending on the implementation needs, the various steps / components described in this application can be broken down into more steps / components, or two or more steps / components or parts of the operation of steps / components can be combined into new steps / components to achieve the purpose of this invention.
[0049] Those skilled in the art will readily understand that the above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.
Claims
1. A method for identifying pipeline defects based on VR panoramic video, characterized in that: Includes the following steps: Acquire image data of the inner wall of the pipe from two fisheye lenses; The image data is stitched together in real time to form a complete panoramic image of the inner wall of the pipe; The panoramic images are used to construct and present a VR pipeline environment for the identification of pipeline defects.
2. The pipeline defect identification method based on VR panoramic video according to claim 1, characterized in that: The two fisheye lenses are mounted on the same mounting shaft and are mounted back to back.
3. The pipeline defect identification method based on VR panoramic video according to claim 2, characterized in that: The two fisheye lenses are positioned on the central axis of the pipeline inspection robot.
4. The pipeline defect identification method based on VR panoramic video according to claim 2, characterized in that: The two fisheye lenses are installed vertically or horizontally.
5. A pipeline defect identification system based on VR panoramic video, characterized in that: include: The image acquisition module is used to acquire image data of the inner wall of the pipe obtained by two fisheye lenses; The image stitching module is used to stitch the image data in real time to form a complete panoramic image of the inner wall of the pipe; The VR construction module is used to construct a VR pipeline environment using the panoramic images. The VR rendering module is used to present the constructed VR pipeline environment for the identification of pipeline defects.
6. A pipeline defect identification device based on VR panoramic video, characterized in that: include: The double fisheye lens is mounted on a pipeline inspection robot and is used to collect image data of the inner wall of the pipeline as the pipeline inspection robot moves. The data processor is connected to the dual fisheye lenses to acquire image data of the inner wall of the pipe collected by the two fisheye lenses. The image data is stitched together in real time to form a complete panoramic image of the inner wall of the pipe, and the panoramic image is used to build a VR pipe environment. The VR display unit, connected to the data processor, is used to present the VR pipeline environment for the wearer to interpret pipeline defects.
7. The pipeline defect identification device based on VR panoramic video according to claim 6, characterized in that: The two fisheye lenses are mounted on the same mounting shaft and are mounted back to back.
8. The pipeline defect identification device based on VR panoramic video according to claim 7, characterized in that: The two fisheye lenses are installed vertically or horizontally.
9. The pipeline defect identification device based on VR panoramic video according to claim 7, characterized in that: The two fisheye lenses are positioned on the central axis of the pipeline inspection robot.
10. The pipeline defect identification device based on VR panoramic video according to claim 9, characterized in that: The mounting shaft is connected to the pipeline inspection robot via a height adjustment mechanism.
