Infrastructure Condition Monitoring With Overview and Detail Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for inspecting large infrastructure such as high-voltage power lines and wind turbines are inefficient, lacking continuous and verifiable documentation, and unable to detect subtle surface defects due to insufficient image resolution and economic feasibility of aerial surveys.

Innovation Solution

A method combining a laser scanning device for overview data acquisition with a high-resolution camera system for detailed imaging, using a swivel and tilt mechanism to align cameras, and GPS/RTK for precise positioning, allowing automated detection and documentation of infrastructure defects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a single camera is used for aerial image acquisition, then the entire system can be captured in one view, but the surface resolution is insufficient to detect subtle defects

Engineering Contradiction:
Improvefield of viewVSAvoidsurface resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The imaging system is segmented into multiple cameras with different functions: an overview camera for capturing the entire system and detail cameras for high-resolution surface inspection. This segmentation allows each camera to be optimized for its specific purpose, resolving the contradiction between wide field of view and high surface resolution.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The inspection process is extended from a single temporal moment to multiple time points. The overview camera captures images at one time point, and detail cameras capture images at subsequent time points after equipment positions are determined. This temporal dimension allows the system to achieve both comprehensive coverage and detailed inspection without requiring all cameras to capture simultaneously.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If automated image acquisition is implemented, then inspection efficiency increases, but the cost and complexity of the system increases

Engineering Contradiction:
Improveinspection efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The overview camera performs preliminary action by capturing images of the entire system first, allowing the evaluation unit to determine equipment positions before detail cameras perform high-resolution imaging. This preliminary action simplifies the overall system control by separating the positioning task from the detailed inspection task.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The evaluation unit processes images from the overview camera to determine equipment positions, then uses this information to control the detail cameras for targeted high-resolution imaging. This feedback loop allows the system to automatically adapt its inspection strategy based on the captured data, maintaining high productivity while managing complexity through intelligent control.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If manual inspection by trained personnel is used, then detailed assessment is possible, but continuous and verifiable documentation cannot be achieved

Engineering Contradiction:
Improveassessment accuracyVSAvoiddocumentation continuity
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs self-service by automatically capturing, processing, and documenting inspection data through the camera array and evaluation unit. This eliminates the need for manual inspection while providing continuous, verifiable digital documentation, resolving the contradiction between assessment accuracy and documentation reliability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical inspection process is replaced with an automated optical-electronic system consisting of cameras, image processing algorithms, and digital documentation. This substitution maintains assessment accuracy through high-resolution imaging while ensuring continuous and verifiable documentation through automated digital recording.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Measurement precision

If high-resolution detail cameras are used, then surface defects can be detected, but the field of view is limited and multiple time points are required

Engineering Contradiction:
Improvesurface resolutionVSAvoidinspection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The overview camera performs preliminary action by capturing images of the entire system first, allowing the evaluation unit to determine equipment positions before detail cameras perform high-resolution imaging. This preliminary action enables the detail cameras to focus only on relevant areas, reducing the total inspection time despite requiring multiple time points.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuity of useful action by seamlessly transitioning from overview imaging to detailed inspection. The evaluation unit continuously processes data and directs detail cameras to capture images at subsequent time points, ensuring that the inspection process flows without interruption and minimizing total inspection time.

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables cost-effective, automated monitoring of infrastructure with high-resolution detail capture, reducing downtime and eliminating the need for manual inspections by providing precise, real-time or near-real-time detection of subtle defects.

Implementation Method 1

aerial surveying of high-voltage power lines or other installations using laser scanning devices (so-called LIDAR, in particular 'Airborne Laser Scanning' (ALS))

Methodology Applied
Scientific EffectLIDAR: LIDAR

Implementation Method 2

image acquisition (aerial photogrammetry)

Methodology Applied
Scientific EffectPhotography: Photography

Data Source

PatentEP3376213B1Method and assembly for monitoring the state of a system with operating elements
Publication Date: 2025.11.12 SIEMENS ENERGY GLOBAL GMBH & CO KG
  • EP3376213B1 patent drawingFigure 1
  • EP3376213B1 patent drawingFigure 2
  • EP3376213B1 patent drawingFigure 3

AI summary

The present invention relates to a method for condition monitoring of a system with equipment (7), in which overview data is acquired by means of a first vehicle (9) with an overview sensor arrangement (17, 18) for optical detection of the system, and the equipment is identified in the overview data by means of an evaluation unit (20), and the positions of the equipment are determined taking into account the position of the first vehicle. Detailed images of the equipment are generated by means of a detail camera (19) on board a second or the first vehicle, which is directed towards the respective positions of the equipment. Furthermore, the present invention relates to a corresponding arrangement for carrying out the method according to the invention. One embodiment relates to the condition monitoring of high-voltage pylons (1) with high-voltage overhead lines (29) that are strung between the pylons.Insulators (7) are suspended from the cross members (4, 5, 6) as operating equipment.