Visual Structural Stress Inference via Image Affine Transformations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing structural stress monitoring methods rely on direct measurements with sensors, which can be costly and complex, and lack efficient remote or non-contact solutions for detecting structural impairments and stress in real-time.

Innovation Solution

A method and apparatus using visual image and video data to infer structural stress by computing affine transformations between frames, estimating deformation, and converting it into time-varying stress without direct imaging of the structure, employing off-the-shelf cameras and processors to analyze sequences of images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If direct measurement sensors are used to monitor structural stress, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improvestructural stress measurementVSAvoidmonitoring system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces mechanical stress sensors with a visual imaging system that captures deformation through camera images. The system uses image processing algorithms to calculate affine transformations between consecutive frames, deriving stress information from visual data rather than direct mechanical measurement, thereby reducing device complexity while maintaining monitoring capability

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces visual images as an intermediary medium to indirectly measure structural stress. Instead of direct contact with the structure, the system uses camera captures of the structure's appearance changes over time to infer deformation and stress states, eliminating the need for complex sensor installations

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If direct contact sensors are installed on the structure, then measurement precision is improved, but ease of operation and installation difficulty worsen

Engineering Contradiction:
Improvestress detection accuracyVSAvoidsensor installation ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system substitutes physical sensor installation with remote visual monitoring. By using camera images to track deformation through affine transformation calculations, the system eliminates the need for complex sensor mounting and installation procedures while maintaining the ability to measure stress accurately

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a visual copy or representation of the structure's deformation state through image sequences. By analyzing changes in the visual representation (images) rather than directly measuring the physical structure, the system avoids difficult installation while preserving measurement capability

Inventive Principle:
Principle #26Copying

3Productivity

If multiple cameras are used to monitor multiple structures, then productivity and monitoring coverage are improved, but device complexity increases

Engineering Contradiction:
Improvemonitoring throughputVSAvoidsystem architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent designs a universal image processing system that can handle multiple structures and cameras using the same affine transformation algorithms. The system processes images from different cameras and structures through a unified computational framework, enabling multi-site monitoring without proportionally increasing complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges the processing of multiple camera feeds and multiple structures into a single integrated workflow. By combining image sequences from different sources and applying consistent transformation algorithms across all structures, the system achieves high productivity while managing complexity through standardized processing pipelines

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10846819B2Method and apparatus to infer structural stresses with visual image and video data
Publication Date: 2020.11.24 SOUTHERN METHODIST UNIVERSITY
  • US10846819B2 patent drawing
  • US10846819B2 patent drawing

AI summary

The present invention includes an apparatus and method for determining time-varying stress experienced by a structure comprising: obtaining images that include the structure; segmenting the second and any subsequent images to include the “static” portions that are identified from the first image; computing with a processor the affine transformations between the first and second, and optionally subsequent images, sequence of images; estimating a deformation (i.e. translation and rotation) undergone by the structure; and converting the deformation to estimate the structural stress by using one or more scaling functions) to generate the time-varying stress experienced by the structure.