Computer Vision for Building Component Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In the insurance industry, manual property inspections and assessments are cumbersome, prone to human error, and lack accurate software tools for segmenting and classifying building components and materials, leading to inaccurate assessments and biases.

Innovation Solution

A computer vision system using neural network-based segmentation models to identify and classify building components and materials in digital images or videos, determining material or attribute types based on confidence values compared to pre-calculated threshold values, and optionally utilizing user input for selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual property inspections are performed by human operators, then detailed assessment of building components can be conducted, but the process is cumbersome and prone to human error

Engineering Contradiction:
Improveassessment accuracyVSAvoidinspection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical inspection processes with an automated computer vision system that uses machine learning models to detect, segment, and classify building components. The system processes images and video feeds to automatically identify structural elements, materials, and conditions without human physical presence, thereby eliminating human error while maintaining assessment accuracy and significantly reducing inspection time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Extent of automation

If software tools are used to assist with inspection tasks, then some automation is achieved, but the technical capabilities are severely lacking

Engineering Contradiction:
Improveautomation levelVSAvoidclassification accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent employs multiple machine learning models with different specialized functions (detection models, segmentation models, classification models) that process images through various transformation stages. Each model is trained on specific parameters and features, progressively refining the analysis from basic object detection to detailed material classification, thereby achieving both high automation and high precision simultaneously.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If human operators physically inspect properties, then direct observation of building components is possible, but large amounts of paperwork must be generated and processed

Engineering Contradiction:
Improveinformation capture completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent creates digital copies of building components through image capture and processing, replacing physical inspection and manual documentation. The system generates structured digital data including detected objects, segmented regions, classified materials, and measured attributes directly from images, eliminating the need for physical presence and manual paperwork while maintaining complete information capture.

Inventive Principle:
Principle #26Copying

4Reliability

If manual inspection methods are used, then flexibility in assessing various building components is maintained, but accuracy is reduced due to human bias errors

Engineering Contradiction:
Improveassessment reliabilityVSAvoidoperational simplicity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments the inspection task into distinct processing stages: detection of building components, segmentation of specific regions within components, classification of materials and attributes, and measurement of physical properties. This segmentation allows each stage to be optimized independently with specialized machine learning models, improving reliability through consistent automated processing while maintaining operational simplicity through integrated system execution.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20230185839A1Computer Vision Systems and Methods for Segmenting and Classifying Building Components, Contents, Materials, and Attributes
Publication Date: 2023.06.15 INSURANCE SERVICES OFFICE INC
  • US20230185839A1 patent drawing
  • US20230185839A1 patent drawing
  • US20230185839A1 patent drawing

AI summary

Computer vision systems and methods for segmenting and classifying building components, contents, materials or attributes are provided. The system obtains media content indicative of an asset. The system identifies and segments items of the asset based on one or more segmentation models. The system determines, based on one or more classification models, a value associated with material or other attribute classification for each of the segmented items. The value indicates how likely the segmented item belongs to a particular material or attribute type. The system determines a material or attribute type for each of the segmented items based on a comparison of the confidence value of the material or the attribute to pre-calculated threshold values. The threshold values define a cut-off indicative of a segmented item most likely to be a particular type of material or attribute.