Welding Guide Display Using Image Features for Real-Time Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual welding operations are dependent on the experience and knowledge of the worker, leading to variability in quality, particularly for those with limited experience or knowledge, and existing technologies lack effective solutions to improve welding quality consistently.

Innovation Solution

A display control device that extracts features from images of welding operations, using image processing and a database to generate guides for improving welding parameters, such as torch angle and groove position, displayed to the worker in real-time, enhancing the quality of the welding process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual welding operations are performed by workers with limited experience or knowledge, then the welding quality becomes inconsistent and dependent on worker skill, but implementing automated guidance systems increases device complexity

Engineering Contradiction:
Improvewelding qualityVSAvoidguidance system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system captures images of the welding operation, extracts features (torch angle, groove position, etc.), compares them against reference data, and provides real-time feedback to the worker through a display device. This closed-loop feedback mechanism enables workers of any skill level to achieve consistent high-quality welds without requiring complex automated control systems.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system uses image processing to create a digital representation (copy) of the welding scene, extracting key geometric features and comparing them against pre-stored reference images of correct welding positions. This allows the system to guide workers without requiring complex physical measurement devices or sophisticated sensors.

Inventive Principle:
Principle #26Copying

2Reliability

If real-time image processing and feedback systems are implemented to guide welding operations, then welding quality improves for workers of all experience levels, but the device complexity and computational requirements increase

Engineering Contradiction:
Improvewelding operation qualityVSAvoidimage processing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system extracts only the essential geometric features (torch angle, groove position, weld pool characteristics) from the captured images, rather than processing the entire image data. By focusing only on the critical parameters needed for quality assessment, the system achieves reliable guidance with simplified processing requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Reference images and feature data are pre-captured and stored in a database before the welding operation begins. During the actual welding process, the system only needs to compare real-time extracted features against these pre-prepared references, significantly reducing the computational complexity and enabling real-time feedback without complex processing.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If automated feature extraction and guidance display systems are used, then welding consistency improves across workers of varying skill levels, but the system requires sophisticated image processing algorithms

Engineering Contradiction:
Improvewelding operation efficiencyVSAvoidimage processing algorithm complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system replaces complex mechanical measurement devices (protractors, position sensors, alignment tools) with simple image capture and digital processing. By using a camera and software-based feature extraction, the system achieves automated guidance without requiring sophisticated hardware, simplifying the overall system while maintaining high productivity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12087180B2Display control device, display system, welding system, welding method, display control method, storage medium
Publication Date: 2024.09.10 KK TOSHIBA
  • US12087180B2 patent drawing
  • US12087180B2 patent drawing
  • US12087180B2 patent drawing

AI summary

According to one embodiment, a display control device extracts a first feature from a first image of a welding operation, and causes a display device to display the first feature and a guide, the guide being related to the welding operation. The guide preferably includes a second feature corresponding to the first feature. The first feature and the second feature each may indicate a shape and position of a component related to the welding operation.