Voice-Assisted Defect Logging for Glove-Based Quality Inspection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for logging paint defects during quality inspection in industries, such as using handwritten notes or digital diaries, are time-consuming and cumbersome, especially when inspectors wear gloves, and sharing defect logs across units is difficult due to the need for digitization.
Innovation Solution
A voice-assisted defect logging system that integrates a voice-to-text conversion model with a large language model and domain model to identify defect type, location, and part, allowing real-time recording and verification in 2D/3D views, and facilitates seamless integration and communication for repair.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If handwritten notes or digital diaries are used for defect logging, then defect recording can be performed, but inspection time increases and productivity decreases
Solution Approach 1:
The patent replaces the mechanical system of manual writing (handwritten notes) or manual data entry (digital diaries) with an acoustic system (voice-based defect logging). Inspectors speak defects naturally during inspection, and the system automatically converts speech to structured defect records, eliminating the time-consuming manual writing or typing process while maintaining accurate defect documentation.
Solution Approach 2:
The system enables inspectors to log defects independently through natural speech without requiring manual intervention for data entry. The voice-to-text conversion and defect structuring happen automatically, allowing inspectors to complete logging tasks themselves during the inspection process without additional time overhead.
2Loss of information
If manual defect logging is used, then defect information can be recorded, but time consumption increases
Solution Approach 1:
The system replaces manual information recording with automatic speech-to-text conversion. Inspectors verbally describe defects in natural language during inspection, and the system automatically transcribes, structures, and stores the defect information, completing the entire logging process in seconds rather than minutes or hours.
Solution Approach 2:
The system performs preliminary processing of voice inputs by pre-processing to remove noise and converting speech to text structure in advance, so that defect information is immediately captured and organized without requiring subsequent manual processing or data entry steps.
3Loss of information
If digital diaries are used for defect logging, then digitization can be achieved, but sharing across units remains difficult
Solution Approach 1:
The system creates a universal defect logging platform that generates standardized defect records in a common format suitable for sharing across different units and departments. The structured defect data produced by the voice-based system can be seamlessly integrated with other enterprise systems, enabling easy sharing and collaboration without format conversion or manual re-entry.
4Measurement precision
If inspectors use gloves during inspection, then inspection accuracy is maintained, but defect logging becomes more difficult
Solution Approach 1:
The system replaces manual writing or typing operations with voice-based defect logging. Inspectors wearing gloves can naturally speak defect observations without needing to physically write or type, eliminating the dexterity issues associated with manual logging while maintaining inspection accuracy through glove use.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The embodiments of present disclosure herein address unresolved problems of handwritten notes or digital diaries for logging defects during quality inspection. Also, these kinds of inspections in the industries are time bound. In certain sensitive inspection cases inspectors are required to use gloves while inspecting which leads to added overhead of working with gloves while noting down the defects. Sharing of these defect logs also becomes difficult as they first must be digitized to be shared across the different units in the industry. Embodiments herein provide a method and system which logs the defects identified by inspectors using inspector's voice. The system identifies defect type, location and sub-section from inspector speech and marks the defect in an orthogonal view, a two-dimensional (2D) view, a three-dimensional (3D) view of the artifact being inspected for verification. The system also allows for marking the defects as resolved during the repair or rework process.