Connector Fastening Detection Using Image-Guided Sensor Timing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic devices struggle to accurately and efficiently determine whether a cable connector is properly fastened during manufacturing processes, often leading to product defects due to resource limitations and excessive power consumption when analyzing multiple types of sensor data.
Innovation Solution
An electronic device equipped with a communication circuit and processor that receives a streaming image and sensor data to identify the start and end of a fastening action, determining if the connector is securely fastened by analyzing data from the start to the end of the operation, thereby reducing errors and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If various kinds of sensor data analysis are performed to improve connector fastening detection accuracy, then measurement precision is improved, but use of energy increases excessively
Solution Approach 1:
The system performs preliminary action by capturing streaming images continuously before the fastening action occurs, and uses image recognition to detect the start of fastening action. This allows the system to prepare for sensor data analysis in advance, analyzing sensor data only during the actual fastening period rather than continuously, thereby reducing overall power consumption while maintaining detection accuracy
Solution Approach 2:
The system applies periodic action by analyzing sensor data at specific intervals only during the detected fastening action period, rather than continuously. The processor determines to analyze sensor data based on the start and end timestamps of the fastening action identified from streaming images, creating a periodic analysis pattern that reduces energy consumption while maintaining measurement precision
2Reliability
If various kinds of sensor data are continuously analyzed to improve fastening detection reliability, then reliability is improved, but productivity decreases due to resource limitations
Solution Approach 1:
The system performs preliminary action by continuously capturing streaming images and identifying fastening action timestamps before sensor data analysis begins. This preparation allows the system to process sensor data efficiently only when needed, improving reliability through comprehensive analysis during critical periods without continuously consuming processing resources that would reduce productivity
Solution Approach 2:
The system implements periodic sensor data analysis based on the fastening action period identified from images. By analyzing sensor data only during the detected fastening interval (from start timestamp to end timestamp) and skipping analysis during other periods, the system maintains high detection reliability when it matters most while preserving manufacturing productivity through reduced computational load
3Measurement precision
If manual inspection is performed to detect connector fastening status, then measurement precision can be achieved, but productivity decreases due to labor requirements
Solution Approach 1:
The system replaces manual inspection with an automated multi-modal detection system that combines streaming image recognition with sensor data analysis. The processor automatically identifies fastening action from images and analyzes corresponding sensor data, eliminating the need for manual inspection while maintaining or improving measurement precision and significantly increasing manufacturing throughput
Solution Approach 2:
The system implements self-service by automatically capturing streaming images, identifying fastening action timestamps, selecting and analyzing relevant sensor data, and determining fastening status without human intervention. This automated self-inspection process maintains high measurement precision while dramatically improving productivity by freeing workers from manual inspection tasks
Data Source
AI summary
An electronic device according to various embodiments may include a communication circuit and a processor, wherein the processor is configured to receive a streaming image photographed by a first external electronic device through the communication circuit from a first external electronic device, identify a start of a fastening action of a user with respect to a target connector based on the streaming image, periodically obtain sensor data from a second external electronic device worn on the user based on identifying the start of the fastening action, identify an end of the fastening action with respect to the target connector based on the streaming image, and determine whether the target connector is fastened based on the sensor data obtained from the start of the fastening action to the end of the fastening action.


