Image-Based Component Verification for Worker Assembly Operations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for determining operation appropriateness are inaccurate due to variations in worker physical features, leading to potential mistakes or omissions.

Innovation Solution

An operation determination apparatus that includes an image obtainer, component detector, grip determiner, and notification controller to accurately identify the component being gripped by a worker and provide notifications when a mismatch occurs, using image processing and predetermined component features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the technique monitors worker's physical movement based on captured images, then it can detect operation actions, but it cannot accurately determine whether operations are performed appropriately due to variations in worker physical features

Engineering Contradiction:
Improveoperation determination accuracyVSAvoidworker physical feature variation
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent uses image copying technology to capture and analyze components in the worker's hand. By creating digital copies of components from captured images and comparing them with standard component images, the system can accurately identify components regardless of worker physical variations. This copying approach enables precise operation determination while adapting to different workers.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces mechanical observation of worker movements with image processing and component recognition systems. Instead of relying on physical movement patterns that vary by worker, the system uses captured images to detect and identify components, substituting mechanical monitoring with optical and computational methods that are independent of worker physical features.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If the system provides real-time notifications for incorrect components, then it reduces mistakes and omissions, but it increases system complexity

Engineering Contradiction:
Improveoperation correctnessVSAvoidsystem structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the system notifies workers when incorrect components are detected. The notification process provides immediate feedback on operation correctness, allowing workers to correct mistakes promptly. This feedback loop enhances reliability by preventing propagation of errors while maintaining a relatively simple system structure through straightforward comparison and notification logic.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12361532B2Operation determination apparatus and operation determination method
Publication Date: 2025.07.15 OMRON CORP
  • US12361532B2 patent drawing
  • US12361532B2 patent drawing
  • US12361532B2 patent drawing

AI summary

An operation determination apparatus includes an image obtainer that obtains a captured image of a worker gripping a component and performing an operation of attaching the component to a workpiece, a component detector that detects a component in the captured image obtained by the image obtainer, a grip determiner that determines, based on a detection result from the component detector, whether the worker is gripping a component and whether the component gripped by the worker is a component to be attached to the workpiece in the operation, and a notification controller that controls a predetermined notification to be provided in response to the grip determiner determining that the component gripped by the worker is not the component to be attached to the workpiece in the operation.