Assembling Machine Fiducial Super-Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing component mounting machines face challenges in securing sufficient resolution for small components while avoiding errors in positioning due to limited camera visual fields and potential misalignment during multi-frame type super-resolution processing.

Innovation Solution

The assembly machine employs a moving head with fiducial marks, an imaging device, and an image processing section that uses super-resolution processing to generate high-resolution data by calculating displacement amounts based on fiducial marks, allowing accurate positioning and recognition of components regardless of initial position errors, and adjusts the camera visual field to accommodate both small and large components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the camera visual field is set wide to fit large components, then large components can be imaged, but small components occupy insufficient area in the image data and resolution is inadequate

Engineering Contradiction:
Improvecapability to image various sized componentsVSAvoidresolution for small components
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by moving the imaging device to capture multiple images of the component at different positions. Instead of using a fixed wide-angle lens that compromises resolution, the system dynamically changes the relative position between the imaging device and component, capturing multiple images that are then synthesized to achieve high resolution while maintaining compatibility with various component sizes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent transitions from a two-dimensional image capture problem to a three-dimensional solution by introducing the temporal dimension (multiple images captured at different times/positions). By capturing images from multiple positions and synthesizing them, the system achieves high resolution without requiring a narrow fixed visual field, thus resolving the contradiction between wide field of view and high resolution.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multi-frame type super-resolution processing is used to generate high resolution data, then resolution is improved, but positioning errors occur when there are errors between instructed position and actual position

Engineering Contradiction:
Improveresolution of image dataVSAvoidaccuracy of positioning
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces fiducial marks as an intermediary reference object that is attached to the component. These fiducial marks serve as a stable reference frame that allows the system to accurately calculate the component's position and orientation in each captured image. By using these fiducial marks as intermediaries, the system can perform accurate positioning even when there are errors between instructed and actual positions, thus enabling reliable super-resolution processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system employs feedback by detecting the position of fiducial marks in each captured image and using this information to calculate the actual position and orientation of the component. This feedback mechanism allows the system to correct for positioning errors and accurately align multiple images during super-resolution processing, ensuring both high resolution and positioning accuracy.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9980420B2Assembling machine
Publication Date: 2018.05.22 FUJI CORP
  • US9980420B2 patent drawing
  • US9980420B2 patent drawing
  • US9980420B2 patent drawing

AI summary

The assembling machine is provided with fiducial marks which are attached to a defined position on a moving head, and an image processing section which recognizes the holding state of the component by the holding member based on high resolution data which is generated by super-resolution processing which uses a plurality of items of image data. The image processing section includes a displacement amount calculation section which calculates each displacement amount of imaging positions of other items of image data in relation to the imaging position of reference data, a positioning processing section which performs the positioning of the other items of image data in relation to the reference data, and a reconstruction processing section which generates the high resolution data based on the plurality of items of image data which are positioned.