Neural network-based visual system calibration method

A neural network and calibration method technology, applied in the field of vision system calibration, can solve problems such as low accuracy, slow iteration speed, and cumbersome calibration process, and achieve the effect of simplifying calibration steps, accelerating convergence speed, and improving generalization.

Active Publication Date: 2016-11-09
江苏中服焦点跨境贸易服务有限公司
View PDF6 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to overcome the problems of low accuracy, slow iteration speed and cumbersome calibration process of the traditional calibration...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network-based visual system calibration method
  • Neural network-based visual system calibration method
  • Neural network-based visual system calibration method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention uses the image processing algorithm to obtain 160 groups of image coordinates and corresponding Delta robot coordinates from the camera shooting, for network training and experiments, and uses the Faugeras calibration algorithm to obtain the network initial value and network structure, because the initial value and the network structure are relatively close The real model can reduce the number of iterations of network training and improve the calibration efficiency. Specifically, it includes deriving the Faugeras calibration algorithm suitable for the Delta robot vision system according to the positional relationship between the robot and the camera; using the Faugeras calibration algorithm to obtain the linear internal parameters and linear external parameters of the vision system calibration, and use them as the initial weight of the neural network And bias, because the initial weight and bias are close to the real value, it can speed up the netwo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a neural network-based visual system calibration method. The method comprises the steps of deriving a Faugeras calibration algorithm suitable for a Delta robot vision system according to a position relationship between a robot and a video camera; solving a linear intrinsic parameter and a linear extrinsic parameter for vision system calibration by utilizing the Faugeras calibration algorithm, and taking the linear intrinsic parameter and the linear extrinsic parameter as an initial weight value and an offset of a neural network; and deriving a 2-2-3-1 four-layer neural network structure suitable for Delta robot vision system calibration by utilizing Faugeras, wherein a transitive relation between an input layer and a hidden layer of the network represents an extrinsic parameter for video camera calibration, a transitive relation between the hidden layer and an output layer of the network represents the extrinsic parameter for the vision system calibration, and an activation function of the neural network is nonlinear due to existence of nonlinear factors such as distortion and the like. In an output of the neural network, an X axis and a Y axis of a coordinate system of the robot have different network characteristics, so that the 2-2-3-1 four-layer distributed neural network structure is adopted; and in addition, the experimental calibration precision of the method is 0.109mm, and the precision of a conventional Faugeras calibration algorithm is 0.535mm.

Description

technical field [0001] The invention relates to a neural network calibration method, in particular to a calibration method for a vision system used to control material grabbing of an industrial Delta robot. Background technique [0002] There are many influencing factors in the imaging process of the Delta robot vision system, such as radial distortion, tangential distortion, and measurement errors. The final camera imaging model has become a complex nonlinear model, and the mapping relationship between object points and image points has also become a non-linear mapping relationship. Many researchers have conducted in-depth research on the imaging relationship of cameras and proposed many new calibration methods. Traditional calibration methods cannot include all nonlinear factors in the imaging process, and can only select the main factors, while ignoring other uncertain factors. However, an accurate mathematical calibration model will lead to cumbersome calculations and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00G06N3/02
CPCG06N3/02G06T2207/10016
Inventor 顾寄南丁卫唐仕喜尚正阳张瑜于萍萍张丽鹏高国伟
Owner 江苏中服焦点跨境贸易服务有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products