Turnover box automatic positioning method based on image geometrical characteristics

A geometric feature and automatic positioning technology, applied in the field of image analysis, can solve problems such as low efficiency, uncontrollable error rate, small turnover box spacing, etc., and achieve the effect of short time, accurate positioning effect, and less hardware changes

Active Publication Date: 2020-08-14
天津施格机器人科技有限公司
View PDF9 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, its handling tasks are mainly completed manually, and the existing problems are: (1) high labor cost; (2) low efficiency; (3) error rate is uncontrollable, and the source of error cannot be traced
[0004] The segmentation-based method has poor positioning effect on images with small differences in grayscale between the target and the background, and it is difficult to completely separate the target from the background, so the positioning accuracy is low, and it is difficult to guide the robot arm to grasp
The edge-based method is sensitive to noise, and the accuracy of some turnover box images with no obvious difference between the gray level and the background is low, and the recognition rate is difficult to meet the industrial-grade requirements
The biggest problem with the feature-based method is that the process of extracting and analyzing features takes a long time, and it is difficult to distinguish some false targets that are similar to the target features.
The method based on deep learning requires a large number of labeled samples for training the model, and the final positioning accuracy is affected by the labeling accuracy, and the positioning results may be unstable, which is not suitable for precise grasping
[0005] The turnover box positioning problem has the following difficulties: (1) The image background of the turnover box is complex, and there are various types of internal materials, which may interfere with target recognition; (2) The distance between the turnover boxes is small, and adjacent boxes may interfere with each other
(3) For gray turnover boxes, positioning based on color features will lead to large errors
(4) The turnover box may be deformed during use, and the shape of each turnover box will not be exactly the same
[0006] Existing methods are difficult to achieve precise positioning of turnover boxes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Turnover box automatic positioning method based on image geometrical characteristics
  • Turnover box automatic positioning method based on image geometrical characteristics
  • Turnover box automatic positioning method based on image geometrical characteristics

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] like figure 1 , figure 2 and image 3 As shown, the present invention provides a method for automatic positioning of turnover boxes based on image geometric features, including the following steps:

[0055] S1: According to the original image obtained from the camera, the vertical edge and horizontal edge are obtained, and the area where the vertical edge and horizontal edge are located is intercepted as the region of interest ( Roi image), specifically, the four sides corresponding to the upper, lower, left and right sides of the turnover box Roi The images are recorded as Roi_u , Roi_d , Roi_l , Roi_r .

[0056] S2: convert each Roi The image sequentially extracts the RGB channel components, and then Roi The image is grayscaled to obtain a grayscale image, and a total of 4 single-channel images are obtained. The gradient image is obtained for each single-channel image, and then the local threshold method is used to binarize each gradient image. The loca...

Embodiment 2

[0088] like Figure 4 to Figure 10 As shown, in the actual production process, the collected turnover box images may have incomplete targets, that is, if only 3 sides are photographed, then 3 images will be generated Roi image, for the 3 generated Roi The steps of image processing are similar to the case of photographing 4 sides, the difference is that in the process of calculating the center point and rotation angle, the length and width of the box are known, and the captured complete edges and Compare the known length and width dimensions of the box to determine whether the complete edge is long or wide, and then divide each Roi The detection result of the image is mapped to the original image, and the average value of the angles of the three detected sides is used as the rotation angle of the box, and the final center point is calculated according to the size and rotation angle of the box. This method is suitable for batch image processing of the turnover box size of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a turnover box automatic positioning method based on image geometrical characteristics, and the method comprises the steps: S1, obtaining a vertical edge and a horizontal edge according to an original image, and obtaining a region of interest (Roi image); s2, carrying out binarization processing; s3, removing noise points; s4, carrying out straight line detection on the binary image by adopting a Hough transformation strategy to obtain a plurality of approximate straight lines, and then fusing the approximate straight lines into a fused straight line by adopting a straight line fusion method; s5, obtaining to-be-selected edges, if the number of the to-be-selected edges is zero, returning to the step S2, reducing the offset C, and continuing iteration until at least one to-be-selected edge is obtained; s6, determining the color of the local image to filter out false edges; and S7, integrating the edges, and calculating a central point and a rotation angle to realize positioning. The turnover box can be positioned in the visible light image, consumed time is short, and manual participation is not needed.

Description

technical field [0001] The invention relates to the technical field of image analysis, in particular to an automatic positioning method for a turnover box based on image geometric features. Background technique [0002] Locating the target of interest in the image is a key technology in the fields of image processing, machine vision, etc. Its purpose is to find the target of interest in the image, extract its position information in the image, and then calibrate it through the camera Convert its position to the world coordinate system to lay the foundation for subsequent operations such as robot grasping. The short-distance transportation of materials is an essential link in scenarios such as warehouses and assembly lines. The turnover box is a standardized material container, which is widely used in the circulation and storage of materials. At present, its handling tasks are mainly completed manually, and the existing problems are: (1) high labor cost; (2) low efficiency;...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/32G06K9/40G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V10/30G06V10/48G06V10/25G06V10/44G06V10/56G06N3/045G06F18/241G06F18/25
Inventor 王乐金喆侯冠楠张立
Owner 天津施格机器人科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products