A special-shaped parts detection and diversion system and method

By using 3D vision technology and machine learning technology to detect the shape and size of the package in the diversion system of the express sorting center, and automatically divert through the diversion device, the problem of inefficient manual operation in the existing technology is solved, and multiple packages are realized efficient processing.

CN110694926BActive Publication Date: 2024-11-15CHINA POST SCI & TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201911071089.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-11-05
Publication Date
2024-11-15
Estimated Expiration
2039-11-05

AI Technical Summary

Technical Problem

The existing automated sorting equipment cannot adapt to multiple types and sizes of parcels, resulting in a large number of manual operations required for picking and diversion in the express sorting center, which is inefficient.

Method used

A special-shaped piece detection shunt system is designed, including a control system, a transmission belt, a special-shaped detection device and a shunt. Using 3D vision technology and machine learning technology to detect the shape and size of the package through cameras and gratings, determine whether the shunt is needed, and pass The shunt diverts the package to the specified line.

Benefits of technology

Automatic divert of packages of various forms and specifications is achieved, reducing labor costs and work intensity, and improving sorting efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN110694926B_ABST
    Figure CN110694926B_ABST
Patent Text Reader

Abstract

The present invention discloses a system and method for detecting and diverting irregular parts, which relates to the field of logistics sorting technology; it includes a control system, a conveyor belt I, a conveyor belt II, an irregular detection device and a diverter, wherein the conveyor belt I and the conveyor belt II are arranged in sequence, the diverter is arranged at the terminal of the conveyor belt II, the irregular detection device is installed at the conveyor belt II, and the control system controls the opening and operation of the conveyor belt, the irregular detection device and the diverter. The present invention measures the size of the parcel on the transmission line and identifies the irregular parcel on the transmission line through the combined application of 3D vision technology, machine learning technology and transmission diverter, and transmits them to different sorting equipment or sorting directions, so that the sorting system can enable the main channel to process parcels of various forms and specifications, replacing the exclusive manual processing of multiple types of parcels, reducing labor costs and work intensity.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of logistics sorting, and in particular to a device and method for detecting and diverting special-shaped packages. Background Art

[0002] With the rapid development of the logistics industry, the pressure of logistics sorting is increasing. At present, in the express sorting center, there are many types and sizes of parcels, but the existing automated sorting equipment cannot adapt to a variety of types and sizes of parcels, such as special-shaped pieces, oversized pieces and super small pieces. Therefore, before the parcels are introduced into the sorting machine, they need to be manually picked to remove the parcels on the transmission line that do not meet the requirements of the sorting machine, and at the same time, the large and small pieces that meet the requirements of the machine are multi-channel diversion according to the size requirements.

[0003] At present, all processing centers use manual operation to pick packages in the pre-processing stage of sorting. This method requires a lot of manpower and limits the efficiency of package processing in the pre-processing stage of sorting. Therefore, sorting and diversion devices for special-shaped packages need to be developed urgently. Summary of the invention

[0004] The object of the present invention is to provide a system and method for detecting and diverting irregular-shaped parts, so as to solve the above-mentioned problems existing in the prior art.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is as follows:

[0006] A system for detecting and diverting irregular parts includes a control system, a conveyor belt I, a conveyor belt II, a irregular detection device and a diverter. The conveyor belt I and the conveyor belt II are arranged in sequence, the diverter is arranged at the terminal of the conveyor belt II, and the irregular detection device is installed at the conveyor belt II. The control system is communicatively connected with the conveyor belt I, the conveyor belt II, the irregular detection device and the diverter to control the opening and operation of the conveyor belt, the irregular detection device and the diverter.

[0007] Preferably, the special-shaped detection device is installed at the conveyor belt II through a bracket, and the special-shaped detection device includes a camera I, a camera II and a grating. The grating is installed on the column of the bracket, and the grating is opposite to the connection between the conveyor belt I and the conveyor belt II. The camera I is installed on the top of the bracket to shoot the top surface of the package on the transmission line; the camera II is installed below the conveyor belt, and the shooting direction of the camera II is opposite to the connection between the conveyor belt I and the conveyor belt II.

[0008] Preferably, the camera I is a 3D industrial camera, and the camera II is a 3D line scan camera.

[0009] Preferably, the system further comprises a photoelectric sensor, which is arranged on the conveyor belt II to detect in real time the moving position of the irregular-shaped packages to be diverted.

[0010] Another object of the present invention is to provide a method for detecting and diverting irregular-shaped parts, comprising the following steps:

[0011] S1, the parcels to be diverted on the transmission line pass through a special-shaped detection device, which performs image detection on the mail to be diverted, and obtains basic information about the appearance of the mail to be diverted through an image analysis process;

[0012] S2: judging whether it is necessary to perform special-shaped mail diversion processing on the mail to be diverted based on the obtained basic information of the appearance of the mail to be diverted.

[0013] Preferably, step S1 specifically includes:

[0014] S11, when the parcel to be diverted is transferred from conveyor belt I to conveyor belt II, a grating arranged on a bracket is used to determine whether the parcel is unstable; at the same time, camera II obtains contour point cloud data of the bottom surface of the mail;

[0015] S12, when the package to be diverted runs on the conveyor belt II and passes under the camera I, the camera I obtains the contour point cloud data of the top surface of the package;

[0016] S13, according to the contour point cloud data in step S11 and step S12, the geometric feature information of the package is obtained through specific image algorithm calculation processing.

[0017] Preferably, step S2 specifically includes:

[0018] S21, determining whether the package's appearance meets the requirements, if yes, proceeding to step S22, if not, determining that the package is a special-shaped package and needs to be diverted;

[0019] S22, determining whether the surface morphology of the package meets the flatness requirement, if so, proceeding to step S23, otherwise determining that the mail is a special-shaped item and needs to be diverted;

[0020] S23, calling the mathematical model file to determine whether the geometric feature information meets the set geometric shape requirements. If yes, it is determined that the mail is not a special-shaped item and does not need to be diverted; otherwise, it is determined that the mail is a special-shaped item and needs to be diverted.

[0021] Preferably, the mathematical model file preparation process in step S23 is as follows: using a special-shaped detection device to collect a large amount of package shape geometry information and prepare a training sample set; using the training sample set to perform machine deep learning training, and finally obtaining a mathematical model file.

[0022] Preferably, the method further comprises:

[0023] S3, the photoelectric sensor on the conveyor belt II records the position of the package to be diverted, and when the package is close to the diverter, the diverter determines the diversion route of the package to be diverted according to the judgment result in step S2;

[0024] If the package to be diverted is a special-shaped piece, the control system will send a control signal to the diverter according to the predefined diversion route to divert the package to the designated route.

[0025] The main functions of the shunt system and shunt detection method provided in the present invention are as follows:

[0026] 1. Package tracking, positioning and shape determination functions

[0027] The mail on the main channel first passes through a 3D scanning camera, which uses a specific image processing algorithm to determine the size and shape attributes of the package. Multiple photoelectric sensors on the main channel can track and locate the package in real time.

[0028] 2. Special package separation function

[0029] By determining the package shape attributes from the image system, when tracking the package to the separation device, it can be selected whether to separate the package based on its shape attributes.

[0030] 3. Adaptability to various emails

[0031] Due to the application of the special-shaped parts diversion system, the main channel can handle parcels of various forms and specifications, replacing the existing cumbersome manual processing of multiple types of parcels, reducing labor costs and work intensity.

[0032] The beneficial effects of the present invention are:

[0033] The present invention provides a system and method for detecting and diverting special-shaped packages. By jointly applying 3D vision technology, machine learning technology and a transmission splitter, the size of the packages on the transmission line is measured and the special-shaped packages on the transmission line are identified. Then, the control system controls the transmission splitter to divert large, small and special-shaped packages and transmit them to different sorting equipment or sorting directions respectively, so that the sorting system can enable the main channel to process packages of various forms and specifications, replacing the exclusive manual processing of multiple types of packages, thereby reducing labor costs and work intensity. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 is a structural diagram of the special-shaped parts detection and diversion system in Example 1;

[0035] Figure 2 is a usage state diagram of the special-shaped part detection and diversion system in Example 1;

[0036] Figure 3 is the overall structural diagram of the whole-belt type balance wheel splitter module in Example 1;

[0037] Figure 4 is an internal structure diagram of the whole-belt type balance wheel splitter module in Example 1;

[0038] Figure 5 is a structural diagram of a steering unit of a full-belt type balance wheel splitter module in Example 1;

[0039] Figure 6 is an overall structural diagram of the balance wheel unit of the whole-belt balance wheel splitter module in Example 1;

[0040] Figure 7 This is an internal structural diagram of the balance wheel unit of the whole-belt balance wheel splitter module in Example 1;

[0041] Figure 8 is a structural diagram of the whole-belt type diversion device route 1 in Example 2;

[0042] Fig. 9 is a structural diagram of the whole-belt type diversion device route 2 in Example 2;

[0043] Fig.10 is a structural diagram of the whole-belt type diversion device route 3 in Example 2;

[0044] Fig.11 It is the flow chart of the algorithm for detecting irregular parts;

[0045] 1 is conveyor belt I, 2 is conveyor belt II, 3 is grating, 4 is 3D industrial camera, 5 is bracket, 6 is control cabinet, 7 is 3D line scan camera, 8 is photoelectric sensor, 9 is diverter, 10 is conveyor belt II, 11 is position I for package operation, 12 is position II for package operation, 9-1 is balance wheel unit, 9-2 is diverter module, 9-3 is upper end cover, 9-4 is support plate, 9-5 is lever, 9-6 is reversing motor, 9-7 is bearing seat, 9-8 is cable, 9-9 is crossbeam, 9-10 is the connector A, 9-11 is the swing unit supporting flap, 9-12 is the conveyor belt, 9-13 is the motor, 9-14 is the connector B, 9-15 is the sleeve, 9-16 is the cable, 9-17 is the top surface tensioning device, 9-18 is the reversing roller, 9-19 is the reversing swing rod-A, 9-20 is the reversing vertical rod, 9-21 is the steering rod, 9-22 is the reversing cross rod-B, 9-23 is the steering shaft, I is the diversion route 1, II is the diversion route 2, and III is the diversion route 3. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation methods described herein are only used to explain the present invention and are not used to limit the present invention.

[0047] Example 1

[0048] This embodiment provides a system for detecting and diverting irregular-shaped parts. Figure 1 As shown, it includes a control system, a conveyor belt I, a conveyor belt II, a special-shaped detection device, a photoelectric sensor and a diverter. The conveyor belt I and the conveyor belt II are arranged in sequence, the diverter is arranged at the terminal of the conveyor belt II, the special-shaped detection device is installed at the conveyor belt II, and the photoelectric sensor is arranged on the conveyor belt II to detect the moving position of the special-shaped package to be diverted in real time. The control system is connected to the conveyor belt I, the conveyor belt II, the special-shaped detection device and the diverter in communication to control the opening and operation of the conveyor belt, the special-shaped detection device and the diverter.

[0049] The special-shaped detection device is installed at the conveyor belt II through a bracket. The special-shaped detection device includes a camera I, a camera II and a grating. The grating is installed on the column of the bracket, and the grating is facing the connection between the conveyor belt I and the conveyor belt II. The camera I is installed on the top of the bracket to shoot the top surface of the package on the transmission line; the camera II is installed below the conveyor belt, and the shooting direction of the camera II is facing the connection between the conveyor belt I and the conveyor belt II. The control system is set in the control box, and the control box can be placed in any spare place.

[0050] In this embodiment, the camera I is a 3D industrial camera, and the camera II is a 3D line scan camera.

[0051] The flow divider used in this embodiment can be any flow divider with a flow diversion function. In this embodiment, a compact full-belt balance wheel flow divider is used, such as Figure 2 As shown, it includes 3 full-belt splitter modules, each module includes an upper end cover, a support plate, a steering unit and a plurality of pluggable balance wheel units installed on the steering unit; the support plate is arranged at both ends of the splitter module to support the full-belt balance wheel splitter module, the upper end cover is provided with a through hole corresponding to the balance wheel unit, and when the two ends of the upper end cover are fixed on the support plate, the plurality of balance wheel units and the upper end cover form a bearing surface.

[0052] During installation, the balance wheel unit is inserted into the flat shaft at the upper end of the steering shaft through the sleeve. During maintenance, an upward force F is applied to the balance wheel unit. When the force is greater than the gravity of the balance wheel unit and the locking force, the balance wheel unit can be taken out separately without removing the cover.

[0053] The diverting unit of the diverter in this embodiment is as follows: Figure 3 and Figure 4 As shown, it includes a balance wheel lever, a bearing seat, a steering shaft, a reversing assembly, a driving device, a bearing seat, a crossbeam and a steering rod, wherein the steering rod is connected to the steering assembly or the balance wheel unit. In this embodiment, the steering rod is connected to the steering assembly, the steering assembly is connected to the steering shaft, and the balance wheel lever is fixedly connected to the steering shaft; the bearing seat is installed on the crossbeam to fix the steering shaft, the steering rod is connected to the motor, the steering rod is connected to the steering assembly, the steering assembly is connected to the steering shaft through the balance wheel lever, and the balance wheel lever is fixedly connected to the steering shaft;

[0054] When the motor is running, the driving device drives the steering rod, and the steering rod drives the reversing assembly to translate, and at the same time, the reversing assembly drives the balance wheel lever, and the balance wheel lever drives the steering shaft inserted and fixed in the crossbeam bearing seat to rotate around its central axis to rotate the balance wheel unit. In this embodiment, the crossbeam is a C-shaped crossbeam.

[0055] The steering assembly comprises a reversing rocker arm-A, a reversing vertical rod and a reversing cross rod-B. The reversing rocker arm A and the reversing cross rod-B are arranged in parallel and both ends are connected by the reversing vertical rod.

[0056] In this embodiment, the steering shaft is provided with a connector joint A. When the steering shaft is connected to the sleeve, the connector joint B provided in the sleeve is inserted into the connector joint A to realize the circuit connection relationship between the balance wheel unit and the steering unit. The connector joint A can be provided inside the steering shaft or outside the steering shaft; the connector joint B can also be provided inside or outside the sleeve. The inner hole of the steering shaft leads out the wires for connecting the power supply and the controller.

[0057] The balance wheel unit in this embodiment is as follows Figure 5 and Figure 6 As shown, it includes a sleeve, a conveyor belt device, a supporting folding plate and a top surface tensioning device. The conveyor belt device includes a conveyor belt driving device, a conveyor belt and a reversing roller. The conveyor belt is sleeved on the reversing roller. The conveyor belt driving device drives the conveyor belt to operate. In this embodiment, the conveyor belt driving device can adopt a motor, a roller device or an electric roller. The supporting folding plate is arranged on both sides of the pendulum unit to support the pendulum unit. The top surface tensioning device is fixed on the bending plate. By adjusting the position of the reversing roller, the tightness of the conveyor belt is adjusted to prevent the conveyor belt from running off. The sleeve is pluggable and installed on the steering shaft. The conveyor belt device is used for package transportation.

[0058] In a more preferred embodiment, the conveyor belt can be a flat conveyor belt, a toothed belt or a mesh belt. The conveyor belt in this embodiment is provided with guide ribs to prevent the conveyor belt from deviating.

[0059] In this embodiment, the balance wheel units in the balance wheel splitter module can be arranged in double rows or multiple rows in a staggered manner, or in double rows or multiple rows in a non-staggered in-line manner, and the spacing between the balance wheels in the first row is different from the spacing between the balance wheels in the second row.

[0060] Example 2

[0061] This embodiment provides a method for performing special-shaped flow diversion using the special-shaped part detection and diversion system in Embodiment 1, comprising the following steps:

[0062] S1, the parcels to be diverted on the transmission line pass through the special-shaped detection device, the special-shaped detection device performs image detection on the mails to be diverted, and obtains the basic appearance information of the mails to be diverted through the image analysis process; specifically including:

[0063] S11, when the parcel to be diverted is transferred from conveyor belt I to conveyor belt II (at position I), a grating disposed on the bracket is used to determine whether the parcel is unstable; at the same time, camera II obtains contour point cloud data of the bottom surface of the mail;

[0064] S12, when the package to be diverted runs on the conveyor belt II and passes under the camera I (at position II), the camera I acquires the contour point cloud data of the top surface of the package;

[0065] S13, according to the contour point cloud data in step S11 and step S12, the geometric feature information of the package is obtained through specific image algorithm calculation processing.

[0066] S2, judging whether it is necessary to perform special-shaped mail diversion processing on the mail to be diverted based on the obtained basic information of the shape of the mail to be diverted, specifically including:

[0067] S21, determining whether the package's appearance meets the requirements, if yes, proceeding to step S22, if not, determining that the package is a special-shaped package and needs to be diverted;

[0068] S22, determining whether the surface morphology of the package meets the flatness requirement, if so, proceeding to step S23, otherwise determining that the mail is a special-shaped item and needs to be diverted;

[0069] S23, calling the mathematical model file to determine whether the geometric feature information meets the set geometric shape requirements. If yes, it is determined that the mail is not a special-shaped item and does not need to be diverted; otherwise, it is determined that the mail is a special-shaped item and needs to be diverted.

[0070] The mathematical model file preparation process in step S23 is as follows: using a special-shaped detection device to collect a large amount of package shape geometry information and prepare a training sample set; using the training sample set to perform machine deep learning training, and finally obtaining a mathematical model file.

[0071] Preferably, the method further comprises:

[0072] S3, the photoelectric sensor on the conveyor belt II records the position of the package to be diverted, and when the package is close to the diverter, the diverter determines the diversion route of the package to be diverted according to the judgment result in step S2;

[0073] If the package to be diverted is a special-shaped piece, the control system will send a control signal to the diverter according to the predefined diversion direction to divert the package to the designated route.

[0074] By adopting the above technical solution disclosed in the present invention, the following beneficial effects are obtained:

[0075] The present invention provides a system and method for detecting and diverting special-shaped packages. By jointly applying 3D vision technology, machine learning technology and a transmission splitter, the size of the packages on the transmission line is measured and the special-shaped packages on the transmission line are identified. Then, the control system controls the transmission splitter to divert large, small and special-shaped packages and transmit them to different sorting equipment or sorting directions respectively, so that the sorting system can enable the main channel to process packages of various forms and specifications, replacing the exclusive manual processing of multiple types of packages, thereby reducing labor costs and work intensity.

[0076] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be considered as the scope of protection of the present invention.

Claims

1. A special-shaped parts detection and diversion system, characterized in that: It includes a control system, a conveyor belt I, a conveyor belt II, a special-shaped detection device and a diverter, wherein the conveyor belt I and the conveyor belt II are arranged in sequence, the diverter is arranged at the terminal of the conveyor belt II, the special-shaped detection device is installed at the conveyor belt II, and the control system is connected to the conveyor belt I, the conveyor belt II, the special-shaped detection device and the diverter for communication, so as to control the opening and operation of the conveyor belt, the special-shaped detection device and the diverter; The splitter is a compact belt-type balance wheel splitter, comprising three full-belt splitter modules, each module comprising a steering unit and a plurality of pluggable balance wheel units mounted on the steering unit; The steering unit comprises a balance wheel lever, a steering shaft, a reversing assembly, a driving device, a bearing seat, a crossbeam and a steering rod, wherein the reversing assembly is connected to the steering shaft and the balance wheel lever is fixedly connected to the steering shaft; the bearing seat is mounted on the crossbeam to fix the steering shaft, the steering rod is connected to the reversing motor, the steering rod is connected to the reversing assembly, the reversing assembly is connected to the steering shaft through the balance wheel lever and the balance wheel lever is fixedly connected to the steering shaft; When the reversing motor is in operation, the driving device drives the steering rod, and the steering rod drives the reversing assembly to translate, and at the same time, the reversing assembly drives the balance wheel lever, and the balance wheel lever drives the steering shaft inserted and fixed in the crossbeam bearing seat to rotate around its central axis to rotate the balance wheel unit; The reversing assembly comprises a reversing swing rod-A, a reversing vertical rod and a reversing cross rod-B, wherein the reversing swing rod-A and the reversing cross rod-B are arranged in parallel and the two ends are connected by the reversing vertical rod; The balance wheel unit comprises a sleeve and a conveyor belt device, wherein the sleeve is pluggably installed on the steering shaft, and the conveyor belt device is used for package transportation.

2. The irregular-shaped parts detection and diversion system according to claim 1, characterized in that: The special-shaped detection device is installed at the conveyor belt II through a bracket. The special-shaped detection device includes a camera I, a camera II and a grating. The grating is installed on the column of the bracket, and the grating is opposite to the connection between the conveyor belt I and the conveyor belt II. The camera I is installed on the top of the bracket to shoot the top surface of the package on the transmission line; the camera II is installed below the conveyor belt, and the shooting direction of the camera II is opposite to the connection between the conveyor belt I and the conveyor belt II.

3. The irregular-shaped parts detection and diversion system according to claim 2, characterized in that: The system further comprises a photoelectric sensor, which is arranged on the conveyor belt II to detect in real time the moving position of the irregular-shaped packages to be diverted.

4. A method for detecting and diverting irregular parts using the irregular part detection and diversion system according to claim 2 or 3, characterized in that: The following steps are involved: S1, the parcels to be diverted on the transmission line pass through a special-shaped detection device, which performs image detection on the mail to be diverted, and obtains basic information about the appearance of the mail to be diverted through an image analysis process; S2: judging whether it is necessary to perform special-shaped mail diversion processing on the mail to be diverted based on the obtained basic information of the appearance of the mail to be diverted.

5. The method for detecting and diverting irregular-shaped parts according to claim 4, characterized in that: Step S1 specifically includes: S11, when the parcel to be diverted is transferred from conveyor belt I to conveyor belt II, a grating arranged on a bracket is used to determine whether the parcel is unstable; at the same time, camera II obtains contour point cloud data of the bottom surface of the mail; S12, when the package to be diverted runs on the conveyor belt II and passes under the camera I, the camera I obtains the contour point cloud data of the top surface of the package; S13, according to the contour point cloud data in step S11 and step S12, the geometric feature information of the package is obtained through specific image algorithm calculation processing.

6. The method for detecting and diverting irregular-shaped parts according to claim 4, characterized in that: Step S2 specifically includes: S21, determining whether the package's appearance meets the requirements, if yes, proceeding to step S22, if not, determining that the package is a special-shaped package and needs to be diverted; S22, determining whether the surface morphology of the package meets the flatness requirement, if so, proceeding to step S23, otherwise determining that the mail is a special-shaped item and needs to be diverted; S23, calling the mathematical model file to determine whether the geometric feature information meets the set geometric shape requirements. If yes, it is determined that the mail is not a special-shaped item and does not need to be diverted; otherwise, it is determined that the mail is a special-shaped item and needs to be diverted.

7. The method for detecting and diverting irregular-shaped parts according to claim 6, characterized in that: The mathematical model file preparation process in step S23 is as follows: using a special-shaped detection device to collect a large amount of package shape geometry information and prepare a training sample set; using the training sample set to perform machine deep learning training, and finally obtaining a mathematical model file.

8. The method for detecting and diverting irregular-shaped parts according to claim 4, characterized in that: The method further includes: S3, the photoelectric sensor on the conveyor belt II records the position of the package to be diverted, and when the package is close to the diverter, the diverter determines the diversion route of the package to be diverted according to the judgment result in step S2; If the package to be diverted is a special-shaped piece, the control system will send a control signal to the diverter according to the predefined diversion route to divert the package to the designated route.