System and method for detecting and removing sundries in residual tobacco shreds based on visual detection

Abstract

The invention discloses a system and a method for detecting and removing sundries in residual tobacco shreds based on visual inspection, and the system comprises a vibration material scattering device which comprises a material scattering basket and a vibrator; the feeding device comprises a conveying belt, a feeding pipe and a discharging hopper which are arranged in sequence; the sundry identification device comprises an image acquisition camera and an image processing detection unit; the blanking device comprises a plurality of blanking areas and a discharge port which are regularly arranged; the sundry removing device comprises a sundry positioning camera, a sundry image detection unit and a negative pressure suction device. According to the method, image acquisition and impurity identification are carried out on the residual tobacco shreds in the falling process, the impurities can be timely and accurately detected, the situation that the impurities are covered and cannot be detected is avoided, the impurities are identified and positioned by establishing the impurity and tobacco shred identification method based on the segmentation model, and the identification accuracy is improved. And an impurity removing device is used for accurately removing impurities, so that the purposes of improving the purity of the residual tobacco shreds and improving the quality of the doped tobacco shreds are achieved.

Description

Technical Field

[0001] The present invention relates to the field of visual inspection of cigarettes, and in particular to a system and method for detecting and removing foreign matters in residual tobacco based on visual inspection. Background Art

[0002] During the cigarette rolling and packaging process, cigarettes are rejected because their appearance, physical indicators and small box packaging do not meet the quality control standards. In fact, these cigarettes can be disassembled and separated, and the tobacco is recycled and reused. Tobacco blending is an important part of the cigarette blending and flavoring process. At present, the blended tobacco is mostly quality cigarettes that pass through the disassembly device to separate the cigarette paper and filter rod from the tobacco. The disassembled tobacco is screened out of the cigarette paper and other debris using spectral impurity removal equipment, but spectral impurity removal is not effective in removing small pieces of cigarette paper, and the tobacco screened by spectral impurity removal needs to be manually screened again.

[0003] The invention patent with the publication number CN117000634A discloses a residual tobacco sorting and impurity removal device, which uses air separation to separate the paper scraps from the residual tobacco, thereby achieving the purpose of sorting and impurity removal. The utility model with the publication number CN218502333U discloses a recycled tobacco impurity removal and adsorption device, which uses the principle of electrostatic adsorption to remove tiny impurities from the residual tobacco. The utility model with the publication number CN221769313U discloses a debris detection device for an online tobacco recycling system, which uses a visual detection method combined with a negative pressure device to remove impurities from the tobacco. The invention patent with the publication number CN117770505A discloses an impurity removal detection method and device for an online tobacco recycling system, which uses traditional image processing methods to detect impurities in the recycled tobacco, and is assisted by a negative pressure device to remove the impurities.

[0004] However, using traditional image processing methods to identify debris may result in misidentification or failure to detect, and the detection effect of various types of debris is poor. Moreover, after the residual tobacco passes through the de-impurity equipment, a small amount of large cigarette paper pieces and heavy filter rod residues will still remain. At this time, using the above device to remove debris from the residual tobacco has certain limitations, which will affect the quality of the re-mixed tobacco. Summary of the invention

[0005] In view of the above-mentioned deficiencies, the present invention provides a detection and removal system for debris in residual tobacco based on visual detection, so as to achieve the removal of debris in residual tobacco, improve the purity of residual tobacco, and improve the quality of re-mixed tobacco.

[0006] The technical solution adopted by the present invention to solve the technical problem is: The system for detecting and removing debris from residual tobacco based on visual inspection includes: The vibrating spreading device comprises a spreading frame basket and a vibrator for providing kinetic energy therefor; it is used to receive the residual tobacco shreds delivered by the feeding device, and to make the residual tobacco shreds evenly spread through the pores of the spreading frame basket onto the unloading device through vibration; A feeding device, comprising a conveying belt, a feeding pipe and a feeding hopper which are arranged in sequence, wherein the feeding hopper is connected to a spreading frame basket; The debris recognition device includes an image acquisition camera and an image processing detection unit, wherein the image acquisition camera is used to acquire images of residual tobacco in the scattering process, and the image processing detection unit is used to detect debris in the image and the partition where the debris is located, and transmit the partition information to the debris removal device; The material discharge device comprises a plurality of regularly arranged material discharge areas and a lower discharge port, each material discharge area is provided with an openable and closable bottom to slide the residual tobacco shreds removed of impurities to the discharge port; The debris removal device includes a debris positioning camera, a debris image detection unit and a negative pressure suction device. The debris positioning camera is used to collect images when the debris removal device moves to the partition where the debris is located. The debris image detection unit is used to locate the debris in the collected image and transmit the debris coordinates and the suction path to the negative pressure suction device. The negative pressure suction device absorbs the debris through the negative pressure to achieve the purpose of debris removal.

[0007] As a further improvement, the conveyor belt is a transport device that transports the tobacco dropped from the spectral impurity removal equipment to the detection and rejection system, the feed pipe is a connecting device that connects the conveyor belt and the discharge funnel, and the discharge funnel is a device that allows the tobacco to fall smoothly into the scattering frame basket.

[0008] As a further improvement, the image acquisition camera includes several cameras arranged above the feeding device, which obtain images of the residual tobacco in the process of falling, and simultaneously stitch the images of each camera, and the stitched image covers all the feeding areas of the feeding device.

[0009] As a further improvement, the image acquisition camera includes four cameras arranged at the four corners above the unloading device.

[0010] As a further improvement, the image processing detection unit detects the collected (stitched) images through an embedded image processing algorithm. When filter rod fragments or cigarette paper fragments are detected, the material spreading frame basket stops vibrating and moves to the top of the next drop area. The image processing detection unit feeds back the drop area number of the debris to the debris removal device.

[0011] As a further improvement, the unloading device is used to receive the residual tobacco shreds scattered by the vibrating scattering device, and includes a nine-square grid-shaped unloading area. Each unloading area can control the opening and closing of the bottom unloading plate through compressed air, so that the residual tobacco shreds removed from the debris can slide to the discharge port.

[0012] As a further improvement, when the spreading time of the spreading frame basket above a certain drop-off area exceeds the set time and the debris identification device still fails to identify the debris, the vibrating spreading device stops vibrating and moves to the next drop-off area on its own, and at this time the drop-off plate of the drop-off area opens to allow the residual tobacco to slide off.

[0013] As a further improvement, when the vibrating spreading device moves to the next material drop area, the debris detected in the partition where the previous material drop area is located will be filtered out. When the debris removal device removes the debris, the partition image will be activated again for detection. When all partitions in the above process cannot be identified, the vibrating spreading device stops spreading material and the conveyor belt stops feeding, and then starts again after each partition is activated.

[0014] In order to solve the technical problem, the present invention also provides a method for detecting and removing debris in residual tobacco based on visual detection. The method collects and processes images of residual tobacco in the blanking process, establishes a debris and tobacco recognition method based on a segmentation model to identify the debris, and uses a debris removal device to remove the debris.

[0015] The method for detecting and removing impurities in residual tobacco based on visual inspection includes: S1, obtaining images of residual tobacco in the process of falling, and stitching the images of each camera; S2, cropping and removing the background of the stitched image according to the range of the blanking area below; S3, partition the image obtained in S2 in the order from left to right and from top to bottom, record them as nine partitions a~i, and mark a~i as 0 to indicate the activation state; S4, importing the image obtained in S3 into the trained segmentation model to segment the debris and tobacco in the image, and the background part and the debris part of the image after segmentation will be covered by masks of different colors; S5. When the segmentation model detects that there are debris in a certain material drop area, the material spreading frame basket stops vibrating and moves to the top of the next material drop area, derives the partition number of the material drop area, and changes its state number to 1 to indicate a closed state. The detection result is synchronously fed back to control the debris removal device to go to the area to remove debris. When the vibration material spreading device has been spreading for more than the set time and still no debris is detected, it automatically moves to the next material drop area. S6, after the debris removal device reaches the feedback partition, the image of the area is collected by the debris positioning camera; S7, using the segmentation model to detect the debris in the image obtained in S6, and at the same time obtain the coordinates of the center point of the minimum circumscribed rectangle of the debris, and optimize the elimination path of multiple debris in the manner of first the horizontal coordinate and then the vertical coordinate; S8. According to the rejection path, the negative pressure suction device moves to the center point of the debris to suck the debris. After the debris in the area is sucked, the state number of the area is changed to 0 to indicate the activated state; S9. After the removal is completed, the blanking plate below the blanking area automatically opens to allow the residual tobacco to slide off. After the residual tobacco has completely slid off, the blanking plate automatically closes; S10, repeat S4 to S9 until all the remaining tobacco is processed.

[0016] The beneficial effects brought by the present invention are: The vibrating spreading device of the present invention can make the spreading more uniform by adopting a large-aperture spreading frame basket to spread the material from the side, and at the same time assists the debris identification device to identify the debris of the residual smoke and tobacco mixture in the falling process, so as to detect the debris in time and accurately, and there will be no situation where the debris is covered and cannot be detected. By performing image acquisition, image stitching, image cropping and partitioning on the residual smoke and tobacco in the falling process, a debris and tobacco recognition method based on the segmentation model is established to identify and locate the debris, and the debris is accurately removed by the debris removal device, so as to achieve the purpose of improving the purity of the residual smoke and tobacco and improving the quality of the re-mixed tobacco. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0018] Figure 1 It is a schematic diagram of the three-dimensional structure of the system of the present invention; Figure 2 It is a front view of the system structure of the present invention; Figure 3 It is a side view of the system structure of the present invention; Figure 4 A schematic diagram of a vibrating material spreading device of the system of the present invention; Figure 5 It is a schematic diagram of the debris removal device of the system of the present invention.

[0019] Figure 6 It is a schematic diagram of the method flow of the present invention.

[0020] 1-vibrating material spreading device; 11-material spreading frame basket; 2-feeding device; 21-conveyor belt; 22-feeding pipe; 23-discharging funnel; 3-debris identification device; 31-image acquisition camera; 4-discharging device; 41-discharging area; 42-discharging plate; 5-debris removal device; 51-debris positioning camera; 52-negative pressure suction device. DETAILED DESCRIPTION

[0021] The following will be combined with the embodiments of the present invention and the accompanying drawings to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0022] The first embodiment of the present invention relates to a system for detecting and removing foreign matter in residual tobacco based on visual detection, referring to Figures 1 to 3 , including a vibrating material spreading device 1, a feeding device 2, a debris identifying device 3, a material unloading device 4 and a debris removing device 5.

[0023] Reference Figure 4 The vibrating spreading device 1 includes a spreading frame basket 11 and a vibrator for providing kinetic energy therefor, which is used to receive the residual tobacco delivered by the feeding device 2, and through vibration, the residual tobacco is evenly spread through the side pores around the large-aperture spreading frame basket 11 and fall onto the unloading device 4.

[0024] The feeding device 2 includes a conveyor belt 21, a feed pipe 22 and a discharge funnel 23 which are arranged in sequence, and the discharge funnel 23 is connected to the spreading frame basket 11; wherein, the conveyor belt 21 is a transport device for transporting the tobacco dropped by the spectral impurity removal equipment to the detection and rejection system, the feed pipe 22 is a connecting device connecting the conveyor belt 21 and the discharge funnel 23, and the discharge funnel 23 is a device for allowing the tobacco to smoothly drop into the spreading frame basket 11; when the system is turned on, the vibrating spreading device 1 and the debris removal device 5 can be moved to the top of the first drop area 41 in the upper left corner by means of a common chain drive, at which time the residual tobacco after one impurity removal falls onto the conveyor belt 21, and is transported to the feed port above the system through the conveyor belt 21, so that the residual tobacco slides through the feed pipe 22 into the spreading frame basket 11 below.

[0025] The debris identification device 3 includes an image acquisition camera 31 and an image processing detection unit. The image acquisition camera 31 is used to acquire images of residual tobacco in the scattering process. The image processing detection unit is used to detect debris in the image and the partition where the debris is located, and transmit the partition information to the debris removal device 5.

[0026] The material discharge device 4 comprises a plurality of regularly arranged material discharge areas 41 and a lower material discharge port. Each material discharge area 41 is provided with an openable and closable bottom to allow the residual tobacco shreds with impurities removed to slide to the conical material discharge port.

[0027] Reference Figure 5The debris removal device 5 includes a debris positioning camera 51, a debris image detection unit and a negative pressure suction device 52. The debris positioning camera 51 is used to collect images when the debris removal device 5 moves to the partition where the debris is located. The debris image detection unit is used to locate the debris in the collected image and transmit the debris coordinates and the suction path to the negative pressure suction device 52. The negative pressure suction device 52 absorbs the debris through the negative pressure to achieve the purpose of debris removal. After the debris is removed, the blanking plate 42 in the area is opened to allow the residual tobacco on it to slide to the collection area below, and the debris removal device 5 moves to the next blanking area 41 where debris needs to be removed.

[0028] As a preferred embodiment, the image acquisition camera 31 includes four cameras arranged above the feeding device 4, and the cameras obtain the full-area image of the residual tobacco in the process of falling, and simultaneously perform image stitching on the images of each camera, and the stitched image covers all directions and all feeding areas 41 of the feeding device 4. The image processing and detection unit detects the stitched image through the embedded image processing algorithm, and when the filter rod fragments or cigarette paper fragments are detected, the spreading frame basket 11 stops vibrating and moves to the top of the next feeding area 41, and the image processing and detection unit feeds back the number of the feeding area 41 where the debris is located to the debris removal device 5.

[0029] As a preferred embodiment, the unloading device 4 is used to receive the residual tobacco shreds scattered by the vibration spreading device 1, and includes nine dropping areas 41 in a 3×3 grid shape. Each dropping area 41 can control the opening and closing of the bottom dropping plate 42 through compressed air, so that the residual tobacco shreds removed from the debris can slide to the discharge port. When the spreading frame basket 11 above a certain dropping area 41 has been spreading for more than the set time, and the debris identification device 3 still does not identify the debris, the vibration spreading device 1 stops vibrating and moves to the next dropping area 41 by itself, and at this time the dropping plate 42 of the dropping area 41 opens to allow the residual tobacco shreds to slide.

[0030] When the vibrating spreading device 1 moves to the next material drop area 41, the debris detected in the partition where the previous material drop area 41 is located will be filtered out. After the debris removal device 5 removes the debris, the partition image will be activated again for detection. When all partitions in the above process cannot be identified, the vibrating spreading device 1 stops spreading materials, and the conveyor belt 21 stops feeding materials, and then starts to operate again after each partition is activated.

[0031] Another embodiment of the present invention relates to a method for detecting and removing debris in residual tobacco based on visual detection. The method collects and processes images of residual tobacco during the blanking process, establishes a debris and tobacco recognition method based on a segmentation model to identify the debris, and uses a debris removal device 5 to remove the debris.

[0032] Reference Figure 6 The method for detecting and removing foreign matter in residual tobacco based on visual detection includes: S1, obtaining images of residual tobacco in the process of falling, and stitching the images of each camera; S2. Since the spliced ​​image will contain a part of the background area, the spliced ​​image is cropped according to the overall range of the lower blanking area 41 to remove the image background outside the loading area; S3, partition the image obtained in S2 in the order from left to right and from top to bottom, record them as nine partitions a~i, and mark a~i as 0 to indicate the activation state; S4, importing the image obtained in S3 into the trained segmentation model to segment the debris and tobacco in the image, and the background part and the debris part of the image after segmentation will be covered by masks of different colors; Optionally, use the Labelme annotation tool to annotate the debris in the remaining tobacco at the pixel level, import it into the segmentation model for training, and establish the FCN segmentation model; S5. When the segmentation model detects that there are debris in a certain material drop zone 41, the material spreading frame basket 11 stops vibrating and moves to the top of the next material drop zone 41, derives the partition number of the material drop zone 41, and changes its state number to 1 to indicate a closed state. The detection result is synchronously fed back to control the debris removal device 5 to go to the area to remove debris. When the vibration material spreading device 1 has been spreading for more than the set time and still no debris is detected, it automatically moves to the next material drop zone 41. S6, after the debris removal device 5 reaches the feedback partition, the debris locating camera 51 collects images of the area; S7, using the segmentation model to detect the debris in the image obtained in S6, and at the same time obtain the coordinates of the center point of the minimum circumscribed rectangle of the debris, and optimize the elimination path of multiple debris in the manner of first the horizontal coordinate and then the vertical coordinate; S8. According to the rejection path, the negative pressure suction device 52 moves to the center point of the debris to suck the debris. After the debris in the area is sucked, the state number of the area is changed to 0 to indicate an activated state; S9, after the removal is completed, the blanking plate 42 below the blanking area 41 automatically opens to allow the residual tobacco to slide off, and after the residual tobacco has completely slid off, the blanking plate 42 automatically closes; S10, repeat S4 to S9 until all the remaining tobacco is processed.

[0033] The method further includes step S11, when the vibration spreading device 1 moves to the next drop zone 41, the debris detected in the partition where the previous drop zone 41 is located will be filtered out based on the partition state, that is, the debris image of the previous partition is not within the process range of the next partition debris image recognition process to avoid repeated detection of debris; when the debris removal device 5 removes the debris, the partition image will be activated again for detection. When all the partitions in the above process cannot be identified, the vibration spreading device 1 stops spreading the material, the conveyor belt 21 stops feeding, and each partition is activated and then operates again.

[0034] It should be noted that the above is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A system for detecting and removing foreign matter from residual tobacco based on visual detection, characterized in that: include A vibrating spreading device, comprising a spreading frame basket and a vibrator, for evenly spreading the residual tobacco shreds onto the feeding device through vibration; A feeding device, comprising a conveying belt, a feeding pipe and a feeding hopper which are arranged in sequence, wherein the feeding hopper is connected to a spreading frame basket; The debris recognition device includes an image acquisition camera and an image processing detection unit, wherein the image acquisition camera is used to acquire images of residual tobacco in the scattering process, and the image processing detection unit is used to detect debris in the image and the partition where the debris is located, and transmit the partition information to the debris removal device; The material discharge device comprises a plurality of regularly arranged discharge areas and discharge ports, each discharge area being provided with an openable and closable bottom so that the residual tobacco shreds removed from the impurities can slide to the discharge port; The debris removal device includes a debris positioning camera, a debris image detection unit and a negative pressure suction device. The debris positioning camera is used to collect images when the debris removal device moves to the partition where the debris is located. The debris image detection unit is used to locate the debris in the collected image and transmit the debris coordinates and the suction path to the negative pressure suction device. The negative pressure suction device absorbs the debris through the negative pressure to achieve the purpose of debris removal.

2. The detection and rejection system according to claim 1, characterized in that: The image acquisition camera includes several cameras arranged above the feeding device, which obtain images of residual tobacco in the process of falling, and simultaneously stitch the images of each camera, and the stitched image covers all the feeding areas of the feeding device.

3. The detection and rejection system according to claim 2, characterized in that: The image acquisition camera includes four cameras arranged at the four corners above the unloading device.

4. The detection and rejection system according to claim 1, characterized in that: The image processing detection unit detects the collected image through an embedded image processing algorithm. When debris is detected, the spreading frame basket stops vibrating and moves to the top of the next drop area. The image processing detection unit feeds back the drop area number where the debris is located to the debris removal device.

5. The detection and rejection system according to claim 1, characterized in that: The unloading device comprises a nine-grid-shaped unloading area, and each unloading area can control the opening and closing of the bottom unloading plate through compressed air, so that the residual tobacco shreds removed from the debris can slide to the discharge port.

6. The detection and rejection system according to claim 1 or 5, characterized in that: When the spreading time of the spreading frame basket above a certain drop zone exceeds the set time and the debris recognition device still fails to recognize the debris, the vibrating spreading device stops vibrating and moves to the next drop zone by itself, and at this time the drop plate of the drop zone opens to allow the residual tobacco to slide off.

7. The detection and rejection system according to claim 6, characterized in that: When the vibrating spreading device moves to the next material-dropping area, the debris detected in the partition where the previous material-dropping area is located will be filtered out. After the debris removal device removes the debris, the partition image will be activated again for detection. When all partitions in the above process cannot be identified, the vibrating spreading device stops spreading materials, and the conveyor belt stops feeding materials, and then starts to operate again after each partition is activated.

8. A method for detecting and removing foreign matter from residual tobacco based on visual detection, characterized in that: include S1, obtaining images of residual tobacco in the process of falling, and stitching the images of each camera; S2, cropping and removing the background of the stitched image according to the range of the blanking area below; S3, partition the image obtained in S2 in the order from left to right and from top to bottom, record them as nine partitions a~i, and mark a~i as 0 to indicate the activation state; S4, importing the image obtained in S3 into the trained segmentation model to segment the debris and tobacco in the image, and the background part and the debris part of the image after segmentation will be covered by masks of different colors; S5. When the segmentation model detects that there are debris in a certain material drop area, the spreading frame basket stops vibrating and moves to the top of the next material drop area, derives the partition number of the material drop area, and changes its state number to 1 to indicate a closed state. The detection result is synchronously fed back to control the debris removal device to go to the area to remove debris; S6, after the debris removal device reaches the feedback partition, the image of the area is collected by the debris positioning camera; S7, using the segmentation model to detect the debris in the image obtained in S6, and at the same time obtain the coordinates of the center point of the minimum circumscribed rectangle of the debris, and optimize the elimination path of multiple debris in the manner of first the horizontal coordinate and then the vertical coordinate; S8. According to the rejection path, the negative pressure suction device moves to the center point of the debris to absorb the debris. After the debris in the area is absorbed, the state number of the area is changed to 0 to indicate the activation state; S9. After the removal is completed, the blanking plate below the blanking area automatically opens to allow the residual tobacco to slide off. After the residual tobacco has completely slid off, the blanking plate automatically closes; S10, repeat S4 to S9 until all the remaining tobacco is processed.

9. The detection and elimination method according to claim 8, characterized in that: In S5, when the spreading time of the spreading frame basket above a certain drop zone exceeds the set time and the debris recognition device still fails to recognize the debris, the vibrating spreading device stops vibrating and moves to the next drop zone by itself, and at this time the drop plate of the drop zone opens to allow the residual tobacco to slide off.

10. The detection and elimination method according to claim 8, characterized in that: The method also includes S11, when the vibration spreading device moves to the next material drop area, the debris detected in the partition where the previous material drop area is located will be filtered out, and the partition image will be activated again for detection only after the debris removal device removes the debris. When all the partitions in the above process cannot be identified, the vibration spreading device stops spreading the material, the conveyor belt stops feeding, and then each partition is activated and then operates again.

Images