Book binding quality detection device
By designing a bookbinding quality inspection device, which utilizes machine vision to identify the image information of the binding staples, the automated inspection of bookbinding quality is achieved, solving the problems of low efficiency and poor accuracy of manual inspection, and improving inspection efficiency and accuracy.
Patent Information
- Application Number
- CN202520206753.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-10
- Publication Date
- 2026-01-23
- Estimated Expiration
- 2035-02-10
AI Technical Summary
In the existing technology, the quality inspection of this booklet mainly relies on human visual identification, which is inefficient, has high labor costs, and is prone to errors in judgment.
Design a bookbinding quality inspection device, including a conveying mechanism, an imaging mechanism, an inspection mechanism, and a rejection mechanism. The device uses machine vision to identify the image information of the binding staples, automatically judges the quality, and removes unqualified books, thus achieving automated inspection.
It improves testing efficiency and accuracy, saves labor costs, standardizes testing, and is suitable for automated testing of various booklet types.
Smart Images

Figure CN223819165U_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of book production equipment technology, and in particular to a book binding quality inspection device. Background Technology
[0002] Paper notebooks, also known as booklets, are typically bound with staples. During the binding process, staples may become crooked, deformed, or even missing. Poor binding can severely impact the user experience. Currently, in actual production and inspection, identification mainly relies on human eyes, which is inefficient, labor-intensive, and prone to causing eye fatigue and errors over extended periods. Utility Model Content
[0003] The purpose of this disclosure is to provide a bookbinding quality inspection device to save labor costs and improve the efficiency and accuracy of inspection.
[0004] To achieve the above objectives, this disclosure provides a bookbinding quality inspection device, comprising a conveying mechanism, an imaging mechanism, an inspection mechanism, and a rejection mechanism. The conveying mechanism is used to pass the bookbinding through the imaging mechanism and the rejection mechanism. The imaging mechanism is located on at least one side of the conveying mechanism and is used to acquire image information of the bookbinding, the image information including image information of the binding staples. The inspection mechanism is used to determine a quality inspection result based on the image information of the binding staples, wherein the quality inspection result is qualified or unqualified. The rejection mechanism is used to remove bookbindings with unqualified quality inspection results from the conveying mechanism.
[0005] In one embodiment of this disclosure, the booklet includes a first booklet and a second booklet, which are stacked along the thickness direction of the booklet. The binding staples of the first booklet and the binding staples of the second booklet are located on opposite sides of the width direction of the booklet. The imaging mechanism includes a first imaging mechanism and a second imaging mechanism. The first imaging mechanism is located on one side of the transmission mechanism and is used to acquire image information of the first booklet. The second imaging mechanism is located on the other side of the transmission mechanism and is used to acquire image information of the second booklet.
[0006] In one embodiment of this disclosure, at least one of the first imaging mechanism and the second imaging mechanism includes a camera and an adjustment mechanism. The camera is mounted on the adjustment mechanism and is used to acquire image information of the book. The adjustment mechanism can drive the camera to reciprocate relative to the book to adjust the distance between the camera and the side of the book where the binding staples are provided.
[0007] In one embodiment of this disclosure, the adjustment mechanism includes a base, a handle, and a mounting portion. The base is mounted on the frame of the conveying mechanism, the handle is mounted on the base, the handle extends toward the side of the booklet where the binding staples are provided, and the handle is provided with external threads; the camera is mounted on the mounting portion.
[0008] The base is provided with a first threaded hole that mates with the external thread. The handle is rotatably connected to the mounting part. The handle can reciprocate along its extension direction to drive the camera to reciprocate along the extension direction of the handle. Alternatively, the mounting part is provided with a second threaded hole that mates with the external thread. The handle can rotate relative to the base about its own axis so that the camera can reciprocate along the extension direction of the handle.
[0009] In one embodiment of this disclosure, the bookbinding quality inspection device further includes a first detection element connected to the imaging mechanism so that the imaging mechanism can acquire image information of the book.
[0010] In one embodiment of this disclosure, the rejection mechanism includes a pushing component, which includes a reciprocating drive mechanism and a pusher plate. The reciprocating drive mechanism is mounted on one side of the conveying mechanism, and the pusher plate is connected to the reciprocating drive mechanism. The reciprocating drive mechanism can drive the pusher plate to move towards the defective booklet, so as to remove the defective booklet from the conveying mechanism.
[0011] In one embodiment of this disclosure, the rejection mechanism further includes a guide mechanism, the guide mechanism including a guide rod extending along the width direction of the conveying mechanism, and the push plate being slidably connected to the guide rod.
[0012] In one embodiment of this disclosure, the rejection mechanism includes a vacuum adsorption device for adsorbing unqualified copies so that the unqualified copies leave the conveying mechanism.
[0013] In one embodiment of this disclosure, the bookbinding quality inspection device further includes a control device; the inspection mechanism includes an image processing unit, a target recognition unit, a result statistics unit, and a result transmission unit. The image processing unit is used to extract images of each target region to be inspected from the image information; the target recognition unit is used to process each target region image to be inspected using a target detection model to obtain the category information of each binding staple in each target region image to be inspected; the result statistics unit is used to determine the quality inspection result based on the category information of each binding staple in each target region image to be inspected and preset conditions; the result transmission unit is used to transmit the quality inspection result to the control device, and the control device is used to control the rejection mechanism to remove unqualified books from the conveying mechanism.
[0014] In one embodiment of this disclosure, the bookbinding quality inspection device further includes a second detection element connected to the control device to send a signal to the control device that the book has passed the rejection mechanism.
[0015] The main beneficial effects of this disclosure are:
[0016] The bookbinding quality inspection device disclosed herein transports the book via a conveying mechanism. When the book passes through an imaging mechanism, the imaging mechanism acquires image information of the book, including image information of the binding staples. The inspection mechanism determines the quality inspection result based on the image information of the binding staples, and the quality inspection result is either qualified or unqualified. When an unqualified book is transported by the conveying mechanism to a rejection mechanism, the rejection mechanism removes the book with the unqualified quality inspection result from the conveying mechanism, thereby realizing automated inspection of bookbinding quality, unified inspection standards, effectively improving inspection efficiency and accuracy, and saving labor costs. Attached Figure Description
[0017] To more clearly illustrate the technical solutions in the specific embodiments of this disclosure or the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.
[0018] Figure 1 A schematic diagram of the structure of the bookbinding quality inspection device provided in this embodiment of the disclosure;
[0019] Figure 2 A schematic diagram of the structure of the bookbinding quality inspection device provided in this embodiment of the disclosure (the display screen and mounting bracket are not shown);
[0020] Figure 3for Figure 2 A magnified view of a section at point A in the middle;
[0021] Figure 4 for Figure 2 A magnified view of a section at point B in the middle;
[0022] Figure 5 A top view of the bookbinding quality inspection device provided in this embodiment of the disclosure (the display screen and mounting bracket are not shown);
[0023] Figure 6 A front view of the bookbinding quality inspection device provided in this embodiment of the disclosure (neither the display screen nor the mounting bracket is shown);
[0024] Figure 7 This is a schematic diagram of image information acquired by the first imaging mechanism in an embodiment of this disclosure;
[0025] Figure 8 This is a schematic diagram of the target region image to be detected in an embodiment of this disclosure.
[0026] The annotations in the attached figures are explained as follows:
[0027] 1-Transfer mechanism; 21-First imaging mechanism; 211-Camera; 212-Base; 2121-First base plate; 2122-First side wall; 2123-Guide rail; 213-Handle; 2131-Insert section; 2132-First limiting part; 2133-Second limiting part; 2134-Anti-slip texture; 214-Mounting part; 2141-Second side wall; 2142-Second base plate; 215-Light source; 22-Second imaging mechanism; 3-Rejection mechanism; 31-Reciprocating drive mechanism; 32-Push plate; 33-Guide rod; 4-First detection element; 5-Second detection element; 6-Industrial control computer; 7-Display screen; 101-First booklet; 102-Second booklet; 200-Binding staple image. Detailed Implementation
[0028] The technical solutions of this disclosure will be clearly and completely described below with reference to the embodiments. Obviously, the described embodiments are only some embodiments of this disclosure, not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.
[0029] In the description of this disclosure, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing this disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this disclosure. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.
[0030] In the description of this disclosure, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "joining" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this disclosure based on the specific circumstances.
[0031] See Figures 1 to 8 As shown, this embodiment provides a bookbinding quality inspection device, including a conveying mechanism 1, an imaging mechanism, an inspection mechanism, and a rejection mechanism 3. The conveying mechanism 1 is used to pass the book through the imaging mechanism and the rejection mechanism 3. The imaging mechanism is located on at least one side of the conveying mechanism 1 and is used to collect image information of the book, including image information of the binding staples. The inspection mechanism is used to determine the quality inspection result based on the image information of the binding staples, wherein the quality inspection result is qualified or unqualified. The rejection mechanism 3 is used to remove the book with the unqualified quality inspection result from the conveying mechanism 1.
[0032] The bookbinding quality inspection device provided in this embodiment transports the book via a conveying mechanism 1. When the book passes through an imaging mechanism, the imaging mechanism acquires image information of the book, including image information of the binding staples. The inspection mechanism determines the quality inspection result based on the image information of the binding staples, and the quality inspection result is either qualified or unqualified. When an unqualified book is transported by the conveying mechanism 1 to the rejection mechanism 3, the rejection mechanism 3 removes the book with the unqualified quality inspection result from the conveying mechanism 1, thereby realizing automated inspection of bookbinding quality, unified inspection standards, effectively improving the efficiency and accuracy of inspection, and saving labor costs.
[0033] It should be noted that, although Figure 2 This booklet is shown in the diagram, but the structure of the booklet binding quality inspection device provided in this embodiment does not include this booklet.
[0034] In some embodiments, the conveying mechanism 1 may be a belt conveyor. Of course, the conveying mechanism 1 may also be a roller conveyor. For example, see [link to example]. Figure 1 As shown, the conveying direction of the conveying mechanism 1 is indicated by the arrow direction X.
[0035] It should be understood that the number of volumes can be one or more, and each volume contains at least one binding staple. Typically, the binding staple is installed on one side of the volume's length. When there are multiple binding staples, they are spaced apart along the length of the volume. When there are multiple volumes, they are stacked along their thickness. In this case, the binding staples on the side of all volumes can be on the same side or on opposite sides. For example, some volumes may have their binding staples on one side, while others may have their binding staples on the other side.
[0036] For example, in this embodiment, there are ten books, of which five books have the binding side on one side and the binding side of the other five books has the binding side on the other side.
[0037] In one embodiment, the booklet includes a first booklet 101 and a second booklet 102, which are stacked along the thickness direction of the booklet. The binding staples of the first booklet and the binding staples of the second booklet are located on opposite sides of the width direction of the booklet. The imaging mechanism includes a first imaging mechanism 21 and a second imaging mechanism 22. The first imaging mechanism 21 is located on one side of the transmission mechanism 1 and is used to acquire image information of the first booklet 101. The second imaging mechanism 22 is located on the other side of the transmission mechanism 1 and is used to acquire image information of the second booklet 102.
[0038] For example, see Figure 7 As shown, the first volume contains five copies, and the second volume contains five copies. The binding of the first volume is located in the direction of the volume's movement (within the direction of travel). Figure 2 The arrow X in the diagram indicates the left side, and the binding staple of the second book is located on the right side of the book's running direction. The book's running direction is consistent with the conveying direction of conveyor mechanism 1.
[0039] Accordingly, the first imaging mechanism 21 is located on the left side of the running direction of the conveying mechanism 1, and is used to acquire image information of the first booklet in order to obtain image information of the binding staples of the first booklet; the second imaging mechanism 22 is located on the right side of the running direction of the conveying mechanism 1, and is used to acquire image information of the second booklet in order to obtain image information of the binding staples of the second booklet.
[0040] The image information of the staples includes whether the staples are present or missing. When the image information of the staples indicates that the staples are present, it includes, but is not limited to, whether the staples are qualified, deformed, or crooked.
[0041] Of course, there can be at least one first volume and one second volume. The number of first volumes and second volumes can be the same or different.
[0042] In one embodiment, at least one of the first imaging mechanism 21 and the second imaging mechanism 22 includes a camera 211 and an adjustment mechanism. The camera 211 is mounted on the adjustment mechanism and is used to acquire image information of the book. The adjustment mechanism can drive the camera 211 to reciprocate relative to the book to adjust the distance between the camera 211 and the side of the book where the binding staples are provided.
[0043] Taking the first imaging mechanism 21 as an example, see Figure 3 As shown, the first imaging mechanism 21 includes a camera 211 and an adjustment mechanism. The camera 211 is mounted on the adjustment mechanism. The camera 211 is used to acquire image information of the book. The adjustment mechanism can drive the camera 211 to reciprocate relative to the book in order to adjust the distance between the camera 211 and the side of the book where the binding staples are provided.
[0044] Since there are various types of booklets, and the width of different types of booklets may be different, when the position of the camera 211 remains unchanged, the distance between the binding staples of wider booklets and the camera 211 is closer, while the distance between the binding staples of narrower booklets and the camera 211 is farther. In order to ensure that the camera 211 can clearly capture image information of booklets of different widths, in this embodiment, the camera 211 is mounted on an adjustment mechanism. The adjustment mechanism drives the camera 211 to reciprocate relative to the booklet to adjust the distance between the camera 211 and the side of the booklet with binding staples, so as to ensure that the lens of the camera 211 can clearly capture image information of the binding staples.
[0045] In one possible design, see Figure 3 As shown, the adjustment mechanism includes a base 212, a handle 213, and a mounting part 214. The base 212 is mounted on the frame of the conveying mechanism 1, and the handle 213 is mounted on the base 212. The extension direction of the handle 213 faces the side of the book where the binding staple is provided, and the handle 213 is provided with external threads. The camera 211 is mounted on the mounting part 214. The base 212 is provided with a first threaded hole that mates with the external threads. The handle 213 is rotatably connected to the mounting part 214, and the handle 213 can reciprocate along its extension direction to drive the camera 211 to reciprocate along the extension direction of the handle 213.
[0046] Specifically, the base 212 includes a first base plate 2121 and a first side wall 2122. The first base plate 2121 is mounted on the frame of the conveying mechanism 1. The first side wall 2122 is fixedly connected to one end of the first base plate 2121. The fixed connection can be, but is not limited to, welding or connection by fasteners (bolts and nuts). A first threaded hole is provided in the first side wall 2122. A handle 213 passes through the first side wall 2122, and the external thread of the handle 213 mates with the first threaded hole. The mounting part 214 includes a second sidewall 2141 with a groove. An insertion section 2131 is provided at one end of the handle 213 near the camera 211. A first limiting part 2132 and a second limiting part 2133 are provided at both ends of the insertion section 2131. The first limiting part 2132 and the second limiting part 2133 are located on both sides of the second sidewall 2141 so that the insertion section 2131 is limited to the groove, ensuring that the insertion section 2131 can only rotate relative to the mounting part 214. In the extending direction of the handle 213, the insertion section 2131 is fixed relative to the mounting part 214. For example, when the handle 213 is rotated in a first direction (e.g., clockwise), the handle 213 can move towards the book in its extending direction. At this time, the first limiting part 2132 pushes against the second side wall 2141 to drive the mounting part 214 and the camera 211 to move together towards the book. When the handle 213 is rotated in a second direction (e.g., counterclockwise), the handle 213 can move away from the book in its extending direction. At this time, the second limiting part 2133 abuts against the surface of the second side wall 2141 near the book to drive the mounting part 214 and the camera 211 to move together away from the book.
[0047] For example, the end of the handle 213 away from the mounting part 214 is provided with anti-slip texture 2134 to increase friction and facilitate rotation of the handle.
[0048] For example, see Figure 3 As shown, the base 212 is provided with a guide rail 2123, and the mounting part 214 also includes a second base plate 2142. The second base plate 2142 is fixedly connected to the second side wall 2141. The surface of the second base plate 2142 away from the second side wall 2141 is provided with a sliding groove. The sliding groove is slidably connected to the guide rail 2123 to improve the stability of the camera 211 during movement.
[0049] In another possible design, a second threaded hole can be provided in the mounting part 214, which engages with the external thread, allowing the handle 213 to rotate relative to the base 212 about its own axis, so that the camera 211 can reciprocate along the extension direction of the handle 213.
[0050] In one embodiment, the first imaging mechanism 21 may further include a light source 215. The lens of the camera 211 is mounted at the light inlet. The light source 215 can be any suitable type of light source, and the number of light sources 215 is not limited. In this embodiment, a strip light source 215 is used. The strip light source 215 can be adjusted forward, backward, left, right, up, and down by the light source 215 bracket to ensure that the camera 211 can capture a clear image. In this embodiment, since it is dynamic detection, a global camera can be used for the camera 211. Of course, other types of industrial cameras can also be used.
[0051] In this embodiment, the structure of the second imaging mechanism 22 is the same as that of the first imaging mechanism 21, and will not be described again here.
[0052] It should be noted that the structure of the second imaging mechanism 22 may also be different from that of the first imaging mechanism 21.
[0053] It should be understood that the number of copies can be one, or two or more, and the binding staples of each copy are located on one side of the copy's width. In both of these cases, only one imaging mechanism can be used, which is basically the same in structure as the aforementioned first imaging mechanism 21, and will not be described again here. In this case, the number of imaging mechanisms can be one, and it is located on one side of the conveying mechanism 1. When the conveying mechanism 1 transports the copy, the side of the copy containing the binding staples faces the imaging mechanism.
[0054] In one embodiment, see Figure 5 and Figure 6 As shown, the binding quality inspection device also includes a first detection element 4, which is connected to the imaging mechanism so that the imaging mechanism can acquire image information of the book.
[0055] When the conveying mechanism 1 carries the book past the imaging mechanism, it triggers the first detection element 4. When the camera 211 receives the signal emitted by the first detection element 4, it can collect the image information of the book.
[0056] For example, the first detection element 4 can be a proximity switch.
[0057] The specific structure of the rejection mechanism 3 will be introduced below. There are various structural forms of the rejection mechanism 3.
[0058] In one embodiment, see Figure 1 and Figure 4As shown, the rejection mechanism 3 includes a pushing component, which includes a reciprocating drive mechanism 31 and a pusher plate 32. The reciprocating drive mechanism 31 is installed on one side of the conveying mechanism 1, and the pusher plate 32 is connected to the reciprocating drive mechanism 31. The reciprocating drive mechanism 31 can drive the pusher plate 32 to move towards the defective booklet, so as to remove the defective booklet from the conveying mechanism 1.
[0059] For example, the reciprocating drive mechanism 31 can be a cylinder, with the cylinder body mounted on the frame. A push plate 32 is connected to the piston rod of the cylinder. For instance, the push plate 32 is fixedly connected to the piston rod of the cylinder by fasteners, which may include bolts and nuts. The piston rod of the cylinder drives the push plate 32 to move towards the defective booklet, thereby removing the defective booklet from the conveying mechanism 1 via the push plate 32. After removing the defective booklet from the conveying mechanism 1, the piston rod retracts.
[0060] Of course, the reciprocating drive mechanism 31 is not limited to a cylinder. For example, the reciprocating drive mechanism 31 can also be an electric push rod or a linear guide 2123.
[0061] In some embodiments, see Figure 4 As shown, the rejection mechanism 3 also includes a guiding mechanism, which includes a guide rod 33 that extends along the width direction of the conveying mechanism 1, and the push plate 32 is slidably connected to the guide rod 33.
[0062] The guide rod 33 is installed above the conveying mechanism 1. The distance between the guide rod 33 and the conveying surface of the conveying mechanism 1 should ensure that the book to be tested can pass through smoothly.
[0063] For example, there can be multiple guide rods 33, which are arranged in parallel and spaced apart. The push plate 32 is provided with a through hole, and the guide rods 33 pass through the through hole. When the piston rod of the cylinder drives the push plate 32 to move, the guide rods 33 can play a guiding role to ensure the smoothness of the push plate 32's movement.
[0064] In other embodiments, the rejection mechanism 3 may also include a vacuum adsorption device for adsorbing unqualified copies so that the unqualified copies leave the conveying mechanism 1.
[0065] For example, the vacuum adsorption device includes a vacuum pump and a suction cup. The suction port of the vacuum pump is connected to the suction cup through a pipeline. The suction cup can adsorb onto the upper surface of the defective booklet to remove the defective booklet from the conveying mechanism 1.
[0066] In one embodiment, the bookbinding quality inspection device further includes a control device; the inspection mechanism includes an image processing unit, a target recognition unit, a result statistics unit, and a result transmission unit. The image processing unit is used to extract images of each target area to be inspected from image information; the target recognition unit is used to process the images of each target area to be inspected through a target detection model to obtain the category information of each binding staple in each target area image; the result statistics unit is used to determine the quality inspection result based on the category information of each binding staple in each target area image and preset conditions; the result transmission unit is used to transmit the quality inspection result to the control device, and the control device is used to control the rejection mechanism 3 to remove unqualified bookbindings from the conveying mechanism 1.
[0067] For example, the image processing unit adjusts the brightness and contrast of the image information acquired by the imaging mechanism to make the image features more obvious, and then performs image cropping and segmentation to extract the image of the target region to be detected. Taking the first imaging mechanism 21 as an example, the image information acquired by the first imaging mechanism 21 is as follows: Figure 7 As shown, within the field of view, the five books with visible binding staples are all first books 101, and the five books above the first books 101 are all second books 102. Each first book and second book contains two binding staples, and within the field of view, two rows of binding staples can be seen arranged along the stacking direction of the first books.
[0068] In this embodiment, the `cv2.addWeighted()` function from the Python standard library OpenCV can be used to perform weighted fusion of image information, thereby adjusting the brightness and contrast of the image. Then, through matrix slicing, the target regions containing the left and right columns of staples are extracted from the original image; that is, each target region contains one column of staples image. See [link to documentation]. Figure 8 As shown, each target area to be detected contains five staple images 200, and the five staple images 200 are arranged in a row along the stacking direction of the book.
[0069] For example, the parameters within parentheses of the `cv2.addWeighted()` function can include `src1`, `alpha`, `src2`, `beta`, and `gamma`. Here, `src1` is the first input image (e.g., the original image); `alpha` is the weight of the first image, used to control contrast, and is usually a floating value; the larger the value, the higher the contrast; `src2` is the second input image; `beta` is the weight of the second image (usually 0); and `gamma` is a brightness adjustment value used to brighten or darken the image. It should be noted that the `cv2.addWeighted()` function is existing technology and will not be described in detail here.
[0070] In this embodiment, the target recognition unit can identify staples using a deep learning target detection algorithm. For example, the single-stage target detection model PPYOLO can be used as a baseline for model training.
[0071] During model training, labeled image data is used for training. By adjusting the model's parameters, the model can accurately locate and classify target regions in the image.
[0072] It should be noted that the preset training stop conditions can be selected based on actual production needs and actual production quality inspection standards.
[0073] It should also be noted that the principle and implementation method of adjusting the model parameters of the initial model and performing iterative training are well known and easy to implement by those skilled in the art, and will not be described in detail in this embodiment.
[0074] For unqualified booklets, the category label for the binding staples includes at least one of skewed, deformed, and missing staples. In other words, this embodiment can only label unqualified items when training the target detection model.
[0075] It should be understood that when the category label of the staple is missing, there will be no skewing or deformation at the same time. When the category label of the staple is skewed, deformation may occur at the same time. When the staple is deformed, skewing may also occur at the same time. Of course, it is also possible to train the system to label only the category labels with obvious defects. For example, when the staple is severely skewed, the corresponding category label of the staple is skewed, and deformation can be disregarded in this case.
[0076] After training the object detection model, the model is used to process the images of each target region to obtain the category information of each staple in each target region image. For example, the category information of the staple is either qualified or defective. When the category information of the staple is defective, the defect type includes at least one of skew, deformation, and missing.
[0077] It should be understood that when a staple is missing, there will be no shape or deformation at the same time; when a staple is crooked, there may be deformation at the same time; and when a staple is deformed, there may be crookedness at the same time.
[0078] The result statistics unit is used to determine the quality inspection result based on the category information of each binding staple in the image of each target area to be inspected and preset conditions. Specifically, the number of books to be inspected and the position of the binding staples in the books to be inspected can be determined first. The bookbinding quality inspection device also includes an industrial control computer 6, which judges the binding quality of the books to be inspected in real time through its built-in program and sends the quality inspection result to the control device. For example, the model of the industrial control computer 6 can be RK-620 / M45 / I7-8700CPU / 3070TI.
[0079] When there is at least one booklet to be tested, and the binding staples of each booklet to be tested are located on one side of the width direction of the booklet, if the number of binding staple images 200 in each target area image to be tested is equal to the number of booklets to be tested, and the category information of all binding staples is qualified, then the quality inspection result is that the booklet to be tested is qualified; otherwise, the quality inspection result is that the booklet to be tested is unqualified.
[0080] The following example illustrates the situation with five books to be tested, each containing two binding staples.
[0081] Specifically, five books to be tested are stacked along their thickness direction, and all the binding staples of the five books are located on the same side of the width direction. There are two images of the target area to be inspected. If the number of binding staple images in each target area image is five, and the category information of all binding staples is qualified, then the quality inspection result is that the book to be tested is qualified.
[0082] If at least one of the target area images contains more than five staple images, and / or at least one staple has a defective category (e.g., skew, deformation, and missing), the quality inspection result is that the booklet to be inspected is a non-conforming booklet.
[0083] When the book to be tested includes a first book and a second book, and the first book and the second book are stacked along the thickness direction of the book, with the binding staples of the first book and the binding staples of the second book located on opposite sides of the width direction of the book, if the number of binding staple images in each target area image of the first book is equal to the number in the first book, and the number of binding staple images in each target area image of the second book is equal to the number in the second book, and all binding staple category information is qualified, then the quality inspection result is that the book to be tested is qualified; otherwise, the quality inspection result is that the book to be tested is unqualified.
[0084] The following example illustrates this, with each of the first and second volumes containing five copies and two binding staples.
[0085] Specifically, see Figure 7 As shown, five first booklets 101 and five second booklets 102 are stacked along the thickness direction of the booklet to be tested, with the five second booklets 102 positioned above the five first booklets 101. The binding staples of the first booklets and the binding staples of the second booklets are located on opposite sides of the width direction of the booklet to be tested. At this time, there are four images of the target area to be detected: a first target area image, a second target area image, a third target area image, and a fourth target area image. The first and second target area images each contain two rows of binding staples from the first booklet, and the third and fourth target area images each contain two rows of binding staples from the second booklet. For example, Figure 7 The image shown can be of the first target region to be detected.
[0086] If the number of staple images in the first target area image and the number of staple images in the second target area image are both equal to the number of the first booklet, and the number of staple images in the third target area image and the number of staple images in the fourth target area image are both equal to the number of the second booklet, and all staple category information is qualified, then the quality inspection result is that the booklet to be tested is a qualified booklet.
[0087] If at least one of the number of staple images in the first target area image and the second target area image is not equal to the number of the first booklet, and / or at least one of the number of staple images in the third target area image and the fourth target area image is not equal to the number of the second booklet, and / or at least one staple has a defective category (e.g., skewed, deformed, or missing), then the quality inspection result is that the booklet to be inspected is a non-conforming booklet.
[0088] The result transmission unit transmits the quality inspection results to the control device, which controls the rejection mechanism 3 to remove unqualified copies from the conveying mechanism 1. For example, the result transmission unit packages the quality inspection results in binary form (e.g., 1 for good products and 0 for defective products) and sends it to the control device. The transmission method of the result transmission unit can be serial communication, network communication (such as Socket communication), or other standard communication protocols. The specific choice depends on factors such as application requirements, transmission distance, and data rate; this embodiment does not limit this.
[0089] In one embodiment, see Figure 5 and Figure 6 As shown, the bookbinding quality inspection device also includes a second inspection element 5, which is connected to the control device to send a signal to the control device that the book has passed the rejection mechanism 3.
[0090] When the booklet passes through the second detection element 5, the second detection element 5 sends a signal to the control device. If the control device receives a judgment result of a defective booklet from the detection unit, the control device controls the rejection mechanism 3 to reject the defective booklet, while the qualified booklet continues to flow to the next production line.
[0091] For example, the second detection element 5 can be a proximity switch.
[0092] In this embodiment, the control device can be a PLC controller, such as the Omron CP1E-N30.
[0093] In one embodiment, see Figure 1 As shown, the binding quality inspection device also includes a display screen 7, which is mounted on the frame of the conveying mechanism 1 via a mounting bracket. The display screen 7 displays images acquired by the imaging mechanism, the analyzed inspection results, and statistical production data in real time, facilitating real-time monitoring and improvement of the production process and enhancing product quality.
[0094] In summary, the bookbinding quality inspection device provided in this embodiment is an online automated inspection device for bookbinding quality based on machine vision recognition. The entire inspection process does not affect the operation of the original book production equipment, has low modification costs, and a high degree of automation. Compared with manual inspection methods, the bookbinding quality inspection device provided in this embodiment has higher inspection efficiency and more accurate inspection results.
[0095] It should be understood that when the number of books to be tested is small (e.g., one book), defects such as missing binding staples are relatively easy to detect and can be detected by visual inspection. However, when defects such as skewed or deformed binding staples are involved, or when the number of books to be tested is large, visual inspection is prone to low accuracy. Therefore, the book binding quality inspection device provided in this embodiment is not only suitable for detecting defects such as missing binding staples, but also particularly suitable for detecting defects such as skewed or deformed binding staples that are not easily detected by the human eye. This can improve production efficiency and facilitate widespread application.
[0096] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this disclosure, and are not intended to limit them. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this disclosure.
Claims
1. A device for detecting the binding quality of a booklet, characterized in that, The system includes a conveying mechanism, an imaging mechanism, a detection mechanism, and a rejection mechanism. The conveying mechanism is used to pass the booklet through the imaging mechanism and the rejection mechanism. The imaging mechanism is located on at least one side of the conveying mechanism and is used to acquire image information of the booklet, including image information of the binding staples. The detection mechanism is used to determine a quality inspection result based on the image information of the binding staples, wherein the quality inspection result is qualified or unqualified. The rejection mechanism is used to remove booklets with unqualified quality inspection results from the conveying mechanism.
2. The bookbinding quality inspection device according to claim 1, characterized in that, The booklet includes a first booklet and a second booklet, which are stacked along the thickness direction of the booklet. The binding staples of the first booklet and the binding staples of the second booklet are located on opposite sides of the width direction of the booklet. The imaging mechanism includes a first imaging mechanism and a second imaging mechanism. The first imaging mechanism is located on one side of the transmission mechanism and is used to acquire image information of the first booklet. The second imaging mechanism is located on the other side of the transmission mechanism and is used to acquire image information of the second booklet.
3. The bookbinding quality inspection device according to claim 2, characterized in that, At least one of the first imaging mechanism and the second imaging mechanism includes a camera and an adjustment mechanism. The camera is mounted on the adjustment mechanism and is used to acquire image information of the book. The adjustment mechanism can drive the camera to reciprocate relative to the book to adjust the distance between the camera and the side of the book where the binding staples are provided.
4. The bookbinding quality inspection device according to claim 3, characterized in that, The adjustment mechanism includes a base, a handle, and a mounting part. The base is mounted on the frame of the conveying mechanism, the handle is mounted on the base, the extension direction of the handle is toward the side of the booklet where the binding staples are provided, and the handle is provided with external threads; the camera is mounted on the mounting part. The base is provided with a first threaded hole that mates with the external thread. The handle is rotatably connected to the mounting part. The handle can reciprocate along its extension direction to drive the camera to reciprocate along the extension direction of the handle. Alternatively, the mounting part is provided with a second threaded hole that mates with the external thread. The handle can rotate relative to the base about its own axis so that the camera can reciprocate along the extension direction of the handle.
5. The bookbinding quality inspection device according to claim 1, characterized in that, It also includes a first detection element, which is connected to the imaging mechanism to enable the imaging mechanism to acquire image information of the book.
6. The bookbinding quality inspection device according to claim 1, characterized in that, The rejection mechanism includes a pushing component, which includes a reciprocating drive mechanism and a pusher plate. The reciprocating drive mechanism is installed on one side of the conveying mechanism, and the pusher plate is connected to the reciprocating drive mechanism. The reciprocating drive mechanism can drive the pusher plate to move towards the defective booklet, so as to remove the defective booklet from the conveying mechanism.
7. The bookbinding quality inspection device according to claim 6, characterized in that, The rejection mechanism further includes a guiding mechanism, which includes a guide rod that extends along the width direction of the conveying mechanism, and the push plate is slidably connected to the guide rod.
8. The bookbinding quality inspection device according to claim 1, characterized in that, The rejection mechanism includes a vacuum adsorption device, which is used to adsorb unqualified copies so that the unqualified copies leave the conveying mechanism.
9. The bookbinding quality inspection device according to any one of claims 1 to 8, characterized in that, It also includes a control device; the detection mechanism includes an image processing unit, a target recognition unit, a result statistics unit, and a result transmission unit, wherein the image processing unit is used to extract images of each target region to be detected from the image information; The target recognition unit is used to process the images of each target region to be detected using a target detection model to obtain the category information of each binding staple in each target region image to be detected; the result statistics unit is used to determine the quality detection result based on the category information of each binding staple in each target region image to be detected and preset conditions; the result transmission unit is used to transmit the quality detection result to the control device, and the control device is used to control the rejection mechanism to remove the unqualified booklets from the conveying mechanism.
10. The bookbinding quality inspection device according to claim 9, characterized in that, It also includes a second detection element, which is connected to the control device to send a signal to the control device that the book has passed through the rejection mechanism.