Book binding quality detection device and detection method

Abstract

The invention relates to the technical field of book production equipment, in particular to a book binding quality detection device and method. The book binding quality detection device comprises a conveying mechanism, an imaging mechanism, a detection mechanism and a rejection mechanism, wherein the conveying mechanism is used for enabling a book to pass through the imaging mechanism and the rejection mechanism; the imaging mechanism is located on at least one side of the conveying mechanism and used for collecting image information of the book, and the image information comprises image information of the binding nails; the detection mechanism is used for determining a quality detection result according to the image information of the staples, the quality detection result is qualified or unqualified, and the rejecting mechanism is used for moving the staples with the unqualified quality detection result out of the conveying mechanism, so that the automatic detection of the stapling quality of the staples is realized, the detection standard is unified, and the detection efficiency is improved. The detection efficiency and accuracy are effectively improved, and the labor cost is saved.

Description

Technical Field

[0001] The present invention relates to the technical field of book production equipment, and in particular to a book binding quality detection device and a detection method. Background Art

[0002] Paper notebooks, also known as books, are usually bound with staples. During the binding process, the staples may be skewed, deformed, or even missing. Poor binding of the book will seriously affect the consumer experience. At present, in the actual production and testing process, recognition mainly relies on human eyes, which has low recognition efficiency and high labor costs. In addition, long-term recognition can easily cause eye fatigue, leading to misjudgment. Summary of the invention

[0003] The purpose of the present invention is to provide a bookbinding quality inspection device and inspection method to save labor costs and improve inspection efficiency and accuracy.

[0004] Based on the above-mentioned purpose, the present disclosure provides a binding quality inspection device for this book, including a conveying mechanism, an imaging mechanism, a detection mechanism and a rejection mechanism, wherein the conveying mechanism is used to allow the book to pass through the imaging mechanism and the rejection mechanism; the imaging mechanism is located on at least one side of the conveying mechanism, and is used to collect image information of the book, wherein the image information includes image information of binding nails; the detection mechanism is used to determine a quality inspection result based on the image information of the binding nails, wherein the quality inspection result is qualified or unqualified, and the rejection mechanism is used to move the book with an unqualified quality inspection result out of the conveying mechanism.

[0005] In one embodiment of the present disclosure, the book includes a first book and a second book, the first book and the second book are stacked along the thickness direction of the book, the binding nails of the first book and the binding nails of the second book are respectively located on both sides of the width direction of the book, and the imaging mechanism includes a first imaging mechanism and a second imaging mechanism, the first imaging mechanism is located on one side of the conveying mechanism, and is used to collect image information of the first book, and the second imaging mechanism is located on the other side of the conveying mechanism, and is used to collect image information of the second book.

[0006] In one embodiment of the present disclosure, at least one of the first imaging mechanism and the second imaging mechanism includes a camera and an adjustment mechanism, wherein the camera is installed on the adjustment mechanism, and the camera is used to collect image information of the book. The adjustment mechanism can drive the camera to reciprocate relative to the book to adjust the distance between the camera and a side of the book where a binding is provided.

[0007] In one embodiment of the present disclosure, the adjustment mechanism includes a base, a handle and a mounting portion, the base is mounted on the frame of the transmission mechanism, the handle is mounted on the base, the extension direction of the handle is toward the side of the book where the binding nail is provided, and the handle is provided with an external thread; the camera is mounted on the mounting portion;

[0008] The base is provided with a first threaded hole matching with the external thread, the handle is rotatably connected to the mounting portion, and the handle can reciprocate along its extension direction to drive the camera to reciprocate along the extension direction of the handle; or, the mounting portion is provided with a second threaded hole matching with the external thread, and the handle can rotate around its own axis relative to the base, so that the camera can reciprocate along the extension direction of the handle.

[0009] In one embodiment of the present disclosure, the book binding quality detection device further includes a first detection element, and the first detection element is connected to the imaging mechanism so that the imaging mechanism collects image information of the book.

[0010] In one embodiment of the present disclosure, the rejection mechanism includes a pushing assembly, which includes a reciprocating drive mechanism and a push plate. The reciprocating drive mechanism is installed on one side of the conveying mechanism, and the push plate is connected to the reciprocating drive mechanism. The reciprocating drive mechanism can drive the push plate to move in a direction close to the unqualified book to move the unqualified book out of the conveying mechanism.

[0011] In one embodiment of the present disclosure, the rejection mechanism further includes a guide mechanism, the guide mechanism includes a guide rod, the guide rod extends along the width direction of the conveying mechanism, and the push plate is slidably connected to the guide rod.

[0012] In one embodiment of the present disclosure, the rejection mechanism includes a vacuum adsorption device, and the vacuum adsorption device is used to adsorb unqualified books so that the unqualified books leave the conveying mechanism.

[0013] In one embodiment of the present disclosure, the binding quality inspection device for this book also includes a control device; the inspection mechanism includes an image processing unit, a target recognition unit, a result statistics unit and a result transmission unit, the image processing unit is used to extract each target area image to be detected from the image information; the target recognition unit is used to process each of the target area images to be detected through a target detection model to obtain the category information of each binding staple in each of the target area images to be detected; the result statistics unit is used to determine the quality inspection result according to the category information of each binding staple in each of the target area images to be detected and preset conditions; the result transmission unit is used to transmit the quality inspection result to the control device, and the control device is used to control the rejection mechanism to move unqualified books out of the conveying mechanism.

[0014] In one embodiment of the present disclosure, the book binding quality detection device further includes a second detection element, and the second detection element is connected to the control device to send a signal to the control device indicating that the book has passed through the rejection mechanism.

[0015] Based on the above purpose, the present disclosure also provides a binding quality detection method, including:

[0016] Acquire image information of the book to be tested, wherein the image information includes at least one image of a region to be tested, and each image of the region to be tested includes at least one image of a binding nail;

[0017] Extracting each of the to-be-detected area images from the image information to form an to-be-detected target area image;

[0018] Processing each of the target area images to be detected by using a target detection model to obtain category information of each binding staple in each of the target area images to be detected;

[0019] Determining a quality inspection result according to category information and preset conditions of each binding staple in each of the target area images to be inspected;

[0020] The quality inspection result is transmitted to a control device; the control device is used to control a rejection mechanism to perform corresponding operations according to the quality inspection result.

[0021] In one embodiment of the present disclosure, the category information of the binding staples is qualified or defective. When the category information of the binding staples is defective, the defect type includes at least one of skew, deformation and missing.

[0022] In one embodiment of the present disclosure, extracting each of the to-be-detected area images from the image information to form a to-be-detected target area image includes:

[0023] Performing image enhancement processing on the image information;

[0024] The image information is cut and segmented to extract each target area image to be detected, wherein the target area image to be detected includes a row of binding nail images arranged along the thickness direction of the book.

[0025] In one embodiment of the present disclosure, the target detection model is trained in the following manner:

[0026] Obtain the historical image information of the sample and the corresponding category label of the binding;

[0027] Training an initial model according to the historical image information and the corresponding category labels of the binding staples;

[0028] If the preset training stop condition is met, the initial model is used as the target detection model;

[0029] If the preset training stop condition is not met, the model parameters of the initial model are adjusted and the training is iterated until the preset training stop condition is met.

[0030] In one embodiment of the present disclosure, in obtaining the historical image information of the sample of this book and the corresponding category label of the binding nail, the historical graphic information obtained is the image information of the unqualified sample, and the corresponding category label of the binding nail includes at least one of skew, deformation and missing.

[0031] In one embodiment of the present disclosure, determining the quality inspection result according to the category information and preset conditions of each binding staple in each of the target area images to be inspected includes:

[0032] Determine the number of books to be tested and the positions of the bindings of the books to be tested;

[0033] When the number of the books to be tested is at least one, and the binding nails of each of the books to be tested are located on one side of the width direction of the book to be tested, if the number of binding nail images in each target area image to be tested is equal to the number of books to be tested, and the category information of all binding nails is qualified, then the quality inspection result is that the book to be tested is a qualified book; otherwise, the quality inspection result is that the book to be tested is an unqualified book;

[0034] When the book to be tested includes a first book and a second book, the first book and the second book are stacked along the thickness direction of the book to be tested, and the binding nails of the first book and the binding nails of the second book are respectively located on both sides of the width direction of the book, if the number of binding nail images in each target area image to be detected of the first book is equal to the number of the first book, and the number of binding nail images in each target area image to be detected of the second book is equal to the number of the second book, and the category information of all binding nails is qualified, then the quality inspection result is that the book to be tested is a qualified book; otherwise, the quality inspection result is that the book to be tested is an unqualified book.

[0035] The beneficial effects of the present disclosure are mainly:

[0036] The binding quality inspection device for books provided by the present disclosure transports the books through a conveying mechanism. When the books pass through an imaging mechanism, the imaging mechanism collects image information of the books, the image information includes image information of binding nails, and the inspection mechanism is used to determine the quality inspection result according to the image information of the binding nails, and the quality inspection result is qualified or unqualified; when the unqualified books are conveyed to the rejection mechanism by the conveying mechanism, the rejection mechanism removes the books with unqualified quality inspection results out of the conveying mechanism, thereby realizing automatic inspection of the binding quality of the books, unifying the inspection standards, effectively improving the efficiency and accuracy of the inspection, and saving labor costs.

[0037] The present disclosure provides a binding quality inspection method for a book, which obtains image information of the book to be inspected, wherein the image information includes at least one image of an area to be inspected, and each image of the area to be inspected includes at least one image of a binding nail; then, each image of the area to be inspected is extracted from the image information to form an image of a target area to be inspected; then, each image of the target area to be inspected is processed by a target detection model to obtain category information of each binding nail in each image of the target area to be inspected; then, according to the category information of each binding nail in each image of the target area to be inspected and preset conditions, a quality inspection result is determined; and then, the quality inspection result is transmitted to a control device, and the control device is used to control a rejection mechanism to perform corresponding operations according to the quality inspection result, thereby realizing automatic inspection of the binding quality of the book, unifying the inspection standards, effectively improving the efficiency and accuracy of the inspection, and saving labor costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the specific embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0039] Figure 1 A schematic diagram of the structure of a book binding quality inspection device provided in an embodiment of the present disclosure;

[0040] Figure 2 A schematic diagram of the structure of a book binding quality detection device provided in an embodiment of the present disclosure (the display screen and the mounting frame are not shown);

[0041] Figure 3 for Figure 2 A partial enlarged view of the middle A;

[0042] Figure 4 for Figure 2 A partial enlarged view of point B in the middle;

[0043] Figure 5 A top view of a book binding quality inspection device provided in an embodiment of the present disclosure (the display screen and the mounting frame are not shown);

[0044] Figure 6 A front view of the book binding quality detection device provided in an embodiment of the present disclosure (the display screen and the mounting frame are not shown);

[0045] Figure 7 A schematic diagram of image information collected by the first imaging mechanism in an embodiment of the present disclosure;

[0046] Figure 8 is a schematic diagram of an image of a target area to be detected in an embodiment of the present disclosure;

[0047] Fig. 9 A flowchart of a binding quality inspection method for a book provided in an embodiment of the present disclosure.

[0048] The following are the descriptions of the reference numerals:

[0049] 1-transmission mechanism; 21-first imaging mechanism; 211-camera; 212-base; 2121-first bottom plate; 2122-first side wall; 2123-guide rail; 213-handle; 2131-insertion section; 2132-first limiting portion; 2133-second limiting portion; 2134-anti-slip pattern; 214-installation portion; 2141-second side wall; 2142-second bottom plate; 215-light source; 22-second imaging mechanism; 3-rejection mechanism; 31-reciprocating drive mechanism; 32-push plate; 33-guide rod; 4-first detection element; 5-second detection element; 6-industrial computer; 7-display screen; 101-first book; 102-second book; 200-binding nail image. DETAILED DESCRIPTION

[0050] The technical solution of the present disclosure will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present disclosure.

[0051] In the description of the present disclosure, it should be noted that, if the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. appear, the orientation or position relationship indicated is based on the orientation or position relationship shown in the accompanying drawings, which is only for the convenience of describing the present disclosure and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present disclosure. In addition, if the terms "first", "second", "third" appear, they are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0052] In the description of the present disclosure, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present disclosure can be understood according to specific circumstances.

[0053] See also Figures 1 to 8 As shown, this embodiment provides a binding quality inspection device for this book, including a conveying mechanism 1, an imaging mechanism, a detection mechanism and a rejection mechanism 3, the conveying mechanism 1 is used to allow the book to pass through the imaging mechanism and the rejection mechanism 3; the imaging mechanism is located on at least one side of the conveying mechanism 1, and is used to collect image information of the book, and the image information includes image information of the binding nails; the detection mechanism is used to determine the quality inspection result according to the image information of the binding nails, wherein the quality inspection result is qualified or unqualified, and the rejection mechanism 3 is used to move the book with an unqualified quality inspection result out of the conveying mechanism 1.

[0054] The binding quality inspection device for this book provided in this embodiment conveys the book through a conveying mechanism 1. When the book passes through an imaging mechanism, the imaging mechanism collects image information of the book, and the image information includes image information of the binding nails. The inspection mechanism is used to determine the quality inspection result according to the image information of the binding nails, and the quality inspection result is qualified or unqualified; when the unqualified book is conveyed to the rejection mechanism 3 by the conveying mechanism 1, the rejection mechanism 3 moves the book with the unqualified quality inspection result out of the conveying mechanism 1, thereby realizing automatic inspection of the binding quality of the book, unifying the inspection standards, effectively improving the efficiency and accuracy of the inspection, and saving labor costs.

[0055] It should be noted that although Figure 2 This book is shown in the figure, but this book is not included in the structure of the binding quality detection device for this book provided in this embodiment.

[0056] In some embodiments, the conveying mechanism 1 may be a belt conveyor. Of course, the conveying mechanism 1 may also be a roller conveyor. For example, see Figure 1 As shown, the conveying direction of the conveying mechanism 1 is indicated by the arrow direction X.

[0057] It should be understood that the number of books can be one or more, and each book contains at least one binding nail. Usually, the binding nail is installed on one side of the length direction of the book. When the number of binding nails is more than one, the binding nails are arranged at intervals along the length direction of the book. When the number of books is more than one, the multiple books are stacked along the thickness direction. At this time, the side edges of all the books equipped with binding nails can be located on the same side or on two opposite sides. For example, the side edges of some books equipped with binding nails are located on one side, and the side edges of other books equipped with binding nails are located on the other side.

[0058] Exemplarily, the number of books in this embodiment is ten, of which five books have one side with binding staples located on one side, and the other five books have one side with binding staples located on the other side.

[0059] In one embodiment, the book includes a first book 101 and a second book 102, the first book 101 and the second book 102 are stacked along the thickness direction of the book, the binding nails of the first book and the binding nails of the second book are respectively located on both sides of the width direction of the book, the imaging mechanism includes a first imaging mechanism 21 and a second imaging mechanism 22, the first imaging mechanism 21 is located on one side of the conveying mechanism 1, and is used to collect image information of the first book 101, and the second imaging mechanism 22 is located on the other side of the conveying mechanism 1, and is used to collect image information of the second book 102.

[0060] For example, see Figure 7As shown, the number of the first book is five, the number of the second book is five, and the binding nails of the first book are located in the running direction of the book (in Figure 2 The binding nail of the second book is located on the right side of the running direction of the book. The running direction of the book is consistent with the conveying direction of the conveying mechanism 1.

[0061] Correspondingly, the first imaging mechanism 21 is located on the left side of the running direction of the conveying mechanism 1, and is used to collect image information of the first book to obtain image information of the binding nails of the first book; the second imaging mechanism 22 is located on the right side of the running direction of the conveying mechanism 1, and is used to collect image information of the second book to obtain image information of the binding nails of the second book.

[0062] The image information of the staples includes the presence of the staples or the absence of the staples. When the image information of the staples indicates that the staples are present, it includes but is not limited to the staples being qualified, deformed or skewed.

[0063] Of course, the number of the first volume and the number of the second volume can also be at least one, and the number of the first volume and the number of the second volume can be the same or different.

[0064] In one embodiment, at least one of the first imaging mechanism 21 and the second imaging mechanism 22 includes a camera 211 and an adjustment mechanism. The camera 211 is installed on the adjustment mechanism. The camera 211 is used to collect image information of the book. The adjustment mechanism can drive the camera 211 to reciprocate relative to the book to adjust the distance between the camera 211 and a side of the book where the binding is provided.

[0065] Taking the first imaging mechanism 21 as an example, see Figure 3 As shown, the first imaging mechanism 21 includes a camera 211 and an adjusting mechanism. The camera 211 is installed on the adjusting mechanism. The camera 211 is used to collect image information of the book. The adjusting mechanism can drive the camera 211 to reciprocate relative to the book to adjust the distance between the camera 211 and the side of the book where the binding is provided.

[0066] Since there are many types of books, the widths of different types of books may be different. When the position of camera 211 remains unchanged, the distance between the binding nails of a wider book and camera 211 is closer, and the distance between the binding nails of a narrower book and camera 211 is farther. In order to ensure that the camera 211 can clearly capture image information of books of different widths, the present embodiment installs the camera 211 on an adjustment mechanism, and the adjustment mechanism drives the camera 211 to reciprocate relative to the book to adjust the distance between the camera 211 and the side of the book where the binding nails are provided, thereby ensuring that the lens of the camera 211 can clearly capture image information of the binding nails.

[0067] In one possible design, see Figure 3 As shown, the adjustment mechanism includes a base 212, a handle 213 and a mounting portion 214. The base 212 is installed on the frame of the conveying mechanism 1, and the handle 213 is installed on the base 212. The extension direction of the handle 213 is toward the side of the book where the binding nail is provided, and the handle 213 is provided with an external thread; the camera 211 is installed on the mounting portion 214; the base 212 is provided with a first threaded hole matching the external thread, the handle 213 is rotatably connected to the mounting portion 214, and the handle 213 can reciprocate along its extension direction to drive the camera 211 to move reciprocally along the extension direction of the handle 213.

[0068] Specifically, the base 212 includes a first bottom plate 2121 and a first side wall 2122. The first bottom plate 2121 is installed on the frame of the conveying mechanism 1. The first side wall 2122 is fixedly connected to one end of the first bottom plate 2121. The fixed connection method may be but is not limited to welding or connection through fasteners (bolts and nuts). The first threaded hole is set on the first side wall 2122, and the handle 213 is passed through the first side wall 2122, and the external thread of the handle 213 matches the first threaded hole. The mounting portion 214 includes a second side wall 2141, which is provided with a groove. An insertion section 2131 is provided at the end of the handle 213 close to the camera 211, and the two ends of the insertion section 2131 are respectively provided with a first limiting portion 2132 and a second limiting portion 2133. The first limiting portion 2132 and the second limiting portion 2133 are located on both sides of the second side wall 2141 so that the insertion section 2131 is limited in the groove, ensuring that the insertion section 2131 can only rotate relative to the mounting portion 214, and in the extension direction of the handle 213, the insertion section 2131 and the mounting portion 214 are relatively fixed. Exemplarily, when the handle 213 is rotated along a first direction (for example, a clockwise direction), the handle 213 can move along its extension direction toward the direction close to the book. At this time, the first limiting portion 2132 pushes against the second side wall 2141 to drive the mounting portion 214 and the camera 211 to move together toward the direction close to the book; when the handle 213 is rotated along a second direction (for example, a counterclockwise direction), the handle 213 can move along its extension direction away from the book. At this time, the second limiting portion 2133 abuts against the surface of the second side wall 2141 close to the book to drive the mounting portion 214 and the camera 211 to move together toward the direction away from the book.

[0069] Exemplarily, an end of the handle 213 away from the mounting portion 214 is provided with an anti-slip pattern 2134 to increase friction and facilitate rotation of the handle.

[0070] For example, see Figure 3As shown, the base 212 is provided with a guide rail 2123, and the mounting portion 214 also includes a second bottom plate 2142, the second bottom plate 2142 is fixedly connected to the second side wall 2141, and a slide groove is provided on the surface of the second bottom plate 2142 away from the second side wall 2141, and the slide groove is slidably connected to the guide rail 2123 to improve the stability of the camera 211 during movement.

[0071] In another possible design, a second threaded hole may be provided in the mounting portion 214 , and the second threaded hole cooperates with the external thread, so that the handle 213 can rotate around its own axis relative to the base 212 , so that the camera 211 can reciprocate along the extension direction of the handle 213 .

[0072] In one embodiment, the first imaging mechanism 21 may further include a light source 215. The lens of the camera 211 is installed at the light entrance. The light source 215 may be any suitable type of light source, and the number of the light sources 215 is not limited. In this embodiment, the light source 215 adopts a bar light source 215. The bar light source 215 can be adjusted forward, backward, left, right, up and down by the light source 215 bracket to ensure that the camera 211 can take a clear image. In this embodiment, since it is a dynamic detection, the camera 211 can adopt a global camera. Of course, other types of industrial cameras can also be used.

[0073] In this embodiment, the structure of the second imaging mechanism 22 is the same as that of the first imaging mechanism 21 , and will not be described in detail herein.

[0074] It should be noted that the structure of the second imaging mechanism 22 may also be different from that of the first imaging mechanism 21 .

[0075] It should be understood that the number of books can be one, or two or more, and the binding nails of each book are located on one side of the width direction of the book. In the above two cases, only one imaging mechanism can be used, and the structure of the imaging mechanism is basically the same as the first imaging mechanism 21 mentioned above, which will not be described in detail here. In this case, the number of imaging mechanisms can be one, and it is located on one side of the conveying mechanism 1. When the conveying mechanism 1 conveys the book, the side of the book with the binding nails faces the imaging mechanism.

[0076] In one embodiment, see Figure 5 and Figure 6 As shown, the binding quality detection device of this book also includes a first detection element 4, and the first detection element 4 is connected to the imaging mechanism so that the imaging mechanism collects the image information of this book.

[0077] When the conveying mechanism 1 carries the book through the imaging mechanism, the first detection element 4 is triggered. When the camera 211 receives the signal sent by the first detection element 4, the image information of the book can be collected.

[0078] Exemplarily, the first detection element 4 may be a proximity switch.

[0079] The specific structure of the rejection mechanism 3 will be introduced below. The rejection mechanism 3 has various structural forms.

[0080] In one embodiment, see Figure 1 and Figure 4 As shown, the rejection mechanism 3 includes a pushing component, which includes a reciprocating drive mechanism 31 and a push plate 32. The reciprocating drive mechanism 31 is installed on one side of the conveying mechanism 1, and the push plate 32 is connected to the reciprocating drive mechanism 31. The reciprocating drive mechanism 31 can drive the push plate 32 to move in a direction close to the unqualified book to move the unqualified book out of the conveying mechanism 1.

[0081] Exemplarily, the reciprocating drive mechanism 31 may be a cylinder, the cylinder body of the cylinder is mounted on the frame, and the push plate 32 is connected to the piston rod of the cylinder. For example, the push plate 32 is fixedly connected to the piston rod of the cylinder by a fastener, and the fastener may include a bolt and a nut. The piston rod of the cylinder drives the push plate 32 to move toward the direction of the unqualified book, so that the unqualified book is moved out of the conveying mechanism 1 through the push plate 32. After the unqualified book is moved out of the conveying mechanism 1, the piston rod is retracted.

[0082] Of course, the reciprocating drive mechanism 31 is not limited to the cylinder. For example, the reciprocating drive mechanism 31 can also be an electric push rod or a linear guide rail 2123.

[0083] In some embodiments, see Figure 4 As shown, the rejection mechanism 3 further includes a guide mechanism, which includes a guide rod 33 . The guide rod 33 extends along the width direction of the conveying mechanism 1 , and the push plate 32 is slidably connected to the guide rod 33 .

[0084] The guide rod 33 is installed above the conveying mechanism 1, and the distance between the guide rod 33 and the conveying surface of the conveying mechanism 1 should ensure that the book to be tested can pass smoothly.

[0085] For example, there can be multiple guide rods 33, which are arranged in parallel and spaced apart. The push plate 32 is provided with a through hole, and the guide rod 33 is passed through the through hole. When the piston rod of the cylinder drives the push plate 32 to move, the guide rod 33 can play a guiding role to ensure the stability of the movement of the push plate 32.

[0086] In other embodiments, the rejection mechanism 3 may also include a vacuum adsorption device, which is used to adsorb unqualified books so that the unqualified books leave the conveying mechanism 1.

[0087] Exemplarily, the vacuum adsorption device includes a vacuum pump and a suction cup, the suction port of the vacuum pump is connected to the suction cup through a pipeline, and the suction cup can be adsorbed on the upper surface of the unqualified book to move the unqualified book out of the conveying mechanism 1.

[0088] In one embodiment, the binding quality inspection device for this book also includes a control device; the inspection mechanism includes an image processing unit, a target recognition unit, a result statistics unit and a result transmission unit, the image processing unit is used to extract each target area image to be detected from the image information; the target recognition unit is used to process each target area image to be detected through a target detection model to obtain the category information of each binding staple in each target area image to be detected; the result statistics unit is used to determine the quality inspection result according to the category information of each binding staple in each target area image to be detected and preset conditions; the result transmission unit is used to transmit the quality inspection result to the control device, and the control device is used to control the rejection mechanism 3 to move the unqualified book out of the conveying mechanism 1.

[0089] Exemplarily, the image processing unit is used to adjust the brightness and contrast of the image information collected by the imaging mechanism to make the image features more obvious, and then perform image cropping and segmentation to extract the image of the target area to be detected. Taking the first imaging mechanism 21 as an example, the image information collected by the first imaging mechanism 21 is as follows: Figure 7 As shown, within the field of view, the five volumes with binding nails can be seen, all of which are the first volume 101, and the five volumes located above the first volume 101 are the second volume 102. Each of the first volume and the second volume contains two binding nails. Within the field of view, two columns of binding nails can be seen arranged along the stacking direction of the first volume.

[0090] In this embodiment, the cv2.addWeighted() function of the Python standard library OpenCV can be used to perform weighted fusion on the image information, thereby adjusting the brightness and contrast of the image information; then, by means of matrix slicing, the target areas to be detected where the left and right columns of staples are located are extracted from the original image, that is, each target area to be detected contains a column of staple images. Figure 8 As shown, each target area to be detected includes five binding nail images 200 , and the five binding nail images 200 are arranged in a row along the stacking direction of the booklet.

[0091] Exemplarily, the parameters in the brackets of the cv2.addWeighted() function may include src1, alpha, src2, beta, and gamma, where the parameter src1 is the first input image (e.g., the original image); the parameter alpha is the weight of the first image, which is used to control the contrast and is usually a floating value. The larger the value, the higher the contrast of the image; the parameter src2 is the second input image. The parameter beta is the weight of the second image (usually 0); the parameter gamma is a brightness adjustment value used to brighten or darken the image. It should be noted that the cv2.addWeighted() function is a prior art and will not be described in detail here.

[0092] In this embodiment, the target recognition unit can recognize the staples by using a deep learning target detection algorithm. For example, a single-stage target detection model PPYOLO can be used as a baseline for model training.

[0093] During the model training process, labeled image data is used for training, and by adjusting the model parameters, the model can accurately locate the target area in the image and perform classification.

[0094] It should be noted that the preset training stop condition can be selected according to actual production needs and actual production quality inspection standards.

[0095] It should also be noted that the principles and implementation methods of adjusting the model parameters of the initial model and performing iterative training are well known to those skilled in the art and are easy to implement, and will not be described in detail in this embodiment.

[0096] For the unqualified book, the category label of the binding includes at least one of skew, deformation and missing. That is, in this embodiment, when training the object detection model, only unqualified labels can be marked.

[0097] It should be understood that when the category label of a staple is missing, there will be no skew or deformation at the same time. When the category label of a staple is skew, it may be deformed at the same time. When the staple is deformed, it may also be skewed at the same time. Of course, through training, only the category labels with obvious defects are marked. For example, when the staple is seriously skewed, the corresponding category label of the staple is skew, and deformation can be ignored at this time.

[0098] After the target detection model is trained, each target area image to be detected is processed by the target detection model to obtain the category information of each staple in each target area image to be detected. Exemplarily, the category information of the staple is qualified or defective. When the category information of the staple is defective, the defect type includes at least one of skew, deformation and missing.

[0099] It should be understood that when a staple is missing, there may not be a simultaneous appearance or deformation, when a staple is skewed, there may be a simultaneous deformation, and when a staple is deformed, there may also be a simultaneous skew.

[0100] The result statistics unit is used to determine the quality inspection result according to the category information and preset conditions of each binding nail in each target area image to be inspected. Specifically, the number of books to be inspected and the positions of the binding nails of the books to be inspected can be determined first. The book binding quality inspection device also includes an industrial computer 6, which determines the binding quality of the book to be inspected in real time through the built-in program of the industrial computer 6, and sends the quality inspection result to the control device. Exemplarily, the model of the industrial computer 6 can be RK-620 / M45 / I7-8700CPU / 3070TI.

[0101] When there is at least one book to be tested and the binding staples of each book to be tested are located on one side of the width direction of the book, if the number of binding staple images 200 in each target area image to be detected is equal to the number of books to be tested, and the category information of all binding staples is qualified, then the quality inspection result is that the book to be tested is a qualified book; otherwise, the quality inspection result is that the book to be tested is an unqualified book.

[0102] The following description is made by taking the example that there are five books to be tested and each book to be tested contains two binding staples.

[0103] Specifically, five books to be tested are stacked along their thickness direction, and all the binding nails of the five books to be tested are located on the same side of the book width direction. There are two target area images to be tested. If the number of binding nail images in each target area image to be tested is five, and the category information of all binding nails is qualified, the quality inspection result is that the book to be tested is a qualified book.

[0104] If the number of binding staple images in at least one target area image to be inspected is not five, and / or the category information of at least one binding staple is defective (such as skewed, deformed and missing), the quality inspection result is that the volume to be inspected is an unqualified volume.

[0105] When the books to be tested include a first book and a second book, the first book and the second book are stacked along the thickness direction of the books, and the binding nails of the first book and the binding nails of the second book are respectively located on both sides of the width direction of the books, if the number of binding nail images in each target area image to be detected of the first book is equal to the number of the first book, and the number of binding nail images in each target area image to be detected of the second book is equal to the number of the second book, and all the category information of the binding nails is qualified, then the quality inspection result is that the book to be tested is a qualified book; otherwise, the quality inspection result is that the book to be tested is an unqualified book.

[0106] The following description will be made by taking as an example that the number of the first volume and the second volume are both five, and the first volume and the second volume both contain two binding staples.

[0107] Specifically, see Figure 7 As shown, five first books 101 and five second books 102 are stacked along the thickness direction of the book to be tested, wherein the five second books 102 are located above the five first books 101, and the binding nails of the first books and the binding nails of the second books are respectively located on both sides of the width direction of the book to be tested. At this time, there are four target area images to be detected, namely the first target area image to be detected, the second target area image to be detected, the third target area image to be detected and the fourth target area image to be detected, wherein the first target area image to be detected and the second target area image to be detected respectively contain two columns of binding nails of the first book, and the third target area image to be detected and the fourth target area image to be detected respectively contain two columns of binding nails of the second book. Exemplarily, Figure 7 What is shown may be an image of a first target area to be detected.

[0108] If the number of binding staple images in the first target area image to be detected and the number of binding staple images in the second target area image to be detected are equal to the number of the first book, and the number of binding staple images in the third target area image to be detected and the number of binding staple images in the fourth target area image to be detected are equal to the number of the second book, and the category information of all binding staples is qualified, then the quality inspection result is that the book to be tested is a qualified book.

[0109] If at least one of the number of binding staple images in the first target area image to be detected and the number of binding staple images in the second target area image to be detected is not equal to the number of the first book, and / or at least one of the number of binding staple images in the third target area image to be detected and the number of binding staple images in the fourth target area image to be detected is not equal to the number of the second book, and / or the category information of at least one binding staple is defective (such as skewness, deformation and missing), then the quality inspection result is that the book to be tested is an unqualified book.

[0110] The result transmission unit is used to transmit the quality inspection result to the control device, and the control device is used to control the rejection mechanism 3 to move the unqualified books out of the transmission mechanism 1. Exemplarily, the result transmission unit packages the quality inspection result in a binary form (for example, good products are 1, and defective products are 0) and sends it to the control device. The transmission mode of the result transmission unit can be serial communication, network communication (such as Socket communication) or other standard communication protocols. The specific selection depends on factors such as application requirements, transmission distance and data rate, and this embodiment does not limit this.

[0111] In one embodiment, see Figure 5 and Figure 6 As shown, the book binding quality detection device further includes a second detection element 5, which is connected to the control device to send a signal to the control device indicating that the book has passed through the rejection mechanism 3.

[0112] When the book passes through the second detection element 5, the second detection element 5 sends a signal to the control device. If the control device receives the judgment result of the book corresponding to the detection unit as a defective product, the control device controls the rejection mechanism 3 to reject the unqualified book, and the qualified book continues to flow to the next production line.

[0113] Exemplarily, the second detection element 5 may be a proximity switch.

[0114] In this embodiment, the control device may be a PLC controller, such as Omron CP1E-N30.

[0115] In one embodiment, see Figure 1 As shown, the bookbinding quality inspection device also includes a display screen 7, which is mounted on the frame of the conveying mechanism 1 through a mounting frame. The display screen 7 displays the images collected by the imaging mechanism, the inspection results obtained through analysis, and the statistical production data in real time, so as to facilitate real-time monitoring and improvement of the production process and improve product quality.

[0116] In summary, the bookbinding quality detection device provided in this embodiment is an online automatic bookbinding quality detection device based on machine vision recognition. The entire detection process does not affect the operation of the original book production device, the modification cost is low, and the degree of automation is high. Compared with the manual detection method, the bookbinding quality detection device provided in this embodiment has higher detection efficiency and more accurate detection results.

[0117] This embodiment also provides a binding quality detection method for this book. Fig. 9 As shown, the binding quality inspection method of this book includes:

[0118] Step S902, obtaining image information of the book to be tested, the image information including at least one image of a region to be tested, each image of the region to be tested including at least one image of a binding nail;

[0119] Step S904, extracting each to-be-detected area image from the image information to form a to-be-detected target area image;

[0120] Step S906, processing each to-be-detected target area image by using the target detection model to obtain category information of each binding staple in each to-be-detected target area image;

[0121] Step S908, determining a quality inspection result according to the category information of each binding staple in each target area image to be inspected and a preset condition;

[0122] Step S910, transmitting the quality inspection result to the control device; the control device is used to control the rejection mechanism 3 to perform corresponding operations according to the quality inspection result.

[0123] The binding quality inspection method of the book provided in the present embodiment obtains the image information of the book to be inspected, wherein the image information includes at least one image of the area to be inspected, and each image of the area to be inspected includes at least one image of a binding nail; then, each image of the area to be inspected is extracted from the image information to form an image of a target area to be inspected; then, each image of the target area to be inspected is processed by a target detection model to obtain the category information of each binding nail in each image of the target area to be inspected; then, according to the category information of each binding nail in each image of the target area to be inspected and preset conditions, the quality inspection result is determined; and then, the quality inspection result is transmitted to the control device, and the control device is used to control the rejection mechanism 3 to perform corresponding operations according to the quality inspection result, thereby realizing the automatic inspection of the binding quality of the book, unifying the inspection standards, effectively improving the efficiency and accuracy of the inspection, and saving labor costs.

[0124] The book binding quality detection method provided in this embodiment can be applied to the book binding quality detection device provided in this embodiment.

[0125] In step S902, the image information of the book to be tested may be acquired by an imaging mechanism.

[0126] In one embodiment, each image of the area to be detected is extracted from the image information to form an image of the target area to be detected, including: performing image enhancement processing on the image information; cropping and segmenting the image information to extract each image of the target area to be detected, wherein the image of the target area to be detected includes a row of binding nail images arranged along the thickness direction of the book.

[0127] Exemplarily, the image information of the image processing unit can be used to perform image enhancement processing, and the image enhancement processing includes adjusting the brightness and contrast of the image information to make the image features more obvious. Then, the enhanced image information is cropped and segmented to extract the images of each target area to be detected. In this embodiment, the cv2.addWeighted() function of the Python standard library OpenCV is used to perform weighted fusion on the image information to adjust the brightness and contrast of the image information; then, the target areas to be detected where the left and right columns of staples are located are extracted from the original image by matrix slicing, that is, each target area to be detected contains a column of staple images. See Figure 8As shown, each target area to be detected includes five binding nail images 200 , and the five binding nail images 200 are arranged in a row along the stacking direction of the booklet.

[0128] It should be noted that the specific method for adjusting the brightness and contrast of the image information has been described before and will not be repeated here.

[0129] In some embodiments, the object detection model is trained by:

[0130] Obtain the historical image information of the sample and the corresponding category label of the binding;

[0131] Training the initial model based on historical image information and corresponding category labels of binding staples;

[0132] If the preset training stop condition is met, the initial model is used as the target detection model;

[0133] If the preset training stop condition is not met, the model parameters of the initial model are adjusted and the training is iterated until the preset training stop condition is met.

[0134] Exemplarily, in order to obtain the historical image information of the sample of this book and the corresponding category label of the binding nail, it is necessary to collect a large amount of historical image information, which contains the image of the area to be detected and the corresponding quality problems. In order to train the target detection model, it is necessary to annotate these images of the area to be detected. For example, the corresponding category label of the binding nail can be annotated with LabelImg to construct a target detection data set. Among them, the category label of the binding nail includes qualified or unqualified, and the unqualified label includes at least one of skew, deformation and missing. There can be many forms of labels. For example, Chinese can be used, such as "deformed" and "skewed"; for example, pinyin can also be used, such as "bianxing" and "waixie".

[0135] Then select the target detection algorithm. For example, you can use the single-stage target detection model PPYOLO as the baseline for model training.

[0136] During the model training process, labeled image data is used for training, and by adjusting the model parameters, the model can accurately locate the target area in the image and perform classification.

[0137] It should be noted that the preset training stop condition can be selected according to actual production needs and actual production quality inspection standards.

[0138] It should also be noted that the principles and implementation methods of adjusting the model parameters of the initial model and performing iterative training are well known to those skilled in the art and are easy to implement, and will not be described in detail in this embodiment.

[0139] In one embodiment, in obtaining the historical image information of the sample of the book and the corresponding category label of the binding nail, the historical graphic information obtained is the image information of the unqualified sample, and the corresponding category label of the binding nail includes at least one of skew, deformation and missing. That is, in this embodiment, when training the object detection model, only the unqualified labels can be marked.

[0140] It should be understood that when the category label of a staple is missing, there will be no skew or deformation at the same time. When the category label of a staple is skew, it may be deformed at the same time. When the staple is deformed, it may also be skewed at the same time. Of course, through training, only the category labels with obvious defects are marked. For example, when the staple is seriously skewed, the corresponding category label of the staple is skew, and deformation can be ignored at this time.

[0141] After the target detection model is trained, each target area image to be detected is processed by the target detection model to obtain the category information of each staple in each target area image to be detected. Exemplarily, the category information of the staple is qualified or defective. When the category information of the staple is defective, the defect type includes at least one of skew, deformation and missing.

[0142] It should be understood that when a staple is missing, there may not be a simultaneous appearance or deformation, when a staple is skewed, there may be a simultaneous deformation, and when a staple is deformed, there may also be a simultaneous skew.

[0143] In one embodiment, the quality inspection result is determined according to the category information of each staple in each target area image to be inspected and the preset conditions, including:

[0144] Determine the number of books to be tested and the location of the binding staples of the books;

[0145] When there is at least one book to be tested and the binding staples of each book to be tested are located on one side of the width direction of the book to be tested, if the number of binding staple images in each target area image to be tested is equal to the number of books to be tested, and the category information of all binding staples is qualified, then the quality inspection result is that the book to be tested is a qualified book; otherwise, the quality inspection result is that the book to be tested is an unqualified book.

[0146] The following description is made by taking the example that there are five books to be tested and each book to be tested contains two binding staples.

[0147] Specifically, five books to be tested are stacked along their thickness direction, and all the binding nails of the five books to be tested are located on the same side of the book width direction. There are two target area images to be tested. If the number of binding nail images in each target area image to be tested is five, and the category information of all binding nails is qualified, the quality inspection result is that the book to be tested is a qualified book.

[0148] If the number of binding staple images in at least one target area image to be inspected is not five, and / or the category information of at least one binding staple is defective (such as skewed, deformed and missing), the quality inspection result is that the volume to be inspected is an unqualified volume.

[0149] When the book to be tested includes a first book and a second book, the first book and the second book are stacked along the thickness direction of the book to be tested, and the binding nails of the first book and the binding nails of the second book are respectively located on both sides of the width direction of the book, if the number of binding nail images in each target area image to be detected of the first book is equal to the number of the first book, and the number of binding nail images in each target area image to be detected of the second book is equal to the number of the second book, and all the category information of the binding nails is qualified, then the quality inspection result is that the book to be tested is a qualified book; otherwise, the quality inspection result is that the book to be tested is an unqualified book.

[0150] The following description will be made by taking as an example that the number of the first volume 101 and the number of the second volume 102 are both five, and the first volume 101 and the second volume 102 both contain two binding staples.

[0151] Specifically, five first books and five second books are stacked along the thickness direction of the book to be tested, wherein the five second books are located above the five first books, and the binding nails of the first books and the binding nails of the second books are respectively located on both sides of the width direction of the book to be tested. At this time, there are four target area images to be detected, namely the first target area image to be detected, the second target area image to be detected, the third target area image to be detected and the fourth target area image to be detected, wherein the first target area image to be detected and the second target area image to be detected respectively contain two columns of binding nails of the first book, and the third target area image to be detected and the fourth target area image to be detected respectively contain two columns of binding nails of the second book.

[0152] If the number of binding staple images in the first target area image to be detected and the number of binding staple images in the second target area image to be detected are equal to the number of the first book, and the number of binding staple images in the third target area image to be detected and the number of binding staple images in the fourth target area image to be detected are equal to the number of the second book, and the category information of all binding staples is qualified, then the quality inspection result is that the book to be tested is a qualified book.

[0153] If at least one of the number of binding staple images in the first target area image to be detected and the number of binding staple images in the second target area image to be detected is not equal to the number of the first book, and / or at least one of the number of binding staple images in the third target area image to be detected and the number of binding staple images in the fourth target area image to be detected is not equal to the number of the second book, and / or the category information of at least one binding staple is defective (such as skewness, deformation and missing), then the quality inspection result is that the book to be tested is an unqualified book.

[0154] In some embodiments, after the target area image is processed by the target detection model to obtain the quality detection result, it also includes: updating the database in real time, recording the current total production, the total number of good products, the total number of defective products and the yield rate, and displaying the image collected by the imaging mechanism, the analysis of the detection results and the statistical production data in real time through the display screen 7. This facilitates real-time monitoring and improvement of the production process and improves product quality.

[0155] It should be understood that when the number of books to be tested is small (for example, only one book), if the defect is only the missing binding nails, it is relatively easy to be found and can be detected by human eye observation or other methods. However, when it comes to defects such as skewness and deformation of binding nails, or when the number of books to be tested is large, human eye observation is prone to defects such as low accuracy. Therefore, the book binding quality inspection device and method provided in this embodiment are not only suitable for detecting defects such as missing binding nails, but also particularly suitable for detecting defects such as skewness and deformation of binding nails that are not easily identified by the human eye, which can improve production efficiency and is conducive to popularization and application.

[0156] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present disclosure.

Claims

1. A book binding quality inspection device, characterized in that: It includes a conveying mechanism, an imaging mechanism, a detection mechanism and a rejection mechanism, wherein the conveying mechanism is used to allow the book to pass through the imaging mechanism and the rejection mechanism; the imaging mechanism is located on at least one side of the conveying mechanism, and is used to collect image information of the book, wherein the image information includes image information of the binding nails; the detection mechanism is used to determine a quality detection result based on the image information of the binding nails, wherein the quality detection result is qualified or unqualified, and the rejection mechanism is used to move the book with an unqualified quality detection result out of the conveying mechanism.

2. The book binding quality inspection device according to claim 1, characterized in that: The book includes a first book and a second book, the first book and the second book are stacked along the thickness direction of the book, the binding nails of the first book and the binding nails of the second book are respectively located on both sides of the width direction of the book, the imaging mechanism includes a first imaging mechanism and a second imaging mechanism, the first imaging mechanism is located on one side of the conveying mechanism, and is used to collect image information of the first book, and the second imaging mechanism is located on the other side of the conveying mechanism, and is used to collect image information of the second book.

3. The book binding quality inspection device according to claim 2, characterized in that: At least one of the first imaging mechanism and the second imaging mechanism includes a camera and an adjustment mechanism, wherein the camera is installed on the adjustment mechanism, and the camera is used to collect image information of the book. The adjustment mechanism can drive the camera to reciprocate relative to the book to adjust the distance between the camera and a side of the book where a binding is provided.

4. The book binding quality inspection device according to claim 3 is characterized in that: The adjustment mechanism comprises a base, a handle and a mounting portion, wherein the base is mounted on the frame of the transmission mechanism, the handle is mounted on the base, the extension direction of the handle is toward the side of the booklet where the binding nail is arranged, and the handle is provided with an external thread; the camera is mounted on the mounting portion; The base is provided with a first threaded hole matching with the external thread, the handle is rotatably connected to the mounting portion, and the handle can reciprocate along its extension direction to drive the camera to reciprocate along the extension direction of the handle; or, the mounting portion is provided with a second threaded hole matching with the external thread, and the handle can rotate around its own axis relative to the base, so that the camera can reciprocate along the extension direction of the handle.

5. The book binding quality inspection device according to claim 1, characterized in that: It also includes a first detection element, which is connected to the imaging mechanism so that the imaging mechanism can collect image information of the book.

6. The book binding quality inspection device according to claim 1, characterized in that: The rejection mechanism includes a pushing component, which includes a reciprocating drive mechanism and a push plate. The reciprocating drive mechanism is installed on one side of the conveying mechanism, and the push plate is connected to the reciprocating drive mechanism. The reciprocating drive mechanism can drive the push plate to move in a direction close to the unqualified book to move the unqualified book out of the conveying mechanism.

7. The book binding quality inspection device according to claim 6, characterized in that: The rejecting mechanism further comprises a guiding mechanism, wherein the guiding mechanism comprises a guiding rod, wherein the guiding rod extends along the width direction of the conveying mechanism, and the push plate is slidably connected to the guiding rod.

8. The book binding quality inspection device according to claim 1, characterized in that: The rejecting mechanism comprises a vacuum adsorption device, and the vacuum adsorption device is used for adsorbing unqualified books so that the unqualified books leave the conveying mechanism.

9. The book binding quality inspection device according to any one of claims 1 to 8, characterized in that: It also includes a control device; the detection mechanism includes an image processing unit, a target recognition unit, a result statistics unit and a result transmission unit, and the image processing unit is used to extract each target area image to be detected from the image information; The target recognition unit is used to process each of the target area images to be detected through a target detection model to obtain category information of each binding staple in each of the target area images to be detected; the result statistics unit is used to determine the quality inspection result based on the category information of each binding staple in each of the target area images to be detected and preset conditions; the result transmission unit is used to transmit the quality inspection result to the control device, and the control device is used to control the rejection mechanism to move unqualified books out of the conveying mechanism.

10. The book binding quality inspection device according to claim 9, characterized in that: It also includes a second detection element, which is connected to the control device to send a signal to the control device indicating that the book has passed through the rejection mechanism.

11. A method for detecting the binding quality of a book, characterized in that: include: Acquire image information of the book to be tested, wherein the image information includes at least one image of a region to be tested, and each image of the region to be tested includes at least one image of a binding nail; Extracting each of the to-be-detected area images from the image information to form an to-be-detected target area image; Processing each of the target area images to be detected by using a target detection model to obtain category information of each binding staple in each of the target area images to be detected; Determining a quality inspection result according to category information and preset conditions of each binding staple in each of the target area images to be inspected; transmitting the quality inspection result to a control device; The control device is used to control the rejection mechanism to perform corresponding operations according to the quality detection result.

12. The binding quality inspection method of claim 11, characterized in that: The category information of the binding staples is acceptable or defective. When the category information of the binding staples is defective, the defect type includes at least one of skew, deformation, and missing.

13. The method for detecting the binding quality of a booklet according to claim 11, characterized in that: Extracting each of the to-be-detected area images from the image information to form an to-be-detected target area image, including: Performing image enhancement processing on the image information; The image information is cut and segmented to extract each target area image to be detected, wherein the target area image to be detected includes a row of binding nail images arranged along the thickness direction of the book.

14. The binding quality inspection method of claim 11, characterized in that: The object detection model is trained in the following way: Obtain the historical image information of the sample and the corresponding category label of the binding; Training an initial model according to the historical image information and the corresponding category labels of the binding staples; If the preset training stop condition is met, the initial model is used as the target detection model; If the preset training stop condition is not met, the model parameters of the initial model are adjusted and the training is iterated until the preset training stop condition is met.

15. The binding quality inspection method of claim 14, characterized in that: In obtaining the historical image information of the sample of this book and the corresponding category label of the binding nail, the obtained historical graphic information is the image information of the unqualified sample, and the corresponding category label of the binding nail includes at least one of skew, deformation and missing.

16. The binding quality inspection method of claim 11, characterized in that: Determining the quality inspection result according to the category information and preset conditions of each binding staple in each of the target area images to be inspected includes: Determine the number of books to be tested and the positions of the bindings of the books to be tested; When the number of the books to be tested is at least one, and the binding nails of each of the books to be tested are located on one side of the width direction of the book to be tested, if the number of binding nail images in each target area image to be tested is equal to the number of books to be tested, and the category information of all binding nails is qualified, then the quality inspection result is that the book to be tested is a qualified book; otherwise, the quality inspection result is that the book to be tested is an unqualified book; When the book to be tested includes a first book and a second book, the first book and the second book are stacked along the thickness direction of the book to be tested, and the binding nails of the first book and the binding nails of the second book are respectively located on both sides of the width direction of the book, if the number of binding nail images in each target area image to be detected of the first book is equal to the number of the first book, and the number of binding nail images in each target area image to be detected of the second book is equal to the number of the second book, and the category information of all binding nails is qualified, then the quality inspection result is that the book to be tested is a qualified book; otherwise, the quality inspection result is that the book to be tested is an unqualified book.

Images