A method and device for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole

Abstract

The present invention relates to the field of footwear quality inspection, and particularly to a method and device for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole. The method includes: obtaining the images to be detected of the inner and outer surfaces of the high-top shoe sole, wherein the high-top shoe sole in the first image to be detected has a first bright area and a second bright area; the high-top shoe sole in the second image to be detected only has a second light-shielding area; extracting the region of interest in the first image to be detected, and the region of interest is the bright area of the high-top shoe sole; extracting the region of interest in the second image to be detected, and the region of interest is the second light-shielding area of the high-top shoe sole; selecting the first bright area located at the lower side to form a glue overflow detection area on the outer surface of the high-top shoe sole; selecting the upper edge glue line of the second light-shielding area, and taking the area formed by translating the upper edge glue line downward by a certain distance as the glue shortage or breakage detection area on the inner surface of the high-top shoe sole. The present invention greatly improves the production efficiency and product quality.

Description

Technical Field

[0001] It relates to the field of shoe quality inspection, and particularly to a method and device for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole. Background Art

[0002] With the development of industrialization in China, the shoe-making industry has also entered a period of rapid development. As a labor-intensive industry, the shoe-making industry is facing a series of problems such as labor shortage, rising labor costs, and low work efficiency. In the shoe-making process, whether manual or machine is used for applying glue to the sole, it is impossible to ensure the quality of glue brushing. When defective products occur, rework is required, which not only affects the production efficiency of the enterprise, but also affects the reputation of the enterprise when such shoes enter the market.

[0003] Regarding the quality inspection of sole glue, some enterprises ensure product quality by using the method of manual visual inspection. This method is not only easily affected by the state of the workers, but also the toxic gases volatilized from the glue have an impact on human health. Some enterprises detect product quality by installing industrial cameras on both sides of the sole. This method has two problems: First, it is impossible to automatically obtain the detection area, and the detection area needs to be set manually; Second, the existing technology generally detects the glue quality of flat soles, and there is no suitable solution for detecting the glue on the inner and outer surfaces of high-top soles. Summary of the Invention

[0004] In view of the problems in the prior art that the detection of glue spraying quality of shoes is greatly affected by human subjectivity and it is impossible to automatically obtain the detection areas of the glue on the inner and outer surfaces of high-top soles, the present invention provides a method and device for automatically detecting glue on the inner and outer surfaces of high-top soles.

[0005] The technical solution of the present invention is as follows:

[0006] A method for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole includes the following steps:

[0007] Obtain the images to be detected on the inner and outer surfaces of the high-top shoe sole, wherein the high-top shoe sole in the first image to be detected has a first bright area and a second bright area; the high-top shoe sole in the second image to be detected only has a second shaded area;

[0008] Extract the regions of interest in the first image to be detected, and the regions of interest are the bright areas of the high-top shoe sole; extract the regions of interest in the second image to be detected, and the regions of interest are the second shaded areas of the high-top shoe sole;

[0009] Select the first bright area located at the lower side to form an overglue detection area on the outer side of the high-top shoe sole; select the upper edge glue line of the second shaded area, and the area formed by translating the upper edge glue line downward by a certain distance is used as a glue shortage or breakage detection area on the inner side of the high-top shoe sole.

[0010] Further, obtaining the first image to be detected of the outer side of the high-top sole specifically includes: irradiating the high-top sole with an oblique light source, and obtaining the first image to be detected of the outer side of the high-top sole with a camera above a frame, wherein the camera is located above the light source, so that the high-top sole in the first image to be detected has a first bright light area, a second bright light area, and a first light-shielded area located in the middle, the outer side of the sole close to the camera and the light source is the first bright light area, and the inner side of the high-top sole away from the camera and the light source is the second bright light area;

[0011] Acquiring the second image to be detected on the inner side of the high-top sole specifically includes: using the light source at the bottom inner side of the conveyor belt to illuminate vertically upward, while other light sources do not illuminate, and using a camera above the rack to acquire the second image to be detected of the high-top sole, wherein the high-top sole in the second image to be detected only has a second shading area.

[0012] Furthermore, extracting the region of interest in the first image to be detected and the second image to be detected specifically includes:

[0013] A lower limit value for screening the sole area is set, the area where the sole is located is screened from the first image to be detected and the second image to be detected, and the area is filled internally to form an image containing only the sole;

[0014] By setting a lower threshold value, extracting a region of interest from the first image to be detected according to the pixel grayscale value, wherein the region of interest is a bright area of the high-top shoe sole;

[0015] By setting the upper threshold value, an area of interest is extracted from the second image to be detected according to the pixel grayscale value, and the area of interest is the second light-shielding area of the high-top shoe sole.

[0016] Furthermore, the method further includes: selecting a first bright light area located at the lower side of the bright light area, and performing minimum circumscribed rectangle processing on the first bright light area and the second light-shielding area, including:

[0017] Extracting pixel points where pixels in the first bright light area change dramatically, and obtaining the outer contour of the first bright light area;

[0018] Extracting pixel points where pixels in the second light-shielding area change dramatically, and obtaining the outer contour of the second light-shielding area;

[0019] According to the position coordinates of all points on the outer contour, a position coordinate array is obtained;

[0020] Screen the minimum column value in the position coordinate array, and obtain the minimum serial number index of the minimum column value in the position coordinate array; if the minimum serial number index is greater than 0, rearrange and combine the position coordinate array to obtain a new position array, so that the minimum serial number index coordinate is the first point of the new position array; if the minimum serial number index is equal to 0, rearrange and combine the position coordinate array, and the obtained new position array is the same as the original position array; judge the sorting rule of the new position array, which can be specified as clockwise or counterclockwise. If the sorting is specified as clockwise, when counterclockwise sorting appears, the position array needs to be sorted reversely; if the sorting is specified as counterclockwise, when clockwise sorting appears, the position array also needs to be sorted reversely.

[0021] Calculate the minimum circumscribed rectangle of the outer contour of the first bright area, set the indentation dimension h1 in the long direction and the lengthening dimension w1 in the wide direction to obtain a new transformed rectangle.

[0022] Calculate the minimum circumscribed rectangle of the outer contour of the second light-shielding area, set the indentation dimension h1 in the long direction, and translate the minimum circumscribed rectangle along its short axis direction by a distance d1 to obtain a new transformed rectangle.

[0023] Further, forming the glue detection area on the outer side of the high-top shoe sole specifically includes:

[0024] According to the fact that the new transformed rectangle intersects the outer contour of the first bright area at four set points A, B, C, and D. In the coordinate axis, let AB and CD be the column directions, and AD and BC be the row directions. Divide the four points into two groups according to the column values. The two points BC with larger column values are used as the first group, and the two points AD with smaller column values are used as the second group. Among the first group, point B has a smaller row value, and among the second group, point A has a smaller row value. Obtain the position serial numbers of points A and B in the new position array respectively.

[0025] Record all the point sets from point A to point B in the first bright area, which form a curve segment along the shoe bottom line. Set a fixed distance, and translate the curve segment downward by this fixed distance to generate a new equidistant parallel line segment; the curve segment and the new equidistant parallel line segment are connected end to end to form a detection area, and the detection area is the glue detection area on the outer side of the high-top shoe sole.

[0026] Further, forming the glue detection area on the inner side of the high-top shoe sole specifically includes:

[0027] According to the fact that the new transformed rectangle intersects the outer contour of the second light-shielding area at two set points A and B, respectively determine the position serial numbers of points A and B in the new position array according to the position coordinates of points A and B.

[0028] Record all the point sets of the second light-shielding area from point A to point B, which form a curve segment along the shoe bottom line. Set a fixed distance and translate the curve segment downward by this fixed distance to generate a new equidistant parallel line segment. The curve segment and the new equidistant parallel line segment are connected end to end to form a detection area, and the detection area is the glue detection area on the inner side of the high-top shoe sole.

[0029] Furthermore, it also includes: using UV light to re-acquire the glue images to be detected on the inner and outer sides of the high-top shoe sole, performing glue overflow detection on the glue images to be detected in the glue overflow detection area on the outer side of the high-top shoe sole, and performing glue shortage or breakage detection on the glue images to be detected in the glue shortage or breakage detection area on the inner side of the high-top shoe sole.

[0030] Furthermore, when performing glue detection on the glue images to be detected in the glue detection areas on the inner and outer sides of the high-top shoe sole, the glue mixed with the fluorescent liquid combines with the irradiation of UV light to separate the blue channel image of the glue images to be detected, thereby determining whether there is glue overflow on the outer side of the high-top shoe sole and whether there is glue shortage or breakage on the inner side of the high-top shoe sole.

[0031] An automatic glue detection device for the inner and outer sides of a high-top shoe sole includes:

[0032] An image acquisition module to be detected, which is used to acquire the images to be detected on the inner and outer sides of the high-top shoe sole, where the high-top shoe sole in the first image to be detected has a first bright area and a second bright area; the high-top shoe sole in the second image to be detected only has a second light-shielding area;

[0033] An interested area processing module, which is used to extract the interested areas in the first image to be detected, and the interested areas are the bright areas of the high-top shoe sole; extract the interested areas in the second image to be detected, and the interested areas are the second light-shielding areas of the high-top shoe sole;

[0034] A glue detection area forming module, which is used to select the first bright area located on the lower side to form a glue overflow detection area on the outer side of the high-top shoe sole; select the upper edge glue line of the second light-shielding area, and use the area formed by translating the upper edge glue line downward by a certain distance as the glue shortage or breakage detection area on the inner side of the high-top shoe sole.

[0035] Due to the adoption of the above technical solutions, the present invention has significant technical effects:

[0036] A method and device for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole. Using machine vision algorithms, a three-primary-color image of the shoe sole with glue is obtained through an industrial camera paired with different light sources. The blue-channel image in the three channels is separated, and the detection area is fully automatically extracted and detected to achieve the detection of glue overflow on the outer side of the shoe sole, and the detection of lack of glue or broken glue on the inner side. This fully automatic shoe sole glue spraying quality detection has less impact on the physical health of workers and is not affected by human subjectivity. It can detect the glue overflow on the outer side of the shoe, and the lack of glue or broken glue on the inner side more accurately and comprehensively. It can not only solve the problem of visual blind spots, but also automatically generate the detection area, and the edge accuracy can reach within 0.2 mm. This method is not restricted by product types and placement angles, and has a wide range of adaptability, which greatly improves production efficiency and product quality. Brief Description of the Drawings

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, all other embodiments obtained without creative efforts belong to the scope of protection of the present invention.

[0038] Figure 1 It is a schematic flowchart of automatically detecting glue on the inner and outer surfaces of a high-top shoe sole in an embodiment of the present invention;

[0039] Figure 2 It is a schematic diagram of the physical object of a glue-overflow shoe sole under a blue light source in an embodiment of the present invention;

[0040] Figure 3 It is a schematic diagram of extracting the region of interest of the gray value in an embodiment of the present invention;

[0041] Figure 4 It is a schematic diagram of the position serial numbers of the processed area on the outer side of the shoe sole in an embodiment of the present invention;

[0042] Figure 5 It is a schematic diagram of the new position serial numbers of the processed area on the outer side of the shoe sole in an embodiment of the present invention;

[0043] Figure 6 It is a schematic diagram of the physical object of the glue-overflow detection area on the outer side of a high-top shoe sole in an embodiment of the present invention.

[0044] Figure 7 It is a schematic diagram of the position serial numbers of the processed area on the inner side of the shoe sole in an embodiment of the present invention;

[0045] Figure 8 It is a schematic diagram of the new position serial numbers of the processed area on the inner side of the shoe sole in an embodiment of the present invention;

[0046] Figure 9It is a schematic diagram of the physical object of the glue shortage or glue breakage detection area on the inner side of the high-top shoe sole in the embodiment of the present invention. Detailed implementation mode

[0047] The present invention will be further described in detail below in conjunction with embodiments. The following embodiments are explanations of the present invention, and the present invention is not limited to the following embodiments.

[0048] Embodiment:

[0049] Please refer to Figure 1 , the present invention provides a method for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole, including the following steps:

[0050] Step S10, obtaining the images to be detected on the inner and outer surfaces of the high-top shoe sole, where the high-top shoe sole in the first image to be detected has a first bright area and a second bright area; the high-top shoe sole in the second image to be detected only has a second light-shielding area;

[0051] Step S20, extracting the region of interest in the first image to be detected, where the region of interest is the bright area of the high-top shoe sole; extracting the region of interest in the second image to be detected, where the region of interest is the second light-shielding area of the high-top shoe sole;

[0052] Step S30, selecting the first bright area located on the lower side to form the glue overflow detection area on the outer side of the high-top shoe sole; selecting the upper edge glue line of the second light-shielding area, and taking the area formed by translating the upper edge glue line downward by a certain distance as the glue shortage or glue breakage detection area on the inner side of the high-top shoe sole.

[0053] Specifically, execute step S10 to obtain the images to be detected on the inner and outer sides of the high-top shoe sole.

[0054] In an embodiment of the present invention, a glue quality detection device for the sole is used to detect the glue quality on the inner and outer surfaces of a high-top sole. The sole glue quality detection device includes: a frame, a conveyor belt, a plane mirror, a camera assembly, and a light source assembly; the conveyor belt is installed on the frame and has plane mirrors on both sides. The conveyor belt is made of a light-transmitting material and is used to convey the sole. There is a detection position above the conveyor belt; the camera assembly includes at least a first camera, a second camera, a third camera, and a fourth camera, which are respectively arranged at intervals around the detection position above. The lenses of the camera assembly are inclined downward, and the lens directions are aligned with the detection position below; the first camera is used to photograph the left outer side and the right inner side of the sole; the second camera combines the plane mirror to reflect the outer side of the sole tail to photograph the inner side and the outer side of the sole tail; the third camera is used to photograph the right outer side and the left inner side of the sole; the fourth camera combines the plane mirror to reflect the outer side of the sole tail to photograph the front outer side and the front inner side of the sole; the light source assembly includes: a first light source, a second light source, a third light source, and a light source controller. The light source controller is electrically connected to the first light source, the second light source, and the third light source, and is used to control the turning on and off of each light source; the first light source is located inside the conveyor belt and below the detection position, and is used to emit bottom light to the sole on the detection position. The bottom light is white light; the second light source is arranged below the camera assembly and above the detection position, and is used to emit irradiation light to at least the front, rear, left, and right outer sides of the sole on the detection position. The second light source is blue light; the third light source is arranged below the camera assembly and above the detection position, and is used to emit detection light to the sole on the detection position. The third light source is UV light; the light source assembly is inclined downward, and the emitted light is directed at the detection position and irradiates the sole to be detected.

[0055] Another embodiment of the present invention, the sole gluing quality detection device includes: a frame, a conveyor belt, a camera assembly, and a light source assembly; the conveyor belt is installed on the frame, the conveyor belt is made of light-transmitting material, the conveyor belt is used to convey the sole, and there is a detection position above the conveyor belt; the camera assembly at least includes a first camera, a second camera, a third camera, a fourth camera, a fifth camera, and a sixth camera. The first camera, the second camera, the third camera, and the fourth camera are respectively arranged around the detection position at intervals, and the lenses of the camera assembly are inclined downward, and the lens directions are aligned with the detection position below; since the distance between the front end and the tail end of the sole is too large, the camera cannot focus on the front end and the tail end of the sole at the same time. Therefore, the fifth camera is below the second camera and is located at the front side of the detection position, and the sixth camera is below the fourth camera and is located at the rear side of the detection position; the first camera is used to photograph the left outer side and the right inner side of the sole; the second camera is used to photograph the inner side of the tail end of the sole; the third camera is used to photograph the right outer side and the left inner side of the sole; the fourth camera is used to photograph the inner side of the front end of the sole; the fifth camera is used to photograph the outer side of the front end of the sole; the sixth camera is used to photograph the outer side of the tail end of the sole.

[0056] In the embodiment of the present invention, since the conveyor belt is made of light-transmitting material and does not reflect light, when only the second light source on one side emits irradiation light to the high-top sole at the detection position, the first light source at the bottom of the conveyor belt does not generate light, and the conveyor belt area photographed by the camera is a dark area, and only the high-top sole is illuminated by the irradiation light to form a bright area. At the same time, since the second light source is arranged below the camera assembly, the high-top sole in the first image to be detected has a first bright area and a second bright area. Please refer to Figure 2 , the outer side of the sole close to the camera and the light source is the first bright area, and the partial area of the sole far from the camera and the light source and the inner side of the high-top sole far from the camera and the light source are the second bright area.

[0057] In this embodiment, the above-mentioned sole gluing quality detection device is used to obtain the image to be detected of the outer side of the high-top sole. In other embodiments, other sole gluing quality detection devices can also be used, as long as the light source is arranged below the camera, so that the high-top sole in the image to be detected has a first bright area and a second bright area.

[0058] In the embodiment of the present invention, since the conveyor belt is made of light-transmitting material and does not reflect light, when the first light source inside the conveyor belt emits irradiation light to the high-top sole at the detection position, no light is generated above the conveyor belt, and the conveyor belt area photographed by the camera is a bright area, and only a second light-shielding area is formed at the high-top sole, so that the high-top sole in the second image to be detected only has a second light-shielding area.

[0059] Execute step S20. After obtaining the images to be detected on the inner and outer surfaces of the high-top shoe sole using the above camera, extract the regions of interest in the images to be detected.

[0060] In the embodiment of the present invention, set a lower limit value for the shoe sole area screening. Screen the area where the shoe sole is located from the images to be detected, and perform internal filling on this area to form an image containing only the shoe sole. Please refer to Figure 3 , extract the regions of interest in the first image to be detected using pixel gray scale, and set a lower limit value for the threshold. After screening the area of the first image to be detected, set the pixel values of the bright regions on the outer side of the shoe sole close to the camera and light source, the partial regions of the shoe sole far from the camera and light source, and the bright regions on the inner side of the high-top shoe sole far from the camera and light source to 0, and set the pixel values of the first light-shielding regions on the partial shoe sole close to the camera and light source to 255. Extract the regions of interest from the images to be detected according to the pixel gray scale values, where the bright regions with pixel values set to 0 are the regions of interest.

[0061] Extract the regions of interest in the second image to be detected using pixel gray scale, and set an upper limit value for the threshold. After screening the area of the second image to be detected, the second light-shielding regions with pixel values of the shoe sole set to 0 are the regions of interest.

[0062] In the embodiment of the present invention, after extracting the regions of interest in the first image to be detected and the second image to be detected, process the regions of interest, separate the regions of interest into individual components to form single-connected domains, and perform morphological opening operations on the single-connected domains to remove surrounding burrs and breakpoints.

[0063] Execute step S30. Select the first bright region located at the lower side to form an overflow glue detection region on the outer side of the high-top shoe sole; select the upper edge glue line of the second light-shielding region, and use the region formed by translating the upper edge glue line downward by a certain distance as a lack of glue or broken glue detection region on the inner side of the high-top shoe sole.

[0064] In the embodiment of the present invention, please refer to Figure 4, perform a minimum bounding rectangle process on the first bright region, extract the pixel points with drastic pixel changes in the first bright region to obtain the outer contour of the first bright region; obtain a position coordinate array based on the position coordinates of all points on the outer contour; screen the minimum column value in the position coordinate array and obtain the minimum serial number index of the minimum column value in the position coordinate array; if the minimum serial number index is greater than 0, rearrange and combine the position coordinate array to obtain a new position array such that the coordinate of the minimum serial number index is the first point in the new position array; if the minimum serial number index is equal to 0, rearrange and combine the position coordinate array, and the obtained new position array is the same as the original position array; judge the sorting rule of the new position array, which can be specified as clockwise or counterclockwise. If the sorting is specified as clockwise, when counterclockwise sorting appears, the position array needs to be sorted in reverse; if the sorting is specified as counterclockwise, when clockwise sorting appears, the position array also needs to be sorted in reverse; calculate the minimum bounding rectangle of the outer contour of the first bright region, set the indentation dimension h1 in the long direction and the lengthening dimension w1 in the wide direction to obtain a new transformed rectangle.

[0065] In the embodiment of the present invention, the new transformed rectangle intersects the outer contour of the first bright region at four set points A, B, C, and D. In the coordinate axis, let AB and CD be the column directions, and AD and BC be the row directions. Divide the four points into two groups according to the column values. The two points BC with larger column values are used as the first group, and the two points AD with smaller column values are used as the second group. Among the first group, point B is the point with a smaller row value, and among the second group, point A is the point with a smaller row value. Obtain the position serial numbers of points A and B in the new position array respectively.

[0066] In the embodiment of the present invention, please refer to Figure 5 , record all the point sets from point A to point B, which form a curve segment along the shoe bottom line. Set a fixed distance, and translate the curve segment downward by this fixed distance to generate a new equidistant parallel line segment; the curve segment and the new equidistant parallel line segment are connected end to end to form a detection area, and the detection area is the glue overflow detection area on the outer side of the high-top shoe sole.

[0067] In the embodiment of the present invention, please refer to Figure 6 , use UV light to re-obtain the glue image to be detected on the outer side of the high-top shoe sole, and perform glue overflow detection on the glue image to be detected in the glue overflow detection area on the outer side of the high-top shoe sole.

[0068] In the embodiment of the present invention, please refer to Figure 7, set the lower limit value of the sole area screening, screen the area where the sole is located from the to-be-detected image, and perform internal filling on this area to form an image containing only the sole. Perform a minimum bounding rectangle process on the second light-shielding area, extract the pixel points with drastic pixel changes in the second light-shielding area to obtain the outer contour of the second light-shielding area; obtain the position coordinate array according to the position coordinates of all points on the outer contour; screen the minimum column value in the position coordinate array and obtain the minimum serial number index of the minimum column value in the position coordinate array; if the minimum serial number index is greater than 0, rearrange and combine the position coordinate array to obtain a new position array, so that the minimum serial number index coordinate is the first point position in the new position array; if the minimum serial number index is equal to 0, rearrange and combine the position coordinate array, and the obtained new position array is the same as the original position array; judge the sorting rule of the new position array, which can be specified as clockwise or counterclockwise. If the sorting is specified as clockwise, when counterclockwise sorting appears, the position array needs to be sorted in reverse; if the sorting is specified as counterclockwise, when clockwise sorting appears, the position array also needs to be sorted in reverse; calculate the minimum bounding rectangle of the outer contour of the second light-shielding area, set the indentation dimension h1 in the long direction, and make the minimum bounding rectangle translate a distance d1 along its short axis direction to obtain a new transformed rectangle.

[0069] In the embodiment of the present invention, according to the new transformed rectangle intersecting with the outer contour of the second light-shielding area at two set points A and B, respectively determine the position serial numbers of points A and B in the new position array according to the position coordinates of points A and B;

[0070] In the embodiment of the present invention, please refer to Figure 8 , record all the point sets from point A to point B, which form a curve segment along the shoe bottom line, set a fixed distance, and translate the curve segment downward by this fixed distance to generate a new equidistant parallel line segment; the curve segment and the new equidistant parallel line segment are connected end to end to form a detection area, and the detection area is the detection area for glue shortage or breakage on the inner side of the high-top shoe sole.

[0071] In the embodiment of the present invention, please refer to Figure 9 , use UV light to re-obtain the glue to-be-detected image of the inner side of the high-top shoe sole, and perform glue shortage or breakage detection on the glue to-be-detected image in the detection area for glue shortage or breakage on the inner side of the high-top shoe sole.

[0072] The embodiment of the present invention includes an automatic glue detection device for the inner and outer sides of a high-top shoe sole, including:

[0073] A to-be-detected image acquisition module, configured to acquire the to-be-detected image of the inner and outer sides of the high-top shoe sole, wherein the high-top shoe sole in the first to-be-detected image has a first bright area and a second bright area; the high-top shoe sole in the second to-be-detected image only has a second light-shielding area;

[0074] The region of interest processing module is used to extract the region of interest in the first image to be detected, where the region of interest is the bright region of the high-top shoe sole; and extract the region of interest in the second image to be detected, where the region of interest is the second light-shielding region of the high-top shoe sole.

[0075] The glue detection region forming module is used to select the first bright region located on the lower side to form the glue overflow detection region on the outer side of the high-top shoe sole; and select the upper edge glue line of the second light-shielding region, and use the region formed by translating the upper edge glue line downward by a certain distance as the glue shortage or glue break detection region on the inner side of the high-top shoe sole.

[0076] In the embodiment of the present invention, only the method of collecting images from one direction and performing machine vision algorithms on them to detect glue overflow on the outer side, glue shortage or glue break on the inner side is introduced. In order to obtain all glue overflow detections on the outer side of the high-top shoe sole and all glue shortage or glue break detections on the inner side, it is necessary to take pictures from four directions of front, back, left, and right respectively and automatically generate corresponding detection regions, so as to complete the glue quality detection of the entire shoe sole.

[0077] In addition, it should be noted that all equivalent or simple changes made according to the structure, features and principles described in the inventive concept of the present invention are included in the protection scope of the present invention. Those skilled in the art of the present invention can make various modifications or supplements to the described specific embodiments or use similar methods to replace them, as long as they do not deviate from the structure of the present invention or exceed the scope defined by this claims, they should fall within the protection scope of the present invention.

Claims

1. A method for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole, characterized in that, The steps include: Acquire the images to be detected of the inner and outer surfaces of the high-top shoe sole, wherein the high-top shoe sole in the first image to be detected has a first bright light area and a second bright light area; and the high-top shoe sole in the second image to be detected has only a second light-shielded area; Extracting an area of interest in the first image to be detected, wherein the area of interest is a bright area of the high-top shoe sole; extracting an area of interest in the second image to be detected, wherein the area of interest is a second light-shielded area of the high-top shoe sole; The first bright light area on the lower side is selected to form a glue overflow detection area on the outer side of the high-top shoe sole; The upper edge glue line of the second light-shielding area is selected, and the area formed by translating the upper edge glue line downward for a certain distance is used as the glue shortage or glue breakage detection area on the inner side of the high-top shoe sole; Re-acquire the glue detection images on the inner and outer sides of the high-top sole by using UV light, perform glue overflow detection on the glue detection images in the glue overflow detection area on the outer side of the high-top sole, and perform glue shortage or glue breakage detection on the glue detection images in the glue shortage or glue breakage detection area on the inner side of the high-top sole; When the glue detection image is used for glue detection in the glue detection area on the inner and outer sides of the high-top sole, the glue added with fluorescent liquid is combined with UV light irradiation to separate the blue channel image of the glue detection image, so as to judge whether there is glue overflow on the outer side of the high-top sole and whether there is glue shortage or broken on the inner side of the high-top sole; Among them, the first bright light area located on the lower side is selected, and the minimum circumscribed rectangle processing is performed on the first bright light area and the second shading area, including: extracting the pixel points of the first bright light area with drastic pixel changes to obtain the outer contour of the first bright light area; extracting the pixel points of the second shading area with drastic pixel changes to obtain the outer contour of the second shading area; obtaining a position coordinate array according to the position coordinates of all points on the outer contour; screening the minimum column value in the position coordinate array, and obtaining the minimum serial number index of the minimum column value in the position coordinate array; if the minimum serial number index is greater than 0, rearranging and combining the position coordinate array to obtain a new position array, so that the minimum serial number index coordinate is the first point of the new position array; if the minimum serial number index is equal to 0, rearrange the position coordinate array to keep the new position array consistent with the original position array; determine the sorting rule of the new position array, which can be set to clockwise or counterclockwise. If the sorting is set to clockwise, when counterclockwise sorting occurs, the position array needs to be reversely sorted; if the sorting is set to counterclockwise, when clockwise sorting occurs, the position array also needs to be reversely sorted; calculate the minimum bounding rectangle of the outer contour of the first bright area, set the indentation size h1 in the long direction, and the lengthen size w1 in the wide direction to obtain the transformed new rectangle; calculate the minimum bounding rectangle of the outer contour of the second shading area, set the indentation size h1 in the long direction, and make the minimum bounding rectangle translate along its short axis by a distance d1 to obtain the transformed new rectangle.

2. The method for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole according to claim 1, characterized in that, Obtaining the first image to be detected on the outer side of the high-top shoe sole specifically includes: irradiating the high-top shoe sole with an oblique light source, and obtaining the first image to be detected on the outer side of the high-top shoe sole by using a camera above the frame. The camera is located above the light source, so that the high-top shoe sole in the first image to be detected has a first bright area, a second bright area and a first light-shielding area in the middle. The outer side of the shoe sole close to the camera and the light source is the first bright area, and the inner side of the high-top shoe sole far from the camera and the light source is the second bright area; Obtaining the second image to be detected on the inner side of the high-top shoe sole specifically includes: irradiating vertically upward by the light source at the bottom inside the conveyor belt, and not irradiating the other light sources, and obtaining the second image to be detected of the high-top shoe sole by using a camera above the frame. The high-top shoe sole in the second image to be detected only has a second light-shielding area.

3. A method for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole according to claim 1, characterized in that, Extracting the regions of interest in the first image to be detected and the second image to be detected specifically includes: Setting a lower limit value for the shoe sole area screening, screening the area where the shoe sole is located from the first image to be detected and the second image to be detected, and filling the inside of the area to form an image that only contains the shoe sole; By setting a lower threshold value, extracting the region of interest from the first image to be detected according to the pixel gray value, and the region of interest is the bright area of the high-top shoe sole; By setting an upper threshold value, extracting the region of interest from the second image to be detected according to the pixel gray value, and the region of interest is the second light-shielding area of the high-top shoe sole.

4. A method for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole according to claim 1, characterized in that, Forming the glue overflow detection area on the outer side of the high-top shoe sole specifically includes: According to the fact that the new rectangle after transformation intersects the outer contour of the first bright area at four set points A, B, C, and D. In the coordinate axis, let AB and CD be the column directions, and AD and BC be the row directions. Divide the four points into two groups according to the column values. The two points BC with larger column values are used as the first group, and the two points AD with smaller column values are used as the second group. Among the first group, point B is the point with a smaller row value, and among the second group, point A is the point with a smaller row value. Respectively obtain the position numbers of points A and B in the new position array; Record all the point sets from point A to point B in the first bright area, which form a curve segment along the shoe bottom line. Set a fixed distance, and translate the curve segment downward by this fixed distance to generate a new equidistant parallel line segment; the curve segment and the new equidistant parallel line segment are connected end to end to form a detection area, and the detection area is the glue overflow detection area on the outer side of the high-top shoe sole.

5. A method for automatically detecting glue on the inner and outer surfaces of a high-top shoe sole according to claim 1, characterized in that, Forming the glue shortage or glue breakage detection area on the inner side of the high-top shoe sole specifically includes: According to the fact that the new rectangle after transformation intersects the outer contour of the second light-shielding area at two set points A and B, respectively determine the position numbers of points A and B in the new position array according to the position coordinates of points A and B; Record all the point sets from point A to point B in the second light-shielding area, which form a curve segment along the shoe bottom line. Set a fixed distance, and translate the curve segment downward by this fixed distance to generate a new equidistant parallel line segment; the curve segment and the new equidistant parallel line segment are connected end to end to form a detection area, and the detection area is the glue shortage or glue breakage detection area on the inner side of the high-top shoe sole.

6. An automatic glue detecting device for the inner and outer surfaces of a high-top shoe sole, characterized in that, The device implements the method described in any one of claims 1-5 above.

Images