Method and device for detecting inner and outer surfaces of high-top shoe soles

Abstract

This invention relates to the field of footwear quality inspection, and more particularly to a method and apparatus for inspecting the inner and outer surfaces of high-top shoe soles. The method includes the following steps: Multiple industrial cameras in front, behind, left, and right directions are mounted above the frame of the high-top shoe sole inspection station, along with corresponding combination light sources in multiple directions. A bottom light source is mounted below the inspection station. The brightness of the light sources in different directions is controlled by the combination light sources in multiple directions and the bottom light source. The industrial cameras acquire images of the high-top shoe sole from different directions; the location to be inspected is identified in the images; the multiple industrial cameras acquire images of the high-top shoe sole corresponding to the location to be inspected using different light sources; and the images of the high-top shoe sole corresponding to the location to be inspected are then inspected to detect any excess glue, insufficient glue, or broken glue at the location to be inspected. This invention makes the quality inspection of high-top shoe sole glue unaffected by human intervention, resulting in more accurate and comprehensive inspection, solving the problem of blind spots, and improving production efficiency and product quality.

Description

Technical Field

[0001] This invention relates to the field of footwear quality inspection, and more particularly to a method and apparatus for inspecting the inner and outer surfaces of high-top shoe soles. Background Technology

[0002] With the development of my country's industrialization, the shoe manufacturing industry has also ushered in a period of rapid development. As a labor-intensive industry, the shoe manufacturing industry is also facing a series of problems such as labor shortage, rising labor costs, and low work efficiency. In the shoe manufacturing process, whether manual or machine is used for applying glue to the sole, it is impossible to guarantee the quality of the glue application. When defective products are produced, they need to be reworked, which not only affects the production efficiency of enterprises, but also damages the reputation of enterprises when such shoes enter the market.

[0003] Regarding the quality inspection of shoe sole adhesives, some companies rely on manual visual inspection to ensure product quality. This method is not only easily affected by human factors, but also carries the risk of toxic gases evaporating from the adhesive, which can harm human health. Other companies use industrial cameras mounted on both sides of the sole to inspect product quality. However, this method has two problems: first, it cannot automatically detect the quality of the sole adhesive, requiring manual settings for the detection device; second, current technology generally only tests the adhesive quality of flat soles, and there is no suitable solution for automatically detecting the adhesive quality of the inner and outer surfaces of high-top soles. Summary of the Invention

[0004] This invention addresses the problem that the quality inspection of high-top shoe sole adhesive is easily affected by human conditions and has blind spots in the inspection field in the existing technology, and provides a method and device for inspecting the inner and outer surfaces of high-top shoe soles.

[0005] The technical solution of the present invention is as follows:

[0006] A method for testing the inner and outer surfaces of high-top shoe soles includes the following steps:

[0007] The high-top shoe sole detection station is equipped with multiple industrial cameras in the front, back, left, and right directions and a combination light source corresponding to multiple directions. A bottom light source is installed below the detection station. The brightness of the light source in different directions is controlled by the combination light source in multiple directions and the bottom light source. The industrial cameras are used to capture images of the high-top shoe sole in different directions to be detected.

[0008] Identify the location to be detected in the image;

[0009] Multiple industrial cameras from different directions use different light sources to acquire images of the high-top shoe sole corresponding to the location to be detected;

[0010] The high-top shoe sole image corresponding to the location to be detected is inspected to detect any excess glue, missing glue, or broken glue at the location to be detected.

[0011] Furthermore, the combined light source in multiple directions includes a UV light source in the front-to-back direction, a left and right combined light source including a blue light source and a UV light source, and the bottom light source is a side-back white light source.

[0012] Furthermore, specifically including:

[0013] The first industrial camera located on the left side above the frame uses the blue light source controlled by the left combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the left side of the shoe sole.

[0014] The third industrial camera located on the right side above the frame uses the blue light source controlled by the right combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the right side of the shoe sole.

[0015] The first industrial camera located on the left side above the frame uses the white backlight to capture an image of the inner right inspection surface of the shoe sole while other light sources are dark.

[0016] The third industrial camera, located on the right side above the frame, uses the control of the side-back white light source to be on while other light sources are off, to capture an image of the inner detection surface on the left side of the shoe sole.

[0017] The second industrial camera located on the front side above the frame uses the control of the side back white light source to be on while other light sources are off, to capture images of the inner inspection surface of the shoe sole's heel.

[0018] The fourth industrial camera, located above the rear of the frame, uses the control of the side-back white light source to be lit while other light sources are dimmed to capture images of the inner inspection surface at the front end of the shoe sole.

[0019] The second industrial camera located on the front side above the frame uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, and combines this with the first plane mirror at the heel of the shoe to acquire an image of the outer inspection surface of the heel of the shoe.

[0020] The fourth industrial camera, located above the rear of the frame, uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, and combines this with the second plane mirror at the front of the shoe sole to acquire an image of the outer inspection surface at the front of the shoe sole.

[0021] Furthermore, specifically including:

[0022] The first industrial camera located on the left side above the frame uses the blue light source controlled by the left combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the left side of the shoe sole.

[0023] The third industrial camera located on the right side above the frame uses the blue light source controlled by the right combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the right side of the shoe sole.

[0024] The first industrial camera located on the left side above the frame uses the white backlight to capture an image of the inner right inspection surface of the shoe sole while other light sources are dark.

[0025] The third industrial camera, located on the right side above the frame, uses the control of the side-back white light source to be on while other light sources are off, to capture an image of the inner detection surface on the left side of the shoe sole.

[0026] The second industrial camera located on the front side above the frame uses the control of the side back white light source to be on while other light sources are off, to capture images of the inner inspection surface of the shoe sole's heel.

[0027] The fourth industrial camera, located above the rear of the frame, uses the control of the side-back white light source to be lit while other light sources are dimmed to capture images of the inner inspection surface at the front end of the shoe sole.

[0028] The fifth industrial camera, located below the second industrial camera, is positioned in front of the detection station. It uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, to capture images of the outer detection surface at the front of the shoe sole.

[0029] The sixth industrial camera, located below the fourth industrial camera, is positioned behind the detection station. It uses a blue light source that controls the left and right combined light sources to illuminate while other light sources remain dim, to capture images of the outer inspection surface of the shoe sole's heel.

[0030] Furthermore, it also includes using a white light source on the side to collect images of the inner side of the sole; using blue stripes on the left and right to collect images of the outer side of the sole; adding fluorescent liquid to the sole glue, using a UV light source to illuminate the area to be tested on the sole, and producing different bright and dark areas to detect whether there is excess glue on the outer side of the sole and whether there is missing or broken glue on the inner side of the sole.

[0031] Furthermore, the specific areas to be inspected on the inner and outer surfaces of the high-top shoe sole include:

[0032] The high-top shoe sole is illuminated by different light sources, and the first image of the high-top shoe sole to be detected is obtained by an industrial camera. The industrial camera is located above the light source, so that the high-top shoe sole in the first image to be detected has a first bright area and a second bright area. The outer side of the shoe sole closer to the industrial camera and the light source is the first bright area, and the inner side of the high-top shoe sole farther away from the industrial camera and the light source is the second bright area.

[0033] The high-top shoe sole is illuminated vertically upwards by a light source at the bottom inside the conveyor belt, while other light sources are not used. An industrial camera above the frame is used to acquire a second image of the high-top shoe sole to be inspected. The high-top shoe sole in the second image to be inspected only has a second light-blocking area.

[0034] Extract the region of interest (ROI) from the first image to be detected, wherein the ROI is the bright area of ​​the high-top shoe sole; extract the ROI from the second image to be detected, wherein the ROI is the second light-blocking area of ​​the high-top shoe sole;

[0035] Select the first bright area on the lower side to form the glue overflow detection area on the outer side of the high-top shoe sole; select the glue line along the upper edge of the second light-blocking area, and move the glue line downwards a certain distance to form the area to be used as the glue missing or broken glue detection area on the inner side of the high-top shoe sole.

[0036] A device for detecting the inner and outer surfaces of a high-top shoe sole, comprising:

[0037] The light source control module is used to install industrial cameras in multiple directions (front, back, left, and right) and corresponding combination light sources above the frame of the high-top shoe sole detection position. A bottom light source is installed below the detection position. The brightness of the light sources in different directions is controlled by the combination light sources in multiple directions and the bottom light source. The industrial cameras are used to collect images of the high-top shoe sole to be detected in different directions.

[0038] The visual acquisition module is used to identify the location to be detected in the image to be detected. Multiple industrial cameras in different directions use different light sources to acquire the high-top shoe sole image corresponding to the location to be detected.

[0039] The glue detection module is used to detect the high-top shoe sole image corresponding to the detected position, and to detect the glue overflow, glue shortage or glue breakage at the detected position.

[0040] Furthermore, the light source control module includes: a side-back white light source, a blue light source, and a UV light source.

[0041] The side-back white light source is located inside the conveyor belt and below the detection position, and is used to emit backlight to the sole of the shoe at the detection position;

[0042] The blue light source is positioned below the industrial camera assembly and above the detection position, and is used to emit illumination light onto the outer sides of the left, right, front, and rear of the shoe sole at the detection position.

[0043] The UV light source is positioned below the industrial camera assembly and above the detection position, and is used to emit detection light onto the sole of the shoe at the detection position.

[0044] The blue light source and UV light source are installed at a downward angle, and the emitted light is directed towards the detection position, illuminating the sole of the shoe to be detected.

[0045] Furthermore, the vision acquisition module includes: a first industrial camera, a second industrial camera, a third industrial camera, a fourth industrial camera, a first plane mirror, and a second plane mirror. The industrial cameras are respectively arranged at intervals around the detection position above the detection position, and the plane mirrors are arranged on both sides of the conveyor belt.

[0046] The lens of the industrial camera assembly is tilted downwards, with the lens direction aligned with the detection position below.

[0047] The first industrial camera is used to photograph the left outer side and the right inner side of the shoe sole;

[0048] The second industrial camera, in conjunction with the first plane mirror, is used to photograph the inner side of the heel of the shoe sole and the outer side of the heel reflected by the plane mirror.

[0049] The third industrial camera is used to photograph the right outer side and the left inner side of the shoe sole;

[0050] The fourth industrial camera, in conjunction with the second plane mirror, is used to photograph the inner front side of the shoe sole and the outer front side reflected by the plane mirror.

[0051] Furthermore, the vision acquisition module includes: a first industrial camera, a second industrial camera, a third industrial camera, a fourth industrial camera, a fifth industrial camera, and a sixth industrial camera. The first, second, third, and fourth industrial cameras are respectively arranged at intervals around the detection position above it. The lenses of the industrial camera components are tilted downwards and the lens direction is aligned with the detection position below. The fifth industrial camera is below the second industrial camera and located in front of the detection position, and the sixth industrial camera is below the fourth industrial camera and located behind the detection position.

[0052] The first industrial camera is used to photograph the left outer side and the right inner side of the shoe sole;

[0053] The second industrial camera is used to photograph the inner side of the heel of the shoe sole;

[0054] The third industrial camera is used to photograph the right outer side and the left inner side of the shoe sole;

[0055] The fourth industrial camera is used to photograph the inner front side of the shoe sole;

[0056] The fifth industrial camera is used to photograph the outer front side of the shoe sole;

[0057] The sixth industrial camera is used to photograph the outer side of the heel of the shoe sole.

[0058] This invention, by adopting the above technical solutions, has significant technical effects:

[0059] By utilizing machine vision algorithms and employing industrial cameras with different light sources, this invention enables fully automated extraction and inspection of the detection areas on both the inner and outer sides of shoe soles. This fully automated sole adhesive quality inspection has minimal impact on human health and is unaffected by human subjectivity. It provides more accurate and comprehensive detection of issues such as glue breakage, insufficient glue, and glue overflow on each side of the shoe. It not only solves the problem of blind spots but also automatically generates detection areas, significantly improving production efficiency and product quality. Attached Figure Description

[0060] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, all other embodiments obtained without creative effort are within the scope of protection of the present invention.

[0061] Figure 1 This is a schematic diagram of the structure of the high-top shoe sole inner and outer surface detection device according to an embodiment of the present invention;

[0062] Figure 2 This is a flowchart illustrating the method for detecting the inner and outer surfaces of high-top shoe soles according to an embodiment of the present invention.

[0063] Figure 3 This is a schematic diagram of an industrial camera using a blue light source controlled by the left combined light source, according to an embodiment of the present invention.

[0064] Figure 4 This is a schematic diagram of an industrial camera using a blue light source controlled by a right-side combined light source, according to an embodiment of the present invention.

[0065] Figure 5 This is a schematic diagram of an industrial camera using a white backlight source on the control side, according to an embodiment of the present invention.

[0066] Figure 6 This is a schematic diagram of an industrial camera using a UV light source that controls a right-side combined light source for detection, according to an embodiment of the present invention.

[0067] Figure 7 This is a schematic diagram illustrating the principle of how an industrial camera in this invention uses a blue light source that controls the left and right combined light sources in conjunction with a plane mirror to collect data.

[0068] The labels for the attached figures are as follows:

[0069] 1. First plane mirror; 2. Inner side of the heel of the shoe sole; 3. Outer side of the shoe sole reflected by the plane mirror. Detailed Implementation

[0070] The present invention will be further described in detail below with reference to the embodiments. The following embodiments are explanations of the present invention, but the present invention is not limited to the following embodiments.

[0071] Example:

[0072] Please refer to Figure 1 This invention provides a device for detecting the inner and outer surfaces of high-top shoe soles, comprising:

[0073] The light source control module uses a combination of light sources from multiple directions and a bottom light source to control the brightness of light sources from different directions;

[0074] The vision acquisition module uses industrial cameras in multiple directions (front, back, left, and right) to acquire images of the high-top shoe sole from different angles.

[0075] The glue detection module identifies the location to be detected in the image and detects whether there is excess glue, insufficient glue, or broken glue at the location.

[0076] This embodiment of the invention also includes a position detection device. A conveyor belt is installed above the bottom light source. The conveyor belt is made of a light-transmitting material and is used to transport high-top shoe soles. A detection position is located above the conveyor belt and a through-beam sensor is installed thereon. When the conveyor belt transports the high-top shoe sole to the detection position above the conveyor belt, the through-beam sensor senses that the high-top shoe sole has reached the detection position and sends a high-top shoe sole arrival signal to the industrial camera for image acquisition.

[0077] Specifically, the light source control module of this embodiment includes: a UV light source in the front-to-back direction, a left-to-right combined light source including a blue light source and a UV light source in the left-to-right direction, and a side-back white light source located inside the conveyor belt. The side-back white light source is located not only inside the conveyor belt but also below the detection position, and is used to emit bottom light onto the sole of the shoe at the detection position; the blue light source is located below the industrial camera assembly and above the detection position, and is used to emit illumination light onto the outer sides of the left and right sides of the sole of the shoe at the detection position; the UV light source is located below the industrial camera assembly and above the detection position, and is used to emit detection light onto the sole of the shoe at the detection position; the blue light source and the UV light source are installed at a downward angle, and the emitted light is directed toward the detection position, illuminating the sole of the shoe to be detected.

[0078] The visual acquisition module of this invention includes: a first industrial camera, a second industrial camera, a third industrial camera, a fourth industrial camera, a first plane mirror, and a second plane mirror. The industrial cameras are spaced apart and arranged around the detection position above it. The plane mirrors are positioned on both sides of the conveyor belt. The lenses of the industrial camera assemblies are tilted downwards, with the lens direction aligned with the detection position below. The first industrial camera is mounted on the left side above the frame of the high-top shoe sole detection position, and is used to capture the left outer side and right inner side of the shoe sole. Figure 7 As shown, the second industrial camera is installed on the front side of the frame above the high-top shoe sole detection position, and together with the first plane mirror 1 behind the detection position, it is used to photograph the inner rear side 3 of the shoe sole and the outer rear side 2 reflected by the plane mirror; the third industrial camera is installed on the right side of the frame above the high-top shoe sole detection position, and is used to photograph the outer right side and the inner left side of the shoe sole; the fourth industrial camera is installed on the rear side of the frame above the high-top shoe sole detection position, and together with the second plane mirror in front of the detection position, it is used to photograph the inner front side and the outer front side reflected by the plane mirror.

[0079] This invention also provides a method for detecting the location to be detected on the inner and outer surfaces of the sole of a high-top shoe, specifically including:

[0080] First, the high-top shoe sole is illuminated using different light sources. An industrial camera, positioned above the light sources, captures a first image of the high-top shoe sole to be inspected. This results in the high-top shoe sole in the first image having a first bright area, a second bright area, and a first shaded area in between. The outer side of the sole closest to the industrial camera and light source is the first bright area, the portion of the sole closest to the industrial camera and light source is the first shaded area, and the portion of the sole furthest from the industrial camera and light source, as well as the inner side of the high-top shoe sole furthest from the industrial camera and light source, constitutes the second bright area. Then, a light source at the bottom inside the conveyor belt illuminates the shoe vertically upwards, and an industrial camera above the frame captures a second image of the high-top shoe sole to be inspected. The high-top shoe sole in the second image only has the second shaded area.

[0081] Then, regions of interest (ROIs) are extracted from the first and second images to be detected. By setting a lower limit for the sole area, the area containing the sole is selected from the first and second images to be detected, and this area is filled to form an image containing only the sole. By setting a lower threshold, ROIs are extracted from the first image to be detected based on pixel grayscale values; the ROI is the bright area of ​​the high-top sole. By setting an upper threshold, ROIs are extracted from the second image to be detected based on pixel grayscale values; the ROI is the second shading area of ​​the high-top sole. The ROIs then need to be processed by separating them into individual components to form simply connected components. Morphological opening operations are performed on the simply connected components to remove surrounding burrs and breakpoints.

[0082] Select the first bright area located on the lower side, and process it using the minimum bounding rectangle method. Extract pixels with drastic pixel changes within the first bright area to obtain its outer contour. Based on the coordinates of all points on the outer contour, obtain a position coordinate array. Filter the position coordinate array to find the smallest column value and obtain its minimum index within the array. If the minimum index is greater than 0, rearrange and combine the position coordinate array to obtain a new position array, such that the minimum index coordinate is the first point in the new position array. If the minimum index is 0, rearrange the position coordinate array to obtain a new position array that is consistent with the original position array; determine the sorting rule of the new position array, which can be specified as clockwise or counterclockwise. If the sorting is specified as clockwise, the position array needs to be reversed when counterclockwise sorting occurs; if the sorting is specified as counterclockwise, the position array also needs to be reversed when clockwise sorting occurs; calculate the minimum bounding rectangle of the outer contour of the first bright area, set the indentation size h1 in the long direction and the extension size w1 in the wide direction to obtain the transformed new rectangle.

[0083] Finally, based on the intersection of the transformed new rectangle and the outer contour of the first bright area at four designated points A, B, C, and D, and considering AB and CD as column directions and AD and BC as row directions on the coordinate axis, the four points are divided into two groups according to their column values. The two points with larger column values ​​(BC) form the first group, and the two points with smaller column values ​​(AD) form the second group. In the first group, point B is the point with the smaller row value, and in the second group, point A is the point with the smaller row value. The position indices of points A and B in the new position array are obtained respectively. All point sets from point A to point B are recorded, forming a curve segment along the sole of the shoe. A fixed distance is set, and the curve segment is shifted downwards by this fixed distance to generate new equidistant parallel line segments. The curve segment and the new equidistant parallel line segments are connected end-to-end to form a detection area, which is the glue overflow detection area on the outer side of the high-top shoe sole. In this way, the glue image to be detected on the outer side of the high-top shoe sole can be re-acquired using UV light, and automatic glue overflow detection can be performed on the glue overflow detection area on the outer side of the high-top shoe sole.

[0084] A second light-blocking area is selected, and its minimum bounding rectangle is processed. Pixels with drastic pixel changes within the second light-blocking area are extracted to obtain its outer contour. A position coordinate array is obtained based on the coordinates of all points on the outer contour. The smallest column value in the position coordinate array is selected, and its minimum index is determined. If the minimum index is greater than 0, the position coordinate array is rearranged to obtain a new position array, such that the minimum index is the first point in the new position array. If the index is equal to 0, rearrange and combine the position coordinate array to obtain a new position array that is consistent with the original position array; determine the sorting rule of the new position array, which can be specified as clockwise or counterclockwise. If the sorting is specified as clockwise, the position array needs to be reversed when counterclockwise sorting occurs; if the sorting is specified as counterclockwise, the position array also needs to be reversed when clockwise sorting occurs; calculate the minimum bounding rectangle of the outer contour of the second shading area, set the longitudinal indentation size h1, and translate the minimum bounding rectangle a distance d1 along its minor axis to obtain the transformed new rectangle.

[0085] Finally, based on the intersection of the transformed new rectangle and the outer contour of the second light-blocking area at two designated points A and B, the position indices of points A and B in the new position array are obtained according to their coordinates. All point sets from point A to point B are recorded, forming a curve segment along the sole. A fixed distance is set, and the curve segment is shifted downwards by this fixed distance to generate new equidistant parallel line segments. The curve segment and the new equidistant parallel line segments are connected end-to-end to form a detection area, which is the detection area for missing or broken glue on the inner side of the high-top sole. In this way, UV light can be used to re-acquire the glue image to be detected on the inner side of the high-top sole, and automatic detection of missing or broken glue can be performed on the glue image in the detection area on the inner side of the high-top sole.

[0086] Please refer to Figure 2 This embodiment provides a method for detecting the inner and outer surfaces of high-top shoe soles, including the following steps:

[0087] Step S10: An industrial camera with multiple directions (front, back, left, right) and a combination light source corresponding to multiple directions are installed above the frame of the high-top shoe sole detection position. A bottom light source is installed below the detection position. The brightness of the light source in different directions is controlled by the combination light source in multiple directions and the bottom light source. The industrial camera is used to collect images of the high-top shoe sole in different directions to be detected.

[0088] Step S20: Identify the location to be detected in the image to be detected;

[0089] Step S30: Industrial cameras from multiple directions acquire images of the high-top shoe sole corresponding to the location to be detected using different light sources;

[0090] Step S40: Detect the high-top shoe sole image corresponding to the detection position, and detect the overflow, missing or broken glue conditions corresponding to the detection position.

[0091] Specifically, step S10 utilizes a combination of light sources from multiple directions, controls the brightness of light sources from different directions using a bottom light source, and uses an industrial camera to acquire images of the high-top shoe sole from different directions; such as Figure 3 As shown, the first industrial camera on the left side, located above the frame at the high-top shoe sole inspection position, uses the blue light source controlled by the left combination light source to be lit while other light sources are dark, to capture images of the outer inspection surface on the left side of the shoe sole.

[0092] like Figure 4 As shown, the third industrial camera on the right side, located above the frame at the high-top shoe sole inspection position, uses the blue light source controlled by the right combination light source to be on while other light sources are off, to capture images of the outer inspection surface on the right side of the shoe sole.

[0093] like Figure 7 As shown, the second industrial camera located above the frame of the high-top shoe sole detection position uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, and combines this with the first plane mirror behind the detection position to collect images of the outer detection surface of the shoe sole's heel.

[0094] The fourth industrial camera located above the frame of the high-top shoe sole inspection position uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, and combines this with the second plane mirror in front of the inspection position to collect images of the outer inspection surface of the front end of the shoe sole.

[0095] like Figure 5 As shown, the first industrial camera on the left side, located above the frame at the high-top shoe sole inspection position, uses a white light source on the control side to illuminate while other light sources are dimmed to capture images of the inner inspection surface on the right side of the shoe sole.

[0096] The second industrial camera located above the frame at the high-top shoe sole inspection position uses a white backlight on the control side to illuminate the image of the inner inspection surface of the shoe sole's heel while other light sources remain dark.

[0097] The fourth industrial camera located above the frame at the high-top shoe sole inspection position uses a white backlight on the control side to capture images of the inner inspection surface at the front of the shoe sole while other light sources are dim.

[0098] The third industrial camera on the right side, located above the high-top shoe sole inspection station, uses a white backlight on the control side to illuminate the image while other light sources remain dark, capturing images of the inner left inspection surface of the shoe sole.

[0099] Specifically, step S20 identifies the location to be detected in the image to be detected. First, the images to be detected on the inner and outer sides of the high-top sole are acquired. The high-top sole in the first image to be detected has a first bright area and a second bright area. The region of interest in the first image to be detected is extracted. The region of interest is the bright area of ​​the high-top sole. The first bright area located on the lower side is selected to form the location to be detected for glue overflow on the outer side of the high-top sole. The glue line along the upper edge of the second light-blocking area is selected, and the area formed by shifting the upper edge of the glue line downwards by a certain distance is used as the detection area for glue deficiency or glue breakage on the inner side of the high-top sole.

[0100] Specifically, in step S30, industrial cameras in multiple directions (front, back, left, right) use UV light sources to acquire images of the high-top shoe sole corresponding to the location to be detected, such as... Figure 6 As shown, the third industrial camera on the right side, located above the frame at the high-top shoe sole detection position, uses a UV light source below the third industrial camera on the right side to acquire images of the high-top shoe sole corresponding to the outer right side and inner left side to be detected positions.

[0101] The first industrial camera on the left, located above the frame at the high-top shoe sole detection position, uses a UV light source below the first industrial camera on the left to acquire images of the high-top shoe sole corresponding to the outer left and inner right detection positions.

[0102] The second industrial camera located above the frame of the high-top shoe sole detection position uses a UV light source below the second industrial camera to collect images of the high-top shoe sole corresponding to the outer and inner detection positions of the heel.

[0103] The fourth industrial camera located above the frame at the high-top shoe sole detection position uses a UV light source below the fourth industrial camera and a second plane mirror behind the detection position to acquire images of the high-top shoe sole corresponding to the outer and inner front detection positions.

[0104] In another embodiment of the present invention, the visual acquisition module includes: a first industrial camera, a second industrial camera, a third industrial camera, a fourth industrial camera, a fifth industrial camera, and a sixth industrial camera. The industrial cameras are respectively arranged at intervals around the detection position above it. The lenses of the industrial camera components are tilted downwards, with the lens direction aligned with the detection position below. The first industrial camera is installed on the left side above the frame of the high-top shoe sole detection position, and is used to photograph the left outer side and the right inner side of the shoe sole. The second industrial camera is installed on the front side above the frame of the high-top shoe sole detection position, and is used to photograph the rear inner side of the shoe sole. The third industrial camera is installed on the right side above the frame of the high-top shoe sole detection position, and is used to photograph the right outer side and the left inner side of the shoe sole. The fourth industrial camera is installed on the rear side above the frame of the high-top shoe sole detection position, and is used to photograph the front inner side of the shoe sole. The fifth industrial camera is installed on the front side below the frame of the high-top shoe sole detection position, and is used to photograph the front outer side of the shoe sole. The sixth industrial camera is installed on the rear side below the frame of the high-top shoe sole detection position, and is used to photograph the rear outer side of the shoe sole.

[0105] In another embodiment, the first industrial camera located above the frame uses a blue light source that controls the left combined light source to be on while other light sources are off to capture an image of the outer inspection surface on the left side of the shoe sole.

[0106] The third industrial camera located above the frame uses the blue light source controlled by the right combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the right side of the shoe sole.

[0107] The first industrial camera located above the frame uses the controlled side-back white light source, while other light sources are dimmed, to capture an image of the inner inspection surface on the right side of the shoe sole.

[0108] The third industrial camera, located above the frame, uses the control of the side-back white light source to illuminate while other light sources are dimmed, to capture an image of the inner detection surface on the left side of the shoe sole.

[0109] The second industrial camera located above the frame uses the control of the side-back white light source to be on while other light sources are off, to capture images of the inner inspection surface of the shoe sole's heel.

[0110] The fourth industrial camera, located above the frame, uses the control of the side-back white light source to be lit while other light sources are dimmed to capture images of the inner detection surface at the front end of the shoe sole.

[0111] The fifth industrial camera, located below the second industrial camera, is positioned in front of the detection station. It uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, to capture images of the outer detection surface at the front of the shoe sole.

[0112] The sixth industrial camera, located below the fourth industrial camera, is positioned behind the inspection station. The camera uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, to capture images of the outer inspection surface of the shoe sole.

[0113] Specifically, step S40 detects the high-top shoe sole image corresponding to the location to be detected acquired in step S30. Since fluorescent liquid is added to the shoe sole glue, when UV light source shines obliquely on the shoe sole containing fluorescent liquid glue, different bright and dark areas will be generated on the shoe sole. The detection of the location to be detected in the high-top shoe sole image is used to determine the situation of broken glue, missing glue, and overflow glue in the shoe.

[0114] In other embodiments, a white side-back light source is used to acquire images of the inner side of the sole, and a UV light source is used to detect whether there is glue breakage or missing glue at the detection location on the inner side of the sole; left and right blue strip lights are used to acquire images of the outer side of the sole, and a UV light source is used to detect whether there is glue overflow at the detection location on the outer side of the sole. Fluorescent liquid is added to the sole adhesive; when a UV light source obliquely illuminates the sole containing the fluorescent liquid adhesive, different bright and dark areas will appear on the sole, thereby determining the condition of glue breakage, missing glue, and glue overflow.

[0115] The aforementioned automatic glue detection device for the inner and outer surfaces of high-top shoe soles is used to detect whether there is excess glue, insufficient glue, or broken glue. This device automatically generates a detection area, and industrial cameras in multiple directions (front, back, left, and right) use a UV light source to capture images of this area. The images are then inspected. If a bright area appears on the outer surface of the sole, it indicates excess glue; if a dark area appears on the inner surface, it indicates insufficient glue.

[0116] Furthermore, it should be noted that all equivalent or simple variations made to the structure, features, and principles described in this patent concept are included within the protection scope of this patent. Those skilled in the art to which this invention pertains may make various modifications or additions to the described specific embodiments or use similar methods to replace them, as long as they do not deviate from the structure of this invention or exceed the scope defined in these claims, all of which should fall within the protection scope of this invention.

Claims

1. A method of detecting the inner and outer surfaces of a high-top shoe sole, characterized by, Includes the following steps: The high-top shoe sole detection station is equipped with multiple industrial cameras in the front, back, left, and right directions and corresponding combination light sources above the frame. A bottom light source is installed below the detection station. The brightness of the light sources in different directions is controlled by the combination light sources in multiple directions and the bottom light source. The industrial cameras are used to capture images of the high-top shoe sole in different directions. The combination light sources in multiple directions include UV light sources in the front and back directions, and left and right combination light sources including blue light sources and UV light sources. The bottom light source is a side-back white light source. Identify the location to be detected in the image; Multiple industrial cameras from different directions acquire images of the high-top shoe sole corresponding to the location to be detected using different light sources: The first industrial camera located on the left side above the frame uses the blue light source controlled by the left combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the left side of the shoe sole. The third industrial camera located on the right side above the frame uses the blue light source controlled by the right combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the right side of the shoe sole. The first industrial camera located on the left side above the frame uses the control of the side-back white light source to be on while other light sources are off, to capture an image of the inner right inspection surface of the shoe sole. The third industrial camera, located on the right side above the frame, uses the control of the side-back white light source to be on while other light sources are off, to capture an image of the inner detection surface on the left side of the shoe sole. The second industrial camera located on the front side above the frame uses the control of the side back white light source to be on while other light sources are off, to capture images of the inner inspection surface of the shoe sole's heel. The fourth industrial camera, located above the rear of the frame, uses the control of the side-back white light source to be lit while other light sources are dimmed to capture images of the inner inspection surface at the front end of the shoe sole. The second industrial camera located on the front side above the frame uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, and combines this with the first plane mirror at the heel of the shoe to acquire an image of the outer inspection surface of the heel of the shoe. The fourth industrial camera, located above the rear of the frame, uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, and combines this with the second plane mirror at the front of the shoe sole to acquire an image of the outer inspection surface at the front of the shoe sole. The high-top shoe sole image corresponding to the detection position is inspected to detect whether there is excess glue, missing glue, or broken glue at the detection position: fluorescent liquid is added to the shoe sole glue. The detection position of the shoe sole is illuminated by a UV light source. The different bright and dark areas produced can be used to detect whether there is excess glue on the outer side of the shoe sole and whether there is missing glue or broken glue on the inner side of the shoe sole. The blue light source of the high-top shoe sole is illuminated by a combination of left and right light sources. The first image of the high-top shoe sole to be detected is obtained by an industrial camera. The industrial camera is located above the light source, so that the high-top shoe sole in the first image to be detected has a first bright area and a second bright area. The outer side of the shoe sole closer to the industrial camera and the light source is the first bright area, and the inner side of the high-top shoe sole farther away from the industrial camera and the light source is the second bright area. The high-top shoe sole is illuminated vertically upwards by a light source at the bottom inside the conveyor belt, while other light sources are not used. An industrial camera above the frame is used to acquire a second image of the high-top shoe sole to be inspected. The high-top shoe sole in the second image to be inspected only has a second light-blocking area. Extract the region of interest (ROI) from the first image to be detected, wherein the ROI is the bright area of ​​the high-top shoe sole; extract the ROI from the second image to be detected, wherein the ROI is the second light-blocking area of ​​the high-top shoe sole; Select the first bright area to form the glue overflow detection area on the outer side of the high-top shoe sole; Select the upper edge of the second light-blocking area, and move the upper edge of the adhesive line downwards a certain distance to form the area where the glue is missing or broken on the inner side of the high-top sole.

2. The method for detecting the inner and outer surfaces of high-top shoe soles according to claim 1, characterized in that, Multiple industrial cameras using different light sources can acquire images of the high-top shoe sole corresponding to the location to be detected. Specifically, this may also include: The first industrial camera located on the left side above the frame uses the blue light source controlled by the left combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the left side of the shoe sole. The third industrial camera located on the right side above the frame uses the blue light source controlled by the right combined light source to be on while other light sources are off, to capture an image of the outer inspection surface on the right side of the shoe sole. The first industrial camera located on the left side above the frame uses the control of the side-back white light source to be on while other light sources are off, to capture an image of the inner right inspection surface of the shoe sole. The third industrial camera, located on the right side above the frame, uses the control of the side-back white light source to be on while other light sources are off, to capture an image of the inner detection surface on the left side of the shoe sole. The second industrial camera located on the front side above the frame uses the control of the side back white light source to be on while other light sources are off, to capture images of the inner inspection surface of the shoe sole's heel. The fourth industrial camera, located above the rear of the frame, uses the control of the side-back white light source to be lit while other light sources are dimmed to capture images of the inner inspection surface at the front end of the shoe sole. The fifth industrial camera, located below the second industrial camera, is positioned in front of the detection station. It uses a blue light source that controls the left and right combined light sources to be on while other light sources are off, to capture images of the outer detection surface at the front of the shoe sole. The sixth industrial camera, located below the fourth industrial camera, is positioned behind the detection station. It uses a blue light source that controls the left and right combined light sources to illuminate while other light sources remain dim, to capture images of the outer inspection surface of the shoe sole's heel.

3. A device for detecting the inner and outer surfaces of high-top shoe soles, characterized in that, For implementing the method for detecting the inner and outer surfaces of high-top shoe soles as described in claim 1, the high-top shoe sole inner and outer surface detection device comprises: The light source control module is used to mount multiple industrial cameras in front, behind, left, and right directions and corresponding combination light sources above the frame of the high-top shoe sole detection position. A bottom light source is installed below the detection position. The brightness of the light sources in different directions is controlled by the combination light source and the bottom light source. The industrial cameras capture images of the high-top shoe sole from different directions. The light source control module includes: a side-back white light source, a blue light source, and a UV light source. The side-back white light source is located inside the conveyor belt and below the detection position, and is used to emit bottom light onto the shoe sole at the detection position. The blue light source is located below the industrial camera assembly and above the detection position, and is used to emit illumination light onto the outer sides of the left, right, front, and rear of the shoe sole at the detection position. The UV light source is located below the industrial camera assembly and above the detection position, and is used to emit detection light onto the shoe sole at the detection position. The blue light source and the UV light source are installed at a downward angle, and the emitted light is directed towards the detection position and illuminates the shoe sole to be detected. A visual acquisition module is used to identify the location to be detected in an image. Multiple industrial cameras in different directions use different light sources to acquire images of the high-top shoe sole corresponding to the location to be detected. The visual acquisition module includes: a first industrial camera, a second industrial camera, a third industrial camera, a fourth industrial camera, a first plane mirror, and a second plane mirror. The industrial cameras are respectively arranged at intervals around the detection position above it, and the plane mirrors are arranged on both sides of the conveyor belt. The lenses of the industrial camera components are tilted downwards, with the lens direction aligned with the detection position below. The first industrial camera is used to capture the left outer side and the right inner side of the shoe sole. The second industrial camera, combined with the first plane mirror, is used to capture the rear inner side of the shoe sole and the rear outer side reflected by the plane mirror. The third industrial camera is used to capture the right outer side and the left inner side of the shoe sole. The fourth industrial camera, combined with the second plane mirror, is used to capture the front inner side of the shoe sole and the front outer side reflected by the plane mirror. The glue detection module is used to detect the high-top shoe sole image corresponding to the detected position, and to detect the glue overflow, glue shortage or glue breakage at the detected position.

4. A device for detecting the inner and outer surfaces of high-top shoe soles, characterized in that, For implementing the method for detecting the inner and outer surfaces of high-top shoe soles as described in claim 2, the high-top shoe sole inner and outer surface detection device comprises: The light source control module is used to mount multiple industrial cameras in front, behind, left, and right directions and corresponding combination light sources above the frame of the high-top shoe sole detection position. A bottom light source is installed below the detection position. The brightness of the light sources in different directions is controlled by the combination light source and the bottom light source. The industrial cameras capture images of the high-top shoe sole from different directions. The light source control module includes: a side-back white light source, a blue light source, and a UV light source. The side-back white light source is located inside the conveyor belt and below the detection position, and is used to emit bottom light onto the shoe sole at the detection position. The blue light source is located below the industrial camera assembly and above the detection position, and is used to emit illumination light onto the outer sides of the left, right, front, and rear of the shoe sole at the detection position. The UV light source is located below the industrial camera assembly and above the detection position, and is used to emit detection light onto the shoe sole at the detection position. The blue light source and the UV light source are installed at a downward angle, and the emitted light is directed towards the detection position and illuminates the shoe sole to be detected. A vision acquisition module is used to identify the location to be detected in an image. Multiple industrial cameras in different directions acquire images of the high-top shoe sole corresponding to the location to be detected using different light sources. The vision acquisition module includes a first industrial camera, a second industrial camera, a third industrial camera, a fourth industrial camera, a fifth industrial camera, and a sixth industrial camera. The first, second, third, and fourth industrial cameras are respectively arranged in a ring around the detection position at intervals. The lenses of the industrial camera components are tilted downwards and the lens direction is aimed at the detection position below. The fifth industrial camera is below the second industrial camera and located in front of the detection position, and the sixth industrial camera is below the fourth industrial camera and located behind the detection position. The first industrial camera is used to photograph the left outer side and the right inner side of the shoe sole; The second industrial camera is used to photograph the inner side of the heel of the shoe sole; The third industrial camera is used to photograph the right outer side and the left inner side of the shoe sole; The fourth industrial camera is used to photograph the inner front side of the shoe sole; The fifth industrial camera is used to photograph the outer front side of the shoe sole; The sixth industrial camera is used to photograph the outer side of the heel of the shoe sole; The glue detection module is used to detect the high-top shoe sole image corresponding to the detected position, and to detect the glue overflow, glue shortage or glue breakage at the detected position.

Images