Abnormality detection device for loom

Abstract

To provide an abnormality detection device for a loom capable of accurately designating a range of an opening part when generating a pseudo abnormal image.SOLUTION: The pseudo abnormal image generation unit includes a temporary designation unit, an auxiliary line drawing unit, a determination unit, and a drawing unit. The tentative designation unit tentatively designates a tentative upper warp end point P1, a tentative lower warp end point P2, and a tentative welt point P3 with respect to the opening image displayed on the processing screen S. The auxiliary line drawing unit draws an upper auxiliary line P1 connecting the tentative upper warp end point P3 and the tentative welt point H1 that are tentatively designated by the tentative designation unit, and a lower auxiliary line P2 connecting the tentative lower warp end point P3 and the tentative welt point H2 that are tentatively designated by the tentative designation unit. The determination unit determines the positions of the tentative upper warp end point H1, the tentative lower warp end point H2, and the tentative welt point P3, which are tentatively designated at the position where the upper auxiliary line P1 coincides with the upper warps Tu and the lower auxiliary line P2 coincides with the lower warps Td. The drawing unit draws a pseudo-abnormality in the opening R defined by the tentative upper warp end point P1, the tentative lower warp end point P2, and the tentative welt point P3 determined by the determining unit.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to an abnormality detection device for a loom. [Background technology]

[0002] A loom weaves fabric by inserting a weft thread into an opening defined by warp threads. However, if an abnormality occurs in the opening, for example, if a broken warp thread gets inside the opening, the quality of the woven fabric will be reduced. Therefore, as disclosed in Patent Document 1, for example, a loom is designed to detect defects in the opening, i.e., weaving abnormalities, from a camera image of the opening.

[0003] In detecting such weaving abnormalities in a loom, a determination model that has learned from training data may be used, as disclosed in Patent Document 2, for example. In Patent Document 2, the determination model learns normal image data and pseudo-abnormal image data of the equipment, and determines whether or not there is an abnormality in the equipment. The pseudo-abnormal image data is data that simulates an abnormality by processing a part of the normal image data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-196972 [Patent Document 2] Patent Publication No. 2021-157303 Summary of the Invention [Problem to be solved by the invention]

[0005] When a judgment model is used to detect weaving abnormalities in a loom, pseudo-abnormal image data is generated by processing a portion of an image of the opening captured by the opening to increase the amount of abnormal image data to be learned. To generate such pseudo-abnormal image data of the opening, it is necessary to accurately specify the opening range in the opening image captured by a camera, i.e., three points: the upper warp end point of the upper warp thread that leaves the reed and extends forward, the lower warp end point of the lower warp thread that leaves the reed and extends forward, and the woven cloth. However, other components near the opening may be reflected in the opening image captured by the camera. In this case, if any of the upper warp end point, the lower warp end point, and the woven cloth are hidden by the other components in the opening image, it may be impossible to accurately specify the three points: the upper warp end point, the lower warp end point, and the woven cloth. As a result, the opening range specified in the pseudo-abnormal image data becomes inaccurate, which reduces the judgment accuracy of the judgment model using the pseudo-abnormal image data. [Means for solving the problem]

[0006] The abnormality detection device for a loom for solving the above-mentioned problems detects weaving abnormalities from an image of an opening captured by a camera, the image being related to an opening defined by a reed, an upper warp thread above a weft thread, a lower warp thread below the weft thread, and a woven cloth where the upper warp thread and the lower warp thread cross, and the device uses a judgment model that has learned normal images of the opening when the opening is normal and abnormal images of the opening when the opening is abnormal, the device having a pseudo-abnormal image generation unit that generates a pseudo-abnormal image from the opening image captured by the camera, and the pseudo-abnormal image generation unit generates a pseudo-abnormal image from the opening image displayed on a processing screen of a display unit by adding a provisional upper warp end point that is assumed to be an upper warp end point of the upper warp thread that leaves the reed and extends forward, and a pseudo-abnormal image generation unit that ... The device has a temporary designation unit that temporarily designates a temporary lower warp end point that is assumed to be the lower warp end point of the lower warp thread that comes out and extends forward, and a temporary woven opening point that is assumed to be the woven opening; an auxiliary line drawing unit that draws an upper auxiliary line connecting the temporary upper warp end point and the temporary woven opening point that are temporarily designated by the temporary designation unit, and a lower auxiliary line connecting the temporary lower warp end point and the temporary woven opening point; a determination unit that confirms the positions of the temporary upper warp end point, temporary lower warp end point, and temporary woven opening point that are temporarily designated at a position where the upper auxiliary line coincides with the upper warp thread in the opening image and the lower auxiliary line coincides with the lower warp thread in the opening image; and a drawing unit that draws a pseudo-abnormality in the opening defined by the temporary upper warp end point, temporary lower warp end point, and temporary woven opening point determined by the determination unit.

[0007] According to this, when a pseudo-abnormal image is generated using the pseudo-abnormal image generating unit, the auxiliary line drawing unit can draw upper auxiliary lines and lower auxiliary lines on the closure image. When the upper auxiliary line coincides with the upper warp thread and the lower auxiliary line coincides with the lower warp thread, the temporary closure mouth point is located at the position where the upper auxiliary line and the lower auxiliary line intersect. Furthermore, the temporary upper warp end point is located at a position overlapping the upper warp thread, and the temporary lower warp end point is located at a position overlapping the lower warp thread. Therefore, by aligning the upper auxiliary line with the upper warp thread and the lower auxiliary line with the lower warp thread, the three points of the temporary upper warp end point, the temporary lower warp end point, and the temporary closure mouth point can be accurately positioned at positions that define the closure. As a result, by confirming the three points of the temporary upper warp end point, the temporary lower warp end point, and the temporary closure mouth point using the confirming unit, the positions of the upper warp end point, the lower warp end point, and the closure mouth can be accurately specified on the closure image, thereby accurately specifying the closure range. Furthermore, since the drawing unit can draw the pseudo-abnormal image in the range of the opening that is specified with high precision, it is possible to generate a highly accurate pseudo-abnormal image.

[0008] In an abnormality detection device for a loom, when the temporary designation unit temporarily designates the temporary upper warp end point and the temporary lower warp end point and also temporarily designates the temporary weaving mouth point, the auxiliary line drawing unit preferably displays the upper auxiliary line and the lower auxiliary line simultaneously.

[0009] According to this, the point where the upper auxiliary line and the lower auxiliary line intersect is temporarily designated as the temporary woven opening point, so the auxiliary line drawing unit displays the upper auxiliary line and the lower auxiliary line and the temporary woven opening point at the same time. As a result, the woven opening can be designated at the position where the temporary woven opening point is displayed as soon as the upper auxiliary line coincides with the upper warp and the lower auxiliary line coincides with the lower warp. Therefore, the efficiency of the work of designating the woven opening position is improved compared to when the upper auxiliary line and the lower auxiliary line are drawn and displayed separately.

[0010] In the abnormality detection device for a loom, the auxiliary line drawing unit may display a connecting auxiliary line connecting the provisional upper warp end point and the provisional lower warp end point. This makes it easier to see the range of the opening by the upper auxiliary line, the lower auxiliary line, and the connection auxiliary line.

[0011] In the loom abnormality detection device, the auxiliary line drawing unit may display the upper auxiliary line and the lower auxiliary line in a manner different from a manner in which the connection auxiliary line is displayed. This makes it easy to identify changes in the upper and lower auxiliary lines when moving the temporary woven opening point to align the upper auxiliary line with the upper warp and the lower auxiliary line with the lower warp. Furthermore, the process of moving the temporary woven opening point to the expected woven opening position can be seen, making it easier to position the woven opening. Furthermore, the upper auxiliary line, lower auxiliary line, and connection auxiliary line make it easy to see the extent of the opening. [Effects of the Invention]

[0012] The present invention makes it possible to specify the range of the opening with high precision when generating a pseudo abnormal image. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a plan view schematically showing a loom. [Figure 2] FIG. 2 is a diagram showing the opening. [Figure 3] FIG. 3 is a diagram showing a processing screen and an opening image. [Figure 4] FIG. 4 is a block diagram showing the configuration of an abnormality detection device for a loom. [Figure 5] FIG. 5 is a block diagram showing the configuration of the pseudo-abnormal image generating unit. [Figure 6] FIG. 6 is a diagram of a processing screen displaying the provisional upper warp end points, provisional lower warp end points, and connection auxiliary lines. [Figure 7] FIG. 7 is a diagram of a processing screen on which the upper auxiliary line and the lower auxiliary line are displayed. [Figure 8] FIG. 8 is a diagram showing the state in which the provisional upper warp end points, provisional lower warp end points, and provisional weaving mouth points have been determined. [Figure 9] FIG. 9 is a diagram of the processing screen displaying the upper auxiliary line. [Figure 10] FIG. 10 is a diagram of a processing screen on which the upper auxiliary line and the lower auxiliary line are displayed. [Figure 11]FIG. 11 is a diagram of a processing screen when the temporary upper warp end points are finely adjusted. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, a specific embodiment of an abnormality detection device for a loom will be described. <Loom> As shown in Fig. 1, the loom 10 has a frame 11. The frame 11 has a pair of side frames 11a, 11b. The pair of side frames 11a, 11b are located at both ends of the loom 10 in the left-right direction. Of the pair of side frames 11a, 11b, one side frame 11a is located at the left end, and the other side frame 11b is located at the right end.

[0015] A plurality of warp threads T are arranged in the left-right direction of the loom 10. Each warp thread T extends in the front-rear direction of the loom 10. The warp threads T are drawn out from a supply roll (not shown) provided at the rear of the frame 11. After being woven into a fabric W, the warp threads T are wound up by a take-up roll (not shown) provided at the front of the frame 11. The warp threads T move from the rear to the front in the front-rear direction of the loom 10.

[0016] The loom 10 has a warp shedding device 121 that sheds warp threads T. The warp shedding device 121 has, for example, two heald frames 12. The two heald frames 12 are aligned in the front-to-rear direction of the loom 10. Each heald frame 12 is provided with a plurality of healds (not shown). The plurality of healds are arranged in the left-to-right direction of the loom 10. Of the plurality of warp threads T arranged in the left-to-right direction of the loom 10, some warp threads T are threaded through the healds of one heald frame 12, while the other warp threads T are threaded through the healds of the other heald frame 12. Each heald frame 12 moves back and forth in the up-and-down direction of the loom 10. When one heald frame 12 moves upward, the other heald frame 12 moves downward. When one heald frame 12 moves downward, the other heald frame 12 moves upward.

[0017] As shown in Figure 2, one heald frame 12 moves upward, and the warp thread T threaded through the heald of that one heald frame 12 becomes the upper warp thread Tu, and the other heald frame 12 moves downward, and the warp thread T threaded through the heald of the other heald frame 12 becomes the lower warp thread Td. Therefore, in accordance with the up and down movement of the pair of heald frames 12, the warp thread T that becomes the upper warp thread Tu and the warp thread T that becomes the lower warp thread Td are alternately switched.

[0018] An opening R formed by the warp threads T is defined by a reed 16 (described later), upper warp threads Tu, lower warp threads Td, and a woven cloth fell Wa where the upper warp threads Tu and lower warp threads Td intersect. The rear end of the opening R is defined by the reed 16, and the front end of the opening R is defined by the woven cloth fell Wa. The upper and lower ends of the opening R are defined by a group of upper warp threads Tu and a group of lower warp threads Td. When viewed from the left to right of the loom 10, the opening R has a substantially triangular shape.

[0019] In the following description, when the loom 10 is viewed from the left to the right, the end point of the upper warp thread Tu that leaves the reed 16 and extends forward is referred to as the upper warp end point W1, and the end point of the lower warp thread Td that leaves the reed 16 and extends forward is referred to as the lower warp end point W2. When the loom 10 is viewed from the left to the right, the area inside a triangle formed by connecting the three points of the upper warp end point W1, the lower warp end point W2, and the loom mouth Wa with straight lines is referred to as the range of the opening R.

[0020] 1, the opening R has an entrance R1 and an exit R2. The entrance R1 is located at the left end of the opening R in the left-right direction of the loom 10. The exit R2 is located at the right end of the opening R in the left-right direction of the loom 10.

[0021] The loom 10 has a weft insertion device 13. The weft insertion device 13 has a main nozzle 14 and a plurality of sub-nozzles 15. The main nozzle 14 is attached to one of the side frames 11a. The main nozzle 14 ejects air to insert the weft Y into the opening R in the left-right direction of the loom 10. The weft Y enters the opening R from an entrance R1. After flying through the opening R in the left-right direction of the loom 10, the tip of the weft Y exits the opening R from an exit R2. The direction in which the weft Y is inserted by the main nozzle 14 is called the weft insertion direction. The weft insertion direction is from the left to the right in the left-right direction of the loom 10.

[0022] The multiple sub-nozzles 15 are arranged forward of the warp shedding device 121 in the front-to-rear direction of the loom 10. The multiple sub-nozzles 15 are arranged downstream of the main nozzle 14 in the weft insertion direction. The multiple sub-nozzles 15 are arranged in the left-to-right direction of the loom 10. Each sub-nozzle 15 sprays air onto the weft Y inserted into the opening R of the warp T.

[0023] The reed 16 beats the weft Y inserted into the opening R. The reed 16 is disposed between the warp shedding device 121 and the sub-nozzles 15 in the front-rear direction of the loom 10. The reed 16 is disposed downstream of the main nozzle 14 in the weft insertion direction.

[0024] As shown in FIG. 2, the reed 16 has reed dents 161. A plurality of reed dents 161 are arranged in the left-right direction of the loom 10. The warp thread T passes between adjacent reed dents 161 in the left-right direction of the loom 10. A recess 161a is provided on the front surface of each reed dent 161. The recesses 161a of the multiple reed dents 161 are connected in the left-right direction of the loom 10, thereby forming a weft thread flying passage 16a in the reed 16. The weft thread Y inserted into the opening R of the warp thread T flies through the weft thread flying passage 16a.

[0025] The reed 16 is fixed to a slay 18 that swings back and forth in the front-to-back direction of the loom 10. Therefore, the reed 16 swings back and forth in the front-to-back direction of the loom 10 together with the slay 18. The reed 16 beats the weft yarn Y inserted into the opening R by moving to the front of the loom 10. The weft yarn Y flying through the weft flying passage 16a is beaten toward the loom mouth Wa.

[0026] The loom 10 weaves by moving the warp thread T from the rear to the front in the longitudinal direction of the loom 10, while repeating the shedding operation of the warp thread T by the warp shedding device 121, the weft insertion operation of the weft thread Y by the weft insertion device 13, and the beating operation by the reed 16.

[0027] As shown in Fig. 1, the loom 10 has an operation unit 27. The operation unit 27 is provided on one of the side frames 11a. The operation unit 27 is provided forward of the main nozzle 14 in the front-to-rear direction of the loom 10. The operation unit 27 has a display unit 27a that displays an operation screen of the loom 10, and a housing 27b that houses the display unit 27a.

[0028] <Loom malfunction detection device> 4, the loom abnormality detection device 30 includes an imaging device 31 and a computer 41. The imaging device 31 includes a camera 32, lighting 33, and a control unit 34. The computer 41 includes a detection unit 42, an input unit 35, and a display unit 27a. The loom abnormality detection device 30 detects a weaving abnormality using the detection unit 42 from the image of the opening R captured by the camera 32.

[0029] As shown in Fig. 3, an example of a weaving abnormality is a state in which a part of the upper warp thread Tu protrudes into the range of the opening R. Other weaving abnormalities include a state in which the lower warp thread Td protrudes into the range of the opening R, the range of the opening R is narrowed due to slack in the upper warp thread Tu or the lower warp thread Td, or the warp thread T protrudes outside the opening R.

[0030] <Imaging device> The camera 32 is a digital camera. The camera 32 has an imaging element. Examples of the imaging element include a charge coupled device (CCD) image sensor and a complementary metal oxide semiconductor (CMOS) image sensor.

[0031] As shown in FIG. 1, the camera 32 is provided at a position where it can capture an image of the opening R from the entrance R1 side. Specifically, the camera 32 is disposed on one of the side frames 11a. The camera 32 captures an image of the opening R from the upstream side toward the downstream side in the weft insertion direction of the weft yarn Y. In other words, the camera 32 captures an image of the opening R from the left side. The image captured by the camera 32 is stored in a memory unit (not shown) of the camera 32 as image data of the opening R. The lighting 33 is an LED light. The lighting 33 is provided at a position where it can illuminate the opening R.

[0032] As shown in FIG. 4, the control unit 34 includes a processor 34a and a main memory 34b. The processor 34a may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), or a digital signal processor (DSP). The main memory 34b includes a random access memory (RAM) and a read-only memory (ROM). The main memory 34b stores program code or instructions configured to cause the processor 34a to execute processing. The main memory 34b, i.e., the computer-readable medium, includes any available medium accessible by a general-purpose or special-purpose computer. The control unit 34 may be configured with a hardware circuit such as an application-specific integrated circuit (ASIC) or a field-programmable gate array (FPGA). The control unit 34, which is a processing circuit, may include one or more processors operating according to a computer program, one or more hardware circuits such as ASICs or FPGAs, or a combination thereof.

[0033] The control unit 34 is connected to the camera 32 and the lighting 33. The control unit 34 controls the timing at which the camera 32 captures an image and the timing at which the lighting 33 emits light. The camera 32 captures an image when a signal is input from the control unit 34, and the lighting 33 emits light when a signal is input from the control unit 34. Since signals are input to the camera 32 and the lighting 33 simultaneously, the lighting 33 illuminates the opening R at the same time that the camera 32 captures an image of the opening R.

[0034] <Computer> The detection unit 42 includes a processor 42a and a main memory 42b. Examples of the processor 42a include a CPU, a GPU, and a DSP. The main memory 42b includes RAM and ROM. The main memory 42b stores program code or instructions configured to cause the processor 42a to execute processing. The main memory 42b, i.e., the computer-readable medium, includes any available medium accessible by a general-purpose or special-purpose computer. The detection unit 42 may be configured by a hardware circuit such as an ASIC or FPGA. The detection unit 42, which is a processing circuit, may include one or more processors operating according to a computer program, one or more hardware circuits such as an ASIC or FPGA, or a combination thereof.

[0035] The main storage unit 42b stores a program related to a pseudo-abnormal image generation application, which includes a program for causing the processor 42a to perform display processing.

[0036] The detection unit 42 is electrically connected to the input unit 35 and the display unit 27a. The input unit 35 is, for example, a mouse. The input unit 35 can be changed as appropriate to a device other than a mouse, such as a touch pen. The input unit 35 is provided for operating the operation unit 27. The display unit 27a is a display. The detection unit 42 is also electrically connected to the camera 32. The detection unit 42 acquires image data related to the opening R stored in the camera 32.

[0037] Here, the image related to the opening R will be referred to as the "opening image." In the opening image, the warp threads T above the weft thread Y are upper warp threads Tu, and the warp threads T below the weft thread Y are lower warp threads Td. Therefore, the opening R is defined by the reed 16, the upper warp threads Tu above the weft thread Y, the lower warp threads Td below the weft thread Y, and the woven edge Wa where the upper warp threads Tu and the lower warp threads Td intersect.

[0038] The image data acquired by the detection unit 42 are of three types: normal image data, abnormal image data, and pseudo-abnormal image data. The normal image data is data relating to a normal image captured by the camera 32 when the opening R is in a normal state. The normal state of the opening R is a state in which no abnormalities such as warp threads T protruding within the range of the opening R have occurred. The abnormal image data is data relating to an abnormal image captured by the camera 32 when the opening R is in an abnormal state. The pseudo-abnormal image data is data relating to an abnormal image that is pseudo-generated using the pseudo-abnormal image generation unit 50, which will be described later.

[0039] As shown in FIG. 5, the detection unit 42 includes a determination unit 43 and a pseudo-abnormal image generation unit 50. The detection unit 42, that is, the determination unit 43 and the pseudo-abnormal image generation unit 50, are functional elements that function when the processor 42a executes a program stored in the main storage unit 42b.

[0040] The determination unit 43 has a determination model that has learned both normal images and abnormal images (including pseudo-abnormal images). The determination unit 43 then uses the determination model to detect weaving abnormalities from images of the opening R captured by the camera 32, i.e., the opening image. Preferably, the opening image learned by the determination model is one in which the reed 16 is at the furthest position from the woven cloth camel Wa and the opening R is at its widest, but this can be changed as appropriate as long as the opening R is open to some extent.

[0041] As shown in Fig. 3, the range of the specified shedding R is the inside of a triangle formed by connecting the upper warp end point W1, the lower warp end point W2, and the cloak fall Wa, which are displayed on the shedding image. In addition, as shown in Fig. 6, the range of the shedding R is preferably located forward of the main nozzle 14.

[0042] The abnormal images are images of the opening R that are actually captured by the camera 32. However, because the frequency with which actual abnormalities occur in the loom 10 is low, the number of abnormal images captured by the camera 32 is not very large. On the other hand, to improve the accuracy of the determination by the determination model, it is preferable to have the determination model learn more abnormal images. For this reason, the pseudo-abnormal image generation unit 50 is used to generate pseudo-abnormal images to increase the number of abnormal images. In the following description, abnormal image data related to the pseudo-abnormal images will be referred to as "pseudo-abnormal image data."

[0043] <Pseudo abnormal image generation unit> The pseudo-abnormal image generating unit 50 operates by a pseudo-abnormal image generating application. The pseudo-abnormal image generating unit 50 generates a pseudo-abnormal image from the opening image captured by the camera 32.

[0044] 5, pseudo-abnormal image generating unit 50 has a temporary designation unit 51, an auxiliary line drawing unit 52, a determination unit 53, and a drawing unit 54. Pseudo-abnormal image generating unit 50 performs image processing on the normal image of opening R captured by camera 32. That is, pseudo-abnormal image generating unit 50 performs image processing on the normal image of the opening.

[0045] As shown in Fig. 3, the opening image displays the entrance R1 of the opening R. In detail, the opening image displays the upper warp Tu and lower warp Td that define the entrance R1, as well as the reed 16 and weft passage 16a located behind the entrance R1.

[0046] The pseudo-abnormal image generating unit 50 acquires image data relating to the opening image stored in the camera 32, and displays the acquired image data on a processing screen S of the display unit 27a. The processing screen S is a screen on which a creator of a pseudo-abnormal image performs the work of generating a pseudo-abnormal image. The pseudo-abnormal image generating unit 50 also displays an opening image display area Sa, a first operation button Sb, a second operation button Sc, a third operation button Sd, and a fourth operation button Se on the processing screen S.

[0047] An aperture image is displayed in the aperture image display area Sa. The first operation button Sb is operated to display a desired aperture image in the aperture image display area Sa. The second operation button Sc is operated when generating a pseudo-abnormal image in the aperture image display area Sa. The third operation button Sd is operated when drawing a pseudo-abnormality in the aperture image display area Sa. The fourth operation button Se is operated when saving pseudo-abnormal image data related to the created pseudo-abnormal image.

[0048] <Temporary designation> 6 and 7, the temporary designation unit 51 temporarily designates a temporary upper warp end point P1, a temporary lower warp end point P2, and a temporary woven weaving mouth point P3 for the sheath image displayed in the sheath image display area Sa of the processing screen S. The temporary upper warp end point P1 is a point that simulates the upper warp end point W1 of the upper warp thread Tu that leaves the reed 16 and extends forward. The temporary upper warp end point P1 can be designated at any position on the sheath image, but if the upper warp end point W1 is displayed on the sheath image, it is preferable to designate the temporary upper warp end point P1 on that upper warp end point W1.

[0049] The temporary lower warp end point P2 is a point that is assumed to be the lower warp end point W2 of the lower warp thread Td that leaves the reed 16 and extends forward. The temporary lower warp end point P2 can be specified at any position on the shed image. If the lower warp end point W2 is displayed on the shed image, it is preferable to specify the temporary lower warp end point P2 at that lower warp end point W2. The temporary woven cloth opening point P3 is a point that is specified at a position that is assumed to be the woven cloth opening Wa. The temporary woven cloth opening point P3 can be specified at any position. If the woven cloth opening Wa is displayed on the shed image, it is preferable to specify the temporary woven cloth opening point P3 at that woven cloth opening Wa.

[0050] The provisional designation of the provisional upper warp end point P1, provisional lower warp end point P2, and provisional woven weaving mouth point P3 is performed by operating the input unit 35. Specifically, when the worker operates the input unit 35 to designate a desired position in the sheath image display area Sa, the provisional upper warp end point P1, provisional lower warp end point P2, or provisional woven weaving mouth point P3 is designated in the sheath image and displayed.

[0051] 3, if the three points of the upper warp end point W1, the lower warp end point W2, and the woven cloth opening Wa are displayed on the woven cloth image in the woven cloth image display area Sa, the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven cloth opening point P3 are designated above these three points. As a result, the range of the woven cloth R is accurately designated inside the triangle connecting the three points of the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven cloth opening point P3.

[0052] On the other hand, in the loom 10, other parts F, such as a part of the heald frame 12 and a part of the main nozzle 14, exist around the opening R. When the opening R is imaged by the camera 32, the other parts F may appear in the opening image, and one of the upper warp end point W1, the lower warp end point W2, or the woven cloth waist Wa may be hidden in the opening image. For example, as shown in Fig. 6, the woven cloth waist Wa is hidden by the other parts F.

[0053] In this case, the three points of the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven weave opening point P3 cannot be accurately specified on the shed image, and therefore the range of the shed R cannot be accurately specified. Even in such a case, as shown in Fig. 7, the temporary designation unit 51 temporarily designates the three points of the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven weave opening point P3 on the shed image displayed in the shed image display area Sa. In the case shown in Fig. 7, the woven weave opening Wa is hidden by another part F. In this case, the temporary woven weave opening point P3 may be temporarily designated at a position assumed to be the woven weave opening Wa, or at another position.

[0054] <Auxiliary line drawing section> The auxiliary line drawing unit 52 draws, on the opening image, an upper auxiliary line H1 connecting the temporary upper warp end point P1 and the temporary woven opening point P3 that have been temporarily designated on the opening image by the temporary designation unit 51, and a lower auxiliary line H2 connecting the temporary lower warp end point P2 and the temporary woven opening point P3. Furthermore, when the temporary upper warp end point P1 and the temporary lower warp end point P2 are temporarily designated on the opening image, the auxiliary line drawing unit 52 displays a connection auxiliary line H3 connecting the temporary upper warp end point P1 and the temporary lower warp end point P2. Each of the upper auxiliary line H1 and the lower auxiliary line H2 is displayed as a dashed line on the opening image, and the connection auxiliary line H3 is displayed as a solid line. In other words, the auxiliary line drawing unit 52 displays the upper auxiliary line H1 and the lower auxiliary line H2 in a manner different from that of the connection auxiliary line H3.

[0055] Furthermore, when the temporary upper warp end point P1 and the temporary lower warp end point P2 are temporarily designated on the sheath image and the connection auxiliary line H3 is displayed, and the operator operates the input unit 35 to designate an arbitrary position on the sheath image, the auxiliary line drawing unit 52 displays the temporary woven opening point P3 at the designated position. Furthermore, the auxiliary line drawing unit 52 displays an upper auxiliary line H1 connecting the temporary upper warp end point P1 and the temporary woven opening point P3 on the sheath image, and also displays a lower auxiliary line H2 connecting the temporary lower warp end point P2 and the temporary woven opening point P3 on the sheath image. In other words, when the temporary upper warp end point P1 and the temporary lower warp end point P2 are temporarily designated by the temporary designation unit 51, the auxiliary line drawing unit 52 simultaneously displays the upper auxiliary line H1 and the lower auxiliary line H2. As a result, a virtual triangle connecting the three points of the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven opening point P3 is displayed on the sheath image.

[0056] 8, when the operator moves the temporary woven opening point P3 by operating the input unit 35, the auxiliary line drawing unit 52 changes the lengths of the upper auxiliary line H1 and the lower auxiliary line H2 to follow the movement of the temporary woven opening point P3. As the temporary woven opening point P3 moves away from the temporary upper warp end point P1, the length of the upper auxiliary line H1 increases, and as the temporary woven opening point P3 moves away from the temporary lower warp end point P2, the length of the lower auxiliary line H2 increases. As a result, the length of each side of the triangle displayed in the sheathing image changes, and the shape of the triangle also changes.

[0057] Then, when the operator operates the input unit 35 to align the upper auxiliary line H1 with the upper warp Tu and the lower auxiliary line H2 with the lower warp Td on the shedding image, the temporary woven weave mouth point P3 will overlap with the woven weave mouth Wa on the shedding image. The position of the temporary woven weave mouth point P3 is then temporarily designated as the woven weave mouth Wa. As a result, on the shedding image, the temporary upper warp end point P1 is temporarily designated at a position overlapping with the upper warp end point W1, and the temporary lower warp end point P2 is temporarily designated at a position overlapping with the lower warp end point W2. Furthermore, on the shedding image, the temporary woven weave mouth point P3 is temporarily designated at a position overlapping with the woven weave mouth Wa.

[0058] <Confirmed part> The determination unit 53 determines on the shed image the positions of the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven cloth opening point P3 that were temporarily designated at the positions where the upper auxiliary line H1 coincides with the upper warp Tu and the lower auxiliary line H2 coincides with the lower warp Td. Specifically, when the operator releases the operation of the input unit 35, the determination unit 53 determines the positions of the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven cloth opening point P3. Then, the range of the shed R defined by the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven cloth opening point P3 is determined on the shed image. The temporary upper warp end point P1 overlaps with the upper warp end point W1, and the temporary lower warp end point P2 overlaps with the lower warp end point W2. The temporary woven cloth opening point P3 overlaps with the woven cloth opening Wa. As a result, the range of the opening R is specified with high precision.

[0059] <Drawing section> The drawing unit 54 draws a pseudo-abnormality in the shed R defined by the temporary upper warp end point P1, temporary lower warp end point P2, and temporary woven opening point P3 determined by the determination unit 53. Specifically, the drawing unit 54 displays a pseudo-abnormal warp thread T on the shed image. The worker operates the input unit 35 to pseudo-display a warp thread T extending from any position of at least one of the upper warp thread Tu and the lower warp thread Td. In FIG. 8, the warp thread T extending from the upper warp thread Tu is drawn. This pseudo-displayed warp thread T is displayed on the shed image as an abnormal warp thread T.

[0060] As a result, a pseudo-abnormal image showing that an abnormal warp thread T exists in the opening R is displayed on the opening image, and a pseudo-abnormal image is generated. After the pseudo-abnormal image is generated, the pseudo-abnormal image data relating to the generated pseudo-abnormal image is stored in the main memory unit 42b of the detection unit 42, and is learned as pseudo-abnormal image data by the determination unit 43. Then, as the amount of pseudo-abnormal image data generated by the pseudo-abnormal image generation unit 50 increases, the determination accuracy by the determination unit 43 improves.

[0061] [Operation of the embodiment] Next, the operation of the embodiment will be described together with a method for generating a pseudo-abnormal image. To generate a pseudo-abnormal image, the worker starts up a pseudo-abnormal image generation application. Note that the worker has previously taken an image of the opening R in a normal state using the camera 32.

[0062] As shown in FIG. 6, the processing screen S displays an opening image display area Sa, a first operation button Sb, a second operation button Sc, a third operation button Sd, and a fourth operation button Se. The operator operates the first operation button Sb by operating the input unit 35 to display image data for generating a pseudo-abnormal image. Note that image data can be selected by repeatedly operating the first operation button Sb. The pseudo-abnormal image generating unit 50 displays the specified image data in the opening image display area Sa.

[0063] In the selected shedding image, the woven edge Wa is hidden by the other parts F, and the upper warp end point W1 and the lower warp end point W2 are displayed. The worker performs an operation to specify the range of the shedding R on the shedding image.

[0064] The worker operates the second operation button Sc by operating the input unit 35. This enables the temporary designation work. The worker operates the input unit 35 to designate a temporary upper warp end point P1 at the position of the upper warp end point W1 in the sheath image. The temporary designation unit 51 then temporarily designates the temporary upper warp end point P1 at a position overlapping with the upper warp end point W1 in the sheath image. The worker also operates the input unit 35 to designate a temporary lower warp end point P2 at the position of the lower warp end point W2 in the sheath image. The temporary designation unit 51 then temporarily designates the temporary lower warp end point P2 at a position overlapping with the lower warp end point W2 in the sheath image. When the temporary upper warp end point P1 and the temporary lower warp end point P2 are temporarily designated in the sheath image, the auxiliary line drawing unit 52 displays a connecting auxiliary line H3 connecting the temporary upper warp end point P1 and the temporary lower warp end point P2, as shown in FIG. 7.

[0065] The worker operates the input unit 35 to designate any position on the shelving image and temporarily designate the temporary weaving opening point P3. The auxiliary line drawing unit 52 then displays the temporary weaving opening point P3 on the shelving image. Simultaneously with displaying the temporary weaving opening point P3, the auxiliary line drawing unit 52 also displays an upper auxiliary line H1 connecting the temporary upper warp end point P1 and the temporary weaving opening point P3 on the shelving image, and a lower auxiliary line H2 connecting the temporary lower warp end point P2 and the temporary weaving opening point P3 on the shelving image. A triangle having three vertices, the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary weaving opening point P3, is then displayed on the shelving image.

[0066] Next, the worker operates the input unit 35 to move the temporary woven opening point P3 to the position where the woven opening Wa is expected to be located. As the temporary woven opening point P3 moves, the shape of the triangle changes.

[0067] 8, the worker operates the input unit 35 to align the upper auxiliary line H1 with the upper warp thread Tu and the lower auxiliary line H2 with the lower warp thread Td. When the upper auxiliary line H1 is aligned with the upper warp thread Tu and the lower auxiliary line H2 is aligned with the lower warp thread Td, the temporary woven weave opening point P3 is displayed at the position assumed to be the woven weave opening Wa. After that, the worker releases the operation of the input unit 35, and the temporary designation unit 51 temporarily designates the temporary woven weave opening point P3 at the position assumed to be the woven weave opening Wa on the sheath image.

[0068] When the operator operates the input unit 35 to confirm the provisional upper warp end point P1, provisional lower warp end point P2, and provisional woven weaving mouth point P3 at the provisionally designated positions, the positions of the provisional upper warp end point P1, provisional lower warp end point P2, and provisional woven weaving mouth point P3 in the shed image are confirmed. In other words, the extent of the shed R is defined in the shed image. As a result, even if the woven weaving mouth Wa is hidden in the shed image, the extent of the shed R can be designated with high accuracy.

[0069] The worker operates the third operation button Sd by operating the input unit 35. This enables the worker to draw a pseudo-abnormality on the opening image. The worker operates the input unit 35 to pseudo-display a warp thread T extending from any position on either the upper warp thread Tu or the lower warp thread Td. As a result, a pseudo-abnormal image is generated in which an abnormal warp thread T is present in the opening R.

[0070] The operator operates the fourth operation button Se by operating the input unit 35. The pseudo-abnormal image data relating to the generated pseudo-abnormal image is stored in the main memory unit 42b of the detection unit 42, and is learned by the determination unit 43 as pseudo-abnormal image data.

[0071] According to the above embodiment, the following effects can be obtained. (1) The pseudo-abnormal image generating unit 50 can use the auxiliary line drawing unit 52 to draw an upper auxiliary line H1 that coincides with the upper warp thread Tu and a lower auxiliary line H2 that coincides with the lower warp thread Td. When the upper auxiliary line H1 coincides with the upper warp thread Tu and the lower auxiliary line H2 coincides with the lower warp thread Td, the temporary woven fabric opening point P3 is located at the position where the upper auxiliary line H1 and the lower auxiliary line H2 intersect. Since the woven fabric opening Wa is located at the position where the upper warp thread Tu and the lower warp thread Td intersect, the temporary woven fabric opening point P3 located at the position where the upper auxiliary line H1 and the lower auxiliary line H2 intersect is located at the woven fabric opening Wa. Furthermore, the temporary upper warp end point P1 overlaps the upper warp thread Tu, and the temporary lower warp end point P2 overlaps the lower warp thread Td. Therefore, the three points, temporary upper warp end point P1, temporary lower warp end point P2, and temporary woven cloth opening point P3, can be accurately positioned at positions that define the shed R. As a result, by determining the three points, temporary upper warp end point P1, temporary lower warp end point P2, and temporary woven cloth opening point P3, using the determining unit 53, the positions of the upper warp end point W1, lower warp end point W2, and woven cloth opening Wa can be accurately specified in the shed image, allowing the range of the shed R to be accurately specified. Then, the drawing unit 54 can draw a pseudo-abnormal image within the accurately specified range of the shed R, allowing a highly accurate pseudo-abnormal image to be generated. As a result, the loom abnormality detection device 30 can suppress a decrease in the judgment accuracy using the judgment model.

[0072] (2) After temporarily designating the temporary upper warp end point P1 and the temporary lower warp end point P2 on the shed image, when the temporary woven weave opening point P3 is temporarily designated and moved, the auxiliary line drawing unit 52 can simultaneously display the upper auxiliary line H1 and the lower auxiliary line H2. The position where the upper auxiliary line H1 and the lower auxiliary line H2 intersect is temporarily designated as the temporary woven weave opening point P3, so the auxiliary line drawing unit 52 displays the upper auxiliary line H1 and the lower auxiliary line H2 and the temporary woven weave opening point P3 at the same time. As a result, when the upper auxiliary line H1 coincides with the upper warp Tu and the lower auxiliary line H2 coincides with the lower warp Td, the woven weave opening Wa can be displayed at the position where the temporary woven weave opening point P3 is displayed. Therefore, compared to when the upper auxiliary line H1 and the lower auxiliary line H2 are drawn and displayed separately, the efficiency of the work of displaying the position that will become the woven weave opening Wa is improved.

[0073] (3) The auxiliary line drawing unit 52 displays the upper auxiliary lines H1 and the lower auxiliary lines H2 in a different manner from the connection auxiliary lines H3. This makes it easy to distinguish the changes in the upper auxiliary lines H1 and the lower auxiliary lines H2 when moving the temporary woven weave opening point P3 to align the upper auxiliary line H1 with the upper warp thread Tu and the lower auxiliary line H2 with the lower warp thread Td. Furthermore, the process of moving the temporary woven weave opening point P3 to the expected position of the woven weave opening Wa can be seen, making it easier to position the woven weave opening Wa. Furthermore, the upper auxiliary lines H1, the lower auxiliary lines H2, and the connection auxiliary lines H3 make it easy to see the extent of the opening R.

[0074] (4) The woven edge Wa is located at the intersection of the upper warp threads Tu and the lower warp threads Td. The upper warp end point W1 is located at a position overlapping the upper warp threads Tu, and the lower warp end point W2 is located at a position overlapping the lower warp threads Td. The area of ​​the opening R can be precisely specified by using a provisional upper warp end point P1 temporarily designated on the upper warp threads Tu, a provisional lower warp end point P2 temporarily designated on the lower warp threads Td, an upper auxiliary line H1 aligned with the upper warp threads Tu, and a lower auxiliary line H2 aligned with the lower warp threads Td.

[0075] (5) The auxiliary line drawing unit 52 displays a connection auxiliary line H3 that connects the provisional upper warp end point P1 and the provisional lower warp end point P2 on the opening image. This causes the parts around the opening R to be displayed in the opening image display area Sa. Therefore, by displaying the upper auxiliary line H1, the lower auxiliary line H2, and the connection auxiliary line H3, the extent of the opening R becomes easier to see.

[0076] (6) The auxiliary line drawing unit 52 displays the upper auxiliary line H1 and the lower auxiliary line H2 as dashed lines. For example, when the upper warp thread Tu and the upper auxiliary line H1 coincide with each other, as in the case where the auxiliary line drawing unit 52 displays the upper auxiliary line H1 as a solid line, the solid lines do not overlap. In other words, when the upper warp thread Tu and the upper auxiliary line H1 coincide with each other, and when the lower warp thread Td and the lower auxiliary line H2 coincide with each other, it is easy to distinguish whether or not the two lines coincide with each other.

[0077] [Example of change] This embodiment can be modified as follows: This embodiment and the following modifications can be combined and implemented within the scope of technical compatibility.

[0078] The auxiliary line drawing unit 52 may separately draw an upper auxiliary line H1 connecting the provisionally designated provisional upper warp end point P1 and the provisional woven opening point P3, and a lower auxiliary line H2 connecting the provisional lower warp end point P2 and the provisional woven opening point P3. The method for specifying the opening R in this case will be described below.

[0079] As shown in FIG. 9, the worker temporarily designates a temporary upper warp end point P1 at a position overlapping with the upper warp thread Tu in the shed image. At this time, it is assumed that the upper warp end point W1 and woven weft Wa are hidden by other parts F in the shed image. The worker temporarily designates a temporary upper warp end point P1 at a position on the upper warp thread Tu in the shed image that is assumed to be near the upper warp end point W1. Then, as shown in FIG. 10, the worker temporarily designates a temporary woven weft point P3 at a position overlapping with the upper warp thread Tu and draws an upper auxiliary line H1 connecting the temporary upper warp end point P1 and the temporary woven weft point P3. The worker moves the temporary woven weft point P3 to a position that is assumed to be the woven weft Wa while aligning the upper auxiliary line H1 with the upper warp thread Tu.

[0080] Next, the worker provisionally designates a temporary lower warp end point P2 at a position overlapping with the lower warp thread Td in the sheath image. The worker provisionally designates a temporary lower warp end point P2 at a position overlapping with the lower warp end point W2 on the lower warp thread Td in the sheath image. The worker aligns the lower auxiliary line H2 with the lower warp thread Td and moves the lower auxiliary line H2 toward a temporary woven opening point P3. Then, while making the lower auxiliary line H2 intersect with the upper auxiliary line H1, the worker provisionally designates a temporary woven opening point P3 at the position where the lower auxiliary line H2 intersects with the upper auxiliary line H1.

[0081] The temporary upper warp end point P1, temporary lower warp end point P2, and temporary woven weave mouth point P3 have been temporarily designated, but the temporary upper warp end point P1 has been temporarily designated outside the other part F. As described above, the upper warp end point W1 is hidden by the other part F, so the position of the temporarily designated temporary upper warp end point P1 is located away from the upper warp end point W1. Therefore, the worker fine-tunes the position of the temporary upper warp end point P1 so that it approaches the upper warp end point W1, which is located in a position hidden by the other part F.

[0082] The upper warp thread end point W1, which is hidden by the other part F, is located on an extension line of the upper warp thread Tu, so as shown in Fig. 11, the worker operates the input unit 35 to move the temporary upper warp thread end point P1 along the upper warp thread Tu toward the other part F. At this time, the worker moves the temporary upper warp thread end point P1 to a position where the upper warp thread end point W1 is assumed to be located based on the entire opening image.

[0083] Even if the upper auxiliary line H1 and the lower auxiliary line H2 are drawn separately in this way, the woven opening Wa is located at the intersection of the upper auxiliary line H1 and the lower auxiliary line H2, so the temporary woven opening point P3 can be provisionally specified with high accuracy.

[0084] Furthermore, even after the provisional upper warp end point P1, provisional lower warp end point P2, and provisional woven cloth opening point P3 have been provisionally designated, the pseudo-abnormal image generating unit 50 can adjust the positions of the provisional upper warp end point P1, provisional lower warp end point P2, and provisional woven cloth opening point P3. This allows the positions of the provisional upper warp end point P1, provisional lower warp end point P2, and provisional woven cloth opening point P3 to be designated with high accuracy.

[0085] When the closure opening Wa is displayed in the closure image and the lower warp end point W2 is hidden by another part F, the pseudo-abnormal image generating unit 50 may temporarily designate the temporary lower warp end point P2 to specify the range of the closure R. In this case, after temporarily designating the positions of the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary closure opening point P3, the position of the temporary lower warp end point P2 may be further fine-tuned.

[0086] In an opening image in which the upper warp end point W1, the lower warp end point W2, and the woven cloth opening Wa are all hidden by other parts F, the pseudo-abnormal image generating unit 50 may temporarily designate the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven cloth opening point P3 to designate the range of the opening R. In this case, the positions of the temporary upper warp end point P1, the temporary lower warp end point P2, and the temporary woven cloth opening point P3 can be temporarily designated by superimposing the upper auxiliary line H1 and the lower auxiliary line H2 on the upper warp thread Tu and the lower warp thread Td displayed in the opening image.

[0087] The upper auxiliary line H1 and the lower auxiliary line H2 may be displayed as solid lines instead of dashed lines, or may be displayed in other display modes. The processing screen S may display only the aperture image display area Sa.

[0088] ○As in the embodiment, when the upper warp thread end point W1 and the lower warp thread end point W2 are displayed on the opening image, when the temporary upper warp thread end point P1 and the temporary lower warp thread end point P2 are temporarily specified, the auxiliary line drawing unit 52 does not need to display the connection auxiliary line H3.

[0089] In the embodiment, the pseudo-abnormal image is generated by processing the normal image. However, the pseudo-abnormal image may be generated by further processing the abnormal image. [Explanation of symbols]

[0090] H1...upper auxiliary line, H2...lower auxiliary line, H3...connection auxiliary line, P1...temporary upper warp end point, P2...temporary lower warp end point, P3...temporary loom mouth point, R...opening, S...processing screen, Tu...upper warp, Td...lower warp, W1...upper warp end point, W2...lower warp end point, Wa...loom mouth, Y...weft, 16...reed, 27a...display unit, 30...loom abnormality detection device, 32...camera, 50...pseudo-abnormal image generation unit, 51...temporary designation unit, 52...auxiliary line drawing unit, 53...confirmation unit, 54...drawing unit.

Claims

1. An abnormality detection device for a loom detects weaving abnormalities from an image of an opening captured by a camera, the image being related to an opening defined by a reed, an upper warp thread above a weft thread, a lower warp thread below the weft thread, and a woven cloth cutout where the upper warp thread and the lower warp thread cross, using a determination model that has learned normal images of the opening in a normal state and abnormal images of the opening in an abnormal state, a pseudo-abnormal image generating unit that generates a pseudo-abnormal image from the opening image captured by the camera, The pseudo-abnormal image generating unit a temporary designation unit that temporarily designates, for the sheath image displayed on the processing screen of the display unit, a temporary upper warp end point that is assumed to be an upper warp end point of the upper warp thread that leaves the reed and extends forward, a temporary lower warp end point that is assumed to be a lower warp end point of the lower warp thread that leaves the reed and extends forward, and a temporary woven camel point that is assumed to be the woven camel; an auxiliary line drawing unit that draws an upper auxiliary line connecting the provisional upper warp end point and the provisional woven opening point provisionally designated by the temporary designation unit, and a lower auxiliary line connecting the provisional lower warp end point and the provisional woven opening point; a determination unit that determines the positions of the provisional upper warp end point, the provisional lower warp end point, and the provisional woven opening point that are temporarily designated at a position where the upper auxiliary line coincides with the upper warp in the opening image and the lower auxiliary line coincides with the lower warp in the opening image; a drawing unit that draws a pseudo-abnormality in the opening defined by the temporary upper warp end point, the temporary lower warp end point, and the temporary woven opening point determined by the determining unit; An abnormality detection device for a loom having the same.

2. 2. The abnormality detection device for a loom according to claim 1, wherein the temporary designation unit temporarily designates the temporary upper warp end point and the temporary lower warp end point, and temporarily designates the temporary loom mouth point, and the auxiliary line drawing unit simultaneously displays the upper auxiliary line and the lower auxiliary line.

3. 3. The abnormality detection device for a loom according to claim 2, wherein the auxiliary line drawing unit displays a connecting auxiliary line connecting the provisional upper warp end point and the provisional lower warp end point.

4. The abnormality detection device for a loom according to claim 3, wherein the auxiliary line drawing unit displays the upper auxiliary line and the lower auxiliary line in a manner different from a manner in which the connection auxiliary line is displayed.

Images