Sewing machine worker taking and placing action analysis method and system, medium and terminal

Abstract

The invention provides a sewing machine worker taking and placing action analysis method and system, a medium and a terminal, and the method comprises the steps: obtaining a time difference between a motor thread trimming time point and a motor starting time point which are adjacent, and taking the adjacent motor thread trimming time point and the motor starting time point as a timestamp array; selecting the timestamp array of which the time difference is greater than a preset threshold as a target timestamp array; when it is detected that no cloth exists near a machine needle of the sewing machine, actual sewing action data of the sewing machine before the time period corresponding to the target timestamp array is obtained; when it is judged that the lathe worker completes sewing of one finished product, the thread trimming time point corresponding to the target timestamp array serves as the starting time point of the releasing action, and the mean value of the corresponding thread trimming time point and the motor starting time point serves as the starting time point of the taking action. According to the sewing machine turner taking and placing action analysis method and system, the medium and the terminal, the taking and placing actions of the turner are analyzed based on the action data and the image data of the sewing machine, and rapidness and high efficiency are achieved.

Description

Technical Field

[0001] This application belongs to the technical field of data processing, and relates to a method, system, medium and terminal for analyzing the picking and placing actions of sewing machine operators. Background Art

[0002] At present, garment factories generally face the problem of identifying and improving the sewing efficiency of sewing machine operators. To improve sewing efficiency, it is necessary to accurately identify which actions of employees are slower during the sewing process and which links have room for optimization.

[0003] In the prior art, Internet of Things (IoT) sewing equipment has basically replaced ordinary sewing machines. With the development of the IoT system, IoT sewing equipment can provide real-time sewing information of sewing machine operators. Therefore, in order to identify and improve the efficiency of sewing machine operators, how to analyze the sewing actions of sewing machine operators based on the sewing information of IoT sewing equipment has become an important problem to be solved in the current garment production field. Summary of the Invention

[0004] The purpose of this application is to provide a method, system, medium and terminal for analyzing the picking and placing actions of sewing machine operators, which identify and analyze the picking and placing actions of sewing machine operators based on the action data and image data of the sewing machine, and provide data support for judging the efficiency of sewing machine operators.

[0005] In a first aspect, this application provides a method for analyzing the picking and placing actions of sewing machine operators. The method includes the following steps: obtaining the thread cutting time point and the motor starting time point of the sewing machine; obtaining the time difference between adjacent motor thread cutting time points and motor starting time points, and using the adjacent motor thread cutting time point and motor starting time point as a time stamp array; selecting the time stamp arrays with time differences greater than a preset threshold as target time stamp arrays; when it is detected that there is no fabric near the sewing needle of the sewing machine, obtaining the actual sewing action data of the sewing machine before the period corresponding to the target time stamp array; judging whether the sewing machine operator has completed sewing a finished product based on the actual sewing action data; when it is determined that the sewing machine operator has completed sewing a finished product, using the thread cutting time point corresponding to the target time stamp array as the start time point of the placing action, and using the average value of the thread cutting time point and the motor starting time point corresponding to the target time stamp array as the start time point of the picking action.

[0006] In one implementation manner of the first aspect, obtaining the thread cutting time point and the motor starting time point of the sewing machine includes the following steps: obtaining the event data of the sewing machine; the event data includes the event generation time and the event type; using the event generation times corresponding to the event types of thread cutting and motor starting as the thread cutting time point and the motor starting time point.

[0007] In an implementation of the first aspect, it further includes detecting whether there is fabric near the sewing needle of the sewing machine; Detecting whether there is fabric near the sewing needle of the sewing machine includes the following steps: Obtain multiple sewing needle area images within the time period corresponding to the target timestamp array; Calculate the difference between the pixel values of each sewing needle area image and the sewing needle reference image, where there is fabric near the sewing needle in the sewing needle reference image; When the proportion of pixel points with a difference greater than the preset difference in the sewing needle area image is greater than the first preset proportion, it is determined that there is fabric in the sewing needle area image; Among the multiple sewing needle area images, when the proportion of sewing needle area images determined to have fabric does not exceed the second preset proportion, it is determined that there is no fabric near the sewing needle of the sewing machine.

[0008] In an implementation of the first aspect, determining whether the sewing worker has completed sewing a finished product based on the actual sewing action data includes the following steps: Obtain the reference sewing action data required for a finished product: Judge whether the actual sewing action data between a certain time point and the thread cutting time point corresponding to the target timestamp array is consistent with the reference sewing action data; If so, it is determined that the sewing worker has completed sewing a finished product.

[0009] In an implementation of the first aspect, the actual sewing action data and the reference sewing action data adopt one or more combinations of the number of sewing stitches, the number of times of lifting and pressing the presser foot, and the number of times of starting and stopping the motor between adjacent thread cuttings.

[0010] In an implementation of the first aspect, judging whether the actual sewing action data between a certain time point and the thread cutting time point corresponding to the target timestamp array is consistent with the reference sewing action data includes the following steps: Extract the segmented action features of the reference sewing action data; Extract the segmented action features of the actual sewing action data; Judge whether the segmented action features of the reference sewing action data and the segmented action features of the actual sewing action data match one by one; When they match one by one, it is determined that the actual sewing action data and the reference sewing action data are consistent.

[0011] In a second aspect, the present application provides a sewing machine sewing worker picking and placing action analysis system, and the system includes a first acquisition module, a second acquisition module, a selection module, a third acquisition module, a judgment module, and an analysis module; The first acquisition module is configured to acquire the thread cutting time point and the motor starting time point of the sewing machine; The second acquisition module is configured to acquire the time difference between adjacent motor thread cutting time points and motor starting time points, and use the adjacent motor thread cutting time points and motor starting time points as a time stamp array; The selection module is configured to select the time stamp array with the time difference greater than a preset threshold as the target time stamp array; The third acquisition module is configured to acquire the actual sewing action data of the sewing machine before the period corresponding to the target time stamp array when it is detected that there is no fabric near the sewing needle of the sewing machine; The judgment module is configured to judge whether the operator has completed sewing a finished product based on the actual sewing action data; The analysis module is configured to, when it is determined that the operator has completed sewing a finished product, use the thread cutting time point corresponding to the target time stamp array as the start time point of the placing action, and use the average value of the thread cutting time point and the motor starting time point corresponding to the target time stamp array as the start time point of the picking action.

[0012] In a third aspect, the present application provides a terminal, which includes: a processor and a memory; The memory is configured to store a computer program; The processor is configured to execute the computer program stored in the memory, so that the terminal executes the above-mentioned sewing machine operator picking and placing action analysis method.

[0013] In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a terminal, the above-mentioned sewing machine operator picking and placing action analysis method is implemented.

[0014] In a fifth aspect, the present application provides a sewing machine operator picking and placing action analysis system, including the above-mentioned terminal and a sewing machine; The sewing machine includes an information acquisition module; The information acquisition module is configured to acquire the thread cutting time point and the motor starting time point of the sewing machine, and provide them to the terminal.

[0015] As described above, the sewing machine operator picking and placing action analysis method, system, medium and terminal of the present application have the following beneficial effects.

[0016] (1) Identify and analyze the operator's picking and placing actions based on the action data and image data of the sewing machine, which is fast and efficient.

[0017] (2) Provide data support for judging the operator's efficiency. Description of the Drawings

[0018] Figure 1Shown is a flowchart of the sewing machine operator's picking and placing action analysis method of the present application in an embodiment.

[0019] Figure 2 Shown is a schematic diagram of the event data of the present application in an embodiment.

[0020] Figure 3 Shown is a schematic diagram of the motor thread cutting time point and the motor starting time point in the present application in an embodiment.

[0021] Figure 4 Shown is a detection schematic diagram of the presence of fabric near the sewing needle of the sewing machine in the present application in an embodiment.

[0022] Figure 5 Shown is a segmented schematic diagram of the reference sewing action data in the present application in an embodiment.

[0023] Figure 6 Shown is a segmented schematic diagram of the number of sewing stitches during thread cutting in the present application in an embodiment.

[0024] Figure 7 Shown is a segmented feature schematic diagram of the reference sewing action data in the present application in an embodiment.

[0025] Figure 8 Shown is a segmented matching schematic diagram of the reference sewing action data and the actual sewing action data in the present application in an embodiment.

[0026] Figure 9 Shown is a structural schematic diagram of the sewing machine operator's picking and placing action analysis system of the present application in an embodiment.

[0027] Figure 10 Shown is a structural schematic diagram of the terminal of the present application in an embodiment.

[0028] Figure 11 Shown is a structural schematic diagram of the sewing machine operator's picking and placing action analysis system of the present application in another embodiment. Detailed implementation manners

[0029] The following uses specific specific examples to illustrate the implementation manners of the present application. Those skilled in the art can easily understand other advantages and effects of the present application from the content disclosed in this specification. The present application can also be implemented or applied through other different specific implementation manners. Various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that, without conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0030] It should be noted that the illustrations provided in the following embodiments only schematically illustrate the basic concept of the present application. Therefore, only the components related to the present application are shown in the drawings, rather than being drawn according to the number, shape, and size of the components in actual implementation. The types, quantities, and proportions of the components in actual implementation can be arbitrarily changed, and the component layout type may also be more complex.

[0031] In addition, in the present application, descriptions such as "first" and "second" are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between various embodiments can be combined with each other, but it must be based on the ability of those of ordinary skill in the art to implement. When the combination of technical solutions conflicts with each other or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by the present application.

[0032] As Figure 1 shown, in one embodiment, the sewing machine operator picking and placing action analysis method of the present application includes steps S1 to S6.

[0033] Step S1, obtain the thread cutting time point and the motor starting time point of the sewing machine.

[0034] Specifically, an information collection module is provided in the sewing machine of the present application. The information collection module is used to collect the event data of the sewing machine. As Figure 2 shown, the event data includes the event occurrence time, event type, and event parameters. In one embodiment, the event type can be represented by digital numbers such as 0, 1, 2, etc. For example, 2 represents motor start, 3 represents motor stop, and 6 and 7 respectively represent the thread cutting and post-thread cutting actions of the sewing machine. The event parameters represent the parameter information involved in the corresponding event type. For example, for the event with the event type of motor stop, its event parameter is the number of stitches sewn this time. Therefore, obtain the event data of the sewing machine, and use the event generation times corresponding to the thread cutting and motor start as the thread cutting time point and the motor starting time point. As Figure 3 shown, according to event types 6 and 2, the corresponding thread cutting time point and motor starting time point can be obtained.

[0035] Step S2, obtain the time difference between adjacent motor thread cutting time points and motor starting time points, and use the adjacent motor thread cutting time points and motor starting time points as a time stamp array.

[0036] Specifically, in the present application, the sewing operations of the sewing machine operator are divided into four actions: picking up the fabric, sewing the fabric, arranging the fabric, and placing the fabric. Among them, the action of picking up the fabric is the starting process of the sewing operation, indicating picking up the fabric to be sewn. The action of sewing the fabric is the intermediate process of the sewing operation, indicating sewing the fabric. The action of arranging the fabric is the intermediate process of the sewing operation, indicating arranging the fabric. The action of placing the fabric is the ending process of the sewing operation, indicating placing the sewn fabric. Therefore, for a piece of fabric, its sewing operations are successively picking up the fabric, sewing the fabric, arranging the fabric, sewing the fabric... (where the number of times of arranging the fabric and sewing the fabric depends on different sewing requirements), and placing the fabric.

[0037] As can be seen from the above, during the sewing process of the sewing machine operator, the actions of picking up the fabric and placing the fabric are in one-to-one correspondence. Among them, the time points of the actions of picking up the fabric and placing the fabric occur between the thread cutting time point and the motor starting time point. Therefore, calculate the time difference between adjacent thread cutting time points and motor starting time points. During this time difference, the sewing machine operator may perform the actions of picking up the fabric and placing the fabric. At the same time, use the adjacent thread cutting time point and motor starting time point as a time stamp array. For example, the time stamp array is expressed as [thread cutting time point, next motor starting time point].

[0038] Step S3: Select the time stamp arrays with the time difference greater than the preset threshold as the target time stamp arrays.

[0039] Specifically, it is possible for the sewing machine operator to perform the actions of picking up the fabric and placing the fabric between the thread cutting time point and the motor starting time point, but the time length requirements of the above actions also need to be considered at the same time. If the time length is too short, it may only be a pause in the sewing action and no actions of picking up the fabric and placing the fabric are performed. Therefore, based on the above special situation, it is necessary to set the action time thresholds for picking up the fabric and placing the fabric. Only when the time difference is greater than the preset threshold, such as 3s, can the actions of picking up the fabric and placing the fabric be further analyzed.

[0040] It should be noted that the time threshold can be obtained and updated through multiple learning processes.

[0041] Step S4: When it is detected that there is no fabric near the sewing needle of the sewing machine, obtain the actual sewing action data of the sewing machine before the period corresponding to the target time stamp array.

[0042] Specifically, when analyzing the picking and placing actions of the sewing machine operator, it is first necessary to detect whether there is fabric near the sewing needle of the sewing machine. Only when there is no fabric near the sewing needle can the picking and placing actions of the sewing machine operator be identified and analyzed.

[0043] In one embodiment, detecting whether there is fabric near the sewing needle of the sewing machine includes the following steps.

[0044] 41) Obtain multiple images of the needle area within the time period corresponding to the target timestamp array.

[0045] Among them, an image acquisition module, such as a camera, is provided on the sewing machine. Based on the camera, multiple images of the needle area within the time period corresponding to the target timestamp array are acquired.

[0046] 42) Calculate the difference in pixel values between each image of the needle area and the needle reference image, where there is cloth near the needle in the needle reference image.

[0047] Among them, the needle reference image is pre-acquired, that is, an image with cloth near the needle. The image of the needle area and the needle reference image are acquired by the camera at the same position. Calculate the difference in pixel values of the corresponding pixel points between the image of the needle area and the needle reference image.

[0048] 43) When the proportion of pixel points in the image of the needle area whose difference is greater than the preset difference is not greater than the first preset proportion, it is determined that there is no cloth in the image of the needle area; otherwise, it is determined that there is cloth in the image of the needle area.

[0049] Among them, count the proportion of pixel points in the image of the needle area whose difference is greater than the preset difference. When the proportion is greater than the first preset proportion, it is determined that there is no cloth in the image of the needle area.

[0050] 44) Among the multiple images of the needle area, when the proportion of images of the needle area determined to have cloth does not exceed the second preset proportion, it is determined that there is no cloth near the needle of the sewing machine.

[0051] Among them, for multiple images of the needle area, count the proportion of images of the needle area with cloth again. Only when the proportion exceeds the second preset proportion, it is determined that there is cloth near the needle of the sewing machine. When the proportion of images of the needle area determined to have cloth does not exceed the second preset proportion, it is determined that there is no cloth near the needle of the sewing machine. As Figure 4 shown, the left side is the needle reference image, and the right side has the image of the needle area. Through the above analysis, it can be determined that there is cloth near the needle in the right image.

[0052] When it is detected that there is no cloth near the needle of the sewing machine, then obtain the actual sewing action data of the sewing machine before the time period corresponding to the target timestamp array. Among them, the actual sewing action data can be one or a combination of multiple of the number of sewing stitches between adjacent thread cuts, the number of times of lifting and lowering the presser foot, and the number of times of starting and stopping the motor.

[0053] Step S5: Based on the actual sewing action data, determine whether the operator has completed sewing a finished product.

[0054] Specifically, determining whether a sewing worker has completed sewing a finished product based on the actual sewing action data includes the following steps.

[0055] 51) Obtain the reference sewing action data required for a finished product.

[0056] Taking the number of sewing stitches between adjacent thread cuts as an example to obtain the reference sewing action data. The reference sewing action data can be obtained by manual input. In this application, the reference sewing action data is constructed according to the number of sewing times required between each thread cut during the sewing process of a finished product.

[0057] 52) Determine whether the actual sewing action data between a certain time point and the thread cut time points corresponding to the target time stamp array is consistent with the reference sewing action data.

[0058] Among them, the reference sewing action data is segmented according to different sewing states. For example, the sewing action data where there is fabric near the sewing needle is used as the first segment of data, the sewing action data where there is no fabric near the sewing needle and the time difference between the thread cut time point and the motor start time point is less than or equal to a preset threshold is used as the second segment of data, and the sewing action data where there is no fabric near the sewing needle and the time difference between the thread cut time point and the motor start time point is greater than the preset threshold is used as the third segment of data. For each segment of sewing action data, the segmented action features corresponding to the reference sewing action data and the actual sewing action data are extracted. Determine whether the segmented action features of the reference sewing action data and the segmented action features of the actual sewing action data match one by one; when they match one by one, it is determined that the actual sewing action data and the reference sewing action data are consistent.

[0059] As Figure 5 shown, according to the time difference between the motor stop time point and the motor start time point, the time difference between the thread cut time point and the motor start time point, and whether there is fabric near the sewing needle, the sewing data is divided into two segments of data. In the first segment of data, if the time difference is small and there is fabric near the sewing needle, it is the action of sewing the fabric; if the time difference is large and there is fabric near the sewing needle, it may be the action of straightening the fabric or an abnormal action. In the second segment of data, if the time difference is small and there is no fabric near the sewing needle, it is determined as the action of sewing the fabric. When the time difference is large and there is no fabric near the sewing needle, it is determined as the action of placing the fabric. Therefore, it is necessary to segment the sewing action data of a finished product according to different sewing actions.

[0060] As Figure 6 shown, collect the number of thread cuts and the number of sewing stitches between thread cuts during the sewing process. As Figure 7As shown, classify the number of sewing stitches between thread cuts, where category characters are used to replace the original number of stitches. Preferably, different stitch number intervals correspond to different categories. For example, 21 stitches and 16 stitches are close to category 0, and 91 stitches and 83 stitches are close to category 1. Classify the remaining two segments of data in the same way. Figure 5 The sewing data in Figure 5 can be divided into three segments. The first segment has a total of 2 thread cuts with categories 0 and 1, the second segment has a total of 1 thread cut with category 0, and the third segment has a total of 1 thread cut with category 1. It should be noted that only the sewing stitch number is used for classification here, so it can be classified only by judging the numerical size. For classification with more selected features, classification methods such as clustering or SVM and other machine learning algorithms can be used. Therefore, classify the number of sewing stitches between thread cuts corresponding to each segment of data as the segmented action feature of the reference sewing action data and the segmented action feature of the actual sewing action data. Compare each segmented action feature of the reference sewing action data and the actual sewing action data one by one. When both are the same, it is determined that the actual sewing action data and the reference sewing action data are consistent. As Figure 8 shown, each time take a segment of actual sewing action data and match it with the reference sewing action data to check if there are features in the same order as the reference sewing action data. For Figure 6 the embodiment of Figure 6 , that is, check if 0101 appears. The first time taking the first segment of data does not meet the requirement, the second time taking the first and second segments of data also does not meet the requirement, and the third time taking the first to third segments of data meets the requirement. At this time, it is determined that the lathe worker has completed one piece. The next time taking the actual sewing action data starts from the fourth segment of data and repeats the above operation.

[0061] 53) If so, determine that the lathe worker has completed sewing one finished product.

[0062] Among them, when it is determined that the actual sewing action data and the reference sewing action data are consistent, it is determined that the lathe worker has completed sewing one finished product.

[0063] Step S6: When it is determined that the lathe worker has completed sewing one finished product, use the thread cut time points corresponding to the target time stamp array as the start time points of the placing action, and use the average value of the thread cut time points corresponding to the target time stamp array and the motor start time points as the start time points of the taking action.

[0064] The protection scope of the method for analyzing the taking and placing actions of the sewing machine lathe worker described in the embodiments of this application is not limited to the execution order of the steps listed in this embodiment. Any solutions achieved by adding or subtracting steps and replacing steps of the prior art according to the principles of this application are included in the protection scope of this application.

[0065] The embodiment of the present application further provides a sewing machine operator's pick-and-place action analysis system. The sewing machine operator's pick-and-place action analysis system can implement the sewing machine operator's pick-and-place action analysis method described in the present application. However, the implementation devices of the sewing machine operator's pick-and-place action analysis system described in the present application include, but are not limited to, the structures of the sewing machine operator's pick-and-place action analysis system listed in this embodiment. Any structural deformation and replacement of the prior art made according to the principles of the present application are included in the protection scope of the present application.

[0066] As Figure 9 shown, in one embodiment, the sewing machine operator's pick-and-place action analysis system of the present application includes a first acquisition module 91, a second acquisition module 92, a selection module 93, a third acquisition module 94, a judgment module 95, and an analysis module 96.

[0067] The first acquisition module 91 is used to acquire the thread cutting time point and the motor start time point of the sewing machine.

[0068] The second acquisition module 92 is connected to the first acquisition module 91 and is used to acquire the time difference between adjacent motor thread cutting time points and motor start time points, and use the adjacent motor thread cutting time points and motor start time points as a time stamp array.

[0069] The selection module 93 is connected to the second acquisition module 92 and is used to select the time stamp array with a time difference greater than a preset threshold as the target time stamp array.

[0070] The third acquisition module 94 is connected to the selection module 93 and is used to acquire the actual sewing action data of the sewing machine before the period corresponding to the target time stamp array when it is detected that there is no fabric near the sewing needle of the sewing machine.

[0071] The judgment module 95 is connected to the third acquisition module 94 and is used to judge whether the operator has completed sewing a finished product based on the actual sewing action data.

[0072] The analysis module 96 is connected to the judgment module 95 and is used to, when it is determined that the operator has completed sewing a finished product, use the thread cutting time point corresponding to the target time stamp array as the start time point of the placing action, and use the average value of the thread cutting time point and the motor start time point corresponding to the target time stamp array as the start time point of the picking action.

[0073] Among them, the structures and principles of the first acquisition module 91, the second acquisition module 92, the selection module 93, the third acquisition module 94, the judgment module 95, and the analysis module 96 correspond one by one to the steps in the above sewing machine operator's pick-and-place action analysis method, so they will not be elaborated here.

[0074] In several embodiments provided by this application, it should be understood that the disclosed system, device or method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules / units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or units can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces. The indirect coupling or communication connection of devices or modules or units can be in electrical, mechanical or other forms.

[0075] The modules / units described as separate components may or may not be physically separated. The components shown as modules / units may or may not be physical modules, that is, they can be located in one place or distributed to multiple network units. Some or all of the modules / units can be selected according to actual needs to achieve the purpose of the embodiments of this application. For example, in each embodiment of this application, the functional modules / units can be integrated in a processing module, or each module / unit can exist physically alone, or two or more modules / units can be integrated in one module / unit.

[0076] Those of ordinary skill in the art should further realize that the units and algorithm steps of each example described in combination with the embodiments disclosed in this article can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0077] The embodiments of the present application also provide a computer-readable storage medium. Those of ordinary skill in the art can understand that all or part of the steps in the methods of the above embodiments can be completed by instructing a processor through a program. The program can be stored in a computer-readable storage medium. The storage medium is a non-transitory medium, such as random access memory, read-only memory, flash memory, hard disk, solid state drive, magnetic tape, floppy disk, optical disc, and any combination thereof. The above storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrating one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disc (DVD)), or a semiconductor medium (e.g., solid state disk (SSD)), etc.

[0078] The embodiments of the present application also provide a terminal. The terminal includes a processor and a memory.

[0079] The memory is used to store a computer program.

[0080] The memory includes various media that can store program codes, such as ROM, RAM, magnetic disk, USB flash drive, memory card, or optical disc.

[0081] The processor is connected to the memory and is used to execute the computer program stored in the memory, so that the terminal executes the above sewing machine operator picking and placing action analysis method.

[0082] Preferably, the processor can be a general-purpose processor, including a central processing unit (CPU for short), a network processor (NP for short), etc.; it can also be a digital signal processor (DSP for short), an application specific integrated circuit (ASIC for short), a field programmable gate array (FPGA for short), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0083] Such as Figure 10As shown, the terminal of the present application is presented in the form of a general-purpose computing device. The components of the terminal may include, but are not limited to: one or more processors or processing units 101, a memory 102, and a bus 103 that connects different system components (including the memory 102 and the processing unit 101).

[0084] The bus 103 represents one or more of several types of bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. By way of example, these architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0085] The terminal typically includes a variety of computer system-readable media. These media can be any available media that can be accessed by the terminal, including volatile and non-volatile media, removable and non-removable media.

[0086] The memory 102 may include computer system-readable media in the form of volatile memory, such as random access memory (RAM) 1021 and / or cache memory 1022. The terminal may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, a storage system 1023 may be used for reading and writing on non-removable, non-volatile magnetic media ( Figure 10 not shown, commonly referred to as a "hard disk drive"). Although Figure 10 not shown in the figure, a disk drive for reading and writing on a removable non-volatile disk (such as a "floppy disk") and an optical disk drive for reading and writing on a removable non-volatile optical disk (such as a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 103 through one or more data media interfaces. The memory 102 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the embodiments of the present application.

[0087] A program / utility 1024 having a set (at least one) of program modules 10241 may be stored, for example, in the memory 102. Such program modules 10241 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include the implementation of a network environment. The program modules 10241 generally perform the functions and / or methods in the embodiments described in the present application.

[0088] The terminal can also communicate with one or more external devices (such as keyboards, pointing devices, displays, etc.), and can also communicate with one or more devices that enable users to interact with the terminal, and / or communicate with any device that enables the terminal to communicate with one or more other computing devices (such as network cards, modems, etc.). Such communication can be carried out through the input / output (I / O) interface 104. Also, the terminal can communicate with one or more networks (such as local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) through the network adapter 105. As Figure 10 shown, the network adapter 105 communicates with other modules of the terminal through the bus 103. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in combination with the terminal, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0089] As Figure 11 shown, in one embodiment, the sewing machine worker picking and placing action analysis system of the present application includes the above-mentioned terminal 111 and sewing machine 112.

[0090] The sewing machine 112 includes an information collection module.

[0091] The information collection module is used to collect the thread cutting time point and motor starting time point of the sewing machine 112 and provide them to the terminal 111.

[0092] It should be noted that the terminal 111 can be set on the sewing machine 112 for local processing; or it can be set in the cloud for cloud processing. When the terminal 111 is set in the cloud, one terminal can simultaneously perform worker picking and placing action analysis on multiple sewing machines.

[0093] The above embodiments are only illustrative of the principles and effects of the present application, and are not used to limit the present application. Any person familiar with this technology can modify or change the above embodiments without departing from the spirit and scope of the present application. Therefore, all equivalent modifications or changes completed by those with ordinary knowledge in the technical field without departing from the spirit and technical idea disclosed by the present application should still be covered by the claims of the present application.

Claims

1. A method for analyzing the picking and placing actions of a sewing machine operator, characterized in that The method includes the following steps: Obtain the thread cutting time point and the motor starting time point of the sewing machine; Obtain the time difference between adjacent motor thread cutting time points and motor starting time points, and use the adjacent motor thread cutting time points and motor starting time points as a time stamp array; Select the time stamp arrays with the time difference greater than the preset threshold as the target time stamp arrays; When it is detected that there is no fabric near the sewing needle of the sewing machine, obtain the actual sewing action data of the sewing machine before the period corresponding to the target time stamp array; Judge whether the operator has completed sewing a finished product based on the actual sewing action data; When it is determined that the operator has completed sewing a finished product, use the thread cutting time point corresponding to the target time stamp array as the start time point of the placing action, and use the average value of the thread cutting time point and the motor starting time point corresponding to the target time stamp array as the start time point of the picking action.

2. The sewing machine worker picking and placing action analysis method according to claim 1, characterized in that, Obtaining the thread cutting time point and the motor starting time point of the sewing machine includes the following steps: Obtain the event data of the sewing machine; the event data includes the event generation time and the event type; Use the event generation times corresponding to the thread cutting and motor starting as the thread cutting time point and the motor starting time point.

3. The sewing machine operator picking and placing motion analysis method according to claim 1, characterized in that, It also includes detecting whether there is fabric near the sewing needle of the sewing machine; Detecting whether there is fabric near the sewing needle of the sewing machine includes the following steps: Obtain multiple sewing needle area images within the period corresponding to the target time stamp array; Calculate the difference in pixel values between each sewing needle area image and the sewing needle reference image, where there is fabric near the sewing needle in the sewing needle reference image; When the proportion of pixel points with the difference greater than the preset difference in the sewing needle area image is greater than the first preset proportion, it is determined that there is fabric in the sewing needle area image; Among the multiple sewing needle area images, when the proportion of sewing needle area images determined to have fabric does not exceed the second preset proportion, it is determined that there is no fabric near the sewing needle of the sewing machine.

4. The sewing machine worker's picking and placing action analysis method according to claim 1, characterized in that Judging whether the operator has completed sewing a finished product based on the actual sewing action data includes the following steps: Obtain the reference sewing action data required for a finished product: Judge whether the actual sewing action data between a certain time point and the thread cutting time point corresponding to the target time stamp array is consistent with the reference sewing action data; If so, it is determined that the operator has completed sewing a finished product.

5. The sewing machine operator's pick-and-place motion analysis method according to claim 4, characterized in that The actual sewing action data and the reference sewing action data adopt one or more combinations of the number of sewing stitches, the number of times of lifting and pressing the presser foot, and the number of times of starting and stopping the motor between adjacent thread cuttings.

6. The sewing machine worker's picking and placing motion analysis method according to claim 4, characterized in that, Judging whether the actual sewing action data between a certain time point and the thread cutting time point corresponding to the target time stamp array is consistent with the reference sewing action data includes the following steps: Extract the segmented action features of the reference sewing action data; Extract the segmented action features of the actual sewing action data; Judge whether the segmented action features of the reference sewing action data and the segmented action features of the actual sewing action data match one by one; When they match one by one, it is determined that the actual sewing action data and the reference sewing action data are consistent.

7. A sewing machine operator's picking and placing action analysis system, characterized in that, The system includes a first acquisition module, a second acquisition module, a selection module, a third acquisition module, a judgment module, and an analysis module; The first acquisition module is configured to acquire the thread cutting time point and the motor starting time point of the sewing machine; The second acquisition module is configured to acquire the time difference between adjacent motor thread cutting time points and motor starting time points, and use the adjacent motor thread cutting time points and motor starting time points as a time stamp array; The selection module is configured to select the time stamp array with a time difference greater than a preset threshold as the target time stamp array; The third acquisition module is configured to acquire the actual sewing action data of the sewing machine before the period corresponding to the target time stamp array when it is detected that there is no fabric near the sewing needle of the sewing machine; The judgment module is configured to judge whether the operator has completed sewing a finished product based on the actual sewing action data; When it is determined that the operator has completed sewing a finished product, the analysis module uses the thread cutting time point corresponding to the target time stamp array as the start time point of the placing action, and uses the average value of the thread cutting time point and the motor starting time point corresponding to the target time stamp array as the start time point of the picking action.

8. A terminal, characterized in that The terminal includes: a processor and a memory; The memory is used to store computer programs; The processor is configured to execute the computer program stored in the memory, so that the terminal executes the sewing machine operator picking and placing action analysis method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the terminal, it implements the sewing machine operator picking and placing action analysis method according to any one of claims 1 to 6.

10. A sewing machine operator's picking and placing action analysis system, characterized in that, Including the terminal according to claim 8 and a sewing machine; The sewing machine includes an information acquisition module; The information acquisition module is configured to acquire the thread cutting time point and the motor starting time point of the sewing machine and provide them to the terminal.

Images