Operation assisting system of sewing machine and operation assisting method of sewing machine

Abstract

The work assistance system of the sewing machine (1) includes: a display (24) for displaying augmented reality images; and a processor (1001). The processor (1001) generates augmented reality images to assist sewing operations using the sewing machine (1), and displays the augmented reality images on the display (24) by superimposing them onto a real image containing the sewing machine (1).

Description

Technical Field

[0001] This invention relates to a sewing machine operation assistance system and a sewing machine operation assistance method. Background Technology

[0002] As disclosed in Patent Document 1, the following technology is known: Augmented Reality (AR) is used to assist unskilled workers in their work.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2023-047367 Summary of the Invention

[0004] In the technical field of sewing machines, there is also a desire for technologies that can assist operators in their sewing work.

[0005] The purpose of this invention is to assist the sewing operation of the sewing machine operator.

[0006] The sewing machine operation assistance system of the present invention includes: a display for displaying augmented reality images; and a processor. The processor generates augmented reality images to assist sewing operations using the sewing machine, and displays the augmented reality images on the display in a manner that overlays them onto a real image containing the sewing machine.

[0007] The effects of the invention

[0008] According to the sewing machine operation assistance system of the present invention, the sewing operation of the sewing machine operator is assisted. Attached Figure Description

[0009] Figure 1 This is a schematic diagram illustrating the operation assistance system of a sewing machine according to the embodiment.

[0010] Figure 2 This is a structural diagram of the AR glasses involved in the implementation method.

[0011] Figure 3 This is a hardware structure diagram of the controller involved in the implementation method.

[0012] Figure 4 This diagram illustrates the real-world image and augmented-real-world image displayed on the display according to the embodiments.

[0013] Figure 5 This diagram illustrates real-world and augmented-real-world images displayed on a monitor, as described in other embodiments. Detailed Implementation

[0014] Below, refer to the appendix. Figure 1The embodiments of the present invention will be described below, but the scope of the present invention is not limited to these embodiments. The structural elements of the embodiments described below can be appropriately combined. In addition, sometimes some structural elements are not used.

[0015] [Operation Assistance System]

[0016] Figure 1 This diagram schematically illustrates a work assistance system for a sewing machine 1 according to an embodiment. The work assistance system utilizes augmented reality (AR) to assist the operator of the sewing machine 1 in their sewing work. In the following description, augmented reality will be appropriately referred to as AR.

[0017] like Figure 1 As shown, the sewing machine 1 has a sewing machine head 2, a needle bar 4, a thread take-up lever 5, a thread adjuster 6, a needle plate 7, a presser foot 8, a valve 9, and an electric motor 10.

[0018] The needle bar 4 holds the sewing machine needle 3 and moves back and forth in the vertical direction. The needle bar 4 is supported by the sewing machine head 2. The needle bar 4 is positioned above the needle plate 7 and can face the surface of the object being sewn, S. The upper thread is hooked onto the sewing machine needle 3. The sewing machine needle 3 has a thread hole through which the upper thread passes. The sewing machine needle 3 holds the upper thread on the inner surface of the thread hole. The needle bar 4 moves back and forth in the vertical direction, thereby allowing the sewing machine needle 3 to move back and forth in the vertical direction while holding the upper thread.

[0019] The take-up lever 5 supplies thread to the sewing machine needle 3. The take-up lever 5 is supported by the sewing machine head 2. The take-up lever 5 has a take-up hole through which the thread passes. The take-up lever 5 holds the thread on the inner surface of the take-up hole. The take-up lever 5 reciprocates vertically while holding the thread. The take-up lever 5 reciprocates in conjunction with the needle bar 4. The vertical reciprocating movement of the take-up lever 5 thereby pulls out or lifts the thread.

[0020] The thread adjuster 6 applies tension to the upper thread. Upper thread is supplied to the thread adjuster 6 from the thread supply source. In the path of the upper thread, the take-up lever 5 is positioned between the sewing machine needle 3 and the thread adjuster 6. The thread adjuster 6 adjusts the tension of the upper thread supplied to the sewing machine needle 3 via the take-up lever 5.

[0021] The needle plate 7 supports the object being sewn, S. The sewing machine needle 3, held by the needle bar 4, is opposite to the needle plate 7. The needle plate 7 has a needle hole through which the sewing machine needle 3 can pass. The sewing machine needle 3, through which the object being sewn, S, supported on the needle plate 7, passes, is inserted.

[0022] The presser foot 8 presses down on the object being sewn, S, from above. The presser foot 8 is supported by the sewing machine head 2. The presser foot 8 is positioned above the needle plate 7 and holds the object being sewn, S, between itself and the needle plate 7.

[0023] The spool 9 holds the spool housed in the spool housing. The spool 9 is positioned below the needle plate 7. The spool 9 rotates in conjunction with the needle bar 4. The spool 9 supplies the lower thread. The spool 9 retrieves the upper thread from the sewing machine needle 3, which passes through the needle hole of the needle plate 7 and is supported on the sewing object S.

[0024] Electric motor 10 generates power. Electric motor 10 has a stator supported by sewing machine head 2 and a rotor rotatably supported by the stator. The rotor rotates, thereby generating power from electric motor 10. An angle sensor 12, which detects the rotation angle of the rotor, is provided on electric motor 10. The power generated by electric motor 10 is transmitted to needle bar 4, thread take-up lever 5, and spool 9 via a power transmission mechanism (not shown). Needle bar 4, thread take-up lever 5, and spool 9 are linked. The power generated by electric motor 10 is transmitted to needle bar 4, causing needle bar 4 and the sewing machine needle 3 held by needle bar 4 to reciprocate in the vertical direction. The power generated by electric motor 10 is transmitted to thread take-up lever 5, causing thread take-up lever 5 to reciprocate in the vertical direction in conjunction with needle bar 4. The power generated by electric motor 10 is transmitted to spool 9, causing spool 9 to rotate in conjunction with needle bar 4 and thread take-up lever 5. Sewing machine 1 sews the object S through the coordinated action of sewing machine needle 3 held by needle bar 4 and spool 9.

[0025] The upper thread from the thread supply source, after being hooked on the thread adjuster 6, passes through the take-up lever 5 and hooks onto the sewing machine needle 3. If the motor 10 rotates, the needle bar 4 descends, and the sewing machine needle 3, held by the needle bar 4, passes through the sewing object S, through the needle hole provided on the needle plate 7. If the sewing machine needle 3 passes through the needle hole on the needle plate 7, the lower thread supplied from the feed 9 hooks onto the upper thread hooked on the sewing machine needle 3. With the lower thread hooked onto the upper thread, the sewing machine needle 3 rises and retracts from the sewing object S. When the sewing machine needle 3 has passed through the sewing object S, the sewing machine 1 stops the sewing object S. When the sewing machine needle 3 retracts from the sewing object S, the sewing machine 1 moves the sewing object S towards the inside of the sewing machine 1. The sewing machine 1 repeatedly moves and stops the sewing object S while reciprocating the sewing machine needle 3, thus forming a stitch on the sewing object S.

[0026] The sewing machine 1's operation assistance system includes so-called AR glasses 20. The AR glasses 20 are worn on the head of the operator using the sewing machine 1 to perform sewing operations. The operator operates the sewing machine 1 to perform sewing operations. While the operator operates the sewing machine 1, the AR glasses 20 display AR images (augmented reality images) to assist in the sewing operations using the sewing machine 1. The AR images are images of the sequence of sewing operations. The AR glasses 20 overlays the real-world image containing the sewing machine 1 and the AR image for display. By overlaying the AR image onto the real-world image for display, the operator's sewing operations are assisted, enabling the operator to perform sewing operations appropriately and efficiently.

[0027] Figure 2 This is a structural diagram of the AR glasses 20 according to the implementation method. (See diagram below.) Figure 1 and Figure 2 As shown, the AR glasses 20 have a controller 21, a sensor group 22, a camera 23, and a display 24.

[0028] Figure 3 This is a hardware structure diagram illustrating the controller 21 according to the implementation method. The controller 21 includes a computer system 1000. The computer system 1000 has a processor 1001 such as a CPU (Central Processing Unit), a main memory 1002 including non-volatile memory such as ROM (Read Only Memory) and volatile memory such as RAM (Random Access Memory), a storage device 1003, and an interface 1004 including input / output circuitry. The functions of the controller 21 are stored as a computer program in the storage device 1003. The processor 1001 reads the computer program from the storage device 1003, expands it into the main memory 1002, and executes the processing according to the computer program. In addition, the computer program can also be transmitted to the computer system 1000 via a network.

[0029] Sensor group 22 detects at least the sewing machine 1. Sensor group 22 detects the state of AR glasses 20. Sensor group 22 includes external sensors, position sensors, and motion sensors. External sensors detect the relative position (relative distance) between AR glasses 20 and sewing machine 1, and the shape of sewing machine 1. An example of an external sensor is a 3D sensor that detects 3D data of sewing machine 1. An example of a 3D sensor is a laser scanner. Position sensors detect the position of AR glasses 20. An example of a position sensor is a GNSS (Global Navigation Satellite System) receiver that detects the absolute position of sewing machine 1. Motion sensors detect the movement of AR glasses 20. Examples of motion sensors include inertial measurement units (IMUs), accelerometers, and gyroscopes.

[0030] Camera 23 takes pictures of at least the sewing machine 1. Multiple cameras 23 are set. For example, cameras 23 are set on the left and right sides of AR glasses 20.

[0031] The display 24 is positioned in front of the operator's eyes. For example... Figure 1As shown, AR glasses 20 are worn on the worker's head with a display 24 positioned in front of the worker's eyes. The display 24 displays a real-world image including the sewing machine 1. The display 24 is a see-through type. The real-world image in front of the worker is displayed on the display 24 through which the see-through display 24 passes. The worker can visually recognize the real-world image (outside world) in front of them through the see-through display 24. An AR image is projected onto the display 24. The AR image is displayed on the display 24 in a manner that overlays the real-world image. The worker can visually recognize the real-world image overlaid with the AR image.

[0032] The processor 1001 generates an AR image to assist in sewing operations using the sewing machine 1. The processor 1001 displays the AR image on the display 24 by overlaying the AR image onto a real-world image containing the sewing machine 1.

[0033] Next, an example of an AR image generation method will be described. The processor 1001 calculates the position, size, and shape of the sewing machine 1 in real space based on a real-world image captured by the camera 23, and the relative position (relative distance) between the AR glasses 20 and the sewing machine 1 detected by the sensor group 22, as well as the shape of the sewing machine 1. The position of the sewing machine 1 in real space is its 3D coordinates. Based on the 3D coordinates of the sewing machine 1, the processor 1001 generates a specified AR image and positions the AR image within the real-world image by superimposing the AR image onto the real-world image.

[0034] The worker wearing AR glasses 20 moves their head, so the image captured by camera 23 is a moving image. Processor 1001 calculates the change in the relative position of AR glasses 20 and sewing machine 1 based on the movement of AR glasses 20 detected by sensor group 22, and generates an AR image by superimposing it onto a real image based on the change in relative position.

[0035] Figure 4 This diagram illustrates the real-world image and AR image displayed on the display 24 according to the embodiment. The real-world image includes a sewing machine 1. Additionally, the real-world image includes an image 31 of the hand of an operator performing sewing work using the sewing machine 1. The hand image 31 is an image of a hand in real space. The AR image is an image 32 showing the movement of the operator's hand performing the sewing work. Image 32 is displayed on the display 24 superimposed on the real-world image. Image 32 is also displayed on the display 24 superimposed on image 31.

[0036] exist Figure 4In the example shown, image 32 is an image representing the hand movements of a worker who performed a sewing operation in the past. Processor 1001 acquires the image representing the hand movements of a worker who performed a sewing operation in the past, i.e., the past image. The past image is stored in storage 1003. Processor 1001 retrieves the past image from storage 1003. Alternatively, the past image can also be stored on a server configured externally to the AR glasses 20. Processor 1001 can also retrieve the past image from the server via a wireless communication system. Processor 1001 generates image 32 as an AR image based on the past image.

[0037] Furthermore, the content and sequence of sewing operations in past images are the same as those of sewing operations performed by workers in real space.

[0038] The operator can visually recognize both image 31 (as a real-world image) and image 32 (as an AR image) while simultaneously moving their hand to appropriately perform sewing operations. Because they can refer to their past hand movements while sewing, the operator can effectively utilize their strengths from past sewing experiences or identify areas for improvement. With image 32 as an AR image assisting the operator's sewing work, the operator can perform sewing appropriately and efficiently.

[0039] If the operator is not skilled, image 32 can also be an image representing the hand movements of a skilled operator performing the sewing operation. Processor 1001 acquires the image representing the hand movements of a skilled operator performing the sewing operation, i.e., the skilled image. The skilled image is stored in storage 1003. Processor 1001 retrieves the skilled image from storage 1003. Alternatively, the skilled image can be stored on a server configured externally to the AR glasses 20. Processor 1001 can also retrieve the skilled image from the server via a wireless communication system. Processor 1001 generates image 32 as an AR image based on the skilled image.

[0040] Furthermore, the content and sequence of sewing operations in the skilled image are the same as those performed by the operator in real space.

[0041] The operator can visually recognize both image 31 (as a real-world image) and image 32 (as an AR image) while simultaneously moving their hand to perform sewing operations appropriately. By observing the hand movements of a skilled operator while performing sewing, the operator can identify areas for improvement. With the assistance of image 32 (as an AR image), the operator can perform sewing operations appropriately and efficiently.

[0042] [Effect]

[0043] As described above, in this embodiment, the work assistance system for the sewing machine 1 includes: a display 24 for displaying augmented reality images; and a processor 1001. The processor 1001 generates an image 32 as an AR image to assist in sewing operations using the sewing machine 1, and displays the image 32 on the display 24 in a manner that overlays it onto a real-world image containing the sewing machine 1.

[0044] According to the implementation method, the image 32 is displayed on the display 24 in a manner that overlays the real image, thereby assisting the operator in sewing operations, enabling the operator to perform sewing operations appropriately and efficiently.

[0045] By displaying an image 32 representing the operator's past hand movements, the operator can perform sewing work while referring to their past hand movements, effectively utilizing their own strengths in past sewing work or identifying areas for improvement.

[0046] By displaying image 32 representing the hand movements of a skilled worker, the worker can observe and imitate these movements while performing sewing, thus identifying areas for improvement. Image 32 representing the hand movements of a skilled worker is helpful in training workers.

[0047] [Other Implementation Methods]

[0048] Figure 5 This diagram illustrates real-world images and AR images displayed on a display, as described in other embodiments. In the above embodiments, the real-world images and AR images are displayed on the display 24 of the AR glasses 20. Figure 5 As shown, both real-world and AR images can be displayed on the screen of the tablet terminal 40. A processor 1001 is located on the tablet terminal 40. The processor 1001 enables the screen of the tablet terminal 40 to display both real-world and AR images.

[0049] The present invention includes the following methods. (1)

[0051] A sewing machine operation assistance system, which has the following features: A display that shows augmented reality images; and processor, The processor generates the augmented reality image, which is used to assist sewing operations using a sewing machine. The augmented reality image is displayed on the monitor in a manner that overlays it onto a real image containing a sewing machine. (2)

[0053] According to the sewing machine operation assistance system described in (1), in which, The augmented reality image is an image representing the sequence of the sewing operations. (3)

[0055] According to the sewing machine operation assistance system described in (1), in which, The augmented reality image is an image representing the hand movements of the worker performing the sewing operation. (4)

[0057] According to the sewing machine operation assistance system described in (3), among which, The processor acquires past images, which are images representing the hand movements of the operator during a past sewing operation. The augmented reality image is generated based on the past image. (5)

[0059] According to the sewing machine operation assistance system described in (3), among which, The processor acquires a skilled image, which is an image representing the hand movements of a skilled worker performing a sewing operation. The augmented reality image is generated based on the skilled image. (6)

[0061] A method for assisting in the operation of a sewing machine, comprising the following steps: Generate augmented reality images to assist sewing operations using sewing machines; and The augmented reality image is displayed on the monitor by overlaying it onto a real image containing a sewing machine. (7)

[0063] According to the sewing machine operation assistance system described in (1), in which, The display is a transmissive display. The real-world image is displayed through the front of the transmissive display. (8)

[0065] According to the sewing machine operation assistance system described in (1), in which, The display is mounted on a tablet terminal. The processor enables the tablet terminal's display to show the real image and the augmented reality image.

[0066] This application is based on Japanese Patent Application No. 2023-197320, filed on November 21, 2023, the contents of which are incorporated herein by reference.

Claims

1. A sewing machine operation assistance system, comprising: A display that shows augmented reality images; and processor, The processor generates the augmented reality image, which is used to assist sewing operations using a sewing machine. The augmented reality image is displayed on the monitor in a manner that overlays it onto a real image containing a sewing machine.

2. The sewing machine operation assistance system according to claim 1, wherein, The augmented reality image is an image representing the sequence of the sewing operations.

3. The sewing machine operation assistance system according to claim 1, wherein, The augmented reality image is an image representing the hand movements of the worker performing the sewing operation.

4. The sewing machine operation assistance system according to claim 3, wherein, The processor acquires past images, which are images representing the hand movements of the operator during a past sewing operation. The augmented reality image is generated based on the past image.

5. The sewing machine operation assistance system according to claim 3, wherein, The processor acquires a skilled image, which is an image representing the hand movements of a skilled worker performing a sewing operation. The augmented reality image is generated based on the skilled image.

6. A method for assisting in the operation of a sewing machine, comprising the following steps: Generate augmented reality images to assist sewing operations using sewing machines; and The augmented reality image is displayed on the monitor by overlaying it onto a real image containing a sewing machine.

7. The sewing machine operation assistance system according to claim 1, wherein, The display is a transmissive display. The real-world image is displayed through the front of the transmissive display.

8. The sewing machine operation assistance system according to claim 1, wherein, The display is mounted on a tablet terminal. The processor enables the tablet terminal's display to show the real image and the augmented reality image.

Images