Manual embroidery device based on AI and AR and embroidery method thereof
Through real-time monitoring and feedback from AI and AR technologies, the problems of high learning difficulty, low efficiency and difficulty in multi-person collaboration in hand-embroidery are solved, and a high-precision and efficient embroidery process is achieved, supporting multi-person collaboration and work sharing.
Patent Information
- Application Number
- CN202411474555.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-22
- Publication Date
- 2024-12-06
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing hand-made embroidery is difficult to learn, inefficient, prone to errors, and is difficult to achieve precise control and multi-person collaboration.
Using AI and AR-based hand-embroidery devices and methods, real-time monitoring and feedback of high-definition cameras and AR glasses, deep learning models are used to identify needle methods and line directions, provide personalized feedback and path suggestions, and support multi-person collaboration and work sharing.
It improves the accuracy and efficiency of embroidery, reduces the occurrence of errors, helps beginners quickly master complex pattern skills, and achieves design consistency and social interaction in multi-person collaboration.
Smart Images
Figure CN119083062A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of embroidery, and in particular to a manual embroidery device and an embroidery method based on AI and AR. Background Art
[0002] Hand embroidery is a craft that uses needles and threads to sew patterns and decorations on cloth or other textiles. Through different stitches, thread materials and color combinations, embroidery can create a variety of artistic effects. Hand embroidery is mainly used to decorate clothing, fabrics, and household items (such as pillowcases, tablecloths, curtains, etc.). Embroidery enhances the beauty of items. As a traditional craft, embroidery is used to express specific symbols, meanings or stories. Some embroidery works are used in religious ceremonies or festive occasions, such as embroidery on wedding costumes or religious clothing. Embroidery is not only a functional decoration, but also an art form. Many artists express their personal artistic style and emotions through embroidery.
[0003] The existing hand embroidery process requires first determining the pattern to be embroidered, and then pre-drawing the outline on the fabric or transferring the design pattern to the fabric by other means. The embroiderer needs to choose the right fabric, needle and thread, and the color and thickness of the thread determine the embroidery effect. Different stitches (such as cross stitch, flat stitch, chain stitch, etc.) can be used to achieve different artistic effects, and the embroiderer chooses different stitches according to the needs of the pattern. The embroiderer manually operates the needle and thread, sews on the fabric according to the design pattern, and completes the embroidery by relying on personal craftsmanship. During the embroidery process, it may be necessary to adjust the line direction and correct the stitch length to ensure the accuracy of the pattern. The process of hand embroidery is very dependent on experience and skills, so it takes a long time of practice to master the precise stitches and techniques. The existing hand embroidery is difficult to design and implement for complex patterns. The embroiderer needs to frequently refer to drawings or design drawings, which is prone to stitch deviation or pattern asymmetry. Hand embroidery requires a long period of experience accumulation to master various stitches and techniques. It is difficult for beginners to get started quickly and it is easy to make mistakes. In hand embroidery, stitch errors and line deviations often occur, requiring frequent rework, which is time-consuming and labor-intensive. Traditional hand embroidery relies on hand-eye coordination, and it is difficult to accurately control the length and direction of the stitches, especially when the sewing tension and thread angle are incorrect, which can easily cause inconsistent details of the pattern. Traditional embroidery is mainly completed by individuals, and social interaction and remote collaboration are limited, making it difficult to carry out multi-person collaborative embroidery projects. In summary, the main disadvantages of existing hand embroidery are high learning difficulty, low efficiency, easy errors, and difficulty in precision control. Summary of the invention
[0004] In view of the shortcomings of the prior art, the present invention provides a hand embroidery device and an embroidery method based on AI and AR, which solve the problems of high learning difficulty, low efficiency and easy error in the prior art hand embroidery.
[0005] To achieve the above objectives, the present invention is implemented through the following technical solutions: a manual embroidery device based on AI and AR, comprising a support frame, both sides of the upper end surface of the support frame are fixedly provided with support telescopic rods, the upper ends of the two support telescopic rods are fixedly provided with clamping mechanisms, one of the two support telescopic rods is rotatably sleeved with an adjusting telescopic rod on the outer rod body of the support telescopic rod, one end of the adjusting telescopic rod is hingedly provided with an extension rod, and one end of the extension rod is rotatably provided with a camera;
[0006] A rotating shaft is rotatably arranged at the inner center of the support frame body through a clockwork seat, an exhibition board is fixedly sleeved on the shaft body of the rotating shaft, a slot is provided at the center of one end of the exhibition board, an elastic cloth is fixedly arranged between the front end of the exhibition board and the rear inner wall of the support frame body, elastic ropes are fixedly arranged at the front and rear ends of the elastic cloth, and a socket is provided at the center of one side of the support frame body.
[0007] Preferably, a pull plate is fixedly provided on the outer side of the support frame near the insertion hole through a positioning spring, and a plug column is fixedly provided on the rear end of one side of the pull plate close to the rotating shaft, and the end of the plug column away from the pull plate passes through the insertion hole to the inside of the card slot.
[0008] Preferably, the clamping mechanism includes a base plate, a rear clamping plate is fixedly provided on the upper end surface of the base plate near the rear end, a limiting groove is opened at the center of the upper end surface of the base plate, a limiting slider is slidingly provided inside the limiting groove, a front clamping plate is fixedly provided on the upper end of the limiting slider, and a clamping spring is fixedly provided on the rear end of the limiting slider.
[0009] Preferably, the front splint is located at the front end of the rear splint, a stabilizing telescopic rod is fixedly arranged between the front and rear splints near the edge, the lower end of the base plate is fixedly arranged on the upper end of the supporting telescopic rod, and the rear end of the clamping spring is fixedly arranged on the rear inner wall of the limiting slide groove.
[0010] A hand embroidery system based on AI and AR, comprising a central processing control unit, the central processing control unit is connected to a high-definition camera, the high-definition camera is connected to AR glasses, the central processing control unit is connected to the AR glasses, the central processing control unit is connected to a mobile application, the mobile application is connected to a social and work sharing platform, the social and work sharing platform is connected to an AI personalized embroidery guidance system, and the AI personalized embroidery guidance system is connected to an augmented reality pattern generator;
[0011] The AI personalized embroidery guidance system includes a real-time image analysis module, a personalized feedback generation module, an embroidery path prediction module, a learning and progress tracking module, and a real-time feedback module.
[0012] Preferably, the central processing control unit is connected to the high-definition camera and the AR glasses via Bluetooth or via a local area network, the mobile application is a mobile phone or a computer, and the mobile application is connected to the central processing control unit via a 4 / 5G network.
[0013] Preferably, the mobile application and the social and work sharing platform are bidirectionally connected, and the social and work sharing platform, the AI personalized embroidery guidance system, and the augmented reality pattern generator are all connected to the central processing control unit.
[0014] An embroidery method of a manual embroidery device based on AI and AR specifically comprises the following steps:
[0015] S1. Preparation
[0016] First, unfold the display board so that the elastic cloth forms a semicircle, and the embroidery tool can be placed on it. Then, the pin is inserted into the card slot under the action of the positioning spring to position the display board. If the display board is not positioned, it will return to its original position under the action of the spring. Then take out the cloth board to be embroidered and fix it between the front and rear clamping plates by clamping the clamping spring. Finally, adjust the length of the telescopic rod and the angle between the extension rod and the camera to ensure that the camera is aimed at the embroidered cloth board. The user wears AR glasses and ensures that they are in a connected state.
[0017] S2. Data Collection
[0018] The camera will capture the user's embroidery fabric, stitches and line movements, and the captured data will be pre-processed for denoising, edge detection, and color correction to facilitate subsequent AI model processing. The pre-processed data will eliminate unnecessary interference in the image;
[0019] S3. Embroidery recognition
[0020] In the real-time image analysis module, the pre-trained deep learning model is used to automatically identify the stitches, line directions, and stitch lengths used by the user. The model is used to classify different types of embroidery stitches and mark each step of the user's operation. The stitch directions in the image are then compared with the design pattern to determine the accuracy of the operation.
[0021] S4. Embroidery reminder
[0022] Generate personalized feedback based on the user's current embroidery status, needle style, and line quality. For example, when uneven stitches are detected in a certain area, a prompt will be generated to suggest that the user make corrections.
[0023] S5. Real-time projection feedback
[0024] Through AR glasses, feedback information is projected on the user's embroidery fabric in real time. For large deviations, the stitch correction path will be displayed in the virtual interface. For minor operational problems, vibrations or slight visual prompts will be used to remind the user to make adjustments.
[0025] S6. Path prediction and adjustment
[0026] By analyzing the design pattern and the user's operating habits, the system predicts the next embroidery path. For complex patterns, the system will display the recommended needle path to guide the user to complete the subsequent operations. If the user chooses to manually adjust the operation path, the system will automatically recalculate and update the stitch guide. This flexibility ensures the user's freedom of manual creation. AI only provides auxiliary suggestions, not mandatory requirements.
[0027] S7. Learning and Progress Tracking
[0028] The system will record the user's operation data each time, including needle type, stitch length, and time efficiency. Through this data, the system can analyze the user's operation habits and accuracy problems and generate a detailed progress report. Based on the user's historical operations, the system will recommend technical points that need to be improved. For example, if the user performs poorly in a certain needle technique, the system will provide a special practice plan and provide real-time learning guidance through AR glasses;
[0029] S8. Feedback and social interaction
[0030] Users can share their embroidery progress and works through the system, and AI will automatically generate an embroidery report for other users to view and learn. Through the AI personalized feedback system, different users can work together to complete large embroidery projects at the same time. The system synchronizes the operation progress of each user on a virtual canvas to ensure consistency of design and stitches when multiple users collaborate.
[0031] The present invention provides a hand embroidery device and an embroidery method based on AI and AR, which have the following beneficial effects:
[0032] The present invention provides a manual embroidery device based on AI and AR and an embroidery method thereof. The present invention uses a support frame and a camera hardware device, so that the embroiderer can operate more conveniently, and provides real-time feedback through AR glasses, which greatly reduces the errors caused by lack of experience in the manual embroidery process. The system can analyze the needle method, line direction and stitch length in the embroidery process through a deep learning model, automatically identify each step of the user's operation, judge the accuracy of the operation through image comparison, and generate personalized feedback to help the user adjust the operation in real time, thereby improving the accuracy of embroidery. The system can predict the next embroidery path according to the user's operating habits and design patterns, and provide a recommended needle method path, which not only reduces the complexity of embroidery, but also helps beginners to better In order to better master the embroidery skills of complex patterns, the system will record the user's embroidery operation data, such as needle type and stitch length, and generate a detailed progress report to help users understand their progress in embroidery skills. It also provides personalized practice suggestions to help users improve their skills faster. The system supports sharing embroidery works and progress through social platforms, and allows multiple users to work together to complete large embroidery projects. The system synchronizes the user's operation progress through a virtual canvas to ensure the consistency of design and stitches during collaboration, breaking through the limitations of social interaction and collaboration in traditional hand embroidery. Through the system's real-time feedback function, the embroiderer can be immediately prompted and adjusted when uneven or deviated stitches occur, reducing rework caused by errors and improving work efficiency and embroidery quality. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Figure 1 It is a schematic diagram of the system framework flow of the present invention;
[0034] Figure 2 It is a schematic diagram of the right shaft side of the present invention;
[0035] Figure 3 It is a schematic diagram of the left shaft side of the present invention;
[0036] Figure 4 It is a top cross-sectional schematic diagram of the present invention;
[0037] Figure 5 It is a schematic diagram of the axial side of the stretch fabric of the present invention;
[0038] Figure 6 It is a schematic diagram of the plug-in column axis side of the present invention;
[0039] Figure 7 It is an axial side schematic diagram of the clamping mechanism of the present invention.
[0040] Among them, 1. support frame; 2. clamping mechanism; 3. adjustable telescopic rod; 4. extension rod; 5. camera; 6. elastic cloth; 7. elastic rope; 8. pull plate; 9. socket; 10. support telescopic rod; 11. rotating shaft; 12. display board; 13. slot; 14. plug column; 15. positioning spring; 201. bottom plate; 202. limit slider; 203. limit slide groove; 204. stabilize telescopic rod; 205. clamping spring; 206. rear splint; 207. front splint. DETAILED DESCRIPTION
[0041] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0042] Example 1
[0043] like Figure 2-7 As shown, an embodiment of the present invention provides a hand embroidery device based on AI and AR, including a support frame 1, support telescopic rods 10 are fixedly arranged on both sides of the upper end surface of the support frame 1, and clamping mechanisms 2 are fixedly arranged on the upper ends of the two support telescopic rods 10. An adjusting telescopic rod 3 is rotatably sleeved on the outer rod body of one of the two support telescopic rods 10, and an extension rod 4 is hingedly arranged at one end of the adjusting telescopic rod 3, and a camera 5 is rotatably arranged at one end of the extension rod 4;
[0044] A rotating shaft 11 is rotatably provided at the inner center of the support frame body 1 through a spring seat, an exhibition board 12 is fixedly sleeved on the shaft body of the rotating shaft 11, a slot 13 is provided at the center of one end of the exhibition board 12, an elastic cloth 6 is fixedly provided between the front end of the exhibition board 12 and the rear inner wall of the support frame body 1, elastic ropes 7 are fixedly provided at the front and rear ends of the elastic cloth 6, and a socket 9 is provided at the center of one side of the support frame body 1.
[0045] A pull plate 8 is fixedly provided on the outer side of the support frame 1 near the insertion hole 9 through a positioning spring 15, and a plug column 14 is fixedly provided on the rear end of the pull plate 8 near the rotating shaft 11. The end of the plug column 14 away from the pull plate 8 passes through the insertion hole 9 and reaches the inside of the card slot 13.
[0046] The clamping mechanism 2 includes a base plate 201, a rear clamping plate 206 is fixedly provided on the upper end surface of the base plate 201 near the rear end, a limiting slide groove 203 is opened at the center of the upper end surface of the base plate 201, a limiting slider 202 is slidingly provided inside the limiting slide groove 203, a front clamping plate 207 is fixedly provided on the upper end of the limiting slider 202, and a clamping spring 205 is fixedly provided at the rear end of the limiting slider 202.
[0047] The front clamping plate 207 is located at the front end of the rear clamping plate 206, and a stabilizing telescopic rod 204 is fixedly arranged at the edge between the front clamping plate 207 and the rear clamping plate 206. The lower end of the bottom plate 201 is fixedly arranged on the upper end of the supporting telescopic rod 10, and the rear end of the clamping spring 205 is fixedly arranged on the rear inner wall of the limiting slide groove 203.
[0048] The elastic fabric 6 is fixed between the display board 12 and the support frame 1, providing a flexible storage function. When the display board 12 is unfolded, the elastic fabric 6 is pulled into a semicircular area, and the user can place embroidery tools such as needles and threads on it. Through this design, the tools can be easily accessed and kept neat; when not in use, the display board 12 can be folded up, and the tools and fabrics can be neatly stored to save space. Through the adjustable support telescopic rod 10 and the adjustment telescopic rod 3, the overall height and angle can be flexibly adjusted. This allows users to adjust the embroidery position and angle according to personal needs, improve the comfort of operation and the accuracy of embroidery. The hinged design of the extension rod 4 allows the user to freely adjust the position and angle of the camera 5 according to needs, so that the camera 5 can accurately aim at the embroidery fabric. After the user wears the AR glasses, he can view the picture captured by the camera 5 in real time to ensure that every step of the embroidery process is within the monitoring range, thereby improving the accuracy and controllability of the embroidery. The clamping mechanism 2 fixes the embroidery fabric through the front clamping plate 207 and the rear clamping plate 206, and cooperates with the limiting slide groove 203, the limiting slider 202 and the clamping spring 205 to ensure that the fabric is firmly positioned. This design effectively prevents the fabric from sliding or deforming during the embroidery process, ensuring the stability and accuracy of the embroidery. The device is equipped with a spring seat and a rotating shaft 11 design. When the user does not need to use the display board 12, the display board 12 can automatically return to its original position through the action of the spring. This is not only convenient for operation, but also ensures the stability and safety of the display board 12 during the unfolding and storage process. A plug post 14 is provided on the side of the pull plate 8 close to the rotating shaft 11. By operating the pull plate 8, the user can quickly insert or pull out the plug post 14 to complete the fixation or release of the display board 12. The operation is simple and convenient.
[0049] Example 2
[0050] like Figure 1 As shown, a hand embroidery system based on AI and AR includes a central processing control unit, the central processing control unit is connected to a high-definition camera, the high-definition camera is connected to AR glasses, the central processing control unit is connected to the AR glasses, the central processing control unit is connected to a mobile application, the mobile application is connected to a social and work sharing platform, the social and work sharing platform is connected to an AI personalized embroidery guidance system, and the AI personalized embroidery guidance system is connected to an augmented reality pattern generator;
[0051] The AI personalized embroidery guidance system includes a real-time image analysis module, a personalized feedback generation module, an embroidery path prediction module, a learning and progress tracking module, and a real-time feedback module.
[0052] The central processing control unit is connected to the high-definition camera and AR glasses via Bluetooth or a local area network. The mobile application is a mobile phone or a computer, and the mobile application is connected to the central processing control unit via a 4 / 5G network.
[0053] The mobile application is bidirectionally connected to the social and work sharing platform, and the social and work sharing platform, the AI personalized embroidery guidance system, and the augmented reality pattern generator are all connected to the central processing control unit.
[0054] An embroidery method of a manual embroidery device based on AI and AR specifically comprises the following steps:
[0055] S1. Preparation
[0056] First, unfold the display board 12 so that the elastic fabric 6 is pulled into a semicircle, and the embroidery tool can be placed on it. Then, under the action of the positioning spring 15, the plug 14 is inserted into the card slot 13 to position the display board 12. If the display board 12 is not positioned, it will return to its original position under the action of the spring. Then, take out the cloth board to be embroidered and fix it between the front clamping plate 207 and the rear clamping plate 206 by the clamping spring 205. Finally, adjust the length of the telescopic rod 3 and the angle between the extension rod 4 and the camera 5 to ensure that the camera 5 is aimed at the embroidered cloth board. The user wears the AR glasses and ensures that they are in a connected state.
[0057] S2. Data Collection
[0058] The camera will capture the user's embroidery fabric, stitches and line movements, and the captured data will be pre-processed for denoising, edge detection, and color correction to facilitate subsequent AI model processing. The pre-processed data will eliminate unnecessary interference in the image;
[0059] S3. Embroidery recognition
[0060] In the real-time image analysis module, the pre-trained deep learning model is used to automatically identify the stitches, line directions, and stitch lengths used by the user. The model is used to classify different types of embroidery stitches and mark each step of the user's operation. The stitch directions in the image are then compared with the design pattern to determine the accuracy of the operation.
[0061] S4. Embroidery reminder
[0062] Generate personalized feedback based on the user's current embroidery status, needle style, and line quality. For example, when uneven stitches are detected in a certain area, a prompt will be generated to suggest that the user make corrections.
[0063] S5. Real-time projection feedback
[0064] Through AR glasses, feedback information is projected on the user's embroidery fabric in real time. For large deviations, the stitch correction path will be displayed in the virtual interface. For minor operational problems, vibrations or slight visual prompts will be used to remind the user to make adjustments.
[0065] S6. Path prediction and adjustment
[0066] By analyzing the design pattern and the user's operating habits, the system predicts the next embroidery path. For complex patterns, the system will display the recommended needle path to guide the user to complete the subsequent operations. If the user chooses to manually adjust the operation path, the system will automatically recalculate and update the stitch guide. This flexibility ensures the user's freedom of manual creation. AI only provides auxiliary suggestions, not mandatory requirements.
[0067] S7. Learning and Progress Tracking
[0068] The system will record the user's operation data each time, including needle type, stitch length, and time efficiency. Through this data, the system can analyze the user's operation habits and accuracy problems and generate a detailed progress report. Based on the user's historical operations, the system will recommend technical points that need to be improved. For example, if the user performs poorly in a certain needle technique, the system will provide a special practice plan and provide real-time learning guidance through AR glasses;
[0069] S8. Feedback and social interaction
[0070] Users can share their embroidery progress and works through the system, and AI will automatically generate an embroidery report for other users to view and learn. Through the AI personalized feedback system, different users can work together to complete large embroidery projects at the same time. The system synchronizes the operation progress of each user on a virtual canvas to ensure consistency of design and stitches when multiple users collaborate.
[0071] The real-time image analysis module uses a high-definition camera to capture the user's embroidery process, including stitches, line direction, and embroidery progress. The camera sends image data to the AI system for analysis in real time. Using computer vision technologies such as image recognition and edge detection, the stitches and line paths on the embroidery fabric are identified. The system can distinguish different types of stitches, line colors, stitch lengths, and fabric material changes. The personalized feedback generation module generates feedback and suggestions suitable for the user's current operation based on the image analysis results and combined with the AI learning model. Based on the deep learning model and reinforcement learning algorithm, the system can generate customized guidance suggestions based on the embroidery style, historical performance, and current operation status of different users. For example, the system can determine whether the user makes a mistake on a certain stitch and whether the tension or length of the line needs to be adjusted. The embroidery path prediction module is a system that predicts the user's next stitch direction by analyzing the current stitch and design pattern, and provides visual guidance. This guidance is directly superimposed on the fabric through augmented reality glasses to help users adjust the embroidery path in real time. Path prediction uses time series data analysis, combined with the previous stitches and the overall structure of the design pattern, and uses the prediction model LSTM neural network to infer the user's next operation. The system can also adjust the recommended embroidery path and stitch style based on the user's historical preferences. The learning and progress tracking module provides users with personalized learning plans and tracks the user's progress through the embroidery data recorded by the system. The system generates personalized learning suggestions based on the user's past embroidery works, learning history, and error records. By collecting data on the user's operations, the system can generate a detailed embroidery progress report, including the stitches mastered, the proficiency of the operation, and the time efficiency. Based on this data, the system can recommend areas for users to focus on practicing and provide corresponding practice suggestions. The real-time feedback mechanism is that during the user's embroidery process, AI provides instant feedback through augmented reality (AR) glasses or other prompts to help users correct stitch or line problems. This feedback does not interfere with the user's manual operation, ensuring a natural embroidery experience. The feedback mechanism can be through vibration, sound, or visual prompts. Visual prompts are presented through AR glasses, and the system virtually overlays guide patterns or stitch correction paths on the fabric based on real-time data captured by the camera.
[0072] The system design of the present invention focuses on not disturbing the user's manual embroidery process and maintaining the natural experience of embroidery. Augmented reality technology and intelligent prompts will not directly interfere with the user's operation, ensuring that the user has full control over every step of the embroidery process. Although the system uses modern technologies (such as AI and AR), users can still embroider in the traditional manual way without the mechanized operation feel. Users can freely choose whether to adopt the system's suggestions, such as needle adjustment and path suggestions, which fully retains the flexibility and creativity of handicrafts.
[0073] Through AR glasses, the system of the present invention superimposes virtual embroidery patterns and stitch paths on the fabric, providing users with visual real-time guidance. This not only simplifies the operation of complex patterns, but also helps novices quickly master embroidery skills. Users can see the virtual stitch paths on the embroidery fabric through glasses, avoiding the trouble of frequently checking drawings or design files, thereby improving the efficiency of embroidery. Through path projection, the system can help users maintain consistency when processing complex designs and reduce problems caused by manual errors.
[0074] The AI personalized embroidery guidance system captures user operations through a camera, analyzes in real time, and provides personalized feedback. This feedback mechanism not only helps users improve their skills, but also provides personalized learning suggestions based on each person's style and progress. The system generates exclusive operation suggestions based on the user's operating habits and embroidery style, such as needle adjustment and color matching suggestions to improve embroidery accuracy. The system has a built-in learning module, which is suitable for beginners to gradually master new needle techniques. It will also adjust learning suggestions based on the user's performance to help users continuously improve their embroidery skills.
[0075] Through real-time monitoring by smart cameras and AI, the system of the present invention can detect subtle errors in user operations, and promptly provide prompts through AR glasses, vibrations, etc., to reduce errors in embroidery and improve overall efficiency. The system of the present invention can quickly detect errors that occur during the embroidery process, such as stitch deviation, uneven lines, etc., and remind users to adjust through vision or vibration. This greatly reduces the possibility of rework later. The system's prompts and guidance help users avoid unnecessary mistakes and speed up the completion of complex designs, especially when highly precise operations are required.
[0076] The system of the present invention can support the sharing and collaboration functions of embroidery works. Users can upload their works through the cloud, share the embroidery process with other users, learn skills, and even collaborate remotely to create complex embroidery projects. Users can share their embroidery works on social platforms through mobile applications, or discuss their creative experience with embroidery enthusiasts. The system of the present invention can also be set up with a live broadcast function, and users can display the embroidery process in real time. Through cloud collaboration, multiple users can participate in an embroidery project at the same time, and the system will synchronize their operation progress to achieve real-time collaborative embroidery for multiple people. The system of the present invention can not only track the user's embroidery progress, but also generate detailed operation reports to help users analyze their performance in different needle methods and operation times. Through the AI learning model, users can obtain personalized improvement suggestions. The system will automatically record each operation of the user, generate a timeline and stitch progress chart, and the user can view his operation history at any time.
[0077] Based on the user's historical data, the system will analyze which stitches need to be improved, which part of the operation is more time-consuming, and provide suggestions for improving efficiency and accuracy. AI can not only provide technical assistance, but also recommend new embroidery designs and creative inspirations based on the user's preferences and creative habits. This function can greatly enrich the user's creative options and bring more artistic inspiration. According to the user's historical embroidery works and styles, the system will recommend new patterns, color combinations and stitch combinations to help users broaden their creative horizons and keep their inspiration. Users can import personal designs, and the system of the present invention automatically generates embroidery patterns and optimizes them to styles suitable for hand embroidery, and projects them onto the fabric for guidance. The system of the present invention is not only suitable for traditional hand embroidery, but can also be adjusted according to different fabrics and different stitches to ensure that it can provide help in a variety of embroidery styles. Whether it is fine silk embroidery or thick linen embroidery, the system can adapt and provide personalized guidance. The system of the present invention can adapt to a variety of embroidery materials (such as cotton, silk, linen, etc.), and automatically adjust the system settings according to different fabrics to better guide user operations. Whether the user prefers traditional embroidery style or modern innovative embroidery design, the system can provide customized guidance and suggestions based on the style.
[0078] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A hand embroidery device based on AI and AR, comprising a support frame (1), characterized in that: Both sides of the upper end surface of the support frame (1) are fixedly provided with support telescopic rods (10), and the upper ends of the two support telescopic rods (10) are fixedly provided with clamping mechanisms (2), and an adjusting telescopic rod (3) is rotatably sleeved on the outer rod body of one of the two support telescopic rods (10), and an extension rod (4) is hingedly provided at one end of the adjusting telescopic rod (3), and a camera (5) is rotatably provided at one end of the extension rod (4); A rotating shaft (11) is rotatably arranged at the center of the support frame (1) through a spring seat, an exhibition board (12) is fixedly sleeved on the shaft of the rotating shaft (11), a clamping groove (13) is provided at the center of one end of the exhibition board (12), an elastic cloth (6) is fixedly arranged between the front end of the exhibition board (12) and the rear inner wall of the support frame (1), elastic ropes (7) are fixedly arranged at the front and rear ends of the elastic cloth (6), and a plug hole (9) is provided at the center of one side of the support frame (1).
2. The AI and AR-based hand embroidery device according to claim 1, characterized in that: A pull plate (8) is fixedly provided on the outer side of the support frame (1) near the insertion hole (9) via a positioning spring (15); an insertion column (14) is fixedly provided on the rear end of one side of the pull plate (8) near the rotating shaft (11); and one end of the insertion column (14) away from the pull plate (8) passes through the insertion hole (9) and reaches the interior of the card slot (13).
3. The AI and AR-based hand embroidery device according to claim 1, characterized in that: The clamping mechanism (2) comprises a base plate (201), a rear clamping plate (206) is fixedly arranged at the rear end of the upper end surface of the base plate (201), a limiting sliding groove (203) is provided at the center of the upper end surface of the base plate (201), a limiting sliding block (202) is slidably arranged inside the limiting sliding groove (203), a front clamping plate (207) is fixedly arranged at the upper end of the limiting sliding block (202), and a clamping spring (205) is fixedly arranged at the rear end of the limiting sliding block (202).
4. The AI and AR-based hand embroidery device according to claim 3, characterized in that: The front clamping plate (207) is located at the front end of the rear clamping plate (206), and a stabilizing telescopic rod (204) is fixedly arranged at the edge between the front clamping plate (207) and the rear clamping plate (206). The lower end of the bottom plate (201) is fixedly arranged on the upper end of the supporting telescopic rod (10), and the rear end of the clamping spring (205) is fixedly arranged on the rear inner wall of the limiting sliding groove (203).
5. A hand embroidery system based on AI and AR, comprising a central processing control unit, characterized in that: The central processing control unit is connected to a high-definition camera, the high-definition camera is connected to AR glasses, the central processing control unit is connected to the AR glasses, the central processing control unit is connected to a mobile application, the mobile application is connected to a social and work sharing platform, the social and work sharing platform is connected to an AI personalized embroidery guidance system, and the AI personalized embroidery guidance system is connected to an augmented reality pattern generator; The AI personalized embroidery guidance system includes a real-time image analysis module, a personalized feedback generation module, an embroidery path prediction module, a learning and progress tracking module, and a real-time feedback module.
6. The AI and AR-based hand embroidery system according to claim 5, characterized in that: The central processing control unit is connected to the high-definition camera and AR glasses via Bluetooth or a local area network. The mobile application is a mobile phone or a computer, and the mobile application is connected to the central processing control unit via a 4 / 5G network.
7. The AI and AR based hand embroidery system according to claim 5, characterized in that: The mobile application is bidirectionally connected to the social and work sharing platform, and the social and work sharing platform, the AI personalized embroidery guidance system, and the augmented reality pattern generator are all connected to the central processing control unit.
8. An embroidery method of a manual embroidery device based on AI and AR according to any one of claims 1 to 7, characterized in that: The specific steps include: S1. Preparation First, unfold the display board (12) so that the elastic cloth (6) is pulled into a semicircle, and the embroidery tool can be placed on it. Then, under the action of the positioning spring (15), the plug post (14) is inserted into the card slot (13) to position the display board (12). If the display board (12) is not positioned, it will return to its original position under the action of the spring. Then, take out the cloth board to be embroidered and fix it between the front clamping plate (207) and the rear clamping plate (206) by clamping the clamping spring (205). Finally, adjust the length of the telescopic rod (3) and the angle between the extension rod (4) and the camera (5) to ensure that the camera (5) is aimed at the embroidered cloth board. The user wears the AR glasses and ensures that they are in a connected state. S2. Data Collection The camera will capture the user's embroidery fabric, stitches and line movements, and the captured data will be pre-processed for noise removal, edge detection, and color correction; S3. Embroidery recognition In the real-time image analysis module, the pre-trained deep learning model is used to automatically identify the stitches, line directions, and stitch lengths used by the user. The model is used to classify different types of embroidery stitches and mark each step of the user's operation. The stitch directions in the image are then compared with the design pattern to determine the accuracy of the operation. S4. Embroidery reminder Generate personalized feedback based on the user's current embroidery status, needle style, and line quality. For example, when uneven stitches are detected in a certain area, a prompt will be generated to suggest that the user make corrections. S5. Real-time projection feedback Through AR glasses, feedback information is projected on the user's embroidery fabric in real time. For large deviations, the stitch correction path will be displayed in the virtual interface. For minor operational problems, vibrations or slight visual prompts will be used to remind the user to make adjustments. S6. Path prediction and adjustment By analyzing the design pattern and the user's operating habits, the system predicts the next embroidery path. For complex patterns, the system will display the recommended needle path to guide the user to complete the subsequent operations. If the user chooses to manually adjust the operation path, the system will automatically recalculate and update the stitch guide; S7. Learning and Progress Tracking The system will record the user's operation data each time, including needle type, stitch length, and time efficiency. Through these data, the system can analyze the user's operation habits and precision problems, generate detailed progress reports, and based on the user's historical operations, the system will recommend technical points that need to be improved; S8. Feedback and social interaction Users can share their embroidery progress and works through the system, and AI will automatically generate an embroidery report for other users to view and learn. Through the AI personalized feedback system, different users can work together to complete large embroidery projects at the same time. The system synchronizes the operation progress of each user on a virtual canvas to ensure consistency of design and stitches when multiple users collaborate.