Method and system for man-machine interaction air visual control of electric arc fuse wire additive manufacturing digital twin system

Through human-computer interactive air visual control technology, real-time monitoring and control of arc fuse additive manufacturing process, the problem of lack of real-time monitoring and intelligent regulation in the existing technology is solved, and process quality and safety are improved and costs are reduced.

CN118939151APending Publication Date: 2024-11-12NINGXIA UNIVERSITY
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202410982313.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-22
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The arc fuse additive manufacturing process lacks real-time monitoring of forming and in-situ identification and prediction of defects. It has large structural deformation, poor overall performance, and lacks intelligent visible control methods, resulting in a long and high cost in the manufacturing process.

Method used

Using human-computer interactive air visual control method, the physical scene and digital twin system virtual model of arc fuse additive manufacturing are imported into the air visualization system, and the three-dimensional configuration display and operation are performed through the aerial imaging module to realize real-time monitoring and control, and use Negative refractive index glass improves operational safety.

Benefits of technology

Real-time observation and control of the arc fuse additive manufacturing process is achieved, process quality is improved, operation risks is reduced, application scope is expanded, and a more intelligent process quality control solution is provided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939151A_ABST
    Figure CN118939151A_ABST
Patent Text Reader

Abstract

The invention provides a man-machine interaction air visual control method and system for an electric arc fuse additive manufacturing digital twinning system, and the method comprises the steps: regulating and controlling an electric arc fuse additive manufacturing machining sequence through a man-machine interaction air visual control system, automatically exporting a machining code after obtaining an instruction in an interaction process, and carrying out a machining process. The real-time performance of visualization of aerial imaging of the processing flow is ensured in the whole process; and initial setting, process regulation and result feedback of the machining process are provided. The whole process is regulated and controlled through man-machine interaction, the accuracy of the product in the design stage can be improved, the result of deposition of each layer of the product in the natural environment can be predicted, data are visualized through aerial imaging, the condition of the production stage is fed back in real time, and the production efficiency is improved. And meanwhile, the observation process of the electric arc fuse wire additive manufacturing digital twinning system is regulated and controlled through other interaction instructions, and the real-time performance, effectiveness and intuition of a user on machining control are met.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent engineering manufacturing technology, and in particular to a method and system for human-machine interactive aerial visualization control of an arc fuse additive manufacturing digital twin system. Background Art

[0002] Arc-fused wire additive manufacturing is an important development direction of additive manufacturing. It is a processing and manufacturing method that uses electric arc as heat source and metal welding wire as filler material. The molten droplets are deposited layer by layer through computer-planned deposition path and CNC machine tools or robots. It has the characteristics of high processing efficiency, short manufacturing cycle, and excellent product performance. It is suitable for rapid integral forming of large-size metal parts.

[0003] Digital twins (DT), through bidirectional mapping and connection between physical and virtual entities, can map the properties, structure, state, performance, function and behavior of physical entities and systems to the virtual world, forming a high-fidelity dynamic multi-dimensional, multi-scale, multi-physical quantity model, providing an effective means for observing, recognizing, understanding, controlling and transforming the physical world. They are potential solutions to help overcome many problems in manufacturing to improve part quality and shorten the time to qualified products.

[0004] Human-computer interaction is the process of interaction between people and computer systems. User information is fed back through input devices, thereby achieving information exchange and interaction between the two parties. There are many forms of expression through visualization technology. Aerial imaging is an effective means to enhance the user's intuitive perception and interactive experience.

[0005] For arc additive manufacturing production, the current processing process lacks real-time monitoring of forming and in-situ identification and prediction of defects, resulting in large structural deformation and poor overall performance. There is an urgent need to break through the cross-scale uniform control and prediction of metal parts performance, complex structure intelligent path planning methods, manufacturing process deformation control and prediction, and intelligent monitoring, identification and prediction of forming accuracy and defects. At the same time, there is a lack of intelligent visible control means, and the production of components with good structure and mechanical properties based on additive manufacturing methods will consume a lot of time and expensive economic costs. The aerial visualization method proposed in the present invention can effectively solve these problems and complete the process control optimization of producing components by arc fuse additive manufacturing methods. Summary of the invention

[0006] In view of the defects in the prior art, the object of the present invention is to provide a method and system for human-machine interactive aerial visualization control of an arc fuse additive manufacturing digital twin system.

[0007] The method for human-machine interactive aerial visualization control of an arc fuse additive manufacturing digital twin system provided by the present invention comprises:

[0008] Step S1: importing the arc fuse additive manufacturing physical scene, the digital twin system virtual model, and the operation information into the human-machine interactive aerial visualization system, and performing the three-dimensional configuration display and operation of all equipment information through the aerial imaging module;

[0009] Step S2: The user selects and controls the model display and the actual operation of the model;

[0010] Step S3: The user selects the size and slice type of the deposited metal structure according to the information provided by the arc fuse additive manufacturing digital twin system, and generates a corresponding processing program according to the selection;

[0011] Step S4: starting the processing program, controlling the arc fuse additive manufacturing physical entity to process, and monitoring and controlling the entire processing process;

[0012] Step S5: according to the processing results, obtaining the entity morphology and characteristic information of the arc fuse after additive manufacturing processing, and displaying its basic situation;

[0013] The aerial imaging module displays the three-dimensional configuration of the arc fuse additive manufacturing virtual model through negative refractive index glass.

[0014] Preferably, the step S1 comprises:

[0015] The arc fuse additive manufacturing physical scene includes an equipment robot arm, a welding machine, a welding gun, a positioner and a forming component; the equipment robot arm is used to carry the welding gun and realize the displacement function in the physical space coordinates; the welding machine is used to provide a heat source, provide an energy source for arc fuse additive manufacturing, and provide a heat source basis for melting the metal wire; the welding gun is used as an output form of the heat source, providing metal and heat source at the gun head to achieve deposition; the positioner is used to carry the substrate, connect the equipment robot arm to achieve displacement in the physical space, and realize deposition in different postures; the forming component represents the forming state of the metal after being melted by the heat source input, and represents the state after deposition;

[0016] The digital twin system virtual model includes a digital virtual model robot arm, a welding machine, a welding gun, a positioner and a forming component, as digital information data and a digital model of a physical entity, wherein the digital information data is obtained by converting data acquired through a UDP communication protocol and a camera;

[0017] The operation information includes click, drag, zoom in, zoom out and long touch;

[0018] The operation includes an indication of a user interface and an operation of a virtual model of a digital twin system, wherein the indication of the user interface is used to open the user interface through the aerial imaging module; and the operation operates the interface by selecting different options;

[0019] The user interface includes one or more of print model selection, print material selection, arc information display, print status display, workpiece completion display, and defect display;

[0020] The virtual model operations of the digital twin system include: the index finger pointing up indicates asynchronous operation to enlarge the model, the index finger pointing down indicates asynchronous operation to reduce the model, the thumb pointing up indicates synchronous operation to control the robot arm, and the victory gesture indicates synchronous operation to exit the control of the robot arm.

[0021] Preferably, step S2 comprises:

[0022] The actual operation scenarios include controlling the arc fuse additive manufacturing physical scenario and the digital twin system virtual model, including synchronous and asynchronous operations;

[0023] The synchronous operation includes: the arc fuse additive manufacturing physical scene and the digital twin virtual model are changed synchronously, and the two communicate in real time and receive and execute instructions;

[0024] The asynchronous operation includes: through the human-computer interaction visualization system, independently operating the digital twin virtual model through operation information, including model enlargement and model change display position, or completing the operation of the user interface instructions through operation information.

[0025] Preferably, step S3 comprises:

[0026] Select the size, shape and deposition path of the pre-deposition, including the current and voltage that affect the size of the deposition body, and the corresponding process parameter settings, and automatically generate the processing program code from the various setting information, convert it into the robot language and start processing the required forming component specific conditions;

[0027] The size and shape of the pre-deposition are the physical state of the formed component formed by the deposition of the metal wire after being subjected to the heat source, including the formed height, width, defect type, and defect condition; the deposition path of the pre-deposition is the path of the robot arm carrying the welding gun in the physical space to perform the deposition process, and finally forms the formed component condition;

[0028] The process parameters of the arc fuse additive manufacturing include deposition current, deposition voltage, wire feeding speed, and welding travel speed. The process parameters affect the size and shape of the deposited body. The influence is specifically obtained by obtaining the influence range of the parameters on the formed components through a machine learning model, and obtaining the corresponding influence range and influence situation.

[0029] Preferably, the step S4 comprises:

[0030] The monitoring information includes one or more of spectral information, spatial information, acoustic information, and thermal information, and the processed and converted features are obtained in the arc fuse additive manufacturing digital twin system. In the human-computer interactive visual control, the corresponding information is displayed, and the surface defects of the additively manufactured parts are located, and the positioning information is recorded and fed back;

[0031] The spectral information obtains light signal intensity information through a spectrometer and a laser spectrometer, which is used to find defects caused by abnormal light signals; the spatial information obtains physical space coordinates and image information through a CCD camera, which is used to find whether the deposition path is normal and whether the expected formed component is obtained; the acoustic information is obtained through an acoustic sensor, which is used to find defects when the acoustic characteristics are abnormal, and at the same time, understand whether the formed component is normal through the acoustic characteristics; the thermal information obtains temperature and temperature field information through a thermal imager and a thermometer, which is used to regulate the deposition process and control the formed component;

[0032] The step S5 includes: the processing result includes processing completion, processing defect type and location information and processing basic feature information; the processing basic feature information includes one or more of length, width, aspect ratio and perfect situation fitting in the deposition sample morphology information.

[0033] The system for human-machine interactive aerial visual control of the arc fuse additive manufacturing digital twin system provided by the present invention comprises:

[0034] Module M1: Import the arc fuse additive manufacturing physical scene, digital twin system virtual model, and operation information into the human-machine interactive aerial visualization system, and perform 3D configuration display and operation of all equipment information through the aerial imaging module;

[0035] Module M2: Select and control the model display and actual operation;

[0036] Module M3: Based on the information provided by the arc fuse additive manufacturing digital twin system, the size and slice type of the deposited metal structure are selected, and the corresponding processing program is generated according to the selection;

[0037] Module M4: Start the processing program, control the arc fuse additive manufacturing physical entity for processing, and monitor and control the entire processing process;

[0038] Module M5: According to the processing results, obtain the entity morphology and feature information of the arc fuse after additive manufacturing processing, and display its basic situation;

[0039] The aerial imaging module displays the three-dimensional configuration of the arc fuse additive manufacturing virtual model through negative refractive index glass.

[0040] Preferably, the module M1 comprises:

[0041] The arc fuse additive manufacturing physical scene includes an equipment robot arm, a welding machine, a welding gun, a positioner and a forming component; the equipment robot arm is used to carry the welding gun and realize the displacement function in the physical space coordinates; the welding machine is used to provide a heat source, provide an energy source for arc fuse additive manufacturing, and provide a heat source basis for melting the metal wire; the welding gun is used as an output form of the heat source, providing metal and heat source at the gun head to achieve deposition; the positioner is used to carry the substrate, connect the equipment robot arm to achieve displacement in the physical space, and realize deposition in different postures; the forming component represents the forming state of the metal after being melted by the heat source input, and represents the state after deposition;

[0042] The digital twin system virtual model includes a digital virtual model robot arm, a welding machine, a welding gun, a positioner and a forming component, as digital information data and a digital model of a physical entity, wherein the digital information data is obtained by converting data acquired through a UDP communication protocol and a camera;

[0043] The operation information includes click, drag, zoom in, zoom out and long touch;

[0044] The operation includes an indication of a user interface and an operation of a virtual model of a digital twin system, wherein the indication of the user interface is used to open the user interface through the aerial imaging module; and the operation operates the interface by selecting different options;

[0045] The user interface includes one or more of print model selection, print material selection, arc information display, print status display, workpiece completion display, and defect display;

[0046] The virtual model operations of the digital twin system include: the index finger pointing up indicates asynchronous operation to enlarge the model, the index finger pointing down indicates asynchronous operation to reduce the model, the thumb pointing up indicates synchronous operation to control the robot arm, and the victory gesture indicates synchronous operation to exit the control of the robot arm.

[0047] Preferably, the module M2 comprises:

[0048] The actual operation scenarios include controlling the arc fuse additive manufacturing physical scenario and the digital twin system virtual model, including synchronous and asynchronous operations;

[0049] The synchronous operation includes: the arc fuse additive manufacturing physical scene and the digital twin virtual model are changed synchronously, and the two communicate in real time and receive and execute instructions;

[0050] The asynchronous operation includes: through the human-computer interaction visualization system, independently operating the digital twin virtual model through operation information, including model enlargement and model change display position, or completing the operation of the user interface instructions through operation information.

[0051] Preferably, the module M3 comprises:

[0052] Select the size, shape and deposition path of the pre-deposition, including the current and voltage that affect the size of the deposition body, and the corresponding process parameter settings, and automatically generate the processing program code from the various setting information, convert it into the robot language and start processing the required forming component specific conditions;

[0053] The size and shape of the pre-deposition are the physical state of the formed component formed by the deposition of the metal wire after being subjected to the heat source, including the formed height, width, defect type, and defect condition; the deposition path of the pre-deposition is the path of the robot arm carrying the welding gun in the physical space to perform the deposition process, and finally forms the formed component condition;

[0054] The process parameters of the arc fuse additive manufacturing include deposition current, deposition voltage, wire feeding speed, and welding travel speed. The process parameters affect the size and shape of the deposited body. The influence is specifically obtained by obtaining the influence range of the parameters on the formed components through a machine learning model, and obtaining the corresponding influence range and influence situation.

[0055] Preferably, the module M4 comprises:

[0056] The monitoring information includes one or more of spectral information, spatial information, acoustic information, and thermal information, and the processed and converted features are obtained in the arc fuse additive manufacturing digital twin system. In the human-computer interactive visual control, the corresponding information is displayed, and the surface defects of the additively manufactured parts are located, and the positioning information is recorded and fed back;

[0057] The spectral information obtains light signal intensity information through a spectrometer and a laser spectrometer, which is used to find defects caused by abnormal light signals; the spatial information obtains physical space coordinates and image information through a CCD camera, which is used to find whether the deposition path is normal and whether the expected formed component is obtained; the acoustic information is obtained through an acoustic sensor, which is used to find defects when the acoustic characteristics are abnormal, and at the same time, understand whether the formed component is normal through the acoustic characteristics; the thermal information obtains temperature and temperature field information through a thermal imager and a thermometer, which is used to regulate the deposition process and control the formed component;

[0058] The module M5 includes: the processing results include processing completion, processing defect type and location information and processing basic feature information; the processing basic feature information includes one or more of length, width, aspect ratio and perfect fit in the deposition sample morphology information.

[0059] Compared with the prior art, the present invention has the following beneficial effects:

[0060] (1) The method based on human-machine interactive aerial visualization in the present invention combined with the arc fuse additive manufacturing digital twin system can observe the additive manufacturing process status in real time, obtain the molten pool characteristic information of the entire arc fuse additive manufacturing, and complete the control of the arc fuse additive manufacturing physical state by completing the aerial operation mode;

[0061] (2) The present invention integrates the human-machine interactive aerial imaging interaction technology with the physical entity information of arc fuse additive manufacturing through aerial imaging, and visualizes the arc fuse manufacturing process through aerial imaging technology, which is easy to operate;

[0062] (3) The present invention uses negative refractive index glass to perform aerial visualization imaging of arc fuse additive manufacturing, which greatly increases the safety of the operation process and avoids contact with metal and arcs, greatly improving safety; at the same time, it more intelligently provides the most effective solution for the additive manufacturing process, while expanding its scope of application, providing new theories, new ideas and new strategies for arc fuse additive process quality control, which has important theoretical significance and engineering application value. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0064] Figure 1 It is the overall architecture diagram for constructing the aerial visualization of human-machine interaction of the digital twin system for arc fuse additive manufacturing;

[0065] Figure 2 It is a structural block diagram for constructing aerial visualization of human-machine interaction in the digital twin system for arc fuse additive manufacturing;

[0066] Figure 3 It is a structural schematic diagram of the aerial visualization of human-machine interaction in building the digital twin system of arc fuse additive manufacturing;

[0067] Among them: 1-arc fuse additive manufacturing physical entity, 2-arc fuse additive manufacturing digital twin system, 3-aerial imaging human-computer interaction, 4-aerial imaging module; 11-robotic arm, 12-positioner, 13-forming component; 21-digital twin robotic arm information flow, 22-digital twin forming component information flow, 23-digital twin positioner information flow; 31-aerial imaging robotic arm model, 22-aerial imaging forming component model, 33-aerial imaging positioner model. DETAILED DESCRIPTION

[0068] The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several changes and improvements can also be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0069] Example 1

[0070] The present invention provides a method for human-computer interactive aerial visualization control of an arc fuse additive manufacturing digital twin system, comprising: step S1: importing an arc fuse additive manufacturing physical scene, a digital twin system virtual model, and operation information into the human-computer interactive aerial visualization system, and performing three-dimensional configuration display and operation of all equipment information through an aerial imaging module; step S2: a user selects and controls the model display situation and the actual operation situation of the model; step S3: the user selects the size and slice type of the deposited metal structure according to the information provided by the arc fuse additive manufacturing digital twin system, and generates a corresponding processing program according to the selection; step S4: starting the processing program, controlling the arc fuse additive manufacturing physical entity to process, and monitoring and controlling the processing process throughout; step S5: according to the processing result, obtaining the entity morphology and feature information of the arc fuse additive manufacturing after processing, and displaying its basic situation; the aerial imaging module displays the three-dimensional configuration of the arc fuse additive manufacturing virtual model through a glass with a negative refractive index.

[0071] The step S1 includes: the arc fuse additive manufacturing physical scene includes an equipment robot arm, a welding machine, a welding gun, a positioner and a forming component; the equipment robot arm is used to carry the welding gun and realize the displacement function in the physical space coordinates; the welding machine is used to provide a heat source, provide an energy source for arc fuse additive manufacturing, and provide a heat source basis for melting the metal wire; the welding gun is used as an output form of the heat source, providing metal and heat source at the gun head to achieve deposition; the positioner is used to carry the substrate, connect the equipment robot arm to achieve displacement in the physical space, and realize deposition in different postures; the forming component represents the forming state of the metal after being melted by the heat source input, and represents the state after deposition; the digital twin system virtual model includes a digital virtual model robot arm, a welding machine, a welding gun, a positioner and a forming component, as a digital signal of the physical entity information data and digital model, the digital information data is obtained through the UDP communication protocol and camera acquisition data conversion; the operation information includes click, drag, zoom in, zoom out and long touch; the operation includes user interface indications and digital twin system virtual model operations, the user interface indications are used to open the user interface through the aerial imaging module; the control is to operate the interface by selecting different options; the user interface includes one or more of printing model selection, printing material selection, arc information display, printing status display, workpiece completion display, and defect display; the digital twin system virtual model operations include: index finger upward indicates asynchronous operation to zoom in the model, index finger downward indicates asynchronous operation to zoom out the model, thumb up indicates synchronous operation to control the robot arm, and victory gesture indicates synchronous operation to exit the control of the robot arm.

[0072] The step S2 includes: the actual operation includes controlling the arc fuse additive manufacturing physical scene and the digital twin system virtual model, including synchronous operation and asynchronous operation; the synchronous operation includes: the arc fuse additive manufacturing physical scene and the digital twin virtual model change synchronously, completing real-time communication and receiving instructions and executing them between the two; the asynchronous operation includes: through the human-computer interaction visualization system, the digital twin virtual model is independently operated through operation information, including model enlargement and model change display position, or the user interface instructions are operated through operation information.

[0073] The step S3 includes: selecting the size, shape and deposition path of the pre-deposition, including the current and voltage that have an impact when setting the size of the deposition body, and the corresponding process parameter settings, and automatically generating a processing program code for each setting information, converting it into a robot language and starting to process the required specific conditions of the formed component; the size and shape of the pre-deposition are the physical state of the formed component formed by the deposition of the metal wire after being subjected to a heat source, including the formed height, width, defect type and defect condition; the deposition path of the pre-deposition is the path of the robot arm carrying the welding gun when performing the deposition process in the physical space, and finally forming the formed component; the process parameters of the arc fuse additive manufacturing include deposition current, deposition voltage, wire feeding speed and welding travel speed, and the process parameters affect the size and shape of the deposition body; the influence is specifically obtained through a machine learning model to obtain the influence range of the parameters on the formed component, and obtain the corresponding influence range and influence condition.

[0074] The step S4 includes: the monitoring information includes one or more of spectral information, spatial information, acoustic information, and thermal information, and the processed and converted features are obtained in the arc fuse additive manufacturing digital twin system, and the corresponding information is displayed in the human-computer interactive visual control, and the surface defects of the additively manufactured parts are located, and the positioning information is recorded and fed back; the spectral information obtains optical signal intensity information through a spectrometer and a laser spectrometer, which is used to find the generation of defects due to abnormal optical signals; the spatial information obtains physical space coordinates and image information through a CCD camera, which is used to find whether the deposition path is normal and whether the expected formed component is obtained; the acoustic information is obtained through an acoustic sensor, which is used to find the generation of defects when the acoustic characteristics are abnormal, and at the same time, the acoustic characteristics are used to understand whether the formed component is normal; the thermal information obtains temperature and temperature field information through a thermal imager and a thermometer, which is used to regulate the deposition process and control the formed component;

[0075] The step S5 includes: the processing result includes processing completion, processing defect type and location information and processing basic feature information; the processing basic feature information includes one or more of length, width, aspect ratio and perfect situation fitting in the deposition sample morphology information.

[0076] The present invention also provides a system for human-computer interactive aerial visualization control of an arc fuse additive manufacturing digital twin system, comprising: module M1: importing the arc fuse additive manufacturing physical scene, the digital twin system virtual model, and operation information into the human-computer interactive aerial visualization system, and performing three-dimensional configuration display and operation of all equipment information through the aerial imaging module; module M2: selecting and controlling the model display situation and the actual operation situation of the model; module M3: selecting the size and slicing type of the deposited metal structure according to the information provided by the arc fuse additive manufacturing digital twin system, and generating a corresponding processing program according to the selection; module M4: starting the processing program, controlling the arc fuse additive manufacturing physical entity to be processed, and monitoring and controlling the entire processing process; module M5: obtaining the entity morphology and feature information of the arc fuse additive manufacturing after processing according to the processing results, and displaying its basic situation; the aerial imaging module displays the three-dimensional configuration of the arc fuse additive manufacturing virtual model through a glass with a negative refractive index.

[0077] The module M1 includes: the arc fuse additive manufacturing physical scene includes an equipment robot arm, a welding machine, a welding gun, a positioner and a forming component; the equipment robot arm is used to carry the welding gun and realize the displacement function in the physical space coordinates; the welding machine is used to provide a heat source, provide an energy source for arc fuse additive manufacturing, and provide a heat source basis for melting the metal wire; the welding gun is an output form of the heat source, providing metal and heat source at the gun head to realize deposition; the positioner is used to carry the substrate, connect the equipment robot arm to realize displacement in the physical space, and realize deposition in different postures; the forming component represents the forming state of the metal after being melted by the heat source input, and represents the state after deposition; the digital twin system virtual model includes a digital virtual model robot arm, a welding machine, a welding gun, a positioner and a forming component, as a digital signal of the physical entity information data and digital model, the digital information data is obtained through the UDP communication protocol and camera acquisition data conversion; the operation information includes click, drag, zoom in, zoom out and long touch; the operation includes user interface indications and digital twin system virtual model operations, the user interface indications are used to open the user interface through the aerial imaging module; the control is to operate the interface by selecting different options; the user interface includes one or more of printing model selection, printing material selection, arc information display, printing status display, workpiece completion display, and defect display; the digital twin system virtual model operations include: index finger upward indicates asynchronous operation to zoom in the model, index finger downward indicates asynchronous operation to zoom out the model, thumb up indicates synchronous operation to control the robot arm, and victory gesture indicates synchronous operation to exit the control of the robot arm.

[0078] The module M2 includes: the actual operation includes controlling the arc fuse additive manufacturing physical scene and the digital twin system virtual model, including synchronous operation and asynchronous operation; the synchronous operation includes: the arc fuse additive manufacturing physical scene and the digital twin virtual model change synchronously, completing real-time communication and receiving instructions and executing them between the two; the asynchronous operation includes: through the human-computer interaction visualization system, the digital twin virtual model is independently operated through operation information, including model enlargement and model change display position, or the operation of the user interface instructions is completed through operation information.

[0079] The module M3 includes: selecting the size, shape and deposition path of the pre-deposition, including the current and voltage that have an impact when setting the size of the deposition body, and the corresponding process parameter settings, and automatically generating a processing program code for each setting information, converting it into a robot language and starting to process the specific conditions of the required formed component; the size and shape of the pre-deposition are the physical state of the formed component formed by the deposition of the metal wire after being subjected to a heat source, including the formed height, width, defect type and defect condition; the deposition path of the pre-deposition is the path of the robot arm carrying the welding gun when performing the deposition process in the physical space, and finally forming the formed component; the process parameters of the arc fuse additive manufacturing include deposition current, deposition voltage, wire feeding speed and welding travel speed, and the process parameters affect the size and shape of the deposition body; the influence is specifically obtained through a machine learning model to obtain the influence range of the parameters on the formed component, and obtain the corresponding influence range and influence condition.

[0080] The module M4 includes: monitoring information including one or more of spectral information, spatial information, acoustic information, and thermal information, and the processed and converted features are obtained in the arc fuse additive manufacturing digital twin system, and the corresponding information is displayed in the human-computer interactive visual control, and the surface defects of the additively manufactured parts are located, and the positioning information is recorded and fed back; the spectral information obtains optical signal intensity information through a spectrometer and a laser spectrometer, which is used to find the generation of defects due to abnormal optical signals; the spatial information obtains physical space coordinates and image information through a CCD camera, which is used to find whether the deposition path is normal and whether the expected formed component is obtained; the acoustic information is obtained through an acoustic sensor, which is used to find the generation of defects when the acoustic characteristics are abnormal, and at the same time, the acoustic characteristics are used to understand whether the formed component is normal; the thermal information obtains temperature and temperature field information through a thermal imager and a thermometer, which is used to regulate the deposition process and control the formed component;

[0081] The module M5 includes: the processing results include processing completion, processing defect type and location information and processing basic feature information; the processing basic feature information includes one or more of length, width, aspect ratio and perfect fit in the deposition sample morphology information.

[0082] Embodiment 2:

[0083] See also Figure 1-Figure 3 , the present invention provides a method for human-machine interactive visual control of an arc fuse additive manufacturing digital twin system in combination with an embodiment. Taking arc fuse additive manufacturing processing simulation as an example, the specific implementation steps are as follows:

[0084] Step S1: Acquire scene information of the arc fuse additive manufacturing physical entity 1, including acquiring specific data of equipment such as the model robot arm 11, the forming component 12, the positioner 13, and the arc fuse additive manufacturing physical entity environment information.

[0085] Step S2: Import the acquired information into the arc fuse additive manufacturing digital twin system 2 through information communication, and classify the digital twin robot arm information flow 21, digital twin forming component information flow 22, and digital twin positioner information flow 23 in the arc fuse additive manufacturing digital twin system 2, and organize some physical environment information to control data classification.

[0086] Step S3: The aerial imaging module 4 is used to complete the aerial imaging human-computer interaction 3 with the database through the negative refractive index glass to form an aerial imaging robotic arm model 31, an aerial imaging forming component model 32, an aerial imaging positioner model 33 and a functional unit 34.

[0087] The digital twin manipulator information flow 21, digital twin forming component information flow 22, and digital twin positioner information flow 23 in the arc fuse additive manufacturing digital twin system 2 have problems with the geometric model and data information maintaining real-time communication of data information and feedback operation consistency with the manipulator 11, forming component 12, and positioner 13 in the arc fuse additive manufacturing physical entity 1. The aerial imaging manipulator model 31, aerial imaging forming component model 32, and aerial imaging positioner model 33 in the aerial imaging human-computer interaction 3 have problems with synchronous and asynchronous changes in the digital twin manipulator information flow 21, digital twin forming component information flow 22, and digital twin positioner information flow 23 in the arc fuse additive manufacturing digital twin system 2, but they maintain consistency, coexistence, and interactivity in terms of time and function.

[0088] Embodiment 3:

[0089] Embodiment 3 is a preferred example of Embodiment 2.

[0090] See also Figure 1-Figure 3, step S3 in the method of human-computer interaction visualization control of an arc fuse additive manufacturing digital twin system described in this embodiment is described in detail to illustrate another functional role of the arc fuse additive manufacturing digital twin system 2 and the aerial imaging human-computer interaction 3 implemented in the method, and the angle and relative position relationship between the aerial imaging human-computer interaction 3 operation and the arc fuse additive manufacturing physical entity 1 in the merged image are adjusted to achieve an interactive effect.

[0091] Step S3: The aerial imaging module 4 is used to complete the aerial imaging human-computer interaction 3 with the database through the negative refractive index glass to form an aerial imaging robotic arm model 31, an aerial imaging forming component model 32, an aerial imaging positioner model 33 and a functional unit 34.

[0092] The operator opens the aerial imaging module 4 to complete the aerial imaging of the digital twin robot arm information flow 21, the digital twin forming component information flow 22, and the digital twin positioner information flow 23 of the arc fuse additive manufacturing digital twin system 2, and completes the aerial imaging human-computer interaction 3 including the aerial imaging robot arm model 31, the aerial imaging forming component model 32, the aerial imaging positioner model 33 and the functional unit 34.

[0093] The functional unit 34 controls the aerial imaging robot arm model 31, the aerial imaging forming component model 32, and the aerial imaging positioner model 33 through synchronous and asynchronous operations to change them individually or synchronously with the robot arm 11, the forming component 12, and the positioner 13 in the arc fuse additive manufacturing physical entity 1.

[0094] The operator controls the aerial imaging robot model 31, the aerial imaging forming component model 32, and the aerial imaging positioner model 33 to conform to the geometric proportions and time consistency of the robot 11, the forming component 12, and the positioner 13 through asynchronous changes, including but not limited to the specific display of some models and the change of the model proportions. The aerial imaging robot model 31, the aerial imaging forming component model 32, and the aerial imaging positioner model 33 transmit information to the digital twin robot information flow 21, the digital twin forming component information flow 22, and the digital twin positioner information flow 23 according to the changes of the robot 11, the forming component 12, and the positioner 13 through synchronous changes, including but not limited to one or more of printing synchronous display, model steering, and finished product display.

[0095] The user interface instructions of the operator through the functional unit include the login interface, the model selection control, and the welding start selection control. The welding selection instructions include one of selecting the printing parts, printing the physical environment conditions, and selecting the printing parameters. The welding monitoring instructions include one or more of the current process parameters, processing progress, geometric errors, possible error existence and conditions. The post-weld comparison includes one of the forming accuracy display, possible defect display during forming, and completion degree.

[0096] In the description of the present application, it should be understood that the terms "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0097] Those skilled in the art know that, in addition to implementing the system, device and its various modules provided by the present invention in a purely computer-readable program code, it is entirely possible to implement the same program in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers and embedded microcontrollers by logically programming the method steps. Therefore, the system, device and its various modules provided by the present invention can be considered as a hardware component, and the modules included therein for implementing various programs can also be considered as structures within the hardware component; the modules for implementing various functions can also be considered as both software programs for implementing the method and structures within the hardware component.

[0098] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various changes or modifications within the scope of the claims, which does not affect the essence of the present invention. In the absence of conflict, the embodiments of the present application and the features in the embodiments can be combined with each other arbitrarily.

Claims

1. A method for human-machine interactive aerial visualization control of an arc fuse additive manufacturing digital twin system, characterized in that: include: Step S1: importing the arc fuse additive manufacturing physical scene, the digital twin system virtual model, and the operation information into the human-machine interactive aerial visualization system, and performing the three-dimensional configuration display and operation of all equipment information through the aerial imaging module; Step S2: The user selects and controls the model display and the actual operation of the model; Step S3: The user selects the size and slice type of the deposited metal structure according to the information provided by the arc fuse additive manufacturing digital twin system, and generates a corresponding processing program according to the selection; Step S4: starting the processing program, controlling the arc fuse additive manufacturing physical entity to process, and monitoring and controlling the entire processing process; Step S5: according to the processing results, obtaining the entity morphology and characteristic information of the arc fuse after additive manufacturing processing, and displaying its basic situation; The aerial imaging module displays the three-dimensional configuration of the arc fuse additive manufacturing virtual model through negative refractive index glass.

2. The method for human-machine interactive aerial visualization control of the arc fuse additive manufacturing digital twin system according to claim 1 is characterized in that: The step S1 comprises: The arc fuse additive manufacturing physical scene includes an equipment robot arm, a welding machine, a welding gun, a positioner and a forming component; the equipment robot arm is used to carry the welding gun and realize the displacement function in the physical space coordinates; the welding machine is used to provide a heat source, provide an energy source for arc fuse additive manufacturing, and provide a heat source basis for melting the metal wire; the welding gun is used as an output form of the heat source, providing metal and heat source at the gun head to achieve deposition; the positioner is used to carry the substrate, connect the equipment robot arm to achieve displacement in the physical space, and realize deposition in different postures; the forming component represents the forming state of the metal after being melted by the heat source input, and represents the state after deposition; The digital twin system virtual model includes a digital virtual model robot arm, a welding machine, a welding gun, a positioner and a forming component, as digital information data and a digital model of a physical entity, wherein the digital information data is obtained by converting data acquired through a UDP communication protocol and a camera; The operation information includes click, drag, zoom in, zoom out and long touch; The operation includes an indication of a user interface and an operation of a virtual model of a digital twin system, wherein the indication of the user interface is used to open the user interface through the aerial imaging module; and the operation operates the interface by selecting different options; The user interface includes one or more of print model selection, print material selection, arc information display, print status display, workpiece completion display, and defect display; The virtual model operations of the digital twin system include: the index finger pointing up indicates asynchronous operation to enlarge the model, the index finger pointing down indicates asynchronous operation to reduce the model, the thumb pointing up indicates synchronous operation to control the robot arm, and the victory gesture indicates synchronous operation to exit the control of the robot arm.

3. The method for human-machine interactive aerial visualization control of the arc fuse additive manufacturing digital twin system according to claim 1, characterized in that: The step S2 comprises: The actual operation scenarios include controlling the arc fuse additive manufacturing physical scenario and the digital twin system virtual model, including synchronous and asynchronous operations; The synchronous operation includes: the arc fuse additive manufacturing physical scene and the digital twin virtual model are changed synchronously, and the two communicate in real time and receive and execute instructions; The asynchronous operation includes: through the human-computer interaction visualization system, independently operating the digital twin virtual model through operation information, including model enlargement and model change display position, or completing the operation of the user interface instructions through operation information.

4. The method for human-machine interactive aerial visualization control of the arc fuse additive manufacturing digital twin system according to claim 1, characterized in that: The step S3 comprises: Select the size, shape and deposition path of the pre-deposition, including the current and voltage that affect the size of the deposition body, and the corresponding process parameter settings, and automatically generate the processing program code from the various setting information, convert it into the robot language and start processing the required forming component specific conditions; The size and shape of the pre-deposition are the physical state of the formed component formed by the deposition of the metal wire after being subjected to the heat source, including the formed height, width, defect type, and defect condition; the deposition path of the pre-deposition is the path of the robot arm carrying the welding gun in the physical space to perform the deposition process, and finally forms the formed component condition; The process parameters of the arc fuse additive manufacturing include deposition current, deposition voltage, wire feeding speed, and welding travel speed. The process parameters affect the size and shape of the deposited body. The influence is specifically obtained by obtaining the influence range of the parameters on the formed components through a machine learning model, and obtaining the corresponding influence range and influence situation.

5. The method for human-machine interactive aerial visualization control of the arc fuse additive manufacturing digital twin system according to claim 1, characterized in that: The step S4 comprises: The monitoring information includes one or more of spectral information, spatial information, acoustic information, and thermal information, and the processed and converted features are obtained in the arc fuse additive manufacturing digital twin system. In the human-computer interactive visual control, the corresponding information is displayed, and the surface defects of the additively manufactured parts are located, and the positioning information is recorded and fed back; The spectral information obtains light signal intensity information through a spectrometer and a laser spectrometer, which is used to find defects caused by abnormal light signals; the spatial information obtains physical space coordinates and image information through a CCD camera, which is used to find whether the deposition path is normal and whether the expected formed component is obtained; the acoustic information is obtained through an acoustic sensor, which is used to find defects when the acoustic characteristics are abnormal, and at the same time, understand whether the formed component is normal through the acoustic characteristics; the thermal information obtains temperature and temperature field information through a thermal imager and a thermometer, which is used to regulate the deposition process and control the formed component; The step S5 includes: the processing result includes processing completion, processing defect type and location information and processing basic feature information; the processing basic feature information includes one or more of length, width, aspect ratio and perfect situation fitting in the deposition sample morphology information.

6. A system for human-machine interactive aerial visualization control of arc fuse additive manufacturing digital twin system, characterized in that: include: Module M1: Import the arc fuse additive manufacturing physical scene, digital twin system virtual model, and operation information into the human-machine interactive aerial visualization system, and perform 3D configuration display and operation of all equipment information through the aerial imaging module; Module M2: Select and control the model display and actual operation; Module M3: Based on the information provided by the arc fuse additive manufacturing digital twin system, the size and slice type of the deposited metal structure are selected, and the corresponding processing program is generated according to the selection; Module M4: Start the processing program, control the arc fuse additive manufacturing physical entity for processing, and monitor and control the entire processing process; Module M5: According to the processing results, obtain the entity morphology and feature information of the arc fuse after additive manufacturing processing, and display its basic situation; The aerial imaging module displays the three-dimensional configuration of the arc fuse additive manufacturing virtual model through negative refractive index glass.

7. The system for human-machine interactive aerial visual control of the arc fuse additive manufacturing digital twin system according to claim 6, characterized in that: The module M1 comprises: The arc fuse additive manufacturing physical scene includes an equipment robot arm, a welding machine, a welding gun, a positioner and a forming component; the equipment robot arm is used to carry the welding gun and realize the displacement function in the physical space coordinates; the welding machine is used to provide a heat source, provide an energy source for arc fuse additive manufacturing, and provide a heat source basis for melting the metal wire; the welding gun is used as an output form of the heat source, providing metal and heat source at the gun head to achieve deposition; the positioner is used to carry the substrate, connect the equipment robot arm to achieve displacement in the physical space, and realize deposition in different postures; the forming component represents the forming state of the metal after being melted by the heat source input, and represents the state after deposition; The digital twin system virtual model includes a digital virtual model robot arm, a welding machine, a welding gun, a positioner and a forming component, as digital information data and a digital model of a physical entity, wherein the digital information data is obtained by converting data acquired through a UDP communication protocol and a camera; The operation information includes click, drag, zoom in, zoom out and long touch; The operation includes an indication of a user interface and an operation of a virtual model of a digital twin system, wherein the indication of the user interface is used to open the user interface through the aerial imaging module; and the operation operates the interface by selecting different options; The user interface includes one or more of print model selection, print material selection, arc information display, print status display, workpiece completion display, and defect display; The virtual model operations of the digital twin system include: the index finger pointing up indicates asynchronous operation to enlarge the model, the index finger pointing down indicates asynchronous operation to reduce the model, the thumb pointing up indicates synchronous operation to control the robot arm, and the victory gesture indicates synchronous operation to exit the control of the robot arm.

8. The system for human-machine interactive aerial visual control of the arc fuse additive manufacturing digital twin system according to claim 6, characterized in that: The module M2 comprises: The actual operation scenarios include controlling the arc fuse additive manufacturing physical scenario and the digital twin system virtual model, including synchronous and asynchronous operations; The synchronous operation includes: the arc fuse additive manufacturing physical scene and the digital twin virtual model are changed synchronously, and the two communicate in real time and receive and execute instructions; The asynchronous operation includes: through the human-computer interaction visualization system, independently operating the digital twin virtual model through operation information, including model enlargement and model change display position, or completing the operation of the user interface instructions through operation information.

9. The system for human-machine interactive aerial visual control of the arc fuse additive manufacturing digital twin system according to claim 6, characterized in that: The module M3 comprises: Select the size, shape and deposition path of the pre-deposition, including the current and voltage that affect the size of the deposition body, and the corresponding process parameter settings, and automatically generate the processing program code from the various setting information, convert it into the robot language and start processing the required forming component specific conditions; The size and shape of the pre-deposition are the physical state of the formed component formed by the deposition of the metal wire after being subjected to the heat source, including the formed height, width, defect type, and defect condition; the deposition path of the pre-deposition is the path of the robot arm carrying the welding gun in the physical space to perform the deposition process, and finally forms the formed component condition; The process parameters of the arc fuse additive manufacturing include deposition current, deposition voltage, wire feeding speed, and welding travel speed. The process parameters affect the size and shape of the deposited body. The influence is specifically obtained by obtaining the influence range of the parameters on the formed components through a machine learning model, and obtaining the corresponding influence range and influence situation.

10. The system for human-machine interactive aerial visual control of the arc fuse additive manufacturing digital twin system according to claim 6, characterized in that: The module M4 comprises: The monitoring information includes one or more of spectral information, spatial information, acoustic information, and thermal information, and the processed and converted features are obtained in the arc fuse additive manufacturing digital twin system. In the human-computer interactive visual control, the corresponding information is displayed, and the surface defects of the additively manufactured parts are located, and the positioning information is recorded and fed back; The spectral information obtains light signal intensity information through a spectrometer and a laser spectrometer, which is used to find defects caused by abnormal light signals; the spatial information obtains physical space coordinates and image information through a CCD camera, which is used to find whether the deposition path is normal and whether the expected formed component is obtained; the acoustic information is obtained through an acoustic sensor, which is used to find defects when the acoustic characteristics are abnormal, and at the same time, understand whether the formed component is normal through the acoustic characteristics; the thermal information obtains temperature and temperature field information through a thermal imager and a thermometer, which is used to regulate the deposition process and control the formed component; The module M5 includes: the processing results include processing completion, processing defect type and location information and processing basic feature information; the processing basic feature information includes one or more of length, width, aspect ratio and perfect fit in the deposition sample morphology information.

Citation Information

Patent Citations

  • A method for realizing three-dimensional data volume rendering of air display and virtual interaction

    CN109242953A

  • Electric arc fuse wire additive manufacturing digital twin system construction method and system based on mixed reality

    CN117150587A

  • Electric arc additive manufacturing digital twinning visualization method

    CN118363502A