Immersive three-dimensional modeling and straight-through 3D printing system and method based on XR

Abstract

The invention discloses an XR-based immersive three-dimensional modeling and straight-through 3D printing system and method, and the method comprises the steps: S1, collecting user input, and converting the user input into an interaction instruction; s2, generating three-dimensional model data; s3, superposing the three-dimensional model into a real physical environment according to a proportion of 1: 1, and outputting a virtual-real fusion display result; s4, performing printability analysis on the model, marking a problem area, guiding a user to modify and providing an automatic repair suggestion; s5, generating a support structure, and providing visual preview and interactive editing; s6, slicing and path planning are executed, and a printing instruction file meeting the control requirement of the 3D printer is generated; s7, communication connection with the 3D printer is established, and printing state information is fed back; and S8, providing storage and calling support of the three-dimensional model file, parameter configuration and environment map data. According to the invention, seamless integration of immersive XR modeling, MR real-time verification and one-key direct-through 3D printing is realized.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of computer graphics, human-computer interaction and additive manufacturing technology, and in particular to an XR-based immersive three-dimensional modeling and direct 3D printing system and method. BACKGROUND

[0002] With the rapid development of three-dimensional modeling and additive manufacturing technology, immersive modeling and direct 3D printing have gradually become an important application direction in industrial design, product development and education and training. However, the existing three-dimensional modeling and printing process still has the following defects:

[0003] Traditional modeling software is mostly based on two-dimensional screen operation, and users rely on mouse and keyboard to complete complex modeling tasks, which lacks spatial sense and immersion, and the model scale, size and fit with the real environment are difficult to intuitively grasp, the learning curve is steep, and the operation is complex. In the design review and verification stage, the existing technology usually relies on rendering or screen demonstration for display, which is difficult to fully perceive the spatial relationship and human-machine ergonomics characteristics of complex three-dimensional models, and if a more intuitive effect is needed, a physical prototype is relied on, resulting in high cost and long cycle.

[0004] In the link from virtual design to real manufacturing, the current process generally relies on multi-software collaboration, and the user needs to export the model first, then perform format conversion, and then import the slicing software to configure the printing parameters and support structure, and finally generate a printing instruction file and transmit it to the 3D printer. This process is not only fragmented and tedious, but also prone to compatibility problems and data loss in the multiple import, export and conversion processes. If it is found that the model has overhanging, thin-walled or hole problems that cannot be printed during the printing stage, the model needs to be modified and the entire process needs to be repeated, which is inefficient and causes serious resource waste. The existing technology still lacks an end-to-end solution that seamlessly connects XR immersive modeling, MR environment real-time verification and 3D printing preprocessing, and cannot realize one-key automatic completion of the complete process from modeling to direct printing. This limitation creates a gap between design and manufacturing, making it difficult to meet the actual application requirements of rapid iteration, low cost and high reliability.

[0005] Therefore, how to provide an XR-based immersive three-dimensional modeling and direct 3D printing system and method is a problem that those skilled in the art need to solve. SUMMARY

[0006] One purpose of the present application is to propose an XR-based immersive three-dimensional modeling and direct 3D printing system and method, which fully integrates an immersive modeling engine, an MR fusion display, printability analysis, intelligent support generation, and an automated slicing and printing process. The entire process of intuitive creation, real-time verification, defect repair, support generation, slicing processing, and printing issuance of a three-dimensional model in an XR environment is described in detail. The present application has the advantages of natural modeling interaction, accurate spatial perception, efficient virtual-real verification, seamless connection of the printing process, and a significantly shortened prototype manufacturing cycle.

[0007] The XR-based immersive three-dimensional modeling and direct 3D printing method according to the embodiment of the present application comprises the following steps: S1, an XR interaction engine collects user input and converts the input into an interaction instruction, which is transmitted to an immersive modeling engine and an MR fusion engine; S2, the immersive modeling engine receives the interaction instruction and operates on geometric data in a three-dimensional space to generate three-dimensional model data; S3, the MR fusion engine receives the three-dimensional model data, superimposes the three-dimensional model in a 1:1 scale into a real physical environment, and outputs a virtual-real fusion display result to an XR user interface; S4, a printing pre-processing engine receives the three-dimensional model data, performs printability analysis on the model, and marks problem areas in the XR user interface to guide the user to modify and provide automatic repair suggestions; S5, an intelligent support generation module generates a support structure based on the geometric features and printing parameters of the three-dimensional model, and provides visual preview and interactive editing in the XR user interface; S6, a slicing function module performs slicing and path planning based on the three-dimensional model and the support structure to generate a printing instruction file that meets the control requirements of a 3D printer; S7, a printing management module receives the printing instruction file, establishes a communication connection with the 3D printer, and feeds back printing status information to the XR user interface; S8, a data management module provides storage and calling support for three-dimensional model files, parameter configurations, and environment map data throughout the process.

[0008] Optionally, the step S1 comprises: S11, collecting hand gesture input, voice input, or controller input; S12, detecting hand gesture state, providing a high-light prompt when the hand enters the determination range, recognizing pinch gestures and single-finger click gestures, and analyzing them into structured operation instructions; The pinch gesture: the thumb and index finger touch and remain still, the object can be moved by moving the arm, the starting point: the hand enters the object determination range, the object interaction can be determined, when the thumb and index finger make a pinch gesture, the object follows the current coordinates and movement trajectory of the hand, then when the pinch gesture is canceled and the thumb and index finger are released, the movement stops; S13, converting the voice input into machine-readable instructions by natural language recognition technology, and parsing the structured operation instructions by the intelligent agent; S14, collecting controller input, reading the state of buttons, triggers, joysticks and touchpads, and generating structured operation instructions according to the input mapping table; S15, aligning the gesture, voice and controller structured operation instructions according to the timestamp, performing event fusion and conflict arbitration, and outputting the interaction instructions.

[0009] Optionally, the step S2 comprises: S21, receiving the interaction instructions transmitted by the XR interaction engine, and selecting a modeling mode according to the interaction instructions, including polygon modeling, voxel modeling, surface modeling and parametric modeling; S22, in the polygon modeling mode, performing vertex editing, edge editing and face editing operations, supporting stretching, rotating, scaling and translating; S23, in the voxel modeling mode, performing voxel unit addition, deletion and merging operations to form a voxel structure; S24, in the surface modeling mode, performing curve drawing, surface generation and surface editing operations; S25, in the parametric modeling mode, generating a geometric object according to user input parameters, and supporting real-time update after parameter adjustment; S26, supporting importing external three-dimensional model files, and performing loading, displaying and modifying operations; S27, providing users with intuitive three-dimensional space reference system and scale tools, and performing complex three-dimensional modeling operations in the XR environment natively and immersively; S28, generating three-dimensional model data and outputting to the MR fusion engine and the printing preprocessing engine.

[0010] Optionally, the step S3 comprises: S31, receiving the three-dimensional model data output by the immersive modeling engine; S32, during or after the modeling process, the user can seamlessly switch to the MR mode; S33, performing spatial anchoring to align the three-dimensional model with the spatial reference point of the physical environment in the world coordinate system; S34, environment understanding, collecting environment depth data and image data, generating spatial mapping information of the physical environment; S35, determining the positional relationship between the virtual model and the physical object based on the spatial mapping information; S36, performing virtual-real occlusion processing, hiding the corresponding part in the display result when the virtual model is occluded by the physical object; S37, superimposing the three-dimensional model into the physical environment according to a 1:1 scale, maintaining the spatial consistency of the model and the real scene; S38, supporting real-time adjustment of the position, pose and scale of the model in the MR environment by the user; S39, supporting virtual assembly testing and ergonomic evaluation.

[0011] Optionally, the step S4 comprises: S41, performing printability analysis on the three-dimensional model, automatically checking whether the three-dimensional model has problems such as too large overhanging angle, thin wall, hole and self-intersecting surface; The method for checking the too large overhanging angle: detecting the included angle between the normal vector of each triangular facet or curved surface and the direction of gravity. If the included angle is greater than a preset threshold angle, the facet is marked as a potential overhanging problem surface;

[0012] The method for checking the thin wall: emitting a ray from a large number of points on the model surface along the normal line inward. If the ray hits the opposite surface within a very short preset distance, the area is marked as a thin wall;

[0013] The method for checking the hole: performing manifold checking to ensure that each edge is shared by and only by two surfaces. If there is an edge that is not shared by two surfaces or an edge that is not shared by any surface, it indicates that the model has a hole or a non-manifold problem, and all edges are checked for closure; The method for checking the self-intersecting surface: using a spatial partition data structure to perform efficient triangle intersection testing to detect whether different parts of the model penetrate each other; S42, in the XR user interface, highlighting the potential overhanging problem surface in red, highlighting the thin wall problem in yellow, highlighting the hole problem in purple, and highlighting the self-intersecting surface problem in magenta; S43, for the area with the problem of too large overhanging angle, generating an automatic repair suggestion to add a support structure below the area, or the user directly pushes and pulls the vertices and surfaces in the XR user interface to locally thicken or add temporary support; S44, for the thin wall area, generating an automatic repair suggestion: thickening the area to above a minimum wall thickness threshold, or the user directly uses a one-key thickening function in the XR user interface; S45, for the hole region, generate an automatic repair suggestion: use the automatic hole filling function or generate a new face based on the boundary edge ring to fill the hole; S46, for the self-intersection region, generate an automatic repair suggestion: eliminate the intersection by local mesh refinement algorithm in the intersection region and re-topology; S47, display the repair icon or text prompt next to the problem area in the XR user interface, and the user can trigger automatic repair or enter manual repair mode by clicking.

[0014] Optionally, the step S5 comprises: S51, determine the area that needs support according to the geometric characteristics of the three-dimensional model and the overhanging detection result; S52, select the support structure type according to the generation mode, including tree-shaped support and linear grid support; S53, select the support material type according to the material attribute, including support of the same material as the model or soluble material support; S54, automatically generate support structure under the determined overhanging area, and bind the support structure with the three-dimensional model; S55, visually display the support structure in the XR user interface, supporting the user to view the support position, quantity and form; S56, provide interactive editing function, allowing the user to move, scale, add, delete and adjust the form of the support structure in the XR user interface; S57, output the finally confirmed support structure together with the three-dimensional model to the slicing function module.

[0015] Optionally, the step S6 comprises: S61, the user completes the preparation and parameter setting in the XR user interface, including importing the three-dimensional model file, performing model moving, rotating, scaling and copying operations, and configuring the printing parameters, including layer height, filling density, support setting, temperature and speed; S62, when the user issues a slicing instruction in the XR user interface, the system automatically collects the three-dimensional model data, user setting parameters and printer configuration information in the XR environment, and converts them into command line parameters and configuration files or application program interface mode to pass to the slicing engine; S63, the slicing function module performs model loading and verification, printer parameter application, layer slicing, path planning and printer control command insertion, and generates a printing instruction file; The model loading and verification includes reading the three-dimensional model file and verifying according to the support structure; The printer parameter application is the printer definition file and user setting parameter, which establishes the printing task context; The slicing is to slice the three-dimensional model along the Z-axis direction to generate layer-enclosed two-dimensional polygon contour data; The path planning is to plan the motion path and extrusion amount of the print head in the layer-enclosed two-dimensional polygon contour data, including generating outer wall, inner wall, filling, support and attachment structure path, and calculating the required extrusion amount; The printer control command includes temperature control, fan control and pause control; The motion path and the printer control command are translated according to the G-code syntax specification to generate a print instruction file containing start code and end code; S64, the user outputs the print instruction file directly to the print management module without exporting the file or manually converting in the XR user interface; S65, the print management module establishes wired or wireless connection with the target 3D printer, automatically sends the print instruction file to the printer and starts the printing task; S66, the XR user interface displays the printing state information in real time during the printing process, including task progress bar and estimated completion time.

[0016] Optionally, the step S7 includes: S71, receiving the print instruction file generated by the slicing function module; S72, the print management module establishes wired or wireless connection with the target 3D printer, automatically sends the print instruction file to the printer and starts the printing task; S73, real-time monitoring of the running state of the 3D printer, including printing progress, temperature, nozzle movement and material consumption information; S74, generating alarm information and displaying it in the XR user interface when an abnormal state is detected; S75, real-time feedback of the state information in the printing process to the XR user interface in a visual form, including task progress bar and estimated completion time; S76, after the printing task is completed, the task end processing is performed and the task result is stored to the data management module.

[0017] Optionally, the step S8 includes: S81, receiving and storing three-dimensional model files, including STL format files, 3MF format files and other three-dimensional model files imported by the user; S82, receiving and storing user parameter settings, including modeling parameters, printing parameters and interface configuration parameters; S83, receiving and storing printing configuration files, including printer definition files, material configuration files and slicing parameter files; S84, receive and store environment map data, including depth images, RGB images and spatial anchor point information collected by the XR device; S85, provide a three-dimensional model file calling interface to the immersive modeling engine, support model loading, modification and saving; S86, provide a printing parameter and configuration file calling interface to the printing preprocessing engine, support printability analysis and slicing task execution; S87, provide an environment map data calling interface to the MR fusion engine, support spatial alignment and fusion of the model and the physical environment; S88, provide a historical data calling interface to the XR user interface, support user loading and reuse of stored models, parameters and configurations.

[0018] The XR-based immersive three-dimensional modeling and direct-through 3D printing system according to the embodiment of the application comprises: An XR interaction engine, configured to collect user input and render a virtual scene, and output an interaction instruction; An immersive modeling engine, configured to perform geometric operations in a three-dimensional space and generate a three-dimensional model; An MR fusion engine, configured to perform spatial anchoring, environment understanding and virtual-real occlusion processing, and superimpose the three-dimensional model on a real physical environment in a 1:1 scale to realize virtual-real fusion display; A printing preprocessing engine, comprising a printability analysis module, an intelligent support generation module and a slicing function module; The printability analysis module is configured to detect the three-dimensional model, highlight and mark problem areas in an XR environment, guide the user to modify and provide automatic repair suggestions; The intelligent support generation module is configured to automatically generate a support structure according to geometric characteristics of the three-dimensional model and printing parameters, and provide visual preview and editing in an XR user interface; The slicing function module is configured to integrate or encapsulate slicing software, slice and path plan the three-dimensional model, and generate a printing instruction file in a 3D printer instruction format; A printing management module, configured to establish a communication connection with a 3D printer, execute printing task issuing, printing queue management and printing state monitoring; A data management module, configured to store three-dimensional model files, user parameter settings, printing configuration files and environment map data, and provide calling interfaces to various modules; An XR user interface, configured to present menus, tool tips, operation panels and state displays in an XR environment, and receive operation input from the user.

[0019] The application has the following beneficial effects: The application introduces immersive interaction modeling and MR real-time verification in an XR environment, aiming at the problems of insufficient spatial perception, complex operation, fragmented process and high printing failure rate in traditional three-dimensional modeling, adopts a multi-modal interaction mode of natural gestures, voice and controller input, combines immersive modeling engine and virtual-real fusion display, and realizes intuitive modeling operation and real-time preview conforming to human spatial cognition; A high-precision environment adaptability verification mechanism is introduced in the design stage, problems of mismatch with the physical environment are found in time through spatial anchoring and virtual-real occlusion processing, and expensive modification and prototype iteration in the later stage is avoided; In the manufacturing link, a printable analysis and intelligent support generation module is integrated, potential defects such as overhang, thin wall, hole and self-intersection are automatically detected and repair suggestions are generated, combined with parameterized support generation and interactive editing, the model quality and printing success rate are significantly improved; The seamless connection of the slicing function module and the printing management module eliminates the cumbersome steps of exporting, converting and manual slicing, realizes the one-key straight-through printing of "what you see is what you get", and greatly shortens the cycle from virtual design to physical manufacturing; In addition, the visual interaction of the immersive environment reduces the professional threshold of 3D modeling and prototype manufacturing, so that non-professional users can also quickly master it, and supports multi-user collaborative modeling and review, and enhances team collaboration efficiency and creativity. BRIEF DESCRIPTION OF DRAWINGS

[0020] The accompanying drawings are included to provide a further understanding of the application, and constitute a part of the specification, together with the embodiments of the application, to explain the application, and do not constitute a limitation on the application. In the drawings:

[0021] Fig. 1 The overall flowchart of the XR-based immersive three-dimensional modeling and straight-through 3D printing method proposed by the application; Fig. 2 The printable analysis flowchart of the XR-based immersive three-dimensional modeling and straight-through 3D printing method proposed by the application; Fig. 3 The user operation flowchart of the XR-based immersive three-dimensional modeling and straight-through 3D printing method proposed by the application. DETAILED DESCRIPTION

[0022] The application will now be described in further detail with reference to the drawings. These drawings are simplified schematic diagrams, and only illustrate the basic structure of the application in a schematic manner, and therefore only show the components related to the application.

[0023] Reference Figs. 1-3 The XR-based immersive three-dimensional modeling and straight-through 3D printing method includes the following steps: S1, the XR interaction engine collects user input and converts the input into interaction instructions, which are transmitted to the immersive modeling engine and the MR fusion engine; S2, the immersive modeling engine receives the interaction instruction, operates the geometric data in three-dimensional space, and generates three-dimensional model data; S3, the MR fusion engine receives the three-dimensional model data, superimposes the three-dimensional model in a 1:1 scale to the real physical environment, and outputs a virtual-real fusion display result to an XR user interface; S4, the print preprocessing engine receives the three-dimensional model data, performs printability analysis on the model, and labels problem areas in the XR user interface to guide the user to modify and provide automatic repair suggestions; S5, the intelligent support generation module generates a support structure according to the geometric characteristics of the three-dimensional model and the printing parameters, and provides visual preview and interactive editing in the XR user interface; S6, the slicing function module performs slicing and path planning according to the three-dimensional model and the support structure, and generates a printing instruction file meeting the control requirements of a 3D printer; S7, the print management module receives the printing instruction file, establishes a communication connection with the 3D printer, and feeds back printing state information to the XR user interface; S8, the data management module provides storage and calling support for three-dimensional model files, parameter configurations, and environment map data in the whole process.

[0024] The present application collects user input through an XR interaction engine and converts it into interaction instructions; an immersive modeling engine generates three-dimensional model data according to the instructions; an MR fusion engine superimposes the model in a 1:1 scale to the physical environment and outputs a virtual-real fusion result; a print preprocessing engine performs printability analysis on the model and highlights problem areas; an intelligent support generation module automatically generates support and provides visual editing; a slicing function module performs slicing and path planning to generate a printing instruction file; a print management module issues tasks and monitors the printing state; and a data management module provides storage and calling of files, parameters, and environment data throughout the process. The process is coherent, ensuring efficient connection of modeling, verification, and printing

[0025] In the present embodiment, the step S1 comprises: S11, collecting gesture input, voice input, or controller input of the user; S12, detecting the gesture state, when the hand enters the determination range, there is a highlight prompt, recognizing the pinch gesture and the single-finger click gesture, and analyzing as a structured operation instruction; The pinch gesture: after the thumb and the index finger touch, they remain stationary, the object can be moved by moving the arm, the starting point: the hand enters the object determination range, the object interaction can be determined, when the pinch gesture is cancelled and the thumb and the index finger are released, the movement stops. S13, converting the voice input into machine-readable instructions by natural language recognition technology, and parsing the machine-readable instructions into structured operation instructions by an intelligent agent; S14, collecting controller input, reading the state of buttons, triggers, joysticks, and touchpads, and generating structured operation instructions according to an input mapping table; S15, aligning the gesture, voice, and controller structured operation instructions according to timestamps, performing event fusion and conflict arbitration, and outputting interaction instructions.

[0026] The application realizes multi-modal input processing in an XR interaction engine, including collecting gesture, voice, and controller input. Gesture recognition supports pinch and single-click operations, enabling object movement and interaction; voice input is recognized and parsed into structured instructions by an intelligent agent; controller input is mapped to generate operation instructions through buttons, triggers, joysticks, and touchpads. Each input is aligned according to timestamps and performs event fusion and conflict arbitration to output unified interaction instructions, ensuring the naturalness and accuracy of operations.

[0027] In the embodiment, the step S2 includes: S21, receiving interaction instructions transmitted by the XR interaction engine, and selecting a modeling mode according to the interaction instructions, including polygon modeling, voxel modeling, surface modeling, and parametric modeling; S22, in the polygon modeling mode, performing vertex editing, edge editing, and face editing operations, supporting stretching, rotating, scaling, and translating; S23, in the voxel modeling mode, performing voxel unit addition, deletion, and merging operations to form a voxel structure; S24, in the surface modeling mode, performing curve drawing, surface generation, and surface editing operations; S25, in the parametric modeling mode, generating a geometric object according to user input parameters, and supporting real-time updating after parameter adjustment; S26, supporting importing external three-dimensional model files, and performing loading, displaying, and modifying operations; S27, providing users with intuitive three-dimensional space reference systems and scale tools for complex three-dimensional modeling operations in the XR environment in a native and immersive manner; S28, generating three-dimensional model data and outputting to the MR fusion engine and the printing preprocessing engine.

[0028] The application supports multiple modeling modes in an immersive modeling engine, including polygon, voxel, curved surface and parametric modeling. Users can realize vertex, edge and face editing, execute voxel unit operations, draw curves and generate curved surfaces, or generate geometric objects according to parameters and update in real time through interactive instructions. The system supports the import and modification of external three-dimensional model files, provides a spatial reference system and a scale tool, ensures that users complete immersive modeling in an XR environment, and outputs three-dimensional model data to an MR fusion engine and a printing preprocessing engine.

[0029] In the embodiment, the step S3 comprises: S31, receiving three-dimensional model data output by the immersive modeling engine; S32, seamlessly switching to an MR mode during or after the modeling process; S33, performing spatial anchoring to align the three-dimensional model with a spatial reference point of a physical environment in a world coordinate system; S34, performing environment understanding to collect environment depth data and image data and generate spatial mapping information of the physical environment; S35, determining a positional relationship between a virtual model and a physical object based on the spatial mapping information; S36, performing virtual-real occlusion processing to hide corresponding parts in a display result when the virtual model is occluded by the physical object; S37, superimposing the three-dimensional model into the physical environment according to a 1:1 scale to maintain spatial consistency of the model and the real scene; S38, supporting real-time adjustment of a position, a pose and a scale of the model in the MR environment by the user; S39, supporting virtual assembly testing and ergonomics evaluation.

[0030] The application realizes the combination of a three-dimensional model and a physical environment in an MR fusion engine, supports spatial anchoring, environment understanding and virtual-real occlusion processing, and guarantees the scale and position consistency of the model and the real scene. The user can seamlessly switch to an MR mode during or after the modeling process, adjust the position, pose and scale of the model, and carry out virtual assembly testing and ergonomics evaluation, so as to realize high-precision verification and interactive experience in an immersive environment.

[0031] In the embodiment, the step S4 comprises: S41, performing printability analysis on the three-dimensional model to automatically check whether the three-dimensional model has problems such as too large overhanging angle, thin wall, hole and self-intersection surface; The method for checking the too large overhanging angle comprises detecting an included angle between a normal vector of each triangular facet or curved surface and a gravity direction. If the included angle is greater than a preset threshold angle, the facet is marked as a potential overhanging problem facet;

[0032] The thin-wall checking method: rays are emitted from a large number of points on the model surface along the normal direction. If the rays hit the opposite surface within a short preset distance, the area is marked as a thin wall;

[0033] The hole checking method: perform manifold checking to ensure that each edge is shared by two faces only, and if there is an edge that is not shared by two faces or an edge that is not shared by any face, it indicates that the model has a hole or a non-manifold problem, and at the same time, check whether all edges are closed; The self-intersecting face checking method: use a spatial partition data structure to perform efficient triangle intersection testing to detect whether different parts of the model penetrate each other; S42, in the XR user interface, highlight the potential overhanging problem surface in red, the thin-wall problem in yellow, the hole problem in purple, and the self-intersecting face problem in magenta; S43, for the overhanging angle problem area, generate an automatic repair suggestion, add a support structure below the area, or the user directly pushes and pulls the vertex and the face in the XR user interface to locally thicken or add a temporary support; S44, for the thin-wall area, generate an automatic repair suggestion: thicken the area to above the minimum wall thickness threshold, or the user directly uses the one-key thickening function in the XR user interface; S45, for the hole area, generate an automatic repair suggestion: use the automatic hole filling function or generate new face patches based on the boundary edge ring to fill the hole; S46, for the self-intersecting area, generate an automatic repair suggestion: locally encrypt the grid and re-topology in the intersection area through a grid re-partitioning algorithm to eliminate the intersection; S47, in the XR user interface, display a repair icon or a text prompt beside the problem area, and the user can trigger automatic repair or enter manual repair mode by clicking.

[0034] The present application performs printability analysis on the three-dimensional model in the print preprocessing stage, automatically detects overhanging, thin-wall, hole and self-intersecting problems, and highlights them in different colors in the XR interface. The system generates automatic repair suggestions, and the user can choose one-key repair or manual adjustment to ensure that the model has good structural integrity and manufacturability before printing, thereby reducing the printing failure rate.

[0035] In the embodiment, the step S5 includes: S51, determine the area that needs support according to the geometric characteristics of the three-dimensional model and the overhanging detection result; S52, select the support structure type according to the generation mode, including tree-shaped support and linear grid support; S53, selecting a support material type according to the material properties, including support of the same material as the model or soluble material support; S54, automatically generating a support structure under the determined overhanging area and binding the support structure with the three-dimensional model; S55, visualizing the support structure in the XR user interface, supporting the user to view the support position, quantity and form; S56, providing an interactive editing function to allow the user to move, scale, add or delete and adjust the form of the support structure in the XR user interface; S57, outputting the finally confirmed support structure together with the three-dimensional model to the slicing function module.

[0036] In the intelligent support generation stage of the present application, tree-shaped or grid supports are automatically generated according to the model geometric features and overhanging detection results, and different materials can be selected. The support structure is bound with the model and visualized in the XR interface, and the user can perform interactive editing such as moving, scaling and adding or deleting, and finally the confirmed support is output together with the model to the slicing module.

[0037] In the present embodiment, the step S6 comprises: S61, the user completes preparation and parameter setting in the XR user interface, including importing the three-dimensional model file, performing model moving, rotating, scaling and copying operations, and configuring printing parameters, including layer height, filling density, support setting, temperature and speed; S62, when the user issues a slicing instruction in the XR user interface, the system automatically collects the three-dimensional model data, user setting parameters and printer configuration information in the XR environment, and converts them into command line parameters and configuration files or application program interface mode to pass to the slicing engine; S63, the slicing function module performs model loading and verification, printer parameter application, layer slicing, path planning and printer control command insertion, and generates a printing instruction file; The model loading and verification includes reading the three-dimensional model file and verifying according to the support structure; The printer parameter application defines the printer file and user setting parameters to establish the printing task context; The layer slicing is to slice the three-dimensional model along the Z-axis direction to generate closed two-dimensional polygon contour data of each layer; The path planning is to plan the movement path and extrusion amount of the print head in the closed two-dimensional polygon contour data of each layer, including generating outer wall, inner wall, filling, support and attachment structure paths, and calculating the required extrusion amount; The printer control command includes temperature control, fan control and pause control; The motion path and the printer control command are translated according to the G-code syntax specification to generate a printing instruction file containing start code and end code; S64, the user exports the file without exporting the file or manually converting the file, and directly outputs the printing instruction file to the printing management module in the XR user interface; S65, the printing management module establishes a wired or wireless connection with the target 3D printer, automatically sends the printing instruction file to the printer, and starts the printing task; S66, the XR user interface displays the printing state information in real time during the printing process, including the task progress bar and the estimated completion time.

[0038] In the slicing phase, the user completes the parameter setting and issues the instruction in the XR interface, and the system automatically collects the model and configuration data and transmits them to the slicing engine. The slicing module performs model verification, layer slicing and path planning to generate a printing file containing control commands. The user can directly pass through the printing management module without exporting or converting, thereby improving efficiency.

[0039] In the embodiment, the step S7 comprises: S71, receiving the printing instruction file generated by the slicing function module; S72, the printing management module establishes a wired or wireless connection with the target 3D printer, automatically sends the printing instruction file to the printer, and starts the printing task; S73, real-time monitoring of the running state of the 3D printer, including printing progress, temperature, nozzle movement and material consumption information; S74, generating an alarm information when an abnormal state is detected and displaying it in the XR user interface; S75, real-time feedback of the state information in the printing process to the XR user interface in a visual form, including the task progress bar and the estimated completion time; S76, after the printing task is completed, performing task end processing and storing the task result to the data management module.

[0040] In the printing management phase, the system establishes a wired or wireless connection with the 3D printer, automatically issues the slicing file and starts the task. The module real-time monitors the printing progress, temperature and material consumption, triggers an alarm when an abnormality occurs and prompts in the XR interface. The printing state is visualized in the form of progress bar and estimated completion time, and the result is stored after completion.

[0041] In the embodiment, the step S8 comprises: S81, receiving and storing a three-dimensional model file, including an STL format file, a 3MF format file and other three-dimensional model files imported by the user; S82, receive and store user parameter settings, including modeling parameters, printing parameters and interface configuration parameters; S83, receive and store printing configuration files, including printer definition files, material configuration files and slicing parameter files; S84, receive and store environmental map data, including depth images, RGB images and spatial anchor point information collected by XR devices; S85, provide a three-dimensional model file calling interface to the immersive modeling engine, supporting model loading, modification and saving; S86, provide a printing parameter and configuration file calling interface to the printing preprocessing engine, supporting printability analysis and slicing task execution; S87, provide an environmental map data calling interface to the MR fusion engine, supporting spatial alignment and fusion of the model and the physical environment; S88, provide a historical data calling interface to the XR user interface, supporting user loading and reuse of stored models, parameters and configurations.

[0042] In the data management phase, the application supports the reception and storage of three-dimensional models, user parameters, printing configurations and environmental map data, and provides calling interfaces to modeling, preprocessing, MR fusion and XR interface modules. The system realizes historical data reuse, ensuring data consistency and traceability from modeling to printing.

[0043] The XR-based immersive three-dimensional modeling and direct-through 3D printing system comprises: An XR interaction engine for collecting user input and rendering a virtual scene, outputting interaction instructions; An immersive modeling engine for performing geometric operations in three-dimensional space to generate a three-dimensional model; An MR fusion engine for performing spatial anchoring, environment understanding and virtual-real occlusion processing, superimposing the three-dimensional model in a 1:1 scale into a real physical environment to realize virtual-real fusion display; A printing preprocessing engine including a printability analysis module, an intelligent support generation module and a slicing function module; The printability analysis module is configured to detect the three-dimensional model and highlight the problem area in the XR environment, guiding the user to modify and providing automatic repair suggestions; The intelligent support generation module is configured to automatically generate support structures according to the geometric features of the three-dimensional model and the printing parameters, and provide visual preview and editing in the XR user interface; The slicing function module is configured to integrate or encapsulate slicing software, slice and path plan the three-dimensional model, and generate a printing instruction file conforming to the 3D printer instruction format; a print management module configured to establish a communication connection with the 3D printer, perform print task issuing, print queue management, and print status monitoring; a data management module configured to store three-dimensional model files, user parameter settings, print configuration files, and environment map data, and provide calling interfaces to the modules; an XR user interface configured to present menus, tool tips, operation panels, and status displays in the XR environment, and receive operation inputs from the user.

[0044] The present application realizes a complete process from three-dimensional modeling, virtual-real fusion verification, printability analysis, support structure generation, slicing processing to print task execution by constructing a system including an XR interaction engine, an immersive modeling engine, an MR fusion engine, a print preprocessing engine, a print management module, a data management module, and an XR user interface. The system structure is clear, and the modules cooperate with each other, enabling intuitive modeling, real-time verification, and one-key direct printing in the XR environment, improving design efficiency and manufacturing success rate, and effectively reducing the operation threshold and time cost.

[0045] Embodiment 1 To verify the feasibility of the present application in implementation, the present application is applied to a customized mobile phone support design and manufacturing project. In this project, the user wears MR glasses and completes three-dimensional modeling and accurate size setting of the mobile phone support in the XR environment through gestures, voice, and a space ruler tool. After modeling is completed, the user switches to the MR mode, the system anchors the virtual model to the real desktop, the user can observe the fit degree of the model and the desktop from multiple angles around the desktop, and directly modifies the design in the MR environment in real time when finding that the bottom contact surface is too small, to ensure stability and aesthetics.

[0046] In the implementation process, the system of the present application automatically performs printability analysis and support generation, detects a hanging area and prompts that support may be needed, then generates a preview of tree-shaped support for the user to confirm. After the user confirms, the system directly completes slicing and path planning without exporting or converting the file, generates a G-code file meeting the requirements of the 3D printer, and issues it to the desktop 3D printer through the network. During the printing process, the user can view the printing progress and estimated completion time in real time in the MR interface. The final obtained physical mobile phone support is completely consistent with the preview effect in the MR environment, realizing the rapid verification and manufacturing of "what you see is what you get".

[0047] To more comprehensively verify the actual effect of the present application, it is compared with the traditional 3D modeling-slicing-printing step-by-step process. In the comparison experiment, key indicators such as modeling efficiency, print preprocessing efficiency, print success rate, material waste rate, and total manufacturing cycle are recorded and statistically analyzed, and the experimental results are shown in Table 1:

[0048] Table 1 Performance comparison of the method of the application and the traditional method in actual modeling

[0049] As can be seen from the data in Table 1, the method of the application is significantly better than the traditional method in many indicators. In the design stage, the user observes that the bottom surface is too small through the actual desktop scale and can directly adjust it in the MR by gestures. Compared with the traditional two-dimensional screen modeling, at least three repeated modification processes of exporting-printing-verification are saved, and the design time is shortened by about 40%.

[0050] In the printing pretreatment link, the system automatically detects a suspended structure of about 60°, which will cause a failure probability of about 30% if not handled. The system generates a tree-shaped support preview in the XR interface in real time, and the user directly enters the printing stage after confirmation. The traditional process needs to manually export STL and import the slicing software to manually set the support, which takes about 15 minutes on average, while the system completes it with one key, with an efficiency improvement of more than 70%.

[0051] Finally, the printed mobile phone holder is completely consistent with the appearance and proportion in the MR preview, without the need for secondary modification, and the model is successful once. Compared with the traditional method which needs an average of 3 printing iterations (about 3 hours each time), the application reduces about 6 hours of invalid manufacturing time, reduces the waste of printing materials by more than 60%, and significantly improves the efficiency and success rate.

[0052] As can be seen from the above, the immersive three-dimensional modeling and direct-through 3D printing system and method based on XR proposed by the application not only significantly improves the intuitiveness and operation efficiency of modeling, but also effectively reduces the printing failure rate caused by model defects or size deviation, and realizes the closed-loop process from virtual modeling, MR verification to one-key printing. Compared with the traditional step-by-step process, the application has obvious advantages in design verification, manufacturing cycle, user experience and success rate, and is particularly suitable for personalized design, rapid prototyping and other application scenarios, which verifies its engineering practicability and wide popularization value.

[0053] The above describes only the preferred specific embodiments of the application, but the protection scope of the application is not limited thereto, and any person skilled in the art can make equivalent replacements or changes to the technical solutions and inventive concepts of the application within the technical scope disclosed by the application, which should be covered within the protection scope of the application.

Claims

1. An XR-based immersive 3D modeling and direct-to-3D printing method, characterized in that, Includes the following steps: S1, the XR interaction engine collects user input and converts the input into interaction commands, which are then transmitted to the immersive modeling engine and the MR fusion engine; S2. The immersive modeling engine receives the interactive instructions, manipulates geometric data in three-dimensional space, and generates three-dimensional model data. S3, the MR fusion engine receives the three-dimensional model data, superimposes the three-dimensional model onto the real physical environment at a 1:1 scale, and outputs the virtual-real fusion display result to the XR user interface; S4. The printing preprocessing engine receives the 3D model data, performs printability analysis on the model, marks the problem areas in the XR user interface, guides the user to make modifications, and provides automatic repair suggestions. S5. The intelligent support generation module generates a support structure based on the geometric features and printing parameters of the three-dimensional model, and provides a visual preview and interactive editing in the XR user interface; S6. The slicing function module performs slicing and path planning based on the three-dimensional model and support structure, and generates a printing instruction file that meets the control requirements of the 3D printer. S7. The print management module receives the print instruction file, establishes a communication connection with the 3D printer, and feeds back the print status information to the XR user interface. S8, the data management module provides support for storing and accessing 3D model files, parameter configurations, and environmental map data throughout the process.

2. The XR-based immersive 3D modeling and direct-to-line 3D printing method according to claim 1, characterized in that, Step S1 includes: S11. Collect user gesture input, voice input, or controller input; S12. Detect gesture status. When a hand enters the detection range, there will be a highlight prompt. Recognize pinch gestures and single-finger tap gestures and parse them into structured operation instructions. The pinch gesture: After the thumb and index finger touch and remain still, the object can be moved by moving the arm. The starting point is when the hand enters the object's detection range, and the interaction between the object and the object can be determined. When the thumb and index finger make a pinch gesture, the object moves according to the hand's current coordinates and movement trajectory. Then, when the pinch gesture is canceled and the thumb and index finger are released, the movement stops. S13. Using natural speech recognition technology, the voice input is converted into machine-readable instructions, and then parsed into structured operation instructions by an intelligent agent; S14. Acquire controller input, read the status of buttons, triggers, joysticks and touchpad, and generate structured operation instructions based on the input mapping table; S15. Align the gestures, voice and controller structured operation instructions according to timestamps, perform event fusion and conflict arbitration, and output interactive instructions.

3. The XR-based immersive 3D modeling and direct-to-line 3D printing method according to claim 2, characterized in that, Step S2 includes: S21. Receive the interaction instructions transmitted by the XR interaction engine, and select the modeling mode according to the interaction instructions, including polygon modeling, voxel modeling, surface modeling and parametric modeling. S22. In polygon modeling mode, perform vertex editing, edge editing and face editing operations, and support stretching, rotation, scaling and translation; S23. In voxel modeling mode, perform voxel unit addition, deletion and merging operations to form voxel structure; S24. In surface modeling mode, perform curve drawing, surface generation, and surface editing operations; S25. In parametric modeling mode, geometric objects are generated based on the parameters input by the user, and real-time updates are supported after parameter adjustments. S26. Supports importing external 3D model files and performing loading, display, and modification operations; S27. Provide users with an intuitive 3D spatial reference system and scale tool to perform complex 3D modeling operations natively and immersively in the XR environment; S28. Generate 3D model data and output it to the MR fusion engine and printing preprocessing engine.

4. The XR-based immersive 3D modeling and direct-to-line 3D printing method according to claim 1, characterized in that, Step S3 includes: S31. Receive the 3D model data output by the immersive modeling engine; S32. Users can seamlessly switch to MR mode during or after modeling. S33. Perform spatial anchoring to align the three-dimensional model with the spatial reference point of the physical environment in the world coordinate system; S34. Perform environmental understanding, collect environmental depth data and image data, and generate spatial mapping information of the physical environment; S35. Determine the positional relationship between the virtual model and the physical object based on the spatial mapping information; S36. Perform virtual-physical occlusion processing. When the virtual model is occluded by a physical object, the corresponding part is hidden in the display result. S37. Superimpose the three-dimensional model onto the physical environment at a 1:1 scale to maintain spatial consistency between the model and the real scene; S38. Supports users to adjust the position, pose and scale of the model in real time in the MR environment; S39. Supports virtual assembly testing and ergonomic evaluation.

5. The XR-based immersive 3D modeling and direct-to-line 3D printing method according to claim 1, characterized in that, Step S4 includes: S41. Perform printability analysis on the three-dimensional model and automatically check whether the three-dimensional model has problems such as excessive overhang angle, thin walls, holes and self-intersecting surfaces. The method for checking excessive overhang angle is as follows: detect the angle between the normal vector of each triangular facet or curved surface and the direction of gravity. If the angle is greater than a preset threshold angle, the facet is marked as a potential overhang problem facet. The thin-wall inspection method is as follows: rays are emitted inward from a large number of points on the model surface along the normal. If the rays hit the opposite surface within a very short preset distance, the area is marked as a thin wall. The hole detection method involves performing a manifold check to ensure that each edge is shared by exactly two faces. If there are edges that are not shared by two faces or are not shared by any faces, it indicates that the model has holes or non-manifold issues. At the same time, it checks whether all edges are closed. The self-intersecting surface inspection method uses a spatial segmentation data structure to perform efficient triangle intersection testing to detect whether different parts of the model penetrate each other. S42. In the XR user interface, the potential overhangs, thin walls, holes and self-intersecting problem surfaces are displayed in a highlighted form; S43. For the area with excessive overhang angle, generate automatic repair suggestions, add support structures below the area, or allow the user to directly push and pull the vertices and surfaces in the XR user interface to locally thicken or add temporary supports. S44. For thin-walled areas, generate automatic repair suggestions: thicken the area to above the minimum wall thickness threshold, or the user can directly use the one-click thickening function in the XR user interface. S45. For the hole area, generate automatic repair suggestions: use the automatic hole filling function or generate a new patch based on the boundary edge ring to fill the hole; S46. For self-intersecting regions, generate automatic repair suggestions: locally refine the mesh and retopology in the intersecting regions using a mesh re-partitioning algorithm to eliminate intersections; S47. Display a repair icon or text prompt next to the problem area in the XR user interface. Users can click to trigger automatic repair or enter manual repair mode.

6. The XR-based immersive 3D modeling and direct-to-line 3D printing method according to claim 1, characterized in that, Step S5 includes: S51. Based on the geometric features of the three-dimensional model and the overhang detection results, determine the area that needs to be supported; S52. Select the support structure type according to the generation method, including tree support and linear grid support; S53. Select the support material type according to the material properties, including supports made of the same material as the model or supports made of soluble materials; S54. Automatically generate a support structure below the defined overhang area and bind the support structure to the 3D model; S55. Visualize the support structure in the XR user interface, allowing users to view the support location, quantity, and shape; S56. Provides interactive editing functions, allowing users to move, scale, add, delete, and adjust the shape of the support structure in the XR user interface; S57. Output the final confirmed support structure and 3D model to the slicing function module.

7. The XR-based immersive 3D modeling and direct-to-line 3D printing method according to claim 1, characterized in that, Step S6 includes: S61. The user completes the preparation and parameter settings in the XR user interface, including importing the three-dimensional model file, performing model movement, rotation, scaling and copying operations, and configuring printing parameters, including layer height, infill density, support settings, temperature and speed. S62. When the user issues a slicing command in the XR user interface, the system automatically collects the three-dimensional model data, user setting parameters and printer configuration information in the XR environment, and converts them into command line parameters and configuration files or application programming interfaces and transmits them to the slicing engine. S63, the slicing function module performs model loading and verification, printer parameter application, layer slicing, path planning and printer control command insertion, and generates a print instruction file; The model loading and verification includes reading the 3D model file and verifying it according to the support structure; The printer parameters are applied to the printer definition file and user settings to establish a print task context; The layered slicing involves slicing the three-dimensional model into layers along the Z-axis to generate closed two-dimensional polygon contour data for each layer. The path planning involves planning the movement path and extrusion amount of the print head in the closed two-dimensional polygonal contour data of each layer, including generating the outer wall, inner wall, filling, support and attachment structure paths, and calculating the required extrusion amount; The printer control commands include temperature control, fan control, and pause control; The motion path and printer control commands are translated according to the G-code syntax specification to generate a print instruction file containing start and end codes; S64. Users do not need to export files or manually convert them in the XR user interface; the print instruction file is directly output to the print management module. S65. The print management module establishes a wired or wireless connection with the target 3D printer, automatically sends the print instruction file to the printer, and starts the print task. The S66 and XR user interfaces display real-time printing status information during the printing process, including a task progress bar and estimated completion time.

8. The XR-based immersive 3D modeling and direct-to-line 3D printing method according to claim 1, characterized in that, Step S7 includes: S71, Receive the print instruction file generated by the slicing function module; S72. The print management module establishes a wired or wireless connection with the target 3D printer, automatically sends the print instruction file to the printer, and starts the print task. S73. Real-time monitoring of the 3D printer's operating status, including printing progress, temperature, nozzle movement, and material consumption information; S74. When an abnormal state is detected, generate alarm information and display it in the XR user interface; S75. The status information during the printing process is displayed in real time to the XR user interface in a visual form, including the task progress bar and the estimated completion time. S76. After the printing task is completed, perform task completion processing and store the task results in the data management module.

9. The XR-based immersive 3D modeling and direct-to-line 3D printing method according to claim 1, characterized in that, Step S8 includes: S81. Receive and store 3D model files, including STL format files, 3MF format files, and other 3D model files imported by the user; S82. Receive and store user parameter settings, including modeling parameters, printing parameters, and interface configuration parameters; S83. Receive and store print configuration files, including printer definition files, material configuration files, and slice parameter files; S84. Receive and store environmental map data, including depth images, RGB images and spatial anchor point information acquired through XR devices; S85 provides a 3D model file calling interface to the immersive modeling engine, supporting the loading, modification and saving of models; S86 provides an interface for calling print parameters and configuration files to the print preprocessing engine, supporting printability analysis and slice task execution; S87. Provides an interface for calling environmental map data to the MR fusion engine, supporting spatial alignment and fusion of the model and the physical environment; S88 provides a historical data retrieval interface to the XR user interface, supporting users to load and reuse stored models, parameters, and configurations.

10. An XR-based immersive 3D modeling and direct-through 3D printing system, comprising the XR-based immersive 3D modeling and direct-through 3D printing method according to any one of claims 1 to 9, characterized in that, include: The XR interaction engine is used to collect user input, render virtual scenes, and output interaction commands. An immersive modeling engine used to perform geometric operations in 3D space and generate 3D models; The MR fusion engine is used to perform spatial anchoring, environment understanding and virtual-real occlusion processing, and superimposes the 3D model onto the real physical environment at a 1:1 scale to achieve virtual-real fusion display. The print preprocessing engine includes a printability analysis module, an intelligent support generation module, and a slicing function module; The printability analysis module is used to detect the 3D model, highlight the problem areas in the XR environment, guide the user to make modifications, and provide automatic repair suggestions. The intelligent support generation module is used to automatically generate support structures based on the geometric features and printing parameters of the 3D model, and provide visual preview and editing in the XR user interface; The slicing function module is used to integrate or encapsulate slicing software, slice the three-dimensional model and plan the path, and generate a printing instruction file that conforms to the 3D printer instruction format. The print management module is used to establish a communication connection with the 3D printer and perform tasks such as printing task distribution, print queue management, and print status monitoring. The data management module is used to store 3D model files, user parameter settings, print configuration files and environmental map data, and provides calling interfaces to various modules; An XR user interface is used to present menus, tooltips, action panels, and status displays in an XR environment, and to receive user input.

Images