AR 3D Print Mapping for Real-Time Gesture-Based Alterations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D printing methods do not allow users to modify objects during the printing process using body movements, leading to inefficiencies, material waste, and difficulty in translating user intentions into numerical changes.
Innovation Solution
A system combining augmented reality (AR) and IoT devices to track user appendage movements, allowing real-time modification of 3D printed objects by mapping user gestures to the object's CAD model and communicating these changes to the 3D printer for implementation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 3D printing is performed without real-time modification capability, then the printing process is simple and stable, but the user cannot modify the object during printing leading to material waste and reprints
Solution Approach 1:
The system transitions from a static 3D printing process to a dynamic one by enabling real-time modification of the CAD model during printing. The AR device displays the 3D model and allows users to manipulate it dynamically, with changes immediately reflected in the printing process through continuous communication between the computing device and 3D printer.
Solution Approach 2:
The system implements feedback by continuously monitoring the printing progress and allowing users to view and modify the 3D model in real-time through the AR device. The system detects which portions have been printed and enables modifications to unprinted portions, creating a closed-loop control system that prevents material waste by allowing corrections before completion.
2Ease of operation
If users must use numerical inputs to modify 3D objects, then the modification process is precise, but it is difficult for users to translate their intentions into accurate numerical changes
Solution Approach 1:
The system replaces traditional numerical input methods with gesture-based control. Users can manipulate the 3D model directly through physical gestures captured by the AR device, eliminating the need to translate intentions into numerical values. The system automatically converts gesture movements into precise geometric modifications of the CAD model.
Solution Approach 2:
The system creates a virtual copy of the 3D model in the AR environment that users can manipulate. This virtual representation allows users to interact with the object intuitively through gestures, and the system automatically translates these interactions into precise modifications of the actual CAD model, maintaining manufacturing precision while improving ease of operation.
3Adaptability or versatility
If 3D printing allows real-time modifications, then user experience and flexibility improve, but the system complexity increases due to AR integration and real-time processing
Solution Approach 1:
The computing device performs multiple functions: it controls the 3D printer, processes AR graphics, tracks printing progress, and handles gesture recognition. By consolidating these functions into a single multi-functional system, the patent reduces the need for separate specialized devices, thereby managing system complexity while enabling real-time modifications.
Solution Approach 2:
The system merges the CAD modeling environment, 3D printing control, and AR visualization into an integrated workflow. The AR device combines multiple technologies (gesture recognition, 3D rendering, real-time communication) into a unified interface that simplifies user interaction while maintaining the complex backend processes necessary for real-time modification capability.
Data Source
AI summary
According to one embodiment, a method, computer system, and computer program product for modifying an object being 3D printed using augmented reality is provided. The present invention may include analyzing shape, dimensions, and/or axis of the object being 3D printed; mapping at least one part of one or more of a user's appendages to at least one portion of the object being 3D printed; tracking movements of the at least one mapped part of the one or more of the user's appendages; and modifying the at least one portion of the object being 3D printed based on the tracked movements of the at least one part of the one or more of the user's appendages.