Closed-Loop Reinforcement Control for Consistent Additive Deposition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Additive manufacturing faces challenges in achieving consistent print quality due to unstable non-homogeneous printing materials, with existing methods relying on expensive trial-and-error experimentation and struggling to adapt to material inconsistencies and long-time horizon assessments.

Innovation Solution

A self-correcting closed-loop control policy using machine reinforcement learning that dynamically adjusts manufacturing process parameters based on real-time sensor feedback from cameras and other sensors, allowing for immediate adaptation to material changes and inconsistencies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional trial-and-error experimentation is used to optimize manufacturing parameters, then manufacturing precision can be improved, but loss of time and productivity deteriorate significantly

Engineering Contradiction:
Improveprint quality consistencyVSAvoidoptimization time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system implements a closed-loop control mechanism where sensors continuously monitor deposition quality and provide real-time feedback to the reinforcement learning controller. This feedback loop enables the system to automatically adjust manufacturing parameters based on observed deviations, eliminating the need for time-consuming trial-and-error experimentation while maintaining high print quality consistency.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The reinforcement learning controller enables the manufacturing system to self-correct deviations in deposition quality autonomously. The system learns optimal control policies through simulation and then automatically applies them in real manufacturing operations, allowing the system to self-adjust parameters without external intervention or repeated experimentation, thus dramatically reducing optimization time.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If fixed manufacturing parameters are used, then device complexity is reduced, but adaptability to material inconsistencies deteriorates

Engineering Contradiction:
Improveadaptation to material variationsVSAvoidcontrol system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The control system transitions from static fixed parameters to dynamic adaptive parameters. The reinforcement learning controller continuously adjusts manufacturing parameters based on real-time sensor feedback and learned policies, enabling the system to adapt to material inconsistencies and variations. This dynamic approach enhances adaptability while the underlying learned policies maintain manageable system complexity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs parameter changes as a core mechanism for adaptation. The reinforcement learning controller modifies manufacturing parameters such as deposition rate, head speed, and temperature based on observed material variations and deposition quality. This parameter adaptation enables the system to handle non-homogeneous materials effectively while the learned policies structure these changes to avoid excessive complexity.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If real-time sensor feedback and dynamic parameter adjustment are implemented, then manufacturing precision improves, but device complexity increases

Engineering Contradiction:
Improvedeposition consistencyVSAvoidcontrol system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The closed-loop feedback system uses sensors to monitor deposition quality in real-time and feeds this information back to the reinforcement learning controller. The controller processes this feedback and adjusts parameters accordingly, achieving high deposition consistency. The feedback mechanism is structured through learned policies that translate sensor data into controlled parameter adjustments, managing complexity through intelligent automation rather than manual control loops.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system replaces traditional mechanical control approaches with machine learning-based control. Instead of complex mechanical adjustment mechanisms or rule-based control systems, the patent uses a reinforcement learning controller that processes sensor feedback and determines parameter adjustments algorithmically. This substitution reduces the need for complex mechanical control hardware while achieving superior deposition consistency through intelligent software control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20240345548A1Learning closed-loop control policies for manufacturing
Publication Date: 2024.10.17 MASSACHUSETTS INST OF TECH
  • US20240345548A1 patent drawing
  • US20240345548A1 patent drawing
  • US20240345548A1 patent drawing

AI summary

A manufacturing system and method involves learning a self-correcting closed-loop control policy through machine reinforcement learning for a manufacturing process that involves on-the-fly adjustment of process parameters to handle inconsistencies in the manufacturing process and material formulations, and controlling operation of a tool configured to interact with or produce a product including dynamically adjusting at least one parameter of the manufacturing process to thereby dynamically adjust operation of the tool based on qualitative performance information derived from at least one sensor applied as feedback to the closed-loop control policy learned through machine reinforcement learning.