Reinforcement Learning Controller for Cosmetic Dispensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing cosmetic dispensing machines face challenges in precisely controlling the weight of cosmetic products due to reliance on volume-based dispensing systems, which are influenced by product density and viscosity, requiring frequent calibration and maintenance, and are not adaptable to variations in environmental conditions or product changes.

Innovation Solution

Implementing a reinforcement-learning controller that uses a strategy to optimize the dispensing of cosmetic products by adjusting control signals based on real-time weighing data and error feedback, allowing the system to adapt to changes in products and environmental conditions without prior calibration, using algorithms like Gaussian process regression or deep reinforcement learning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If volume-based dispensing systems (piston, pump) are used to dispense cosmetic products, then the dispensing speed and productivity are improved, but the manufacturing precision (weight control) deteriorates due to influence from product density and viscosity variations

Engineering Contradiction:
Improvedispensing speedVSAvoidweight control precision
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent implements a feedback control system using a weighing cell that continuously measures the weight of cosmetic product dispensed into the receptacle. The controller compares the measured weight with the target weight and adjusts the piston movement or pump operation in real-time to compensate for variations in product density and viscosity, thereby maintaining precise weight control while preserving dispensing speed.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces pure mechanical volume-based dispensing control with an integrated measurement and control system. Instead of relying solely on mechanical piston displacement or pump volume metrics, the system substitutes mechanical control with a hybrid approach that incorporates electronic weighing and adaptive control algorithms to determine the actual weight of dispensed product, overcoming the limitations of mechanical systems when product properties vary.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If electromechanical systems with controlled metering-pump or metering-piston are used, then the adaptability to different products is improved, but the device complexity increases due to need for calibration and coordination of multiple components

Engineering Contradiction:
Improveadaptability to product variationsVSAvoidsystem calibration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a self-calibrating system where the controller automatically adjusts the dispensing parameters based on real-time weight measurements from the weighing cell. The system performs self-calibration by comparing target weights with actual dispensed weights and automatically adjusting piston movement distances or pump operation parameters, eliminating the need for manual calibration and reducing system complexity despite the presence of multiple electromechanical components.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If calibration is performed frequently to maintain dispensing precision, then the manufacturing precision is improved, but the loss of time and productivity deteriorate

Engineering Contradiction:
Improvedispensing precisionVSAvoidcalibration time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements continuous weight monitoring during the dispensing process using the weighing cell, eliminating the need for periodic calibration interruptions. The system continuously measures the weight of dispensed product and adjusts parameters in real-time, maintaining continuous useful action without stopping for calibration, thereby preserving both precision and productivity.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentEP4111145B1Machine for dispensing a controlled amount of a cosmetic composition
Publication Date: 2024.12.11 LOREAL SA
  • EP4111145B1 patent drawingFigure 1~2
  • EP4111145B1 patent drawingFigure 3~4
  • EP4111145B1 patent drawingFigure 5~6

AI summary

The present application relates to a device for dispensing a determined weight of a cosmetic product into a receptacle from a reservoir, the device comprising at least one electromechanical member capable of moving an amount of cosmetic product from said reservoir installed in the device to a dispensing zone of said device where said amount of product may be transferred through a nozzle into the interior of the receptacle received in said dispensing zone, the device comprising a controller configured to deliver a control signal to the electromechanical member according to an error with respect to a setpoint corresponding to the determined weight of cosmetic product to be delivered, said error being determined on the basis of a weighing datum obtained by at least one weighing cell for the reservoir installed in the receiving zone, the device being characterized in that the controller is a reinforcement-learning controller.