REMOTE BEAUTY CONSULTATION SYSTEM

Abstract

REMOTE BEAUTY CONSULTATION SYSTEM A system is provided that includes a consultation device; a user device; and a dispensing device. The consultation device and the user device are configured to conduct a communication session with each other that includes the transmission, from the user device to the consultation device, of information that includes a desired cosmetic product and information relating to a user of the user device; the analysis, by the consultation device, of the information received from the user device; and the generation and transmission of a recommended cosmetic formula to the user device. The user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product. Figure for the abstract: none.

Description

Title of the invention: REMOTE BEAUTY CONSULTATION SYSTEM CONTEXT

[0001] Domain

[0002] The present disclosure generally relates to a system, apparatus, and method for determining a combination of cosmetic materials that can be mixed and dispensed for a particular user. SUMMARY

[0003] In one embodiment, a system is provided that includes an advisory device; a user device; and a dispensing device, wherein the advisory device and the user device are configured to perform a communication session with each other that includes: transmitting, from the user device to the advisory device, information that includes a desired cosmetic product and information relating to a user of the user device; analyzing, by the advisory device, the information received from the user device; and generating and transmitting a recommended cosmetic formula to the user device, and wherein the user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product.

[0004] In one embodiment, the dispensing device includes a plurality of cartridges that each contain a cosmetic material and the dispensing device is configured to dispense a specified amount of the cosmetic material from the plurality of cartridges into a receiving area, and the recommended cosmetic formula is generated based on the cosmetic material in each of the cartridges in the dispensing device.

[0005] In one embodiment, the communication session is a video conference between the user and a beauty advisor who operates the advisory device.

[0006] In one embodiment, the user-related information is at least one of diagnostic data, biological data, environmental data, and social media activity data relating to the user.

[0007] In one embodiment, the diagnostic data is image data of the user captured by a camera of the user device.

[0008] In one embodiment, the advisory device or the user device is configured to convert the user's image data into data three-dimensional and perform a surface analysis of a part of the user's body based on the three-dimensional data.

[0009] In one embodiment, the advisory device is configured to determine target regions of the user's body part to be treated with the desired cosmetic product based on the surface analysis, and to generate the recommended cosmetic formula based on the determined target regions.

[0010] In one embodiment, the desired cosmetic product is one of a skin care product, a hair care product, and a nail coloring product.

[0011] In one embodiment, a method is provided that is implemented by a system that includes an advisory device; a user device; and a dispensing device, wherein the advisory device and the user device are configured to perform a communication session with each other, the method comprising: transmitting, from the user device to the advisory device, information that includes a desired cosmetic product and information relating to a user of the user device; analyzing, by the advisory device, the information received from the user device; and generating and transmitting a recommended cosmetic formula to the user device, and wherein the user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product. Brief description of the drawings

[0012] The patent or application file contains at least one drawing executed in color. A more complete appreciation of the disclosure and many of the associated advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings in which:

[0013] [Fig-1] [Fig.l] is a global perspective view of a dispensing device of a cosmetic product, or of a distributor of a cosmetic product, according to one example;

[0014] [Fig.2] [Fig.2] is a perspective view of a distributor body, according to a example ;

[0015] [Fig.3] [Fig.3] is a perspective view of the cosmetic product dispenser with the distributor body removed, according to one example;

[0016] [Fig.4A] [Fig.4A] is a perspective view of internal components of the cosmetic product dispenser, according to one example;

[0017] [Fig.4B] [Fig.4B] is a perspective view of internal components of the cosmetic product dispenser, according to one example;

[0018] [Fig.5] [Fig.5] is a perspective view of a cartridge, according to an example;

[0019] [Fig.6] [Fig.6] is a perspective view of a cartridge gear wheel, according to an example;

[0020] [Fig.7A] [Fig.7A] is a perspective view of a bottom plate, according to an example;

[0021] [Fig.7B] [Fig.7B] is a perspective view of the bottom plate, seen from below, according to one example;

[0022] [Fig.8] [Fig.8] is a perspective view of a base, according to an example;

[0023] [Fig.9A] [Fig.9A] is an exploded perspective view of a housing, arranged above a collector, according to one example;

[0024] [Fig.9B] [Fig.9B] is a perspective view of the housing in an open position, according to one example;

[0025] [Fig. 10] [Fig. 10] is a diagram showing an exemplary primary process sequence of a cosmetic formulation method 900, according to one example;

[0026] [Fig 111] [Fig. 11] is a process diagram showing an example of a method for detecting cosmetic material in the cosmetic product dispenser, according to an example;

[0027] [Fig.l2A] [Fig.l2B] [Fig.l2A] and 12B are process diagrams representing examples of a method for selecting a cosmetic formulation, according to one example;

[0028] [Fig. 13] [Fig. 13] is a process diagram showing an example of a method of dispensing cosmetic material in the cosmetic product dispenser, according to an example

[0029] [Fig. 14] [Fig. 14] is a diagram showing an example of a connected cosmetic product dispensing system, according to an example; and

[0030] [Fig. 15] [Fig. 15] is a diagram showing an exemplary circuitry of the controller and the cosmetic dispenser, according to an example.

[0031] [Fig. 16] [Fig. 16] shows components of an eco-system that uses the cosmetic dispenser to prepare personalized doses for a user.

[0032] [Fig. 17] [Fig. 17] shows an ecosystem that is based on proposing a trendy lipstick color to a user.

[0033] [Fig.l8A] [Fig.l8A] shows an example of an operation flow in the ecosystem for distributing a personalized shade of lipstick from the perspective of the app.

[0034] [Fig.l8B] [Fig.l8B] shows an additional flowchart of how the smartphone app algorithms in the lipstick ecosystem may allow a user to see a lipstick shade in the user's selfie.

[0035] [Fig.l8C] [Fig.l8C] further illustrates how the specific set of cartridges can result in different shade universes to be presented to the user.

[0036] [Fig.l8D] [Fig.l8D] shows how a “match my look” mode can operate on the app in the lipstick ecosystem.

[0037] [Fig.l8E] [Fig.l8E] shows details of how the lipstick recommendation engine works based on the user's outfit selfie.

[0038] [Fig. 19] [Fig. 19] shows an ecosystem that is based on the proposition of a skin care formulation to the user that is most effective for the user.

[0039] [Fig.20A] [Fig.20A] shows an example of the flow of operations in the ecosystem to distribute a personalized skincare formulation from an app perspective.

[0040] [Fig.20B] [Fig.20B] shows an example of how a combination different environmental factors determined to be present for a user may lead to different dosage amounts from three different cartridges.

[0041] [Fig.21] [Fig.21] shows an eco-system that is used to distribute a fund of custom complexion for a user.

[0042] [Fig.22A] [Fig.22A] shows an example of the flow of operations in the ecosystem to distribute a personalized foundation from the app perspective.

[0043] [Fig.22B] [Fig.22B] provides details of a method of making a complexion diagnosis.

[0044] [Fig.22C] [Fig.22D] [Fig.22C] and 22D show details concerning the how deep learning is used to estimate skin tone in an image.

[0045] [Fig.23] [Fig.23] shows a structure of a cartridge which carries a label NFC.

[0046] [Fig.24] [Fig.24] shows a data format of the data stored on the NFC tag on the cartridge.

[0047] [Fig.25] [Fig.25] shows a table that includes descriptions of the various fields contained in the NFC tag data format.

[0048] [Fig.26] [Fig.26] shows a structure of the distribution device which is equipped for an intelligent system of interchangeable cartridges.

[0049] [Fig.27] [Fig.27] shows the establishment of a connection between the device of distribution and a user smartphone device.

[0050] [Fig.28] [Fig.28] shows a consumer app state machine that shows a process from the perspective of the cartridge priming app before any use of the dispensing device.

[0051] [Fig.29] [Fig.29] shows a method of managing an NFC tag of defective cartridge in the above mentioned scenario.

[0052] [Fig.30] [Fig.30] shows a side view of a dispensing device which includes a retractable plate.

[0053] [Fig.31 A] [Fig.31B] [Fig.31 A] and 31B show different states of the plate retractable when at different heights.

[0054] [Fig.32] [Fig.32] shows a cleaning formula reservoir arranged between the body of the dispensing device and the retractable plate.

[0055] [Fig.33] [Fig.33] shows another use of the retractable plate described above- above to provide a method of rinsing the cartridges to remove any remaining ingredients or residue.

[0056] [Fig.34A] [Fig.34B] [Fig.34C] [Fig.34A], 34B and 34C show a system smart custom compartmentalized for use with the distribution system.

[0057] [Fig.34D] [Fig.34E] [Fig.34D] and 34E illustrate mechanisms to enable detecting a tray and compartment position to be sent to a user's mobile device.

[0058] [Fig.35A] [Fig.35B] [Fig.35A] and 35B show a method for the user to provide a final personalized beauty supplement to any of the compartments in the disclosed tray.

[0059] [Fig.36] [Fig.36] shows a system that allows a user to send a distribution formula to the distribution device described based on the results of a digital beauty consultation with a beauty advisor (BA).

[0060] [Fig.37] [Fig.37] shows a flow of operations in a consultation session of beauty between the consumer and the CB.

[0061] [Fig.38] [Fig.38] shows an example of all data types of consumer that may be collected during the consultation session.

[0062] [Fig.39] [Fig.39] shows a different example of a consultation session, where the consumer is interested in a hair care product.

[0063] [Fig.40] [Fig.40] shows another example of a consultation session, where the consumer is interested in a nail gel product to be dispensed from a dispensing device.

[0064] [Fig.41] [Fig.41] shows an example of the types of device settings of distribution which can be determined during the remote consultation illustrated in [Fig.37], 39 and 40. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0065] In the drawings, like reference numerals designate identical or corresponding parts in the plurality of views. Furthermore, as used herein, the words "a," "an," and the like generally have the meaning of "one or more," unless otherwise indicated.

[0066] Referring now to the drawings, like reference numerals designate identical or corresponding parts in the several views.

[0067] The selection of cosmetic formulations, and of constituent cosmetic materials for formulating cosmetic formulations, is a common activity often relying on subjective decision-making and manual intervention. There is a wide variety of cosmetic materials available, and countless combinations and permutations of possible cosmetic formulations.

[0068] On each occasion where cosmetic formulations are used, subjective decisions are often made by an end user of cosmetic products to produce satisfactory cosmetic formulations. The results are generally the result of experimentation, perhaps requiring multiple iterations to produce a satisfactory result. Due in part to limited knowledge of specific traits of the base cosmetic materials and the necessary proportions, the resulting cosmetic formulations may lack precision. Repeatability in producing a specific cosmetic formulation is thus difficult to accomplish. The embodiments below address these problems in the conventional art.

[0069] Specifically, the description below relates to an eco-system for delivering skin care and manufacturing a formula customization system for at-home use that is based on a specialized dispensing device that allows ingredients for a cosmetic product to be instantly blended into a user's preferred end result and then easily transported for portability.

[0070] The system shown below is a first-of-its-kind, AI-powered, 3-in-1 device for personalized at-home skincare, foundation, and liquid lipstick. The device and its corresponding app evaluate users' individual skin and local environment data to create and deliver personalized skincare and cosmetic formulas, on the spot, that are optimized by the increased levels of personalization over time.

[0071] The overall ecosystem features a motorized, artificial intelligence-enabled cartridge system, as described above, that creates customized skincare and cosmetic formulas in four steps. The device creates customized skin serums through the following process: 1. Personal Skin Analysis: The user takes a photo with a smartphone camera and opens an app on the smartphone. The app uses artificial intelligence to analyze the user's overall skin condition, assessing deep wrinkles, fine lines, blackheads, lack of firmness, pore visibility, and dullness. 2. Environmental Assessment: The app (and / or a separate cloud platform) assesses local environmental conditions that may influence the user's skin condition, including weather, temperature, humidity, UV index, air quality, and pollen. 3. Product Preference: The user then enters their specific skincare concerns, such as fine lines, wrinkles, blackheads, rough skin texture, and dullness into the app. 4. Customized Formulation and Dispensing: A customized blend of high-performance skincare is then dispensed in a single calibrated dose at the top of the device.

[0072] The motor system, located at the top of the device, moves and compresses the formula from the cartridges at the base of the machine in an upward motion to the dispensing tray above for clean application.

[0073] With regular use, the AI ​​platform can assess the appearance of a user's skin over time, helping users identify what works and benchmark future formulas. The AI-powered system can optimize the effectiveness of personalized formulas. By regularly taking photos, users allow the intelligent system to recognize the effects of formulas and adjust the dosage of active ingredients accordingly. That said, the user can override the system's recommendations if, for example, they are looking for an additional moisturizer.

[0074] The skin care system contains active ingredients including AHAs, vitamins C and E, hyaluronic acid, ferulic acid, retinol, cucumber, thyme and blackberry.

[0075] The cosmetic product offerings, for foundation and liquid lipstick, will have the ability to incorporate real-time trend information and color matching technology into its personalized product offerings as described below. • By using the lipstick system, consumers will be able to create a liquid lipstick based on their personal skin tone and preferences. The system can match the shade to the user's clothing or accessories, or they can even opt to create a particular color that is trending on social media. The device will feature three cartridges; collectively, these cartridges will have the capacity to create hundreds of shades. • The foundation system described below will contain three cartridges, ranging from light to intense tones. Recognizing that a foundation is never one-size-fits-all, a selection of these color trios can be offered to match the widest variety of shades. Using a shade matching tool, the three cartridges will dispense varying levels of color to create customized shades. The device has the capacity to create hundreds of custom shades. The device will create a single dose of color, but users can easily double or triple the amount with an additional touch control.

[0076] There are three dosage settings for the system described herein. There will be a standard size dose (0.7 grams; roughly the size of a pistachio) that users can double or triple with an additional touch control.

[0077] The device has a detachable housing with a mirror allowing you to take a calibrated dose of product with you.

[0078] From opening the app and taking a photo of a face to dispensing the product, the user experience with the present system takes approximately three minutes.

[0079] [DISTRIBUTION DEVICE]

[0080] [Fig. 1] is an overall perspective view of a cosmetic product dispensing device 100, or a cosmetic product dispenser, according to an example. The visible portion of the cosmetic product dispenser 100 includes a base 102 connected to a power cord 104. The base 102 provides support for the dispenser body 106. A housing 108 is disposed above the dispenser body 106, a switch button 110 may be disposed partially within the dispenser body 106 such that the dispenser body 106 secures the positioning of the switch button 110, and an indicator and light button 122 may be disposed partially within the dispenser body 106 such that the dispenser body 106 secures the positioning of the indicator and light button 122. The indicator and light button 122 may be a mechanical or capacitive touch button.

[0081] [Fig. 2] is a perspective view of the dispenser body 106, according to one example. The dispenser body 106 is a hollow, thin-walled container that serves as a cover for a large portion of the components of the cosmetic product dispenser 100. In this example, the dispenser body 106 has a first end at the top having a cross-section approximately square with rounded corners, while a second end at the bottom has a circular cross-section. The dispenser body 106 may provide a base for the housing 108, or other components that serve as a base for the housing 108. The dispenser body 106 may also include a mounting point for the switch button 110 and a mounting point for the indicator light and button 122.

[0082] [Fig. 3] is a perspective view of the cosmetic product dispenser 100 with the dispenser body 106 removed, according to one example. The switch button 110, the indicator and light button 122, a controller 150, a bottom plate 166, an inductive plate 176, and a gear housing 170 are visible in this view, as are a lower body section 154, a middle body section 155, and an upper body section 156. The switch button 110 is electrically connected to the controller 150.

[0083] The controller 150 includes circuitry for distributing power received via the power cord 104, controlling one or more motors 112 to dispense cosmetic material, detecting readings from an optical encoder 192, charging one or more batteries 126, operating any indicators such as the lighted indicator and button 122, buzzers or other audio-visual signals, sensors such as for detecting the availability status, type and quantity of cosmetic material, and communicating wirelessly with external devices, including circuitry for sending and receiving signals and data, for example via smartphones and other wireless devices, using a variety of communication protocols, such as radio frequency (RF), Bluetooth, Wi-Fi or cellular.

[0084] The inductive plate 176 carries the bottom plate 166, apart from the base 102 and the power cord 104, the remainder of the cosmetic dispenser 100 is disposed above the bottom plate 166. The gear housing 170 is disposed above the internal components of the cosmetic dispenser 100 which are described in more detail by FIG. 4 to [Fig.9B], is connected to them, and provides support therefor. Further, the gear housing 170 includes a plurality of gear housing cartridge holes 178, one for each cartridge 114 in the cosmetic dispenser 100. A nozzle 160 of each cartridge 114 is disposed within one of the gear housing cartridge holes 178. Various additional substructures and covers may be disposed between the internal components of the cosmetic dispenser 100 and the dispenser body 106.

[0085] For example, the upper body section 156 is disposed above the middle body section 155, and the lower body section 154 is disposed below the middle body section 155. When connected, the distributor body 106 attaches to the exterior of at least one of the lower body section 154, the middle body section 155, and the upper body section 156. The bottom plate 166 is disposed below and connected to the lower body section 154.

[0086] [Fig.4A] and [Fig.4B] are perspective views of internal components of the cosmetic product dispenser 100, according to one example. The internal assembly includes a plurality of dispensing assemblies 120, disposed above the bottom plate 166 and the inductive plate 176. Each dispensing assembly 120 includes a cartridge 114, a cartridge gear 116, a motor 112, a motor gear 124, an ejector 140, an ejector split ring 190, an ejector spring 142, an ejector spring pin 144, a detent plunger 146, and a detent spring 152. The controller 150 controls the operation of each of the dispensing assemblies 120. The cosmetic product dispenser 100 includes at least one dispensing assembly 120.The examples described herein contain three dispensing assemblies 120, although those skilled in the art will recognize that a cosmetic product dispenser 100 may have any number of dispensing assemblies 120.

[0087] Further, a plurality of batteries 126 within the cosmetic dispenser 100 are electrically connected to the plurality of dispensing assemblies 120 to provide electrical power for operation of the controller 150, the dispensing assembly 120, the motor 112, and various indicators, such as the indicator light and button 122 (described in more detail in [Fig. 3]), buzzers, and other audiovisual signals.

[0088] The controller 150 and a connected device 300 (shown in [Fig. 14]) enable a user to operate the cosmetic product dispenser 100 wirelessly. Cosmetic material formulation and recipe commands to the controller 150 may be received from the connected device 300, such as a smartphone, tablet, or personal computer, configured to communicate with the cosmetic product dispenser 100. In addition, cosmetic material dispensing may also be triggered by the user by touching the indicator light and button 122 on the cosmetic product dispenser 100.

[0089] The cartridge 114 also has a cartridge spigot 162 disposed on or near the nozzle 160, is connected near a first end to the cartridge gear 116, is connected near a second end to the bottom plate 166, with a motor gear 124 connected to the motor 112, and the motor gear 124 drivingly connected to the cartridge gear 116. The cartridge 114 and the cartridge gear 116 are held in position by the gear housing 170 (shown in [Fig. 3]). The cartridge 114 may be disposed within the cosmetic dispenser 100, and held in place by the ejector 140 connected to an ejector spring 142, the ejector spring pin 144 connected at a first end to the ejector spring 142 and rigidly connected at a second end to an interior surface of at least one of the dispenser body 106, the lower body section 154, the middle body section 155, the upper body section 156, and another internal structure. The dispensing assembly 120 further includes an ejector split ring 190 (shown in [Fig.4A]) to guide the movement of the ejector 140 within the cosmetic dispenser 100 during insertion and removal of the cartridge 114, with the ejector split ring 190 disposed against the interior surface of at least one of the dispenser body 106, the lower body section 154, the middle body section 155 and the upper body section 156 to provide a guide for the movement of the ejector 140.

[0090] Additionally, a detent plunger 146 may be disposed substantially perpendicular to a longitudinal axis of the cartridge 114 and connected near the second end of the cartridge 114, providing lateral pressure to a circumferential groove 134 of the cartridge 114, holding the cartridge 114 in place along the vertical Y-axis, countering an opposing force applied by tension on the cartridge 114 by the ejector 140, the ejector spring 142, and an ejector spring pin 144. The ejector 140 is disposed within the cosmetic dispenser 100 and is movable substantially parallel to the cartridge 114, and is connected to the ejector spring 142 which is further connected to the ejector spring pin 144. As the cartridge 114 is inserted into the cosmetic dispenser 100, an edge of the ejector 140 contacts an edge near the first end of the cartridge 114.The ejector 140 applies pressure to the cartridge 114 while the ejector spring 142 stretches with increasing distance between the stationary ejector spring pin 144 and the ejector 140, while the ejector 140 moves with the cartridge 114 further into the cosmetic dispenser 100. Once the cartridge 114 is inserted to the point that a first end of the detent plunger 146 contacts the circumferential groove 134 of the cartridge 114, movement of the cartridge 114 along the Y-axis is restricted, holding the cartridge 114 in place.

[0091] The trigger plunger 146 is a mechanism for holding the cartridge 114 in place. The trigger plunger 146 moves along an axis substantially perpendicular to that of the major axis of the cartridge 114. A first end of the trigger plunger 146 is disposed to contact the cartridge 114. A second end is connected to a first end of a trigger spring 152, the second end of the trigger spring 152 contacting an interior surface of at least one of the dispenser body 106, the lower body section 154, the middle body section 155, the upper body section 156, or another internal structure. Insertion of the cartridge 114 into the cosmetic product dispenser 100 moves the detent plunger 146 against the detent spring 152, compressing the detent spring 152. Since the contour of the cartridge 114 varies along the length of the cartridge 114, the detent plunger 146, and the detent spring 152 are moved by varying amounts depending on the position of the cartridge 114 relative to the cosmetic product dispenser 100.At a time when the trigger plunger 146 contacts the circumferential groove 134 of the cartridge 114, the first end of the trigger plunger 146 is adapted to lock the cartridge 114 in place due to pressure from the trigger spring 152 and the geometric relationship between the trigger plunger 146 and the circumferential groove 134.

[0092] Further, the cartridge 114 is inserted into the cosmetic dispenser 100 through a cartridge through-hole 172 of the bottom plate 166. The cartridge through-hole 172 has a base lug cutout 165 ([Fig.7A]) formed to mate with the base lug 164 such that while the base lug 164 and the base lug cutout 165 contact each other, the cartridge 114 cannot rotate relative to the bottom plate 166. The cartridge 114 is also formed to fit within the bottom plate 166 and the cartridge sprocket 116 in a specific orientation. In the position where the cartridge 114 is fully inserted into the cosmetic dispenser 100 and locked in place by the trigger plunger 146, the cartridge 114 is seated against the cartridge gear 116.Additionally, the cartridge gear 116 has a collar portion 168 that is rotatably connected to the gear housing 170, restricting the movement of the cartridge gear 116 such that the cartridge gear 116 may rotate about a longitudinal axis but may not move axially or otherwise, and supporting the position of each of the cartridge gears 116 and the motor gears 124.Likewise, the motor gear 124 has a motor gear collar portion 169 that is rotatably connected to the gear housing 170, restricting the movement of the motor gear 124 such that the motor gear 124 may rotate about a longitudinal axis but may not move axially or otherwise, preserving the relationship between the cartridge gear 116 and the motor gear 124 such that rotational movement of the motor gear 124 results in rotational movement of the cartridge gear 116 at a fixed ratio.

[0093] The motor gear 124 may be a spur gear that includes a spigot cutout 163 ([Fig.6]) that fits the cartridge spigot 162 of the cartridge 114, as depicted by [Fig.4B].

[0094] [Fig. 5] is a perspective view of the cartridge 114, according to one example. The cartridge 114 has a round cylindrical body and a nozzle 160 at a first end. The nozzle 160 is further disposed near a cartridge spigot 162. The cartridge spigot 162 fits within the opening of the cartridge gear 116, matches the shape of the spigot cutout 163 of the cartridge gear 116, and interlocks the rotational movement of the portion near a first end of the cartridge 114 with that of the cartridge gear 116. While the cartridge gear 116 is driven by the motor gear 124 and the motor 112. A second end of the cartridge 114 includes a base spigot 164.The base lug 164 fits within the base lug cutout 165 of the bottom plate 166, secures the second end of the cartridge 114 to the bottom plate 166, and prevents rotational movement of the second end of the cartridge 114 relative to the bottom plate 166. Since the first end of the cartridge 114 is subject to movement of the cartridge gear 116, actuation of the motor 112 rotates the motor gear 124 and drives the cartridge gear 116, thereby opening and closing the nozzle 160 of the cartridge 114. The first and second ends of the cartridge 114 are rotatable relative to each other.

[0095] The cartridge 114 contains and dispenses a quantity of cosmetic material into the housing 108 as needed (described in more detail in FIG. 9). The cartridge 114 dispenses cosmetic material by rotation of the cartridge gear 116 while the cartridge 114 remains in place substantially vertically along the Y axis. The cartridge gear 116 is driven by the motor gear 124 which is rotated by the rotation of the motor 112. The amount of rotation of the motor 112 is controlled by the controller 150.

[0096] A quantity of cosmetic material is released from the cartridge 114 through the nozzle 160 by a first rotational movement of the first end relative to the second end of the cartridge 114. The rotational movement of the first end of the cartridge 114 in a second direction, opposite to the first rotational movement, may close the nozzle 160 of the cartridge 114.

[0097] The cartridge gear 116 actuates the nozzle 160 of the cartridge 114 which is attached to a hollow cartridge lead screw 202 within the cartridge 114. Rotation of the cartridge lead screw 202 proportionally moves a cartridge piston 200 which forces a quantity of cosmetic material through the cartridge lead screw 202 and out of the nozzle 160 of the cartridge 114. The quantity of cosmetic material released during an opening and closing operation of the nozzle 160 is a function of the displacement of the cartridge lead screw 202, which is dependent on the rotational displacement of the cartridge gear 116. Rotation of the motor 112 rotates the respective motor gear 124 and the cartridge gear 116. The controller 150 detects the relative movement of the cartridge gear 116 by using the optical encoder 192 to count a number of cartridge gear slots 148 that pass the optical encoder 192 while the cartridge gear 116 rotates, and the rotation direction of the cartridge gear 116. A specific unit of measurement of the cosmetic material is a dose unit 118.

[0098] In one example, the pitch of the cartridge lead screw 202 is about 1 mm, with one full rotation of the cartridge lead screw 202 dispensing about 1 ml of cosmetic material from the cartridge 114.

[0099] In another example, due to the shape of the cartridge lug 162 of the cartridge 114, the circumferential groove 134 may be a notch or groove around a portion of the circumference of the cartridge 114, rather than extending entirely around the perimeter of the cartridge 114 to secure the cartridge 114 to the trigger plunger 146 in substantially the same manner.

[0100] [Fig. 6] is a perspective view of the cartridge gear 116, according to one example. The cartridge gear 116 may be a spur gear that includes a lug cutout 163 that matches the shape of the cartridge lug 162 of the cartridge 114. The cartridge gear 116 may further have a collar 168 that rotatably connects to an interior surface of the gear housing 170 to align and support the position of the cartridge gear 116 and the corresponding motor gear 124. The cartridge gear 116 may have a plurality of cartridge gear slots 148 for use with the optical encoder 192 to sense the angular position of the cartridge gear 116 and the cartridge lead screw 202.

[0101] [Fig.7A] is a perspective view of the bottom plate 166, according to one example. The bottom plate 166 is connected to the dispenser body 106 and / or the lower body section 154, restricts the plurality of cartridges 114 disposed within the cosmetic dispenser 100, and connects the cosmetic dispenser 100 to the inductive plate 176 disposed below the bottom plate 166.

[0102] The bottom plate 166 includes a plurality of cartridge through-holes 172 to allow insertion, removal, and securing of the plurality of cartridges 114. Each cartridge through-hole 172 includes a base lug cutout 165, and the shape of the base lug cutout 165 matches the shape of the base lug 164 of each cartridge 114 to prevent rotational movement of the second end of the cartridge 114, the portion in contact with the bottom plate 166, when the cartridge 114 is installed in the cosmetic dispenser 100.

[0103] Further, the bottom plate 166 has contact pins 174 (shown in [Fig.7B]) that contact the inductive plate, providing electricity to the bottom plate 166, allowing the cosmetic dispenser 100 to charge the plurality of batteries 126 by contact or induction.

[0104] [Fig.7B] is a perspective view of the bottom plate 166, viewed from the bottom, according to one example. The bottom plate 166 includes three cartridge through-holes 172 disposed within the plate, and contact pins 174. When the bottom plate 166 is disposed within the cosmetic dispenser and on the base 102, the contact pins 174 can conduct electricity from the base 102 to the bottom plate 166. The bottom plate 166 can then inductively charge the plurality of batteries 126 disposed above the bottom plate 166.

[0105] [Fig. 8] is a perspective view of the base 102, according to one example. A power cord 104 is connected at a first end to the base 102. The power cord 104 is connected at a second end to a power source (not shown), providing power for operation of the cosmetic dispenser 100 and for charging the plurality of batteries 126. The base 102 includes a base indentation 128 for positioning the inductive plate 176 and other portions of the cosmetic dispenser 100. The base indentation 128 may have the ability to inductively charge the plurality of batteries 126 using power provided by the power cord 104.Further, it can also charge the cosmetic dispenser 100 through contact pins 174 disposed within the bottom plate 166 when the bottom plate 166 is disposed within the base indentation 128.

[0106] [Fig. 9A] is an exploded perspective view of the housing 108, disposed above a manifold 130, according to one example. The housing 108 includes an upper cover 180, a housing base 182, and a lower cover 184. The upper cover 180 is disposed above the housing base 182, which is disposed above or within the lower cover 184. The upper cover 180 is secured to the housing base 182 by magnets, as described in more detail by [Fig. 9B]. The housing base 182 includes a plurality of housing base through-holes 138. In this example, there is one housing base through-hole 138 for each cartridge 114 in the cosmetic dispenser 100. The bottom cover 184, having a plurality of bottom cover through-holes 136, is disposed below the housing base 182.In this example there is a bottom cover through hole 136 for each cartridge 114 in the cosmetic dispenser 100, and the bottom cover 184 is arranged such that each bottom cover through hole 136 corresponds to and is connected to a housing base through hole 138 of the housing base 182.

[0107] The housing 108 is connected to the manifold 130, the manifold 130 connected to the gear housing 170 and disposed above it, further disposed within the dispenser body 106 of the cosmetic dispenser 100, and the housing 108 is disposed above both the manifold 130 and the dispenser body 106. The manifold 130 includes a manifold through-hole 132 for each cartridge 114 in the cosmetic dispenser 100, and the manifold 130 is disposed such that each manifold through-hole 132 corresponds to and is connected to a housing base through-hole 136 of the bottom cover 184.Further, each manifold through hole 132 of the manifold 130 corresponds to and is disposed above a gear housing cartridge hole 178 of the gear housing 170, providing a passageway through which a cosmetic material can be dispensed from the nozzle 160 of each cartridge 114 through the manifold 130, the bottom cover 184, and into the housing base 182.

[0108] The housing 108 may be shaped such that there is only one orientation by which the housing 108 can connect to the cosmetic dispenser 100. In another example, the shape of the housing 108 may be able to connect to the housing 108 in more than one orientation.

[0109] Further, cosmetic material dispensed into the housing 108 may be prevented from escaping through the use of a one-way duckbill valve 194 (not shown) disposed within each of the housing base through-holes 136 in the bottom cover 184 of the housing 108.

[0110] [Fig.9B] is a perspective view of the housing 108 in an open position, according to one example. The housing 108 includes a top cover 180, a housing base 182, a bottom cover 184, a plurality of hinge magnets 186a, 186b, 186c and 186d, a plurality of cover magnets 188a, 188b, 188c and 188d, and a plurality of mounting magnets 196a, 196b and 196c.

[0111] In one example, the housing base 182, the plurality of mounting magnets 196a-196c, a first half of the plurality of lid magnets 188b and 188d, and a first half of the plurality of hinge magnets 186b and 186d, are disposed within the lower lid 184, with the housing base 182 disposed above. The plurality of mounting magnets 196a-196c are disposed to magnetically connect the housing 108 to the cosmetic product dispensing device 100, for example by connecting to the manifold 130 ([Fig.9A]). The collector 130, or portions of the surface of the collector 130, may be formed of a ferrous material or contain corresponding magnets for magnetic attachment to the plurality of mounting magnets 196a-196c.

[0112] A second half of the plurality of cover magnets 188a and 188c are disposed within one side of the top cover 180, and a second half of the plurality of hinge magnets 186a and 186c are disposed within one side of the upper cover 180. The hinge magnets 186b and 186d are disposed within one side of the lower cover 184 in such a manner that they can be in contact with the corresponding hinge magnets 186a and 186c in at least two planes, depending on a relative position between the upper cover 180 and the lower cover 184. The hinge magnets 186a and 186b have opposite magnetic polarity, as do the respective pairs of hinge magnets 186c and 186d, cover magnets 188a and 188b, and cover magnets 188c and 188d.

[0113] The plurality of 196 and the plurality of lid magnets 188a-188d may be arranged such that the plurality of lower lid through-holes 138 disposed in the housing base 182 are unobstructed to allow cosmetic material to flow from each of the cartridges 114 into the housing 108 while the cosmetic material is dispensed.

[0114] In an instance where the housing 108 is in an open position, the upper cover 180 and the lower cover 184 are positioned approximately in perpendicular planes, with the hinge magnets 186a and 186c magnetically connected to the hinge magnets 186b and 186d, respectively. The magnetic force between each pair of the hinge magnets 186a and 186b and the hinge magnets 186c and 186d is sufficient to hold the upper cover 180 in position relative to the lower cover 184.

[0115] In a case where the housing 108 is in a closed position, the upper cover 180 and the lower cover 184 are positioned approximately in parallel planes, the hinge magnets 186a and 186c magnetically connected to the hinge magnets 186b and 186d, respectively, and the cover magnets 188a and 188c are arranged in corresponding positions, and magnetically connected to the cover magnets 188b and 188d, respectively, the magnetic connection between the pairs of hinge magnets 186a and 186b and hinge magnets 186c and 186d, and between the pair of cover magnets 188a and 188b, and the pair of cover magnets 188c and 188d, sufficient to keep the upper cover 180 connected to the lower cover 184 in a position closed.

[0116] Since the upper cover 180 is connected to the lower cover 184 magnetically, the upper cover 180 may be entirely detachable from the lower cover 184. Further, it may also be capable of connecting to the lower cover 184 in a closed position in more than one orientation about the xz plane, depending on the arrangement of the plurality of hinge magnets 186a-186d and cover magnets 188a-188d within the upper cover 180 and the lower cover 184. Further, the upper cover 180 may be capable to pivot about the bottom cover 184, or vice versa, opening or closing about more than one axis, such as about the x-axis or the z-axis.

[0117] Alternatively, the plurality of mounting magnets 196a-196c may be substituted with a mounting magnet 196 of sufficient strength to secure the housing 108 to the cosmetic product dispensing device 100.

[0118] Alternatively, the plurality of hinge magnets 186a-186d may be substituted with a hinge magnet 186a of sufficient strength in the upper cover 180 and a hinge magnet 186b of sufficient strength in the lower cover 184 to secure one side of the upper cover 180 to the lower cover 184 with the housing 108 in an open or closed position.

[0119] Alternatively, the plurality of cover magnets 188a-188d may be substituted with a cover magnet 188a of sufficient strength in the upper cover 180 and a cover magnet 188b of sufficient strength in the lower cover 184 to secure one side of the upper cover 180 to the lower cover 184 with the housing 108 in a closed position.

[0120] [Fig. 10] is a diagram showing an exemplary primary process sequence of a cosmetic formulation method 900, according to one example. The examples provided herein each include three cartridges, although the same method may be used by a cosmetic dispenser 100 equipped with any number of cartridges 114. The cosmetic formulation method 900 includes a detection method S920, a selection method S940, and a dispensing method S960. An additional mixing method S980 may be performed by a user.The detection methods S920, the selection method S940 and the dispensing method S960 are performed by the cosmetic device 100 based on commands received from the controller 150, the controller 150 sending data to the user and receiving input from the user via the smart device 300 or by indicators on the cosmetic device 100 itself, as depicted in [Fig. 3] and FIG. 4. .

[0121] [Fig. 11] is a process diagram showing an example of a method for detecting cosmetic material in the cosmetic product dispenser 100, according to an example. S920 shows a method for detecting a cosmetic material. The method S920 may include at least one of the steps of step 921 detecting the removal and installation of a cartridge 114, step 922 detecting at least one material characteristic of the cartridge 114, an optional step 923 of detecting an amount of cosmetic material in the cartridge 114, and an optional step 924 of calculating an estimated depletion of the cartridge(s) after a future dispensing operation has been performed.

[0122] Optional step 923 of detecting an amount of material in each of a plurality of cartridges 114 may include, for example, step 923a detecting an amount of material of a cartridge A, step 923b detecting an amount of material of a cartridge B, and step 923c detecting an amount of material of a cartridge C, for example based on a total net displacement (rotation) of the cartridge gear 116 detected by the optical encoder 192 since installation of each cartridge 114.

[0123] The optional step 924 of detecting at least one material characteristic in each of a plurality of cartridges 114 may include, for example, step 924a detecting at least one material characteristic of a cartridge A, step 924b detecting at least one material characteristic of a cartridge B, and step 924c detecting at least one material characteristic of a cartridge C. The material characteristics may include at least one of the set consisting of color, texture, luster, moisture, nutrient content, and chemical formulation. This detection may be performed based on a near-field sensor disposed in the dispenser 100 that detects a radio frequency identification tag on the cartridge that stores information about the contents of the cartridge according to methods well understood in the art.Alternative detection methods may be used such as barcode detection of a barcode printed on the cartridge, or detection using methods well understood in the art. The step of detecting the at least one material characteristic in each of the cartridges may be performed before the optional step of detecting the amount of cosmetic material in each cartridge.

[0124] Further, method S920 may include an optional step 926 to report information that may be derived from historical usage data, from the user or from aggregated user groups, such as which cartridge 114 within the cosmetic dispenser 100 should be depleted of cosmetic material first and when.

[0125] [Fig. 12A] is a process diagram showing an example of an S940 process of selecting a cosmetic formulation, according to an example. S940 includes a method for selecting a cosmetic formulation. The method S940 includes steps of identifying possible cosmetic formulation combinations based on the type and amounts of cosmetic materials present within the cosmetic product dispenser 100, as established by the detection method S920.

[0126] A step 942d may be based on a user selection from a set of cosmetic formulations that are possible for the types and amounts of cosmetic material present within the cosmetic product dispenser 100, or a step 942c allows the user to select from a broader set cosmetic materials inventory 204 that is possible for the types and quantities of cosmetic materials that the cosmetic product dispenser 100 is capable of using.

[0127] In another example, a step 943 of method S940 includes letting a user select a desired dose unit 118. Varying the dose unit 118 may change the set of cosmetic formulations available from within the cosmetic product dispenser 100 if a larger quantity of one or more cosmetic materials than is available to dispense a specific quantity of dose unit 118 for a specific cosmetic formulation is needed.

[0128] For example, if cartridge A contains a yellow cosmetic material, cartridge B contains a red cosmetic material, and cartridge C contains a green cosmetic material, and there is only one dose unit 118 of cartridge A remaining, the user would not be able to choose to dispense any combination of dose units 118 and a cosmetic formulation that requires more than one dose unit 118 of yellow cosmetic material.

[0129] Further, method S940 may include a step 942a for the user to select a cosmetic formulation based on a match to a photo, a step 942b for the user to select a cosmetic formulation based on recommendations, or to select a cosmetic formulation based on another method. U.S. Patent No. 8,634,640 describes a method for selecting a color from an image or photograph in a camera or electronic device, and using color reference data to substantially match the color.

[0130] In another embodiment, a skin diagnosis (sometimes referred to herein as a skin profile) may be performed to provide a recommended plurality of predetermined colors for the user to select from based on an analysis of the user's skin features. The skin diagnosis determines an appropriate color for the user based on an imaging procedure performed on the user's face. Examples of skin diagnostic tools known in the art are: Lancome Diagnos ABS, HR Skinscope, Biotherm Bluesmart, Kiehl's Skinprofiler V.0, CA Dermanalyzer, and the Vichy Vichyconsult.

[0131] For cosmetic formulations that are possible but not available based on the results of the detection method S920, the cosmetic product dispenser 100 may communicate to the user what cosmetic materials are needed to dispense such cosmetic formulations.

[0132] In one example, in step 944 the user selects a dosage unit 118 of a cosmetic formulation that is currently unavailable. Step 944 may determine what cosmetic materials, such as what type of 114 cartridges, are needed to mix and dispense the selected cosmetic formulation.

[0133] In another example, step 944 may determine which additional cosmetic formulations may become available if a specific cartridge 114 is replaced with a full but otherwise identical cartridge 114.

[0134] In another example, step 944 may determine which additional cosmetic formulations may become available if a cartridge 114 is replaced with another cartridge 114 containing a different cosmetic material.

[0135] Step 945 determines whether to proceed to step 947 to prompt the user to confirm and proceed to dispensing a cosmetic formulation or to proceed to step 946 to report which cartridge or cartridges 114 are needed to dispense the desired cosmetic formulation, based on the result of step 944.

[0136] [Fig. 12B] shows an optional process S940b that is performed by the dispensing apparatus 100 alone after a cosmetic formulation has been previously received and is currently stored on the dispensing apparatus 100 in a step 948. The remaining steps 943 to 947 of S940b are identical to those of S940 described by [Fig. 12A]. The process of [Fig. 12B] can be performed without an existing connection being established between the dispensing apparatus 100 and the device 300.

[0137] [Fig. 13] is a process diagram showing an example of a method S960 for dispensing cosmetic material in a cosmetic product dispenser 100, according to an example. Step 961 represents a step for dispensing at least one dose unit of a cosmetic formulation. Method S960 includes steps 962a to 962c of ejecting a requested amount of cosmetic material from at least one cartridge 114 to produce a cosmetic formulation selected by the user in method S940, such that the cosmetic formulation can be applied, transported in a container, or is otherwise available to the user. Method S960 includes optional steps 963a to 963c of detecting the remaining amount of cosmetic material in each of the cartridges and optional step 964 of recording the results in a memory of the dispensing apparatus.

[0138] After the dispensing process S960 is completed, the user can perform the process S980 of mixing the manually released cosmetic material, producing the requested cosmetic formulation.

[0139] [Fig. 14] is a diagram showing an example of a connected cosmetic product dispensing system, according to one example. A system 400, which implements the cosmetic product dispenser 100 described above, includes at least the cosmetic product dispenser 100 and a connected device 300. Optionally, the system may further include one or more external servers 410 which are implemented implemented within a cloud environment. Further, the system may optionally include a cosmetic material inventory 204 which is an inventory of possible cosmetic material that may be inserted into the cosmetic device 100.

[0140] The connected device 300 may be a personal computer (PC), a laptop, a PDA (Personal Digital Assistants), a smartphone, a tablet-type device, a UMPC (Ultra Mobile Personal Computer), a netbook, or a notebook-type personal computer. In the examples below, the connected device 300 is assumed to be a tablet-type device, such as an Apple iPad.

[0141] The connected device 300 is capable of wireless communication with the cosmetic dispenser 100 by means of a wireless communication interface circuitry 774 on the cosmetic dispenser 100. However, the connected device 300 is also capable of presenting a wired connection to the cosmetic dispenser 100 by means of a USB interface 776 on the apparatus 100. In addition, each device, including the cosmetic dispenser 100, can communicate with each other and with the one or more external devices via an internet connection via an 802.11 wireless connection to a wireless internet access point, or a physical connection to the internet access point, such as via an Ethernet interface.Each connected device 300 is capable of wireless communication with other devices, such as via a Bluetooth connection or also by other wireless means.

[0142] The connected device 300 is configured to receive information from a user for use in generating a cosmetic formulation that will be used by the cosmetic product dispenser 100 to dispense a cosmetic material into the housing 108.

[0143] [Fig. 15] is a block diagram showing circuitry of the controller 150 and the cosmetic dispenser 100, according to one example. A central processing unit (CPU) 710 provides master control over the separate components of the circuitry included in the apparatus, such as dispenser control circuitry 740 (which may include control circuitry for the motors 112, circuitry for the optical encoder 192, and inductive sensor circuitry). The CPU 710 may also control an optional input / output device 772 (such as a keyboard or mouse), memory 780, the wireless communication interface circuitry 774, the universal serial bus (USB) controller 776, an LED driver 778, and a display module 780. The LED driver 778 controls the pulsing of one or more indicator lights 122.

[0144] In one embodiment, the circuitry includes, among other things, one or more computing devices such as a processor (e.g., a microprocessor, a quantum processor, a qubit processor, etc.), a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or the like, or any combination thereof, and may include discrete electronic digital or analog circuit elements or components, or combinations thereof.

[0145] In one embodiment, a module includes one or more ASICs having a plurality of predefined logic components.

[0146] In one embodiment, a module includes one or more FPGAs, each having a plurality of programmable logic components.

[0147] In one embodiment, the circuitry includes one or more components operatively coupled (e.g., communicatively, electromagnetically, magnetically, ultrasonically, optically, inductively, electrically, capacitively, wirelessly, or otherwise) to each other.

[0148] In one embodiment, the circuitry includes one or more remotely located components.

[0149] In one embodiment, the remotely located components are operatively coupled, for example, via wireless communication, such as with a connected device 300.

[0150] In one embodiment, the remotely located components are operatively coupled, for example, via one or more communication modules, receivers, transmitters, transceivers, or the like.

[0151] In one embodiment, any of the CPU 710 or other components shown in [Fig. 15] may be substituted with other circuitry elements. Examples of circuitry include memory that, for example, stores instructions or information. Non-limiting examples of memory include volatile memory (e.g., random access memory (RAM), dynamic random access memory (DRAM), or the like), non-volatile memory (e.g., read only memory (ROM), electrically erasable programmable read only memory (EEPROM), compact disk read only memory (CD-ROM), or the like), persistent memory, or the like. Additional non-limiting examples of memory include reprogrammable read only memory (EPROM), flash memory, or the like.

[0152] In one embodiment, the memory is coupled to, for example, one or more computing devices by one or more instructions, information, or power buses.

[0153] In one embodiment, the circuitry includes one or more computer-readable media players, connection interfaces, universal serial bus (USB) ports, memory card ports, or the like, and one or more input / output components such as, for example, a graphical user interface, a display device, a keyboard, a remote control, a trackball, a joystick, a touchscreen, a mouse, a switch, a rotator, or the like, and any other peripheral device.

[0154] In one embodiment, a module includes one or more user input / output components that are operatively coupled to at least one computing device configured to control (electrically controlled, electromechanically controlled, software implemented, firmware implemented, or otherwise controlled, or combinations thereof) at least one parameter associated with, for example, determining one or more thermal properties of tissue responsive to detected shifts in the switching voltage.

[0155] In one embodiment, the circuitry includes a computer-readable media player or memory bank that is configured to accept a signal-carrying medium (e.g., computer-readable memory medium, computer-readable recording medium, or the like).

[0156] In one embodiment, a program for causing a system to perform any of the disclosed methods may be stored on, for example, a computer-readable recording medium, a signal-bearing medium, or the like. Non-limiting examples of signal-bearing media include a recordable-type medium such as magnetic tape, a floppy disk, a hard disk drive, a compact disc (CD), a digital versatile disc (DVD), a Blu-ray disc, a digital recording tape, computer memory, or the like, as well as a transmission-type medium such as a digital or analog communication medium (e.g., a fiber optic cable, a waveguide, a wired telecommunications link, a wireless telecommunications link (e.g., receiver, transmitter, transceiver, transmit logic, receive logic, etc.).Additional non-limiting examples of signal-carrying media include, but are not limited to, DVD-ROM, DVD-RAM, DVD+RW, DVD-RW, DVD-R, DVD+R, CD-ROM, Super Audio CD, CD-R, CD+R, CD+RW, CD-RW, Video CDs, Super Video CDs, flash memory, magnetic tape, magneto-optical disc, MINIDISC, non-volatile memory card, EEPROM, optical disc, optical storage, RAM, ROM, system memory, web server, or the like.

[0157] In one embodiment, the circuitry includes acoustic transducers, electroacoustic transducers, electrochemical transducers, electromagnetic transducers, electromechanical transducers, electrostatic transducers, photoelectric transducers, radio-acoustic transducers, thermoelectric transducers or ultrasonic transducers.

[0158] In one embodiment, the circuitry includes electrical circuitry operatively coupled to a transducer (e.g., an actuator, a motor, a piezoelectric crystal, a microelectromechanical system (MEMS), etc.).

[0159] In one embodiment, the circuitry includes an electrical circuitry comprising at least one discrete electrical circuit, an electrical circuitry comprising at least one integrated circuit, or an electrical circuitry comprising at least one application-specific integrated circuit.

[0160] In one embodiment, the circuitry includes electrical circuitry forming a general-purpose computing device configured by a computer program (e.g., a general-purpose computer configured by a computer program that at least partially performs methods and / or devices described herein, or a microprocessor configured by a computer program that at least partially performs methods and / or devices described herein), electrical circuitry forming a memory device (e.g., forms of memory (e.g., random access memory, flash, read-only memory, etc.)), electrical circuitry forming a communications device (e.g., a modem, a communications switch, optical-electrical equipment, etc.), and / or any non-electrical analogs thereof, such as optical or other analogs.

[0161] [CUSTOMIZED COSMETIC ECOSYSTEM]

[0162] [Fig. 16] shows the components of the ecosystem 1600 that are common to each product type. The ecosystem includes the dispenser 1610, a user smartphone device 1620, and a cloud platform 1630. The smartphone is shown to include two functional blocks of setting up 1621 of the smartphone application ("app") and using 1622 of the smartphone application. The setting up 1621 of the smartphone application will be described in detail below with respect to the various customization examples and involves establishing the initial setting information to configure a user profile of the user.The configuration information can then be used when the smartphone application is used and can also be sent to the cloud platform 1630 for use in sending a selection of relevant paces to the user.

[0163] Use of the smartphone application itself actually involves the user making selections that lead to the determination of a color, and performing interactive communication with the distributor, such as sending the recipe to the dispenser and tracking the dispenser's status (such as inventory and remaining volume of cartridges in the dispenser). The smartphone application also performs interactive communication with the cloud platform. For example, the smartphone application may receive the selection of relevant looks described above, and it may also provide direct user feedback from the user on the looks that the cloud platform has previously sent and it may notify the cloud platform of the colors and recipes actually selected by the user and dispensed by the dispenser. Such feedback may provide a form of machine learning to the cloud platform and improve the algorithms used by the cloud platform.

[0164] [CUSTOM LIPSTICK ECOSYSTEM]

[0165] [Fig. 17] shows the ecosystem (1700) described above which is based on proposing a trendy lipstick color to the consumer after analyzing trends on social media by combining favorite tastes in terms of colors, geographical location, favorite influencers, past selections and others. It gives the opportunity to the consumer to choose a color on the basis of an allure, to try it on virtually and to adjust it if necessary to finally produce the formula on the spot with a connected dispenser. It is also possible to propose a color on the basis of the user's outfit digitized with a selfie. The consumer can save the favorite colors among all and share them with his virtual community.

[0166] [Fig. 17] shows that a user's smartphone ultimately provides a recipe to the dispensing device via a smartphone application ("app"). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (usage) of the smartphone app, the app needs to be parameterized (1710) with parameterization information to configure a user profile. The parameterization of the app may be based on the following configuration inputs. • Questionnaire during integration (such as favorite color) • Social media credentials (such as Instagram, Twitter, Facebook) • Favorite influencers to follow color • Geographic location based on local fashion • Environmental data (UV index, pollution, humidity, pollen)

[0167] The setting inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which can be an external server device that is connected via the Internet.

[0168] Actual use of the smartphone app (1720) includes selecting a mode for lipstick selection. In this example, the modes include a mode for selecting a trending recommendation on social media by algorithms that are executed in the cloud platform (discussed later in greater detail). Another mode allows the user to create their own lipstick color using a wide variety of color options.

[0169] Another mode may allow the user to match a lipstick color to their "look" based on a selfie. In this example, the shade and finish selection on the proposed image is extracted. The user can virtually try on the lipstick in real time, the user can adjust the presented color. When the user is satisfied with the color, the user can touch a button displayed on the app to dispense the formula and an internal neural network will decompose the requested color into different color cartridge doses. After the recipe is sent to the dispenser and the lipstick shade is dispensed, the user can apply the lipstick.

[0170] After using the lipstick, the user can use the app to provide feedback on whether they like the result or not. The user can also save their favorite look and color for later use, and the user can share the look and color on the web via a social media platform.

[0171] The cloud platform implements functions shown in 1730, such as a remote algorithm workflow and an enhancement process.

[0172] In the workflow performed by the cloud platform, personal social media network accounts (influencers, trending looks) may be harvested for data related to lipstick colors. The cloud platform may perform an analysis of one or more collected images to extract an average makeup color (lip color, foundation color, hair color) using a deep learning algorithm to segment lip makeup finishes. For example, the cloud platform may accomplish this by first detecting lips in a plurality of images using a technique known in the art (such as that described in U.S. Patent No. 5,805,745).The cloud platform can then perform comparisons of an extracted color with the colors most appreciated by one or more user communities while also taking into account user parameter inputs received from the user's smartphone device. Taking into account all the collected data, the final step is for the . cloud platform to send the analysis results to the user in the form of the selection of relevant gaits noted above.

[0173] In the improvement process performed by the cloud platform and the smartphone app, the user can save her favorite looks and "like" the popular color to enrich the harvesting algorithms for a relevant recommendation at a later time. The cloud platform can further aggregate the feedback from all users, and the platform can send new users the most trending area by location.

[0174] The dispenser operations in block 1740 are already described in detail above, but are summarized as follows. The dispenser receives a command to dispense a certain proportion of each cartridge. The dispenser dispenses onto the top portion and the user can mix it to obtain the desired color. The dispenser returns the inventory containing the remaining formula to the consumer app to ensure that only dispensable colors are available in the UI when the user makes a selection.

[0175] [Fig. 18A] shows an example flow of operations in the ecosystem described above for distributing a personalized shade of lipstick from the perspective of the app. In step 1810, the user may select a “mode” as discussed above, which may be a mode for selecting a trending recommendation on social media by the algorithms that are executed in the cloud; allowing the user to create their own lipstick color using a wide variety of color options; or allowing the user to match a lipstick color to their “look” based on a selfie.

[0176] Step 1820 shows an example of a display when the mode is chosen to select a trending look powered by an artificial intelligence algorithm of the cloud platform. Step 1820 also shows that a menu is provided at the bottom of the interface to allow the user to switch between the modes described above.

[0177] Step 1830 shows an example display when the user has selected a potential hue and is allowed to adjust the hue using an appropriate adjustment mechanism such as a color palette or a slideshow. The hue may be shown on the user's selfie.

[0178] Step 1840 shows that after a color is finally selected by the user, the color is broken down into a combination of the available colors contained in the cartridges of the dispensing device, and then the recipe is transmitted to the dispensing device for dispensing.

[0179] [Fig. 18B] shows an additional flowchart of how the smartphone app algorithms in the lipstick ecosystem may allow a user to see a lipstick shade on the user's selfie. A recipe prediction module 1860 ("Module 2") may receive as inputs the dispensing capacity of the device, which is the set of three lipstick ingredient cartridges commonly within the dispensing device. Another input may be the bulk tone color of dilution mixtures, which represent the actual color values ​​that can be produced by the ingredients in the cartridge. The output of Module 2 is a list of recipes (actual dispensed amounts from each cartridge) and a corresponding predicted RGB color of the bulk tone resulting from each recipe.Module 1 (1870) can then make a projection of how the lipstick will actually look on one's lips based on the RGB color of the mass tone in a recipe and the user's lip color (lip tone), which results in a recipe list and a corresponding RGB color applied. The relationship between the mass tone color and the color applied based on the user's lip tone can be predetermined and stored in advance. Thus, what can be presented to the user on the display device is a palette based on a universe of RGB colors as shown in 1890.

[0180] [Fig.l8C] further illustrates how the specific set of cartridges can result in different shade universes to be presented to the user.

[0181] [Fig. 18D] shows how the "match my look" mode may operate on the app in the lipstick ecosystem. At stage 1881, a user may enter a selfie that includes the user's outfit. A recommendation may be generated in various ways based on recognition of the colors and / or the type of outfit in the image. For example, a first approach ("Approach 1") at 1882 may use the 7 rules of color science and harmony to target the formation of a certain type of relationship between the lipstick shade and the colors of the outfit based on relationships on a color wheel as illustrated in Approach 1. Alternatively, at stage 1883, a predetermined palette may be presented based on a makeup artist's recommendation given the seasonal style of the outfit in combination with the color of the outfit.

[0182] [Fig. 18E] shows more details of how the lipstick recommendation engine works based on the user's outfit selfie. At step 1891, probes may be set by the user at different points on the outfit, where only one probe may have priority. At step 1892, each probe may be assigned a different color palette based on the makeup artist's recommendation palettes, or it may be based on a predetermined color wheel relationship as shown in [Fig. 18D]. As seen at step 1893, the output may recommend colors based on the set of cartridges installed in the dispensing device, and based on the number and priority of the probes the user has decided to use. If desired, the user can also scan to browse the options that would be available in other color wheels if other sets of cartridges were used. This may prompt the user to purchase a new set of cartridges.

[0183] [PERSONALIZED SKINCARE ECOSYSTEM]

[0184] [Fig. 19] shows the ecosystem (1900) described above which is based on proposing a skincare formulation to the user that is most effective for the user based on the user's geographical location, environmental factor, cumulative UV exposure and a signed clinical diagnosis evaluated by a smartphone or dermatologist. The system adjusts the proportion of active substances to obtain the most effective recipe on a daily basis. The user can save his favorite colors among all and share them with his virtual community.

[0185] [Fig. 19] shows that a user's smartphone ultimately provides a recipe to the dispensing device via a smartphone application ("app"). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (usage) of the smartphone app, the app needs to be parameterized (1910) with parameterization information to configure a user profile. The parameterization of the app may be based on the following configuration inputs. • Questionnaire during integration (such as favorite color) • Skincare analysis by a dermatologist or artificial intelligence algorithms with a selfie • Geographic location based on smartphone location detection function • Environmental data (UV index, pollution, humidity, pollen)

[0186] The setting inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which can be an external server device that is connected via the Internet.

[0187] Actual use of the smartphone app (1920) includes collecting environmental data based on geographic location and combining it with a smartphone diagnosis assessing clinical signs (wrinkles, dark spots, firmness, pores, fine lines, dullness).

[0188] The user can also collect data from a UV sensor, such as a wearable UV sensor as described in U.S. Patent No. 10,060,787, which will actually give an accurate measurement of the cumulative UV exposure received. Based on the historical data of the skin assessment and the environmental factor, the app will formulate the ideal formulation to combat the signs of aging of your skin and protect it from the environment. When the user is satisfied with the formulation, the user can touch a button displayed on the app to dispense the formulation and an internal neural network will break down the requested formulation into ingredients from different cartridges. After the recipe is sent to the dispenser and the formulation is dispensed, the user can apply the formulation. The user can provide feedback on their favorite formulations for a specific period of time.

[0189] The cloud platform implements functions shown in 1930, such as a remote algorithm workflow and an improvement process. In the workflow performed by the cloud platform, based on environmental forecasts on UV, pollen, pollution, temperature, specific notifications are sent to the app user to adjust the recipe. For example, there is a known correlation between environmental conditions and skin aging (see “Assessing the impact of aerial chronic urban pollution (UP) on some facial signs of differently-aged Chinese men” at www.researchgate.net, and “The skin aging exposome” at www.jdsjournal.com).Additionally, by giving an input of the user's geographic location, which can provide a determination of air quality using a tool such as Breezometer™ and a local UV index prediction (or UV exposure can be obtained based on a UV sensor described above), the cloud platform can adjust the recipe to address environmental factors such as UV exposure and air quality. For example, [Fig.20B] below shows sample combinations of environmental factors and how they correlate with the ingredients in the cartridges.

[0190] In the improvement process carried out by the cloud platform and the smartphone app, the user can save his favorite recipes which are the most effective over time or the best feeling on the skin. The user can also share his recipes with the community.

[0191] The cloud platform can further aggregate feedback from all users, and the platform can send new users the area of ​​most trending formulations by location.

[0192] The operations of the distributor in block 1940 are already described in detail above, but they are summarized as follows. The distributor receives an order to dispense a certain proportion from each cartridge. The dispenser dispenses from the top, and the user can mix it to achieve the desired color. The dispenser returns the inventory containing the remaining formula to the consumer's app to ensure that only dispensable ingredients are available in the UI when the user makes a selection.

[0193] [Fig. 20A] shows an example of a flow of operations in the ecosystem described above for dispensing a personalized skincare formulation from the perspective of the app. In step 2010, the user may perform a skincare diagnosis as discussed above, which may be performed by taking a 360° selfie, or a series of photos from different angles using the smartphone's camera functionality. In step 2020, the app performs an analysis of the user's skin to detect skin traits, such as blackheads, wrinkles, firmness, pores, fine lines, dullness, etc. A method for performing deep learning to perform training and execution of this type of detection is discussed in greater detail below. Known alternative methods may also be used, such as those described in U.S. Pat. Nos. 10,325,146 and 9,760,935.

[0194] Step 2030 shows the analysis results for another of the skin traits being analyzed. The results may be shown as a score, which may be relative to people in the user's age range. For example, each of the skin traits may be presented on a five-point scale, and traits that represent a worse than average score may be highlighted as a priority for the user, while traits that are better than average may be presented as a strength.

[0195] Step 2040 shows that the app may present a recommended skincare formulation ("blend") that addresses the user's priority skincare concerns while taking into account current environmental conditions. After the formulation is finally selected by the user, the formulation is broken down into a combination of the available colors contained in the cartridges of the dispensing device, and then the recipe is transmitted to the dispensing device for dispensing in step 2050.

[0196] [Fig.20B] shows an example of how a combination of different environmental factors determined to be present for a user can lead to different dosage amounts from three different cartridges. In this example, the cartridges respectively include ingredients focused on deep damage recovery, cell renewal, and protection from daily skin aggressors (which may include an SPF ingredient and a pollution protection ingredient). In this example, a fixed dose of cartridge 1 can always be used to achieve efficiency, while the proportions of the remaining cartridges vary based on the levels of UV or pollution that are present.

[0197] [CUSTOM FOUNDATION ECOSYSTEM]

[0198] [Fig.21] shows an eco-system 2100 that is used to dispense a customized foundation for the user. The eco-system 2100 uses a deep learning algorithm to measure the user's skin tone with a smartphone. By combining with environmental information or makeup tutorials, the system can adjust throughout the year to always provide the consumer with the best foundation color that matches your tan level / skin tone variation. Based on weather forecasts and UV exposure, the device can also increase skin care actives or SPF.

[0199] [Fig.21] shows that a user's smartphone ultimately provides a recipe to the dispensing device via a smartphone application ("app"). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (usage) of the smartphone app, the app needs to be parameterized (2110) with parameterization information to configure a user profile. The parameterization of the app may be based on the following configuration inputs. • Questionnaire during integration (such as favorite color) • Detection of user skin tone with 360° video and a complexion • Geographic location based on smartphone location detection function • Environmental data (UV index, pollution, humidity, pollen)

[0200] The setting inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which can be an external server device that is connected via the Internet.

[0201] Actual use of the smartphone app (2120) includes collecting environmental data based on geographic location and combining it with a smartphone diagnosis assessing the user's skin tone. While methods for determining a user's skin tone for matching foundation are known in the art, a method below relating to a deep learning method will be discussed in detail. Based on the user's skin condition, the app may determine to merge skin care actives skin with foundation as an SPF when environmental conditions are not optimal. The app makes a determination based on the time of year and the person's tan level to slightly adjust the foundation color to match the skin tone's evolution. When the color does not perfect the matching process, the user can send feedback to the cloud to remotely improve the algorithms. In some cases, the user may wish to use the device to adjust the base color to achieve a specific makeup strategy by layering different colors.

[0202] The cloud platform implements functions shown in 2130, such as a remote algorithm workflow and an improvement process. In the workflow performed by the cloud platform, based on environmental forecasts on UV, pollen, pollution, temperature, specific notifications are sent to the app user to adjust the recipe by adding an SPF. The cloud platform can modify the master formula of the complexion for the user which is sent when the tan level of the consumer is different from the initial diagnosis.

[0203] In the improvement process performed by the cloud platform and the smartphone app, the user can save his favorite recipes that are most effective over time or feel best on the skin. The user can also share his recipes with the community. The cloud platform can further aggregate the feedback from all users, and the platform can send new users the area of ​​most trending formulations by location.

[0204] The dispenser operations in block 2140 are already described in detail above, but are summarized as follows. The dispenser receives a command to dispense a certain proportion from each cartridge. The dispenser dispenses onto the top portion and the user can mix it to achieve the desired color. The dispenser returns the inventory containing the remaining formula to the consumer app to ensure that only dispensable ingredients are available in the UI when the user makes a selection.

[0205] [Fig.22A] shows an example of an operation flow in the ecosystem described above for distributing a personalized foundation from the perspective of the app. In step 2210, the user may perform a skin tone diagnosis as discussed above, which may be performed by taking a 360° selfie, or a series of photos from different angles using the camera functionality of the smartphone. In step 2220, the app performs an analysis of the user's skin to detect the skin tone and shade.

[0206] In step 2230, the app may present a recommended foundation ("mixture") that is matched to the user's skin tone while taking into account current environmental conditions. After the foundation is finally selected by the user, the foundation is broken down into a combination of the available ingredients contained in the cartridges of the dispensing device, and then the recipe is transmitted to the dispensing device for dispensing in step 2240.

[0207] [Fig.22B] provides more details on the method of performing the skin tone diagnosis described above. In step 2211, the user makes a video recording of themselves until a face detection is reached by the smartphone app. In step 2212, a face detection is performed according to known methods. If no face is detected, an error message is displayed to the user, and they may request to change an angle or position of the camera relative to the user until a face detection is reached. Once a face detection is achieved, pre-processing is performed on 10 frames of video data, where a normalization process and a zooming process is performed to evaluate the specific features on the user's face. Normalization is a process to align all frames to the same resolution, orientation, width, lighting etc.The normalization is intended to make the frames comparable to each other and to ensure that the main algorithm will operate within the validated operating condition / range and avoid any outlier data points. A skin tone prediction model is then run at step 2213 based on a median skin tone value detected across the 10 frames used for prediction. In addition, an assessment of the prediction noise is performed using a median approach to filter / average the noise. If the noise prediction is low, a LAB value of the skin tone is used to determine the blend used to generate the foundation at the dispensing device. However, if the noise level is high, then a protection backup questionnaire is triggered at step 2214, which requests a previous foundation that the user has used.Then the previous foundation color is matched to a stored LAB value which is used to determine the mix used to generate the foundation at the dispensing device.

[0208] [Fig.22C]-D show additional details regarding how deep learning is performed to cause the smartphone app (or cloud platform) to estimate a skin tone in an image. The same method can also be used to cause a device to estimate a skin care condition in an image. In [Fig.22C], training is performed for the deep learning model. Inputs are provided at stage 2221, where images (which could be selfies in the form of a 360° video or selfies in the form of a photograph) are input together with metadata associated with the input image and external metadata. The metadata associated with the image may include a date and time (and / or season) along with an optional GPS location and an indication of whether the photograph was taken indoors or outdoors. The external metadata may be historical climate data. Preprocessing is performed on the input images at stage 2222, which may include face detection, centering and scaling, facial recognition (depending on bank availability), and correction for lighting conditions. At stage 2223, the deep learning model performs image-based learning by learning features for skin tone estimation. The deep learning model may also perform frame selection to determine the scalar weight of the importance of selected frames based on a group of images from the same user.The output of the deep learning model (2224) provides a weighted average of skin colors from the selected frames and the weights of the frame selection and post-processing. To adjust the accuracy of the model, a measured skin color is input into the system for the real user on the images to train the deep learning model.

[0209] [Fig.22D] shows the usage of the deep learning model after the training has reached an adequate level. This is referred to as the “inference time” since the skin tone (or condition) will be inferred from images without it being possible to make a truth measurement on the user’s actual skin. It can be seen that the stages in [Fig.22D] are the same except that there is no measurement of the user’s skin color at the final stage.

[0210] [INTELLIGENT SWAPPABLE CARTRIDGE SYSTEM]

[0211] The dispensing device described above allows the cartridges to be swapped. consumables in a smart and efficient manner. The cartridges (consumables) used in the dispensing device described above are preferably managed in sets (such as sets of three cartridges). For example, there may be separate sets of cartridges for each of the lipstick, skincare, and foundation applications described above. In the system, the sets of consumables are equipped with a smart chip or electronic device configured to perform data storage and transmission / reception (such as NFC, RFID, or a contact chip). In the following description, an NFC (near field communication) tag will be mentioned, but the claims are not limited to this example.Each cartridge has different cosmetic attributes and a unique formula ID that can identify attributes such as shade / finish, texture, and skin / hair benefits. The attributes. are stored on the integrated circuit at the time of production and signed using an asymmetric cryptographic algorithm.

[0212] As will be discussed in detail below, the NFC tag applied to the cartridges ensures color universe management for the user, use cases across multiple devices, and traceability. The tag will have two memory areas: one area for production data (encoded during the filling process); and one area for usage where the device will encode usage and track quantities. In addition, the following security mechanism has been implemented: (i) ensuring non-modification of production data: editing of sectors is password protected (secret password); (ii) ensuring non-duplication of cartridge data in case of misappropriation: adding a signature mechanism using a UIID (unique identifier of the tag, encoded data, secret manufacturing key).The app using the device to read the cartridge will then verify that the signature comes from the manufacturing entity before allowing distribution.

[0213] [Fig.23] shows a structure of the cartridge 2300, which is similar to the cartridge described above, but further includes a region 2310, which is an area where metallization is not permitted, and an NFC (smart chip) tag 2320 which is adhered to the bottom of the cartridge in such a way that it is flat and without edges.

[0214] [Fig.24] shows a data format of the data stored on the NFC tag on the cartridge. The column "DEC" denotes an "offset", which are the coordinates of the data encoded in hexadecimal system. The "Page" represents blocks of consecutive data matrices since the system can only read / write one page entirely at a time. It can be seen that the format includes a Tag ID and several domains. The data size for the data included on the NFC tag is 56 bytes in this non-limiting example, but it can also be larger or smaller. The data format shows that there are information domains focused on production information and other domains focused on usage tracking.

[0215] [Fig.25] shows a table that includes obvious descriptions of the various fields contained in the NFC tag data format. In addition, the "base type" means the data type: for example: u8 means an 8-bit unsigned integer. "Ulel6" means a 16-bit unsigned integer. "Length" and "page" are the coordinates and allocation required in the NFC tag memory page. For example, "u8" is an unsigned integer that is encoded in 8 bits, which will require an 8-bit memory space at the page 0 location.

[0216] [Fig.26] shows a structure of the dispensing device 2600 which is equipped for the intelligent system of interchangeable cartridges. It can be seen that the Dispensing device 2600 includes a contact / Hall effect sensor 2610 that detects and counts a lid open / close cycle to trigger read detection and consumable change operations. The device further includes a communication interface 2620, which in this case is a specific NFC antenna, for each cartridge channel that can read and write information to the cartridge's NFC tag at each dispensing.

[0217] [Fig. 27] shows the establishment of a handshake between the dispensing device 2600 and the user smartphone device 2710. The various triggers for initiating communication between the dispensing device and the smartphone may include a connection being established between the devices (such as a Bluetooth pairing), the lid of the dispensing device being opened, a dispense command from the smartphone app (such as one of the apps described above), or a dispense command being entered directly on the dispensing device. In response to the trigger, the handshake includes in step 1, reading a status of the consumables of the cartridges stored on the dispensing device and sending the status to the smartphone. At the same time, the user experience is updated and sent to the smartphone.The "user experience" refers to a context of the device with respect to the user's viewing of a specific interface displaying to the user a pop-up window when the lid is open, the cartridge is empty, or the color wheel has the correct color available. In step 2, the smartphone may transmit or adjust a dispensing command to the dispensing device. In step 3, the dispensing device may transmit feedback about the actual dispensing to the smartphone. In step 4, the smartphone may transmit an instruction to update the NFC tags on the cartridges when a dispensing session is completed.

[0218] [Fig. 28] shows a consumer app state machine that demonstrates a process from the app perspective of priming the cartridges prior to any use of the dispensing device. In an initial priming step 2810, a certain amount of formula may be dispensed in a predetermined sequence and / or simultaneously from each of the cartridges to verify that dispensing can be achieved from each cartridge. In a further priming step 2820, the user may click on a displayed color to order individual dispensing on demand. This may be done to ensure that the correct color is detected in the correct channel within the device so that recipes may be automatically assigned to the correct channel. Step 2830 shows a display, when priming is complete, of the status of the cartridges in the dispensing device.

[0219] Accordingly, the priming method can detect when a new cartridge has been installed and allows for proper engagement with the plunger of the dispensing device and the formula contained in the cartridge so that a proper dose can be dispensed when an actual mixture is created.

[0220] Additionally, by detecting the exact cartridges that are installed, the cartridge set (such as the three-cartridge set) can be determined, and the color attributes (or skincare attributes) that are possible with the current set are automatically updated on the app.

[0221] In addition, the app can perform consumable management by suggesting or automatically performing pipe cleaning when a cartridge is changed. The app can further adapt the formula universe in the user interface function depending on the type of cartridge set installed.

[0222] Additionally, the app's state machine can detect inconsistent sets or missing cartridges. It can offer to purchase a missing set to achieve a result. It can automatically detect expiration dates of any cartridges. Additionally, since security information is stored on the cartridge, it allows for natively multi-user and multi-device functionality since each separate user's smartphone will detect the cartridge information independently.

[0223] During priming, the cartridges may also be authenticated. A 32-bit hash code is generated at production time using a manufacturer's secret key and the code is encoded on the cartridge's NFC tag. The smartphone includes a hard-coded secret key, which may be included in a software development kit (SDK), to verify the hash code when reading data from the NFC tag transmitted from the dispensing device. The smartphone may also be hard-coded with the secret key if possible. A unique item identification (UIID) tag may also be physically added to the cartridge or NFC tag (e.g., in the form of a barcode) and read by the dispensing device. If the cartridge authentication process fails, the dispensing device may transmit the notification to the smartphone.

[0224] In some rare cases, the user may encounter a cartridge where the NFC tag is not read by the machine (coding error, tag destruction, device out of range, other defect). In this case the user should still be able to dispense the formula and use their device as normally as possible. To ensure this tolerant default mode, a recovery cartridge mode requiring the user to enter information from the cartridge will continue the operation. The SDK-based application will then create a virtual cartridge for continue the algorithm for distribution. This automatically triggered recovery mode will be turned off when a new cartridge is inserted or when NFC is back in range.

[0225] [Fig.29] shows a method for handling a faulty cartridge NFC tag in the above-mentioned scenario. If there is an error in the NFC tag's read data, the process is started at step 2910 where the SDK installed on the smartphone activates a recovery mode for a particular channel in the dispensing device. At step 2911, the SDK attempts to write a new production sequence (by transmitting to the tag via the dispensing device) to the tag based on the last read value. At step 2912a, if the tag is written successfully, the process ends. However, at step 2912b, if the label fails to be rewritten, the method proceeds to step 2940. At step 2913, the app displays a message asking the user to verify that a cartridge is in a suitable channel and the dispensing device automatically opens the lid at step 2914.In other words, if the problem was that no cartridge was inserted, then this step will address that possibility. At step 2915, the user confirms that a cartridge is in the channel. If a read is still not possible, at step 2916, the user is asked to select a cartridge color corresponding to a sticker on the cartridge. At step 2917, the user is asked to enter the batch number and the cartridge serial number, and asked to verify that the cartridge is brand new. At step 2918, the SDK creates a virtual cartridge for the channel number. Dispensing operations can continue based on the virtual cartridge being used as a proxy to properly read the NFC tag on the actual cartridge.At step 2919, the virtual cartridge will be stopped if the cartridge suddenly becomes readable for a predetermined number of dispensing operations in a row, or if the entire set of cartridges is changed.

[0226] [Distribution and self-cleaning system]

[0227] Since the system described above includes swappable cartridges of many different types, a special cleaning mechanism that integrates with the easy-to-remove housing structure has been developed to provide a unique cleaning functionality to enhance the user experience.

[0228] [Fig. 30] shows a simplified side view of one embodiment of the dispensing device 3000 showing that the dispensing device includes a retractable plate 3010 with holes 3020 to accommodate the dispensing ends of the cartridges 3030. The device includes a spring 3040 such that, when the spring is not compressed, the retractable plate is in the “stable upright position” and the cartridge nozzles are hidden. The stable upright position hides the nozzle tip and also reduces the entry of dust or contamination into the nozzle.

[0229] It can be seen that the retractable plate includes a side surface that is bent approximately 90 degrees toward the top surface, which allows the plate to move downwardly in a sliding groove 3050 of the dispensing device body.

[0230] [Fig.31 A] shows that when a downward force is applied to the retractable plate, the spring is compressed and the retractable plate is in the "down position".

[0231] [Fig.31B] then shows that when the easy-to-remove housing / cup 3110 is placed above the retractable plate, the "down position" allows the cartridge nozzles to be flush with the dispensing surface 3120 of the housing / cup such that the dispensed formula 3130 is smoothly dispensed onto the dispensing surface.

[0232] With the above retractable plate mechanism in place, the method of cleaning the surface of the housing will be described with reference to [Fig.32].

[0233] [Fig. 32] shows that a cleaning formula reservoir 3250 is disposed between the body of the dispensing device and the retractable plate. In the "stable down position" at step 3210, the dispensing end of the cleaning reservoir is below an opening in the retractable plate. When additional force is applied to the retractable plate at step 3220, the dispensing end of the cleaning reservoir becomes flush with the surface of the housing and compression on the reservoir causes the cleaning formula to be dispensed onto the surface of the housing as shown at step 3230.

[0234] Examples of the cleaning formula include soap, alcohol, or other known cleaning solutions.

[0235] Each position described above may be achieved by manual force provided by the user. Alternatively, each position may be achieved by electromechanical means such as a motorized actuator device as understood in the art. The cleaning formula may be manually wiped, spread and / or brushed and removed by the user.

[0236] [Fig. 33] shows another use of the retractable plate described above to provide a method of rinsing the cartridges to remove any remaining ingredients or residue (indicated by 3350 at step 3310). At step 3310, the dispensing device is shown in the stable lower position. At step 3320, when the housing is pushed downward, the downward movement can be translated into an activation of the cartridge plunger. This can allow the user to use / rinse the last remaining ingredients in the cartridges if desired.

[0237] [SMART CUSTOMIZED COMPARTMENTALIZED SYSTEM]

[0238] [Fig.34A]-C show a smart customized compartmentalized system for use with the dispensing system described above. As described above, the dispensing device in the above embodiments dispenses a cosmetic formula to a housing located on the top with 3 cartridge outlets (in the current examples) or more outlets. The housing may be detachable or non-detachable. In the following embodiments, a dispensing surface (tray) that includes partitioned compartments within the housing may be either integrated into the housing or removable (to be placed by the user on the housing aligned with the cartridge outlets).

[0239] When the tray is removable, this allows the user to selectively choose or customize the compartment (such as choosing the number of partitions and outlets per partition). Different compartments are possible based on the product category: skincare, foundation, lipstick, eyeshadow, etc. Different compartments are possible for the same product category: i.e., skincare (different compartment for specific areas on the face), foundation (different compartment for highlighting & contouring).

[0240] In one embodiment, the tray is circular and can be rotated to allow different product combinations in a compartment without swapping cartridges in the dispensing device. The compartmented tray type is saved in the associated mobile application to obtain appropriate personalized recommendations based on the selected compartment.

[0241] [Fig. 34D] and 34E illustrate a mechanism to enable detection of a position of the tray and compartments to be sent to a mobile device of a user. [Fig. 34D] shows an embodiment of the tray that includes an NFC tag 3411 embedded at a predetermined position inside the tray or on the underside of the tray. When the tray is placed on the dispensing device, these partitions 3412 create compartments surrounding the outlets 3413 on the dispensing device in a particular manner. An NFC reader in the dispensing device can detect the NFC tag to retrieve information indicating what type of tray is in the user device (such as two-compartment, three-compartment, etc.). The exact position of the NFC tag or other object embedded in the tray can be detected to determine the exact position of the compartments relative to the outlets.This may be based on a time of flight between the NFC reader and the NFC tag, or it may be based on the weight of the NFC tag or one or more other objects embedded in the tray that can be detected using one or more Hall effect sensors. The sensors. magnetic elements incorporated into the partitions 3413 themselves can also be used to detect the exact position of the tray. With the information about the tray type and tray position detected as described above, the information can be transmitted to the user's mobile device. With the additional information of the exact cartridges in the dispensing device also being transmitted to the user's mobile device, the user's mobile application can provide instructions on a cosmetic formula to the dispensing device based on the current state of the dispensing device.

[0242] In an alternative embodiment of the tray illustrated in [Fig. 34D], [Fig. 34E] shows a method for detecting a tray type and / or a tray position without using an NFC tag or other objects. The tray may have a visible code 3421 (such as a QR code illustrated in the example of [Fig. 34E]). The code is provided at a predetermined position on the tray. The user may then take a picture of the tray, and the mobile application on the user's smartphone may detect the QR code and the position of the QR code in the image. The information in the QR code itself may be used to indicate what type of tray is being used (such as two-compartment, three-compartment, etc.). At the same time, the position of the QR code may indicate the rotation of the tray relative to the outputs. Similarly to the above example of [Fig.34D], with the information obtained from the QR code, the user's mobile application can provide instructions on a cosmetic formula to the dispensing device based on the current state of the dispensing device.

[0243] Fig. 35 shows a method for the user to provide a final customized beauty supplement to any of the compartments in the tray described above. The addition of a customized beauty supplement provides benefits that cannot be achieved with the dispensing operation described above alone, such as providing coverage of a shade that has an antagonistic effect with the visibility of beads. For example, with matte makeup architectures, the visibility of beads is masked by pigments. This beauty supplement technique provides an optical benefit with increased visibility of the effect of the beads on the surface without problems of instability or viscosity incompatibility. A high concentration of beads or the use of large particle size beads is not possible in a traditional formulation because it will lead to flakes, sedimentation and stability problems.Customization of the final makeup product can be based on another desired texture / finish / effect as well.

[0244] [Fig.35A] shows that following the dispensing operation in step 3501, in step 3502 a final beauty supplement of pearls, glitter powder, stars etc. can be added to personalize the makeup dispensed in the case. Alternatively or further, a texture modifier may be added in step 3502 to modify the final finish texture of the makeup dispensed in the case (i.e., change a matte lipstick to a glossy lipstick, change a matte foundation to a glossy foundation). In step 3503, the beauty supplement may be mixed with the dispensed formula using an applicator.

[0245] As shown in [Fig.35B], to facilitate the addition of the beauty supplement when the tray is compartmentalized as illustrated in [Fig.33] above, a cover 3510 may be provided that conforms to the shape of a particular compartment so that the beauty supplements are not inadvertently applied to the wrong compartment in step 3502 described above.

[0246] [REMOTE CONSULTATION]

[0247] [Fig. 36] shows a system 3600 that allows a user to send a dispensing formula to the dispensing device described above based on the results of a digital beauty consultation with a beauty advisor (BA). The system includes a BA device 3610 that communicates with a consumer (or "user") device 3620. Both devices are represented by a smartphone device, but could be any type of computing device such as a personal computer, laptop, tablet, or the like.

[0248] The communication between the CB device 3610 and the consumer device 3620 may be in the form of a call, a chat session, or a video conference.

[0249] The CB device 3610 executes a remote application 3611 without performing communication with the consumer device 3620. The remote application 3611 performs functions relating to collecting and displaying consumer data for the CB and receiving input and setting recommendations from the CB.

[0250] The consumer device 3620 executes a user interface application (App UI) 3621 that allows the consumer to initiate communication with the CB, receive inputs to form the consumer data, and perform communication with the distribution device 3630.

[0251] The dispensing device 3630 is configured to dispense a cosmetic formula based on instructions received from the consumer device 3620.

[0252] The dispensing device may be used for a variety of cosmetic applications already discussed above. Additional dispensing operations may be performed relating to dispensing nail polish directly onto the user's nails with an ultraviolet (UV) lamp provided to accelerate drying of the nail polish. Other types of cosmetic formulations may be provided, such as liquid eye shadow; dry cosmetics; and hair, skin, body, and sun care products. This list is not limited, and makeup from all categories can be used in the system described above.

[0253] [Fig.37] shows a flow of operations in a beauty consultation session between the consumer and the CB. In step 1, the consumer connects to the CB based on a query sent from the consumer device 3602. The query may be coupled with information entered from the user about the type of cosmetic formulation the user is seeking. The query may be directed to a server (not shown) that may determine an available CB in the system, and then notify the CB device 3601 of a pending query for consultation from a consumer. The appropriate CB for notification of the query may be predetermined based on the CB's area of ​​expertise and the type of cosmetic formulation the user is seeking. A plurality of CBs may be notified of the query simultaneously, and the first CB to accept the query may be used to determine which CB to use in the consultation. Alternatively, the consumer may select a specific CB from the App 3621.

[0254] In step 2, consumer data is collected. [Fig.38] shows an example of all types of consumer data that can be collected during the consultation session. It can be seen that there can be four types of data that are collected: diagnostic data; biological data / environmental data / and social media sharing data.

[0255] The diagnostic data may be data collected based on images taken with the consumer device's camera (to be discussed in more detail later), or it may be direct responses to CB questions. The questions may include a questionnaire, a ranking of user priorities, or it may include status questions, such as hormonal cycle, allergies, medical issues, or the like.

[0256] The biological data may be actual biological samples provided by the user, or described by the user, such as protein samples; microbiome samples; hair, skin, nail samples; and sebum, dandruff, and sweat samples. The biological samples may be collected, for example, by using specific adhesive strips that collect stratum corneum cells from the skin / scalp to extract and analyze proteins (Elisa method). The microbiome samples may be collected, for example, by using specific absorbent papers / cotton swabs placed on the user's skin surface for several seconds to collect sebum, sweat, hydrolipidic film. The hair samples may be collected in the form of a strand of hair that is cut by the user or a few hairs including the bulb that are pulled by the user. Nail samples can be cut by the user. These samples can be collected using sampling kits sent to the user's home and returned for analysis to a commissioned laboratory. The results of the analysis data are stored using a Unique Identifier (UI) and transmitted to remote servers.

[0257] Environmental data may include information specific to an area or user habits. Such data may include information about indoor / outdoor pollution; water quality; screen time; and daily commuting habits (such as use of a car, bicycle, or motorcycle). This information may be collected based on questions or publicly available information.

[0258] Social media sharing data may be obtained from monitoring the consumer's interests on social media platforms. This data may include lifestyle, travel, diet, and interests in certain activities. This data may be obtained from the remote application of the CB 3611, or from an external server, after receiving inputs from the user on internet links to their social media platforms.

[0259] Returning to [Fig. 37], steps 2-4 show an example of a consultation session that includes the collection of diagnostic data using a smartphone camera when the consumer is searching for a facial skincare formulation. In step 2, a "selfie" image or video of the user is captured at the consumer device. In step 3, a 3D conversion is performed on the selfie image or video to obtain a 3D replica of the consumer's face and features. If available, 3D information may be obtained using a time-of-flight sensor or a LIDAR sensor. In step 4, a surface analysis is performed on the 3D image to detect features on the face, such as wrinkles, acne, blackheads, or the like.Based on this analysis, initial diagnostic outputs for the problems determined to be treated may be generated. In step 5, a facial map may be generated that sections the user's 3D image, and treatment targets may be determined at this time. These treatment targets may be determined automatically or manually highlighted by the CB. Depending on the location and nature of the treatment targets, different cosmetic formulations (recipes) may be determined and displayed to the user in step 6. The facial map may include a color legend below the map. of the face that indicates which recipe is used on a region that appears in a particular color on the face map.

[0260] Based on the possibility that a plural amount of treatments can be used based on the user's skin conditions, different types of skin care ingredients can be dispensed into different compartments of a removable housing device as described above.

[0261] [Fig.39] shows a different example of a consultation session, where the consumer is interested in a hair care product. Following the connection to a CB in Step 1, Steps 2 and 3 are similar to Steps 2 to 5 of [Fig.37] described above. However, instead of a 3D surface analysis of the face, the 3D surface analysis is performed on the user's hair. Although not shown, following the surface analysis, a hair map can be generated based on a sectioning similar to Step 5 of [Fig.37], and treatment targets can be determined. As a final output, similarly to Step 6 of [Fig.37], different cosmetic formulations (recipes) for the user's hair can be determined and displayed to the user.

[0262] [Fig.40] shows yet another example of a consultation session, where the consumer is interested in a nail gel product to be dispensed from a dispensing device. The type of dispensing device shown in [Fig.40] allows a user to insert their finger into the dispensing device, where a nail gel is dispensed onto a fingernail of the user and a UV lamp is used to cure the nail gel. Following the connection to the CB in Step 1, Step 2 is similar to Step 2 of [Fig.37] described above. However, instead of a 3D surface analysis of the face, in Step 3, the consumer's data is analyzed to determine a shape, surface, and color of the user's nails.Based on the user's preferences, a color palette may be displayed to the user in step 4 along with a product type from which the user can choose. In step 5, the program settings for the dispensing device are determined prior to a dispensing operation.

[0263] [Fig. 41] shows an example of the types of dispensing device settings that can be determined during the remote consultation illustrated in [Fig. 37], 39 and 40. For a dispensing formula, a plurality of viscosity types can be determined for a liquid, gel, cream, balm or wax. Formulas for all routine steps can be determined for formulas relating to hair care, nail colors (gel and conventional nail polish), liquid eye shadow, skin care, body care or sun care. Different types of formulation possibilities can be determined which include cosmetic products sensitive to oxidation, fresh cosmetic products, or dry cosmetic products. The steps to achieve a precise volume are determined, which include dispensing the correct volume / surface area, dispensing in the correct application order, and dispensing at the correct speed for a more aesthetic result.

[0264] Additional features may be determined during the consultation, such as settings for a UV lamp as noted in the nail gel example described above. The self-cleaning and priming steps described above may also be determined.

[0265] Thus, the foregoing discussion merely discloses and describes exemplary embodiments of the present invention. As will be understood by those skilled in the art, the present invention may be embodied in other specific forms without departing from the spirit or essential features thereof. Accordingly, the disclosure of the present invention is intended to be illustrative, but not to limit the scope of the invention, as well as the other claims. The disclosure, including any readily discernible variations of the present teachings, defines, in part, the scope of the terminology of the preceding claims such that no subject matter of the invention is dedicated to the public.

Claims

Claims

1. A system, comprising: an advisory device; a user device; and a dispensing device; wherein the advisory device and the user device are configured to perform a communication session with each other that includes: transmitting, from the user device to the advisory device, information that includes a desired cosmetic product and information relating to a user of the user device; analyzing, by the advisory device, the information received from the user device; and generating and transmitting a recommended cosmetic formula to the user device;and wherein the user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product and wherein the communication session is a video conference between the user and a beauty advisor who operates the advising device.;

2. The system of claim 1, wherein the dispensing device includes a plurality of cartridges each containing a cosmetic material and the dispensing device is configured to dispense a specified amount of the cosmetic material from the plurality of cartridges into a receiving area, and the recommended cosmetic formula is generated based on the cosmetic material in each of the cartridges in the dispensing device.

3. The system of claim 1, wherein the user-related information is at least one of diagnostic data, biological data, environmental data, and social media activity data relating to the user.

4. The system of claim 3, wherein the diagnostic data is image data of the user captured by a camera of the user device.

5. The system of claim 4, wherein the advisory device or the user device is configured to convert the user's image data into three-dimensional data and perform a surface analysis of a part of the user's body based on the three-dimensional data.

6. The system of claim 5, wherein the advisory device is configured to determine target regions of the user's body part to be treated with the desired cosmetic product based on the surface analysis, and to generate the recommended cosmetic formula based on the determined target regions.

7. The system of claim 1, wherein the desired cosmetic product is one of a skin care product, a hair care product, and a nail coloring product.

8. A method performed by a system that includes an advisory device; a user device; and a dispensing device, wherein the advisory device and the user device are configured to perform a communication session with each other, the method comprising: transmitting, from the user device to the advisory device, information that includes a desired cosmetic product and information relating to a user of the user device; analyzing, by the advisory device, the information received from the user device;and generating and transmitting a recommended cosmetic formula to the user device, and wherein the user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product and wherein the communication session is a video conference between the user and a beauty advisor who operates the advising device.;

Images