Applicator with camera and sensor for skin health mapping

Abstract

APPLICATOR WITH CAMERA AND SENSOR FOR SKIN HEALTH MAPPING A personal care system includes an applicator (100) including a body (105) and an applicator surface (110) configured to apply a formula to the skin, a position sensor module; a skin condition sensor module, and a processor (140).The personal care system is configured to obtain, via the position sensor module, position sensor data; calculate, based on the position sensor data, a position of the applicator on the skin; apply a treatment to the skin at the calculated position; determine treatment characteristics at the calculated position; obtain, via the skin condition sensor module, skin condition sensor data; determine, based on the skin condition sensor data, skin condition information at the calculated position; and store the calculated position, the treatment characteristics, and the skin condition information. The stored information may be used to generate a visualization of a change in skin condition over time, obtain a recommendation from a recommendation engine, or adjust one or more treatments. Figure for abstract: [Fig 1c].

Description

Title of the invention: APPLICATOR WITH camera and SENSOR for skin health mapping ABSTRACT

[0001] In one aspect, a personal care system includes an applicator including a body and an applicator surface coupled to the body, wherein the applicator surface is configured to apply a formula to the skin; a position sensor module; a skin condition sensor module; a processor; and a memory having stored therein computer-executable instructions configured to cause the personal care system to perform steps including obtaining, via the position sensor module, position sensor data; calculating, based on the position sensor data, a position of the applicator on the skin; applying a treatment to the skin at the calculated position; determining treatment characteristics of the treatment applied to the skin at the calculated position; obtaining, via the skin condition sensor module, skin condition sensor data;determining, based on the skin condition sensor data, skin condition information at the calculated position; and storing the calculated position, treatment characteristics, and skin condition information.

[0002] In some embodiments, the skin condition sensor module includes a skin hydration sensor, a skin elasticity sensor, or a combination thereof. In some embodiments, the position sensor module includes a camera, a proximity sensor, a gyroscope, an accelerometer, or a combination thereof.

[0003] In some embodiments, the computer-executable instructions are further configured to cause the personal care system to compare the determined skin condition information with a reference condition and adjust one or more treatments based on the comparison.

[0004] In some embodiments, the personal care system further includes one or more light sources, and the treatment comprises light treatment or phototherapy treatment.

[0005] In another aspect, a method performed by a computer system comprising one or more processors and a memory comprises, by the one or more processors, obtaining position sensor data; calculating, based on the position sensor data, a position of an applicator relative to a user's skin; determining treatment characteristics of a treatment applied to the skin at the calculated position; obtaining skin condition sensor data; determining, based on the skin condition sensor data, skin condition information at the calculated position; and storing the calculated position, treatment characteristics, and skin condition information.

[0006] In some embodiments, the method further includes comparing the determined skin condition information with a reference condition and adjusting one or more treatments based on the comparison. In some embodiments, the method further includes generating a visualization (such as a 2D or 3D animation) of a change in skin condition over time based on the stored calculated position, the stored treatment characteristics, and the stored skin condition information. In some embodiments, the method further includes obtaining a recommendation from a recommendation engine or adjusting one or more treatments based on analysis of the stored information.

[0007] In some embodiments, the skin condition information includes an image of the skin at the calculated position, skin elasticity information, skin hydration information, or a combination thereof.

[0008] In some embodiments, the treatment characteristics include a timestamp. In some embodiments, the treatment characteristics further include an identifier of a dispensed formula, an amount of the dispensed formula, or a combination thereof. In some embodiments, the treatment characteristics further include a treatment intensity, a treatment wavelength, a treatment duration, or a combination thereof.

[0009] This summary is provided to present a selection of concepts in simplified form which are described more fully below in the Detailed Description. This summary is not intended to identify key features of the claimed subject matter or to be used as an aid in determining the scope of the claimed subject matter. Brief description of the drawings

[0010] The foregoing aspects and numerous related advantages of this invention will be more readily appreciated as they become better understood with reference to the following detailed description, when taken in conjunction with the accompanying drawings, in which:

[0011] [Fig. 1 A] [Fig. 1 A] is an example of an applicator, in accordance with the present technology;

[0012] [Fig.lB] [Fig.lB] is an example of a cross-sectional view of the applicator of [Fig.lA], in accordance with the present technology;

[0013] [Fig. IC] [Fig. IC] is another example of a cross-sectional view of the applicator of [Fig. 1A], in accordance with the present technology;

[0014] [Fig.2A] [Fig.2A] is another example of an applicator, in accordance with the present technology;

[0015] [Fig.2B] [Fig.2B] is an example of a cross-sectional view of the applicator of [Fig.2A], in accordance with the present technology;

[0016] [Fig.2C] [Fig.2C] is another example of a cross-sectional view of the applicator of [Fig.2A], in accordance with the present technology;

[0017] [Fig.3A] [Fig.3A] is a top view of an exemplary applicator, in accordance with the present technology;

[0018] [Fig.3B] [Fig.3B] is a top view of an exemplary applicator, in accordance with the present technology;

[0019] [Fig.4] [Fig.4] is an example of a system including an applicator and a base device, in accordance with the present technology;

[0020] [Fig.5] [Fig.5] is another example of a system, in accordance with the present technology;

[0021] [Fig.6] [Fig.6] is an example of a method of using a system, in accordance with the present technology; and

[0022] [Fig.7] [Fig.7] is another example of a method of using a system, in accordance with the present technology. Detailed description

[0023] Described herein is a system for detecting skin conditions and mapping skin health. In some embodiments, a personal care system includes a processing and sensing assembly that includes an applicator having a body and an applicator surface coupled to the body, a position sensor module, a skin condition sensor module, and a processor, the applicator surface configured to apply a formula to the skin. In some embodiments, the applicator is configured to be coupled to a base device in a handheld form factor.In some embodiments, the personal care system is programmed to perform steps including obtaining, via the position sensor module, position sensor data; determining, based on the position sensor data, a position of the applicator on the skin; applying, by the applicator, the formula to the skin at the determined position; determining formula application characteristics of the formula applied to the skin at the determined position; obtaining, via the skin condition sensor module, skin condition sensor data; determining, based on the skin condition sensor data, a skin condition at the determined position; the . storing position information, formula application characteristics, and skin condition. This stored information may be used by the personal care system or other device or computer system to, for example, display a visualization of the treatment and its progressive effects (e.g., in a time-lapse video or animation), determine changes in skin condition over time, recommend different products, adapt treatments or routines to changing environmental conditions or skin conditions, or for other purposes.

[0024] Figures 1A-1C illustrate aspects of an exemplary processing and sensing assembly, in accordance with the present technology. In this example, the processing and sensing assembly is configured as an applicator 100 for applying a formula that also includes sensors that obtain sensor data to calculate the position of the applicator on the user's skin, determine skin condition information, or for other purposes. As shown in [Fig. 1A], the applicator 100 may include a body 105, an applicator surface 110, a label 115, and a platform 120. Also shown is a section line C, along which Figures 1B and 1C are taken. In some embodiments, the body 105 is configured to contain additional components and / or circuitry, such as one or more sensor modules, as shown in Figures 1B and 1C.

[0025] The applicator surface 110 may take any number of forms, including a roller ball configured to dispense and apply a formula located in a reservoir within the applicator 100 (as shown in Figures 1B and 1C). In some embodiments, the roller ball 110 is plastic, but in other embodiments, the roller ball 110 may be glass or metal. In some embodiments, the roller ball is transparent.

[0026] In some embodiments, the applicator 100 further includes a label 115. In some embodiments, the label 115 is a quick response (QR) code, a radio frequency identification (RFID) tag, a barcode, or the like. In some embodiments, the label 115 communicates an identity of the applicator 100 or the one or more formulations within the applicator 100 to a base device, as shown in [Fig. 4]. In some embodiments, the label 115 may be used to identify any number of things about the one or more formulations or the applicator 100, including the amount of formula within the applicator 100, the expiration date of the formula within the applicator 100, or when to replace the applicator 100.

[0027] In some embodiments, the applicator 100 is configured to be coupled to a base device, such as the base device shown in [Fig. 4]. In In some embodiments, the applicator 100 includes a platform 120. Although the platform 120 is illustrated in Figures 1A-1C as including a disc or ring shape, the platform 120 may be configured in other shapes. The platform 120 may include attachment means capable of securing a treatment and collection assembly (e.g., the applicator 100) to a base device 200, such as in a screw-on or threaded-on configuration, a snap-on or snap-on configuration, or with a magnet. In some embodiments, the platform 120 is at least partially transparent or translucent, which may be useful, for example, to allow light from light sources in the upper end of the base device to pass through the platform.In some embodiments, platform 120 may include any number of additional components, such as the components shown in detail in Figures 3A and 3B.

[0028] In some embodiments, the applicator 100 may be configured to apply one or more specific types of skin treatment, such as a formula treatment, a light treatment, or a radiation treatment. In other embodiments, the applicator 100 may be configured to apply a combination of these treatments. In operation, the applicator 100 may be placed within a base device (as shown in [Fig. 4]) and secured to the base device with the platform 120. The roller ball 110 may be rolled over a surface, such as a user's skin, to apply a formula.

[0029] In some embodiments, the formula may be a moisturizer, a concealer, a treatment for wrinkles or fine lines, a toner, an acne treatment, a sunscreen, a foundation, or the like. Multiple formulas may be applied for different purposes, for example, to treat different skin conditions or treat one condition with a combination of formulas.

[0030] Figures 1B and 1C are exemplary cross-sectional views of the illustrative applicator 100, in accordance with the present technology. In the examples shown in Figures 1B and 1C, the applicator 100 includes a body 105, an applicator surface 110, a platform 120, a reservoir 130 configured to contain a formula F, a plunger 145, and an applicator processor 240.

[0031] In some embodiments, the reservoir 130 is located within the body 105, and is configured to contain a formula F, such as a skin care formula. In some embodiments, the skin care formula is a moisturizer, a toner, an acne treatment formula, a wrinkle or fine line treatment formula, or a cosmetic. As the applicator surface, illustrated herein as a roller ball 110, moves or rolls, the formula F from the reservoir 130 is applied to a surface.

[0032] In some embodiments, the applicator 100 further includes a plunger 145 configured to push the formula F toward the roller ball 110 as the formula is applied. In some embodiments, the plunger 145 is controlled by circuitry on a dispensing device or on the applicator 100 itself to push the formula F toward the applicator surface at a rate set to control the flow rate of the formula F onto the surface of the roller ball 110.

[0033] In some embodiments, the applicator 100 includes an applicator processor 140. In some embodiments, the applicator processor 140 performs functions related to applying treatments. In some embodiments, the applicator processor 140 also performs functions related to obtaining and storing information related to skin conditions and treatments, and tracking the progress of treatments over time.

[0034] With respect to treatment-related functions, in some embodiments, the applicator processor 140 is configured to control the plunger 145 to push the formula F toward the applicator surface 110 to apply the formula to the skin, to apply other treatments such as light treatments, or to control other aspects of the applicator 100.

[0035] With respect to functions relating to obtaining and storing information relating to skin conditions and treatments, and tracking the progress of treatments over time, in some embodiments, the applicator processor 140 is further configured to obtain position sensor data from a position sensor module and calculate a position of the applicator on the skin based on the position sensor data. As another example, the applicator processor 140 may be further configured to obtain, via a skin condition sensor module, skin condition sensor data and determine, based on the skin condition sensor data, skin condition information at the calculated position.

[0036] [Fig. 1B] is an example of a sectional view of the applicator 100 along the line of section C of [Fig.lA]. In the example shown in [Fig.lB], the applicator 100 further includes one or more sensor modules 135, such as a position sensor module and a skin condition sensor module.

[0037] In some embodiments, the sensor module 135 includes a skin condition sensor module configured to obtain skin condition sensor data to detect a condition of a portion of the skin. In some embodiments, the sensor module 135 transmits skin condition data to a processor, such as the applicator processor 140, for analysis. In some embodiments, the skin condition sensor module includes a skin hydration sensor, a skin elasticity sensor, or a combination thereof. An elasticity sensor of the skin may take the form of a probe device configured to measure the mechanical and viscoelastic properties of the skin, such as by applying suction to the skin and measuring the skin's resistance to that suction, or by the use of tonometry. A skin hydration sensor may include, for example, a capacitance sensor or a conductance sensor.

[0038] In some embodiments, the sensor module 135 includes a position sensor module configured to obtain position sensor data to calculate a position of the applicator 100 on the skin. In some embodiments, the position sensor module includes a two-dimensional (2D) or three-dimensional (3D) camera module, a proximity sensor, a gyroscope, an accelerometer, or a combination thereof. In some embodiments, the camera module includes one or more cameras configured to take one or more 2D or 3D images (i.e., still images or video) of the skin as the user moves the applicator over the skin. In some embodiments, the camera module includes a microscope camera to capture magnified images of the area of ​​interest on the skin.Image capture may be facilitated by illumination provided by one or more light sources, such as light sources positioned on the applicator. These images may be captured by the camera in, for example, the visible, infrared, or ultraviolet spectrum, or a combination thereof. The images captured by the camera may be used to calculate the position of the applicator on the skin, for example by comparing the captured images with known skin landmarks. Alternatively, the position may be calculated based on images captured by one or more cameras positioned at a distance from the applicator, such that the images capture both the applicator itself and the body part on which the applicator is located.Other sensors such as accelerometers can also be used to calculate the speed of the applicator across the skin surface, the orientation of the applicator relative to the skin surface, or other information.

[0039] In some embodiments, the applicator 100 is configured to deliver radiation treatment via one or more radiating elements 125A, 125B, 125C. Although three radiating elements 125A, 125B, 125C are illustrated in [Fig. 1B], it is to be understood that more or fewer radiating elements 125A, 125B, 125C may be incorporated into the applicator 100. In some embodiments, the radiating elements 125A, 125B, 125C include antennas. In some embodiments, the radiating elements 125A, 125B, 125C are located behind and around the applicator surface 110 as shown in [Fig. 1B]. In some embodiments, the radiating elements 125A, 125B, 125C are configured to produce one or more beams of radiant energy and direct radiation energy to the skin. In some embodiments, the sensor module 135 includes a sensor module configured to determine an intensity, power, amplitude, or frequency of applied radiation energy. In some embodiments, the radiation treatment comprises phototherapy. In some embodiments, the radiation treatment is ultraviolet (UV) treatment. In some embodiments, the UV treatment is used to treat eczema, psoriasis, jaundice, vitiligo, mycosis fungoides, and the like.

[0040] [Fig. 1C] is another example of a cross-sectional view of the applicator 100 along section line C of [Fig. 1A]. In some embodiments, the applicator 100 is configured to apply one or more light treatments or otherwise illuminate the skin with one or more light sources 220A, 220B. Although two light sources 220A, 220B are illustrated, it should be understood that more or fewer light sources may be incorporated into the applicator 100. The skin condition data may be sent to the applicator processor 140, which may instruct the applicator 100 to apply one or more light treatments or take another action, such as illuminating the skin surface for image capture.In some embodiments, light sources 220A, 220B are configured to deliver light treatment, including, but not limited to, blue light, yellow light, near infrared light, or a combination thereof.

[0041] Those skilled in the art should understand that in some embodiments, the applicator 100 may be configured to deliver both radiation therapy and light therapy, simultaneously or independently. The individual figures should not be construed as mutually exclusive. For example, in some embodiments, the applicator 100 may include all of the components illustrated in both Figures 1B and 1C.

[0042] In some embodiments, the applicator processor 140 determines whether to administer one or more treatments, such as applying one or more formulas F from the formula reservoir 130 or applying a light treatment, a phototherapy treatment, or a radiation treatment, or to set or adjust parameters for such treatments. In some embodiments, as treatments are applied, treatment characteristics are collected. In some embodiments, the treatment characteristics include a timestamp of the time the treatment was applied. In some embodiments, the treatment characteristics include environmental data describing the environment in which the treatment was applied, such as ambient temperature, humidity, levels pollution, or the like. In some embodiments, the treatment characteristics include details of the treatment applied, such as an identifier of a dispensed formula, an amount of the dispensed formula, an identifier of a type of light therapy or phototherapy treatment; an intensity, wavelength, or duration of a type of light therapy or phototherapy treatment, or a combination thereof.

[0043] [Fig. 2A] is another example of an applicator 100, in accordance with the present technology. In the example shown in [Fig. 2A], the applicator includes a flat applicator surface 110. In operation, the applicator surface 110 can be moved over the skin. In some embodiments, the applicator surface 110 is the same size and shape as the platform 120. In some embodiments, the applicator surface 110 is integrated into the platform 120. In some embodiments, the applicator surface 110 includes openings, such as to allow formula to be expelled through one or more nozzles positioned at or below the applicator surface, as shown in Figures 2B and 2C.In some embodiments, the applicator surface 110 is at least partially transparent or translucent, which may be useful, for example, to allow light from light sources in the upper end of the base device 200 or on the platform 120 to pass through the applicator surface.

[0044] Figures 2A and 2B are exemplary cross-sectional views of an applicator, in accordance with the present technology. In the examples shown in Figures 2B and 2C, the applicator 100 includes a body 105, an applicator surface 110, a platform 120, a sensor module 135, one or more formula reservoirs 130 configured to contain a formula F, a plunger 145, and an applicator processor 240.

[0045] In some embodiments, multiple formula reservoirs (e.g., reservoirs 130A-130C) located within the body 105 are configured to contain one or more formulas F or formula ingredients. In some embodiments, the one or more formulas F are a skin care formula. In some embodiments, the skin care formula is a moisturizer, a toner, an acne treatment, a wrinkle treatment, a fine line treatment, or a cosmetic. As the applicator surface, illustrated herein as a flat applicator surface 110, moves across the surface, the formula F from the reservoir 130 is applied to the surface via one or more nozzles (e.g., nozzles 150A-150C).

[0046] In some embodiments, the applicator 100 further includes a plunger 145 configured to push the formula F toward the nozzles 150A, 150B, 150C as formula F is applied. In some embodiments, the plunger 145 receives a command from circuitry on a base device or on the applicator itself to push the formula F toward the applicator surface 110.

[0047] In some embodiments, the applicator 100 includes an applicator processor 240. In some embodiments, the applicator processor 240 is configured to control components of the applicator to perform one or more functions, such as to instruct the plunger to push the formula F toward the applicator surface 110. In some embodiments, the applicator processor 240 may be further configured to detect a skin condition with one or more sensors as described herein, and / or to instruct the applicator 100 to apply one or more treatments, as described herein.

[0048] In the example shown in [Fig.2B], the applicator 100 includes a plurality of formula reservoirs 130A, 130B, 130C configured to contain formulas F1, F2, F3. In some embodiments, the formula reservoirs 130A, 130B, 130C are fluidly coupled to the nozzles 150A, 150B, 150C. In some embodiments, each nozzle is configured to dispense a different formula. In some embodiments, multiple reservoirs are coupled to a single nozzle, which may be useful for mixing formulas or ingredients from separate reservoirs before they are expelled from the nozzle. In some embodiments, individual reservoirs are coupled to more than one nozzle, which may be useful for distributing the formula over a wider area of ​​the applicator surface.

[0049] In the examples shown in Figures 2B and 2C, the applicator 100 further includes one or more sensor modules 135, as described herein. In some embodiments, the applicator 100 is configured to deliver one or more light treatments with a light source 220. Although only one light source 220 is illustrated in [Fig. 2B], more or fewer light sources may be incorporated into the applicator 100. In some embodiments, the light treatment is a near infrared (NIR) light treatment, a red light treatment, a blue light treatment, and / or a yellow light treatment.

[0050] In some embodiments, the sensor module 135 includes a skin condition sensor module configured to detect a condition of a portion of the skin. In some embodiments, a processor (e.g., the applicator processor 240) instructs the sensor module 135 to collect skin condition data as the applicator is moved over the skin and receives the collected skin condition data from the sensor module 135. In some embodiments, the applicator processor 240 (or another internal or external processor or combination of processors) uses the skin condition data collected by the sensor module 135 to determine skin conditions at that location, to determine whether or not when to apply treatments to the skin at that location, or to perform another function.

[0051] In the example shown in [Fig.2C], the applicator 100 includes a reservoir 130 configured to contain a formula F, and one or more radiating elements 155A, 155B, 155C on an applicator surface 110 having openings through which the nozzles 150A, 150B can expel the formula F.

[0052] In some embodiments, the sensor module 135 is configured to obtain skin condition data of at least a portion of the skin and transmit the skin condition data to the applicator processor 240. In some embodiments, the sensor module 135 is configured to obtain radiation energy intensity, power, amplitude, or frequency data. In some embodiments, the applicator processor 240 is configured to detect a skin condition based on sensor data obtained from the sensor module 135 and determine whether to administer one or more treatments, such as applying formula F from the formula reservoir 130, applying a radiation treatment, applying a light treatment, or combinations thereof.

[0053] Figures 3A and 3B are top views of exemplary applicators 100, in accordance with the present technology. In some embodiments, sensors of one or more sensor modules, light sources, or both, are arranged on the applicator 100 in a ring configuration. In some embodiments, the applicator 100 includes two light sources 220A, 220B located on opposite sides of the ring, as shown in [Fig. 3A]. In some embodiments, the applicator 100 includes a plurality of sensors 135A, 135B... 135N in a ring configuration or other configuration, and the sensors may be associated with one or more sensor modules (e.g., a skin condition sensor module, a position sensor module).In this manner, the applicator 100 may obtain data that allows the applicator (or other device or system) to determine skin conditions on one or more portions of the skin, as a user moves the applicator 100. In some embodiments, the sensors 135A, 135B... 135N may be used to determine skin conditions in a full 360-degree field of view from the applicator surface 110.

[0054] In some embodiments, the light sources 220A, 220B, 220C, 220D, 220E, 220F, 220G may be alternated or otherwise interleaved with the one or more sensor modules 135A, 135B, 135C, 135D, 135E, 135F, 135G, as shown in the illustrative configuration of [Fig. 3B]. In some embodiments, the applicator 100 may both detect a condition of one or more areas of the skin and deliver light treatment or phototherapy treatment as the applicator moves across the skin in any direction.

[0055] In some embodiments, the user may apply the formula to their skin during the application of a light treatment, such as a near infrared (NIR) light treatment, a red light treatment, a blue light treatment, a yellow light treatment, or a combination thereof, to further treat the condition. In some embodiments, the user may apply the formula to their skin during the application of a radiation treatment, such as x-rays, gamma rays, electrons, protons, neutrons, or a combination thereof to further treat the condition. In some embodiments, the radiation treatment is ultraviolet (UV) light. In some embodiments, the radiation treatment is configured to treat eczema, psoriasis, jaundice, mycosis fungoides, and the like.

[0056] Although [Fig. 3A] is illustrated as having a rolling ball applicator surface 110 and [Fig. 3B] is illustrated as having a flat applicator surface 110 with a plurality of nozzles 150A, 150B, 150C, 150D, either applicator surface 110 could be incorporated with any arrangement of sensors or light sources disclosed herein, or other arrangements not limited to those shown in Figures 3A and 3B.

[0057] In some embodiments, one or more of the sensors 135A, 135B, 135C, 135D, 135E, 135F, 135G are configured to measure an impedance, a capacitance, a deflection, a color, a texture, or a combination thereof of the skin. In some embodiments, individual sensors or sensor modules are configured to measure each of the distinct parameters (capacitance, impedance, deflection, a color, a texture, etc.). In some embodiments, individual sensors or sensor modules are configured to measure a combination of parameters. In some embodiments, duplicate sensors are configured to measure the same parameter at different locations on the applicator.In some embodiments, the condition to be detected based on data obtained from these sensors is hyperpigmentation, acne, fine lines, wrinkles, sun damage, hydration, collagen production, elasticity, oiliness, or a combination thereof.

[0058] [Fig. 4] is an example of a system 1000 including an applicator 100 and a base device 200, in accordance with the present technology. In the example shown in [Fig. 4], the system 100 includes light sources 220A and 220B, actuators 230, and a sensor module 135.

[0059] In some embodiments, the base device 200 includes an end 210. The end 210 may be configured to be visible through the platform 120 on the applicator 100. In some embodiments, the end 210 of the base device 200 includes the light sources 220A, 220B, which are configured to emit light for delivery of a light treatment to a surface. The light treatment may be delivered while other treatments are being performed, such as during application of the formula by the applicator 100.

[0060] In some embodiments, the light sources 220A, 220B are LEDs. In some embodiments, a first light source 220A is configured to deliver light treatment in a first wavelength, and a second light source 220B is configured to deliver light treatment in a second wavelength. In some embodiments, the light treatment in the first wavelength and the light treatment in the second wavelength are delivered simultaneously.

[0061] The actuators 230 may be configured to begin delivery of treatments such as light treatment, formula application, or other treatments or combinations of treatments. In the example shown in [Fig. 4], the one or more actuators 230 include a power button 235 and an application button 245. In some embodiments, the power button 235 is configured to turn the base device on or off, while the application button 245 is configured to deliver one or more treatments described herein, including light treatment, radiation treatment, or application of one or more formulas. In the example shown in [Fig. 4], the actuators 230 are illustrated as buttons. In some embodiments, the actuators 230 may be switches, capacitive touch-type buttons, dials, or the like.

[0062] In some embodiments, the base device 200 further includes a base device processor 255. In some embodiments, the base device processor 255 is configured to instruct the applicator 100, the base device 200, or both, to perform functions such as collecting sensor data, determining states based on collected sensor data, storing collected information, transmitting collected information to other devices, or administering one or more treatments. In some embodiments, the base device 200 also includes a contactless chip reader (not shown in [Fig. 4]) to perform functions such as reading information from an RFID tag on the applicator 100.

[0063] [Fig. 5] is another example of a system 2000, in accordance with the present technology. The system, which implements an applicator 100 and a base device 200 as described herein, further includes a connected communication device 300. Optionally, the system may further include one or more servers external devices that are implemented as part of a cloud computing environment. In the example shown in [Fig. 5], the connected communication device is a mobile computing device with a touchscreen, such as a smartphone or tablet. In some embodiments, the communication device 300 may be or operate in combination with a desktop computer, laptop computer, or other computing device.

[0064] In some embodiments, the communication device 300 includes one or more cameras and a user interface such as a touchscreen, which may present interactive features such as representations of skin condition changes over time, video tutorials or animations, or other elements.

[0065] In some embodiments, the communication device 300 executes a client application and an image capture / scanning engine configured to capture and process digital images (e.g., color images, infrared images, depth images, etc.) or other data obtained, for example, from one or more cameras on the applicator 100. In some embodiments, the digital images or scans are processed by the communication device 300 and / or transmitted to a remote computing system for processing, for example, in a 2D or 3D skin surface model engine that maps skin features, skin condition information, or other information into the model. In some embodiments, the captured image data is transmitted to a position tracking engine to determine the position of the applicator 100 relative to a body surface.In some embodiments, the position tracking engine maintains awareness of the location of the target body surface and the location of the applicator in 3D space.

[0066] In some embodiments, 3D digital models described herein are generated based on sensor data obtained from the sensor modules 135. In such embodiments, the digital 3D models are generated by the communication device 300 or another computing device, such as a remote cloud computing system, or a combination thereof. In some embodiments, the digital 3D models include 3D topology and texture information, which can be used to reproduce an accurate representation of a body surface, such as facial structure and skin features.

[0067] In some embodiments, the communication device 300 prepares information for transmission to, or receives and interprets information from, other devices or systems, such as a remote computer system or a base device 200. This information may include captured digital images, scans, or videos; device settings; personalized care routines specifying, for example, formula application information or light treatment information; user preferences; usage data, user identifiers, device identifiers, or the like.

[0068] In some embodiments, the system 2000 is configured to apply one or more algorithms to a photo or video of a user to detect one or more skin conditions. In some embodiments, the system 2000 uses deep learning algorithms that employ artificial neural networks to identify combinations of image features in input images of the skin and classify those input images as including skin conditions such as acne, hyperpigmentation, rosacea, wrinkles, fine lines, wounds, or other conditions. Such algorithms may further consider information other than images to identify a condition, such as user questionnaire information. In some embodiments, the deep learning algorithms are trained using a supervised learning approach.In some embodiments, the communication device 300 communicates the detected condition to a user of the system and proposes one or more treatments to be applied by the applicator 100.

[0069] In some embodiments, the system 2000 may further obtain environmental condition information with one or more environmental sensors or from another source, such as a server computer. In some embodiments, the environmental conditions may include temperature, humidity, ultraviolet (UV) radiation levels, pollution levels, etc. In some embodiments, the application may collect environmental data from other sources such as weather services. In some embodiments, the application may further recommend to the user a formula, consisting of one or more skin ingredients, based on the skin's particularity and / or the detected environmental conditions.

[0070] In some embodiments, the user may establish a user profile on the application of the communication device 300. In some embodiments, establishing the user profile includes responding to a user questionnaire. In some embodiments, the user questionnaire gives the user a series of inputs including a prior skin treatment, prior use of the application, a desired skin quality, or a skin condition. In some embodiments, a client application running on the communication device 300 may solicit feedback from the user regarding their favorite or most effective formulation to help improve the algorithm.

[0071] In one embodiment, a skincare routine engine performs data processing such as identifying changes in skin condition or generating or adjusting a skincare routine, such as making adjustments to treatment parameters or recommending new products. The skincare routine engine may be implemented on the communication device 300 or on another device or system, such as a server in a cloud computing environment. A skincare routine may include, for example, programmatic skincare routine instructions to apply treatments, collect data (e.g., image data, depth data, usage data, or other data), or perform other functions according to the techniques described herein.In one embodiment, the care routine engine generates care routine information based on user information from a user profile data store, a product data store, or any other source or combination of sources. The care routine engine may employ machine learning or artificial intelligence techniques (e.g., pattern matching, feature extraction and matching, classification, artificial neural networks, deep learning architectures, genetic algorithms, etc.).For example, to identify changes in skin condition or generate or update treatment parameters, the skincare routine engine may analyze (e.g., using computer vision and / or machine learning techniques described herein) digital scans to measure or map wrinkles, pigmentation, skin texture, etc., of the user's skin in a single image or a series of images captured over time. In such a scenario, the skincare routine engine may use this information to recommend, generate, or modify a particular skincare routine that suits the particular characteristics of the user's skin.

[0072] In addition to the technical benefits of the disclosed embodiments that are described elsewhere herein, numerous other technical benefits are achieved in certain embodiments. For example, the system allows certain aspects of the process to be conducted independently by personal care devices or client computing devices, while shifting other processing loads to a remote computer system (which may be a relatively powerful and reliable computer system), thereby improving performance and preserving battery life for the functionality provided by the personal care devices or client computing devices.

[0073] In general, the word "engine," as used herein, refers to logic embedded in hardware or software instructions written in a programming language, such as C, C++, COBOL, JAVA™, PHP, Perl, H™L, CSS, JavaScript, VBScript, ASPX, Microsoft.NET™, and / or similar. An engine may be compiled into executable programs or written in interpreted programming languages. Software engines may be called from other engines or from within themselves. In general, the engines described herein refer to logic modules that may be merged with other engines or divided into sub-engines. Engines may be stored in any type of computer-readable media or computer-based storage device and may be stored on and executed by one or more general-purpose computers, thereby creating a specialized computer configured to provide the engine or its functionality.

[0074] As understood by a person skilled in the art, a "data store" as described herein may be any suitable device configured to store data for access by a computing device. An example of a data store is a high-speed, highly reliable relational database management system (DBMS) that runs on one or more computing devices and is accessible over a high-speed network. Another example of a data store is a key-value store. However, any other suitable technique and / or storage device capable of quickly and reliably providing the stored data in response to queries may be used, and the computing device may be accessible locally rather than over a network, or may be provided as a cloud service.A data store may also include data stored in an organized manner on a computer-readable storage medium, as described below. One skilled in the art will recognize that separate data stores described herein may be combined into a single data store, and / or that a single data store described herein may be separated into multiple data stores, without departing from the scope of the present disclosure.

[0075] The devices shown in [Fig. 5] may communicate with each other via a network (not shown), which may include any suitable communication technology including but not limited to wired technologies such as DSL, Ethernet, fiber optics, USB, and Firewire; wireless technologies such as Wi-Fi, WiMAX, 3G, 4G, LTE, 5G, and Bluetooth; and the Internet. In general, communication between the computing devices or components of [Fig. 5], or other computing components or devices used in accordance with the described embodiments, occurs directly or through intermediary components or devices.

[0076] [Fig. 6] is an exemplary method 600 of using a personal care system to apply and monitor treatments and determine skin condition, in accordance with the present technology. In some embodiments, the system is system 1000 or system 2000 as shown and described in Figures 4 and 5. In some embodiments, the system includes an applicator (such as applicator 100 in Figures 1A-5), sensor modules including one or more sensors (as shown in Figures 1B, 1C, 2B, 2C, 3A, 3B, and 4), and one or more processors (such as applicator processor 140, 240, or base device processor 255 as described herein). Although the description in [Fig. 6] and other descriptions herein refer to a "processor" for ease of explanation, it should be understood that in some embodiments, multiple processors on the same device or on multiple devices may be used to perform the described functions. In some embodiments, the system includes one or more light sources (such as light sources 220 described herein) or one or more radiating elements (such as radiating elements 135 as described herein).In some embodiments, the system further includes a communication device (such as communication device 300) and / or a base device (such as base device 200).

[0077] At block 610, the system obtains, via a position sensor module, position sensor data. In some embodiments, the position sensor module includes a camera, a proximity sensor, a gyroscope, an accelerometer, or a combination thereof. In some embodiments, the position sensor data includes still images or videos, proximity data, orientation data, acceleration data, or other data useful for calculating the position or orientation of an applicator in use.

[0078] At block 620, the system calculates, based on the position sensor data, a position of the applicator in use. In some embodiments, the calculated position includes spatial coordinates, such as 2D coordinates (X / Y) in 2D space or 3D coordinates (X / Y / Z or mesh coordinates) in 3D space. In some embodiments, the calculated position of the applicator corresponds to a particular location on the user's skin.

[0079] At block 630, the system applies a treatment to the skin at the calculated position, using the one or more treatment techniques or devices described herein.

[0080] At block 640, the system determines treatment characteristics of the treatment applied to the skin at the calculated position. By calculating the position and cross-referencing the treatment characteristics applied at that position, the system is able to store detailed information that allows tracking of treatments and the progress of those treatments over time. In some embodiments, the treatment characteristics include a timestamp. In some embodiments, such as for applying a formula to the skin, the treatment characteristics further include an identifier of a dispensed formula, an amount of the dispensed formula, or a combination thereof. In some embodiments, such as for light treatments, phototherapy treatments or radiotherapy treatments, the treatment characteristics further include a treatment intensity, a treatment wavelength, a treatment duration or a combination thereof.

[0081] At block 650, the system obtains, via a skin condition sensor module, skin condition sensor data. In some embodiments, the skin condition sensor module includes a camera, a skin hydration sensor, a skin elasticity sensor, or a combination thereof. In some embodiments, the skin condition sensor data includes still images or videos, skin hydration data (e.g., capacitance data or conductance data), skin elasticity data (e.g., mechanical strength data or tonometry data), or a combination thereof.

[0082] At block 660, the system determines, based on the skin condition sensor data, skin condition information at the calculated position. In some embodiments, the skin condition sensor data may enable the applicator, the base device, the communication device, or an external computing device (such as a server computer in a cloud computing environment) to determine a condition of a portion of the skin. In some embodiments, the condition is hyperpigmentation, acne, fine lines or wrinkles, sagging, sun damage, hydration level, elasticity, oiliness, or a combination thereof.In some embodiments, the determination of the skin condition is performed by one or more processors, which may be located on the applicator, the base device, the communication device, or another computing device (such as a server in a cloud computing environment), or a combination thereof.

[0083] At block 670, the system stores the calculated position, treatment characteristics, and skin condition information. This information may be stored in volatile or non-volatile storage media in the applicator, the base device, the communication device, or an external computing device (such as a server computer in a cloud computing environment).

[0084] [Fig. 7] is an example method 700 of using a personal care system to monitor the progress of treatments and make adjustments based on the progress of treatments, in accordance with the present technology. In some embodiments, the system is system 1000 or system 2000 as shown and described in Figures 4 and 5. In some embodiments, the system includes an applicator (such as applicator 100 in Figures 1A-5), sensor modules including one or more sensors (as shown in Figures 1B, 1C, 2B, 2C, 3A, 3B, and 4), and one or more processors (such as the applicator processor 140, 240 or the base device processor 255 as described herein).

[0085] At block 710, the system obtains stored information including treatment characteristics and skin condition information, cross-referenced with the calculated position of an applicator that applies the treatment(s) at that position.

[0086] At block 720, the system generates a visualization, such as a time-lapse animation, of skin condition changes based on the stored information. This can help show users the progress of skin treatments and suggest ways to adjust treatments to achieve better results. Optionally, the skin condition information is compared to a baseline skin condition, such as a prior skin condition, and an average condition over time, or a desired skin condition. In some embodiments, the baseline condition is stored and / or communicated to the user with the base device or the communication device. In some embodiments, the communication device stores each instance of the user applying one or more treatments, creating a user history of position information, treatment characteristics, and skin condition information.Optionally, the reference states are updated over time based on this information. The visualization may include an image or 3D model of a treated skin area, such as a 3D mesh object with skin condition features, treatment characteristics, or other information mapped onto the object. In some embodiments, one or more portions of the skin are highlighted. In some embodiments, the one or more portions are highlighted on the communication device, either graphically or overlaid on a model or image taken with the one or more sensor modules. In some embodiments, the one or more portions are areas where a treatment has or has not been applied, a condition has been detected, a change in condition has been detected, or a combination thereof.In some embodiments, different colors, symbols, patterns, or the like may be used to distinguish areas of interest, such as highlighting areas where treatment was successful in green, and areas where further treatment is needed in red. An animation of the progress of treatment over time may include gradual changes in color (e.g., from red to green to show areas responding well to treatment) or other visual features in the corresponding skin areas.

[0087] At block 730, the system obtains a recommendation from a recommendation engine or adjusts the treatments based on the stored information. In some embodiments, the system determines whether to periodically adjust the one or more treatments. In some embodiments, the system adjusts one or multiple parameters of the one or more treatments (e.g., formula flow rate, formula type, wavelength, intensity, duration, etc.) after a predetermined time interval. In some embodiments, the base device adjusts the one or more treatments after a predetermined time interval. In some embodiments, the system determines whether to adjust one or more parameters of the one or more treatments after each use. In some embodiments, the system identifies a product (such as a new or previously used formula) based on the stored information and automatically places an order to obtain the product.

[0088] It should be understood that methods 600 and 700 are to be interpreted as purely representative. In some embodiments, the process blocks of methods 600 and 700 may be performed simultaneously, sequentially, in a different order, or even omitted, without departing from the scope of the present disclosure.

[0089] Embodiments disclosed herein may employ circuitry to implement technologies and methodologies described herein, operatively connect two or more components, generate information, determine operating conditions, control an apparatus, device, or method, and / or the like. Circuitry of any type may be used. In one embodiment, the circuitry includes, among other things, one or more computing devices such as a processor (e.g., a microprocessor), a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or the like, or any combination thereof, and may include discrete digital or analog circuit elements or electronics, or combinations thereof.

[0090] One embodiment includes one or more data stores that, for example, store instructions or data. Non-limiting examples of one or more data stores include volatile memory (e.g., random access memory (RAM), dynamic random access memory (DRAM), and the like), non-volatile memory (e.g., read only memory (ROM), electrically erasable programmable read only memory (EEPROM), compact disk read only memory (CD-ROM), and the like), persistent memory, or the like. Other non-limiting examples of one or more data stores include erasable programmable read only memory (EPROM), flash memory, or the like. The one or more data stores may be connected, for example, to one or more computing devices by one or more instruction, data, or power buses.

[0091] In one embodiment, the circuitry includes a computer-readable media player or memory bank configured to accept a signal-carrying medium (e.g., computer-readable memory medium, computer-readable recording medium, or the like). In one embodiment, a program for causing a system to perform any of the disclosed methods may be stored, for example, on a computer-readable recording medium (CRMM), a signal-carrying medium, or the like.Non-limiting examples of signal-carrying media include a recordable-type medium such as any form of flash memory, magnetic tape, floppy disk, hard disk, compact disc (CD), digital video disc (DVD), Blu-ray disc, digital tape, computer memory, or the like, as well as a transmission-type medium such as a digital and / or analog communication medium (e.g., fiber optic cable, waveguide, wired communication link, wireless communication link (e.g., transmitter, receiver, transceiver, transmit logic, receive logic, etc.).Other non-limiting examples of signal-carrying media include, but are not limited to, DVD-ROM, DVD-RAM, DVD+RW, DVD-RW, DVD-R, DVD+R, CD-ROM, Super Audio CD, CD-R, CD+R, CD+RW, CD-RW, video compact discs, super video discs, flash memory, magnetic tape, magneto-optical disc, MINIDISC, non-volatile memory card, EEPROM, optical disc, optical storage, RAM, ROM, system memory, web server, or the like.

[0092] The detailed description set forth above in connection with the accompanying drawings, where like numerals refer to like elements, is intended as a description of various embodiments of the present disclosure and is not intended to represent the only embodiments. Each embodiment described in this disclosure is offered solely by way of example or illustration and should not be construed as preferred or advantageous over other embodiments. The illustrative examples provided herein are not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Likewise, any steps described herein may be interchangeable with other steps, or combinations of steps, to achieve the same or a substantially similar result.In general, the embodiments disclosed herein are not limiting, and the inventors contemplate that other embodiments within the scope of this disclosure may include structures and features from more than one specific embodiment shown in the figures and described in the specification.

[0093] The principles, representative embodiments, and modes of operation of the present disclosure have been described in the foregoing description. However, aspects of the present disclosure, which are intended to be protected, should not be construed as being limited to the particular embodiments disclosed. Furthermore, the embodiments described herein should be considered illustrative rather than restrictive. It should be appreciated that variations and changes may be made by others, and equivalents employed, without departing from the spirit of the present disclosure. Accordingly, it is expressly intended that all such variations, changes, and equivalents fall within the scope of the present disclosure as claimed.

Claims

Claims

1. A personal care system comprising: an applicator (100) including a body (105) and an applicator surface (110) coupled to the body (105), wherein the applicator surface (110) is configured to apply a formula to the skin; a position sensor module; a skin condition sensor module; a processor (140); and a memory having stored therein computer-executable instructions configured to cause the personal care system to perform steps comprising: obtaining, via the position sensor module, position sensor data; calculating, based on the position sensor data, a position of the applicator on the skin; applying a treatment to the skin at the calculated position; determining treatment characteristics of the treatment applied to the skin at the calculated position;obtaining, via the skin condition sensor module, skin condition sensor data; determining, based on the skin condition sensor data, skin condition information at the calculated position; and storing the calculated position, treatment characteristics, and skin condition information.;

2. The personal care system of claim 1, wherein the skin condition sensor module includes a skin hydration sensor, a skin elasticity sensor, or a combination thereof.

3. The personal care system of claim 1, wherein the position sensor module includes a camera, a proximity sensor, a gyroscope, an accelerometer, or a combination thereof.

4. The personal care system of claim 1, wherein the processing features include a timestamp.

5. The personal care system of claim 4, wherein the treatment characteristics further include an identifier of a distributed formula, a quantity of the distributed formula, or a combination thereof.

6. The personal care system of claim 4, wherein the treatment characteristics further include a treatment intensity, a treatment wavelength, a treatment duration, or a combination thereof.

7. The personal care system of claim 1, wherein the skin condition information comprises an image of the skin at the calculated position, skin elasticity information, skin hydration information, or a combination thereof.

8. Cl. The personal care system of claim 1, wherein the computer-executable instructions are further configured to cause the personal care system to compare the determined skin condition information with a reference condition and adjust one or more treatments based on the comparison.

9. The personal care system of claim 1, further comprising one or more light sources, and wherein the treatment comprises light treatment or phototherapy treatment.