WRINKLE DETECTION AND TREATMENT SYSTEM

Abstract

WRINKLE DETECTION AND TREATMENT SYSTEM A system for treating skin, the system including at least one cartridge containing a skincare material, a dispensing device including at least one chamber configured to accept the at least one cartridge, and a processor communicatively coupled to the dispensing device, wherein the processor is configured to view an image of a user's skin, detect one or more features on the user's skin with image processing, and apply the skincare product to the one or more skin conditions of the user via an applicator on the dispensing device. Figure for Abstract: 1

Description

Title of the invention: WRINKLE DETECTION AND TREATMENT SYSTEM SUMMARY

[0001] This summary is provided to present a selection of concepts in a simplified form that are described in more detail herein in the detailed description. This summary is not intended to identify key features of the claimed subject matter, nor to be used as an aid in determining the scope of the claimed subject matter.

[0002] As we age, we develop wrinkles, fine lines, and other skin conditions. In some cases, it can be difficult to detect where these wrinkles begin and end, and treatment often includes invasive techniques, including the use of needles. Described herein are a system for detecting skin features such as wrinkles, fine lines, and pigmentation, and an applicator capable of treating and concealing skin features in a precise, localized manner without the use of invasive methods. Also described herein is a system for applying localized makeup to the face, such as coloring a user's eyebrows or applying eyeliner.

[0003] In one aspect, there is disclosed a system for treating skin, the system comprising at least one cartridge containing a skin formula, a dispensing device configured to accept the at least one cartridge, and a processor communicatively coupled to the dispensing device, wherein the processor is configured to view an image of a user's skin, detect one or more features on the user's skin with image processing, and apply the skin formula to the one or more skin conditions of the user via an applicator on the dispensing device.

[0004] In another aspect, there is disclosed a method of applying a skin treatment with the system of any preceding claim, the method comprising viewing an image of a user's skin, detecting one or more features on the user's skin with image processing, and applying the skin formula to the one or more features on the user's skin via the applicator on the dispensing device. DESCRIPTION OF THE DRAWINGS

[0005] The foregoing aspects and numerous related advantages of this invention will be more readily appreciated as they are better understood with reference to the following detailed description, when taken in conjunction with the accompanying drawings, in which:

[0006] [Figs. 1A-1B] Figures 1A and 1B are examples of skin care devices, in accordance with the present technology;

[0007] [Fig.2] [Fig.2] is an internal view of an exemplary skin care device, in accordance with the present technology;

[0008] [Fig.3] [Fig.3] is an example of a skin care system, in accordance with the present technology; and

[0009] [Fig.4] [Fig.4] is a flowchart of a method of treating a feature on a user's skin, in accordance with the present technology. DETAILED DESCRIPTION

[0010] Although illustrative embodiments have been illustrated and described, it will be appreciated that various modifications may be made thereto without departing from the spirit and scope of the invention.

[0011] Described herein are systems and methods for detecting a feature on a user's skin and accurately applying a skin formula to that feature. In some embodiments, the feature is a wrinkle, a fine line, pigmentation, hyperpigmentation, or acne. In some embodiments, the feature is an eyebrow, an upper lash line, a lower lash line, or a mucous membrane of the eye. In some embodiments, the skin formula is a skin treatment such as a wrinkle or acne treatment. In some embodiments, the treatment is a concealer. In some embodiments, the skin formula is a skin treatment and a concealer. In some embodiments, the skin treatment is a cosmetic such as an eyebrow tint or an eyeliner.In some embodiments, the skincare device includes an infrared camera and an optical sensor to view images of the user's skin as the user moves the device over their face. In some embodiments, a processor on the skincare device detects the skin feature using image processing. In some embodiments, the image processing includes segment-based image processing. In some embodiments, the image processing includes a facial landmark detection algorithm. In one embodiment, the user actuates a user input to instruct the skincare device to apply the skin formula.

[0012] In one embodiment, the skin care device is communicatively coupled to a communication device, such as a smartphone. In some embodiments, the user may command the skin care device to skin to begin taking images or applying the skin formula through an interface on the communication device. In some embodiments, the skin care device or the communication device may alert the user that the skin formula is about to be applied.

[0013] In some embodiments, a system for treating skin is disclosed, the system comprising at least one cartridge containing a skin formula, a dispensing device configured to accept the at least one cartridge, and a processor communicatively coupled to the dispensing device, wherein the processor is configured to view an image of a user's skin, detect one or more features on the user's skin with image processing, and apply the skin formula to the one or more skin conditions of the user via an applicator on the dispensing device.

[0014] In some embodiments, the skin care device is configured to accept one or more cartridges containing a skin formula. In some embodiments, the skin formula is a skin treatment, such as a wrinkle treatment or an acne treatment. In some embodiments, the skin formula is a cosmetic, such as a concealer, an eyebrow tint, or an eyeliner. In some embodiments, the skin formula is both a skin treatment and a concealer.

[0015] Figures 1A and 1B are examples of skin care devices, in accordance with the present technology. The skin care device 100 may include a body 105, a cartridge 110, and an applicator 190. In some embodiments, the skin care device 100 also includes a handle 125. In some embodiments, the handle 125 and the body 110 are removably attached, but in other embodiments, the handle 125 and the body 110 are integral. In some embodiments, the skin care device 100 includes a user input 135.

[0016] As illustrated in Figure 1A, the skin care device 100 may include a cartridge 110. In some embodiments, the skin care device 100 may include more than one cartridge 100. In some embodiments, the cartridge 110 may be attached to the body 105 of the skin care device 100, as illustrated in Figure 1A, but in some embodiments, the cartridge may be disposed within the body 105 of the skin care device 100, as illustrated in [Fig. 2]. In still other embodiments, the cartridge 110 may be located on another portion of the skin care device 100, for example, inside or on the handle 125.

[0017] In some embodiments, the cartridge 110 contains a skin formula. In some embodiments, the cartridge 110 includes a skin treatment. skin, such as a wrinkle treatment or an acne treatment. In some embodiments, the skin formula is a cosmetic, such as a concealer, an eyebrow tint, or an eyeliner. In some embodiments, the skin formula is a mixture of a wrinkle treatment or an acne treatment and a concealer.

[0018] In some embodiments, the cartridge 110 includes an identifier, such as a QR code or an RFID tag, so that the skincare device 100 can identify the type of skincare formula.

[0019] Although the user input 135 is illustrated as a button in FIG. 1A, the user input 135 may take any number of forms including a switch or a capacitive touch-type button. In operation, the user may actuate the user input to begin the imaging process described in detail herein. In some embodiments, the user may further actuate the user input to instruct the device to apply the skin care formula.

[0020] In some embodiments, such as those illustrated by Figures 1A-1B, the applicator 190 is located on the body 105 of the skin care device 100. In some embodiments, the applicator is a mechanical pump. In some embodiments, the applicator is a solenoid pump. In some embodiments, the applicator is a microfluidic pump. In some embodiments, the applicator is a piezoelectric pump. In some embodiments, there is more than one applicator 190 on the skin care device 100. In some embodiments, all of the applicators 190 dispense the same skin formula to different locations. In some embodiments, the applicators 190 may dispense different formulas, i.e., one applicator 190 dispenses the wrinkle treatment, while another applicator 190 dispenses the concealer.In some embodiments, the user may attach a cartridge containing a skin formula to the skin care device, apply the formula, and then replace the cartridge with another cartridge containing a different skin formula, such that the same applicator may dispense the first and second skin formulas. In operation, as a user moves the skin care device 100 over their face (as illustrated and described in [Fig. 4]), a skin formula may be dispensed by the applicator onto one or more features, thereby treating and / or concealing a portion of the user's skin.

[0021] [Fig. 2] is an internal view of an exemplary skin care device, in accordance with the present technology. In some embodiments, the skin care device 100 includes a cartridge 110, an accelerometer 120, a gyroscope 130, a contact sensor 150, a processor 160, a contact pin 165, a battery 170, an infrared camera 175, a light source 180, and an optical system 185 disposed in the body 105 of the skin care device 100.

[0022] The illustrated skincare device 100 includes an accelerometer 120 and a gyroscope 130. In some embodiments, the accelerometer 120 and the gyroscope 130 are communicatively coupled to the processor 160. In operation, the accelerometer 120 measures the vibration or acceleration of the skincare device in the x, y, and z directions to determine the orientation of the skincare device 100. The gyroscope 130, in operation, similarly senses the angular velocity and orientation of the skincare device 100.

[0023] In some embodiments, the skin care device 100 includes a contact sensor 150, communicatively coupled to the processor 160. In some embodiments, the contact sensor is configured to sense proximity to the user's skin. In some embodiments, the contact sensor is also communicatively coupled to a contact pin 165. In some embodiments, the contact pin is located on the same face of the skin care device 100 as the applicator 190. In operation, when a user moves the skin care device 100 over their face, the contact pin 165 senses proximity between the skin care device 100 and the user's face (not shown in [Fig. 2]).The contact pin may communicate this proximity to the contact sensor 150, which may also communicate with the processor 160, and then determine whether the skin care device 100 is in close enough proximity to the face and a facial feature to apply the skin care formula. Although only one contact pin 165 is illustrated in [Fig. 2], the skin care device 100 may have any number of contact pins 165. In some embodiments, each individual contact pin 165 provides a distinct proximity so that the skin formula is applied by the applicator(s) 190 only in the area in sufficient proximity to the user's face.

[0024] In some embodiments, the skin care device 100 includes a battery 170. Although the battery 170 is described in more detail, the skin care device 100 may include other power sources, e.g., capacitors. In one embodiment, the battery 170 is a rechargeable battery 170 configured to receive power from an external source when, for example, the power supply of the rechargeable battery 170 is depleted. In another embodiment, the battery 170 is a single-use battery 170. In one embodiment, a useful life of the single-use battery 170 corresponds to an intended usage interval of the skin care device. 100. As it is used, the skin care device 100 may wear out, become dirty, or no longer be able to provide its intended benefits. In this regard, when the single-use battery 170 becomes depleted and runs out of power, the skin care device 100 may be configured to signal to a user that the skin care device 100 is ready to be replaced, cleaned, reconditioned, and the like.

[0025] In some embodiments, the skin care device 100 further includes an infrared camera 175, a light source 180, and an optical system 185 communicatively coupled to the processor 160. In some embodiments, the light source 180 and the infrared camera 175 are communicatively coupled to the optical system 185. In some embodiments, the skin care device further includes an optical system configured to determine whether the lighting conditions are suitable for detecting the one or more features of the user's skin. In some embodiments, the optical system 185 may sense whether the user is in suitable lighting conditions for detecting a feature on the user's skin with the infrared camera, as described in more detail in [Fig. 3].If it is determined that the user is not in adequate lighting conditions, the light source 180 may illuminate the user's face to better detect the user's features. If this illumination is still not sufficient to detect the user's features, for example if the user is in a dark room, the skin care device 100 may alert the user to move to another location. After determining that the lighting conditions are adequate to detect the user's features, the infrared camera may view an image of the user's face.

[0026] As the user moves the skin care device 100 over their face, the infrared camera views images of the user's skin. The processor may then assign a probability to each pixel in each image as being either (1) a feature, (2) a facial landmark, or (3) normal skin based on the color of each pixel. In some embodiments, the feature is a wrinkle, fine line, pigmentation, hyperpigmentation, or acne. In some embodiments, the feature is detected based on the color of the pixel. In some embodiments, the feature ranges from pink to red. In some embodiments, the feature is any color that is not the color of the user's normal skin. For example, the processor 160 may identify hyperpigmentation on a user's skin by identifying pixels that are pink or red in color.The processor can then apply a skin formula, such as concealer, to the area that is pink or red. In another . For example, the processor 160 may identify acne on a user's skin by detecting pixels that are pink or red in color and apply both an acne treatment and a concealer to the user's acne.

[0027] In some embodiments, the processor 160 detects wrinkles or fine lines on the user's face by detecting pixels whose color is darker than the user's skin tone on the user's face in an unbroken line segment on the user's face. In some embodiments, the processor assigns a probability to each pixel as being either a wrinkle or the user's flawless skin based on the color. In some embodiments, the processor 160 may then instruct the applicator 190 to apply either a wrinkle treatment, a concealer, or both, to effectively treat and conceal the wrinkle or fine line.

[0028] In some embodiments, the processor 160 sets a probability threshold to determine whether to apply a skin formula to pixels that have a probability of being a skin feature, such as a wrinkle, fine line, acne, pigmentation, or hyperpigmentation. In some embodiments, the probability threshold is hard-coded into the processor 160. In some embodiments, the probability threshold may be adjusted based on user preference or needs. For example, the threshold may need to be higher if the skin feature and the user's skin tone are not very distinct from each other. The threshold may also be lowered when the desired skin feature and the unwanted skin feature are distinct from each other, such as when a user has a lighter skin tone and the feature is red or pink in color.In some embodiments, the probability threshold is set to 85%, 90%, 95%, or 100%. If a pixel exceeds the probability threshold, the processor 160 instructs the applicator 190 to apply a skin formula to that specific area. In some embodiments, the processor 160 may detect one or more wrinkles by detecting an unbroken line of pixels on the user's face. In this case, if the average of the pixels within the unbroken segment exceeds the probability threshold, the processor 160 may instruct the applicator 190 to apply the skin formula to the entire wrinkle on the user's face. In some embodiments, the applicator is configured to move so that it can apply the skin formula to the wrinkle without the user having to move the applicator over the wrinkle.

[0029] In some embodiments, the processor may determine the user's facial features through a facial landmark algorithm. In some embodiments, when the processor 160 identifies a facial feature, it instructs the applicator 190 to apply the skin formula. In In some embodiments, the facial feature is an upper lash line, a lower lash line, a mucous membrane of the eye, or an eyebrow. For example, the processor 160 may identify a user's upper lash line using a facial landmark algorithm and then apply eyeliner to the user's upper lash line. In another example, the processor may identify a user's eyebrow with a facial landmark algorithm and then apply an eyebrow tint to the user's eyebrow.

[0030] [Fig. 3] is an exemplary skin care system, in accordance with the present technology. In some embodiments, the skin care device 100 is communicatively coupled to a communication device 300. Although the communication device 300 is illustrated as a smartphone, the communication device 300 may take the form of a personal computer (PC), a laptop computer, a PDA (personal digital assistant), a smartphone, a tablet, a UMPC (ultramobile personal computer), a mini-laptop computer, or a notebook-type personal computer.

[0031] The communication device 300 is capable of wireless communication with the skincare device 100 by means of wireless communication interface circuitry on the skincare device 100. However, the communication device 300 is also capable of having a wired connection with the skincare device 100 by means of a USB interface on the skincare device. Further, each device, including the skincare device 100, may communicate with each other and with the one or more external devices through an Internet connection via an 802.11 wireless connection to a wireless Internet access point, or a physical connection to the Internet access point, for example, through an Ethernet interface. Each connected communication device 300 is capable of wireless communication with other devices, for example, through a Bluetooth connection or other wireless means.

[0032] The connected communication device 300 is configured to receive information from a user to begin the imaging process and / or begin application of a skin formula. In some embodiments, the communication device 300 includes a user interface that allows a user to view one or more features 310a, 310b on the user's face to which the treatment will be applied. In some embodiments, these features 310a, 310b are highlighted or colored on the user interface to allow the user to better view the features. Feature 310a is an example of a wrinkle on the user's face that has been highlighted on the user interface. Feature 310b is an example of an eyebrow on the user's face that has been highlighted on the user interface. In In some embodiments, the user may select one or more of the features 310a, 310b that are highlighted on the user interface to apply the skin formula thereto.

[0033] [Fig. 4] is a flowchart of a method of processing a feature on the skin of a user 400, in accordance with the present technology. At block 410, the method begins.

[0034] At block 420, the system optionally senses the lighting conditions at the user's location. The lighting conditions may be sensed with a light sensor. In some embodiments, the light sensor is on a dispensing device (such as dispensing device 100). In other embodiments, the light sensor is on a communication device (such as communication device 300). In some embodiments, the light sensor takes a reading of the light from the surrounding area to ensure that it will be able to view the user's skin and skin features as described herein. In some embodiments, the dispensing device, the communication device, or both alert the user to move to more optimal conditions to begin viewing.In some embodiments, the user initiates reading of the light sensor by actuating a user input on the dispensing device or the communication device.

[0035] At block 420, the user's skin is viewed. In some embodiments, the user's skin is viewed with an image sensor or camera on the dispensing device, but in other embodiments, the user's skin is viewed with a communication device, such as a smartphone's camera. In some embodiments, the user may move the dispensing device over their skin, such as their face. In some embodiments, the user may select a particular location, such as their eyebrows, cheeks, or forehead.

[0036] At block 430, the dispensing device detects one or more features on the user's skin with an image sensor. In some embodiments, the feature is a wrinkle, a fine line, pigmentation, hyperpigmentation, or acne. In some embodiments, the feature is an upper lash line, a lower lash line, a mucous membrane of the eye, or an eyebrow. In operation, the dispensing device, or the communication device, may detect the one or more features with image processing. In some embodiments, the dispensing device or the communication device may detect the one or more features with cross-polarized light image processing. In some embodiments, the system may detect wrinkles by detecting broken lines on the surface of a user's skin. In some embodiments, the system may detect wrinkles by detecting different types of curves on the surface of a user's skin. In some embodiments, a user's eyebrows may be detected by detecting large broken lines on a user's face. In some embodiments, the system may detect landmarks, such as eyes, eyebrows, nose, etc. In some embodiments, the one or more features may be detected by detecting a color within a predetermined range, such as in the case of detecting pigmentation, hyperpigmentation, or acne. In some embodiments, the predetermined color range is from pink to dark red. In some embodiments, the predetermined color range is the color of the user's eyebrows.In this way, the device can detect one or more features and hide, color or treat them precisely.

[0037] Optionally, at block 440, the dispensing device senses its proximity to the user's skin with a contact sensor. In some embodiments, the user may move the device closer to or further from their skin to ensure that the skin care material is applied properly, as described herein, to the target areas of the one or more features. In some embodiments, the dispenser alerts the user to move the device closer to or further from their skin. In some embodiments, the communication device alerts the user to move the device closer to or further from the user's skin.

[0038] Optionally, at block 451, the dispensing device alerts the user that it is about to begin applying the skin formula. In some embodiments, the alert is an auditory alert. In some embodiments, the alert is a tone or a flashing LED. In some embodiments, the alert is issued on the communication device instead of the dispensing device. Alternatively, at block 452, the dispensing device waits to apply the skin formula until it receives a command from the user. In some embodiments, the command is given by the user by actuating a user input. In some embodiments, the user input is a button, touchpad, or switch.In some embodiments, the command is given with the communication device, for example by a user actuating the touchscreen of the communication device in response to a notification or pop-up window on the communication device.

[0039] At block 460, the skin formula is applied to the user's skin at the detected locations. In some embodiments, the user may move the dispensing device over their skin to apply the skin formula. In some embodiments, block 460 occurs simultaneously with blocks 430 and 440, such that when the dispensing device detects the one or more features and ensures that it is in proximity to the user's hair, it also applies the skin formula to the user's skin.

[0040] In operation, a user may move the dispensing device over their hair, the device may detect, for example, any wrinkles on the user's face, and the device may immediately apply the wrinkle treatment and corrector to the user's wrinkles. Optionally, the user may move the dispensing device over their face multiple times to ensure that any wrinkles they have are filled, treated, and concealed.

[0041] At block 470, the method terminates.

Claims

Claims

1. A system for treating skin, the system comprising: at least one cartridge containing a skin formula; a dispensing device configured to accept the at least one cartridge; and a processor communicatively coupled to the dispensing device, wherein the processor is configured to: view an image of a user's skin; detect one or more features on the user's skin with image processing; and apply the skin formula to the one or more features on the user's skin via an applicator on the dispensing device, wherein the dispensing device further comprises a light sensor configured to determine whether lighting conditions are suitable for detecting the one or more features.

2. The system of claim 1, wherein the dispensing device further comprises a contact sensor configured to sense proximity to the user's skin.

3. A system according to any one of claims 1 to 2, wherein the applicator is one of a piezoelectric pump or a mechanical pump.

4. A system according to any one of claims 1 to 3, wherein the skin formula comprises an anti-wrinkle formula, an anti-acne formula or a cosmetic formula.

5. The system of claims 1 to 3, wherein the skin formula is a concealer, eyeliner, eyebrow tint, or eyebrow gel.

6. A system according to any one of claims 1 to 5, wherein the skin formula is both a skin treatment and a cosmetic.

7. A system according to any one of claims 1 to 6, wherein the feature is a wrinkle, a fine line, pigmentation, hyperpigmentation or acne.

8. The system of any one of claims 1 to 6, wherein the feature is an upper lash line, a lower lash line, a mucous membrane of the eye, or an eyebrow.

9. A method of applying a skin treatment with the system of any preceding claim, the method comprising: viewing an image of a user's skin; determining whether lighting conditions are suitable for detecting the one or more features; detecting the one or more features on the user's skin with image processing; and applying the skin formula to the one or more features on the user's skin via the applicator of the dispensing device, the formula being a cosmetic formula.

Images