Device and method for applying a cosmetic composition through a grid-type end effector

Abstract

A device for applying a composition to facial skin includes an end effector having a base portion and a protruding portion extending distally from the base portion. The protruding portion has a distal opening. The device also includes a detector device that acquires image data corresponding to an image of an area of ​​skin through the distal opening, and an applicator device that applies the composition to locations within the area. The device further includes a processing device that receives and analyzes the image data to determine whether the applicator is aimed to safely dispense the composition to the area and whether flexels within the area correspond to skin artifacts, and that guides the applicator to selectively apply the composition to the flexels when the applicator is aimed to safely dispense the composition to the area and a skin artifact is detected from the flexels.

Description

[Technical Field]

[0001] (Priority Claim) This application claims priority to U.S. Provisional Application No. 62 / 888,025 (filed August 16, 2019), the entire contents of which are incorporated herein by reference. [Background technology]

[0002] Cosmetic compositions can be applied by manually spreading the composition over facial skin using fingers, a brush, or a sponge. Alternatively, certain specialized liquid formulations of cosmetics can be applied to the skin using an airbrush device, in which the cosmetics are applied as a pressurized spray onto the subject's skin. These airbrush devices are generally manually guided by the user over the subject's skin, which may include sensitive areas (e.g., the eyes, nostrils, and / or mouth) that may be irritated or damaged by the application of such pressurized cosmetic sprays. Pressurized airbrush cosmetic sprays may be unsafe for use near a subject's eyes because the user may not be able to control the airbrush device precisely enough to prevent the pressurized cosmetic spray from being accidentally dispensed into the eyes, which could irritate or damage the delicate structures of the eye. Furthermore, cosmetic compositions often contain particulate materials suspended in the liquid formulation. While such particulate materials may be safe for topical use, they may not be safe for inhalation, ingestion, or when applied to mucous membranes. For example, commonly used cosmetic particulate materials, such as finely divided particles, may be safe for use in liquid topical formulations such as lotions and / or creams, but may be harmful if dispensed in a manner that leads to inhalation through the nostrils or ingestion through the mouth. These devices may present health risks when used in close proximity to the nostrils and mouth, as it may not be possible for a user to precisely control the airbrush device sufficiently to prevent accidental dispensing of the cosmetic pressurized spray into the nostrils or mouth. Summary of the Invention [Means for solving the problem]

[0003] One exemplary embodiment of the present invention relates to a handheld device for applying a composition to a user's facial skin. The device includes an end effector having a base portion and a protruding portion extending distally from the base portion, the protruding portion having a distal opening. The device also includes a detector device configured to acquire image data corresponding to an image of an area of skin through the distal opening of the end effector. The device further includes an applicator device configured to apply the composition to a location within the area of skin. In some embodiments, the applicator device includes a nozzle configured to dispense pressurized pulses of the composition from a reservoir to form a thin layer of the composition on the skin. For example, the composition may be a cosmetic composition including particles of a reflectance-modifying agent (e.g., titanium dioxide) in a liquid suspension. The device further comprises a processing unit configured to receive image data from the detector unit, analyze the image data to determine whether the applicator unit is aimed to safely dispense the composition to the area of skin and whether flexels within the area of skin correspond to skin artifacts, and direct the applicator unit to selectively apply the composition to the flexels when the applicator unit is aimed to safely dispense the composition to the area of skin and a skin artifact is detected from the flexels. In some embodiments, the processing unit may determine whether a skin artifact is detected from a flexel based on the reflectance of the area of skin detected in the image.

[0004] In some embodiments, the processing unit of the handheld device may be configured to direct the applicator device to withhold application of the composition to the skin when the applicator device is not aimed to safely dispense the composition to the area of skin. The processing unit may also analyze the image data to determine whether the applicator device is aimed to safely dispense the composition to the area of skin when the image data corresponds to an area of the user's face located at least a predetermined distance from at least one of the eyes, nostrils, and mouth of the user's face. Furthermore, the processing unit may analyze the image data to determine tilt of the device. Specifically, the processing unit may determine that the applicator device is aimed to safely dispense the composition to the area of skin when the magnitude of tilt of the device is below a predetermined threshold, and may determine that the applicator device is not aimed to safely dispense the composition to the area of skin when the magnitude of tilt of the device is above a predetermined threshold.

[0005] The protruding portion of the end effector may further include a plurality of grid bars extending across the distal opening, and the image data corresponds to an image of the area of skin superimposed with the plurality of grid bars. The processing device may be configured to analyze the image data to identify a shadow of at least one of the grid bars in the image and to determine a length of the shadow based on the image data. The processing device may be further configured to determine that the applicator device is aimed to safely dispense the composition to the area of skin if the length of the shadow is below a predetermined threshold, and to determine that the applicator device is not aimed to safely dispense the composition to the area of skin if the length of the shadow is above the predetermined threshold. The processing device may also be configured to adjust the image data to replace data in portions of the image corresponding to the grid bars with data generated by the processing device proximate the skin below the grid bars, and to analyze the adjusted image data to identify locations in the area of skin corresponding to skin artifacts.

[0006] A method for applying a composition to facial skin is also provided. The method includes acquiring, by a detector device, image data corresponding to an image of an area of skin on which a device is placed. For example, the image data corresponds to an image of the area of skin superimposed with a plurality of grid bars of an end effector of the device, the grid bars extending across the area of skin. The method also includes analyzing, by a processor, the image data to determine an inclination of the device relative to the area of skin. The method further includes determining, by the processor, whether the applicator device is aimed to safely dispense the composition to the area of skin based on the inclination of the device. The method also further includes analyzing, by the processor, the image data to identify a location within the area of skin corresponding to a skin artifact, and selectively applying, by the applicator device, the composition to the identified location only if it is determined that the applicator device is aimed to safely dispense the composition to the area of skin. In some embodiments, the processor identifies the location within the area of skin corresponding to the skin artifact based on the reflectance of the area of skin detected in the image.

[0007] In some embodiments, the processing device may determine that the applicator device is aimed to safely dispense the composition to the area of skin if the magnitude of the tilt of the device is below a predetermined threshold, and may determine that the applicator device is not aimed to safely dispense the composition to the area of skin if the magnitude of the tilt of the device is above a predetermined threshold. For example, the processing device may determine the tilt of the device by analyzing the image data to identify a shadow of at least one of the grid bars in the image and analyzing the shadow to determine a three-dimensional vector corresponding to the tilt. Furthermore, the processing device may also adjust the image data to replace data in portions of the image corresponding to the grid bars with data generated by the processing device below the grid bars and proximate the skin, and may analyze the adjusted image data to identify locations in the area of skin corresponding to skin artifacts.

[0008] These and other aspects of the present invention will become apparent to those skilled in the art after reading the following detailed description of the invention, including the drawings and appended claims. [Brief explanation of the drawings]

[0009] [Figure 1] 1 shows a perspective view of a device for applying a composition to a user's skin, according to an exemplary embodiment of the present application. [Figure 2] 2 shows a block diagram of the exemplary device of FIG. 1 for applying a composition to a user's skin. [Figure 3] 1 illustrates an exemplary embodiment of an end effector of a device for applying a composition to a user's skin, according to an exemplary embodiment of the present application. [Figure 4] 1 illustrates an exemplary embodiment of a protruding portion of an end effector of a device for applying a composition to a user's skin, according to an exemplary embodiment of the present application. [Figure 5] 1 illustrates an exemplary method for applying a cosmetic composition to a user's skin, according to an exemplary embodiment of the present application. [Figure 6] 1 illustrates an exemplary embodiment of a view from the interior, protruding portion of the effector of the device in the distal direction toward the user's skin, according to an exemplary embodiment of the present application. [Figure 7a] 10 illustrates another exemplary embodiment of a protruding portion of an end effector of a device for applying a composition to a user's skin. [Figure 7b] 7b shows an exemplary embodiment of a protruding portion of the end effector of the device of FIG. 7a in a tilted configuration. DETAILED DESCRIPTION OF THE INVENTION

[0010] The present invention relates to devices and methods for applying compositions onto skin, particularly mammalian or human facial skin. More particularly, the present invention relates to devices and methods for selectively applying topical compositions to facial skin, e.g., to enhance the aesthetic appearance of the skin, which provide improved safety for operation near sensitive areas of the mammalian or human face (e.g., the eyes, nostrils, and / or mouth).

[0011] The present disclosure may be further understood with reference to the following description and the accompanying drawings, in which like elements are referred to with the same reference numerals. It should be noted that as used herein, the terms "proximal" and "distal" are intended to refer to directions toward (proximal) and away from (distal) the user of the device.

[0012] As used herein, the term "flexel" refers to a small, pixel-like region of skin that corresponds to a single large pixel or a small number of pixels in a digitally acquired image. For example, a flexel may correspond to a region of skin having an average diameter of about 1 / 15 to about 1 / 5 inch.

[0013] The term "intermediate spatial frequency" as used herein is further explained below. For example, image data corresponding to an image of skin may capture light reflectance over a range of spatial frequencies, which is a measure of the level of detail present in the image across a distance across the skin as observed by the detector (e.g., a camera) generating the image data. Spatial frequency may be measured by the number of periodic elements, described as, for example, a periodic sinusoidal pattern corresponding to the period of alternating light and dark stripes, in the image across a distance across the skin as observed by the detector. The spatial frequency of the image may be calibrated and / or normalized based on the distance at which the skin is imaged by the detector. Note that spatial frequency, as used herein, does not measure the wavelength or color of light, but instead refers to the spatial wavelength of the detailed structure of the skin captured by the detector in the image. Data corresponding to the image in the spatial domain (e.g., in the form of pixels or frexels) may be processed by a computer processor using a Fourier transform function to obtain data regarding the image in the spatial frequency domain. This spatial frequency domain is related to the optical resolution of the imaged image, which is different from the wavelength or color of light. As will be appreciated by those skilled in the art, the spatial frequency components of an image can generally be classified into three different categories, including (1) high spatial frequencies, (2) mid-spatial frequencies, and (3) low spatial frequencies, using any suitable method for image analysis, such as Fourier transforms and filtering. As will be appreciated by those skilled in the art, spatial frequency components with high spatial frequencies correspond to light reflectances within the image that contribute to the appearance of sharp edges and small details within the image. For example, with respect to an image of skin, spatial frequency components with high spatial frequencies correspond to features that are considered to be small natural variations in the skin, such as pores, body hair, hair follicles, cells, and the iris of the eye, which may be derived from a person's genetic information. Low spatial frequencies correspond to light reflectances within the image that contribute to broader appearances, such as the color of larger features (e.g., nose, cheeks, etc.). The remaining spatial frequency components between the low frequencies and the spectral frequencies are referred to as mid-spatial frequencies.

[0014] A range of mid-spatial frequencies may be determined for the captured image. For example, the range of mid-spatial frequencies for a region of facial skin may be different from the range of mid-spatial frequencies for a region of leg skin. The range of mid-spatial frequencies may also depend on the underlying skin tone of the imaged skin. In one example, the mid-spatial frequency of human skin may range from about 0.03 cycles / mm to about 1.5 cycles / mm, or more specifically, from about 0.05 cycles / mm to about 1.0 cycles / mm, and even more specifically, from about 0.07 cycles / mm to about 0.5 cycles / mm.

[0015] The present application provides devices and methods for selectively applying compositions to skin, particularly facial skin of a subject (e.g., a mammal or human), which provide improved safety for operation near sensitive areas (e.g., the eyes, nostrils, and / or mouth) that may not otherwise be safe and / or suitable for application of the composition. More specifically, the present application provides devices and methods for selectively applying topical compositions to facial skin while providing safety guards that limit application of the composition to such sensitive areas. As noted above, some compositions may be suitable for topical application but may not be suitable for direct application to sensitive areas, such as the eyes, nose, and / or mouth. Thus, operation of the present application's devices near such sensitive areas (e.g., within a predetermined range of the boundary of the sensitive area) limits the improved safety of operation of the present application's devices near such sensitive areas. As another example, if a composition suitable for topical application is not suitable for inhalation, operation of the device near the entrance to the respiratory system (i.e., the nostrils and mouth) may be limited. For example, devices and methods of embodiments of the present application analyze data corresponding to an image or one or more frames of images of an area of skin adjacent to where the device is positioned to determine whether the applicator device is aimed to safely dispense the composition to the area of skin (e.g., whether the applicator device is aimed to apply the composition outside a predetermined range of the boundary of the sensitive area), and if the applicator device is aimed to safely dispense the composition to the area of skin, further analysis of the image data is performed to selectively apply the composition to selected portions of the skin to resolve skin artifacts (e.g., scars, wrinkles, blemishes, freckles, sun damage, age spots, etc.) that a user may desire to minimize or eliminate to enhance the overall aesthetic appearance of the skin. If the applicator device is aimed to dispense the composition in an unsafe manner (e.g., to an area of skin that is within a predetermined range of the boundary of the sensitive area), the device prevents the applicator device from applying the composition.

[0016] 1 and 2 show an exemplary embodiment of a device 100 for applying a composition (e.g., a cosmetic or medical composition) to skin. The device 100 of this embodiment is preferably sized and shaped to be a handheld device 100 designed to be held in the palm of a user's hand. The device 100 of this embodiment includes a head portion 102 and a handle portion 104. The handle portion 104 of the device 100 has an elongated shape defining a cavity therein for accommodating components. In some embodiments, the handle portion 104 is sized and shaped to be held in the palm of a user's hand. In other embodiments, the handle portion 104 is sized and shaped to be held by the fingertips of a user's hand.

[0017] The head portion 102 of the device 100 according to this embodiment includes an end effector 110 reversibly attached to the body 108 of the head portion 102. The end effector 110 includes an inner surface defining a cavity into which light can be delivered and images of an area of skin can be captured by a detector device. In certain embodiments, the inner surface of the end effector 110, particularly the inner surface of the protruding portion 114, is surface-modified (e.g., a textured molded finish) and / or treated with a surface coating (e.g., a light-absorbing coating) to reduce light reflection by the modified or treated surface. In the exemplary embodiment shown in FIGS. 1 and 2, the end effector 110 includes a base portion 112 reversibly attached to the body 108 and a protruding portion 114 extending distally from the base portion 112. In certain embodiments, the base portion 112 and the protruding portion 114 of the end effector 110 may be formed as a single unitary component, such as by molding a single piece of plastic. In some embodiments, the end effector 110 may be a disposable component that can be replaced after a session of use or as desired by the user. The base portion 112 of the end effector 110 shown in FIGS. 1 and 2 extends from a proximal end 111 that is reversibly attached to the body 108 and a distal end 113 that is connected to the protruding portion 114. As shown in the exemplary embodiment of FIG. 1 , the base portion 112 may have a tapered shape such that its proximal end 111 is wider (e.g., has a wider cross-sectional area) than its distal end 113. Specifically, the tapered shape of the base portion 112 may be funnel-shaped or cone-shaped. The proximal end 111 of the base portion 112 may include any suitable engagement mechanism for reversibly engaging and disengaging from the body 108, as would be understood by one skilled in the art. For example, the proximal end 111 of the base portion 112 and the body 108 may include complementary threads for reversibly engaging and disengaging with one another. In another embodiment, the proximal end 111 of the base portion 112 may be friction-fit with the body 108.In further embodiments, the proximal end 111 of the base portion 112 and the body 108 may include complementary coupling mechanisms that can be pressed together to frictionally engage and disengage the end effector 110 from the body 108. Additionally, in some embodiments, the base portion 112 may have a circular cross-sectional shape and may be rotatable about a longitudinal axis extending from its proximal end 111 to its distal end 113 to reversibly engage and disengage from the body 108. In other embodiments, when the base portion 112 is lockingly attached to the body 108, the base portion 112 is rotatably locked relative to the body 108.

[0018] The protruding portion 114 of the end effector 110 extends from a proximal end 115 connected to the base portion 112 to a distal end 116 that defines a distal opening 117 of the end effector 110. In one exemplary embodiment, the protruding portion 114 extends from its proximal end 115 to its distal end 116 along a longitudinal axis that is perpendicular or substantially perpendicular to a plane extending across the proximal end 111 of the base portion 112 of the end effector 110. The protruding portion 114 may also have a tapered shape, with the proximal end 115 being wider than the distal end 116. As shown in FIGS. 1 and 2 , the proximal and distal ends 115, 116 of the protruding portion 114 may have an elongated, particularly elliptical, cross-sectional shape. However, it is contemplated that the proximal end 115 and distal end 116 of the protruding portion 114 may have any suitable shape for imaging and selectively applying a composition therethrough to an area of the skin, as further described below.

[0019] In some embodiments, the protruding portion 114 of the end effector 110 may include additional surface features. In one exemplary embodiment, the distal end 116 of the end effector 110 includes a plurality of ridges or protrusions extending distally therefrom, such that when the end effector 110 is held against the skin, only the protrusions extending distally from the distal end 116 of the end effector 110 contact the skin. These protrusions reduce the overall contact area of the device 100 with the skin, which can, for example, prevent smearing of pre-applied composition, improve comfort, and / or reduce pillowing of the skin surface that might otherwise occur when a user presses an end effector that does not include such protrusions against the skin.

[0020] In one particular embodiment, as shown in FIG. 3 , the distal end 116 of the end effector 110 includes a plurality of grid bars 118 (shown in the drawing with solid arrows) that extend across the width of the distal opening 117 of the end effector 110. The grid bars 118 divide the distal opening 117 of the end effector 110 into a plurality of distal opening segments 117a, and the applicator device 140 includes at least one nozzle 142 associated with each segment 117a. Thus, each segment 117a may be independently analyzed to identify the portion of the skin to which the composition is to be applied, and based on this analysis, the nozzle 142 associated with the corresponding segment 117a may be operated. Each of the distal opening segments 117a shown in FIG. 3 includes a dot indicating the location of the at least one nozzle 142 of the applicator device 140 within each distal opening segment 117a. As seen in FIG. 3 , the grid bars 118 extend distally from the distal end 116 of the end effector 110, such that when the end effector 110 is held against the skin, only the grid bars 118 contact the skin. In this embodiment, the grid bars 118 all extend the same distance distally from the distal end 116 such that the grid bars 118 collectively lie along a plane parallel or substantially parallel to the distal opening 117 of the end effector 110. In another embodiment, the grid bars 118 are positioned along the same plane as the distal opening 117, such that when the end effector 110 is held against the skin, the grid bars 118 as well as the distal end 116 of the end effector 110 contact the skin. As shown in FIG. 3 , the grid bars 118 are parallel or substantially parallel to one another. The grid bars 118 in this embodiment are uniformly or substantially uniformly spaced from one another. Additionally, the grid bars 118 in some embodiments are surface treated or modified to reduce friction as they move along the skin. For example, friction between the grid bars 118 and the skin may be reduced by coating the grid bars 118 with a friction-reducing coating such as, for example, perfluoropolyether (PFPE), polytetrafluoroethylene (PTFE), nylon, acetone, polyester, polyimide, polyetheretherketone (PEEK), or the like.Alternatively, the grate bars 118 may be formed from a material with a reduced coefficient of friction, such as, for example, those materials identified above.

[0021] Additionally, the distal end 116 of the end effector 110 in this embodiment further includes a pair of shadow guide pins 191, 192 (two are shown in FIG. 4 , but three or more may be included) extending along the same plane as the grid bar 118. The first pin 191 is perpendicular or substantially perpendicular to the second pin 192. This pair of shadow guide pins 191, 192 casts a two-dimensional shadow on the area of skin framed by the distal opening 117 when this area of skin is illuminated by the light sources 120, 121, 122 from the body 108 of the head portion 102. The two-dimensional shadow may then be captured in an image or one or more image frames by the detector apparatus 130. Specifically, the two-dimensional shadow cast by the shadow guide pins 191, 192 may be used to define two of three axes in a three-dimensional coordinate space for determining the orientation of the device 100 and / or the tilt of at least a portion of the device 100 captured in the image(s). The tilt may be determined as a direction vector in three-dimensional space having a magnitude that indicates the amount of deviation from the orientation of the surface of the skin.

[0022] According to this embodiment, the body 108 of the head portion 102 includes at least one light source 120, 121, 122 for delivering light (e.g., visible light) to an area of skin through a distal opening 117 of the end effector 110. The at least one light source 120, 121, 122 may include any suitable light emitting element for illuminating an area of skin, such as one or more light emitting diodes (LEDs). The at least one light source 120, 121, 122 may be selected and positioned to provide a sufficient amount of illumination across the area of skin to detect and / or measure the reflectance of light by the skin. In embodiments in which multiple grid bars 118 extend through the distal opening 117 of the end effector 110, as shown in FIG. 3 , a portion of the area of skin may be blocked by the grid bars 118, while the light source(s) 120, 121, 122 provide a substantially uniform distribution of light to the remainder of the area of skin. In certain embodiments, a portion of the area of skin may also be shielded along the outer edge of the protruding portion 114 of the end effector 110, particularly along the length of the protruding portion 114, while the light sources(s) 120, 121, 122 provide a substantially uniform distribution of light to the remainder of the area of skin.

[0023] Preferably, light source(s) 120, 121, 122 are positioned to deliver light to an area of skin through distal opening 117 of end effector 110 without providing significant illumination to the interior of end effector 110. For example, light source(s) 120 may be positioned perpendicular to distal opening 117 of end effector 110. More specifically, light source(s) 120 may be positioned perpendicular or substantially perpendicular to an area of interest within an area of skin framed by distal opening 117 of end effector 110 when device 100 is in use. As another example, light source(s) 121, 122 may be angled to direct light through distal opening 117 while minimizing light directed toward the interior surface of end effector 110. Specifically, light source(s) 122 may be angled to direct light in a radial cone 204 through distal opening 117 to a target area of skin 202 within the area of skin where distal opening 117 is positioned (shown by the dotted lines in FIG. 4 ). It is contemplated that additional physical barriers and / or reflectors 190 may also be included within body 108 of head portion 102 to direct light from light source(s) 121 or 122 to a desired area of interest while minimizing reflectance of light from the inner surface of end effector 110.

[0024] In some embodiments, the body 108 of the head portion 102 includes at least two different light sources 121, 122 for delivering light at two different wavelengths, which may be operated sequentially or simultaneously. The at least two different light sources 121, 122 may be utilized simultaneously to provide different functions. The two different wavelengths may be selected to minimize interference between the illumination from the two different light sources 121, 122. For example, the body 108 may include a first light source 121 that delivers light having a first color (e.g., blue light) and a second light source 122 that delivers light having a second color (e.g., green light). The first light source 121 and the second light source 122 may be utilized by the device 100 to illuminate an area of skin for imaging and analysis to identify different characteristics of the imaged area. For example, the first light source 121 may be used by the device 100 to illuminate an area of skin for imaging and analysis to determine the tilt or positioning of the device 100 relative to the orientation of the surface of the skin, e.g., whether the outer edges of the grating bars 118 adjacent the protruding portion 114 of the end effector 110 or each distal opening section 117a are in contact with the surface of the skin. Specifically, the first light source 121 may be selected to provide illumination for shadow casting and maximize shadow contrast. The second light source 122 may be used, for example, to illuminate an area of skin for imaging and analysis to identify skin artifacts. In one exemplary embodiment, the second light source 122 may provide diffuse illumination suitable for image analysis to detect skin artifacts corresponding to locations with strong contributions in the mid-spatial frequencies of the image. The first light source 121 and the second light source 122 may be operably connected to the processing unit 150 for selectively operating and controlling the first light source 121 and the second light source 122, as further described below.

[0025] The body 108 of the head portion 102 also includes a detector device 130 for acquiring image data corresponding to an image or one or more image frames of an area of skin obtained through the distal opening 117 of the end effector 110. In embodiments in which multiple grating bars 118 extend through the distal opening 117 of the end effector 110, as shown in FIG. 3 , the image data may correspond to an image or one or more image frames of an area of skin where the distal opening 117 is positioned overlapping the grating bars 118. The detector device 130 includes at least one sensor that detects light reflected from the area of skin and / or the grating bars 118. As will be appreciated by those skilled in the art, the sensor(s) may include any suitable components for detecting light reflectivity. For example, the sensor(s) may be sensitive to the amount of reflected light of one or more wavelengths. Suitable sensors may include, for example, a photographic or video camera (which may include different types of camera lenses), a photodiode, and / or a phototransistor, as will be appreciated by those skilled in the art. In one exemplary embodiment, the sensor(s) of detector device 130 may comprise an RGB camera that may detect light in the red, green, and blue channels of the camera. In some embodiments, detector device 130 may further comprise a color filter array (e.g., a Bayer filter) for acquiring image data corresponding to images at different wavelengths (e.g., different colors) when two or more light sources 121, 122, each having a different wavelength, are used.

[0026] The light source(s) 120, 121, 122 and the detector device 130 are operatively connected to a processing unit 150 that executes instructions stored on a computer-accessible medium 160. The processing unit 150 in this embodiment controls the light source(s) 120, 121, 122 and receives and analyzes image data received from the detector device 130. It is contemplated that the processing unit 150 and the computer-accessible medium 160 may be located anywhere within the device 100 or external to the device 100. In one embodiment, as shown in FIG. 1 , the processing unit 150 and the computer-accessible medium 160 are located within the handle portion 104. The processing unit 150 in this embodiment also controls the applicator device 140 to selectively apply the composition to desired flexels within the area of skin when the processing unit 150 determines that the applicator device 140 is aimed to safely dispense the composition onto the area of skin. Processing device 150 may be, be a part of, or include a computer / processor, which may include, for example, but is not limited to, one or more microprocessors in its entirety, and may use instructions stored on computer-accessible medium 160 (e.g., a memory storage device). Computer-accessible medium 160 may be, for example, a non-transitory computer-accessible medium that includes executable instructions therein. Storage devices may be provided separately from computer-accessible medium 160, but may provide instructions to processing device 150 to configure processing device 150 to perform certain exemplary procedures, processes, and methods.

[0027] As shown in FIG. 2 , the applicator device 140 of this embodiment is part of the body 108 of the head portion 102. The applicator device 140 of this embodiment also selectively applies a composition to portions of skin when guided by the processing device 150 based on image data from the detector device 130. The applicator device 140 of this embodiment includes at least one suitable application device for depositing a topical composition (e.g., a cosmetic composition) onto one or more flexels in which an artifact has been identified. Exemplary cosmetic application devices of this embodiment include, for example, a sprayer (e.g., an electronic sprayer or an airbrush sprayer), a droplet control device, or any other suitable application device for applying the composition in small droplets to the identified flexels, as will be understood by those skilled in the art. In one exemplary embodiment, the applicator device 140 includes one or more nozzle(s) 142 for depositing a pressurized liquid or viscous composition onto the skin in the form of a pressurized pulse or mist to form a thin film of cosmetic coverage at the specific flexels. The nozzle(s) 142 dispense the composition onto the surface of the skin in the form of pulses or mist droplets, thereby forming a thin continuous or discontinuous layer of the composition on the skin. In certain embodiments, the applicator device 140 includes multiple nozzles 142, such as an array of nozzles arranged in any desired configuration. The use of multiple nozzles 142 increases the overall speed at which the device 100 can apply the composition to the flexels, shortening the total time the user needs to move the device 100 over the target portion of the skin before the desired level of artifact treatment is achieved. For example, the applicator device 140 may include 3-8 nozzles, or 4-6 nozzles, each nozzle aimed differently so that the composition can be applied to multiple flexels or different portions of the flexels simultaneously. In one exemplary embodiment, the applicator device 140 includes 5 nozzles. In embodiments in which multiple grid bars 118 extend through the distal opening 117 of the end effector 110, as shown in FIG. 3, the applicator device 140 may include one or more nozzles 142 aimed to dispense the composition into each distal opening segment 117a.

[0028] Nozzle 142 may be any suitable device for depositing a thin layer of a cosmetic composition onto skin. In one exemplary embodiment, nozzle 142 may comprise a dual chamber having a first chamber holding a liquid or viscous composition and a second chamber containing a propellant (e.g., compressed air or nitrogen gas) that applies pressure to the composition but does not mix with it when a pulse of the composition is dispensed into the flexel. In another example, nozzle 142 may comprise a first chamber holding a liquid or viscous composition and a second chamber containing a propellant that mixes with the cosmetic composition when a pulse of the composition is dispensed into the flexel. While two exemplary embodiments of nozzle 142 are described above, it is contemplated that the devices of the present application may include any suitable nozzle(s) 142 for dispensing droplets of a composition under pressure, as would be understood by one of ordinary skill in the art.

[0029] The applicator device 140 is operably connected to a reservoir 170 containing a cosmetic composition to be applied to the skin. Specifically, the applicator device 140 is fluidly connected to the reservoir 170 by a series of conduits, valves, and / or pressure sources. It is contemplated that the reservoir 170 may be contained anywhere within the device 100. In one exemplary embodiment, the reservoir 170 is contained within the handle portion 104 of the device 100, as shown in FIG. 2 . The composition within the reservoir 170 is transferred from the reservoir 170 to the applicator device 140 for application of the composition. In some embodiments, the reservoir 170 is a removable container that can be replaced when its contents are depleted. For example, the reservoir 170 may be a pressurized canister containing the composition to be applied to the skin.

[0030] The composition applied to the skin may include, for example, cosmetic ingredients suitable for modifying the appearance of the skin, such as opacifying agents, color cosmetics, or any other suitable composition for enhancing the appearance of skin. The composition may also include ingredients such as moisturizers for hydration, carriers, or benefit agents (e.g., beneficial compounds / compositions / extracts, or active ingredients) to treat and / or improve skin conditions, such as acne, hyperpigmentation, eczema, hives, vitiligo, psoriasis, rosacea, warts, shingles, cold sores, pigmentation and tone, redness / oxidative stress in the skin, wrinkles, whitening, sagging / elasticity, etc. Exemplary compositions in this embodiment are cosmetic compositions that are applied to the skin to modify or minimize the appearance of artifacts based on image data provided by the detector device 130. Exemplary embodiments of benefit agents that may be incorporated into the composition are further described below.

[0031] A non-limiting list of useful moisturizing active benefit agents includes hyaluronic acid and moisturizers.Hyaluronic acid can be linear hyaluronic acid, cross-linked hyaluronic acid, or a mixture of linear hyaluronic acid and cross-linked hyaluronic acid.It can also be in salt form, for example, sodium hyaluronate.Moisturizers are compounds (e.g., hygroscopic compounds) that aim to increase the moisture content of the top layer of skin.Examples of suitable moisturizers include, but are not limited to, glycerin, sorbitol, trehalose, or their salts or esters.

[0032] A non-limiting list of benefit agents useful for acne includes benzoyl peroxide, retinoids including retinol, retinal, retinoic acid, retinyl acetate, and retinyl palmitate, hydroxy acids including glycolic acid, lactic acid, malic acid, salicylic acid, citric acid, and tartaric acid, sulfur, zinc PCA (zinc pyrrolidone carboxylic acid), allantoin (5-ureidohydantoin), rosemary, 4-hexylresorcinol, N-acetylglucosamine, gluconolactone, niacinamide, azelaic acid, and resveratrol.

[0033] A non-limiting list of useful pigmentation active benefit agents includes resorcinols, e.g., niacinamide, 4-hexylresorcinol, curcuminoids (e.g., Sabiwhite (tetrahydrocurcumin)), phytic acid, resveratrol, soy (Glycine Soja (Soybean) oil, gluconolactone, azelaic acid, and retinoids including retinol, retinal, retinoic acid, retinyl acetate, and retinyl palmitate, enzymes such as laccase, tyrosinase inhibitors, melanin degraders, melanosome migration inhibitors such as PAR-2 antagonists, scrubs, sunscreens, retinoids, antioxidants, tranexamic acid, tranexamic acid cetyl ester hydrochloride, skin whitening agents, linoleic acid, adenosine monophosphate disodium salt, chamomile extract, allantoin, opacifiers, talc and silica, zinc salts, etc. Examples of suitable tyrosinase inhibitors include vitamin C and its derivatives, vitamin E and its derivatives, kojic acid, arbutin, resorcinol, hydroquinone, flavones (e.g., licorice flavanoids, licorice root extract, mulberry root extract, Dioscorea copposita (Dioscorea Coposita root extract, Saxifragaceae extract, etc.), ellagic acid, salicylate and derivatives, glucosamine and derivatives, fullerenes, hinokitiol, diacids, acetylglucosamine, 5,5'-dipropyl-biphenyl-2,2'-diol (Magnolignan), 4-(4-hydroxyphenyl)-2-butanol (4-HPB), and combinations of two or more thereof. Examples of derivatives of vitamin C include ascorbic acid and its salts, ascorbic acid-2-glucoside, Examples of derivatives of vitamin E include, but are not limited to, sodium ascorbyl phosphate, magnesium ascorbyl phosphate, and natural extracts rich in vitamin C. Examples of derivatives of vitamin E include, but are not limited to, α-tocopherol, β-tocopherol, γ-tocopherol, δ-tocopherol, α-tocotrienol, β-tocotrienol, γ-tocotrienol, δ-tocotrienol, and mixtures thereof, tocopherol acetate, tocopherol phosphate, and natural extracts rich in vitamin E derivatives.Examples of resorcinol derivatives include, but are not limited to, resorcinol, 4-substituted resorcinols, such as 4-butylresorcinol (rucinol), 4-hexylresorcinol, phenylethylresorcinol, 4-alkylresorcinols such as 1-(2,4-dihydroxyphenyl)-3-(2,4-dimethoxy-3-methylphenyl)-propane, and resorcinol-rich natural extracts. Examples of salicylates include, but are not limited to, 4-methoxypotassium salicylate, salicylic acid, acetylsalicylic acid, 4-methoxysalicylic acid, and salts thereof. In certain preferred embodiments, the tyrosinase inhibitor includes a 4-substituted resorcinol, a vitamin C derivative, or a vitamin E derivative.

[0034] A non-exhaustive list of useful reddening / antioxidant active beneficial agents includes water-soluble antioxidants, such as sulfhydryl compounds and their derivatives (e.g., sodium metabisulfite and N-acetyl-cysteine), lipoic acid and dihydrolipoic acid, resveratrol, lactoferrin, and ascorbic acid and ascorbic acid derivatives (e.g., ascorbyl palmitate and ascorbyl polypeptide).Oil-soluble antioxidants suitable for use in the compositions of the present invention include, but are not limited to, butylated hydroxytoluene, retinoids (e.g., retinol and retinyl palmitate), tocopherols (e.g., tocopherol acetate), tocotrienols, and ubiquinone.Natural extracts containing antioxidants suitable for use in the compositions of the present invention include, but are not limited to, extracts containing flavonoids and isoflavonoids and their derivatives (e.g., genistein and daidzein), extracts containing resveratrol, etc. Examples of such natural extracts include grape seed, green tea, pine bark, propolis, and feverfew extract. "Feverfew extract" refers to an extract of the plant Tanacetum parthenium. One particularly suitable feverfew extract is commercially available as about 20% active feverfew.

[0035] A non-limiting list of useful wrinkle active benefit agents includes N-acetylglucosamine, 2-dimethylaminoethanol, copper salts such as copper chloride, peptides such as algilain, syn-ake, copper, coenzyme Q10, those containing dill, blackberry, paulownia, Picia anomala, and chicory, resorcinols such as 4-hexylresorcinol, curcuminoids, and retinoids including retinol, retinal, retinoic acid, retinyl acetate, and retinyl palmitate, hydroxy acids including, but not limited to, glycolic acid, lactic acid, malic acid, salicylic acid, citric acid, and tartaric acid.

[0036] A non-limiting list of useful whitening active benefit agents includes vitamin C and its derivatives such as ascorbic acid 2-glucoside, alpha-hydroxy acids such as lactic acid, glycolic acid, malic acid, tartaric acid, citric acid, or any combination of any of the foregoing, beta-hydroxy acids such as salicylic acid, polyhydroxy acids such as lactobionic acid and gluconic acid.

[0037] A non-limiting list of useful benefit agents for sagging skin includes blackberry extract, Coconut Coconut extract, feverfew extract, extract of Phyllanthus niruri, and bimetallic complexes having copper and / or zinc components. The bimetallic complexes having copper and / or zinc components may be, for example, copper-zinc citrate, copper-zinc oxalate, copper-zinc tartrate, copper-zinc malate, copper-zinc succinate, copper-zinc malonate, copper-zinc maleate, copper-zinc aspartate, copper-zinc glutamate, copper-zinc glutarate, copper-zinc fumarate, copper-zinc glucarate, copper-zinc polyacrylate, copper-zinc adipate, copper-zinc pimelate, copper-zinc suberate, copper-zinc azelaate, copper-zinc sebacate, copper-zinc dodecanoate, or combinations thereof.

[0038] Additional skin benefit agents or actives may include those listed in the following paragraphs, some of which are listed above, but which are included below to ensure a more robust list.

[0039] Examples of suitable additional benefit agents include skin lightening agents, darkening agents, anti-aging agents, tropoelastin promoting agents, collagen promoting agents, anti-acne agents, shine adjusting agents, antimicrobial agents (e.g., anti-yeast, anti-fungal and anti-bacterial agents), anti-inflammatory agents, anti-parasitic agents, topical analgesics, sunscreens, photoprotectants, antioxidants, keratolytic agents, detergents / surfactants, moisturizers, nutrients, vitamins, energy enhancers, antiperspirants, skin astringents, deodorants, hair removers, hair growth enhancers, hair growth retarders, stabilizers, hydration enhancers, efficacy enhancers, anti-callus agents, skin conditioning agents, anti-cellulite agents, fluorides, tooth whitening agents, anti-tartar agents and tartar dissolving agents, malodor control agents (e.g., malodor masking agents) or pH altering agents.Examples of various suitable additional cosmetically acceptable actives include UV filters, such as, but not limited to, avobenzone (Parsol 1789), bisdisulizole disodium (Neo Heliopan AP), diethylaminohydroxybenzoyl hexyl benzoate (Uvinul A Plus), ecamsule (Mexoryl SX), methyl anthranilate, 4-aminobenzoic acid (PABA), cinoxate, ethylhexyl triazone (Uvinul T150), homosalate, 4-methylbenzylidene camphor (Parsol 5000), octyl methoxycinnamate (Octinoxate), octyl salicylate (Octisalate), padimate O (Escalol 507), phenylbenzimidazole sulfonic acid (Ensulizole), polysilicone-15 (Parsol SLX), trolamine salicylate, bemotrizinol (Tinosorb S), Benzophenone 1-12, Dioxybenzone, Drometrizole Trisiloxane (Mexoryl XL), Isocotridinol (Uvasorb HEB), Octocrylene, Oxybenzone (Eusolex 4360), Sulisobenzone, Bisoctrizole (Tinosorb M), titanium dioxide, zinc oxide, carotenoids, free radical scavengers, spin traps, retinoids and retinoid precursors such as retinol, retinoic acid and retinyl palmitate, ceramides, polyunsaturated fatty acids, essential fatty acids, enzymes, enzyme inhibitors, minerals, hormones such as estrogen, steroids such as hydrocortisone, 2-dimethylaminoethanol, copper salts such as copper chloride, copper-containing peptides such as Cu:Gly-His-Lys, coenzyme Q10, amino acids such as proline, vitamins, lactobionic acid, acetyl coenzyme A, niacin, riboflavin, thiamine, ribose, electron transporters such as NADH and FADH2, and other plant extracts such as oat, aloe vera, feverfew, soybean, and shiitake mushroom extracts, and derivatives and mixtures thereof.

[0040] Examples of suitable skin lightening benefit agents include, but are not limited to, tyrosinase inhibitors, melanin degraders, melanosome transfer inhibitors (including PAR-2 antagonists), exfoliants, sunscreens, retinoids, antioxidants, tranexamic acid, tranexamic acid cetyl ester hydrochloride, skin bleaching agents, linoleic acid, adenosine monophosphate disodium salt, chamomile extract, allantoin, opacifiers, talc and silica, zinc salts, and the like.

[0041] Examples of suitable tyrosinase inhibitors include, but are not limited to, vitamin C and its derivatives, vitamin E and its derivatives, kojic acid, arbutin, resorcinol, hydroquinone, flavones (e.g., licorice flavanoids, licorice root extract, mulberry root extract, Dioscorea Coposita root extract, Saxifragaceae extract, etc.), ellagic acid, salicylate and derivatives, glucosamine and derivatives, fullerenes, hinokitiol, diacids, acetylglucosamine, 5,5'-dipropyl-biphenyl-2,2'-diol (magnolinone), 4-(4-hydroxyphenyl)-2-butanol (4-HPB), and combinations of two or more thereof. Examples of vitamin C derivatives include, but are not limited to, ascorbic acid and its salts, ascorbic acid-2-glucoside, sodium ascorbyl phosphate, magnesium ascorbyl phosphate, and vitamin C-rich natural extracts. Examples of vitamin E derivatives include, but are not limited to, α-tocopherol, β-tocopherol, γ-tocopherol, δ-tocopherol, α-tocotrienol, β-tocotrienol, γ-tocotrienol, δ-tocotrienol, and mixtures thereof, tocopherol acetate, tocopherol phosphate, and natural extracts enriched with vitamin E derivatives. Examples of resorcinol derivatives include, but are not limited to, resorcinol, 4-substituted resorcinols (e.g., 4-alkylresorcinols such as 4-butylresorcinol (Rucinol), 4-hexylresorcinol (Synovea HR, Sytheon), phenylethylresorcinol (Symwhite, Symrise), and 1-(2,4-dihydroxyphenyl)-3-(2,4-dimethoxy-3-methylphenyl)-propane (Nibitol, Unigen)), and natural extracts enriched with resorcinol. Examples of salicylates include, but are not limited to, 4-methoxypotassium salicylate, salicylic acid, acetylsalicylic acid, 4-methoxysalicylic acid, and salts thereof.In certain preferred embodiments, the tyrosinase inhibitor includes a 4-substituted resorcinol, a vitamin C derivative, or a vitamin E derivative. In more preferred embodiments, the tyrosinase inhibitor includes phenylethylresorcinol, 4-hexylresorcinol, or ascorbyl-2-glucoside.

[0042] Examples of suitable melanin degrading agents include, but are not limited to, peroxides and enzymes (e.g., peroxidase and ligninase). In certain preferred embodiments, melanin inhibitors include peroxides and ligninase.

[0043] Examples of suitable melanosome transfer inhibitors include PAR-2 antagonists (e.g., soybean trypsin inhibitor or Bowman-Birk inhibitor), vitamin B3 and derivatives (e.g., niacinamide), essential soybean, whole soybean, soybean extract. In certain preferred embodiments, the melanosome transfer inhibitor includes soybean extract or niacinamide.

[0044] Examples of exfoliants include, but are not limited to, alpha-hydroxy acids (e.g., lactic acid, glycolic acid, malic acid, tartaric acid, citric acid, or any combination of any of the foregoing), beta-hydroxy acids (e.g., salicylic acid, polyhydroxy acids such as lactobionic acid and gluconic acid), and mechanical exfoliants (e.g., microdermabrasions). In certain preferred embodiments, the exfoliant includes glycolic acid or salicylic acid.

[0045] Examples of sunscreens include avobenzone (Parsol 1789), bisdisulizole disodium (Neo Heliopan AP), diethylaminohydroxybenzoyl hexylbenzoate (Uvinul A Plus), ecamsule (Mexoryl SX), methyl anthranilate, 4-aminobenzoic acid (PABA), cinoxate, ethylhexyl triazone (Uvinul T150), homosalate, 4-methylbenzylidene camphor (Parsol 5000), octyl methoxycinnamate (Octinoxate), octyl salicylate (Octisalate), padimate O (Escalol 507), phenylbenzimidazole sulfonic acid (Ensulizole), polysilicone-15 (Parsol SLX), trolamine salicylate, and bemotrizinol (Tinosorb S), benzophenone 1-12, dioxybenzone, drometrizole trisiloxane (Mexoryl XL), iscotrizinol (Uvasorb HEB), octocrylene, oxybenzone (Eusolex 4360), sulisobenzone, bisoctrizole (Tinosorb M), titanium dioxide, zinc oxide, and the like.

[0046] Examples of retinoids include, but are not limited to, retinol (vitamin A alcohol), retinal (vitamin A aldehyde), retinyl acetate, retinyl propionate, retinyl linoleate, retinoic acid, retinyl palmitate, isotretinoin, tazarotene, bexarotene, adapalene, and combinations of two or more thereof. In certain preferred embodiments, the retinoid is selected from the group consisting of retinol, retinal, retinyl acetate, retinyl propionate, retinyl linoleate, and combinations of two or more thereof. In certain more preferred embodiments, the retinoid is retinol.

[0047] Examples of antioxidants include, but are not limited to, water-soluble antioxidants such as sulfhydryl compounds and their derivatives (e.g., sodium metabisulfite and N-acetyl-cysteine, glutathione), lipoic acid and dihydrolipoic acid, stilbenoids (e.g., resveratrol and derivatives), lactoferrin, iron and copper chelators, and ascorbic acid and ascorbic acid derivatives (e.g., ascorbyl-2-glucoside, ascorbyl palmitate, and ascorbyl polypeptide). Oil-soluble antioxidants suitable for use in the compositions of the present invention include, but are not limited to, butylated hydroxytoluene, retinoids (e.g., retinol and retinyl palmitate), tocopherols (e.g., tocopherol acetate), tocotrienols, and ubiquinone. Natural extracts containing antioxidants suitable for use in the compositions of the present invention include, but are not limited to, extracts containing flavonoids and isoflavonoids and their derivatives (e.g., genistein and daidzein), extracts containing resveratrol, etc. Examples of such natural extracts include grape seed, green tea, black tea, white tea, pine bark, feverfew, parthenolide-free feverfew, oat extract, blackberry extract, cognac extract, soybean extract, pomelo extract, wheat germ extract, hesperedin, grape extract, purslane extract, licochalcone, chalcone, 2,2'-dihydroxychalcone, primrose extract, propolis, and the like.

[0048] In some preferred embodiments, benefit agents useful against acne include, but are not limited to, salicylic acid, zinc PCA (zinc pyrrolidone carboxylic acid), allantoin (5-ureidohydantoin), rosemary, 4-hexylresorcinol, N-acetylglucosamine, gluconolactone, niacinamide, azelaic acid, and resveratrol.

[0049] In some preferred embodiments, the list of useful pigmentation active benefit agents includes tetrahydrocurcumin, phytic acid, resveratrol, Glycine Soja oil, gluconolactone, laccase, 4-hexylresorcinol, N-acetylglucosamine, gluconolactone, niacinamide, azelaic acid, and resveratrol.

[0050] In some preferred embodiments, the list of useful active benefit agents includes treating acne and pigmentation simultaneously and includes 4-hexylresorcinol, N-acetylglucosamine, gluconolactone, niacinamide, azelaic acid, and resveratrol.

[0051] In a particular embodiment, the composition includes one or more reflectance modifying agents (RMAs) (any component useful for altering the reflectance of skin). For example, suitable RMAs may include inks, dyes, pigments, bleaches, chemically altering agents, and other substances that can be used to alter the reflectance of skin. Some suitable RMAs may include transparent RMAs, such as dyes or diluted pigments. Other suitable RMAs may include opaque RMAs having high refractive index particles. Specifically, the high refractive index particles may include particles having a refractive index of 2.0 or greater. In a particular example, the RMA may include titanium dioxide particles. For example, the RMA may include titanium dioxide particles having an average diameter of about 0.35 micrometers to about 1.35 micrometers, about 0.5 micrometers to about 1.0 micrometers, or about 0.6 micrometers to about 0.8 micrometers. Specifically, the titanium dioxide particles may be uniformly distributed and / or suspended in the cosmetic composition (e.g., a liquid suspension).

[0052] The device 100 according to this embodiment further comprises a power supply 180 that provides power to control and operate the device 100. It is contemplated that the power supply 180 may be located anywhere within the device 100 or may be external to the device 100. In one exemplary embodiment, as shown in FIG. 2 , the power supply 180 is housed within the handle portion 104 of the device 100 and is operably connected to the light source(s) 120, 121, 122, the detector device 130, the applicator device 140, and / or the processing device 150. Those skilled in the art will appreciate that a variety of known suitable power sources may be used. For example, the power supply 180 may include a battery or a connection to an external power source. Specifically, the power supply 180 may comprise a rechargeable battery device.

[0053] In use, the head portion 102 is positioned over the area of skin to be treated. In particular, the distal opening 117 of the end effector 110 is positioned relative to the skin and imaged by the detector device 130 to frame the area to be selectively treated by the applicator device 140 as guided by the processing device 150. During use, the device 100 images multiple different areas of the skin. For example, as the head portion 102 is moved across the surface of the skin, the device 100 continuously or sequentially images different areas of the skin to obtain image data and analyzes the image data to identify selected flexels to which the composition is applied. More specifically, as the user moves the head portion 102 back and forth across the surface of the skin multiple times, the device 100 pre-scans the treated area to detect missed or incompletely resolved artifacts and applies the composition to the identified artifacts (e.g., flexels) on the skin. If multiple lattice bars 118 extend through the distal opening 117 of the end effector 110, the user may prefer to move the device 100 along a path that is parallel or substantially parallel to the lattice bars 118, as shown by the dotted lines in FIG. 3.

[0054] The present application also includes a method for determining whether at least a portion of the applicator device 140 of the device 100 is safely positioned and aimed toward a target area of skin to selectively apply a composition (e.g., a cosmetic composition) to a location (e.g., a flexel) within the area of skin. Dispensing is permitted by the applicator device 140 (or by a particular nozzle of the applicator device 140) only if the applicator device 140 or a particular one of its nozzles is determined to be safely aimed, and is prevented (the applicator device 140 is disabled) if the applicator device 140 is determined to be aimed to dispense the composition in an unsafe or potentially unsafe manner. An exemplary method 300 is shown in FIG. 5. In step 302, a user begins use of the device 100 by positioning the distal end 106 of the end effector 110 of the device 100 against the surface of the skin, e.g., facial skin. The distal opening 117 of the end effector 110 frames the area of skin to be imaged and analyzed by the device 100. In some embodiments, as described above, the distal opening 117 may be divided into multiple distal opening segments 117a by multiple grid bars 118, and at least one nozzle 142 of the applicator device 140 is aimed to apply the cosmetic to the skin where each distal opening segment 117a is positioned. As shown in step 304, the detector device 130 images the area through the distal opening 117 to obtain image data of the area of skin.

[0055] In steps 306 and 308, the image data is first analyzed by the processing device 150 to determine whether the nozzle(s) 142 associated with each distal opening segment 117a are aimed to safely dispense composition onto the skin. Each nozzle 142 in this embodiment may be evaluated and controlled independently of one another. Any nozzle 142 determined to be not safely positioned is disabled, and the remaining nozzles 142 of the applicator device 140 are allowed to continue operating. These determinations may be made using any number of suitable methods, as described further below.

[0056] For example, the processing device 150 may analyze the image data to determine whether the image data of the area of skin where the distal opening segment 117a is disposed also corresponds to an area on the user's face that is outside a predetermined distance or radius from one or more sensitive areas (e.g., the eyes, nostrils, and / or mouth). If the area of skin is outside a predetermined distance or radius from one or more sensitive areas, the processing device 150 in this embodiment determines that the nozzle(s) 142 associated with this distal opening segment 117a are aimed to safely dispense the composition onto the skin. Alternatively, if the area of skin is within a sensitive area or within a predetermined distance or radius from a sensitive area (i.e., near or including one or more of the sensitive areas), the processing device 150 determines that the nozzle(s) 142 associated with the distal opening segment 117a are not aimed to safely dispense the composition. Specifically, the processing device 150 of this embodiment compares image data of an area of skin where the distal opening segment 117a is located to a database of previously acquired image data mapped to areas of the user's face to identify an area on the face corresponding to the image data, and determines whether the area includes a sensitive area or a portion of skin less than a predetermined distance from a sensitive area. In this embodiment, if the processing device 150 determines that the nozzles 142 are not aimed to safely dispense composition, the processing device 150 disables the unsafely aimed nozzles 142. The processing device 150 may then restore functionality to the previously disabled nozzle(s) 142 if the device 100 is moved to a different location on the skin and the processing device 150 subsequently determines that the positioning of the previously disabled nozzle(s) 142 is now aimed to safely dispense composition onto the skin.

[0057] In another embodiment, the processing unit 150 may analyze the image data to determine whether the nozzle(s) 142 are aimed at an area of the skin where the distal opening segment 117a is positioned to safely dispense the composition onto the skin. Each distal opening segment 117a may be evaluated independently of one another, and the nozzle(s) 142 associated with each distal opening segment 117a may be controlled separately. Specifically, the processing unit 150 may analyze a portion of the image data corresponding to an area of the skin where the distal opening segment 117a is positioned to determine whether a portion of the outer edge of the protruding portion 114 of the end effector 110 and / or the grid bar 118 adjacent the distal opening segment 117a is in contact with the surface of the skin. If it is determined that a portion of the outer edge of the protruding portion 114 or the grid bar 118 adjacent to the distal opening segment 117a is not in contact with the surface of the skin, then the processing device 150 determines that the nozzle (a) 142 associated with the analyzed distal opening segment 117a is not aimed to safely dispense the composition onto the skin and disables the nozzle(s) 142 that are not safely positioned.

[0058] It should be noted that the contours of a human face are particularly curved around certain sensitive areas, such as the nose adjacent the eyes, the nostrils, and the area surrounding the mouth. When a user attempts to address these areas, the surface of the skin may curve away from a portion of the outer edge of the protruding portion 114 of the end effector 110 and / or the grid bars 118 when the device 100 is positioned over these sensitive areas. Detecting a shadow cast by at least a portion of the outer edge of the protruding portion 114 of the end effector 110 and / or one or more of the grid bars 118 adjacent the distal opening segment 117a in the image data indicates that the portion of the outer edge of the protruding portion 114 of the end effector 110 and / or the grid bars 118 are not positioned in full contact with the surface of the skin, and indicates that the distal opening segment 117a may be positioned within a predetermined distance or radius from the sensitive area. For example, the processing device 150 may disable the nozzle 142 of the applicator device 140 if a shadow(s) on the outer edge of the protruding portion 114 and / or one or more of the grid bars 118 are detected in the portion of the captured image corresponding to the distal opening segment 117a associated with the nozzle 142. Accordingly, the processing device 150 may determine that image data showing the nozzle 142 in such proximity to a sensitive area indicates that the nozzle 142 is being aimed to dispense the composition in an unsafe manner. The processing device 150 may further analyze the direction and / or length of the shadow(s) cast by the outer edge of the protruding portion 114 and / or one of the grid bars 118 adjacent to the distal opening segment 117a to determine whether the nozzle(s) 142 associated with the distal opening segment 117a are being aimed to safely dispense the composition onto the skin.Specifically, the direction and / or length of the shadow may be used to determine if the outer edge of protruding portion 114 and / or one or more of grid bars 118 adjacent distal opening segment 117a are separated from the surface of the skin (either in the direction and / or length of the shadow) beyond a certain predetermined tolerance, which may cause processing device 150 to disable nozzle(s) 142 associated with distal opening segment 117a to prevent composition from being dispensed near or onto the sensitive area. In one exemplary embodiment, processing device 150 may determine that nozzle 142 is aimed to safely dispense composition onto the area of skin if the length of the shadow detected therein is below a predetermined threshold, and may determine that nozzle 142 is aimed to dispense composition in an unsafe manner if the length of the shadow is above the predetermined threshold.

[0059] In a further embodiment, the processing unit 150 may determine the tilt of the device 100 relative to the skin by analyzing the image data. Based on the tilt of the device, the processing unit 150 determines whether the nozzle 142 of the applicator device 140 is aimed to safely dispense the composition onto the skin. When a user attempts to address these areas, they may tilt the device 100 beyond a threshold level that increases the risk of dispensing the composition, but the determination of the composition's final landing point is inaccurate. Because the device 100 in such situations is often near sensitive areas, detection of a tilt above a certain predetermined level causes the processing unit 150 to disable the applicator device 140 to prevent the composition from entering the sensitive area. The processing unit 150 may also take into account the direction of the tilt when determining whether the applicator device 140 is not safely aimed at the sensitive area. For example, the processing unit 150 may disable the applicator device 140 if: 1) the image data indicates that the device 100 is tilted in a direction that follows the contours of a sensitive area; or 2) if the device 100 is tilted to a degree that exceeds a predetermined threshold and / or has a tilt vector magnitude that exceeds a predetermined threshold. Accordingly, the processing unit 150 may determine that image data indicating such proximity to a sensitive area indicates that the nozzle 142 of the applicator device 140 is aimed to dispense the composition in an unsafe manner. In one exemplary embodiment, the processing unit 150 may determine that the applicator device 140 is aimed to safely dispense the composition to an area of skin if the vector magnitude of the device tilt is below a predetermined threshold, and that the applicator device 140 is aimed to dispense the composition in an unsafe manner if the vector magnitude of the device tilt is above the predetermined threshold.

[0060] Additionally, the processing device 150 may also determine that the applicator device 140 is aimed to dispense the composition in an unsafe manner if the image data indicates that the nozzle(s) 142 of the applicator device 140 are misaligned (e.g., separated from the surface of the skin or tilted beyond a certain configuration), thereby causing the nozzle(s) 142 to be aimed to deposit the composition incorrectly—i.e., if the location on the skin where the composition may be directed by the nozzle 142 cannot be determined within a desired margin of error from the target location (e.g., a flexel). The processing device 150 may disable the nozzle(s) 142 when it determines a potential deviation in the application of the composition from the target location that exceeds a desired margin of error, as a larger margin of error may result in unsafe application of the composition to sensitive areas. Thus, the processing device 150 may disable the nozzle(s) 142 if the image data indicates that the nozzle(s) 142 are mispositioned to a degree that exceeds a predetermined threshold and / or if the magnitude of the tilt vector exceeds a predetermined threshold and may result in the erroneous deposition of the composition at a non-target location.

[0061] In step 308, the processing unit 150 evaluates whether at least one nozzle 142 of the applicator device 140 is aimed to safely dispense the composition onto the area of skin, after which method 300 proceeds to step 310, where the image data is further analyzed to identify locations within the area of skin (e.g., flexels where skin artifacts are detected) where the composition should be applied to alter the visual appearance of the skin. If the processing unit 150 determines, based on the image data, that the nozzle(s) 142 are aimed to dispense the composition in an unsafe manner, then it prevents the nozzle(s) 142 from dispensing the composition until this condition changes, increasing the safety of the device 100 when operating near the eyes, nostrils, and / or mouth. More specifically, if the processing device 150 determines that the nozzle(s) 142 are aimed to operate in an unsafe manner, the processing device 150 guides the nozzle(s) 142, e.g., aims them away from the sensitive area and / or positions them at a lower angle, to prevent application of the composition to the skin until the device moves to position the nozzle(s) 142 to safely dispense the composition onto the target area of the skin.

[0062] In step 310, processing device 150 analyzes the image data to determine whether locations (e.g., flexels), if any, within the imaged region of skin correspond to skin artifacts. Specifically, processing device 150 analyzes the image data to identify those locations within the imaged region of skin that correspond to skin artifacts. More specifically, processing device 150 analyzes the image data to determine whether flexels within the imaged region of skin include skin artifacts having a magnitude (i.e., a magnitude greater than a predetermined threshold level) that warrants application of a cosmetic composition. As will be appreciated by those skilled in the art, the image data may be analyzed by processing device 150 to identify skin artifacts using any suitable method. For example, the image data may be analyzed by processing device 150 to identify frexels, if any, within the imaged region representing skin artifacts whose appearance is to be modified by comparing the reflectance corresponding to flexels captured by detector device 130 to the average reflectance of the entire region of skin. In one exemplary embodiment of step 310, a frexel identified as having a reflectance that significantly deviates from the overall average reflectance of its associated image region is determined to correspond to a skin artifact. In another exemplary embodiment, at least one frexel within the imaged region of skin is analyzed by processing device 150 to determine whether the image data corresponds to a frexel containing spectral content within a range of mid-spatial frequencies for the entire frame of imaged skin (i.e., the image acquired by the detector device in step 304) that has high brightness relative to the balance of the image. Locations where the intensity of the mid-spatial frequencies exceeds a threshold level are identified as artifacts to which a composition should be applied. Preferably, the range of mid-spatial frequencies is determined for each region of skin based on the reflectance of the entire imaged region across the facial skin.

[0063] Frexels with a strong contribution from the mid-spatial frequencies of an image may contain artifacts whose appearance a user may wish to modify or minimize, for example. Mid-spatial frequencies are believed to contribute a small percentage (e.g., about 5%) to the overall spatial frequency of a skin image and / or to the visual perception of the skin. However, spatial frequency components within the mid-spatial frequencies are believed to be particularly visually noticeable and therefore contribute disproportionately to the perceived aesthetic appearance of the skin. Therefore, selectively applying cosmetics to frexels corresponding to details within the mid-spatial frequencies of a skin image to modify or minimize the appearance of the skin may impart an aesthetically pleasing appearance to the skin. It may be particularly beneficial to selectively modify or minimize the appearance of only frexels corresponding to mid-spatial frequencies, thereby providing a visually noticeable aesthetic change to the appearance of the skin while modifying only a limited number of frexels on the skin. Thus, the amount of cosmetic composition applied to the skin may be reduced while still providing an aesthetically noticeable improvement to the appearance of the skin. Additional devices and methods for detecting artifacts using reflectance and mid-spatial frequency analysis are described, for example, in U.S. Pat. Nos. 8,007,062, 9,020,184, and 10,092,082, the disclosures of which are incorporated herein by reference.

[0064] If a skin artifact is detected in step 312, the method proceeds to step 314. In step 314, the processing device 150 directs selected nozzle(s) 142 of the applicator device 140 to apply the composition to the location or flexel of the identified artifact(s) within the imaged region of the skin. The selected nozzle(s) 142 are those that the processing device 150 has determined to be aimed to safely dispense the composition onto the skin. Step 312 applies the composition to those locations or flexels where a skin artifact is detected only if the corresponding nozzle(s) 142 are determined by the processing device 150 to be aimed to safely dispense the composition onto the skin. If the processing device 150 determines that the nozzle(s) 142 are aimed to apply the composition to the skin in an unsafe manner, the processing device 150 directs the nozzle(s) 142 to withhold the composition from dispensing the composition. If no skin artifact is detected in step 312 , the method 300 does not apply a composition to any location within the imaged area of skin, and the method 300 proceeds to step 316 .

[0065] At step 316, device 100 is moved by the user to a new frame or area of skin, and the process is repeated. This movement may be detected by device 100 by any suitable means, such as, for example, an accelerometer or image analysis. Method 300 then returns to step 304 and continues on the new area of skin in the manner described above. Note that method 300 may be interrupted and terminated by the user prior to any one of steps 304-316 by any suitable action, such as, for example, removing device 100 from the skin or switching device 100 off (specifically, turning off device power 180).

[0066] In a further embodiment, device 100 includes end effector 110 having a plurality of grating bars 118 extending through a distal opening 117 of end effector 110, as shown, for example, in FIG. 3. The grating bars 118 of end effector 110 provide a visual guide in the image(s) captured by detector device 130 useful for determining the inclination of device 100 relative to the skin, which may then be used in image analysis to determine whether applicator device 140 is aimed to safely dispense composition onto a target area of skin (steps 306 and 308). In particular, device 100 of this embodiment analyzes image data corresponding to an image, or one or more frames of images, of an area of skin acquired through the grated end effector 110 to determine whether applicator device 140 is aimed to safely dispense composition onto the imaged area of skin. More specifically, the image data acquired by the detector device 130 in this embodiment corresponds to an image or one or more image frames of the area of skin where the distal opening 117 is located, also overlaid with the grid bars 118. The processing device 150 analyzes the image data to determine whether the nozzle 142 of the applicator device 140 is aimed to safely dispense the composition onto the skin. For example, the processing device 150 in this embodiment analyzes the image data to identify at least one shadow cast by at least one of the grid bars 118 and / or by the outer edge of the protruding portion 114 of the end effector 110, and determines the inclination of the nozzle(s) 142 relative to the surface of the skin based on the length, width, and / or shape of the shadow. In one embodiment, the inclination may be quantitatively measured using the length of the shadow. Specifically, if the length of the shadow is above a predetermined threshold, it is determined that the applicator device 140 is aimed to unsafely dispense the composition onto the area of skin. If the shadow length is below a predetermined threshold, the applicator device 140 is determined to be aimed to safely dispense the composition onto the area of skin. In another embodiment, the tilt of the nozzle(s) relative to the surface of the skin may be quantitatively measured using the ratio of two different shadows, as further described below.

[0067] As mentioned above, the tilt of each nozzle or device as a whole may also be determined as a directional vector in three-dimensional space having a magnitude indicating the amount of deviation from the surface of the skin. The directional vector may be a composite of directional components in each of the x, y, and z directions, as shown in FIG. 6 . FIG. 6 shows a view from the inside of the head portion 102 of the device 100 in the distal direction, through the distal opening 117 of the end effector 110, including multiple points indicating the placement of the multiple nozzles 142 of the applicator device 140 in the distal direction. As shown in FIG. 6 , the x-axis extends horizontally along the width of the distal opening 117 relative to the view shown in FIG. 6 . The y-axis extends vertically along the length of the distal opening 117 relative to the view shown in FIG. 6 . The z-axis extends in a direction into and out of the view shown in FIG. 6 . The processing unit 150 analyzes the image data to identify at least one shadow cast by the grid bar 118 and / or the outer edge of the protruding portion 114 of the end effector 110. The processing unit 150 further analyzes the length, width, and / or shape of the shadow to determine each directional component (e.g., in the x, y, and z directions as shown in FIG. 6 ) relative to the tilt of the device 100. Specifically, tilt around the y-axis may be detected in this embodiment when the shadow appears longer on one side along the x-axis (e.g., the left side of the view shown in FIG. 6 ) compared to the opposite side of the x-axis (e.g., the right side of the view shown in FIG. 6 ). Tilt around the x-axis may be detected when the shadow is wider on one side along the y-axis (e.g., toward the bottom of the view shown in FIG. 6 ) compared to the opposite side of the y-axis (e.g., toward the top of the view shown in FIG. 6 ). The size of the shadow, e.g., the length and / or width, may be further analyzed to determine the parallel distance of the device from the surface of the skin, e.g., the distance from the surface of the skin in the z-direction. The size of the shadow increases as the device is positioned further from the surface of the skin. Additionally, the device may provide feedback to the user to suggest corrective movements to reduce the tilt. The feedback may be in a direction and magnitude corresponding to a vector opposite to the tilt of the device.

[0068] FIG. 6 shows two separate representative examples of shadows 402, 404 cast by the outer edge of the protruding portion 114 of the end effector 110. Note that the shadows 402, 404 are shown together in FIG. 6 for illustrative purposes only. When the device is in use, the shadows 402, 404 are detected by the processing unit 150 in image data corresponding to separate images reflecting different orientations and tilts of the device 100, as described below. The shadow 402 shown on the left does not exhibit a tilt component in either the x- or y-axis. However, the length and width of the shadow 402 can be analyzed by the processing unit 150 to determine the z-distance between the device and the surface of the skin. The shadow 404 shown on the right exhibits a z-distance tilt component about the x-axis. As can be seen in FIG. 6, the top of the shadow 404 is narrower than the bottom portion of the shadow 404, indicating that the device is tilted upward along the y-axis toward the skin and downward along the y-axis away from the skin.

[0069] Additionally, the grid bar 118 divides the distal opening 117 into a plurality of opening segments 117a, and each portion of the area of skin framed by each of the opening segments 117a may be independently analyzed by the processing device 150 to determine, for each segment 117a, whether the corresponding portion of the skin is suitable for application of the composition. For example, the processing device 150 may analyze the image data, as described above, to identify and determine the slope of each opening segment 117a based on at least one shadow cast by an adjacent grid bar 118 and / or the outer edge of the protruding portion 114 of the end effector 110. The processing device 150 identifies and measures the shadows to independently determine whether the nozzles 142 aligned with each opening segment 117a are aimed to safely dispense the composition to the area of skin within the opening segment 117a, and controls operation of the applicator device 140 to allow only those nozzles 142 aimed to safely dispense the composition through their corresponding opening segments 117a to apply the composition to the skin. In contrast, nozzles 142 aimed to dispense composition onto the skin in an unsafe manner through these opening segments 117 are temporarily restricted from applying composition to the skin to individually improve the safety of operation of each nozzle 142, as assessed by the slope of each opening segment 117a. This embodiment is further illustrated in Example I below.

[0070] 7a and 7b, the processing unit 150 analyzes the image data to identify pairs of shadows 510a, 510b cast by at least two of the grid bars 118 and / or by the outer edges of the protruding portion 114 of the end effector 110, and determines the inclination of the device or nozzle(s) 142 relative to the skin surface 500 based on the ratio of the length and / or width of the shadows 510a, 510b. FIGS. 7a and 7b show a side view of the interior of the head portion 104 of the device 100. As shown in FIGS. 7a and 7b, the at least one light source 120 is positioned proximal to a sensor of the detector unit 130, and the light source(s) 120 and the detector unit 130 are positioned at or near the midpoint between the opposing outer edges of the protruding portion 114 of the end effector 110. The light source(s) 120 and / or detector unit 130 may be positioned anywhere within the interior of the head portion 104 of the device 100, and may be positioned closer toward one outer edge (e.g., on the left side) compared to the opposing outer edge (e.g., on the right side), or vice versa. The light source(s) 120 may illuminate the interior of the protruding portion 114 of the end effector 110. As seen in FIGS. 7a and 7b, when the distal end 116 of the end effector 110 is not in direct contact with the skin surface 500, each of the opposing outer edges of the protruding portion 114 casts a shadow 510a, 510b on the skin surface 500. The processing unit 150 further analyzes the image data to determine the length and / or width of each of the shadows 510a, 510b to determine the ratio of the lengths or widths of the shadows cast by the opposing outer edges of the protruding portion 114. For example, the ratio is between the length or width of shadow 510a and the length or width of shadow 510b. If the ratio is within a predetermined range, it is determined that applicator device 140 (not shown in FIGS. 7a and 7b) is aimed to safely dispense composition onto skin surface 500. If the ratio of the lengths or widths of shadows 510a, 510b is outside the predetermined range, it is determined that applicator device 140 is aimed in an unsafe manner. More specifically, if the ratio between the length or width of shadow 510a and the length or width of shadow 510b is within a predetermined range, it is determined that the tilt of device 100 is with an acceptable error margin of tilt of distal end 116 relative to skin surface 500.For example, as shown in FIG. 7a, the ratio of the length of shadow 510a to the length of shadow 510b is at or near 1:1, indicating that distal end 116 is parallel or substantially parallel to skin surface 500, i.e., not substantially tilted. Thus, in this particular embodiment, if the ratio of the lengths of the shadows cast by opposing outer edges of protruding portion 114 is near or within a desired margin of error up to a 1:1 ratio, applicator device 140 is determined to be aimed to safely dispense composition onto skin surface 500. As can be seen in FIG. 7b, device 100 is significantly tilted from skin surface 500, such that shadow 510a is significantly shorter than shadow 510b. Thus, the ratio of the length of shadow 510a to the length of shadow 510b deviates significantly from the 1:1 ratio shown in FIG. 7a, indicating that distal end 116 is positioned at a significant angle relative to skin surface 500 and device 100 is not aimed to safely dispense composition.

[0071] 7a and 7b are described with respect to the shadow cast by the opposing outer edges of the protruding portion 114, it is contemplated that the processing device 150 may similarly analyze the image data to identify the shadow cast by the grid bars 118 to frame the aperture segments 117a of the distal apertures 117 and determine the tilt of the nozzle(s) 142 corresponding to the aperture segments 117a relative to the skin surface 500. Each portion of the area of skin framed by each of the aperture segments 117a may be independently analyzed by the processing device 150 to determine, for each segment 117a, the ratio of the shadow cast by the opposing grid bars 118 to frame the aperture segment 117 and determine whether the device 100 is oriented for safe application of a composition to the corresponding portion of the skin.

[0072] 7a and 7b show a flat portion of skin 500, but as noted above, the ratio of the length and / or width of shadows 510a, 510b cast by opposing outer edges of protruding portion 114 may be used to determine the tilt of device 100 or nozzle(s) 142 relative to any contoured skin surface 500. In particular, as noted above, facial contours typically curve around certain sensitive areas, and thus, as a user attempts to address these areas, the skin surface may curve away from the outer edges of protruding portion 114. Thus, if the ratio between the lengths of shadows 510a, 510b is outside a predetermined range, processing device 150 may determine that device 100 is excessively tilted relative to skin surface 500, or that device 100 is near or beyond one of the sensitive areas, either of which may be used based on a determination that applicator device 140 is not aimed to dispense the composition in a safe manner.

[0073] As described above, once it has been determined that the applicator device 140 is aimed to safely dispense the composition onto the skin, the method 300 proceeds to step 310, where the image data is further analyzed to identify locations within the area of skin to which the composition should be applied. In this particular embodiment, the image data corresponds to an image, or one or more images or frames, of the area of skin acquired via the gridded end effector 110, and thus the image data corresponds to those areas of skin between the grid bars 118 that are not visible to the skin beneath the grid bars 118 but are visible to the detector device 130. Thus, in one embodiment of step 310, the image data may be adjusted such that portions of the image data that correspond to the grid bars 118 are modified by the processing device 150, and the adjusted image data is further analyzed by the processing device 150 to identify locations within the area of skin to which the composition should be applied. Such adjustments to the image data are particularly useful for those analysis methods that utilize an average or global data profile of the imaged area of skin to identify skin artifacts, as portions of the image data that correspond to the grid bars 118 that are visually significantly different from the skin would otherwise skew the results of such analysis methods. Thus, in this embodiment, processing unit 150 adjusts the image data by replacing data corresponding to portions of the image that include grid bars 118 with data that approximates portions of the skin not covered by grid bars 118 in the captured image. For example, processing unit 150 may adjust the image data such that data in the portions of the image that correspond to grid bars 118 is replaced with an average value, e.g., average reflectance, for the remainder of the image. In another embodiment, processing unit 150 may adjust the image data such that data in the portions of the image that correspond to grid bars 118 is replaced with an interpolated value generated based on adjacent regions of the captured image. In a further embodiment, processing unit 150 adjusts the image data using a database of previously acquired image data mapped to regions of the user's face, such that data in the portions of the image that correspond to grid bars 118 is replaced with previously acquired image data corresponding to the areas of the face covered by grid bars 118 in the captured image. [Example]

[0074] Example I In Example I, device 100 shown in FIG. 4 above includes two separate green LEDs as its first light source 121 and second light source 122. First light source 121 and second light source 122 are individually and separately controlled by processing unit 150 to turn on and off independently of one another. In this example, device 100 determines whether a nozzle (not shown) is aimed to safely dispense a composition onto the area of skin over which first aperture segment 206 is positioned. First light source 121 and second light source 122 may each have a different wavelength and may be turned on simultaneously. Alternatively, first light source 121 may be turned on while the rest of light sources 120, 122 are turned off for a predetermined period of time. Detector unit 130 captures one or more frames of an image encompassing the area of skin framed by first aperture segment 206 during this time to generate image data (e.g., for 100 frames). The processing unit 150 analyzes the image data to identify a first shadow 208 cast by adjacent grid bars 118 on the area of skin framed by the first aperture segment 206 and determines a length of the first shadow 208. If the length of the first shadow 208 exceeds a predetermined threshold, then the processing unit 150 determines that the nozzle is not aimed to safely dispense the composition to the area of skin where the first aperture segment 206 is located. If the length of the first shadow 208 is below the predetermined threshold, then the processing unit 150 determines that the nozzle is aimed to safely dispense the composition to the area of skin where the first aperture segment 206 is located, allowing the device 100 to further identify and apply the composition to the flexel(s) within the first aperture segment 206 where the skin artifact is detected.

[0075] In this example, device 100 also determines whether the area of skin where second aperture segment 210 is positioned is safe and / or suitable for application of a composition, independent of the above-described imaging and analysis of first aperture segment 206. In a preferred embodiment, first light source 121 and second light source 122 each have a different wavelength and are both used to simultaneously illuminate the area of skin. Alternatively, first light source 121 may be turned off and second light source 122 may be turned on for another predetermined period of time. Detector unit 130 captures a separate set of image(s) encompassing the area of skin framed by second aperture segment 210 during this second period to generate a second set of image data (e.g., for 100 frames). Processing unit 150 analyzes the second set of image data to identify and determine the length of second shadow 212 in a manner similar to that described above for first shadow 208. If the length of second shadow 212 exceeds a predetermined threshold, then processing unit 150 determines that another nozzle (not shown) is unsafely aimed to dispense composition onto the area of skin framed by second aperture segment 210. If the length of second shadow 212 is below a predetermined threshold, processing unit 150 determines that another nozzle is unsafely aimed to dispense composition onto the area of skin where second aperture segment 210 is located, allowing device 100 to further identify and selectively apply composition to the flexel(s) within second aperture segment 210 where a skin artifact is detected.

[0076] Although Example I describes the independent imaging and analysis of two aperture segments, it is contemplated that each of aperture segments 117a may be separately imaged and analyzed by device 100 in a similar manner as described above.

[0077] The invention described and claimed herein is not limited in scope by the specific embodiments disclosed herein, which are intended to be illustrative of certain aspects of the invention. Any equivalent embodiments are intended to be within the scope of the invention. Indeed, various modifications of the invention in addition to those shown and described herein will become apparent to those skilled in the art from the foregoing description. Such modifications are also intended to be within the scope of the appended claims. All publications cited herein are incorporated by reference in their entirety.

[0078] [Embodiment] (1) A handheld device for applying a composition to the facial skin of a user, comprising: an end effector comprising a base portion and a protruding portion extending distally from the base portion, the protruding portion having a distal opening; a detector device configured to acquire image data corresponding to an image of the area of skin through the distal opening of the end effector; and an applicator device configured to apply the composition to a location within the area of the skin; a processing unit configured to receive the image data from the detector unit, analyze the image data to determine whether the applicator device is aimed to safely dispense the composition to the area of skin and whether flexels within the area of skin correspond to skin artifacts, and to guide the applicator device to selectively apply the composition to the flexels when the applicator device is aimed to safely dispense the composition to the area of skin and the skin artifact is detected from the flexels. (2) The device of embodiment 1, wherein the processing device is configured to direct the applicator device to withhold application of the composition to the skin when the applicator device is not safely aimed to dispense the composition onto the area of skin. (3) The device of claim 1 or 2, wherein the processing device analyzes the image data and determines that the applicator device is aimed to safely dispense the composition to the area of skin when the image data corresponds to an area of the user's face that is located at least a predetermined distance away from at least one of the eyes, nostrils, and mouth of the user's face. (4) A device as described in embodiment 1 or 2, wherein the processing unit analyzes the image data to determine tilt of the device. (5) The device of claim 4, wherein the processing device determines that the applicator device is safely aimed to dispense the composition to the area of skin when the magnitude of the tilt of the device is below a predetermined threshold, and determines that the applicator device is not safely aimed to dispense the composition to the area of skin when the magnitude of the tilt of the device is above the predetermined threshold.

[0079] (6) A device described in any one of embodiments 1 to 5, wherein the protruding portion of the end effector further comprises a plurality of grid bars extending across the distal opening, and the image data corresponds to an image of the area of skin superimposed on the plurality of grid bars. (7) The device of embodiment 6, wherein the processing unit is configured to analyze the image data to identify a shadow of at least one of the grid bars in the image and determine a length of the shadow based on the image data. (8) The device of claim 7, wherein the processing device is further configured to determine that the applicator device is safely aimed to dispense the composition to the area of skin if the length of the shadow is below a predetermined threshold, and to determine that the applicator device is not safely aimed to dispense the composition to the area of skin if the length of the shadow is above the predetermined threshold. (9) A device described in any of embodiments 6 to 8, wherein the processing device is configured to adjust the image data to replace data in a portion of the image corresponding to the grid bars with data generated by the processing device closer to the skin below the grid bars, and to analyze the adjusted image data to identify locations within the area of skin corresponding to skin artifacts. (10) A device described in any one of embodiments 1 to 9, wherein the processing device determines whether the skin artifact is detected from the frexel based on the reflectance of the area of skin detected in the image.

[0080] (11) The device of any one of claims 1 to 10, wherein the applicator device comprises a nozzle configured to dispense pressurized pulses of the composition from a reservoir to form a thin layer of the composition on the skin. 12. The device of claim 11, wherein the composition is a cosmetic composition comprising particles of a reflectance modifying agent in a liquid suspension. 13. The device of claim 12, wherein the reflectance modifier is titanium dioxide. (14) A method for applying a composition to the facial skin of a user, comprising: acquiring, with a detector arrangement, image data corresponding to an image of the area of the skin where the device is placed; analyzing the image data with a processing unit to determine the tilt of the device compared to the area of the skin; determining, with the processing device, whether the applicator device is aimed to safely dispense the composition onto the area of skin based on the tilt of the device; analyzing, by the processing device, the image data to identify locations within the region of skin corresponding to skin artifacts; selectively applying the composition to the identified location by the applicator device only if it is determined that the applicator device is aimed to safely dispense the composition onto the area of skin. (15) The method of claim 14, wherein the processing device determines that the applicator device is safely aimed to dispense the composition to the area of skin when the magnitude of the tilt of the device is below a predetermined threshold, and determines that the applicator device is not safely aimed to dispense the composition to the area of skin when the magnitude of the tilt of the device is above the predetermined threshold.

[0081] (16) The method of any one of claims 14 to 15, wherein the image data corresponds to an image of the area of skin superimposed with a plurality of grid bars of an end effector of the device, the grid bars extending across the area of skin. (17) The method of embodiment 16, wherein the processing unit determines the tilt of the device by analyzing the image data to identify a shadow of at least one of the grid bars in the image and analyzing the shadow to determine a three-dimensional vector corresponding to the tilt. (18) A method as described in embodiment 16 or 17, wherein the processing device adjusts the image data to replace data in portions of the image corresponding to the grid bars with data generated by the processing device near the skin beneath the grid bars, and analyzes the adjusted image data to identify locations within the area of skin corresponding to skin artifacts. (19) A method according to any one of embodiments 14 to 18, wherein the processing device identifies a location within the region of skin corresponding to a skin artifact based on the reflectance of the region of skin detected within the image.

Claims

1. 1. A handheld device for applying a composition to the facial skin of a user, comprising: an end effector comprising a base portion and a protruding portion extending distally from the base portion, the protruding portion having a distal opening and a plurality of lattice bars extending across the distal opening; a detector device configured to acquire image data through the distal opening of the end effector corresponding to an image of the area of the skin superimposed with the plurality of grating bars; an applicator device configured to apply the composition to a location within the area of the skin; A processing device, receiving the image data from the detector device; analyzing the image data to determine whether the applicator device is aimed to safely dispense the composition to the area of the skin and whether skin artifacts are detected from flexels within the area of the skin; and the processing device analyzes the image data to determine that the applicator device is aimed to safely dispense the composition to the area of the skin when the image data corresponds to an area of the user's face that is located at least a predetermined distance from at least one of the eyes, nostrils, and mouth of the user's face; when the processing device determines that the applicator device is aimed to safely dispense the composition to the area of the skin and the skin artifact is detected from the flexel, instructing the applicator device to apply the composition to the flexel; a processing unit configured to instruct the applicator device to withhold application of the composition to the skin if the applicator device is not safely aimed to dispense the composition onto the area of the skin.

2. The device of claim 1 , wherein the processing unit analyzes the image data to determine tilt of the device.

3. 3. The device of claim 2, wherein the processing device determines that the applicator device is safely aimed to dispense the composition to the area of the skin when the magnitude of the tilt of the device is below a predetermined threshold, and determines that the applicator device is not safely aimed to dispense the composition to the area of the skin when the magnitude of the tilt of the device is above the predetermined threshold.

4. 2. The device of claim 1, wherein the processing unit is configured to analyze the image data to identify a shadow of at least one of the grid bars in the image and determine a length of the shadow based on the image data.

5. 5. The device of claim 4, wherein the processing device is further configured to determine that the applicator device is safely aimed to dispense the composition to the area of the skin if the length of the shadow is below a predetermined threshold, and to determine that the applicator device is not safely aimed to dispense the composition to the area of the skin if the length of the shadow is above the predetermined threshold.

6. 2. The device of claim 1, wherein the processing unit is configured to adjust the image data to replace data in portions of the image corresponding to the grid bars with data generated by the processing unit beneath the grid bars and closer to the skin, and to analyze the adjusted image data to identify locations within the area of the skin corresponding to the skin artifact.

7. 7. The device of claim 1, wherein the processing unit determines whether the skin artifact is detected from the frexel based on the reflectance of the area of the skin detected in the image.

8. 8. The device of any one of claims 1 to 7, wherein the applicator device comprises a nozzle configured to dispense pressurized pulses of the composition from a reservoir to form a thin layer of the composition on the skin.

9. 10. The device of claim 8, wherein the composition is a cosmetic composition comprising particles of a reflectance modifying agent in a liquid suspension.

10. The device of claim 9 , wherein the reflectance modifier is titanium dioxide.

11. 1. A method for applying a composition to the facial skin of a user, comprising: acquiring, with a detector arrangement, image data corresponding to an image of the area of the skin where the device is placed; analyzing the image data with a processing unit to determine the tilt of the device compared to the area of the skin; determining, by the processing device, whether the applicator device is aimed to safely dispense the composition to the area of the skin based on the tilt of the device, the processing device determining that the applicator device is aimed to safely dispense the composition to the area of the skin if the magnitude of the tilt of the device is below a predetermined threshold and determining that the applicator device is not safely aimed to dispense the composition to the area of the skin if the magnitude of the tilt of the device is above the predetermined threshold; analyzing, by the processing device, the image data to identify locations within the area of skin corresponding to skin artifacts; applying the composition to the identified location with the applicator device only if it is determined that the applicator device is aimed to safely dispense the composition onto the area of the skin; withholding application of the composition to the skin if the applicator device is not safely aimed to dispense the composition onto the area of the skin; A method (excluding medical procedures on humans) wherein the image data corresponds to an image of the area of the skin superimposed with a plurality of grid bars of an end effector of the device, the grid bars extending across the area of the skin.

12. 12. The method of claim 11 , wherein the processing unit determines the tilt of the device by analyzing the image data to identify a shadow of at least one of the grid bars in the image and analyzing the shadow to determine a three-dimensional vector corresponding to the tilt.

13. 13. The method of claim 11 or 12, wherein the processing device adjusts the image data to replace data in portions of the image corresponding to the grid bars with data generated by the processing device below the grid bars and closer to the skin, and analyzes the adjusted image data to identify the location within the area of the skin corresponding to the skin artifact.

14. 14. The method of claim 11, wherein the processing device identifies the location within the area of skin corresponding to the skin artifact based on reflectance of the area of skin detected in the image.

Images