System and method for skin analysis using an electronic device

Abstract

There is a need for an improved method that can perform skin characterization using an electronic device such as a smartphone.SOLUTION: There is a skin analysis device for attachment to an electronic device of a human user, the electronic device having at least one skin property measurement device, the skin analysis device including an enclosure including an enclosure body configured to be removably connected to the electronic device, and one or more skin property measurement assists connected to the enclosure and configured to assist the one or more skin property measurement devices in capturing skin property samples of a skin property of the human user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Provisional Application No. 62 / 438,835, filed December 23, 2016, U.S. Provisional Application No. 62 / 344,287, filed June 1, 2016, and U.S. Provisional Application No. 62 / 326,558, filed April 22, 2016, the entire contents of which are incorporated herein by reference.

[0002] The present invention relates to measuring and analyzing skin characteristics, and more particularly to a system and method for measuring skin characteristics using a smartphone-mounted skin analysis device and sharing the measurements to provide recommended skin care products and cosmetics based on the skin analysis. [Background technology]

[0003] Skin care product manufacturers develop skin care products to help users maintain healthy, beautiful skin. However, one of the biggest problems in the consumer skin care and cosmetics industry is the difficulty of assessing skin type, the inability to quantitatively and objectively demonstrate the effectiveness of skin care products, and the difficulty of matching cosmetic colors to consumers' skin tones.

[0004] Various solutions exist that attempt to address at least some of these challenges. However, the limitations and failures of these solutions are numerous. For example, existing solutions suffer from one or more of the following limitations: (a) Measurement inaccuracies, e.g., due to technical limitations, unrealistic user requirements, etc. (b) The range of measurement capabilities is too limited, for example, only measuring one or two skin care attributes when two or more are required to effectively recommend skin care products or provide skin analysis. (c) Price. For example, most solutions are stand-alone devices that do not utilize existing technology and high-end components. Therefore, the solution includes all the components required for the various measurements and all the necessary product designs. This makes such solutions very expensive. (d) Logistical challenges in deploying the solution. Specialized hardware is difficult to deploy, especially if it is expensive. Hardware that is difficult to calibrate, maintain, or use is equally difficult to deploy, in terms of being used, and used correctly.

[0005] Therefore, there is a need in the art for improved methods and systems that can perform skin analysis using electronic devices such as smartphones. Summary of the Invention

[0006] In a first embodiment of the present invention, a skin analysis device for attachment to a user's electronic device is disclosed, the electronic device having at least one skin characteristic measuring device, the skin analysis device comprising: an enclosure including an enclosure body configured to be removably connected to an electronic device; and one or more passive skin characteristic measurement assists connected to the enclosure and configured to assist the one or more skin characteristic measurement devices in taking skin characteristic samples of the user's skin characteristics.

[0007] In one aspect of the first embodiment, the at least one skin characteristic measurement device is a camera, and the one or more passive skin characteristic measurement assists include a lens positioned in front of the camera when the enclosure is connected to the electronic device.

[0008] In another aspect of the first embodiment, the at least one skin characteristic measurement device is a camera, and the one or more passive skin characteristic measurement assists include a color calibrator assembly positioned in front of the camera when the enclosure is connected to the electronic device.

[0009] In another aspect of the first embodiment, the color calibrator assembly includes a sleeve through which the camera takes pictures, a color calibrator disposed on an inner surface of the sleeve, and a skin-contact ring.

[0010] In another aspect of the first embodiment, the at least one skin characteristic measurement device is a camera, and the one or more passive skin characteristic measurement assists include a light source assembly, the light source assembly comprising: a light source plate having one or more individually controllable light sources thereon that illuminate the user when the camera captures an image of the user; a diffuser plate for diffusing one or more light sources passing through the diffuser plate, the light source plate including one or more light source openings located therein that allow the light sources to pass undiffused; and a set of first light sources providing first light sources arranged on the light source plate such that the first light sources do not pass through the light source openings but are diffused by the diffuser plate.

[0011] In another aspect of the first embodiment, the light source assembly further includes a set of second light sources providing a second light source, the second light source being positioned on the light source plate such that the second light source passes through the undiffused light source opening.

[0012] In another aspect of the first embodiment, the first set of light sources are light emitting diode lights providing light emitting diode light, and the second set of light sources are ultraviolet lights providing ultraviolet light.

[0013] In another aspect of the first embodiment, the skin analysis device further comprises: one or more active skin characteristic measurement assists connected to the enclosure and configured to assist the one or more skin characteristic measurement devices in taking skin characteristic samples of the user's skin characteristics; a skin analysis device processor in communication with the electronic device and the one or more active skin characteristic measurement assistants, to receive a sample capture signal from the electronic device, and and a skin analysis device processor configured to control one or more active skin characteristic measurement assists to assist the one or more skin characteristic measurement devices in capturing the skin characteristic samples.

[0014] In another aspect of the first embodiment, the one or more active skin characteristic measurement assists include a light source assembly.

[0015] In another aspect of the first embodiment, the light source assembly further comprises a first light source and a second light source, wherein the first light source is a light emitting diode (LED) light source and the second light source is an ultraviolet (UV) light source.

[0016] In another aspect of the first embodiment, the skin analysis device further comprises a diffusion plate disposed between the light source plate and the user and configured to diffuse the first light source and not diffuse the second light source.

[0017] In another aspect of the first embodiment, the skin analysis device processor further comprises a Bluetooth transceiver, and the sample capture signal is received from the Bluetooth transceiver of the electronic device.

[0018] In another aspect of the first embodiment, the skin analysis device further comprises: a second skin characteristic measurement device connected to the enclosure and configured to capture a second skin characteristic sample of the user's skin characteristic; a skin analyzer processor in communication with the electronic device and the second skin characteristic measuring device, obtaining a second skin characteristic sample from a second skin characteristic measuring device; and a skin analysis device processor configured to provide the second skin characteristic sample to the electronic device.

[0019] In another aspect of the first embodiment, the skin analyzer processor further comprises: to receive a sample capture signal from the electronic device, and A second skin characteristic measuring device is configured to control the second skin characteristic measuring device to capture a second skin characteristic sample.

[0020] In another aspect of the first embodiment, the second skin characteristic measuring device includes a moisture sensor.

[0021] In another aspect of the first embodiment, the skin analysis device processor further comprises a Bluetooth transceiver, and the sample capture signal is received from the Bluetooth transceiver of the electronic device.

[0022] In another aspect of the first embodiment, the enclosure further comprises a cylindrical sleeve assembly opening configured to be positioned in front of a camera of the electronic device when the skin analysis device is attached to the electronic device.

[0023] In another aspect of the first embodiment, the cylindrical sleeve assembly opening is further configured to receive a skin characteristic measurement assist.

[0024] In another aspect of the first embodiment, the skin analysis device comprises: Further comprising an application installed and operating on the electronic device configured to communicate with the skin analysis device and the electronic device to facilitate obtaining skin characteristic samples from the at least one skin characteristic measuring device.

[0025] In a second embodiment of the present invention, a system for performing one or more skin characteristic analyses is disclosed, comprising: 1. A skin characteristic application operating on an electronic device having a camera capable of taking images of a user, the application comprising: Control the camera to take a set of images for the user performing a set of skin care treatments on a set of images to obtain a set of skin analysis measurements; Communicating with the skin analyzer, Sends a start signal to the moisture sensor to start reading the moisture sensor, a skin characteristic application configured to receive a moisture sensor reading from the moisture sensor; A skin analysis device connected to an electronic device, comprising: 1. A processor, comprising: To receive a trigger signal from the skin characteristics application, and responsive to an activation signal to obtain a moisture sensor reading from the moisture sensor; a processor configured to send the moisture sensor readings to a skin characteristic application; A moisture sensor comprising: A system comprising: a skin analysis device comprising a moisture sensor configured to send moisture sensor readings to a processor.

[0026] In one aspect of the second embodiment, the set of skin care treatments includes a sunscreen treatment and color matching.

[0027] In another aspect of the second embodiment, the set of skin care treatments includes a wrinkle treatment, the wrinkle treatment comprising: Converting the image to Lab color, Removing hair and Applying a high pass filter; Change the image to black and white, using a morphological framework to identify potential wrinkles and fine lines; applying a Hough transform; and further comprising inverting the image so that wrinkles in the image become white.

[0028] In another aspect of the second embodiment, the set of skin care treatments includes a pore treatment, the pore treatment comprising: converting the image to a grayscale image having a grayscale matrix; calculating the mean value of the grayscale matrix; subtracting each grayscale matrix element from the mean value to obtain a new grayscale matrix; For each pixel with a pixel color in the new grayscale matrix, Consider a pixel window around a pixel, Counting pixels within a pixel window that have pixel color values ​​within a specified range; If the first amount of pixels in the pixel window or more are counted, set the pixel color as white and increment the white pixel counter by 1; otherwise, set the pixel color to black; and setting a white pixel counter as the pore score.

[0029] In another aspect of the second embodiment, the skin characterization application is further configured to activate an ultraviolet light source when capturing the set of images; the set of images includes an image before applying the sunscreen and one or more images after applying the sunscreen; The set of skin care treatments includes a sunscreen treatment, the sunscreen treatment Calculating a blue score for the set of images; comparing the blue score to a threshold blue score; and if the blue score exceeds a threshold blue score, instructing the user to reapply sunscreen.

[0030] In another aspect of the second embodiment, the set of images further includes an image before applying the sunscreen, the comparing further includes determining a difference between the blue scores of the images before applying the sunscreen and after applying the sunscreen, and the instructing further includes instructing if the difference between the blue scores of the images before applying the sunscreen and after applying the sunscreen exceeds a reduction threshold.

[0031] In a third embodiment of the present invention, a skin analysis device for attachment to a user's electronic device is disclosed, the skin analysis device comprising: an enclosure including an enclosure body configured to be removably connected to an electronic device; and a cylindrical sleeve assembly opening configured to receive the cylindrical sleeve assembly, the cylindrical sleeve assembly opening being positioned in front of a camera of the electronic device when the skin analysis device is attached to the electronic device; a lens inserted for mounting within the cylindrical sleeve assembly opening radially closer to the camera than the first light source; and a cylindrical sleeve assembly inserted for mounting within the cylindrical sleeve assembly opening, the cylindrical sleeve assembly comprising: a cylindrical sleeve; a moisture sensor disposed on the cylindrical sleeve assembly in communication with the skin analyzer processor such that when the skin analyzer is in a measurement mode, the moisture sensor measures the moisture quality of the user's skin surface; a light source assembly disposed in front of the camera when the skin analysis device is attached to the electronic device, the light source assembly diffusing light from a first light source located thereon and in communication with the skin analysis device processor; a skin analysis device processor in communication with the electronic device, the moisture sensor, and the light source assembly and configured to facilitate one or more skin analyses; a battery for powering the skin analyzer processor.

[0032] In a fourth embodiment of the present invention, there is a system for the collection, dissemination and use of skin characteristic samples from a set of users obtained from their electronic devices, comprising: a set of skin characteristic applications installed on each of a set of electronic devices, Facilitating collection of skin characteristic samples for a user from one or more skin characteristic measuring devices; creating a skin characteristic sample data structure from the skin characteristic samples; The system includes each skin characteristic application configured to enable a first skin analysis based on the skin characteristic sample data structure to produce a result.

[0033] In an aspect of a further embodiment, the skin characteristics application is further configured to present results of the first skin analysis.

[0034] In another aspect of the fourth embodiment, the skin characteristic application further comprises: Implementing a product recommendation algorithm based on the first skin analysis; The device is configured to recommend one or more recommended products based on a product recommendation algorithm.

[0035] In another aspect of the fourth embodiment, the skin characteristic application further comprises: The device is configured to provide one or more screens for purchasing the recommended products.

[0036] In another aspect of the fourth embodiment, the skin characteristic application further comprises: configured to communicate the skin characteristic sample data structure to a skin analysis server; The system is receiving a skin characteristic sample data structure from a set of electronic devices; The system further comprises a skin analysis server configured to store the skin characteristic sample data structure in a storage device.

[0037] In another aspect of the fourth embodiment, the skin analysis server further comprises: calculating one or more relative scores from the sample skin characteristics; The one or more relative scores are configured to be disseminated to the user's electronic device.

[0038] In another aspect of the fourth embodiment, the skin characteristic application further comprises: configured to communicate the skin characteristic sample data structure to a product owner server of the product owner; The system is receiving a skin characteristic sample data structure from a set of electronic devices; The system further comprises a product owner server configured to store the skin characteristic sample data structure in a storage device.

[0039] In another aspect of the fourth embodiment, the skin characteristic sample data structure further includes a user referrer, and the skin characteristic application is further configured to communicate if the product owner is the user referrer.

[0040] In another aspect of the fourth embodiment, a user referrer is established upon installation of a skin characteristic application on the user's electronic device or based on a skin analysis device identifier of a skin analysis device attached to the user's electronic device.

[0041] In another aspect of the fourth embodiment, the product owner server further comprises: Obtain a first skin analysis, Implementing a product recommendation algorithm based on the first skin analysis; recommending one or more recommended products based on a product recommendation algorithm; The one or more recommended products are configured to be provided to the user's electronic device.

[0042] In a fifth embodiment of the present invention, there is a method for matching a user's complexion to a suggested product color for an assumed light from a total color option, acquiring a set of images of a user's face, each image in the set of images including a user portion and a color calibration portion, the color calibration portion including at least one color quadrant of a color calibrator having a known color; For each image in the image set, performing a color correction transformation on the user portion based on the color calibration portion; Remove outlier pixels from the user portion; determining an average color of the user portion; averaging each of the average colors of the user portions to arrive at a determined color for the user; comparing the determined color to total color options to arrive at a suggested product color; and communicating the suggested product color.

[0043] In one aspect of the fifth embodiment, the acquiring is from a camera of an electronic device having a camera attached to the skin analysis device, and the color calibrator is located on the skin analysis device.

[0044] In another aspect of the fifth embodiment, the comparing further comprises: arriving at a color difference between the determined color and the set of colors in the total color option; and selecting the color with the smallest color difference as the proposed product color.

[0045] In another aspect of the fifth embodiment, the arriving further includes applying a hue filter to the colors of the total color option to obtain a set of colors.

[0046] In another aspect of the fifth embodiment, the method comprises: Specifying one or more alternative lights or one or more atmospheres; and Determining whether one or more alternative lights or one or more atmospheres will alter the color of the proposed product, and if so, arriving at one or more contextual suggested product colors; and and communicating the contextual suggested product color.

[0047] In a sixth embodiment of the present invention, a system for measuring elasticity of a user's skin having an original position when the user's skin is at rest is disclosed, the system comprising: an electronic device in proximity to a user's skin such that the user's skin moves in response to a vibration motor, a camera that records video and is controllable by a skin characterization application; a vibration motor that causes the electronic device to vibrate and be controllable by a skin characteristic application; an electronic device including a skin characteristic application, the skin characteristic application including: activating a vibration motor when the camera is positioned to capture video of the user's skin; Let the camera record video After a certain time, the vibration motor is stopped. A system configured to process the video and calculate an elasticity score.

[0048] In an aspect of the sixth embodiment, the skin characteristics application is further configured to process the video by measuring the time it takes for the user's skin to return to its original position.

[0049] In another aspect of the sixth embodiment, the skin characteristic application is further configured to activate a set of bursts of the vibration motor and process a sequence of times for the user's skin to return to its original position.

[0050] In another aspect of the sixth embodiment, the system further comprises a skin analysis device for attachment to the electronic device, the skin analysis device including a sleeve having a lens disposed on an inner surface of the sleeve through which the camera takes pictures, and a skin contact ring that contacts the user's skin when the camera is positioned to capture video of the user's skin.

[0051] In a seventh embodiment of the present invention, there is a color calibrator assembly for ensuring that an image of a user captured by a camera of an electronic device having a field of view is of a known color, the color calibrator assembly comprising: a sleeve attached to the electronic device and positioned over the camera, the sleeve axially through which the camera takes a picture of the field of view; a color calibrator disposed on the inner surface of the sleeve and obscuring a portion of the field of view; and a skin contact ring configured to contact the user at a user contact point when the image is captured.

[0052] In an aspect of the seventh embodiment, the color calibrator assembly of claim 46, wherein the color calibrator further comprises a color ring having one or more color quadrants each having a known color.

[0053] In another aspect of the seventh embodiment, the color calibrator assembly further comprises a color calibrator assembly attachment for removably attaching the color calibrator assembly to the electronic device at an attachment point.

[0054] In another aspect of the seventh embodiment, the sleeve, the attachment points and the user contact points all prevent light from entering the color calibrator assembly.

[0055] In another aspect of the seventh embodiment, the color calibrator assembly further comprises a light source disposed axially along the sleeve and configured to add light of a known color to the field of view when the image is captured.

[0056] In another aspect of the seventh embodiment, the color calibrator assembly attachment is configured to cover the flash of the electronic device and prevent light from the flash of the electronic device from entering the image.

[0057] In an eighth embodiment of the present invention, a moisture sensor calibration system is disclosed, wherein the moisture sensor can be pressed against the user's skin with an unknown pressure when taking a moisture sensor reading, where the pressure affects the moisture sensor reading, and the system: 1. An electronic device, comprising: a camera having a variable focal length and having a focal length at which the image is captured; 1. A skin characteristic application, comprising: taking a first photograph of the test object with strong pressure to facilitate recording i) a first focal length when the first photograph was taken and ii) a first moisture sensor reading from the moisture sensor; taking a second photograph of the test object with light pressure and recording i) a second focal length at which the first photograph was taken and ii) a second moisture sensor reading from the moisture sensor; Calculate the pressure-based moisture adjustment gradient; a skin characteristic application configured to apply a pressure-based moisture adjustment factor to the future moisture sensor readings to arrive at adjusted future moisture sensor readings taken at the future focal length; and A moisture sensor comprising: a moisture sensor configured to provide a moisture sensor reading to a skin characteristic application.

[0058] In an aspect of the eighth embodiment, the skin characteristic application further comprises: determining a pressure-based moisture adjustment gradient having a first (x / y) point at (first focal length / first moisture sensor reading) and a second (x / y) point at (second focal length / second moisture sensor reading); A mean focal length is configured to be quantified from the first focal length and the second focal length.

[0059] In another aspect of the eighth embodiment, applying further comprises: Solving the slope-point form equation Y-Y1=m(X-X1), where Y is the adjusted future moisture sensor reading, Y1 is the future moisture sensor reading, m is the pressure-based moisture adjustment gradient; X is the average focal length, X1 is the focal length of the future.

[0060] In an aspect of the eighth embodiment, the skin characteristic application further comprises: prompting a user to select a first focal point near the center of a display of an electronic device previewing the first photograph; It is configured to receive user input to select a focus point as a trigger to take a photograph.

[0061] In an aspect of the eighth embodiment, the skin characteristic application further comprises: asking the user to select a first focal point near the center of a display of the electronic device previewing the first photograph; It is configured to receive user input to select a focus point as a trigger to take a photograph.

[0062] In a ninth embodiment of the present invention, there is disclosed a system for safely using a skin characteristic measuring device that assists in taking a skin characteristic sample of a user but can be dangerous to the user if used in an improper manner, the system comprising: 1. An electronic device having a skin characteristic measurement device for taking images, the skin characteristic application comprising: If the safe use indicator signal is received, an activation signal can be sent to the harmful effect device to turn on the harmful effect device; an electronic device configured to activate a camera to capture an image; A skin analysis device, comprising: an adverse effect device connected to the skin analysis device, an adverse effect device configured to assist the one or more skin characteristic measuring devices in taking skin characteristic samples of the user's skin characteristics in response to an activation signal from the skin characteristic application; 1. A safe use indicator device comprising: a safe use indicator configured to send a safe use indicator signal to the processor; 1. A processor, comprising: Safe use indicator device to get the signal, A system including a skin analysis device including a processor configured to send a safe use indicator device signal to a skin characteristic application.

[0063] In an aspect of the ninth embodiment, the harmful effect device is an ultraviolet light and the safe use indicator is a moisture sensor. [Brief explanation of the drawings]

[0064] The present invention is illustrated in the figures of the accompanying drawings, which are intended to be illustrative and not limiting, and in which like references refer to like or corresponding parts, and in which: [Figure 1] FIG. 1 illustrates exemplary electronic and skin analysis devices and related system aspects according to one embodiment of the present invention. [Figure 2] 2 and 3 show front views of an exemplary skin analysis device according to one embodiment of the present invention. [Figure 3] Same as above. [Figure 4] 4a-b and 5 show embodiments of a sleeve assembly of a skin analysis device according to one embodiment of the present invention. [Figure 5] Same as above. [Figure 6] FIG. 6 shows a skin analysis device circuit board of a skin analysis device according to one embodiment of the present invention. [Figure 7] 7 and 8 show rear views of an exemplary skin analysis device according to one embodiment of the present invention. [Figure 8] Same as above. [Figure 9] FIG. 9 is a method of assembling an exemplary skin analysis device according to one embodiment of the present invention. [Figure 10] FIG. 10 is a method of using a skin analysis device according to one embodiment of the present invention. [Figure 11] FIG. 11 is a method for performing skin care measurements according to one embodiment of the present invention. [Figure 12a] 12a-m show screenshots of an application for an electronic device according to one embodiment of the present invention. [Figure 12b] Same as above. [Figure 12c] Same as above. [Figure 12d] Same as above. [Figure 12e] Same as above. [Figure 12f] Same as above. [Figure 12g] Same as above. [Figure 12h] Same as above. [Figure 12i] Same as above. [Figure 12j] Same as above. [Figure 12k] Same as above. [Figure 12l] Same as above. [Figure 12m] Same as above. [Figure 13] 13a-b are a color matching method for different lights according to one embodiment of the present invention. [Figure 14a] 14a-d show screenshots of an application for an electronic device according to one embodiment of the present invention. [Figure 14b] Same as above. [Figure 14c] Same as above. [Figure 14d] Same as above. [Figure 15] FIG. 15 shows a screenshot of an application for an electronic device according to one embodiment of the present invention. [Figure 16-1] 16a-f show screenshots of an application for an electronic device with mostly raw images and the resulting processed images according to one embodiment of the present invention. [Figure 16-2] Same as above. [Figure 16-3] Same as above. DETAILED DESCRIPTION OF THE INVENTION

[0065] Generally, the invention described herein is a skin analysis device that attaches to a mobile device and performs one or more skin analysis operations, such as capturing images of a person's face to assess moisture, pores, etc. The images and other measurements are stored and compared to other samples and used to recommend products to aid in skin care.

[0066] As used and further explained herein, the following terms have the following meanings: (a) Rear: The side of an electronic device that is normally facing away from the user when the electronic device is being used by that user, and which may have a rear camera. (b) Electronic Device: A device having a camera to which the skin analysis device can be attached, preferably portable (such as a mobile phone or tablet); exemplary electronic devices include smartphones, tablets, digital cameras, personal computers, televisions, etc. (c) Front: The side of an electronic device that typically faces the user when the electronic device is being used by that user and may have a front-facing camera. (d) Image: Unless otherwise specified, image herein refers to a digital image that can be represented by digital data that can be manipulated and processed by electronic devices and computers (e.g., App18, SAS200, etc.). (e) Skin characteristics: one or more characteristics of skin (including hair), such as color, moisture, oiliness, elasticity, etc. (f) Skin Characteristic Measurement Assist: Components that assist the skin characteristic measurement device in taking skin care measurements. These may generally be considered to be either passive (i.e., not requiring control by electronics or the skin analysis device, such as lens 34, contact ring, sleeve 24, etc.) or active (requiring control by electronics, such as light source plates and vibration motors, etc.). (g) Skin Characteristic Measuring Device: A component that performs skin analysis operations either under its own control or under the control of another component. These may be on-board or separate from either the electronic device 10 and the skin analysis device 20. Each may perform or be part of performing multiple skin analysis operations: skin analysis, skin analysis calibration, and skin analysis measurement. (h) Skin Analysis: One or more analyses of one or more skin characteristics. (i) Skin Analysis Action: Actions that cause, lead to, or result in part of a skin analysis, such as skin analysis measurements, including exemplary skin analysis actions including taking photographs, reading moisture sensors, elasticity testing by imaging or recording, etc. (j) Skin Analysis Calibration: Calibrate one or more aspects of the skin analysis device and / or electronic device to enable accurate skin analysis, and enable exemplary skin analysis calibration including light normalization for exposure and color temperature (both of which may be achieved using a conversion function for color correction). (k) Skin Analysis Device: A device removably attachable to electronic device 10 according to an embodiment of the present invention. (l) Skin Analysis Measurement: A measurement of one or more skin characteristics, including taking moisture readings, imaging wrinkles / fine lines / pores, elasticity readings, skin color, etc., any of which values ​​may be expressed as a "score" either absolute, relative, or average - i.e., pore score, relative wrinkle score, color, etc. (m) Skin Analysis Processing: Processing one or more skin analysis measurements, such as by performing image processing on an image. (n) Skin Analysis Recommendation: Using one or more results of one or more skin analyses and one or more skin care product characteristics, recommend appropriate skin care products to a user. (o) Skin Care Products: Products that aid in one or more skin care properties, such as moisturizers, fine line creams, and cosmetics (such as foundations and blushes). (p) Skin Care Product Manufacturers: Skin care product manufacturers, manufacturers, distributors, brands and brand owners. (q) Skin Care Product Characteristics: Attributes of a particular skin product, which may include product color, moisturizing ability, wrinkle reduction ability, etc. (r) Skin Care Updates: These may contain information about skin care from external sources. For example, weather (clouds, sun, high UV, snow) may come from weather information (not shown, but known to those skilled in the art). (s) Skin characteristics: characteristics of the skin or body parts, such as pores, blemishes, sensitivity (polarized light or other light spectrums may be used to show blood vessels close to the surface of the skin, resulting in a "redder" appearance, wrinkles, elasticity, moisture, oil, acne, and skin color). (t) User / Human User / Subject, Person: The person using the skin analysis device and / or the subject of the skin characteristic sample, as the case may be. (u) User Referrer: An entity that initiates a user's use of System 1, such as by encouraging them to download an app (which may be tracked via app download technology) or by distributing a skin analysis device (which may be tracked using a skin analysis device identifier).

[0067] FIG. 1 illustrates an embodiment of a system 1 having an exemplary electronic device 10 and a skin analysis device 20a that can communicate with a skin analysis server 200 (“SAS”), one or more skin care product manufacturers / owners (“product owners”) 300, and one or more e-commerce vendors / sites (“vendors”) 400 via a network 100. system

[0068] System 1 may enable a user to measure, acquire / collect, store, disseminate, track, act on or use various skin characteristics and samples.

[0069] Measuring and acquiring may refer to collecting data at one or more times (each skin characteristic sample) using one or more skin characteristic measuring devices, with or without assistance from one or more skin characteristic assists. The electronic device 10 may have one or more skin characteristic measuring devices (such as cameras 12) and one or more skin characteristic assists (such as vibration motors). The skin analysis device 20 may also have one or more skin characteristic measuring devices (such as moisture sensors 36) and one or more skin characteristic assists (such as lenses 34 or ).

[0070] Storage may refer to local or remote storage of one or more skin characteristic samples for either a particular user or a larger group of users.

[0071] Tracking allows users to compare themselves to their previous skin characteristic samples (i.e., "My skin is moister than it was a week ago") or other skin characteristic samples (i.e., "My skin is oilier than other people similar to me").

[0072] An action could mean the user purchasing a foundation that matches their skin tone for the light they see in, purchasing and using a recommended moisturizer, or visiting a doctor to have a blemish on their skin checked.

[0073] All such may occur between devices that may be connected via one or more networks 100 of various types and configurations, as described herein. Skin analysis server 200

[0074] The SAS 200 may be a server that stores and processes skin characteristic measurements or samples as described herein. The SAS 200 may be any combination of a web server, an application server, and a database server, as known to those skilled in the art. Each such server may include typical server components, including a processor, volatile and non-volatile memory storage, and software instructions executable thereon. The SAS 200 may also be a central point of communication for the app 18 to perform the functions described herein, including exchanging skin analysis measurement samples, product recommendations, e-commerce capabilities, etc. Of course, the skin characteristic app 18 may perform these functions alone or in combination with the SAS 200.

[0075] The SAS 200 may include a database server that receives all skin characteristic samples from all users and stores them in a user profile for each registered and guest user. These may be received from one or more electronic devices 10, although the app 18 may be configured to store the skin characteristic samples only locally (although it may exclude some of the result information based on demographic comparisons).

[0076] For example, if the user profile includes a user referrer, the SAS 200 (and / or app 18) can share the user profile (and the skin characteristic samples received therefrom) with the user referrer, which may be, for example, by providing the user profile to a product owner's server.

[0077] SAS200 may provide various analytical functions as described herein (such as calculating histograms of a user's comparisons to past scores or comparisons to peers) and may provide various display functions as described herein (such as providing a website that presents various analyses, provides links or functional links to other websites to access, displays such results, etc.). Product Owner 300

[0078] The product owner 300 may be an entity as defined above with respect to skin care product interests, as known to those skilled in the art, and may also have one or more product owner servers, including a web server, an application server, and a database server. Each such server may include typical server components, including a processor, volatile and non-volatile memory storage, and software executable thereon. The product owner 300 may be the communication point for the app 18 (directly or via the SAS 200) for skin analysis measurement samples (such as those obtained through a user provided by such product owner 300 to the skin analysis device 20) and for storing and executing product recommendation algorithms. For example, one or more general product recommendation algorithms may be stored and owned by the SAS 200 for each product recommendation type, or the product owner may own and implement its own proprietary product recommendation algorithm (e.g., the product owner 300 receives the necessary data, runs the product recommendation algorithm, and returns recommended products). The product owner 300 may also provide direct e-commerce services, suggest vendors such as Amazon™ (separately or together with the recommended products), or be agnostic to how the user purchases the recommended products. 400 e-commerce vendors

[0079] Vendor 400 may provide one or more e-commerce websites or screens (e.g., as screens on, separate from, or embedded in app 18) that facilitate business or commercial transactions, including the transfer of information, over network 100 (e.g., the Internet). Types of e-commerce sites include, but are not limited to, retail sites, auction sites, and business-to-business sites. Exemplary vendors 400 that facilitate the purchase of skin care products may include Amazon™, eBay™, and Overstock™. Of course, product owner 300 may have its own e-commerce site as part of a general website, or SAS 200 may be such a vendor. electronic equipment

[0080] Electronic device 10 may be a mobile phone, such as an iPhone™, such as the 6 or 6s. Electronic device 10 may have one or more components thereof, such as a camera 12, and other components common to such devices, such as a flash 8, a motor for causing vibration (a “vibration motor” internal to electronic device 10), a screen, a processor, storage / memory, etc. for camera 12's power and volume buttons. Some of such components may have visual or physical aspects and may be visible or present on the exterior surface of electronic device 10 (“visible components”). Other components may be internal to electronic device 10, such as a GPS transceiver (“internal components”), but may have requirements for the exterior surface of electronic device 10 to function properly (e.g., not blocking GPS or other radio signals).

[0081] The electronic device 10 may include expensive and powerful components (including, but not limited to, a processor, storage / memory, camera 12, etc.). However, such components may not be suitable for a skin characteristic measurement device or skin characteristic measurement assist without the use of another skin characteristic measurement device or skin characteristic measurement assist. For example, the camera 12 may have good resolution but may not have sufficient features (such as optical zoom or magnification) to be able to capture images suitable for skin characteristics and skin characteristic samples. Thus, as described herein, a skin characteristic measurement assist (on the skin analysis device 20 and / or electronic device 10) may be used, or another skin characteristic measurement device may be used).

[0082] The electronic device 10 may have software (e.g., an "app") disposed thereon, as is known, which may be obtained and installed from an "app store." Apps according to embodiments of the present invention may be accessed on the electronic device 10 to perform the functions described herein. The app may also access storage located on the electronic device 10, such as for storing data, as described herein. The app may also facilitate communication between the electronic device 10 and the skin analysis device 20 and the network 100 (and thus the SAS 200, product owner 300, and vendor 400).

[0083] Electronic device 10 may also have an operating system that provides access to various application programming interfaces (“APIs”). Such APIs allow apps on electronic device 10 to “call” the API and thus access various functions of electronic device 10 (such as controlling camera 12, vibration motors, activating electronic device light sources such as flash 8, or controlling its operation when performing skin care treatments).

[0084] The electronic device 10 may have one or more apps 18 (also referred to as skin characteristic applications) installed thereon. The apps 18 may perform various functions described herein and may be a human user's primary method of interacting with the electronic device 10 (in terms of accessing the functions described herein) and the skin analysis device 20. The apps 18 may access various functions and components of the electronic device 10. Specifically, the apps 18 may receive input from the user and provide activation signals to the skin analysis device 20 (e.g., to read a moisture sensor, turn on a light source, etc.).

[0085] Electronic device 10 has an owner / user and may have one or more guest users. Skin analyzer 20a

[0086] Exemplary skin analysis device 20a may be one embodiment of skin analysis device 20. Skin analysis device 20a may include exemplary enclosure 22a and sleeve 24a, both of which may include additional components described herein. Sleeve 24a may be introduced into and removably attached to enclosure 22a, and the two may be introduced together by moving sleeve 24a along attachment line 6.

[0087] The skin analysis device 20a may be introduced and removably attached to the electronic device 10 following the fastening line 2 / 4, such as by snapping the skin analysis device 20a onto the back of the electronic device 10. The shape of the skin analysis device 20, and particularly the enclosure 30, can be modified to allow attachment to a variety of electronic devices 20 (e.g., iPhone™, iPad™, various Android™ phones, personal computers, etc.) in a variety of ways (e.g., a portion of the enclosure 30 securely attaches to a protrusion or edge of the electronic device 10, allowing the electronic device 10 to slide into the electronic device opening 48, etc.). The shape of the enclosure 22, or other aspects of the skin analysis device 20 if desired, can be easily modified to accommodate attachment to a variety of electronic devices 10.

[0088] The enclosure 22, and, if necessary, other aspects of the skin analysis device 20, may also be modified so as not to interfere with or disrupt the function of the electronic device 10. By way of example, visible components may include a volume control, a power or launch button, a camera 12, a flash 8, etc., and such components may be exposed through the component opening 46 if covered or affected by the skin analysis device 20 when attached to the electronic device 10. It should also be understood that the shape of the enclosure 22 and other aspects of the skin analysis device 20 may be readily varied to accommodate the exposure of various visible components of, or the facilitation of the operation of, internal components of, various electronic devices 10.

[0089] 1, sleeve 24a may contain several components of skin analysis device 20, such as lenses, color calibrators, light source plates, diffusers, moisture sensors, etc. (most of which are described herein but not visible in FIG. 1), and may be removable from enclosure 22a. In other embodiments, various components of skin analysis device 20 may be separable from other components to create a stand-alone color calibrator as described herein (e.g., along with one or more sleeves 24, calibration ring 84, optionally one or more light sources 72 / 74, optionally diffuser plate 38, and contact ring 28 including stand-alone color calibrator 80).

[0090] As shown in Figure 1, the skin analysis device 20 can be located at the top end 16 of the back surface 14 of the electronic device 10, and can therefore cover the top of the back surface of the electronic device 10, taking up no more than one-third of the vertical height of the electronic device 10, although the size of such top surface can be modified as needed. Again, as shown in Figure 1, the skin analysis device 20 can be attached to the electronic device 10 so that it only covers a small portion of the front surface of the electronic device 10.

[0091] 2 and 3 show front views, and 7 and 8 show back views, of an exemplary skin analysis device 20 according to one embodiment of the present invention. The skin analysis device 20 generally includes an enclosure 50 including an enclosure body 52, a cylindrical sleeve assembly opening 54, a board housing 96, and an electronics housing 98 further including a top housing 94 and side edges 92, both of which operate in conjunction with a lid 140 to house a PCB 120 and an electronics 10, respectively, a lens 34, a cylindrical sleeve assembly 60 including a cylindrical sleeve 24, a moisture sensor 36a with moisture sensor lead 36b, a first light source 72, a second light source 74, and a light source lead 76. 6, a diffuser plate 38 including a light source opening 42 and a camera lens opening 40, and a color calibration ring 80 including an adhesive strip 86, a calibration ring 84 having one or more color quadrants 82, a skin analyzer circuit board (PCB) 120 including a sleeve cutout 132, a processor (which may also include a Bluetooth™ transceiver) 122, a connector 126, a charging indicator 128, a reset button 124 and a battery 130 (not shown on the back of the PCB 120), and a lid 140 including a reset opening 144 and a charging opening 142. Enclosure

[0092] The enclosure 50 includes an enclosure body 52 configured to be removably connected to the electronic device 10, and a cylindrical sleeve assembly opening 54 configured to receive the cylindrical sleeve assembly 60 and positioned in front of the camera 12 of the electronic device 10 when the skin analysis device 20 is attached to the electronic device 10. When the attached enclosure or other part of the skin analysis device 20 covers the flash 8, any light that is part of the image of the user's skin comes from the light source 70.

[0093] The cylindrical sleeve assembly opening 54, also known as the sleeve housing 54, may further include a base plate 102, a lens plate 104, and a wire opening 106. The base plate 102 may be a surface proximate to the electronic device 10 and optionally forming part of the electronic device housing 98. The base plate 102 may be a surface to which the lens 34 and / or sleeve assembly 60 mate and / or rest when inserted into the sleeve assembly opening 50. The lens plate 104 may be a portion of the base plate 102 that conforms to the shape of the lens 34, facilitating proper positioning of the lens when the skin analysis device 20 is attached to the electronic device 10. The wire opening 106 may be an opening in the sleeve housing 50 configured to allow electrical connections from one or more of the moisture sensor 36a (e.g., moisture sensor lead 36b) and the light source assembly (e.g., lead 76) to be attached to the PCB 120.

[0094] The sleeve housing 54 may further include a contact surface 28 that may be in substantial contact with the subject when a skin analysis is performed. The contact surface 28 may be a material that is comfortable for the user, such as plastic or rubber, and may be integral with the enclosure 50 or may be a separate component connectable to the enclosure 50.

[0095] The sleeve housing 54 may further include one or more lips or shelves 62. The shelves 62 may be optionally cylindrical and may be the portion of the sleeve housing 24 on which the moisture sensor 36 and / or color calibrator are mounted. The lips 62 may be radially inward from the contact surface 28 such that the contact surface largely covers the lip 62.

[0096] The electronic device 10 can be slid into the electronic device housing 98 such that the electronic device 10 contacts the lid 140 and is held in place by the lid 140, the top housing 94, and the side edges 92. Such a connection may be sufficiently secure, for example, as a result of the relative dimensions of the electronic device housing 98 and / or the material properties of the enclosure 50 and the electronic device 10, that removing the skin analysis device 20 from the electronic device 10 is unlikely even if a user attempts to do so.

[0097] The enclosure has a front surface 22 on which advertising or other information may be printed, affixed or otherwise disposed. lid

[0098] The lid 140 may be slidably inserted or placed within the board housing 96 to protect the PCB from the environment external to the skin analysis device 20. The lid 140 is molded to fit within the board housing 96 and otherwise conform to the internal layout of the PCB 120 (thus providing a reset opening 144 and a charging opening 142 that allow access to the reset button 124 and charging button 128, respectively). Once inserted, the lid 140 may form part of the electronics housing 98. lens

[0099] The skin analysis device 20 further includes a lens 34 inserted into the cylindrical sleeve assembly opening 54, radially closer to the camera than the first light source. The lens 34 may have a working distance relative to the skin / surface of 16 mm and a working distance relative to the camera 12 lens of 2 mm. The lens 34 may be glass-coated. There may also be one or more polarizers (which may be thin, tinted sheets that polarize the one or more light sources passing through the polarizer and a window, which may be positioned between the lens 34 and the skin, to aid in sensitivity analysis). The lens 34 may be a magnification lens with a magnification appropriate for the skin surface being imaged (e.g., a 30X lens 34 for skin analysis and a different magnification for hair analysis). Sleeve Assembly

[0100] The cylindrical sleeve assembly 60 is inserted for attachment into the cylindrical sleeve assembly opening 50 and includes a moisture sensor 36 disposed on or within the cylindrical sleeve 24, the cylindrical sleeve assembly 60, and optionally located at an end of the sleeve axially remote from the camera, the moisture sensor 36 enabling the skin analysis device 20 to measure the moisture quality of the human user's surface when in measurement mode, and a light diffusion assembly that diffuses light from a first light source disposed thereon when the skin analysis device is attached to the electronic device at an end of the sleeve axially proximal from the camera 12. Cylindrical Sleeve

[0101] The sleeve 24 may be a cylinder sized to be inserted into the housing 50. The sleeve 24 may rest on the base plate 102 when attached to an enclosure that is substantially black on the inside. The sleeve 24 may have an inner surface and an outer surface. The inner surface of the sleeve 24 may be light-absorbing, such as black, so that the nature of the light directed at a target (such as a user's skin) is visible. Moisture Sensor

[0102] The moisture sensor 36 may include a sensor 36a and a sensor lead 36b. The moisture sensor 36 may measure the moisture content of the skin and provide such measurements to the skin analysis device processor 122. The moisture sensor 36 may be capacitive or resistive. In one embodiment, the moisture sensor 36 is capacitive and includes two circular / cylindrical electrodes having a track thickness of 0.3-1 mm with a gap between them of 0.1-1.5 mm. The moisture sensor 36 may be positioned on and attached to the lip 62 of the sleeve 24 and may be shaped so as not to interfere with the camera 12 (and thus may be positioned radially outward relative to the inner surface / interior of the sleeve 24 so that the camera 12 can capture images through the sleeve 24).

[0103] In testing, a moisture sensor with a 0.9 mm track and 0.1 mm gap was found to produce acceptable, reliable, and repeatable capacitance values ​​for a variety of readings (facial skin, arm skin, etc.) and a good range of capacitance, such that some gradations or degrees of moisture can be attributed to the subject's skin or surface.

[0104] The moisture sensor 36 can communicate with the skin analysis device processor via moisture sensor lead 36b, which can travel along the sleeve opening 54, through the wire opening 106, and connect to the PCB 120.

[0105] During use, the skin analysis device 20, particularly the moisture sensor 36 and contact ring 28, may be in contact with a user's face or other surface. The amount of pressure applied to or pressed against the skin analysis device 20 to contact the user's face can affect the moisture sensor 36 reading in a measurable and predictable way. However, it can be difficult to determine how hard a user is pressing during use. To address this, calibration of the sensor's focal length can be performed. This may involve asking the user to press the device firmly using strong pressure to allow the autofocus to determine a first lens movement distance when taking a first moisture reading, and then asking the user to press the skin analysis device lightly using light pressure to allow the autofocus to determine a second lens movement distance when taking a second moisture reading. The app 18 can then interpolate between these values ​​and calculate a formula that best correlates to a range of focal lengths and moisture readings, as described herein. Then, each time a moisture reading is taken in the future, possibly with an unknown pressure, the future focal length is captured and compared to the first lens travel distance and the second lens travel distance to determine a moisture factoring value that can be applied to the moisture reading. Of course, such an approach can rely on the camera 12 being a camera 12 with a variable focal length. light source board

[0106] The light source plate 70 can include a first light source 72, a second light source 74, and light source leads 76. The light source plate 70 can be in communication with the skin analyzer processor, such as via the light source leads 76. The light source plate 70, in combination with the diffuser plate 38, can be referred to as a light source assembly.

[0107] First Light Source: The first light source may be a light-emitting diode (LED) light, such as via a Vishay Semiconductors™ VLMU3100 (power SMD LED PLCC-2), and may have known light characteristics (luminous intensity, luminous intensity with angular displacement, chromaticity, etc.) that may be described in related technical documentation. A first light source that is an LED light may mean that such light needs to be diffused to avoid creating a white spot on the captured image. As such, each LED light may be directly behind the diffuser plate 38, and its light may not pass through the light source opening 42. Some LED lights may be configured to be polarized using one or more polarizers.

[0108] Secondary Light Source: The secondary light source may be an extreme ultraviolet (UV) light, such as via Vishay Semiconductors™ VLMU1610-365-135, and may have known light characteristics (luminosity, luminosity with angular displacement, chromaticity, etc.) that may be described in related technical documentation. A secondary light source that is a UV light may mean that such light does not need to be diffused when an image is captured. As such, each UV light may be directly behind the light source opening 42 so that the UV light passes through such light source opening 42. UV light may be considered a hazardous device in that it may be dangerous if used improperly (e.g., if directed toward a user's eyes for an extended period of time). As such, special care may be taken in controlling the activation of the UV light, as described herein.

[0109] The light source plate 70 may specifically feature multiple lights from multiple light sources that may be individually controllable and mounted so that the angle of the light striking the surface of the skin is varied. The various angles may illuminate the skin to reveal specific textures in a 3D-type effect. This may assist in one or more skin analyses, such as providing a measurement of the depth of wrinkles or fine lines.

[0110] In use, since the light spectrum of one or more light sources (such as a first light source and a second light source, or others that can be added) is known, the flash 8 may be blocked or disabled (such as via the app 18), the contact ring 28 may be securely fastened to the user's face (creating a user contact point where at least a portion of the skin analysis device 10 and / or electronic device 10 is in close proximity to or in contact with the user's skin), and the sleeve 24 blocks external light so that the light spectrum irradiating the user's skin is known. Optionally, in combination with a color calibrator 80, this can enable one or more color matching functions, as described herein.

[0111] Instead of flash 8, it is desirable to use light source plate 70 (in combination with the other components described herein to avoid other light sources), as the light spectrum is not only known and homogenous (potentially more homogenous than from flash 8), but can eliminate shadows and other anomalies that can make various processes difficult.

[0112] Of course, the light source plate may have any number of light sources and may use a variety of other light sources, for example, infrared light, which can measure skin temperature and therefore can be used for different dermatological assessments. Diffuser

[0113] The diffuser plate 38 may be a component shaped and sized to fit inside the sleeve 24 and, therefore, may be circular or cylindrical. The diffuser plate may be made of any material of any color, provided that it has the required diffusion properties based on the light source to be diffused. In one example, such a diffuser plate 38 may be white plastic. The diffuser plate may include one or more light source openings 42 configured to pass desired light from the light source plate and a camera lens opening 40 that allows the camera 12 to function with the lens 34 to capture an image. Color Calibrator

[0114] Color calibrator 80 may be an exemplary passive skin characteristic measurement assist. Color calibrator 80 may be configured such that when camera 12 captures an image, color calibrator 80, or at least a portion of a calibration ring 84 having at least one color quadrant 82, is in a portion of the image, such as a radial portion of the field of view of camera 12.

[0115] The color calibrator 80 is axially inserted into the sleeve opening 54 and may include an adhesive strip 86 to aid in affixing the color calibrator 80 to the skin analysis device 20, such as by folding the adhesive strip 86 so that the calibration ring 84 is at least partially in the field of view of the camera 12 (i.e., the radially outer portion of the field of view, thus creating both a human user portion and a color calibration portion when an image of the human user is captured). Of course, the color calibrator 80 has a central opening 88 sized to allow the camera 12 to take a photograph through the lens 34, as described herein, and capture a sample of the user's skin large enough to be effective. The color quadrants 82 can include any number of colors of known characteristics. In one embodiment, the only color quadrant with the only known color may be gray, with RGB values ​​of 122 / 122 / 121. In this way, when an image is captured by the camera 12, the color of the user's skin may be adjusted based on adjusting the color of the color quadrants 82 compared to those known colors (as described further herein).

[0116] When combined with other components, color calibrator 80 can form a color calibrator assembly that can essentially retain all light from the image captured by camera 12 that is not coming from flash 8.

[0117] Such a color calibrator assembly may include color calibrator 80, sleeve 24, and skin-contact ring 28. In such a configuration, the color calibrator assembly may remain a passive skin characteristic measurement assist. In another embodiment, the color calibrator assembly may further include a light source plate and / or a diffuser plate 38, resulting in a more effective and flexible color calibrator assembly that may become an active skin characteristic measurement assist. As an active characteristic measurement assist, the color calibrator assembly may require another method of controlling processor 24 or light source plate 70.

[0118] The color calibrator assembly configuration may be attached to the electronic device 10 using the skin analysis device 20 or a portion thereof, or may have a simple attachment mechanism ("color calibrator assembly attachment") such as an adhesive ring on the end of the sleeve 24, or a simple mechanical element that snaps or hooks onto the electronic device 10 at an attachment point. The color calibrator assembly attachment may allow the flash 8 to direct light toward the color calibrator assembly attachment, particularly when used as a passive property measurement assist.

[0119] Although described herein as a component that may be part of the skin analysis device 20 , the color calibrator may also be part of a stand-alone device that is attached to the electronic device 10 . PCB Components

[0120] The PCB 120 may include a sleeve cutout 132, a processor (which may also include a Bluetooth™ transceiver) 122, a connector 126, a charging indicator 128, a reset button 124, a battery 130 (on the back side of the PCB 120, not shown), and one or more I / O connections 134.

[0121] The PCB 120 may be a typically configured circuit board with standard connections between components. The PCB 120 may be configured for insertion into the board housing 96, including having a sleeve cutout 132 that fits around the sleeve housing 50.

[0122] A connector 126 may allow the PCB to be connected to a charging and / or data transfer wire, such as a micro or mini USB, as known in the art. A charging indicator 128 may simply indicate that the battery 130 is charging. A reset button 124 may allow the PCB 120 and, in particular, the processor 122, to be reset.

[0123] The PCB further comprises a battery 130 (on the backside of the board 120) to power the PCB 120, and therefore the power accessories (such as the moisture sensor 36 and the light source board 70). The battery 130 can be charged by plugging it into a connector 126, which may be a micro or mini USB port.

[0124] The PCB 120, and more specifically the processor 132, is in communication with the electronic device 10 (e.g., using a Bluetooth transceiver which may be part of the processor 132, or via another wired or wireless connection), as well as with the moisture sensor 36 and the light source board 70, e.g., via an I / O connection 134.

[0125] Processor 132 may be a microprocessor capable of varied and complex functions, including assisting in the acquisition of skin analysis samples (such as by controlling the functioning of moisture sensor 36 and light source plate 120), and processing data (such as skin analysis samples), and communicating (or controlling communication) as described herein. Components of the skin analysis device that can communicate with or be controlled by processor 132 may be considered active components. Processor 132 may include a Bluetooth transceiver, enabling it to communicate with virtually any Bluetooth device, preferably at least with electronic device 10, to facilitate the functions described herein.

[0126] The processor 132 may be a Bluetooth integrated microprocessor from Silicon Labs™ (BGM111) microprocessor, but may have custom firmware.

[0127] The custom firmware may include most off-the-shelf software (OTSS) instructions to control typical functions. However, custom software instructions may be written to enable the functionality described herein and to address shortcomings of typical firmware. In one embodiment, the custom firmware may simply be written to remove unnecessary code that would cause the processor 132 to be slower responsive. operation

[0128] The processor 132 may perform at least the following operations: (a) Regarding the light source plate 70: controlling the light source or any of its individual lights on and off for specific durations. (b) Regarding the moisture sensor 36: controlling the reading and receiving the reading. (c) With respect to the functionality of the Bluetooth transceiver (embedded in processor 132 or separately): providing its Bluetooth signals to connect to electronic device 10, communicating via Bluetooth as needed to establish and maintain connections, and performing functions as described herein. (d) With respect to electronic device 10: (i) Receive a signal from the electronic device 10 to control one or more of the light source plate 70 or the moisture sensor 36 (e.g., receive a sample capture signal from the electronic device 10 indicating that a sample is to be captured). (ii) Providing signals and / or skin characteristic samples to the electronic device 10, such as moisture sensor readings and light information (e.g., the spectral characteristics of one or more light sources that were on when the image was taken). (e) With respect to the battery 130: monitor the battery voltage and shut off one or more components of the PCB 120 if the voltage of the battery 130 falls below a settable and configurable threshold; and monitor the charging of the battery 130. Skin analyzer - assembly

[0129] FIG. 9 is a method 900 of assembling a skin analysis device 20 according to one embodiment of the present invention.

[0130] Method 900 begins at 902, where various components are fabricated, such as via a three-dimensional printer. Such printed components may include enclosure 20, sleeve 24, and enclosure lid 140. As part of such fabrication / printing, such printed components may be trimmed to remove support material.

[0131] In step 904, the lens 34 may be bonded within the enclosure 24. This may be by gluing the lens 34 onto the base plate 102 and into the lens plate 104.

[0132] In step 906, the light source plate 70 may be bonded to one end of the sleeve 24. The end having the light source plate 70 may be the end closest to the electronic device 10 (the "proximal end"). Bonding may involve adhering the light source plate 70 to the sleeve 24, as described herein, such that the light source is radially inward of the sleeve 24 and directs light through the sleeve 24 toward the distal end of the sleeve 24.

[0133] In step 908, the moisture sensor 36 may be bonded to one end of the sleeve 24 (the end opposite to which the light source plate 70 may be bonded), or it may be the end of the sleeve 24 away from the electronic device (the "remote end"). Bonding may involve gluing the light source plate 70 to the sleeve 24.

[0134] At step 910, a battery can be attached to the skin analyzer processor board 70 and leads (such as moisture sensor lead 36b and light source board lead 76) can be soldered to provide power thereto.

[0135] In step 912, the processor 122 may be flashed with custom firmware as described herein.

[0136] In step 914, the sleeve 24 may be slid into the enclosure 22 and bonded thereto, for example, by applying an adhesive to the inner surface of the sleeve housing 54.

[0137] In step 916 , the skin analysis device processor board can be inserted into the enclosure 22 and the wires for the light source plate 70 and moisture sensor 36 can be soldered to the skin analysis device processor board 120 .

[0138] In step 918, the lid 140 may be inserted into the enclosure lid opening 96 and bonded thereto, for example, by applying an adhesive. Optionally, the enclosure lid opening may be designed such that the connection allows the lid 140 to snap into place.

[0139] Various tests can then be performed on the skin analysis device 20, whether attached to the electronic device 10 or separate from the assembly, to ensure proper functioning of the device. Exemplary tests may include: (a) Lens focus: Focus the camera 12 through the lens 34 on the test pattern to ensure that the captured image is sharp. (b) Bluetooth operation: Check whether the Bluetooth serial number is broadcast. (c) LED functionality: Check whether the light source is controlled and works properly. (d) Moisture Sensor Reading Check: Test the moisture sensor 36 outdoors with a damp towel to ensure proper readings are obtained.

[0140] Of course, it should be understood that various methods of assembling the skin analysis device 20 can be followed and various adjustments can be made to the method 900.

[0141] FIG. 10 is a method 1000 of using the skin analysis device 20 according to one embodiment of the present invention.

[0142] Method 1000 may be performed, singly or in combination, by various elements of system 1. Portions of method 1000 may be implemented or performed separately, together, and in various orders (even if shown in a particular order as parts of method 1000). Various portions of method 1000 may be illustrated in screenshots 1200a-m, 1400a-d, and 1500a-b.

[0143] Method 1000 begins at 1002 where a skin measurement is initiated. This may be, for example, via selecting 1202, 1204, 1232, or 1234. While initiation by other aspects of skin analysis device 20 or system 1 is possible, in typical use, initiation is via app 18 and its user. As shown and described herein, initiation may be one or more skin characteristic measurements in most any combination.

[0144] At 1004, a query is made as to whether the skin analysis device 20 and electronic device 10 have been calibrated. This query may be answered, for example, via the app 18, which may store information or flags indicating whether one or more calibrations have been performed (e.g., an autofocus-based moisture sensor calibration flag indicating whether such calibrations have been performed). The calibrations queried may be any and all calibrations, or simply the calibrations required for the initiated skin characteristic measurement.

[0145] If the required calibration has not been performed, method 1000 proceeds to 1006 where such a calibration is performed. Exemplary calibrations include: (a) Focus-based moisture sensor calibration: (i) The user takes a photo when the skin analysis device 20 lightly touches the skin (sample A), and then takes a photo when the skin analysis device 20 makes firm contact with the skin (sample B). (ii) To take a photo, the user is asked to touch the center of the screen / image (as a trigger to prompt the app 18, control the API, and instruct the camera 12 to take the photo), which instructs the camera 12 to focus on that point. The camera 12 then adjusts its focus, and the focal length parameter becomes a value between 0 and 1 (for at least some electronic devices, the range of values ​​can vary). At the same time, the moisture sensor 36 is read to obtain a moisture value. (iii) Taking two values ​​of depth of focus and moisture, it is possible to measure how much pressure from the user affects moisture (pressure-based moisture adjustment factor). A simple (two-point) X vs. Y graph can be created and a line drawn between the two data points. The slope of the line can then be determined and assumed to be the pressure-based moisture adjustment slope for all measurements using moisture sensor 36, given the difference in applied pressure. (iv) Averaging the two focal depth values ​​also produces an "average pressure" focal depth value or average focal length. Each subsequent moisture sensor reading is normalized as if the focal depth were the average. (v) In general, this may be accomplished by solving the equation in slope point form: Y-Y1=m(X-X1). (A) where Y is the adjusted future moisture sensor reading; (B) Y1 is the future moisture sensor reading, (C) m is the pressure-based water adjustment gradient; (D) X is the average focal length, (E) X1 is the future focal length. (vi) As an example, sample A may have a moisture level of 1000 and a depth of focus of 0.2. Sample B may have a moisture level of 1500 and a depth of focus of 0.8. Thus, the slope of the line is 833. The average depth of focus is 0.5. (vii) A new measurement of a new surface or area of ​​skin (i.e., the actual sample is imaged and the calibration completed when the slope is determined) is then taken (Sample C). Sample C has a depth of focus of 0.3 and a moisture level of 600. Using a point slope form, the moisture level can be adjusted to simulate a depth of focus of 0.5, resulting in an adjusted moisture level of 766. (viii) This calibration may be performed one or more times, for example, upon first use of the skin analysis device 20, upon first use of the skin analysis device 20 with a particular electronic device 10, upon first use for a new user (including guest users) of the electronic device 10. (b) Image Calibration (Exposure and Color Temperature): A conversion function is used to scale the RGB values ​​read from one or more known colors on the color calibrator 80 to their target (known) values. The same scaling factor is applied to all pixels in the skin image. This may be as described herein.

[0146] If calibration is not required, method 1000 proceeds to 1008, where a skin measurement is performed. Each skin characteristic measurement performed may involve one or more skin characteristic measurement devices and one or more skin characteristic measurement assistants, all of which must work in unison to properly perform such a skin characteristic measurement. In one embodiment, the skin characteristic measurement may be based on one or more of moisture sensor readings and / or an image of the user.

[0147] Step 1008 is described in more detail in FIG. 11, but in one simple example, the skin characteristic may be a pore analysis, and step 1008 may involve: (a) The electronic device is provided with an input to take a photo (e.g., by a user pressing a button such as a volume up button) that is received by the app 18. (b) The app 18 communicates with the processor 122 via Bluetooth and causes the processor 122 to turn on the first light source 72. (c) The application 18 takes a photo using the camera API at the same time that the first light source 72 is turned on. (d) The app 18 communicates with the processor 122 via Bluetooth and causes the processor 122 to turn off the first light source 72.

[0148] Portions 1008 and FIG. 11 can be implemented or initiated using, for example, screenshots 1200b / 1200d / 1200e.

[0149] Method 1000 then continues at 1010 where a skin analysis measurement sample is obtained. This may involve the app 18 receiving images from the camera 12 (images 1610, 1630, 1650, etc.) or moisture levels from the moisture sensor 36, which may be received by the processor 122 and then communicated to the app 18, for example, via Bluetooth. It should be understood that step 1010 generally involves transferring captured data, which is generally unprocessed, from the skin characteristic measurement device to the app 18.

[0150] Next, method 1000 continues at 1012, where the skin characteristic measurement samples are processed (i.e., one or more skin analysis processes). Of course, such skin analysis processes will depend on which skin characteristic measurements were taken. However, exemplary skin analysis processes may include various image processing techniques (such as those described herein and shown in FIGS. 10, 11, and 13) that can capture raw images (from camera 12) and apply various techniques.

[0151] As some examples, the following skin care treatments may be performed: (a) Wrinkle / Fine Line Treatment - The following steps are performed: (i) The image is converted from RGB to Lab color space to provide luminance, green-red and blue-yellow color components. (ii) Hair Removal - The Lab image is filtered by removing very dark pixels (when the luminance value of the pixel is significantly darker than the average luminance of the image). (iii) Apply a high-pass filter that removes small noise without reducing sharpness (as Gaussian blur does) or contrast. (iv) Convert the image to a black and white image. (v) Using the morphological framework to identify possible structures of darker morphology (such as possible wrinkles, possible fine lines, and possible pores). (vi) Applying a probabilistic Hough Transform yields a list of wrinkles that fill the empty space after the previous filter. These wrinkles can then be rendered as white lines in another monochrome black image. (vii) Applying an inverse transformation that converts from dark to light and vice versa. (viii) A probabilistic Hough transform is applied, for example as a second pass, to obtain a list of wrinkles that are likely to become fine lines in the original image. The list is then filtered by length, and the remaining wrinkles are grouped. The resulting wrinkle list is used to calculate a score for the original image. The score may be affected by having a different number of wrinkles and wrinkles with different characteristics (length, width, etc.). (ix) An example result may be as shown in image 1640. (b) Pore treatment (i) In general, this technique uses edge detection to identify darker areas of the image that are surrounded by lighter pixels. A second pass can then be performed to remove areas larger than, say, 500 micrometers, since these are likely not pores. In more detail: (ii) Take the image as a pixel matrix (rgb - e.g. where each pixel has a pixel color of rgb) and convert it to a grayscale image (each pixel has r=g=b). (iii) Create an empty matrix with zeros (0) at each position with width and height equal to those from 1). (iv) Calculate the mean value of the grayscale matrix: (v) Subtract each grayscale matrix element from the mean value to obtain a new matrix. (A) Example: grayMatrix[x][y] = meanVal - grayMatrix[x][y]. So the new grayscale matrix is ​​the old matrix subtracted from the mean value. (vi) For each pixel in the new grayscale matrix: (A) Take a 7x7 window around the pixel, making it smaller if the pixel is close to an edge (window of pixels). (B) In this 49 pixel square, count those with pixel color values ​​greater than 23 and less than 90 (e.g., a specified range). (C) For example, in step B), if there are 20 or more pixels out of 49 (20 out of 49 is the first number of pixels), then set the center pixel to white (i.e., the pixel that started the process in step vi). Otherwise, set the corresponding pixel to black. (vii) At this point we have a pixel matrix with only black or white values ​​(after iterating in step vi). (viii) The score will be the total number of white pixels from the image and is achieved by counting it at the end or by incrementing the white pixel counter when setting the pixel color to white. (ix) An example result may be as shown in image 1620. (c) Oil treatment (i) System 1 looks for bacterial fluorescence of corneform and proprioceptor bacteria. These bacteria thrive in sebum (oil). The oilier a person's face is, the more bacteria are found. (ii) The user's skin is then exposed to UVB light (wavelength 370 nm), such as via a second light source, and an image is obtained. (iii) The image is converted to the Lab color space. (iv) The pixels are searched for any pixels within a particular color range of fluorescence and such pixels are counted. (v) The total number of pixels in such color ranges produces a measure of the surface area of ​​the bacteria. (vi) An example result may be as shown in image 1660. (d) Elasticity treatment (i) Generally, two methods can be used based on the capabilities of the camera 12 and the electronic device 10. (A) Method 1, for electronic devices 10 with more limited capabilities, such as high frame rate HD video that cannot record in slow motion: (I) Using the user's age and moisture content, a correlation is performed to determine an estimate of elasticity using one of several equations, with higher moisture generally being more elastic and older age being less elastic. (B) Method 2, in an electronic device 10 having the appropriate features: (I) The user's skin is vibrated (using a vibration motor) and a recording video is taken by a camera, e.g., at 240 frames per second. The length of time of the vibration and the intensity of the vibration (e.g., motor speed / RPM) may be configured and varied for different electronic devices 10. (II) Next, the app 18 measures the amount of skin movement. More specifically, the app 18 measures the time it takes for the skin to "rebound," or return to its original position, after the vibrations have stopped. The more elastic the skin, the faster it returns to its original position. This can be based, for example, on tracking the movement of various pixels, groups of pixels, or areas of the skin, or on tracking the number of pixels that enter and / or leave the field of view. The app 18 can activate one or more starts and stops ("bursts") of the vibration motor, for example, taking one sampling and then processing a set of such recordings over time. One or more positions can be measured and averaged to obtain a score. (III) One or more measurements may be obtained or calculated from this measurement. a. Absolute Score: An absolute score can be obtained from a particular combination of elasticity test parameters (motor RPM, time, field of view size, model / version of electronic device 10, model / version of skin analysis device 20, e.g., for elasticity testing this is not necessary). For example, the absolute score may be between 0 and 1 million. The absolute score can be normalized to a "normal" set of elasticity test parameters to allow for better relative scoring. b. Relative Score: The user can then be compared to other users, for example, with similar demographics (as described herein), to arrive at a relative score. (e) Sunscreen treatment (i) Before the sunscreen is applied, a reference image is captured using, for example, UVB light from a second light source (unless the second light source also has UVA light, blocking UVB light may be required to perform such function). (ii) An image of the user's skin is then taken after the sunscreen has been applied. This may be done whenever the user decides to take another image, or the app 18 may be configured with a reminder schedule. (iii) The image displays a green hue shift (because UVB light cannot penetrate and is reflected with a yellow hue, making the image appear green). This green shift gradually fades to blue as the sunscreen wears off and the second light fades. The bluer the image becomes, the more sunscreen needs to be applied. Thus, for example, by considering pixels in the image, a green hue score can be calculated and a blue hue can be calculated. Thresholds can be set via the app 18 to prompt the user to reapply sunscreen. These can include absolute thresholds (e.g., a threshold blue score) and relative thresholds (e.g., a reduction threshold indicating a decrease in blue score from images before and after applying sunscreen). (f) Color matching process: (i) Color matching consists of two main steps: color determination (determining a color for a user with a particular user's complexion is called the "determined color") and color matching (taking the determined color and matching it to available skin care product shades, either by using a skin care product color guide that may have color values ​​for each product shade). (A) The color is determined by the following procedure: (I) Generally, one or more images of one or more regions of the user's face are acquired. For example, three images can be taken using the same procedure as for skin analysis (as described in method 1000 and FIG. 12e), except that the images are of the neck, cheeks, and forehead. These three images can be averaged as described to produce a single color value. (II) For each of the three images: a. Take an image. b. If normalization is possible (eg, using color calibrator 80, as described herein), normalize the colors, eg, using RGB values. c. Perform a color correction transform to correct for the difference. For example, if color quadrant 84 is black (0 / 0 / 0) and is in the image at 1 / 2 / 2 / , then the RGB values ​​of each color in the image must be adjusted by 1 / 2 / 2. (III) Apply a Gaussian filter to slightly blur the image. (IV) Convert each pixel from RGB to L*ab color space. (V) Calculate the average L value across the entire image. (VI) For each pixel, compare its L value with the average L value of the image. a. If the pixel's L value is within the top 25% darkest (i.e., within the dark threshold) or the top 25% lightest (i.e., within the light threshold), then remove this pixel from consideration (removing the influence of skin color anomalies such as hair, blemishes, freckles, etc.) (commonly referred to as removing outlier pixels). (VII) Calculate the average L, A and B values ​​(average color) of the remaining pixels. (VIII) Repeat the above for the second and third images. (B) Average the three L*ab values ​​to get one L*ab value and convert this to RGB (the determined color). (C) Of course, it should be understood that different numbers of images from different locations and different numbers of locations are possible. Additionally, the threshold value can be varied as appropriate. (D) Comparison with foundation color image: (I) Optionally, perform hue filtering, including: a. Calculate the image hue angle from the determined color ("image hue angle"). b. Specify a skin care product to choose between specific product types ("Total Color Options", e.g. "Foundation" - "Foundation Total Color Options"). i. This can be done by the app 18, the user, or a combination thereof. ii. Total Color Options include: a) All color options known to the app. b) All color options known to the app 18 that are owned by one or more vendors 300. c) All color options within a specific palette or collection, for example 300 from one vendor. d) Colors from one or more skin care product color guides (which may be from one or more vendors 300). iii. Note that the hue angle for each skin care product image may be pre-loaded into the app 18, downloaded from the SAS 200 or vendor 300, or input into the app 18 using the camera and skin analysis techniques described herein. c. Compare the hue angle of the image with the hue angle of each total color option. d. Identify the top 5 (or any number) based on hue-angle comparison ("candidate hue matches"). (II) Calculate the color difference between the user's skin and each hue candidate match using a color difference formula such as CIE DeltaE 2000. (III) The lowest score obtained from the color difference formula is the best matching color for an ambient light that matches a sunny day (approximately D50, possibly converted for accuracy). Recall that the skin image can be normalized to this light. (IV) The user may be asked about the light in which the skin care product is intended to be used (e.g., evening, midday, beach, office, as in 1502 of screenshot 1500a, so that the app 18 can infer applicable light characteristics) and / or the desired mood or look (e.g., casual, rock and roll, sophisticated, as in 1502 of screenshot 1500a, so that the app 18 can infer factors such as visibility when determining a color match or adjustment of the match), which may change the recommended color by, for example, applying method 1300a. Such user interactions may be as shown in FIG. 15 and screenshots 1500a and 1500b.

[0152] Steps 1010 and 1012 may be primarily performed on or by electronic device 10 and / or skin analysis device 20. However, other aspects of system 1, such as SAS 200, may be involved if, for example, more processing power or storage space is required.

[0153] At this point, method 1000 may substantially complete processing of a skin analysis measurement sample for one or more skin analysis measurements. This may result in a skin analysis sample. Such a sample may include one or more raw images, one or more processed images, a user identifier, a date and time stamp, and other relevant information. Images are uploaded to SAS 200 in real time and transmitted from electronic device 10. The user's gender, age, GPS coordinates, and other potentially non-personally identifying information (as well as any necessary / desired personal identification, subject to appropriate privacy requirements) may be stored. As described herein, processing may occur on the device and / or SAS 200 and / or Product Owner 300, depending, for example, on how intensive the processing is, what happens after processing, and which entity will have a copy of the data once everything is complete.

[0154] In one example of a skin characteristic sample, the sample (or skin characteristic sample data structure) may include one or more of the following: (a) Six image files (raw, color, two from each of three locations, or composed). Example images include 1610, 1630, and 1650. (b) Optionally, one or more processed versions of the raw image; example images include 1620, 1640, and 1660. (c) Absolute scores for all skin analyses. (d) RGB values ​​of skin color. (e) One or more moisture readings (absolute and / or normalized). (f) Personal information (such as name, age, ethnicity or race, GPS coordinates where permitted, and gender). (g) Historical Sample or Trend Information.

[0155] Method 1000 then proceeds to 1014 to begin the calculations and present the processing required for the analysis. The steps performed at 1014 will be highly analysis dependent, but the captured sample may be compared at step 1014 to one or more collections or subsets stored in SAS 200 that may be relevant, such as by comparing the current user (compared to themselves over time as in FIG. 14c) or the current user (UI element 1260 as in FIG. 12g) to all users of SAS 200 (or product owner 300) in the user's demographics.

[0156] The method 1000 then proceeds to 1016, where the results may be displayed to the user, for example, on one or more screenshots of the app 18 (eg, as shown in FIG. 12g and FIGS. 14a-d).

[0157] Method 1000 then continues at 1018, where a recommendation algorithm is executed. Of course, 1018 can occur before or simultaneously with 1014 / 1016. A recommendation algorithm may exist for each skin characteristic, or even for various combinations of skin characteristics. The recommendation algorithm may be substantially the general recommendation algorithm described herein and may be executed by app 18 and / or SAS 200. In such cases, app 18 and / or SAS 200 may have the necessary data and simply apply the recommendation algorithm. Alternatively, the recommendation algorithm may be executed by product owner 300, for example, if product owner 300 has its own recommendation algorithm. In such cases, app 18 and / or SAS 200 may provide the data necessary for the recommendation algorithm ("recommendation request data") to product owner 300, which may communicate recommended products (either all necessary data or skin product identifiers identifying products whose information is stored in app 18) back to app 18.

[0158] The method 1000 then proceeds to 1020, where one or more recommended products are displayed for the user to view and consider purchasing, for example as shown in FIG. 12h.

[0159] Steps 1018 and 1020 may be somewhat iterative in that they may further involve prompting the user for additional information to better perform the recommendation algorithm. For example, the user may have undergone a moisture analysis and may have dry skin. At 1018, a moisturizer may be recommended. However, after presenting such a recommended product, at 1020 or earlier, method 1000 may ask the user whether they plan to use the product during the day and / or outdoors. If so, the recommendation algorithm may change the moisturizer to one with UV protection, particularly if a skin care update or an external source indicates high UV for the user's location (which may be determined by the GPS location of electronic device 10).

[0160] 11 is a method 1100 for taking skin analysis measurements according to one embodiment of the present invention. Method 1100 essentially addresses how to perform or obtain recording of skin analysis measurements (transferring them to app 18, processing them, and communicating them separately from app 18 beyond).

[0161] Method 1100 begins at 1102, reached, for example, from 1008. At 1102, a query is made as to whether the skin analysis device 20 (and / or electronic device 10) is in place. This may mean that the skin analysis device 20 is being held against the user's face or body. Such a step may be desirable if one or more of the skin characteristic measurement devices and / or skin characteristic measurement assists are potentially damaging (harmful effect devices—skin characteristic measurement devices may assist in capturing a user's skin characteristic sample, but may be dangerous to the user if used in an improper manner). For example, in one embodiment, the second light source 74 may be UV, potentially damaging to the eyes, or other potentially damaging light sources (lasers, infrared, etc.). At 1102, the moisture sensor 36 (a safe use indicator device in such an example) is queried, and if a reading from the moisture sensor 36 indicates that the user has the skin analysis device 20 in place (in such a case, such a reading is a safe use indicator signal), the method may proceed, particularly before the UV light is turned on for safe use. Of course, it may be desirable to ensure that the skin analysis device 20 is in place before performing method 1100, for example to prevent taking inappropriate images. Alternatively, these queries may be performed immediately prior to activation of a particularly problematic / hazardous skin characteristic measurement device.

[0162] If the skin analysis device 20 is not in place, then at 1104 the method 1100 may wait.

[0163] Method 1100 can then reach 1106 and begin a loop (1106-1120 or 1122) for each skin characteristic measurement to be generated. Broadly speaking, there is imaging and moisture sensor readings. However, within imaging, performance of 1106-1120 may vary slightly for wrinkles / fine lines, oil, elasticity, etc., based on, for example, what device or assist is used.

[0164] Returning to 1108, for a given skin characteristic measurement, a query is made as to whether the necessary skin characteristic measurement devices are ready. As an example, the camera 12 or moisture sensor 36 may need to be turned on or warmed up (as known by the app 18), especially if they have not been used recently. If they are not ready, the method 1100 waits at 1110 to prepare them.

[0165] At 1112, a query is made as to whether the necessary skin characteristic measurement assist is ready for a given skin characteristic measurement. This is much the same as the skin characteristic measurement devices at 1108 and 1110. As an example, the first light source 72 may preferably be warmed (to make its light spectrum more homogenous) before use.

[0166] Having ensured that the necessary components are ready, each skin characteristic measurement assist may be activated 1116 (one or more for a given skin characteristic measurement). For a passive skin characteristic measurement assist, this is not necessary (i.e., the lens 34 may already be in place). For an active skin characteristic measurement assist, this may be as follows: (a) The app 18 communicates with the processor 132 (e.g., via Bluetooth) to: (i) For wrinkle treatment, turn on the first light source (unpolarized) in preparation for image capture; (ii) For oily skin, turn on the second light source in preparation for image capture; (b) Apps 18 that communicate with the assistant, for example via an API, (i) For elasticity, the vibration motor is turned on in preparation for image (e.g., video) capture.

[0167] At 1118, each skin characteristic measurement device may be activated (one or more for a given skin characteristic measurement), possibly after a delay to ensure the assist is fully primed (e.g., one second after a particular light source is activated). This involves: (a) The app 18 uses the API to prepare the camera 12, and then accepts input from the user (such as the volume up button being pressed) or a timer to automatically take a picture. (b) App 18 uses the API to turn on "Live Preview" (wrinkles / pores / moisture / oil, etc.). (c) The app 18 communicates with the processor 132 (e.g., via Bluetooth) to initiate communication with the moisture sensor 36.

[0168] At 1120, the activated skin characteristic measurement device and skin characteristic measurement assist may be deactivated (eg, by turning off the first light source 72).

[0169] At 1122, the method 1100 may verify that the appropriate function has occurred. This may be done via logic on the app 18 and / or via input from the user (e.g., by indicating acceptable image quality). This may be performed, for example, using screenshots 1200f.

[0170] The method 1100 may then return to 1010 as described herein.

[0171] Although 1106-1122 are described "for each skin characteristic measurement," it should be understood that several can be combined in quick succession. For example, one or more may be initiated simultaneously, such that control over the above is taken from the user (i.e., by turning various light sources on and off before and between various image captures). The user or logic within app 18 can select one or more skin characteristic measurements, and once the user places the skin analyzer at a first skin location, the necessary steps can be taken without further user input.

[0172] In one exemplary embodiment, wrinkles, oiliness, and moisture are the skin characteristic measurements. Assuming method 1100 reaches 1116 (i.e., camera 12, lens 34, first light source 72, and moisture sensor 36 are ready), the following may occur: (a) The first light source is turned on. (b) An image is taken. (c) The first light source is turned off. (d) The second light source is turned on. (e) An image is taken. (f) The second light source is turned off. (g) The moisture sensor is activated. (h) The processor obtains the moisture sensor reading. (i) The moisture sensor is turned off. (j) The app 18 ensures that the two images and moisture sensor readings are acceptable (e.g., in combination with the user indicating the same) and ends the method 1100.

[0173] 12a-m show screenshots of an app 18 for an electronic device 10 according to one embodiment of the present invention.

[0174] Screenshots 1200a-m illustrate various app 18 screens that may be shown to a user to enable the user to access the functionality described herein. Each such screen may include one or more user interface (UI) elements (buttons, text, widgets, icons, pictures, drop-down lists, tabs, infographics, etc.). It should be understood that screenshots 1200a-m and the illustrated UI elements are exemplary only, and that many designs, layouts, screen orders and styles, UI elements, and features are possible for implementing the functions and aspects of the invention described herein.

[0175] Starting with screenshot 1200a, the user may be presented with buttons 1202 or 1204 to select what they would like to do first. Of course, all of the buttons here may be accessed with user input (e.g., pressing an on-screen button or using a pointing device). If the user selects button 1202, they may begin a skin analysis, as described herein. If the user selects button 1204, they may begin product discovery, as described herein.

[0176] In screenshot 1200b, the user may be presented with the following UI elements: (a) Tab selectors 1206-1214: The user can switch between areas of the application 18 such as: (i) "User Information" 1206: A user can specify and view stored information about the user, as shown in screenshot 1200c and shown in user information area 1226. (ii) Analysis 1208: To initiate and execute the steps of conducting a skin care analysis, the user can view several screenshots (e.g., 1200d-f). (iii) Results 1210: The user can view some screenshots (such as 1200g and 1400a-d) to see the analysis results. (iv) Products 1212: The user can view some screenshots (eg, 1200h) to view recommended products and optionally initiate their purchase. (v) Help 1214: The user may view several screenshots (e.g., 1200i-m) to provide tutorial information on how to perform steps for analyzing or otherwise using system 1 and its components as described herein. (b) UI elements 1216 are a collection of UI elements that show various aspects of the user's skin (skin characteristics) and allow the user to specify the aspects that concern them. These selections may preselect or initiate the steps or functions necessary to analyze the selected skin characteristics when the user toggles to "Analyze." Others may be added over time, and some may be included but not shown, such as sunscreen, as described herein. Instead of UI element 1216, UI element 1420 may be displayed in screenshot 1200b. Such UI element 1420 may, for example, show rewards or awards the user has earned based on past skin analysis results. Such may offer, for example, free or discounted skin care products or other recognition, for example, compared to peers or against a skin care "leaderboard." (c) The UI element 1218 may show a user's skin history, for example, a chart or summary of moisture levels over a period of time, such as the summary shown at 1422 in screenshot 1400b of FIG. 14b or 1432 / 1430 in screenshot 1400c of FIG. 14c. (d) UI element 1220 can show skin care updates and can include links to recommended products (e.g., "Tomorrow is a strong UV day, so wear sunscreen"), and pressing UI element 1220 can display a screenshot such as 1200h to the user that can pre-select a sunscreen based on the user and their skin characteristics. (e) UI element 1222 can show current feedback to the user, for example highlighting trends regarding their skin characteristic sample or comparison to others. (f) UI element 1224 may show an icon for adding a user profile (either the first user profile for app 18 or an additional user profile). (g) UI elements 1226 and 1228 (FIG. 12c) show and allow for input of user information. Such user information can display results based on demographics (i.e., age, gender, ethnicity), make results more accurate, and provide a quality control check (i.e., if ethnicity is "people of color" and the skin analysis measurement indicates very light skin, this may be confirmed).

[0177] In screenshot 1200d, the user may be presented with the following UI elements: (a) UI element 1229 may enable the app 18 to switch between taking samples for the logged-in user and as a guest so that a particular electronic device 10 (having a skin care analysis device 20) can be shared among friends. (b) UI element 1230 may allow the user to jump to tutorials on how to use the app 18 and skin care analyzer device 20. (c) UI elements 1232-1236 may allow a user to initiate one or more analyses of one or more skin characteristics, such as wrinkles / pores / moisture / elasticity 1232, oil 1234, and acne 1236. One or more of such UI elements may be disabled (unselectable). This may be, for example, if the required skin analysis measurement device or skin analysis device assist is not available on either the skin analysis device 20 or the electronic device 10. Other such UI elements may be added, such as those relating to sunscreen and other analyses added later.

[0178] In screenshot 1200e, the user may be presented with a photograph of a user 1240 and various sample locations 1242, 1244, 1246 for the user to apply the skin analysis device 20 to perform the intended analysis.

[0179] In screenshot 1200f, the user can view the captured image 1248 (note that it can be post-processed in FIG. 12f), along with buttons for Retake 1250, Save and Take Next Image 1252 (i.e., save a copy of the image on the electronic device 10), and Next 1254 (i.e., the image is used but not saved to the photo album of the electronic device 10).

[0180] In screenshot 1200g, a user may be presented with the results of a skin care analysis. Such results may be described based on a type of result 1256 and a type aspect of result 1258. In this example, the type is for comparable people, and the aspects are the same gender, same age range, and same country. The type may also be for one's own data, as the aspects are historical data. The results may be presented in a results summary infographic 1260, which may include percentiles for the wrinkles 1262, pores 1264, moisture 1266, elasticity 1268, oil 1270, and acne 1272 results.

[0181] In 1260, percentiles can be assigned to each result (note that the 100% percentile is preferred in FIG. 12g, but either nomenclature can be used). These percentiles may generally be calculated for various skin characteristics as follows: (a) Wrinkles 1262: More wrinkles and / or thicker wrinkles are generally worse. The surface area and total number of wrinkles in an image can be counted. The wrinkles per unit area can then be calculated. This "wrinkle score" is compared to users of the same demographic, with lower scores in the lower percentile. (b) Pores 1264: More and / or larger pores are generally worse. The total number of pores detected in the image can be counted. The surface area represented in the image can be determined. The pores / unit area can then be calculated. This "pore score" is compared to users of the same demographic, with lower scores being in the lower percentile. (c) Moisture 1266: Generally, the more moist the skin, the better. Moisture scores, typically numerical (possibly normalized as described herein), are compared to users of the same demographic, with higher scores in lower percentiles. (d) Elasticity 1268: Generally, the more elastic the skin, the better. Elasticity scores may be compared to users of the same demographic, with higher scores being in the lower percentile. (e) Oil 1270: Generally, the less oily the skin, the better. Oil scores are compared to users of the same demographic, with lower scores in the lower percentile. (f) Acne 1272: Generally, the less acne on the skin the better. Acne scores can be compared across users of the same demographic, with lower scores being in the lower percentile. (g) Sunscreen (see 1400a): Generally, better sunscreen provides more coverage. That means the greener the image, the better, as bluer it is indicating less effective sunscreen. A blue score is applied and the results are displayed, which can indicate whether the user has adequate sunscreen, especially compared to the current weather / UV (as shown in 1402).

[0182] As noted, screenshot 1200 is an example screenshot that can show results. Another example screenshot showing results without comparison can be seen in screenshot 1400d of FIG. 14d. In such screenshot 1400d, UI element 1446 can show various skin characteristics (1442) and their results / scores (1444).

[0183] In screenshot 1200h, the user may be presented with recommended products 1274 along with information about the recommended products 1276, such as ratings, reviews and links thereto, volumetric information, and price. In particular, other users' ratings and reviews may be specific to users with similar skin types and / or skin tones, increasing the value of the ratings and reviews, for example, by filtering the ratings and reviews. The information about the recommended products may further include benefits 1278 and usage instructions 1280. The user may select button 1282 to initiate a purchase of the recommended products, for example, by adding them to a cart on app 18 and / or vendor 400's app (as known in the art).

[0184] Screenshots 1200i-m may present various images 1284, 1286, 1288, 1290, and 1292 that provide instructions to the user. Of course, these may be accompanied by text as needed. Generally, and as further described herein, the user washes their face, checks that it is “normal” (i.e., free of dirt or makeup anomalies), properly positions the skin analysis device, presses a button (such as a volume button) on electronic device 10 to initiate image capture by camera 12 (such as 1288), and waits for a response from app 18 (e.g., via an audible signal or vibration) indicating that the capture is complete.

[0185] 13a-b are also a method 1300a and an example thereof for color matching for different lights according to an embodiment of the present invention.

[0186] The purpose of method 1300a may be to determine whether a shade other than mindE is desirable for a desired user, lighting conditions, and look based on light other than ambient light (e.g., as may be specified by the user: outdoors, too bright for watching TV, darker than indoors, etc.) and the user's potentially desired mood or look (e.g., "mood" such as rock and roll in 1502). As explained, method 1300a considers the image (and thus mindE) to be based on ambient light at the time of capture (optionally normalized to such light, referred to as "captured light"), and the user may then desire product / shade recommendations for either outdoor light or indoor light (each "alternative light" having "alternative light characteristics," as in 1502). Of course, different captured lights and different alternative lights can be used, and all of the configurable parameters can be adjusted to suit (e.g., parameters vary depending on differences in properties between the captured light and various alternative lights). The goal is to change mindE if there is a more appropriate shade for the light / look in which the user intends to use the skin care product (such a more appropriate shade is the "contextual suggested product color").

[0187] The method 1300a begins at 1302 where the minimum dE (minimum color difference) and resulting color (mindE color) are found as described herein (eg, of a candidate hue match or overall color option).

[0188] At 1304, dE values ​​are found for shades that are +1 and +2 darker than the mindE color (i.e., mindE1C and mindE2C, or 1 and 2 shades darker). The dE values ​​between the shades are then found at 1306.

[0189] At 1308, a query is made as to whether mindE1 minus mindE is less than or equal to 1 (where 1 may be set, being the dE between shades in the selection of color options). Of course, if there are more shades in the color options, then the next darker shade is more likely to be closer to mindE (meaning the query at 1308 is more likely to be "yes").

[0190] In 1310, if the answer is yes, the recommended product for outdoor use (assuming such use is specified) would be mindE1.

[0191] At 1312, a query is made if mindE2 minus mindE1 is less than or equal to a configurable parameter (6 as an example for shades 1-6, using the shades from screenshot 1350) and if mindE2 minus mindE1 is less than or equal to a further configurable parameter (3 as an example for shades 7-10, using the shades from screenshot 1350). If so, then at 1316, mindE2C becomes the recommended product for indoor lighting (if the user requests such product recommendations, or they may be stored in app 18). Otherwise, mindE1C becomes the recommended product for indoor lighting.

[0192] Returning to 1308, if the result of the query is "no", the method 1300 continues to 1318 where mindE becomes the recommended product for outdoor lighting.

[0193] Next, at 1320, a query is made if mindE1 minus mindE is less than or equal to a configurable parameter (6 as an example for shades 1-6 using the shades from screenshot 1350) and if mindE1 minus mindE is less than or equal to a further configurable parameter (3 as an example for shades 7-10 using the shades from screenshot 1350). If so, then at 1322, mindEC becomes the recommended product for indoor lighting (if the user requests such product recommendations, or they may be stored in app 18). Otherwise, mindE1C becomes the recommended product for indoor lighting.

[0194] 13b, screenshot 1350 may be an example screenshot when "MyColor" tab 1356 is selected. Screenshot 1350 shows measured skin color 1352 and one or more color options, including a total color option and its color values ​​for a particular color match. Tab 1358 may bring the user to a screenshot, which may be similar to screenshot 1200h, with recommended products, which may be color-matched skin care products such as foundation, blush, etc.

[0195] In 1302b, medium tan is determined to be mindE. In 1304b, tan and deep tan are mindE1C and mindE2C, respectively. In 1306b and 1308b, subtraction is performed, resulting in values ​​of (.925 and 3.197). Thus, tan (mindE1C) becomes the outdoor recommended product or color match in 1318b, and tan becomes the indoor recommended product or color match in 1322.

[0196] Embodiments of the systems and methods described herein may be implemented in hardware or software, or a combination of both. These embodiments may be implemented in a computer program running on a programmable computer or electronic device, each such device including at least one processor, a data storage system (including volatile or non-volatile memory or other data storage elements, or a combination thereof), and at least one communication interface. In certain embodiments, the computer may be a digital or any analog computer.

[0197] Program code is applied to input data to perform the functions described herein and to generate output information that is applied to one or more output devices, in known fashion (for example, this may be accomplished via an application running on an electronic device).

[0198] Each program may be implemented in a high-level procedural or object-oriented programming language, or a scripting language, or both, to communicate with and / or between computer systems. However, the programs may also be implemented in assembly or machine language as needed and / or required by a particular processor or device. The language may be a compiled or interpreted language. Each such computer program may be stored on a storage medium or device (e.g., read-only memory (ROM), magnetic disk, optical disk) readable by a general-purpose or special-purpose computer to configure and operate the computer when the storage medium or device is read by the computer to perform the procedures described herein. System embodiments may also be considered to be implemented as a non-transitory computer-readable storage medium configured with a computer program, the storage medium configured to cause the computer to operate in a specific, predetermined manner to perform the functions described herein.

[0199] Furthermore, the systems and methods of the described embodiments can be distributed in a computer program product that includes a physical, non-transitory computer-readable medium having computer-usable instructions for one or more processors. The medium may be provided in various forms, including one or more diskettes, compact discs, tapes, chips, magnetic and electronic storage media, and the like. Non-transitory computer-readable media includes all computer-readable media, except for transitory propagating signals. The term non-transitory is not intended to exclude computer-readable media such as volatile memory or random access memory (RAM), where data stored therein is stored only temporarily. The computer-usable instructions may be in various forms, including compiled and non-compiled code.

[0200] It will be apparent to one skilled in the art that other configurations, hardware, etc. may be used in any of the above-described embodiments of the products, methods, and systems of the present invention. It will be understood that the specification is illustrative of the present invention, and that other embodiments within the spirit and scope of the invention will be apparent to those skilled in the art.

[0201] The foregoing embodiments have been described by way of example only, and the present invention is not limited by these examples, but is defined by the claims that follow.

Claims

1. 1. A skin analysis device for attachment to a user's electronic device, the skin analysis device having at least one skin characteristic measuring device, an enclosure including an enclosure body configured to be removably connected to the electronic device; and one or more passive skin characteristic measurement assistants connected to the enclosure and configured to assist the one or more skin characteristic measurement devices in taking skin characteristic samples of the user's skin characteristics.

2. 10. The skin analysis device of claim 1, wherein the at least one skin characteristic measurement device is a camera, and the one or more passive skin characteristic measurement assists include a lens positioned in front of the camera when the enclosure is connected to the electronic device.

3. 10. The skin analysis device of claim 1, wherein the at least one skin characteristic measurement device is a camera, and the one or more passive skin characteristic measurement assists include a color calibrator assembly positioned in front of the camera when the enclosure is connected to the electronic device.

4. The color calibrator assembly includes: The skin analysis device of claim 3 , comprising a sleeve through which the camera takes pictures, a color calibrator disposed on an interior surface of the sleeve, and a skin contact ring.

5. The at least one skin characteristic measurement device is a camera, and the one or more passive skin characteristic measurement assistants include a light source assembly, the light source assembly comprising: a light source plate having one or more individually controllable light sources thereon that illuminate the user when the camera captures an image of the user; a diffuser plate for diffusing one or more light sources passing through the diffuser plate, the light source plate including one or more light source openings located therein that allow the light sources to pass therethrough undiffused; a first set of light sources that provide the first light sources, the first light sources being arranged on the light source plate such that the first light sources do not pass through the light source openings but are diffused by the diffuser plate.

6. 6. The skin analysis device of claim 5, wherein the light source assembly further includes a set of second light sources that provide the second light sources and are arranged on the light source plate such that the second light sources pass through the light source opening without diffusing.

7. The skin analysis device of claim 6 , wherein the first set of light sources are light emitting diode lights that provide light emitting diode light, and the second set of light sources are ultraviolet lights that provide ultraviolet light.

8. one or more active skin characteristic measurement assists connected to the enclosure and configured to assist the one or more skin characteristic measurement devices in capturing skin characteristic samples of the user's skin characteristics; a skin analysis device processor in communication with the electronic device and the one or more active skin characteristic measurement assistants, receiving a signal from the electronic device to receive a sample; 10. The skin analysis device of claim 1, further comprising: a skin analysis device processor configured to control the one or more skin characteristic measurement assistants to assist the one or more skin characteristic measurement devices in capturing skin characteristic samples.

9. The skin analysis device of claim 8 , wherein the one or more active skin characteristic measurement assists include a light source assembly.

10. 7. The skin analysis device of claim 6, wherein the light source assembly further includes a first light source and a second light source, the first light source being a light emitting diode (LED) light source and the second light source being an ultraviolet (UV) light source.

11. The skin analysis device of claim 7 , further comprising a diffuser plate configured to be between the light source plate and the user and configured to diffuse the first light source and not diffuse the second light source.

12. 10. The skin analysis device of claim 8, wherein the skin analysis device processor further comprises a Bluetooth transceiver, and the sample capture signal is received from a Bluetooth transceiver of the electronic device.

13. a second skin characteristic measurement device connected to the enclosure and configured to capture a second skin characteristic sample of the user's skin characteristic; a skin analysis device processor in communication with the electronic device and the second skin characteristic measurement device, the skin analysis device processor comprising: obtaining a second skin characteristic sample from the second skin characteristic measuring device; The skin analysis device of claim 1 , further comprising a skin analysis device processor configured to provide the second skin characteristic sample to the electronic device.

14. The skin analyzer processor receiving a sample of a signal from the electronic device; 14. The skin analysis device of claim 13, further configured to control the second skin characteristic measuring device to capture the second skin characteristic sample.

15. The skin analysis device of claim 14 , wherein the second skin characteristic measuring device comprises a moisture sensor.

16. 15. The skin analysis device of claim 14, wherein the skin analysis device processor further comprises a Bluetooth transceiver, and the sample capture signal is received from a Bluetooth transceiver of the electronic device.

17. 10. The skin analysis device of claim 1, wherein the enclosure further comprises an opening in a cylindrical sleeve assembly configured to be positioned in front of a camera of the electronic device when the skin analysis device is attached to the electronic device.

18. 20. The skin analysis device of claim 17, wherein the opening in the cylindrical sleeve assembly is further configured to receive a skin characteristic measurement assist.

19. 10. The skin analysis device of claim 1, further comprising an app installed on and operating on the electronic device configured to communicate with the skin analysis device and the electronic device to facilitate obtaining the skin characteristic sample from the at least one skin characteristic measurement device.

20. 1. A system for performing one or more skin characteristic analyses, comprising:

1. A skin characteristic application running on an electronic device having a camera capable of taking images of a user, the application comprising: controlling the camera to take a series of images of the user; performing a set of skin care treatments on the set of images to obtain a set of skin analysis measurements; Communicating with the skin analyzer, Sends an activation signal to the moisture sensor to start reading the moisture sensor; a skin characteristic application configured to receive moisture sensor readings from the moisture sensor; a skin analysis device connected to the electronic device, 1. A processor, comprising: receiving an activation signal from the skin characteristic application; obtaining a moisture sensor reading from the moisture sensor in response to the activation signal; a processor configured to transmit the moisture sensor readings to the skin characteristic application; A moisture sensor comprising: and a skin analysis device comprising a moisture sensor configured to transmit moisture sensor readings to the processor.

21. The system of claim 20 , wherein the set of skin care treatments includes a sunscreen treatment and color matching.

22. The set of skin care treatments includes a wrinkle treatment, the wrinkle treatment comprising: converting the image to L*a*b color; Removing hair and Applying a high pass filter; changing the image to black and white; using a morphological framework to identify potential wrinkles and fine lines; applying a Hough transform; 21. The system of claim 20, further comprising: inverting the image so that wrinkles in the image are white.

23. The set of skin care treatments includes a pore treatment, and the pore treatment includes: converting the image into a grayscale image having a grayscale matrix; calculating a mean value of said grayscale matrix; subtracting each grayscale matrix element from the mean value to obtain a new grayscale matrix; For each pixel having a pixel color in the new grayscale matrix: Consider a pixel window around said pixel, Counting the pixels within the pixel window that have pixel color values ​​within a specified range; if a first amount or more of pixels within the pixel window are counted, setting the pixel color as white and incrementing a white pixel counter by one, otherwise setting the pixel color to black; 21. The system of claim 20, further comprising: setting the white pixel counter as a pore score.

24. the skin characterization application is further configured to activate an ultraviolet light source when capturing the set of images; the set of images includes one image before applying sunscreen and one or more images after applying sunscreen; The set of skin care treatments includes a sunscreen treatment, the sunscreen treatment comprising: calculating a blue score for the set of images; comparing the blue score to a threshold blue score; 21. The system of claim 20, wherein the system prompts reapplication of sunscreen if the blue score exceeds the threshold blue score.

25. 25. The system of claim 24, wherein the set of images further includes an image before applying sunscreen, wherein comparing further includes determining a difference in the blue color score of the image before applying sunscreen to the image and after applying sunscreen, and wherein instructing further includes instructing if a difference between the blue color score of the image before applying sunscreen and the image after applying sunscreen exceeds a decrease threshold.

26. 1. A skin analysis device for attachment to a user's electronic device, comprising: an enclosure comprising: an enclosure body configured to be removably connected to the electronic device; and a cylindrical sleeve assembly opening configured to receive a cylindrical sleeve assembly, the cylindrical sleeve assembly opening being positioned in front of a camera of the electronic device when the skin analysis device is attached to the electronic device; a lens mounted and inserted within the cylindrical sleeve assembly opening radially closer to the camera than the first light source; a cylindrical sleeve assembly inserted for attachment within the cylindrical sleeve assembly opening, a cylindrical sleeve; a moisture sensor disposed on the cylindrical sleeve assembly in communication with a skin analyzer processor such that the moisture sensor measures moisture quality of the user's skin surface when the skin analyzer is in a measurement mode; and a cylindrical sleeve assembly comprising: a light source assembly positioned in front of the camera when the skin analysis device is attached to the electronic device, the light source assembly diffusing light from a first light source located thereon and in communication with the skin analysis device processor; the skin analysis device processor in communication with the electronic device, the moisture sensor, and the light source assembly and configured to facilitate one or more skin analyses; a battery for powering said skin analyzer processor.

27. 1. A system for capturing, disseminating, and using skin characteristic samples from a set of users obtained from the users' electronic devices, comprising: a set of skin characteristic applications installed on each of the set of electronic devices, each skin characteristic application comprising: Facilitating the capture of skin characteristic samples for a user from one or more skin characteristic measurement devices; creating a skin characteristic sample data structure from the skin characteristic samples; A system including: each skin characteristic application configured to enable a first skin analysis based on the skin characteristic sample data structure to produce a result.

28. The skin characteristic application 28. The system of claim 27, wherein the system displays the results of the first skin analysis.

29. The skin characteristic application running a product recommendation algorithm based on said first skin analysis; 28. The system of claim 27, further configured to recommend one or more recommended products based on the product recommendation algorithm.

30. The skin characteristic application 30. The system of claim 28, further configured to provide one or more screens for purchasing the recommended product.

31. The skin characteristic application further configured to communicate the skin characteristic sample data structure to a skin analysis server; The system further comprises a skin analysis server, the skin analysis server comprising: receiving the skin characteristic sample data structure from the set of electronic devices; 28. The system of claim 27, configured to store the skin characteristic sample data structure in a storage device.

32. The skin analysis server calculating one or more relative scores from the sample skin characteristics; 32. The system of claim 31, further configured to disseminate the one or more relative scores to a user's electronic device.

33. The skin characteristic application further configured to communicate the skin characteristic sample data structure to a product owner server of a product owner; The system further comprises the product owner server, the product owner server comprising: receiving the skin characteristic sample data structure from the set of electronic devices; 28. The system of claim 27, configured to store the skin characteristic sample data structure in a storage device.

34. 34. The system of claim 33, wherein the skin characteristic sample data structure further comprises a user referrer, and the skin characteristic application is further configured to communicate if the product owner is the user referrer.

35. 35. The system of claim 34, wherein the user referrer is established upon installation of the skin characteristic application on the user's electronic device or based on a skin analysis device identifier of a skin analysis device attached to the user's electronic device.

36. The product owner server: obtaining said first skin analysis; running a product recommendation algorithm based on said first skin analysis; recommending one or more recommended products based on the product recommendation algorithm; 34. The system of claim 33, further configured to provide the one or more recommended products to the user's electronic device.

37. 1. A method for matching a user's complexion with a suggested product color for an assumed light from a total color option, comprising: acquiring a set of images of the user's face, each image in the set of images including a user portion and a color calibration portion, the color calibration portion including at least one color quadrant of a color calibrator having a known color; For each image in the set of images: performing a color correction transform on the user portion based on the color calibration portion; removing outlier pixels from said user portion; determining an average color of the user portion; averaging each of the average colors of the user portions to arrive at a determined color for the user; comparing the determined color with the total color options to arrive at the suggested product color; and communicating the suggested product color.

38. 38. The method of claim 37, wherein said obtaining is from a camera of an electronic device having a skin analysis device mounted thereon, and wherein said color calibrator is disposed on said skin analysis device.

39. The comparing step comprises: arriving at a color difference between the determined color and a set of colors in the total color option; 38. The method of claim 37, further comprising: selecting the color with the smallest color difference as the suggested product color.

40. 40. The method of claim 39, wherein said arriving further comprises applying a hue filter to the colors of the total color option to obtain the set of colors.

41. specifying one or more alternative lights or one or more atmospheres; determining whether the one or more alternative lights or one or more atmospheres alter the color of the proposed product, and if so, arriving at one or more contextual suggested product colors; 38. The method of claim 37, further comprising: communicating a color of the contextual suggested product.

42. 1. A system for measuring elasticity of a user's skin having an original position when the user's skin is at rest, comprising: an electronic device in proximity to the user's skin such that the user's skin moves in response to a vibration motor, a camera that records video and is controllable by a skin characterization application; a vibration motor that vibrates the electronic device and is controllable by the skin characteristic application; an electronic device including the skin characteristic application, the skin characteristic application comprising: activating the vibration motor when the camera is positioned to capture video of the user's skin; causing the camera to record the video; After a certain time, the vibration motor is stopped. A system configured to process the video and calculate an elasticity score.

43. 43. The system of claim 42, wherein the skin characteristics application is further configured to process the video by measuring the time it takes for the user's skin to return to the original position.

44. 43. The system of claim 42, wherein the skin characteristic application is further configured to activate a set of bursts of the vibration motor and process a sequence of times for the user's skin to return to the original position.

45. 43. The system of claim 42, further comprising a skin analysis device for attachment to the electronic device, the skin analysis device including a sleeve having a lens disposed on an inner surface of the sleeve through which the camera takes pictures, and a skin contact ring for contacting the user's skin when the camera is positioned to capture video of the user's skin.

46. a color calibrator assembly for ensuring that an image of a user captured by a camera of an electronic device having a field of view is of a known color; a sleeve attached to the electronic device and positioned over the camera axially through which the camera takes a picture of the field of view; a color calibrator disposed on an inner surface of the sleeve and obscuring a portion of the field of view; a skin contact ring configured to contact the user at a user contact point when the image is captured.

47. 47. The color calibrator assembly of claim 46, wherein the color calibrator further comprises a color ring having one or more color quadrants each having a known color.

48. 48. The color calibrator assembly of claim 47, further comprising a color calibrator assembly attachment for removably attaching the color calibrator assembly to the electronic device at an attachment point.

49. 49. The color calibrator assembly of claim 48, wherein the sleeve, the attachment points, and the user contact points all prevent light from entering the color calibrator assembly.

50. 47. The color calibrator assembly of claim 46, further comprising a light source disposed axially along the sleeve and configured to add light of a known color to the field of view when the image is taken.

51. 51. The color calibrator assembly of claim 50, wherein the color calibrator assembly attachment is configured to cover a flash of the electronic device and prevent light from the flash of the electronic device from entering the image.

52. 1. A system for calibrating a moisture sensor, the moisture sensor being capable of being pressed into contact with the user's skin with an unknown pressure when taking a moisture sensor reading, wherein the pressure affects the moisture sensor reading, the system comprising:

1. An electronic device, comprising: a camera having a variable focal length and having a focal length at which the image is captured; 1. A skin characteristic application, comprising: taking a first photograph of the test object with strong pressure and facilitating recording i) a first focal length at which the first photograph was taken and ii) a first moisture sensor reading from the moisture sensor; taking a second photograph of the test object with light pressure and recording i) a second focal length at which the first photograph was taken and ii) a second moisture sensor reading from the moisture sensor; Calculate the pressure-based moisture adjustment gradient; a skin characteristic application configured to apply a pressure-based moisture adjustment factor to the future moisture sensor reading to arrive at an adjusted future moisture sensor reading at the future focal length; and A moisture sensor comprising: a moisture sensor configured to provide a moisture sensor reading to the skin characteristic application.

53. The skin characteristic application further comprises: determining a pressure-based moisture adjustment gradient having a first (x / y) point at (the first focal length / the first moisture sensor reading) and a second (x / y) point at (the second focal length / the second moisture sensor reading); 53. The system of claim 52, configured to quantify an average focal length from the first focal length and the second focal length.

54. The applying further comprises: solving a slope form equation of the equation Y-Y1=m(X-X1), Y is the adjusted future moisture sensor reading; Y1 is the future moisture sensor reading; m is the moisture adjustment gradient based on the pressure, X is the average focal length, 54. The system of claim 53, wherein X1 is the future focal length.

55. The skin characteristic application further comprises: prompting a user to select a first focal point near a center of a display of the electronic device previewing the first photograph; 55. The system of claim 54, configured to receive user input selecting the focus as a trigger to take a photograph.

56. The skin characteristic application further comprises: asking a user to select a first focal point near the center of a display of the electronic device previewing the first photograph; 56. The system of claim 55, configured to receive user input selecting the focus as a trigger to take a photograph.

57. 1. A system for safely using a skin characteristic measuring device that assists a user in taking a skin characteristic sample, but that may be dangerous to the user if used in an improper manner, comprising:

1. An electronic device having a skin characteristic measurement device for taking images, the skin characteristic application comprising: If a safe use indicator signal is received, an activation signal can be sent to the harmful effect device to turn on the harmful effect device; an electronic device configured to activate a camera to capture an image; A skin analysis device, comprising: an adverse effect device connected to the skin analysis device, an adverse effect device configured to assist one or more skin characteristic measuring devices in taking skin characteristic samples of the user's skin characteristics in response to an activation signal from the skin characteristic application; 1. A safe use indicator device comprising: a safe use indicator configured to send a safe use indicator signal to the processor; The processor, Safe use indicator device to get the signal, a skin analysis device including a processor configured to transmit the safe use indicator device signal to the skin characteristic application.

58. 58. The skin analysis device of claim 57, wherein the adverse effect device is an ultraviolet light and the safe use indicator is a moisture sensor.

Images