A skin detection method, system and storage medium

Abstract

The present application relates to a skin detection method, system and storage medium, and to the technical field of skin detection. The skin detection method includes: obtaining a first facial image of a user; selecting a target area based on the first facial image; controlling a first test paper to wipe the target area of ​​the user's face; judging whether the user's face needs to be processed according to the first test paper; if so, processing the user's face, otherwise, obtaining skin status information based on the first facial image; obtaining a second facial image of the user after the facial processing; and obtaining skin status information based on the second facial image. The present application has the effect of improving the accuracy of skin detection results.

Description

Technical Field

[0001] The present application relates to the technical field of skin detection, and in particular to a skin detection method, system and storage medium. Background Art

[0002] With the popularization of health knowledge, users are paying more and more attention to their own conditions in various aspects, for example, they are paying more and more attention to their skin conditions. Therefore, in daily life, some users often check their skin conditions.

[0003] In the related art, when a user detects his or her own skin condition, he or she usually directly takes a photo of the user's skin through a corresponding device, and then calculates the user's skin condition information through a skin detection algorithm.

[0004] The above-mentioned existing technical solutions have the following defects: the state of the skin when taking skin photos directly affects the final skin state information, making the final skin state information easily affected by the skin surface state and having errors, and there is still room for improvement. Summary of the invention

[0005] In order to improve the accuracy of skin detection results, the present application provides a skin detection method, system and storage medium.

[0006] In a first aspect, the present application provides a skin detection method, which adopts the following technical solution:

[0007] A skin detection method, comprising:

[0008] Obtaining a first facial image of a user;

[0009] selecting a target area based on the first facial image;

[0010] Controlling the first test paper to wipe the target area on the user's face;

[0011] Determining whether the user's face needs to be processed according to the first test paper;

[0012] If yes, process the user's face, otherwise, obtain skin condition information based on the first facial image;

[0013] Acquire a second facial image of the user after facial processing;

[0014] Skin condition information is derived based on the second facial image.

[0015] By adopting the above technical solution, the target area is first selected based on the first facial image, and the first test paper after wiping the target area is detected to determine whether there are other substances on the user's face that interfere with the skin detection results. If there are no substances on the user's face that interfere with the skin detection results, the skin state information is obtained based on the first facial image through the skin detection algorithm. If there are substances on the user's face that interfere with the skin detection results, the user's face is first processed, and then a second facial image is taken, and finally the skin state information is obtained based on the second facial image through the skin detection algorithm, so that the skin detection results are not easily affected by other substances, and the accuracy of the skin detection results is improved.

[0016] Optionally, selecting a target area based on the first facial image includes:

[0017] Acquire a light-dark boundary based on the first facial image;

[0018] Selecting a center point based on the bright-dark dividing line;

[0019] The area around the center point is selected as the target area.

[0020] By adopting the above technical solution, when the user's face is greased or covered with cosmetics, it is in a strong reflective state, and the reflective intensity of the grease is greater than the reflective intensity of the cosmetics. When the user's face is not greased or covered with cosmetics, it is in a weak reflective state. A center point is selected from the light-dark dividing line, and then the area around the center point is selected as the target area based on the center point to ensure that there are interference objects in the target area, thereby improving the accuracy of detecting whether there are interference objects on the user's face.

[0021] Optionally, judging whether it is necessary to process the user's face according to the first test paper includes:

[0022] Obtaining the light transmittance of the first test paper;

[0023] Determining whether the light transmittance of the first test paper is included in a preset light transmittance range;

[0024] If yes, there is no need to process the user's face, otherwise, process the user's face.

[0025] By adopting the above technical solution, it is possible to detect whether there are any interfering objects on the user's face. If there are any interfering objects on the user's face, the user's face is processed to improve the accuracy of the user's facial skin detection.

[0026] Optional, including:

[0027] Determine the interference source of the user's face based on the light transmittance of the first test paper compared with a preset database;

[0028] The user's face is processed according to the interference source on the user's face.

[0029] By adopting the above technical solution, the interference sources on the user's face are obtained according to the first test paper, and then the user's face is processed according to the type of the interference source to ensure that the user's face is cleaned.

[0030] Optionally, processing the user's face according to the interference source on the user's face includes:

[0031] Selecting a cleaning solution according to the interference source;

[0032] Spraying cleaning solution onto the user's face;

[0033] Control first wet cotton cloth to wipe the user's face;

[0034] Control a second damp cotton cloth to wipe the user's face.

[0035] By adopting the above technical solution, the corresponding cleaning liquid is selected according to different interference sources to ensure that the user's facial skin can be cleaned. After controlling the first wet cotton cloth to wipe the user's face, the second wet cotton cloth is controlled to wipe the user's face to ensure that the interference on the user's face can be cleaned.

[0036] Optionally, the interference sources include grease and powder.

[0037] Optionally, after wiping the user's face with the second wet cotton cloth, the control further comprises:

[0038] Controlling the second test paper to wipe the user's face;

[0039] Obtaining the light transmittance of the second test paper;

[0040] Determining whether the light transmittance of the second test paper is included in a preset light transmittance range;

[0041] If yes, then obtain the second facial image, otherwise, control the third wet cotton cloth to wipe the user's face.

[0042] By adopting the above technical solution, the skin wiped by the second wet cotton cloth is subjected to a secondary detection to ensure that there are no other interferences on the user's facial skin before obtaining the second facial image, thereby improving the accuracy of the user's skin detection.

[0043] Optionally, before obtaining the second facial image of the user after facial processing, the method further includes:

[0044] Get the humidity of the user's face;

[0045] Determining whether the humidity of the user's face is greater than a preset humidity;

[0046] If yes, the blowing device is controlled to blow air toward the user's face until the humidity of the user's face is no greater than a preset humidity.

[0047] By adopting the above technical solution, the skin detection result is not easily affected by the moisture left on the user's face by the wet cotton cloth, thereby improving the accuracy of the user's facial skin detection.

[0048] In a second aspect, the present application provides a skin detection system, which adopts the following technical solution:

[0049] A skin detection system, comprising:

[0050] An image acquisition module, used to acquire a first facial image and a second facial image of a user;

[0051] A selection module, configured to select a target area based on the first facial image;

[0052] A wiping module, used for controlling the first test paper to wipe the target area on the user's face;

[0053] A judging module, used for judging whether the user's face needs to be processed according to the first test paper;

[0054] a facial processing module, used for processing the user's facial features based on the instructions of the judgment module; and

[0055] A skin condition calculation module is used to obtain skin condition information based on the first facial image or the second facial image.

[0056] By adopting the above technical solution, the target area is first selected based on the first facial image, and the first test paper after wiping the target area is detected to determine whether there are other substances on the user's face that interfere with the skin detection results. If there are no substances on the user's face that interfere with the skin detection results, the skin state information is obtained based on the first facial image through the skin detection algorithm. If there are substances on the user's face that interfere with the skin detection results, the user's face is first processed, and then a second facial image is taken, and finally the skin state information is obtained based on the second facial image through the skin detection algorithm, so that the skin detection results are not easily affected by other substances, and the accuracy of the skin detection results is improved.

[0057] In a third aspect, the present application provides a computer storage medium, which adopts the following technical solution:

[0058] A computer-readable storage medium stores a computer program that can be loaded by a processor and execute any of the above methods.

[0059] By adopting the above technical solution, the skin detection method as described above can be stored conveniently.

[0060] In summary, the present application includes at least one of the following beneficial technical effects:

[0061] First, the target area is selected based on the first facial image, and the first test paper after wiping the target area is detected to determine whether there are other substances on the user's face that interfere with the skin detection results. If there are no substances on the user's face that interfere with the skin detection results, the skin state information is obtained based on the first facial image through the skin detection algorithm. If there are substances on the user's face that interfere with the skin detection results, the user's face is first processed, and then a second facial image is taken. Finally, the skin state information is obtained based on the second facial image through the skin detection algorithm, so that the skin detection results are not easily affected by other substances, and the accuracy of the skin detection results is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 This is a flow chart of a skin detection method according to Example 1 of the present application.

[0063] Figure 2 This is a flowchart of selecting a target area based on the first facial image according to Example 1 of the present application.

[0064] Figure 3 It is a structural schematic diagram of a skin detection system according to Example 2 of the present application. DETAILED DESCRIPTION

[0065] The present application is further described in detail below in conjunction with the accompanying drawings.

[0066] This specific embodiment is merely an explanation of the present application and is not a limitation of the present application. After reading this specification, those skilled in the art may make non-creative modifications to the present embodiment as needed, but such modifications are protected by patent law as long as they are within the scope of the claims of the present application.

[0067] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0068] In addition, the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally means that the associated objects before and after are in an "or" relationship.

[0069] The embodiments of the present application are further described in detail below in conjunction with the drawings in the specification.

[0070] Example 1

[0071] An embodiment of the present application provides a skin detection method, and the main process of the method is described as follows.

[0072] like Figure 1 As shown:

[0073] Step 110: Acquire a first facial image of the user.

[0074] The first facial image of the user is obtained by photographing with a camera.

[0075] Step 120: Select a target area based on the first facial image.

[0076] Among them, a target area is selected according to the analysis of the first facial image to facilitate the next operation. Narrowing the range helps to improve accuracy and reduce the cost of the next operation.

[0077] Selecting a target area based on the first facial image includes the following method:

[0078] Step 121: Acquire a light-dark boundary based on the first facial image.

[0079] When capturing a user's facial image, uneven brightness may occur depending on the reflection of the user's face, and the light-dark boundary is the junction between the strong and weak reflection areas of the face. When the user's face is greased or covered with makeup, it is strongly reflective, and the reflection intensity of the grease is greater than the reflection intensity of the makeup. When the user's face is not greased or not covered with makeup, it is weakly reflective. The light-dark boundary here is the boundary between the grease on the face and the non-grease on the face, or the boundary between the makeup on the face and the non-makeup on the face.

[0080] Step 122: Select a center point based on the light-dark dividing line.

[0081] Among them, a point is randomly selected on the bright and dark dividing line as the center point.

[0082] Step 123: Select the area around the center point as the target area.

[0083] Among them, the center point is taken as the center, and the area around the center point is selected as the target area. The target area can be a circle, an equilateral triangle, or a square. The area of ​​the target area is set according to needs. Here, the area of ​​the target area is 16cm².

[0084] Step 130: Control the first test paper to wipe the target area on the user's face.

[0085] The first test paper is a special matte tape that can absorb the grease on human skin and can also adhere to powder on human skin. After the first test paper absorbs the grease on human skin, it becomes transparent and the light transmittance increases. After the first test paper adheres to the powder on the human body, the light transmittance decreases. By controlling the first test paper to wipe the target area on the user's face, the grease, powder, etc. in the target area can be adhered to the first test paper.

[0086] Step 140: Determine whether the user's face needs to be processed based on the first test paper.

[0087] Among them, according to the first test paper, it can be judged whether the target area of ​​the user's face has oil or whether makeup is applied.

[0088] Determining whether the user's face needs to be processed according to the first test paper includes the following method:

[0089] Step 141: Obtain the light transmittance of the first test paper.

[0090] Wherein, light is used to illuminate one side of the first test paper, and the amount of light transmitted through the first test paper is detected on the other side of the first test paper, and a photosensor is set on the other side of the first test paper to detect the amount of light transmitted.

[0091] Step 142: Determine whether the light transmittance of the first test paper is within a preset light transmittance range.

[0092] The preset light transmittance interval is the light transmittance range of the unused first test paper.

[0093] Step 143: If yes, there is no need to process the user's face; otherwise, process the user's face.

[0094] If the light transmittance of the first test paper is within the preset light transmittance range, it means that there is no grease or cosmetics in the target area of ​​the user's face, or there is very little grease or cosmetics, and there is no need to process the user's face. Otherwise, it means that there is grease or cosmetics in the target area of ​​the user's face, that is, the user's face needs to be processed to ensure the accuracy of the skin detection result.

[0095] Step 150: If yes, process the user's face; otherwise, obtain skin condition information based on the first facial image.

[0096] If the user's face needs to be processed, the following method is used:

[0097] Step 151: Obtain interference sources on the user's face based on the light transmittance of the first test paper by comparing it with a preset database.

[0098] The light transmittance when the first test paper absorbs grease is greater than the light transmittance when the powder is adhered. The preset database stores the light transmittance interval when the test paper absorbs grease and the light transmittance interval when the test paper is adhered with powder. The light transmittance of the first test paper is compared with the light transmittance interval in the preset database. The light transmittance interval in which the light transmittance of the first test paper is located is the interference source corresponding to the light transmittance interval, which is the interference source adhered to the first test paper. Interference sources include grease and cosmetics.

[0099] Step 152: Process the user's face according to the interference source on the user's face.

[0100] The processing of the user's face according to the interference source on the user's face includes the following steps:

[0101] Step 1521: Select a cleaning solution according to the interference source.

[0102] If the interference source is grease, facial cleanser is selected as the cleaning liquid. If the interference source is powder, makeup remover oil is selected as the cleaning liquid.

[0103] Step 1522: Spray cleaning solution onto the user's face.

[0104] Step 1523: Control the first wet cotton cloth to wipe the user's face.

[0105] The first wet cotton cloth is used to wipe the user's face to remove the cleaning solution and interference source on the user's face.

[0106] Step 1524: Control the second wet cotton cloth to wipe the user's face.

[0107] The user's face is wiped again with a second wet cotton cloth to ensure that the user's face is wiped clean.

[0108] After controlling the second wet cotton cloth to wipe the user's face, the method also includes: controlling the second test paper to wipe the user's face; obtaining the light transmittance of the second test paper; judging whether the light transmittance of the second test paper is included in a preset light transmittance range; if so, obtaining a second facial image, otherwise, controlling the third wet cotton cloth to wipe the user's face.

[0109] The second test paper is controlled to wipe the entire face of the user, and then the light transmittance of the second test paper is detected. According to the light transmittance of the second test paper, it is judged whether the user's face is cleaned. If it is not cleaned, the third wet cotton cloth is controlled to wipe the user's face to clean the user's face.

[0110] If the user's face does not need to be processed, the skin condition information is calculated based on the first facial image using a skin detection algorithm.

[0111] Step 160: Acquire a second facial image of the user after facial processing.

[0112] The second facial image of the user after facial processing is obtained by photographing with a camera.

[0113] Step 170: Deriving skin condition information based on the second facial image.

[0114] Wherein, the skin condition information is calculated based on the second facial image by using a skin detection algorithm.

[0115] Before obtaining the second facial image of the user after facial processing, the method further includes:

[0116] The humidity of the user's face is obtained. It is determined whether the humidity of the user's face is greater than a preset humidity. If so, the blowing device is controlled to blow air toward the user's face until the humidity of the user's face is no greater than the preset humidity.

[0117] Among them, a skin moisture tester is used to test the humidity of the user's face. If the humidity of the user's face is greater than a preset humidity, a hair dryer is used to blow air to the user's face until the humidity of the user's face is no greater than the preset humidity, so that the skin detection result is not easily affected by the moisture on the skin surface, thereby improving the accuracy of skin detection.

[0118] Example 2

[0119] The present application embodiment provides a skin detection system, including an image acquisition module 201, a selection module 202, a wiping module 203, a judgment module 204, a face processing module 205 and a skin state calculation module 206.

[0120] The image acquisition module 201 is used to acquire a first facial image and a second facial image of a user.

[0121] The selection module 202 is configured to select a target area based on the first facial image.

[0122] The wiping module 203 is used to control the first test paper to wipe the target area on the user's face.

[0123] The judgment module 204 is used to judge whether the user's face needs to be processed according to the first test paper.

[0124] A facial processing module 205 is used to process the user's face based on the instruction of the judgment module. And,

[0125] The skin state calculation module 206 is configured to obtain skin state information through a skin detection algorithm based on the first facial image or the second facial image.

[0126] The selection module 202 includes a light-dark boundary line acquisition submodule, a center point selection submodule and a target area selection submodule.

[0127] The light-dark boundary acquisition submodule is used to acquire the light-dark boundary based on the first facial image.

[0128] The center point selection submodule is used to select the center point based on the bright and dark dividing line.

[0129] The target area selection submodule is used to select the area around the center point as the target area.

[0130] Example 3

[0131] An embodiment of the present application also provides a computer-readable storage medium storing a computer program that can be loaded by a processor and execute any of the above skin detection methods.

[0132] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0133] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0134] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0135] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0136] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories, random access memories, magnetic disks or optical disks.

[0137] As described above, the above embodiments are only used to introduce the technical solution of the present application in detail, but the description of the above embodiments is only used to help understand the method and core idea of ​​the present invention and should not be understood as limiting the present invention. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention.

Claims

1. A skin detection method, characterized in that: include: Obtaining a first facial image of a user; selecting a target area based on the first facial image; Controlling the first test paper to wipe the target area on the user's face; Determining whether the user's face needs to be processed according to the first test paper; If yes, process the user's face, otherwise, obtain skin condition information based on the first facial image; Acquire a second facial image of the user after facial processing; deriving skin condition information based on the second facial image; Wherein, judging whether it is necessary to process the user's face according to the first test paper includes: Obtaining the light transmittance of the first test paper; Determining whether the light transmittance of the first test paper is included in a preset light transmittance range; If yes, there is no need to process the user's face, otherwise, process the user's face.

2. The method according to claim 1, characterized in that Selecting a target area based on the first facial image includes: Acquire a light-dark boundary based on the first facial image; Selecting a center point based on the bright-dark dividing line; The area around the center point is selected as the target area.

3. The method according to claim 1, characterized in that Processing of the user's face, including: Determine the interference source of the user's face based on the light transmittance of the first test paper compared with a preset database; The user's face is processed according to the interference source on the user's face.

4. The method according to claim 3, characterized in that Processing the user's face according to the interference source on the user's face includes: Selecting a cleaning solution according to the interference source; Spraying cleaning solution onto the user's face; Control first wet cotton cloth to wipe the user's face; Control a second damp cotton cloth to wipe the user's face.

5. The method according to claim 4, characterized in that The interference sources include grease and powder.

6. The method according to claim 4, characterized in that After wiping the user's face with a second damp cotton cloth, also include: Controlling the second test paper to wipe the user's face; Obtaining the light transmittance of the second test paper; Determining whether the light transmittance of the second test paper is included in a preset light transmittance range; If yes, then obtain the second facial image, otherwise, control the third wet cotton cloth to wipe the user's face.

7. The method according to claim 1, characterized in that Before obtaining the second facial image of the user after facial processing, the method further includes: Get the humidity of the user's face; Determining whether the humidity of the user's face is greater than a preset humidity; If yes, the blowing device is controlled to blow air toward the user's face until the humidity of the user's face is no greater than a preset humidity.

8. A skin detection system, characterized in that: include: An image acquisition module, used to acquire a first facial image and a second facial image of a user; A selection module, configured to select a target area based on the first facial image; A wiping module, used for controlling the first test paper to wipe the target area on the user's face; A judging module, used for judging whether the user's face needs to be processed according to the first test paper; a facial processing module, used for processing the user's facial features based on the instructions of the judgment module; and a skin condition calculation module, configured to obtain skin condition information based on the first facial image or the second facial image; The judging module judges whether the user's face needs to be processed according to the first test paper, including: A light-dark dividing line acquisition submodule is used to acquire the light transmittance of the first test paper; The judging module judges whether the light transmittance of the first test paper is included in a preset light transmittance range; If the judgment module judges that it is, the facial processing module does not need to process the user's face, otherwise, the facial processing module processes the user's face.

9. A computer-readable storage medium, characterized in that: A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 7.

Images