A sensitive skin detection method, system, storage medium and intelligent terminal

By using mildly triggered wind and facial feature analysis when users enter a skincare facility, the degree of sensitive skin can be quickly and accurately determined, solving the problems of delayed detection and misdiagnosis in existing technologies, and improving the skincare experience and the accuracy of the assessment.

CN115829935BActive Publication Date: 2026-05-01ZHEJIANG ZHIMEI TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
ZHEJIANG ZHIMEI TECH CO LTD
Filing Date
2022-11-02
Publication Date
2026-05-01

AI Technical Summary

Technical Problem

Existing methods for detecting sensitive skin mainly rely on on-site testing or user self-reporting, which leads to prolonged skincare routines and is prone to misdiagnosis, affecting the user experience.

Method used

By using a mildly triggered wind to detect changes in a user's face when they enter a skincare facility, combined with facial feature analysis and masking, the system can quickly determine the degree of skin sensitivity and label the user with a sensitive skin tag, thus providing a personalized skincare solution.

Benefits of technology

It enables quick and accurate assessment of sensitive skin levels before users enter skincare facilities, reducing misdiagnosis, improving the skincare experience and data analysis efficiency, and ensuring accurate assessment even when makeup is applied.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115829935B_ABST
    Figure CN115829935B_ABST
Patent Text Reader

Abstract

The application relates to a sensitive skin detection method and system, a storage medium and an intelligent terminal, relates to the field of sensitive skin, and comprises the following steps: acquiring user pre-entry information and user identity information; opening an automatic door and blowing out mild triggering wind when the user pre-entry information is acquired; acquiring user facial feature information; determining change area information; determining change condition information; matching and analyzing the sensitive skin degree information and the change condition information stored in a preset sensitive database to determine the sensitive skin degree corresponding to the change condition information, defining the sensitive skin degree as user sensitive skin degree information; judging whether the user sensitive skin degree information is greater than preset determination threshold information; if yes, a sensitive skin label is pasted on the user identity information; and if no, no processing is performed. The application has the advantages that the skin condition of a user can be known in advance, a skin care scheme can be effectively and quickly given, and the skin care experience effect of the user is improved.
Need to check novelty before this filing date? Find Prior Art

Description

A method, system, storage medium, and smart terminal for detecting sensitive skin. Technical Field

[0001] This application relates to the field of sensitive skin, and in particular to a method, system, storage medium, and smart terminal for detecting sensitive skin. Background Technology

[0002] With social development and the improvement of people's living standards, skin care issues are receiving increasing attention from consumers. People's needs for skin care have shifted from prevention and delaying symptoms to repair. Especially now, the fast pace of life, increased work pressure, and more frequent late nights are causing consumers' skin conditions to deteriorate, with a trend towards sensitive skin.

[0003] Sensitive skin refers to skin that reacts to external stimuli with various intolerances, resulting in problems such as redness, peeling, and tightness. Essentially, it is caused by a thinning of the stratum corneum, leading to insufficient skin hydration and ultimately a weakened skin barrier function, making it unable to resist external stimuli.

[0004] Regarding the aforementioned technologies, the inventor believes that current professional skincare institutions only conduct on-site testing or require users to inform them of their skin sensitivity, which significantly prolongs the time required to obtain a skincare plan or treatment, and may even lead to misdiagnosis, affecting the user experience. There is still room for improvement. Summary of the Invention

[0005] To address the issue of significantly prolonged time spent on obtaining skincare solutions or treatments, and even the occurrence of misdiagnosis, this application provides a sensitive skin detection method, system, storage medium, and smart terminal.

[0006] Firstly, this application provides a method for detecting sensitive skin, employing the following technical solution:

[0007] A method for detecting sensitive skin, comprising:

[0008] Obtain user pre-entry information and user identity information;

[0009] The automatic door opens and a light, triggered breeze is blown when the user's pre-entry information is obtained;

[0010] Obtain user facial feature information;

[0011] The user's facial features are analyzed before and after the blow-drying process to determine the areas of change.

[0012] The pixel difference is determined based on the pixel values ​​before and after the change area information, and this pixel difference is defined as the change information.

[0013] The sensitive muscle degree information and change information stored in the preset sensitive database are matched and analyzed to determine the sensitive muscle degree corresponding to the change information, and the sensitive muscle degree is defined as the user's sensitive muscle degree information.

[0014] Determine whether the user's sensitive skin level information is greater than a preset threshold information;

[0015] If the value is greater than 1, then a sensitive skin label will be attached to the user's identity information;

[0016] If it is less than, no action is taken.

[0017] By adopting the above technical solution, a user's skin condition can be determined by using a breeze that only causes slight changes in sensitive skin without causing discomfort upon entering the room. This allows the skin care physician to understand the user's skin condition when reading the user's identity information before performing skin care, thus providing a targeted and quick skin care plan and improving the user's skin care experience.

[0018] Optionally, methods for analyzing user facial feature information to determine areas of change include:

[0019] The user's facial feature information is decomposed and categorized to obtain contour information of the same color;

[0020] Matching analysis is performed based on the occlusion feature information and the same color contour information stored in the preset occlusion database to determine the occlusion feature corresponding to the same color contour information, and the occlusion feature is defined as the current occlusion feature information.

[0021] Determine if the feature information of the current occluder exists;

[0022] If it exists, the current occlusion feature information is removed from the user's facial feature information to obtain the remaining area information;

[0023] Analyze the remaining area information to determine the changed area information;

[0024] If not, the user's facial feature information will be analyzed to determine the area of ​​change.

[0025] By adopting the above technical solution, and by distinguishing the color and regional conditions at the moment of entry, the area where occlusions exist can be removed, thereby reducing the size of the area that needs to be analyzed, reducing the amount of data analyzed by the system, and improving the efficiency of data analysis.

[0026] Optionally, methods for analyzing the remaining area information to determine the changed area information include:

[0027] Obtain user's body information and height information;

[0028] The system matches the preset color feature range information with the user's body information to determine the area in the user's body information that falls within the color feature range information, excluding the user's facial feature information. This area is then defined as the user's other exposed body area information.

[0029] The system performs matching analysis based on the body category information, other exposed body area information, and height information stored in the preset body database to determine the body category corresponding to the user's other exposed body area information at the height corresponding to the height information, and defines the body category as the user's other body category information.

[0030] The similarity is determined by matching the difference information stored in the pre-set similarity database with the user's other body category information to determine the difference degree corresponding to the user's other body category information, and this similarity degree is defined as the user's other difference information.

[0031] Determine whether other distinguishing information about the user is greater than the preset similarity information;

[0032] If at least one is greater than, then the one with the largest user other difference information is defined as the maximum user other difference information, and the corresponding user other body exposure area information is defined as the approximate user other body exposure area information.

[0033] The pixel value corresponding to the remaining area information and the pixel value of other body exposed areas of the user are calculated to obtain the pixel difference information;

[0034] Matching analysis is performed based on the deviation range information stored in the preset allowed database and the other differences information of the maximum user to determine the deviation range corresponding to the other differences information of the maximum user, and this deviation range is defined as the allowed deviation range information;

[0035] Determine whether the pixel difference information falls within the preset allowable deviation range;

[0036] If it falls into the range, the remaining area information will be analyzed to determine the changed area information;

[0037] If the result is not found, output the user's makeup information and the user's confirmation request information;

[0038] If all values ​​are less than the specified values, the remaining area information will be analyzed to determine the information of the changed area.

[0039] By adopting the above technical solution, the system can determine whether a user is wearing makeup by finding the area on their other exposed and identifiable body parts that matches the color of their face. Since the color of a user's face cannot be changed after applying makeup, it is impossible to determine whether they have sensitive skin, thus improving the accuracy of the judgment.

[0040] Optionally, it also includes a method for verifying the user's makeup information, the method comprising:

[0041] Determine the critical region information located in the current occlusion feature information based on the current occlusion feature information and the change region information;

[0042] Based on the cosmetic color information and pixel difference information stored in the preset cosmetic database, as well as information on other exposed areas of the user's body, a matching analysis is performed to determine the cosmetic color corresponding to the pixel difference information generated on the skin that is similar to other exposed areas of the user's body, and this cosmetic color is defined as the current cosmetic color information.

[0043] Matching analysis is performed based on the color change information, cosmetic color information, and critical region information stored in the cosmetic database to determine the color change corresponding to the critical region information after applying the cosmetic color information. The color change corresponding to the cosmetic color information after applying the cosmetic color information is defined as the post-color change information.

[0044] Determine whether the color corresponding to the information in the critical region is consistent with the color information after the change;

[0045] If it matches one of them, output the user's makeup information and the human confirmation request information;

[0046] If all are inconsistent, the user's makeup information will not be output, and the remaining area information will be analyzed to determine the information of the changed area.

[0047] By adopting the above technical solution, since the covering is usually a hat or mask, and since the user must have applied powder during the makeup process, the powder will stick to the covering when it comes into contact with the user's facial skin. Therefore, by determining whether makeup powder has adhered to the area of ​​the covering, it is possible to determine whether the user has applied makeup, thus improving the accuracy of the system's judgment on the makeup result.

[0048] Alternatively, methods for producing a light, triggering breeze include:

[0049] Obtain user movement trajectory information;

[0050] Determine the direction of travel based on the user's travel trajectory information;

[0051] Determine whether the direction of travel is equal to the preset direction of entry;

[0052] If so, then determine the face orientation information based on the user's facial feature information;

[0053] Matching analysis is performed based on the nozzle number group information, face orientation information, remaining area information, and height information stored in the preset number database to determine the nozzle number group corresponding to the face orientation information, remaining area information, and height information, and the nozzle number group is defined as the nozzle number group information to be aligned with the nozzle number group information.

[0054] The entrance location information is analyzed based on the user's movement trajectory information;

[0055] The location information of the blower nozzle and the information of the aligned blower nozzle number group are matched and analyzed according to the preset location database to determine the location of the blower nozzle corresponding to the information of the aligned blower nozzle number group, and the location of the blower nozzle is defined as the location information of the aligned blower nozzle.

[0056] The blowing distance is calculated based on the position information of the blower nozzle and the position information of the doorway;

[0057] Matching analysis is performed on the wind intensity information and wind distance information stored in the preset micro-wind database to determine the wind intensity corresponding to the wind distance information, and the wind intensity is defined as the effective wind intensity information.

[0058] Blow air according to the effective blowing intensity information based on the nozzle number group information;

[0059] If not, then no air blowing will be performed.

[0060] By adopting the above technical solution, the user's facial orientation and relative position information are determined to blow out the corresponding wind in a targeted manner, ensuring that the wind blows on the user's face and has the desired effect. This reduces the situation where random airflow leads to an inability to determine sensitive skin, and improves the accuracy of sensitive skin assessment.

[0061] Optionally, methods for applying airflow to the nozzle number group information according to the effective airflow intensity information include:

[0062] Obtain the quantity information of the user's facial features;

[0063] If there are two or more quantity information, determine the nozzle number group information and the corresponding effective blowing intensity information in sequence.

[0064] After sorting the user's facial feature information according to the preset time sequence information, the acquisition time difference information corresponding to two adjacent facial feature information is obtained. The facial feature information that comes first in the time sequence information is defined as the first facial feature information, and the facial feature information that comes later in the time sequence information is defined as the second facial feature information.

[0065] Determine whether the time difference information obtained is greater than the preset effective time information;

[0066] If it is greater than, then blow air in sequence according to the nozzle number group information and effective blowing intensity information corresponding to the first facial feature information and the second facial feature information;

[0067] If it is less than, then retrieve the alignment nozzle number group information corresponding to the first facial feature information and the second facial feature information, define the alignment nozzle number group information corresponding to the first facial feature information as the first alignment nozzle number group information, and define the alignment nozzle number group information corresponding to the second facial feature information as the second alignment nozzle number group information.

[0068] Determine whether the heights corresponding to the first and second aligned nozzle number groups are consistent;

[0069] If they match, then blow air using the larger of the effective blowing intensity information corresponding to the first aligned nozzle number group information and the second aligned nozzle number group information.

[0070] If they are inconsistent, blow air according to the first aligned nozzle number group information and the second aligned nozzle number information respectively.

[0071] By adopting the above technical solution, when multiple people pass by at the same time, different solutions can be adopted by judging whether they are blowing air from the same set of air nozzles. This reduces the situation where air nozzles cannot be used simultaneously for two people using the same set of air nozzles, thus preventing at least one user from being detected. This improves the smoothness of air blowing detection.

[0072] Thirdly, this application provides a smart terminal, which adopts the following technical solution:

[0073] A smart terminal includes a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executed any of the above-mentioned sensitive muscle detection methods.

[0074] By adopting the above technical solution, a user's skin condition can be determined by using a breeze that only causes slight changes in sensitive skin without causing discomfort upon entering the room. This allows the skin care physician to understand the user's skin condition when reading the user's identity information before performing skin care, thus providing a targeted and quick skin care plan and improving the user's skin care experience.

[0075] Fourthly, this application provides a computer storage medium capable of storing corresponding programs, characterized by sensitive detection and fast calculation.

[0076] A computer-readable storage medium adopts the following technical solution:

[0077] A computer-readable storage medium storing a computer program that can be loaded by a processor and executed by any of the above-described sensitive muscle detection methods.

[0078] By adopting the above technical solution, a user's skin condition can be determined by using a breeze that only causes slight changes in sensitive skin without causing discomfort upon entering the room. This allows the skin care physician to understand the user's skin condition when reading the user's identity information before performing skin care, thus providing a targeted and quick skin care plan and improving the user's skin care experience.

[0079] In summary, this application includes at least one of the following beneficial technical effects:

[0080] 1. By setting the wind, we can determine whether a user has sensitive skin, understand the user's skin condition in advance, and provide a skin care solution in a timely and effective manner, thus improving the user's skin care experience;

[0081] 2. By determining whether makeup powder has adhered to the area covered by the obscuring material, the system can determine whether the user has applied makeup, thus improving the accuracy of the system's judgment on makeup results;

[0082] 3. By determining the user's facial orientation and relative position information, it ensures that the air blows on the user's face and has the desired effect, reducing the possibility of inaccurate judgment of sensitive skin due to random airflow, and improving the accuracy of sensitive skin judgment. Attached Figure Description

[0083] Figure 1 is a flowchart of a sensitive skin detection method in an embodiment of this application.

[0084] Figure 2 is a flowchart of a method for analyzing user facial feature information to determine change area information in an embodiment of this application.

[0085] Figure 3 is a flowchart of a method for analyzing remaining region information to determine changed region information in an embodiment of this application.

[0086] Figure 4 is a flowchart of the method for verifying the output user makeup information in an embodiment of this application.

[0087] Figure 5 is a flowchart of a method for blowing a mild triggering wind according to an embodiment of this application.

[0088] Figure 6 is a flowchart of a method for blowing air according to the effective blowing intensity information of the nozzle number group in an embodiment of this application. Detailed Implementation

[0089] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with Figures 1-6 and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0090] This application discloses a method for detecting sensitive skin. Referring to Figure 1, the method for detecting sensitive skin includes:

[0091] Step 100: Obtain user pre-entry information and user identity information.

[0092] User pre-entry information refers to the user's arrival at the entrance, which can be obtained by a proximity sensor. User identity information refers to the user's identity information upon entering the skincare institution. This can be obtained by facial recognition ID devices, such as those used in subway stations.

[0093] Step 101: When the user pre-entry information is obtained, open the automatic door and blow out a light, trigger-induced wind.

[0094] Triggering wind refers to wind that can trigger changes in the user's face if the user has sensitive skin. The wind force is only for triggering purposes, and is not a strong wind that would cause excessive sensitivity and damage to sensitive skin.

[0095] Step 102: Obtain user facial feature information.

[0096] User facial feature information refers to information about the user's facial features, such as the nose and eyes. This is obtained by taking a photograph and then analyzing the color and outline shape within the defined area.

[0097] Step 103: Analyze the user's facial feature information before and after blow-drying to determine the area of ​​change.

[0098] The change region information refers to the information about areas that change before and after being exposed to wind. The user's facial feature information is divided into several unit regions. Then, the pixel values ​​in all unit regions are compared before and after. If a pixel value changes, it is defined as a unit in the change region information. Then, all units are combined to form the change region information.

[0099] Step 104: Determine the pixel difference based on the pixel values ​​before and after the change area information, and define the pixel difference as the change information.

[0100] The change information is the difference between the pixel values ​​before and after the change in the area. It is calculated by subtracting the pixel values.

[0101] Step 105: Perform matching analysis based on the sensitive muscle degree information and change information stored in the preset sensitive database to determine the sensitive muscle degree corresponding to the change information, and define the sensitive muscle degree as the user's sensitive muscle degree information.

[0102] The user's sensitive skin level information refers to the degree to which the user's skin type is considered sensitive. The database stores a mapping relationship between sensitive skin level information and changes in sensitivity, which was obtained by professionals in the field based on actual changes and research findings, following this pattern and experience. When the system receives corresponding change information, it automatically retrieves the corresponding sensitive skin level from the database and outputs the user's sensitive skin level information.

[0103] Step 106: Determine whether the user's sensitive skin level information is greater than the preset threshold information.

[0104] The threshold information is defined as the value corresponding to the degree of sensitive skin. If the value is greater than this value, the user's skin type must be sensitive. The purpose of this judgment is to determine whether a user has sensitive skin.

[0105] Step 1061: If the value is greater than the target value, then affix a sensitive skin label to the user's identity information.

[0106] Labeling a user with sensitive skin involves adding a sensitive skin tag to the data package corresponding to their identity information. This tag will automatically appear on the display screen when the user swipes their card, allowing the skincare doctor or professional to provide targeted skincare solutions and products, thus offering a better customer experience.

[0107] Step 1062: If it is less than, no processing is performed.

[0108] Referring to Figure 2, methods for analyzing user facial feature information to determine areas of change include:

[0109] Step 200: Decompose and classify the user's facial feature information to obtain contour information of the same color.

[0110] The same-color contour information refers to contours of the same color or colors that are not significantly different from those of adjacent areas. This step is the same as step 103, except that the purpose of this step is to form clusters, i.e., to form contours.

[0111] Step 201: Perform matching analysis based on the occlusion feature information and the same color contour information stored in the preset occlusion database to determine the occlusion feature corresponding to the same color contour information, and define the occlusion feature as the current occlusion feature information.

[0112] The current occlusion feature information includes the characteristics of the occluder, such as color and outline size, like a black hat or a blue mask. The database stores a mapping relationship between occlusion feature information and corresponding outline information, recorded by professionals in the field based on the color and outline of different occluders worn on a person's face. When the system receives corresponding outline information, it automatically retrieves the corresponding occlusion feature from the database and outputs it using the current occlusion feature information. If no match is found, no output is made.

[0113] Step 202: Determine whether the feature information of the current occluder exists.

[0114] The purpose of this assessment is to determine whether there are any obstructions on a person's face that could affect the camera's recognition capabilities.

[0115] Step 2021: If it exists, remove the current occlusion feature information from the user's facial feature information to obtain the remaining area information.

[0116] The remaining area information refers to the information of the area remaining after removing the current occlusion feature information from the user's facial feature information. If it exists, it means there is occlusion. In this case, we can only judge whether there is any change in the unoccluded area. This allows us to analyze the area that needs to be judged before the wind blows, reducing the workload of analyzing changes before and after.

[0117] Step 2022: If not, analyze the user's facial feature information to determine the area of ​​change.

[0118] If it is not present, it means that the user entered the skincare clinic with their face directly exposed. It is necessary to observe all areas of the face to determine whether the user has sensitive skin.

[0119] Step 203: Analyze the remaining area information to determine the changed area information.

[0120] Referring to Figure 3, the methods for analyzing the remaining area information to determine the changed area information include:

[0121] Step 300: Obtain user's body information and height information.

[0122] User body information consists of pixel values ​​of the user's entire body, obtained through camera capture. Height information refers to the user's actual height.

[0123] Step 301: Match the preset color feature range information and user body information to determine the area in the user body information that falls into the color feature range information, excluding the user's facial feature information, and define this area as the user's other exposed body area information.

[0124] Information on other exposed body areas refers to the specific areas of the user's body that are visible and recognizable by the camera when the user enters the skincare facility, outside their clothing. The matching method involves comparing the pixel values ​​corresponding to the user's body information one-to-one with color feature range information to determine if the data falls within the color feature range. If it falls within the range and is not a facial feature, it can be identified as information on other exposed body areas.

[0125] Step 302: Based on the body category information, other exposed body area information, and height information stored in the preset body database, perform matching analysis to determine the body category corresponding to the user's other exposed body area information at the height corresponding to the height information, and define the body category as the user's other body category information.

[0126] The user's other body category information refers to the location of organs corresponding to different body parts captured by the camera. If necessary, an organ can be divided into two parts for identification, such as the arm and the hand. The database stores the mapping relationship between body category information, user's other exposed body areas, and height information. This information was obtained by professionals in the field through extensive shooting and research, recording the positions of organs corresponding to users of different heights in actual photographs.

[0127] Step 303: Perform a matching analysis based on the difference degree information stored in the preset similarity database and the user's other body category information to determine the difference degree corresponding to the user's other body category information, and define the similarity degree as the user's other difference degree information.

[0128] User other distinguishability information refers to the degree of similarity between the user's organs and facial colors corresponding to other body category information. The database stores the mapping relationship between distinguishability information and user other body category information. Experts in this field calculate the similarity level based on the proportion of similar values ​​among all observation records, with higher similarity ratios resulting in higher similarity levels, which are then recorded in the database. When the system receives corresponding user other body category information, it automatically retrieves the corresponding distinguishability level from the database and outputs it as user other distinguishability information.

[0129] Step 304: Determine whether other user differentiation information is greater than the preset similarity information.

[0130] Similarity information refers to the degree to which the user's body type and facial skin texture are nearly identical. The purpose of this judgment is to determine whether a color can be used as a similarity to a face, thereby determining whether makeup has been applied.

[0131] Step 3041: If at least one is greater than, then define the largest of the user's other differences information as the maximum user other differences information, and define the corresponding user other body exposure area information as the approximate user other body exposure area information.

[0132] The maximum user other distinguishability information is the highest level of user other distinguishability information. The approximate user other body exposure area information is the user other body exposure area information that has the highest level of user other distinguishability information. If it is greater than this, it means that there is a region whose pixel value is similar to or even identical to that of the user's face.

[0133] Step 3042: If all are less than, then analyze the remaining area information to determine the changed area information.

[0134] If all values ​​are less than 1, it means that it is impossible to determine whether the user is wearing makeup based on information from other exposed areas of the user's body. In order to reduce unnecessary recording and blind guessing, the remaining area information will be analyzed to determine the information of the changed areas.

[0135] Step 305: Calculate the pixel value corresponding to the remaining area information and the pixel value of other body exposure areas of the user to obtain pixel difference information.

[0136] Pixel difference information is the difference between the pixel value corresponding to the remaining area information and the pixel value of other similar exposed areas of the user's body. It is calculated by numerical comparison.

[0137] Step 306: Perform a matching analysis based on the deviation range information and the maximum user other difference information stored in the preset allowed database to determine the deviation range corresponding to the maximum user other difference information, and define the deviation range as the allowed deviation range information.

[0138] The allowable deviation range information refers to the maximum deviation between the pixel values ​​of other exposed body areas of the user and the pixel values ​​of facial color, corresponding to the maximum allowable user other distinguishability information. The database stores the mapping relationship between the deviation range information and the maximum allowable user other distinguishability information, which was obtained by those skilled in the art based on actual observation and statistical analysis of a large amount of data. When the system receives the corresponding maximum allowable user other distinguishability information, it automatically retrieves the corresponding deviation range from the database and outputs the allowable deviation range information.

[0139] Step 307: Determine whether the pixel difference information falls within the preset allowable deviation range.

[0140] The purpose of this assessment is to determine whether the difference between the pixel values ​​of facial color and the pixel values ​​of other exposed areas of the user's body is too large due to makeup.

[0141] Step 3071: If it falls into the range, analyze the remaining area information to determine the changed area information.

[0142] If the area falls within the range, it means that no makeup was applied. In this case, makeup does not affect the appearance of the changed area, and the remaining area information can be directly analyzed to determine the changed area information.

[0143] Step 3072: If not found, output the user's makeup information and the human confirmation request information.

[0144] User makeup information refers to information about the user's face having been made up, resulting in no visible changes in the affected areas. Human verification request information is a request for skincare personnel to make a human assessment. The output can be in text format. If the information is not included, it indicates a significant difference between the user's facial color and the color of related areas, indirectly suggesting that the user has applied makeup, resulting in no visible changes. In this case, both user makeup information and human verification request information can be output.

[0145] Referring to Figure 4, a method for verifying the output of user makeup information is also included, the method comprising:

[0146] Step 400: Determine the critical region information located in the current occlusion feature information based on the current occlusion feature information and the change region information.

[0147] Critical region information refers to the location of the boundary of the changing region information within the region corresponding to the current occlusion feature information. It is determined by moving the boundary line between the current occlusion feature information and the changing region information a certain width closer to the region corresponding to the current occlusion feature information, thus forming a critical region with the boundary line.

[0148] Step 401: Based on the cosmetic color information and pixel difference information stored in the preset cosmetic database and the information of other exposed areas of the user's body, perform matching analysis to determine the cosmetic color corresponding to the pixel difference information generated on the skin of other exposed areas of the user's body, and define the cosmetic color as the current cosmetic color information.

[0149] The current cosmetic color information is the color pixel value of the cosmetic after it has been applied to skin with similar exposed areas of the user's body, representing the difference between the color pixel values ​​of these areas and the actual color pixel values ​​of the cosmetic. The database stores the mapping relationship between cosmetic color information, pixel difference information, and information about other exposed areas of the user's body. This mapping is obtained by an expert observing the difference between the pixel values ​​corresponding to the actual color of the cosmetic and the user's own color pixel values ​​after applying different colored cosmetics to skin of different colors. When the system receives pixel difference information and information about other exposed areas of the user's body, it automatically retrieves the corresponding cosmetic color from the database and outputs the current cosmetic color information.

[0150] Step 402: Based on the color change information, cosmetic color information and critical region information stored in the cosmetic database, perform matching analysis to determine the color change corresponding to the critical region information after applying the cosmetic color information, and define the color change corresponding to the cosmetic color information after applying the cosmetic color information as the post-color change information.

[0151] The subsequent color change information refers to the color change corresponding to the critical region information after applying the cosmetic color information. The database stores the mapping relationship between color change information, cosmetic color information, and critical region information, which was obtained by professionals in the field based on actual application experiments. When the system receives the corresponding cosmetic color information and critical region information, it automatically looks up the corresponding color change from the database and outputs the subsequent color change information.

[0152] Step 403: Determine whether the color corresponding to the critical region information is consistent with the color information after the change.

[0153] The method of judgment is to compare pixel values.

[0154] Step 4031: If they match, output the user's makeup information and the human confirmation request information.

[0155] If they match, it means the user is wearing makeup and the makeup powder has fallen into the boundary area of ​​the covering. Therefore, it can be confirmed that the user is wearing makeup, and the user's makeup information and a confirmation request can be output. However, because of the makeup, it's impossible to determine whether the skin color under the makeup in the remaining area has changed, so the information about the changed area cannot be determined.

[0156] Step 4032: If there is a discrepancy, the user's makeup information will not be output, but the remaining area information will be analyzed to determine the information of the changed area.

[0157] If there is a discrepancy, it means that the user did not wear makeup but only covered up, so the remaining area information can be directly analyzed to determine the information of the changed area.

[0158] Referring to Figure 5, methods for producing a light, triggered breeze include:

[0159] Step 500: Obtain user's travel trajectory information.

[0160] User movement trajectory information refers to the user's position at the entrance of the skincare clinic. This information can be determined by observing a certain feature of the user from above or directly in front of the camera and analyzing its changes. For example, if the camera directly in front captures a user's head outline gradually becoming larger, it indicates that the user is approaching; if the user's head outline moves to the left, it indicates that the user is moving to the left.

[0161] Step 501: Determine the direction of travel based on the user's travel trajectory information.

[0162] The direction of travel information refers to the direction the user is moving from the entrance. This is determined by arbitrarily choosing two points in time and analyzing their positions before and after to obtain the direction.

[0163] Step 502: Determine whether the travel direction information is equal to the preset entry direction information.

[0164] The entry direction information refers to the direction of entry into the facility. The purpose of this determination is to identify whether the user passes through the entrance or enters the skincare facility for treatment.

[0165] Step 5021: If yes, then determine the face orientation information based on the user's facial feature information.

[0166] Facial orientation information refers to the orientation of the user's face. It is determined by analyzing the features of the two eyes to determine the distance between them and the angle of inclination, thus determining the vertical tilt direction of the face; then, the size of the two eyes is used to determine their front-to-back position, thus determining the horizontal tilt angle of the user. Combining these two methods determines the facial orientation information. If the orientation is correct, it indicates that the user is preparing to enter the facility. To accurately determine changes in the user's face, air needs to be directed towards the face, hence the need to determine facial orientation information.

[0167] Step 5022: If not, do not blow air.

[0168] If not, it means the user does not need skincare and therefore does not need to use a hairdryer, thus avoiding unnecessary trouble.

[0169] Step 503: Based on the matching analysis of the nozzle number group information, face orientation information, remaining area information and height information stored in the preset number database, determine the nozzle number group corresponding to the face orientation information, remaining area information and height information, and define the nozzle number group as the nozzle number group information to be aligned with the nozzle number group information.

[0170] The nozzle group information refers to the numbered group of nozzles that blow air onto the remaining area of ​​the user's face when the user is facing the direction indicated by their facial orientation. The database stores a mapping relationship between nozzle group information, facial orientation information, remaining area information, and height information. This mapping is obtained by professionals observing and recording the actual nozzle groups being aligned when entering from different angles and heights. When the system receives facial orientation information, remaining area information, and height information, it automatically retrieves the corresponding nozzle group from the database and outputs the aligned nozzle group information. It's important to note that the nozzles are mounted on the door frame. When the angle is not perpendicular to the top of the door frame, the air will blow from the side of the door frame; when the angle is parallel to the side door frame, the air will blow directly onto the user from the nozzle on the top door frame.

[0171] Step 504: Analyze the entrance location information based on the user's movement trajectory information.

[0172] The entrance position information refers to the location where the user is about to enter the room. The analysis method uses a position at a certain set perpendicular distance from the camera as the entrance position information on the user's movement trajectory.

[0173] Step 505: Perform a matching analysis based on the nozzle position information and the nozzle number group information stored in the preset position database to determine the nozzle position corresponding to the nozzle number group information, and define the nozzle position as the nozzle position information.

[0174] The alignment nozzle position information refers to the actual location of the nozzle corresponding to the alignment nozzle number group on the map, or its relative position to the camera recording the user's movement trajectory. The database stores the mapping relationship between nozzle position information and alignment nozzle number group information, obtained by professionals in the field through measurement and recording based on actual installation conditions. When the system receives the alignment nozzle number group information, it automatically retrieves the corresponding nozzle position from the database and outputs the alignment nozzle position information.

[0175] Step 506: Calculate the blowing distance based on the position information of the nozzle and the doorway.

[0176] The air blowing distance information refers to the distance the air travels from the position of the air blower nozzle towards the entrance position. It is calculated as the square root of the difference between the x and y coordinates.

[0177] Step 507: Perform matching analysis based on the wind intensity information and wind distance information stored in the preset micro-wind database to determine the wind intensity corresponding to the wind distance information, and define the wind intensity as the effective wind intensity information.

[0178] Effective wind intensity information refers to the required wind intensity at the specified wind distance to ensure a gentle, triggered breeze on the user's face. The database stores a mapping between wind intensity and wind distance information. Experts conduct wind tests at different distances and intensities, observing the wind force at the corresponding monitoring points to determine if it matches the pre-set wind speed. When the system receives wind distance information, it automatically retrieves the corresponding wind intensity from the database and outputs the effective wind intensity information.

[0179] Step 508: Blow air according to the effective blowing intensity information based on the nozzle number group information.

[0180] Referring to Figure 6, the method for blowing air according to the effective blowing intensity information based on the nozzle number group information includes:

[0181] Step 600: Obtain the quantity information of the user's facial feature information.

[0182] The quantity information refers to the number of users' facial feature data. The purpose of obtaining this information is to determine if there are two or more users at the entrance causing data interference.

[0183] Step 601: If there are two or more quantity information, determine the nozzle number group information and the corresponding effective blowing intensity information in sequence.

[0184] Step 602: After sorting the user's facial feature information according to the preset time sequence information, obtain the acquisition time difference information corresponding to two adjacent facial feature information, define the facial feature information that comes first in the time sequence information as the first facial feature information, and define the facial feature information that comes later in the time sequence information as the second facial feature information.

[0185] The time difference information is the interval between two adjacent facial feature pieces. Here, we take the time point when the user arrives at the entrance location as an example. The first facial feature is the one that appears earlier in a sequence of two adjacent facial feature pieces. The second facial feature is the one that appears later in a sequence of two adjacent facial feature pieces.

[0186] Step 603: Determine whether the time difference information obtained is greater than the preset effective time information.

[0187] The onset time information refers to the length of time it takes for the effect to take effect. The purpose of this assessment is to determine whether it will affect other customers.

[0188] Step 6031: If it is greater than, then blow air in sequence according to the nozzle number group information and effective blowing intensity information corresponding to the first facial feature information and the second facial feature information.

[0189] If the value is greater than 1, it means that although there are two, they do not interfere with each other, so the air can be blown in sequence.

[0190] Step 6032: If it is less than, retrieve the alignment nozzle number group information corresponding to the first facial feature information and the second facial feature information, define the alignment nozzle number group information corresponding to the first facial feature information as the first alignment nozzle number group information, and define the alignment nozzle number group information corresponding to the second facial feature information as the second alignment nozzle number group information.

[0191] The first alignment nozzle number group information is the alignment nozzle number group information corresponding to the first facial feature information. The second alignment nozzle number group information is the alignment nozzle number group information corresponding to the second facial feature information. The purpose of retrieving this information is to determine whether the two nozzle number groups will interfere with the user corresponding to the other nozzle number group.

[0192] Step 604: Determine whether the heights corresponding to the first and second aligned nozzle number groups are consistent.

[0193] The purpose of the judgment is to determine whether it will have an impact.

[0194] Step 6041: If they match, blow air using the larger of the effective blowing intensity information corresponding to the first aligned nozzle number group information and the second aligned nozzle number group information.

[0195] If they match, it indicates some interference on the same plane. To ensure that even the farther one receives wind, the wind can be blown according to the higher effective wind intensity information. It should be noted that even blowing at the wind intensity corresponding to the maximum distance will not cause a strong irritation response.

[0196] Step 6042: If they are inconsistent, blow air according to the first aligned nozzle number group information and the second aligned nozzle number information respectively.

[0197] If they are inconsistent, it means they are not on the same plane and will not cause interference. Then you can blow air according to the first and second aligned nozzle number groups and the second aligned nozzle number information respectively.

[0198] This invention provides a computer-readable storage medium storing a computer program that can be loaded by a processor and executed as a sensitive muscle detection method.

[0199] Computer storage media include, for example, USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, optical disks, and other media that can store program code.

[0200] Based on the same inventive concept, embodiments of the present invention provide a smart terminal, including a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executed for a sensitive muscle detection method.

[0201] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0202] The above are all preferred embodiments of this application and are not intended to limit the scope of protection of this application. Any feature disclosed in this specification (including the abstract and drawings) may be replaced by other equivalent or similar features unless specifically stated otherwise. That is, unless specifically stated otherwise, each feature is only one example of a series of equivalent or similar features.

Claims

1. A method for detecting sensitive skin, characterized in that, include: Obtain user pre-entry information and user identity information; The automatic door opens and a light, triggered breeze is blown when the user's pre-entry information is obtained; the user's facial feature information is then acquired. At Before and after blowing air, the user's facial feature information is analyzed to determine the information of the changed area; the pixel difference is determined based on the pixel values ​​before and after the changed area information, and the pixel difference is defined as the change information; the sensitive muscle degree information and the change information stored in the preset sensitive database are matched and analyzed to determine the sensitive muscle degree corresponding to the change information, and the sensitive muscle degree is defined as the user's sensitive muscle degree information. Determine whether the user's sensitive skin level information is greater than a preset threshold information; If the value is greater than 1, then a sensitive skin label will be attached to the user's identity information; If the value is less than the specified value, no processing is performed. The method for analyzing user facial feature information to determine the changing region information includes: decomposing and classifying the user facial feature information to obtain color contour information; performing matching analysis based on the occlusion feature information and color contour information stored in a preset occlusion database to determine the occlusion feature corresponding to the color contour information, and defining this occlusion feature as the current occlusion feature information; determining whether the current occlusion feature information exists; if it exists, removing the current occlusion feature information from the user facial feature information to obtain the remaining region information; analyzing the remaining region information to determine the changing region information; if it does not exist, analyzing the user facial feature information to determine the changing region information; and analyzing the remaining region information to determine the changing region information. Methods for analyzing domain information to determine change area information include: acquiring user body information and height information; matching user body information with preset color feature range information to determine areas in the user body information, excluding facial features, that fall within the color feature range information, defining these areas as other exposed body areas of the user, which are the areas that are specifically exposed outside the user's clothing when entering the skincare facility and can be captured and identified by the camera; and matching and analyzing body category information stored in a preset body database with the user's other exposed body area information and height information to determine the height corresponding to the user's other exposed body area information. The system first identifies the body category and defines it as other body category information for the user. Then, it performs a matching analysis based on the difference level information stored in a pre-set similarity database and the user's other body category information to determine the difference level corresponding to the user's other body category information, defining this difference level as the user's other difference level information. Next, it checks whether the user's other difference level information is greater than a pre-set similarity information. If at least one is greater, the largest user's other difference level information is defined as the maximum user's other difference level information, and the corresponding user's other body exposure area information is defined as the approximate user's other body exposure area information. Finally, it calculates the pixel values ​​corresponding to the remaining area information and the pixel values ​​of the approximate user's other body exposure area information to obtain the image. The system analyzes pixel difference information and performs matching analysis based on the deviation range information stored in the preset allowed database and the maximum user other difference information to determine the deviation range corresponding to the maximum user other difference information. This deviation range is defined as the allowed deviation range information. The system determines whether the pixel difference information falls within the preset allowed deviation range information. If it does, the remaining area information is analyzed to determine the change area information. If it does not fall within the range, the system outputs the user makeup information and the human confirmation request information. If both are less than the set value, the remaining area information is analyzed to determine the change area information. The method for verifying the user makeup information includes: determining the critical area information located in the current occlusion feature information based on the current occlusion feature information and the change area information.The system performs matching analysis based on cosmetic color information, pixel difference information, and information from other exposed areas of the user's body stored in a pre-set cosmetic database to determine the cosmetic color corresponding to the pixel difference information generated on the skin of similar exposed areas. This cosmetic color is defined as the current cosmetic color information. The system then performs matching analysis based on changed color information, cosmetic color information, and critical region information stored in the cosmetic database to determine the changed color of the critical region information after applying the cosmetic color information. This changed color is defined as the subsequent changed color information. The system then checks whether the color corresponding to the critical region information matches the subsequent changed color information. If they match, the system outputs the user's makeup information and a manual confirmation request. If they do not match, the system does not output the user's makeup information but analyzes the remaining area information to determine the changed region information.

2. The method for detecting sensitive skin according to claim 1, characterized in that, The method for blowing a light, triggered breeze includes: acquiring the user's walking trajectory information; determining the walking direction information based on the user's walking trajectory information; determining whether the walking direction information is equal to the preset entry direction information; if so, determining the face orientation information based on the user's facial feature information; performing matching analysis based on the blower nozzle number group information, face orientation information, remaining area information, and height information stored in the preset number database to determine the blower nozzle number group corresponding to the face orientation information, remaining area information, and height information, and defining this blower nozzle number group as the aligned blower nozzle number group information; analyzing the entrance position information based on the user's walking trajectory information; and so on. The system matches and analyzes the nozzle position information and nozzle number group information stored in the preset location database to determine the nozzle position corresponding to the nozzle number group information, and defines the nozzle position as the nozzle position information. It then calculates the blowing distance information based on the nozzle position information and the entrance location information. Next, it matches and analyzes the blowing intensity information and blowing distance information stored in the preset micro-wind database to determine the blowing intensity corresponding to the blowing distance information, and defines the blowing intensity as the effective blowing intensity information. Finally, it blows air according to the effective blowing intensity information for the nozzle number group information; otherwise, it does not blow air.

3. The method for detecting sensitive skin according to claim 2, characterized in that, The method for applying airflow to the nozzle group information according to the effective airflow intensity information includes: acquiring the quantity information of the user's facial features; if there are two or more, sequentially determining the nozzle group information and the corresponding effective airflow intensity information; sorting the user's facial features according to a preset time sequence and acquiring the acquisition time difference information corresponding to two adjacent facial features, defining the facial feature information with the earlier time sequence information as the first facial feature information, and the facial feature information with the later time sequence information as the second facial feature information; determining whether the acquisition time difference information is greater than a preset effective time information; if it is greater, then sequentially applying the nozzle group information and the effective airflow intensity information corresponding to the first and second facial feature information. The system blows air according to the airflow intensity information. If the intensity is less than the specified value, it retrieves the nozzle number group information corresponding to the first and second facial feature information. The nozzle number group corresponding to the first facial feature information is defined as the first nozzle number group information, and the nozzle number group corresponding to the second facial feature information is defined as the second nozzle number group information. The system then determines whether the heights corresponding to the first and second nozzle number groups are consistent. If they are consistent, the system blows air according to the greater of the effective airflow intensity information corresponding to the first and second nozzle number groups information. If they are inconsistent, the system blows air according to the first and second nozzle number groups information respectively.

4. A smart terminal, characterized in that, It includes a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executed according to any one of claims 1 to 3.

5. A computer-readable storage medium, characterized in that, The computer program is stored that can be loaded by a processor and executed according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • Allergen analysis method and device

    CN111466959A