Skin grease detection method, device and system

Through detection methods of resistance value, hair proportion and specular reflection area proportion, the existing skin oil detection problems are solved, and low cost, fast and accurate skin oil detection is achieved, which is suitable for non-smooth Skin area and allow users to detect it themselves.

CN119014812AActive Publication Date: 2024-11-26ZHANGZHOU SOLEX SMART HOME CO LTD
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN202310609001.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-11-26
Estimated Expiration
2043-05-26

AI Technical Summary

Technical Problem

The existing skin oil detection methods are costly and have low accuracy, especially in areas with unsmooth skin, with large errors in detection effects and cannot complete sebum detection in designated areas by themselves.

Method used

Using skin oil detection method based on resistance value, hair proportion and specular reflection area proportion, skin images are collected through bioresistance probes and imaging components, hair segmentation and specular reflection detection in liquid areas are carried out, and the three-elementary equation is used. Calculate skin oil value.

Benefits of technology

It realizes low-cost, fast and accurate skin oil detection, which is suitable for hairy skin areas, reduces the impact of moisture and allows users to complete the test on their own.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119014812A_ABST
    Figure CN119014812A_ABST
Patent Text Reader

Abstract

The invention discloses a skin grease detection method, device and system. The method comprises the following steps: acquiring a resistance value acquired when a biological resistance probe abuts against skin; controlling the camera component to collect a skin image to obtain an original skin image; performing hair segmentation on the original skin image to obtain a skin segmentation image and a corresponding hair area, and calculating a ratio of the hair area to the area of the original skin image to obtain a hair ratio; based on the skin segmentation map, obtaining a reflection image of liquid area mirror reflection, and calculating the area of the reflection image and the area of the skin segmentation map to obtain a mirror reflection area ratio; and obtaining a skin grease value based on the resistance value, the hair ratio and the mirror reflection area ratio. The skin grease detection speed is high, the cost is low, and the detection result is accurate.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of skin detection, and in particular to a skin oil detection method, device and system. Background Art

[0002] There are two main methods for measuring sebum (skin oil) that are recognized worldwide. The first method uses SebumeterSM810 (CK, Germany), which uses the world-recognized The first method is based on the principle of oil spot photometer. A 0.1mm special matte tape is pressed on the skin. After absorbing the oil on the human skin, the tape will become a translucent tape, and the light transmittance will change accordingly. Therefore, its transparency is proportional to the amount of oil. The more oil absorbed, the greater the light transmittance. The oil content of the skin is measured by measuring the light transmittance. The second method uses the principle of image analysis. After the skin to be tested is degreased, an oil-absorbing sticky microporous film is pressed on the skin. Since oil does not scatter light, when the air in the micropores of the film is replaced by the absorbed oil, the film will become transparent and form a light-transmitting point consistent with the opening of the hair follicle. After collecting the tape, combined with professional image analysis software, the number of sebum points, maximum and minimum values, and sebum excretion rate of the measured area are quantified. Both of these solutions have certain limitations.

[0003] The limitations of the first method are as follows:

[0004] 1. High cost. CK sebum testing equipment costs tens of thousands of yuan and requires specific oil-absorbing paper consumables;

[0005] 2. The oil-absorbing paper will still be affected by moisture, resulting in a decrease in accuracy;

[0006] 3. The detection effect of rough skin such as scalp and other hair-containing areas has large errors;

[0007] 4. It takes a long time. It takes 15 seconds to use the oil-absorbing paper, and then tens of seconds of equipment analysis time;

[0008] The limitations of the second method are as follows:

[0009] 1. The cost is high, and oil-absorbing paper consumables are required during use;

[0010] 2. The detection effect of rough skin such as scalp and other hair-containing areas has large errors;

[0011] 3. The oil-absorbing paper will still be affected by moisture, resulting in a decrease in accuracy;

[0012] Furthermore, both methods are performed in laboratories or the subjects are unable to complete the sebum testing of the designated area by themselves. Summary of the invention

[0013] The main purpose of the present invention is to propose a skin oil detection method, device and system, which overcome the shortcomings of the prior art and obtain the skin oil value based on the resistance value, hair ratio and mirror reflection area ratio. The detection speed is fast, the cost is low, and the results are accurate.

[0014] The present invention adopts the following technical solution:

[0015] In a first aspect, a skin oil detection method comprises:

[0016] Obtain the resistance value collected when the bioimpedance probe is pressed against the skin;

[0017] Controlling the camera component to collect skin images and obtain original skin images;

[0018] Perform hair segmentation on the original skin image to obtain the skin segmentation image and the corresponding hair area, and calculate the ratio of the hair area to the original skin image area to obtain the hair proportion value;

[0019] Based on the skin segmentation map, a reflection image of the mirror reflection of the liquid area is obtained, and the reflection image area and the skin segmentation map area are calculated to obtain the mirror reflection area ratio;

[0020] The skin oil value is obtained based on the resistance value, the hair ratio value and the specular reflection area ratio value.

[0021] Preferably, after obtaining the resistance value collected when the bioimpedance probe is pressed against the skin, the method specifically includes:

[0022] Multiple resistance values ​​within the acquisition time are obtained, and the final resistance value is obtained after denoising and filtering.

[0023] Preferably, filtering the resistance value specifically includes:

[0024] After denoising, a list of resistance values ​​is obtained, the mode of the intervals in the list of resistance values ​​is obtained, and the average of all the modes of the intervals is calculated to obtain the final resistance value.

[0025] Preferably, after obtaining the original skin image, the method further includes:

[0026] Based on the skin classification algorithm, it is identified whether the original skin image is an image including skin. If so, the subsequent steps are processed. Otherwise, the subsequent steps are not processed and feedback is given.

[0027] Preferably, hair segmentation is performed on the original skin image to obtain a skin segmentation image, wherein the skin segmentation image is a skin segmentation image obtained based on the first Mask masking method, specifically including:

[0028] Convert the original skin image into a grayscale image;

[0029] Perform adaptive histogram equalization to enhance contrast;

[0030] Count low brightness pixels and suppress them;

[0031] Use OTSU to perform adaptive threshold binarization to obtain a binarized image;

[0032] Perform Gaussian filtering, corrosion operation and median filtering on the binary image;

[0033] The image processed by median filtering is bitwise operated with the original skin image to obtain the skin segmentation map.

[0034] Preferably, the method of obtaining a reflection image of the mirror reflection of the liquid area based on the skin segmentation map, wherein the reflection image is a reflection image obtained based on the second Mask masking method, specifically includes:

[0035] Read the HSV color space of the skin segmentation map;

[0036] The data of each channel obtained by splitting the channel are hue b, saturation g and brightness v;

[0037] Calculate the mean of the brightness v channel, perform mean normalization on the brightness v channel, and remove the average brightness value of the channel;

[0038] The brightness v channel is binarized and segmented to obtain the reflection image of the mirror reflection of the liquid area.

[0039] Preferably, obtaining the skin oil value based on the resistance value, the hair ratio value and the mirror reflection area ratio value specifically includes:

[0040] Substitute the resistance value, hair ratio value and mirror reflection area ratio value into the established three-variable linear equation to obtain the skin oil value.

[0041] Preferably, the three-variable linear equation is expressed as follows:

[0042] y=w1*A+w2*B+w3*C+b

[0043] Among them, y represents the skin oil value; A represents the resistance value; B represents the hair ratio; C represents the mirror reflection area ratio; w1, w2 and w3 are coefficients; b represents the constant term.

[0044] In a second aspect, a skin oil detection device comprises:

[0045] A resistance value acquisition module, used to obtain the resistance value collected when the bioresistance probe is pressed against the skin;

[0046] The skin original image acquisition module is used to control the camera component to collect the skin image and obtain the skin original image;

[0047] The hair ratio calculation module is used to perform hair segmentation on the original skin image, obtain the skin segmentation image and the corresponding hair area, and calculate the ratio of the hair area to the original skin image area to obtain the hair ratio;

[0048] A module for calculating the ratio of the mirror reflection area, for obtaining a reflection image of the mirror reflection of the liquid area based on the skin segmentation map, and calculating the area of ​​the reflection image and the area of ​​the skin segmentation map to obtain the ratio of the mirror reflection area;

[0049] The skin oil value acquisition module is used to obtain the skin oil value based on the resistance value, the hair ratio value and the mirror reflection area ratio value.

[0050] In the third aspect, a skin oil detection system includes: a skin oil detector; the skin oil detector includes a detection head and a shell; two bio-impedance probes are arranged on the surface of the detection head; the camera assembly in the detection head maintains a fixed focal length with the skin through a fixed focus channel; a control circuit board is arranged in the shell; the control circuit board is connected to the bio-impedance probe and the camera assembly respectively; the control circuit board includes the skin oil detection device as described in claim 9.

[0051] Preferably, the skin oil detector further comprises: a control switch connected to the control circuit board.

[0052] In a fourth aspect, a skin oil detection system includes: a skin oil detector and an external terminal device;

[0053] The skin oil detector comprises a detection head and a shell; two bio-impedance probes are arranged on the surface of the detection head; a camera assembly in the detection head maintains a fixed focal length with the skin through a fixed focus channel; a control circuit board is arranged in the shell; the control circuit board is connected to the bio-impedance probe and the camera assembly respectively; the control circuit board is connected to the external terminal device to send the collected resistance value and the original skin image;

[0054] The external terminal device includes the skin oil detection device.

[0055] Preferably, the skin oil detector further comprises: a control switch connected to the control circuit board.

[0056] Compared with the prior art, the present invention has the following beneficial effects:

[0057] (1) The present invention performs skin oil detection based on the collected bioimpedance value and skin image. Its advantage is that the user can complete the skin oil detection quickly and easily at a low cost. In addition, the present invention performs skin hair segmentation and liquid mirror reflection detection based on the skin image, which is not affected by the skin area (skin area or scalp area, etc.), making the skin oil detection on the skin area with hair more accurate.

[0058] (2) The present invention performs denoising and filtering on multiple resistance values ​​obtained within the acquisition time, so that the resistance value finally obtained is more accurate;

[0059] (3) The present invention obtains the original skin image through a camera assembly, and the camera assembly includes a camera and an LED light. The camera is a high-definition fixed-focus camera, which maintains a fixed focal length with the user's skin through a fixed-focus channel to achieve stable acquisition. The camera is equipped with an LED light to ensure that the image data obtained is the brightness of the screen.

[0060] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention so that it can be implemented in accordance with the contents of the specification, and in order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below.

[0061] Based on the following detailed description of specific embodiments of the present invention in conjunction with the accompanying drawings, those skilled in the art will become more aware of the above and other objects, advantages and features of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 This is a flow chart of a skin oil detection method according to Embodiment 1 of the present invention;

[0063] Figure 2 is a detailed flow chart of the skin oil detection method according to the first embodiment of the present invention;

[0064] Figure 3 This is a flow chart of the skin and hair segmentation method according to the first embodiment of the present invention;

[0065] Figure 4 This is a rendering of the skin and hair segmentation effect of the first embodiment of the present invention; the left side is the original image, and the right side is the image after segmentation;

[0066] Figure 5 The mirror reflection effect of the liquid area in the first embodiment of the present invention Figure 1 ; The left side is the original image, and the right side is without mirror reflection;

[0067] Figure 6 The mirror reflection effect of the liquid area in the first embodiment of the present invention Figure 2; The left side is the original image, and the white dots on the right side show the mirror reflection;

[0068] Figure 7 The mirror reflection effect of the liquid area in the first embodiment of the present invention Figure 1 ; The left side is the original image, and the white dots on the right side show a small amount of specular reflection;

[0069] Figure 8 This is the mirror reflection effect of the liquid area in the first embodiment of the invention Figure 2 ; The left side is the original image, and the right side has a lot of white mirror reflections;

[0070] Fig. 9 This is a schematic diagram of the positive correlation between the skin oil value calculated in Example 1 of the present invention and the actual oil amount;

[0071] Fig.10 This is a structural block diagram of a skin oil detection device according to Embodiment 1 of the present invention;

[0072] Fig.11 This is a structural schematic diagram of a skin oil detector of a skin oil detection system according to a second embodiment of the present invention;

[0073] Fig.12 This is a structural block diagram of a skin oil detection system according to Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0074] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention; it is obvious that the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments, and all other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making creative work are within the scope of protection of the present invention.

[0075] In the description of the present invention, it should be noted that the terms "comprises", "includes" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0076] In the description of the present invention, it should be noted that the terms "upper", "lower", "inner", "outer", "top / bottom" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific position, be constructed and operated in a specific position, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance.

[0077] In the description of the present invention, it should be noted that, unless otherwise clearly stipulated and limited, the terms "installed", "provided with", "mounted / connected", "connected", etc. should be understood in a broad sense. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection. It can be a mechanical connection or an electrical connection. It can be a direct connection or an indirect connection through an intermediate medium. It can be the internal connection of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0078] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, step identifiers S101, S102, S103, etc. are only used for convenient expression and do not represent the execution order, and the corresponding execution order can be adjusted.

[0079] Embodiment 1

[0080] See also Figure 1 and Figure 2 As shown, this embodiment provides a skin oil detection method, including:

[0081] S101, obtaining a resistance value collected when the bioimpedance probe is pressed against the skin;

[0082] S102, controlling the camera assembly to collect skin images to obtain original skin images;

[0083] S103, performing hair segmentation on the original skin image to obtain a skin segmentation image and a corresponding hair area, and calculating a ratio of the hair area to the original skin image area to obtain a hair proportion value;

[0084] S104, based on the skin segmentation map, obtaining a reflection image of the mirror reflection of the liquid area, and calculating the reflection image area and the skin segmentation map area to obtain a mirror reflection area ratio;

[0085] S105, obtaining a skin oil value based on the resistance value, the hair ratio value and the mirror reflection area ratio value.

[0086] Specifically, the execution subject of the above S101~S105 can be the control circuit board of the skin oil detector, specifically the control module on the control circuit board (such as a control chip including a single-chip microcomputer or MCU), or the execution subject of S101~S106 is an external terminal device or a cloud server, or some steps are implemented on the control circuit board of the skin oil detector, and some steps are implemented on the external terminal device (mobile phone, tablet computer, embedded device, etc.) or the cloud server. It can be set as needed, and this embodiment does not limit it.

[0087] In this embodiment, the bioimpedance probe is arranged on the surface of the detection head of the skin oil detector. When in use, the user holds the skin oil detector, places the detection head (the end with the bioimpedance probe) close to and against the skin area to be tested, operates the control switch to turn on the device, starts the camera component, synchronously completes the acquisition of the bioimpedance value and the RGB image data, and completes the skin oil detection of the test area through the control circuit board and / or the terminal device.

[0088] Specifically, the detection head has two bioresistance probes on its surface and a high-definition magnifying camera (such as an RGB camera) inside.

[0089] The two bioresistance probes use the two-probe method to measure resistivity, based on the principle that water has a high conductivity and oil does not. The current flows into the skin through one probe and reaches the other probe head through a fixed distance to be received. The resistivity is calculated by analyzing the point difference between the two probes. Therefore, the bioresistance probe is used to detect the moisture condition of the skin.

[0090] The skin image is acquired by an RGB camera, which is a high-definition fixed-focus camera. The fixed-focus channel of the device maintains a fixed focal length with the test skin and plays a role in stability. The RGB camera is equipped with an LED light to ensure the brightness of the screen when acquiring image data.

[0091] In this embodiment, after obtaining the resistance value collected when the bioimpedance probe is pressed against the skin, the method specifically includes:

[0092] Obtain multiple resistance values ​​within the acquisition time (such as multiple resistance values ​​within the image shooting time), remove the corresponding noise data to obtain a valid resistance value list, and use the resistance value filtering algorithm to obtain the final bioimpedance value for the next step of data fusion analysis. The filtering algorithm can be to obtain the interval mode in the list and calculate the average of all interval modes to obtain the final resistance value A.

[0093] Furthermore, after obtaining the original skin image, the method further includes:

[0094] Based on the skin classification algorithm, it is identified whether the original skin image is an image including skin. If so, the subsequent steps are processed. Otherwise, the subsequent steps are not processed and feedback is given.

[0095] Specifically, the skin classification algorithm can use a deep classification model, train the classification model by collecting skin data and non-skin data, and complete the classification of skin and non-skin data through the classification model.

[0096] The main purpose of skin classification detection is to prevent the captured images from being all non-skin areas, which would make it impossible to accurately analyze the oil content. For example, if all the images captured are hair and the scalp is not captured, the detection results may be inaccurate. Therefore, prompts are given in time when the image is captured to improve the user experience.

[0097] See also Figure 3 As shown, the hair segmentation is performed on the original skin image to obtain a skin segmentation image, wherein the skin segmentation image is a skin segmentation image obtained based on the first Mask masking method, specifically including:

[0098] Convert the original skin image into a grayscale image;

[0099] Perform adaptive histogram equalization to enhance contrast;

[0100] Count low brightness pixels and suppress them;

[0101] Use OTSU to perform adaptive threshold binarization to obtain a binarized image;

[0102] Perform Gaussian filtering, corrosion operation and median filtering on the binary image;

[0103] The image processed by median filtering is bitwise operated with the original skin image to obtain the skin segmentation map.

[0104] Specifically, since the user may perform oil detection on the scalp, skin and hair segmentation is required. As shown above, the original skin image is converted into a grayscale image, and a skin segmentation image (also known as the first Mask image, see Figure 4 The first Mask mask image is bitwise operated with the original image to achieve hair segmentation, and the hair ratio value B is calculated by the hair area and the image area. The calculation of the hair area and the original image area is obtained by calculating the image resolution.

[0105] Furthermore, the Frangi filter can be used for direct filtering, and the gradient can be directly calculated while extracting features, setting the brightness threshold, and suppressing low-brightness pixels. The brightness threshold setting method is: manually setting the suppression parameter by statistically analyzing a large amount of data.

[0106] In this embodiment, the reflection image of the mirror reflection of the liquid area is obtained based on the skin segmentation map, wherein the reflection image is a reflection image obtained based on the second Mask masking method, specifically including:

[0107] Read the HSV color space of the skin segmentation map;

[0108] The data of each channel obtained by splitting the channel are hue b, saturation g and brightness v;

[0109] Calculate the mean of the brightness v channel, perform mean normalization on the brightness v channel, and remove the average brightness value of the channel;

[0110] The brightness v channel is binarized and segmented to obtain the reflection image of the mirror reflection of the liquid area.

[0111] Based on the obtained reflection image (ie, the second Mask image), the reflection image area and the skin segmentation image area are calculated to obtain the mirror reflection area ratio C.

[0112] For more information on the specular reflection of liquid areas on the skin and scalp, see Figures 5 to 8 shown.

[0113] Furthermore, obtaining the skin oil value based on the resistance value, the hair ratio value and the mirror reflection area ratio value specifically includes:

[0114] Substitute the resistance value, hair ratio value and mirror reflection area ratio value into the established three-variable linear equation to obtain the skin oil value.

[0115] The three-variable linear equation is expressed as follows:

[0116] y=w1*A+w2*B+w3*C+b

[0117] Among them, y represents the skin oil value; A represents the resistance value; B represents the hair ratio; C represents the mirror reflection area ratio; w1, w2 and w3 are coefficients; b represents the constant term.

[0118] In this embodiment, the fitted w1, w2 and w3 are -0.00357934, 0.16272439 and 0.45652927 respectively, and the fitted b value is 0.33126512.

[0119] The specific fitting process of the three-variable linear equation can be based on the test data in Table 1 below.

[0120] Table 1

[0121]

[0122] Specifically, the actual amount of oil in different oil ranges (oil area ratio), water-oil ratio, resistance value, hair ratio and mirror reflection area ratio can be obtained through experiments, and a three-variable linear equation with resistance value, hair ratio and mirror reflection area ratio as variables can be fitted. In actual testing, the skin oil is calculated based on the obtained resistance value, hair ratio and mirror reflection area ratio as variables. The fitting diagram of the calculated skin oil value and the actual oil amount is shown in the figure. Fig. 9 As shown, from Fig. 9 It can be seen that the skin oil value obtained by this embodiment is positively correlated with the actual oil amount, which shows that the method of the present invention has high accuracy and conforms to the actual situation.

[0123] See also Fig.10 As shown, this embodiment also discloses a skin oil detection device, including:

[0124] The resistance value acquisition module 1001 is used to acquire the resistance value collected when the bioimpedance probe is pressed against the skin;

[0125] The skin original image acquisition module 1002 is used to control the camera assembly to collect the skin image and obtain the skin original image;

[0126] The hair ratio calculation module 1003 is used to perform hair segmentation on the original skin image, obtain the skin segmentation image and the corresponding hair area, and calculate the ratio of the hair area to the original skin image area to obtain the hair ratio;

[0127] The mirror reflection area ratio calculation module 1004 is used to obtain the reflection image of the mirror reflection of the liquid area based on the skin segmentation map, and calculate the reflection image area and the skin segmentation map area to obtain the mirror reflection area ratio;

[0128] The skin oil value acquisition module 1005 is used to obtain the skin oil value based on the resistance value, the hair ratio value and the mirror reflection area ratio value.

[0129] Each module of a skin oil detection device specifically implements the same skin oil detection method, which will not be repeated in this embodiment.

[0130] Embodiment 2

[0131] See also Fig.11As shown, the present embodiment is a skin oil detection system, comprising: a skin oil detector; the skin oil detector comprises a detection head 111 and a shell 112; two bio-impedance probes 1111 are arranged on the surface of the detection head 111; the camera assembly 1112 in the detection head 111 maintains a fixed focal length with the skin through a fixed focus channel 1113; a control circuit board 1121 is arranged in the shell 112; the control circuit board 1121 is connected to the bio-impedance probe 1111 and the camera assembly 1112 respectively; the control circuit board 1121 comprises the skin oil detection device, i.e., it is used to execute the steps of the skin oil detection method.

[0132] The skin oil detector further includes a control switch 1122 connected to the control circuit board 1121 .

[0133] After the control switch 1122 is activated, the skin oil detector is turned on, and after the detection head 111 is pressed against the skin, resistance acquisition and image acquisition can be started.

[0134] In this embodiment, the control circuit board 1121 can send the calculated skin oil value to an external terminal device, which will display the test results to the user, or the control circuit board 1121 can control voice prompts to inform the user of the test results. This embodiment does not limit how to present the results.

[0135] Embodiment 3

[0136] See also Fig.12 As shown, the present embodiment is a skin oil detection system, comprising: a skin oil detector 1201 and an external terminal device 1202; the skin oil detector comprises a detection head and a shell; two bio-impedance probes are arranged on the surface of the detection head; the camera assembly in the detection head maintains a fixed focal length with the skin through a fixed focus channel; a control circuit board is arranged in the shell; the control circuit board is connected to the bio-impedance probe and the camera assembly respectively; the control circuit board is connected to the external terminal device to send the collected resistance value and the original skin image; the external terminal device comprises the skin oil detection device.

[0137] The skin oil detector also includes a control switch connected to the control circuit board.

[0138] The structure of the skin oil detector is shown in Fig.11 shown.

[0139] In this embodiment, the skin oil detector 1201 is connected to the external terminal device 1202 via Wifi. Specifically, the control circuit board contains a Wifi transmitting component, which can establish a wireless connection with the external terminal device 1202 via a Wifi signal.

[0140] The external terminal device 1202 includes a mobile phone, a tablet computer, an embedded device, etc., which is connected to the skin oil detector 1201 through a mini program or APP software.

[0141] The use process of the skin oil detection system of this embodiment is as follows:

[0142] 1. Open the app or applet software on the external terminal device analysis system, and simultaneously long press the control switch to turn on the skin oil detector;

[0143] 2. The skin oil detector can automatically transmit Wifi signals after being turned on, and the App or applet on the external terminal device can connect to the device Wifi;

[0144] 3. After the connection is established, open the device camera through the App or Mini Program, place the detection head of the skin oil detector against the skin area to be tested, control the App or Mini Program to collect skin data, or use the control switch on the device to complete skin data acquisition;

[0145] 4. The acquired skin data includes the signal and RGB image data at the time end of the bioresistance probe. The data is sent to the system App or mini program via Wifi signal;

[0146] 5. Click on the App or Mini Program to confirm the skin oil test and generate a report;

[0147] 6. The APP or applet uses a mobile phone, tablet computer, embedded device, etc. as a carrier, and performs skin oil analysis after obtaining skin oil data.

[0148] For the specific skin oil analysis process, please refer to the specific implementation of the skin oil detection method in Example 1, which will not be described in detail in this example.

[0149] The above is only a preferred specific implementation of the present invention; however, the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical solution and its improved conception within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A method for detecting skin oil, characterized in that: include: Obtain the resistance value collected when the bioimpedance probe is pressed against the skin; Controlling the camera component to collect skin images and obtain original skin images; Perform hair segmentation on the original skin image to obtain the skin segmentation image and the corresponding hair area, and calculate the ratio of the hair area to the original skin image area to obtain the hair proportion value; Based on the skin segmentation map, a reflection image of the mirror reflection of the liquid area is obtained, and the reflection image area and the skin segmentation map area are calculated to obtain the mirror reflection area ratio; The skin oil value is obtained based on the resistance value, the hair ratio value and the specular reflection area ratio value.

2. The skin oil detection method according to claim 1, characterized in that: After obtaining the resistance value collected when the bioimpedance probe is pressed against the skin, the method specifically includes: Multiple resistance values ​​within the acquisition time are obtained, and the final resistance value is obtained after denoising and filtering.

3. The skin oil detection method according to claim 2, characterized in that: Filter the resistance value, including: After denoising, a list of resistance values ​​is obtained, the mode of the intervals in the list of resistance values ​​is obtained, and the average of all the modes of the intervals is calculated to obtain the final resistance value.

4. The skin oil detection method according to claim 1, characterized in that: After obtaining the original skin image, the method further includes: Based on the skin classification algorithm, it is identified whether the original skin image is an image including skin. If so, the subsequent steps are processed. Otherwise, the subsequent steps are not processed and feedback is given.

5. The skin oil detection method according to claim 1, characterized in that: Performing hair segmentation on the original skin image to obtain a skin segmentation image, wherein the skin segmentation image is a skin segmentation image obtained based on the first Mask masking method, specifically comprising: converting the original skin image into a grayscale image; Perform adaptive histogram equalization to enhance contrast; Count low brightness pixels and suppress them; Use OTSU to perform adaptive threshold binarization to obtain a binarized image; Perform Gaussian filtering, corrosion operation and median filtering on the binary image; The image processed by median filtering is bitwise operated with the original skin image to obtain the skin segmentation map.

6. The skin oil detection method according to claim 1, characterized in that: The method of obtaining a reflection image of the mirror reflection of the liquid area based on the skin segmentation map, wherein the reflection image is a reflection image obtained based on the second Mask masking method, specifically includes: Read the HSV color space of the skin segmentation map; The data of each channel obtained by splitting the channel are hue b, saturation g and brightness v; Calculate the mean of the brightness v channel, perform mean normalization on the brightness v channel, and remove the average brightness value of the channel; The brightness v channel is binarized and segmented to obtain the reflection image of the mirror reflection of the liquid area.

7. The skin oil detection method according to claim 1, characterized in that: The step of obtaining the skin oil value based on the resistance value, the hair ratio value and the mirror reflection area ratio value specifically includes: Substitute the resistance value, hair ratio value and mirror reflection area ratio value into the established three-variable linear equation to obtain the skin oil value.

8. The skin oil detection method according to claim 7, characterized in that: The three-variable linear equation is expressed as follows: y=w1*A+w2*B+w3*C+b Among them, y represents the skin oil value; A represents the resistance value; B represents the hair ratio; C represents the mirror reflection area ratio; w1, w2 and w3 are coefficients; b represents the constant term.

9. A skin oil detection device, characterized in that: include: A resistance value acquisition module, used to obtain the resistance value collected when the bioresistance probe is pressed against the skin; The skin original image acquisition module is used to control the camera component to collect the skin image and obtain the skin original image; The hair ratio calculation module is used to perform hair segmentation on the original skin image, obtain the skin segmentation image and the corresponding hair area, and calculate the ratio of the hair area to the original skin image area to obtain the hair ratio; A module for calculating the ratio of the mirror reflection area, for obtaining a reflection image of the mirror reflection of the liquid area based on the skin segmentation map, and calculating the area of ​​the reflection image and the area of ​​the skin segmentation map to obtain the ratio of the mirror reflection area; The skin oil value acquisition module is used to obtain the skin oil value based on the resistance value, the hair ratio value and the mirror reflection area ratio value.

10. A skin oil detection system, characterized in that: include: Skin oil detector; the skin oil detector includes a detection head and a shell; two bio-impedance probes are arranged on the surface of the detection head; the camera assembly in the detection head maintains a fixed focal length with the skin through a fixed focus channel; a control circuit board is arranged in the shell; the control circuit board is connected to the bio-impedance probe and the camera assembly respectively; the control circuit board includes the skin oil detection device as described in claim 9.

11. The skin oil detection system according to claim 10, characterized in that: The skin oil detector also includes a control switch connected to the control circuit board.

12. A skin oil detection system, characterized in that: include: Skin oil detector and external terminal equipment; The skin oil detector comprises a detection head and a shell; two bio-impedance probes are arranged on the surface of the detection head; a camera assembly in the detection head maintains a fixed focal length with the skin through a fixed focus channel; a control circuit board is arranged in the shell; the control circuit board is connected to the bio-impedance probe and the camera assembly respectively; the control circuit board is connected to the external terminal device to send the collected resistance value and the original skin image; The external terminal device includes the skin oil detection device as claimed in claim 9.

13. The skin oil detection system according to claim 12, characterized in that: The skin oil detector also includes a control switch connected to the control circuit board.

Citation Information

Patent Citations

  • Novel skin detection system based on smart phone and auxiliary product selection system

    CN105662348A

  • Skin detection device and detection method thereof

    CN108784647A

  • Self-adaptive skin grease detection method based on color detection

    CN110148125A

  • Skin measuring instrument with moisture detection function, skin measuring system and skin measuring method

    CN115414004A

  • Portable scalp oil content detection and identification method

    CN115588009A