Skin data processing method and device, skin beautifying instrument and skin beautifying system

Abstract

The application provides a skin data processing method and device, a skin beauty instrument and a skin beauty system, and relates to the technical field of biological medicine. The method comprises the following steps: acquiring a current detailed skin image collected by a high-speed multispectral imaging module; determining a current skin position of the skin beauty instrument by comparing the current detailed skin image with a pre-acquired full-face skin image; and determining a current treatment parameter of the skin beauty instrument according to the current detailed skin image and the current skin position. In this way, the high-speed multispectral imaging acquisition technology is combined with the pre-acquired full-face skin image, so that the recognition and positioning navigation function of the user's facial skin details can be quickly completed. Based on the current detailed skin image and the current skin position, the current treatment parameter of the skin beauty instrument is adjusted, so that the treatment parameters corresponding to different skin positions and different skin states are different, and thus precise skin care is achieved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of biological medicine, in particular to a skin data processing method and device, a skin beautifying instrument and a skin beautifying system. BACKGROUND

[0002] In the beauty scene of automatic operation of the beauty device, the beauty device can only perform uniform operation on the whole face according to fixed preset working parameters, and cannot realize precise skin care. SUMMARY

[0003] The present application aims to provide a skin data processing method and device, a skin beautifying instrument and a skin beautifying system to realize precise skin care.

[0004] In the first aspect, the present application provides a skin data processing method applied to a skin beautifying instrument with a high-speed multi-spectral imaging module in front-end configuration; the skin data processing method comprises:

[0005] Obtaining a current detailed skin image collected by the high-speed multi-spectral imaging module;

[0006] Determining a current skin position of the skin beautifying instrument by comparing the current detailed skin image with a pre-collected full-face skin image;

[0007] Determining a current treatment parameter of the skin beautifying instrument according to the current detailed skin image and the current skin position.

[0008] Further, the determination of the current skin position of the skin beautifying instrument by comparing the current detailed skin image with the pre-collected full-face skin image comprises:

[0009] Obtaining a current facial line code corresponding to the current detailed skin image;

[0010] Matching the current facial line code with a plurality of original facial line codes corresponding to the full-face skin image;

[0011] Determining a skin position corresponding to a matched original facial line code as the current skin position of the skin beautifying instrument.

[0012] Further, the current facial line code comprises a feature vector; the obtaining of the current facial line code corresponding to the current detailed skin image comprises:

[0013] obtaining current skin feature data in the current detailed skin image; wherein the current skin feature data comprises attribute data under preset parameters, the preset parameters comprising one or more of pores, color spots and texture, and the attribute data corresponding to attributes comprising one or more of color, size, position, distance and area;

[0014] generating a feature vector corresponding to the current detailed skin image according to the current skin feature data.

[0015] Further, the determining of the current treatment parameter of the skin cosmetic instrument according to the current detailed skin image and the current skin position comprises:

[0016] obtaining a previous detailed skin image and a previous treatment parameter corresponding to the current skin position; wherein the previous detailed skin image is a detailed skin image collected by the high-speed multi-spectral imaging module at the current skin position before the last treatment, and the previous treatment parameter is a treatment parameter corresponding to the current skin position at the last treatment;

[0017] determining a previous treatment effect according to the current detailed skin image and the previous detailed skin image;

[0018] determining the current treatment parameter of the skin cosmetic instrument according to the previous treatment effect and the previous treatment parameter.

[0019] Further, the determining of the previous treatment effect according to the current detailed skin image and the previous detailed skin image comprises:

[0020] obtaining current skin feature data in the current detailed skin image and previous skin feature data in the previous detailed skin image;

[0021] comparing the current skin feature data and the previous skin feature data to obtain a comparison result;

[0022] determining the previous treatment effect according to the comparison result.

[0023] Further, the previous treatment effect comprises positive change, no change or negative change; and the determining of the current treatment parameter of the skin cosmetic instrument according to the previous treatment effect and the previous treatment parameter comprises:

[0024] when the previous treatment effect is positive change, the previous treatment parameter is determined as the current treatment parameter of the skin cosmetic instrument;

[0025] when the previous treatment effect is no change, a treatment parameter obtained by increasing the previous treatment parameter by a first preset proportion is determined as the current treatment parameter of the skin cosmetic instrument.

[0026] When the last treatment effect is a negative change, a treatment parameter obtained by reducing the last treatment parameter by a second preset ratio is determined as the current treatment parameter of the skin cosmetic instrument.

[0027] Further, the determining the current treatment parameter of the skin cosmetic instrument according to the current detailed skin image and the current skin position comprises:

[0028] obtaining a preset basic treatment parameter corresponding to the current skin position and a current skin impedance value;

[0029] adjusting the preset basic treatment parameter according to the current skin impedance value to obtain the current treatment parameter of the skin cosmetic instrument.

[0030] Further, the determining the current treatment parameter of the skin cosmetic instrument according to the current detailed skin image and the current skin position comprises:

[0031] inputting the current detailed skin image and the current skin position into a data model based on deep learning, and taking a treatment parameter output by the data model as the current treatment parameter of the skin cosmetic instrument; wherein the data model is trained based on historical detailed skin images and historical treatment parameters corresponding to different skin positions of a current user.

[0032] Further, after the determining the current treatment parameter of the skin cosmetic instrument according to the current detailed skin image and the current skin position, the method further comprises:

[0033] sending the current detailed skin image, the current skin position and the current treatment parameter to a preset processing device, so that the processing device generates a skin quantification data report; wherein the processing device is a user terminal and / or a cloud server corresponding to the skin cosmetic instrument.

[0034] Further, the full-face skin image is obtained by a binocular multi-spectral imaging module; the current treatment parameter comprises one or more of a use amount of skin care liquid, a penetration rate of skin care liquid, a frequency of an activation signal and an energy of the activation signal, and the activation signal comprises one or more of a radio frequency signal, a low-frequency wave and red light.

[0035] In a second aspect, an embodiment of the present application further provides a skin data processing device applied to a skin cosmetic instrument configured with a high-speed multi-spectral imaging module in front end; the skin data processing device comprises:

[0036] an image acquisition module configured to acquire a current detailed skin image collected by the high-speed multi-spectral imaging module;

[0037] a position determining module configured to determine a current skin position of the skin beautifying instrument by comparing the current detailed skin image with a pre-acquired full-face skin image;

[0038] a parameter determining module configured to determine a current treatment parameter of the skin beautifying instrument according to the current detailed skin image and the current skin position.

[0039] In a third aspect, an embodiment of the present application further provides a skin beautifying instrument, comprising a memory and a processor, wherein the memory stores a computer program capable of running on the processor, and the processor implements the skin data processing method in the first aspect when executing the computer program.

[0040] In a fourth aspect, an embodiment of the present application further provides a skin beautifying system, comprising the skin beautifying instrument in the third aspect, and further comprising a user terminal and a cloud server connected with the skin beautifying instrument respectively.

[0041] The skin data processing method, the skin beautifying instrument and the skin beautifying system provided by the embodiments of the present application have the following advantages: the skin data processing method is applied to a skin beautifying instrument provided with a high-speed multi-spectrum imaging module in front end; the skin data processing method comprises the following steps: acquiring a current detailed skin image collected by the high-speed multi-spectrum imaging module; determining a current skin position of the skin beautifying instrument by comparing the current detailed skin image with a pre-acquired full-face skin image; and determining a current treatment parameter of the skin beautifying instrument according to the current detailed skin image and the current skin position. In this way, the high-speed multi-spectrum imaging acquisition technology is combined with the pre-acquired full-face skin image, so that the recognition and positioning navigation function of the user's facial skin details can be quickly completed; based on the current detailed skin image and the current skin position, the current treatment parameter of the skin beautifying instrument is adjusted, so that the treatment parameters corresponding to different skin positions and different skin states are different, and thus precise skin care is achieved. BRIEF DESCRIPTION OF DRAWINGS

[0042] In order to more clearly illustrate the technical solutions of the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the description of the embodiments or the prior art. Obviously, the drawings described below are some embodiments of the present application, and those skilled in the art can obtain other drawings according to these drawings without any creative effort.

[0043] Figure 1 A flowchart of a skin data processing method provided by an embodiment of the present application;

[0044] Figure 2 A flowchart of another skin data processing method provided by an embodiment of the present application;

[0045] Figure 3 A structural schematic diagram of a skin data processing device provided by an embodiment of the present application is shown in the figure;

[0046] Figure 4 A structural schematic diagram of a skin beautifying instrument provided by an embodiment of the present application is shown in the figure;

[0047] Figure 5 A structural schematic diagram of a skin beautifying system provided by an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0048] The technical solutions of the present application will be described clearly and completely in connection with the embodiments. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all the other embodiments obtained by those skilled in the art without creative labor are within the protection scope of the present application.

[0049] The inventor found that if only the microscopic skin state is acquired in a static state, the acquired skin data is relatively single and not comprehensive, and each microscopic skin image has the problem of image attributes such as being unable to determine the skin position. If only the full-face skin state is acquired in a static state, the acquisition frequency of the skin data is relatively low, the user data update frequency is relatively low, and an accurate solution cannot be made. The prior art cannot acquire the current state of the skin (including the environment inside the pores, the color spots, the texture, and the capillary blood vessels) in real time, and cannot make an accurate skin care solution for the current skin. Based on this, the skin data processing method, device, skin beautifying instrument, and skin beautifying system provided by the embodiments of the present application can realize real-time positioning and detection of the skin effect, and further realize accurate skin care.

[0050] To facilitate the understanding of the present embodiment, first, a skin data processing method disclosed by the embodiments of the present application is described in detail.

[0051] The embodiments of the present application provide a skin data processing method, which is applied to a skin beautifying instrument configured with a high-speed multispectral imaging module in the front end. Referring to a flowchart of a skin data processing method shown in the figure, the method mainly includes the following steps S102-S106: Figure 1

[0052] Step S102: Acquire the current detailed skin image collected by the high-speed multispectral imaging module.

[0053] ​The high-speed multispectral imaging module can be located at the front end of the skin beautifying instrument. When a user holds the skin beautifying instrument to move on the face of a human body, the high-speed multispectral imaging module can perform high-speed multispectral CMOS (Complementary Metal Oxide Semiconductor) image acquisition on the current skin site. The multispectral image acquired in real time is the current detailed skin image.

[0054] In step S104, the current skin site where the skin beautifying instrument is located is determined by comparing the current detailed skin image with the pre-acquired full-face skin image.

[0055] The full-face skin image can be acquired by the binocular multispectral imaging module. The binocular multispectral imaging module can also be located at the front end of the skin beautifying instrument. Before the skin beautifying instrument is used for skin care, the multispectral imaging module can be turned on, and then the skin beautifying instrument is held to scan the face. During the scanning process, the binocular CMOS multispectral imaging of the multispectral imaging module can obtain a full-face image sample, i.e., the full-face skin image. Then, the skin beautifying instrument can be used for skin care.

[0056] In some possible embodiments, step S104 can be implemented by the following process: first, a current facial texture code corresponding to the current detailed skin image is acquired; then, the current facial texture code is matched with a plurality of original facial texture codes corresponding to the full-face skin image; and then, the skin site corresponding to the original facial texture code that is successfully matched is determined as the current skin site where the skin beautifying instrument is located.

[0057] Optionally, the current facial texture code includes a feature vector. Based on this, the current facial texture code can be acquired by the following process: first, current skin feature data in the current detailed skin image is acquired; the current skin feature data includes attribute data under a preset parameter, the preset parameter includes one or more of pores, freckles and texture, and the attribute corresponding to the attribute data includes one or more of color, size, position, distance and area; then, a feature vector corresponding to the current detailed skin image is generated according to the current skin feature data. Further, when the feature vector corresponding to the current detailed skin image is generated, the current skin feature data can be quantized first, and then the data obtained by the quantization is processed in hexadecimal, i.e., converted into data readable by a computer, to obtain the feature vector.

[0058] In order to further improve the matching accuracy, the faceprint coding matching can be combined with the skin impedance value, the skin impedance value can be collected by the electrode device arranged at the front end of the skin beautifying instrument, each original faceprint coding corresponds to a skin impedance value interval range, the skin impedance value interval range is determined by the skin impedance value detected in the skin area where the original faceprint coding is located, for example, the maximum value and the minimum value of the skin impedance value in the skin area where the original faceprint coding is located are determined, and the interval range formed by the maximum value and the minimum value is taken as the skin impedance value interval range corresponding to the original faceprint coding. The size of the human skin impedance has a direct relationship with the thickness of the epidermis and the dermis layer, if the skin impedance is small, it can be determined that the face skin is thin, and vice versa, therefore, the skin impedance value can be used as a prerequisite for zoning screening, and the original faceprint coding corresponding to the current detailed skin image is scanned. Based on this, the specific matching process can be as follows: first, the current skin impedance value collected by the electrode device is obtained; each original faceprint coding is traversed; for the original faceprint coding traversed, if the current skin impedance value is in the preset interval range of the original faceprint coding, and the original faceprint coding can be recognized, the matching is successful, and the matching is ended; if the current skin impedance value is not in the preset interval range of the original faceprint coding, but the original faceprint coding can be matched, it is regarded as an error selection zone or interference, the matching fails, and the matching of the next original faceprint coding is continued; if the current skin impedance value and the original faceprint coding cannot be matched, the matching fails, and the matching of the next original faceprint coding is continued; until the matching is ended.

[0059] In step S106, the current treatment parameter of the skin beautifying instrument is determined according to the current detailed skin image and the current skin position.

[0060] The above-mentioned current treatment parameter can include one or more of the amount of skin care liquid, the penetration rate of the skin care liquid, the frequency of the activation signal and the energy of the activation signal, and the activation signal can include one or more of a radio frequency signal, a low frequency and red light. The skin care liquid can be a liquid skin care product or a liquid medicine with a skin treatment effect, which can be set according to actual needs, and is not limited here.

[0061] The embodiment of the application provides three implementation manners of determining the current treatment parameter of the skin beautifying instrument, which will be introduced respectively.

[0062] Implementation manner one:

[0063] The last treatment parameter corresponding to the current skin position is obtained first; wherein the last treatment parameter is the treatment parameter corresponding to the current skin position in the last treatment; then the last treatment effect is determined according to the current detail skin image and the last detail skin image; finally, the current treatment parameter of the skin beautifying instrument is determined according to the last treatment effect and the last treatment parameter. This way refers to the last treatment effect of the user, and the determined current treatment parameter is more accurate.

[0064] Optionally, the last treatment effect can be determined by the following process: obtaining current skin feature data in the current detail skin image and last skin feature data in the last detail skin image; comparing the current skin feature data and the last skin feature data to obtain a comparison result; determining the last treatment effect according to the comparison result. Further, when determining the last treatment effect according to the comparison result, the change amount (the change amount can be a change ratio, including three cases of positive number, 0, and negative number) of each preset parameter can be obtained first, then the change amounts of the preset parameters are weighted and summed to obtain an effect evaluation value, and then the last treatment effect is determined based on the effect evaluation value, for example, when the effect evaluation value is a positive number, the last treatment effect is positive change; when the effect evaluation value is 0, the last treatment effect is no change; when the effect evaluation value is a negative number, the last treatment effect is negative change.

[0065] Optionally, the last treatment effect includes positive change, no change or negative change; based on this, the step of determining the current treatment parameter of the skin beautifying instrument according to the last treatment effect and the last treatment parameter can be performed by the following way: when the last treatment effect is positive change, the last treatment parameter is determined as the current treatment parameter of the skin beautifying instrument; when the last treatment effect is no change, the treatment parameter obtained by increasing the last treatment parameter by a first preset ratio is determined as the current treatment parameter of the skin beautifying instrument; when the last treatment effect is negative change, the treatment parameter obtained by decreasing the last treatment parameter by a second preset ratio is determined as the current treatment parameter of the skin beautifying instrument. The first preset ratio and the second preset ratio can be set according to actual needs, which is not limited here.

[0066] Implementation mode two:

[0067] The preset basic treatment parameter corresponding to the current skin position and the current skin impedance value are acquired first; then the preset basic treatment parameter is adjusted according to the current skin impedance value, and the current treatment parameter of the skin beautifying instrument is obtained. The preset basic treatment parameter can be a treatment parameter obtained based on a large amount of experimental data, and the preset basic treatment parameters corresponding to different positions are usually different. This method does not need to refer to the treatment effect of the last time, has a certain universality, and is particularly suitable for the scene of using the skin beautifying instrument for skin care for the first time.

[0068] Further, in order to improve the accuracy of the current treatment parameter, the preset basic treatment parameter can also be adjusted by combining the current skin impedance value with the current skin feature data in the current detailed skin image; in addition, the preset basic treatment parameter can also be adjusted directly based on the current skin feature data in the current detailed skin image. The specific adjustment strategy can be set according to actual needs, which is not limited here.

[0069] Implementation mode three:

[0070] The current detailed skin image and the current skin position are input into a data model based on deep learning, and the treatment parameter output by the data model is taken as the current treatment parameter of the skin beautifying instrument; wherein the data model is trained based on the historical detailed skin image and the historical treatment parameter corresponding to different skin positions of the current user.

[0071] The whole process of data model training includes four parts of data set construction, model training, model loading and model parameter adjustment; wherein the data set includes a training set and a verification set, and the training set and the verification set each include a plurality of samples, each sample including a historical detailed skin image and a historical treatment parameter corresponding to different skin positions of a user, the historical detailed skin image being the input of the data model, and the historical treatment parameter being a label. The model training process of the data model can be as follows: training on the training set; verifying on the verification set; the data model saves the optimal weight and reads the weight; and the accuracy of the training set and the verification set is recorded at the same time, facilitating parameter adjustment.

[0072] The skin data processing method provided by the embodiment of the application adopts high-speed multi-spectral imaging acquisition technology combined with pre-acquired full-face skin images, can quickly complete the recognition and positioning navigation function of the facial skin details of the user, adjusts the current treatment parameter of the skin beautifying instrument based on the current detailed skin image and the current skin position, so that the treatment parameters corresponding to different skin positions and different skin states are different, and thus accurate skin care is achieved.

[0073] Further, the current detailed skin image, the current skin position and the current treatment parameter can be sent to a preset processing device to make the processing device generate a skin quantification data report; wherein the processing device can be a user terminal corresponding to the skin beautifying instrument and / or a cloud server.

[0074] The skin quantification indexes in the skin quantification data report can include pore color, spot area, texture line number and capillary depth of the skin photographed by the multi-spectrum imaging module. The user terminal can be an APP, and the user can view the skin quantification data report in the APP. Taking the user terminal as an APP for example, when the user opens the user APP, the state of each point of the skin (which can include inflammation, spot depth, capillary distribution, sensitive skin red area, moisture, oil, etc.) is determined according to the various skin positioning points (i.e. skin positions or skin points) obtained by the front end of the skin beautifying instrument and the full-face image analysis reference quantity, the detailed skin image of each point is obtained, and is transmitted to the user APP local processing to form a skin quantification data report; when the user does not open the user APP, it can be directly transmitted to the cloud server for processing, and the skin quantification data report is returned to the user APP local background after the user APP is started.

[0075] For the sake of understanding, the following refers to Figure 2 The above skin data processing method is described in detail.

[0076] As shown in Figure 2 The front end of the skin beautifying instrument is provided with a high-speed multi-spectrum imaging module and a binocular multi-spectrum imaging module. The high-speed multi-spectrum imaging module acquires a multi-spectrum imaging picture through high-speed multi-spectrum CMOS image acquisition, and is used to collect skin detail points and analyze skin micro imaging. The binocular multi-spectrum imaging module acquires a full-face image sample through binocular CMOS multi-spectrum imaging, and is used to collect full-face image positioning points. The multi-spectrum imaging picture and the full-face image sample are input into a CPU (Central Processing Unit) / MCU (Microcontroller Unit), and the full-face image of the user is taken as a reference quantity to establish an image archive of the full-face skin, and these image files are stored in faceprint encoding.

[0077] The CPU / MCU can transmit the obtained image to an APP or a cloud server, and the image transmission can be performed through hardware encoding and decoding. The APP can perform local processing or the cloud server can perform processing to generate a skin quantification data report. Specifically, the CPU / MCU can determine the state of each skin point (including inflammation, depth of color spots, distribution of capillary pipettes, sensitive skin red area, moisture, oil, etc.) according to the obtained various skin points and the full-face image analysis reference quantity, obtain a detailed skin image of each point, and transmit the image to the user APP for local processing to form a skin quantification data report. The skin quantification data report includes the following skin quantification indexes: pore color, color spot area, texture line number, and capillary depth of the skin photographed by the multi-spectrum imaging module; or when the user does not open the APP, the image is directly transmitted to the cloud server for processing, and the data is returned to the user's local APP background after the APP is started.

[0078] The full-face image is used as a reference surface, and the multi-spectrum imaging picture is used as a positioning point for face skin navigation, that is, to determine the skin point where the skin beautifying instrument is located. The face skin navigation process can be as follows: the image collected by the high-speed multi-spectrum imaging module is used as a reference point to obtain a detailed skin image of the current face, and then the face texture code of the current detailed skin image is compared with the face texture code of the full-face image in the archive to find the best matching object. The skin position corresponding to the matching object is the navigation result. The face texture code can be obtained by the following method: first, determine the color, size, position, distance, and area of pores, color spots, and textures in the face image (i.e., the detailed skin image), and then calculate their geometric feature quantities, which form a feature vector that describes the face image. The face texture code of the detailed skin image is used as the identification parameter to compare, judge, and confirm all original parameters in the database (i.e., the archive), and finally determine the current skin position in front of the skin beautifying instrument to complete the face skin navigation.

[0079] After the sampling of each skin point and the face skin navigation are completed, the skin beautifying instrument is adjusted. The adjustment includes RF (radio frequency), EMS (micro-current or low-frequency), and red light activation signals, and the energy and frequency of the activation signals are adjusted to improve the skin condition. That is, according to the navigation result, the energy and frequency output of the activation signal are adjusted to act on the skin. By adjusting the energy and frequency output of the activation signal, the penetration and absorption rate of the skin care composition at different skin points can be changed. According to the navigation result, the dosage and administration time of each skin point are also changed (the dosage refers to the amount of the skin care liquid). By adjusting the energy and frequency output of the activation signal and changing the dosage and administration time of each skin point, the absorption efficiency of each skin point can be adjusted to achieve the effect of balancing the skin and avoid uneven skin conditions.

[0080] This invention provides two adjustment methods, namely:

[0081] Method 1: Based on the parameters of the previous treatment (including the amount of skin care solution used, the penetration rate of the skin care solution, the energy of the activation signal, and the frequency of the activation signal) and the treatment effect (the treatment effect can be determined based on the skin condition before and after the previous treatment), determine the parameters for the current treatment. The specific implementation method can be as follows:

[0082] Based on the previous skin data attributes, including the color, size, location, distance, and area of ​​the entire face skin after multispectral irradiation (such as pores, pigmentation, and texture), the quantified data of these skin features are compared with the skin data acquired this time to obtain the change ratio. There are three situations: positive change, no change, and negative change. For positive changes, the treatment parameters remain unchanged from the previous treatment. For no change, the energy and frequency, drug dosage, and penetration rate are increased by 10%. For negative changes, the frequency and energy are decreased by 10%, the drug dosage is reduced, and the user is informed of the potential risks.

[0083] Method 2: Based on the sampled detailed skin images and real-time skin impedance values, determine the parameters corresponding to this treatment. The specific implementation method can be as follows:

[0084] When collecting skin data for the first time, since there is no previous reference for comparison, it is not possible to obtain the adjustment conditions using method one. Therefore, the energy and frequency outputs are adjusted by referring to the skin feature data corresponding to the detailed skin image and the real-time skin impedance. For the drug, the default baseline amount remains unchanged.

[0085] The above-mentioned dosage, absorption efficiency, and changes in energy and frequency of RF, EMS and red light can also be transmitted to the APP for local processing to further improve the user's skin data report and continuously improve the big data database.

[0086] Furthermore, after completing facial skin navigation, real-time image data of skin changes and drug dosage at various points on the skin are acquired. Through enhanced deep learning, a data model is established. The database can be continuously improved, the data model can be built, and deep learning can be formed to complete the collection and updating of skincare clinical data. Among them, skin pores, pigmentation, texture, and capillaries, corresponding to the color, size, location, distance, area, and other attributes of the entire face skin, have generated corresponding skin attribute characteristic data index change rates under the effects of RF, EMS, red light, and drug care, as well as under certain treatment or care cycles, forming a data model.

[0087] Through the above data model, the deep learning training is strengthened, the skin beautifying instrument is provided with faster response to match the skin of the user, corresponding energy, frequency and skin care liquid and the use amount are output, meanwhile, different skin care liquid components corresponding to different user genders, ages and skin conditions are classified and counted, and the skin care liquid formula is further improved.

[0088] The embodiment of the present application has the following beneficial effects:

[0089] In the image analysis of collecting the skin state, thousands of databases are built, an solid foundation is laid for establishing the deep learning to identify the skin state and the clinical data of medicine and the tracking of medicine, the identification and visualization of the skin are more accurate and have a lower fault tolerance rate;

[0090] The high-speed multispectral imaging acquisition technology is adopted, the whole face of the user can be quickly positioned and the navigation function is realized, the real-time positioning and detection of the skin are realized; the instruction operation process of the face image navigation and positioning is combined with the multispectral binocular large camera imaging acquisition and the high-speed small camera face detail recognition of the equipment body, the identification and positioning navigation function of the face skin details of the user are realized; the state of each point of the skin is collected, the state of the skin can be accurately judged, the environment in the pores of the skin, the capillary state which cannot be visually observed by the naked eye, the deep skin lesions and the like are included, so that the reference for the output of each parameter of the equipment is provided in real time, different adjustment data output is made according to different skin states, the accurate skin care and accurate drug delivery of the skin are realized, and the balanced skin care is realized;

[0091] Further, the acquired data is continuously trained to strengthen the deep learning, and the fault tolerance rate is continuously upgraded and reduced, so that the equipment is always in the latest state;

[0092] Further, the skin index quantization database is established, the clinical nursing report of the user is combined, the drug formula and the use amount are optimized, the acquired data is classified and counted according to different drug components corresponding to different user genders, ages and skin conditions, the drug formula is further improved, and the actual effective clinical nursing data is provided.

[0093] Corresponding to the above skin data processing method, the embodiment of the present application also provides a skin data processing device, which is also applied to the skin beautifying instrument provided with the high-speed multispectral imaging module at the front end. Figure 3 As shown in a structure schematic diagram of a skin data processing device, the device comprises:

[0094] An image acquisition module 301 is used to acquire the current detailed skin image collected by the high-speed multispectral imaging module;

[0095] The position determining module 302 is configured to determine the current skin position of the skin care device by comparing the current detailed skin image with the pre-acquired full-face skin image.

[0096] The parameter determining module 303 is configured to determine the current treatment parameter of the skin care device according to the current detailed skin image and the current skin position.

[0097] Further, the position determining module 302 is specifically configured to: acquire a current faceprint code corresponding to the current detailed skin image; match the current faceprint code with a plurality of original faceprint codes corresponding to the full-face skin image; and determine the skin position corresponding to the original faceprint code that is successfully matched as the current skin position of the skin care device.

[0098] Further, the current faceprint code includes a feature vector; based on this, the position determining module 302 is further configured to: acquire current skin feature data in the current detailed skin image; wherein the current skin feature data includes attribute data under a preset parameter, the preset parameter includes one or more of pores, freckles and texture, and the attribute corresponding to the attribute data includes one or more of color, size, position, distance and area; and generate a feature vector corresponding to the current detailed skin image according to the current skin feature data.

[0099] In some possible embodiments, the parameter determining module 303 is specifically configured to: acquire a previous detailed skin image and a previous treatment parameter corresponding to the current skin position; wherein the previous detailed skin image is a detailed skin image acquired by the high-speed multi-spectral imaging module at the current skin position before the last treatment, and the previous treatment parameter is a treatment parameter corresponding to the current skin position in the last treatment; determine a previous treatment effect according to the current detailed skin image and the previous detailed skin image; and determine the current treatment parameter of the skin care device according to the previous treatment effect and the previous treatment parameter.

[0100] Further, the parameter determining module 303 is further configured to: acquire current skin feature data in the current detailed skin image and previous skin feature data in the previous detailed skin image; compare the current skin feature data with the previous skin feature data to obtain a comparison result; and determine the previous treatment effect according to the comparison result.

[0101] Further, the above last treatment effect includes positive change, no change or negative change; based on this, the parameter determination module 303 is further configured to: when the last treatment effect is positive change, determine the last treatment parameter as the current treatment parameter of the skin cosmetic instrument; when the last treatment effect is no change, determine the treatment parameter obtained by increasing the last treatment parameter by a first preset ratio as the current treatment parameter of the skin cosmetic instrument; when the last treatment effect is negative change, determine the treatment parameter obtained by decreasing the last treatment parameter by a second preset ratio as the current treatment parameter of the skin cosmetic instrument.

[0102] In some possible embodiments, the parameter determination module 303 is specifically configured to: obtain a preset basic treatment parameter corresponding to the current skin position and the current skin impedance value; and adjust the preset basic treatment parameter according to the current skin impedance value to obtain the current treatment parameter of the skin cosmetic instrument.

[0103] In some possible embodiments, the parameter determination module 303 is specifically configured to: input the current detailed skin image and the current skin position into a data model based on deep learning, and determine the treatment parameter output by the data model as the current treatment parameter of the skin cosmetic instrument; wherein the data model is trained based on historical detailed skin images corresponding to different skin positions of the current user and historical treatment parameters.

[0104] Further, the skin data processing apparatus further includes:

[0105] The data sending module is configured to send the current detailed skin image, the current skin position and the current treatment parameter to a preset processing device, so that the processing device generates a skin quantification data report; wherein the processing device is a user terminal and / or a cloud server corresponding to the skin cosmetic instrument.

[0106] Further, the full-face skin image is obtained by a binocular multi-spectral imaging module; the current treatment parameter includes one or more of a use amount of skin care liquid, a penetration rate of the skin care liquid, a frequency of an activation signal and an energy of the activation signal; and the activation signal includes one or more of a radio frequency signal, a low frequency and red light.

[0107] The skin data processing apparatus provided in the embodiment has the same implementation principle and technical effects as the foregoing skin data processing method embodiments. For brevity, the part of the skin data processing apparatus embodiments not mentioned in the foregoing skin data processing method embodiments can refer to the corresponding content in the foregoing skin data processing method embodiments.

[0108] As Figure 4As shown, an embodiment of the present invention also provides a skin beauty device 400, including: a processor 401, a memory 402 and a bus. The memory 402 stores a computer program that can run on the processor 401. When the skin beauty device 400 is running, the processor 401 and the memory 402 communicate through the bus, and the processor 401 executes the computer program to implement the above-mentioned skin data processing method.

[0109] Specifically, the memory 402 and processor 401 mentioned above can be general-purpose memory and processor, without any specific limitations here.

[0110] like Figure 5 As shown, an embodiment of the present invention also provides a skin beauty system, including the skin beauty instrument 501 described above, and also including a user terminal 502 and a cloud server 503 respectively connected to the skin beauty instrument 501.

[0111] like Figure 5 As shown, the user terminal 502 can also communicate with the cloud server 503. The user terminal 502 can be understood as the user APP corresponding to the skin beauty device 501. The skin beauty device 501 can send detailed skin images of various detected points, corresponding skin locations, and corresponding treatment parameters to the user APP. The user APP can process the data locally to generate a skin quantitative data report; or, when the user does not open the APP, the above data can be directly transmitted to the cloud server 503, which will process and generate a skin quantitative data report. When the APP is launched, the data and / or the skin quantitative data report will be sent back to the user's local APP backend.

[0112] This invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the skin data processing method described in the preceding method embodiments. The computer-readable storage medium includes various media capable of storing program code, such as a USB flash drive, portable hard drive, read-only memory (ROM), RAM, magnetic disk, or optical disk.

[0113] In all examples shown and described herein, any specific values ​​should be interpreted as merely exemplary and not as limitations; therefore, other examples of exemplary embodiments may have different values.

[0114] The flow diagrams and the block diagrams in the drawings are presented to illustrate the architecture, functionality, and operation of possible implementations of apparatuses, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flow diagrams, and combinations thereof, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

[0115] In several embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented by other manners. The apparatus embodiments described above are merely illustrative, for example, the division of the units is merely a logical function division, and actual implementation can have another division manner, and for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some communication interfaces, devices or units, and can be electrical, mechanical or other forms.

[0116] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e. can be located in one place or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0117] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically, or two or more units can be integrated into one unit.

[0118] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A skin data processing method implemented by a processor executing a computer program, characterized by, The application is applied to a skin beauty instrument with a high-speed multi-spectrum imaging module at the front end; the skin data processing method comprises: acquiring a current detailed skin image collected by the high-speed multi-spectrum imaging module; determining a current skin position of the skin beauty instrument by comparing the current detailed skin image with a pre-acquired full-face skin image; determining a current treatment parameter of the skin beauty instrument according to the current detailed skin image and the current skin position, comprising: acquiring a previous detailed skin image corresponding to the current skin position and a previous treatment parameter; wherein the previous detailed skin image is a detailed skin image collected by the high-speed multi-spectrum imaging module at the current skin position before the last treatment, and the previous treatment parameter is a treatment parameter corresponding to the current skin position at the last treatment; determining a previous treatment effect according to the current detailed skin image and the previous detailed skin image; determining the current treatment parameter of the skin beauty instrument according to the previous treatment effect and the previous treatment parameter.

2. The skin data processing method according to claim 1, characterized in that, The current skin position of the skin beauty instrument is determined by comparing the current detailed skin image with the pre-acquired full-face skin image, comprising: acquiring a current face texture code corresponding to the current detailed skin image; matching the current face texture code with a plurality of original face texture codes corresponding to the full-face skin image; determining a skin position corresponding to a matched original face texture code as the current skin position of the skin beauty instrument.

3. The skin data processing method of claim 2, wherein, The current face texture code comprises a feature vector; the current face texture code corresponding to the current detailed skin image is acquired, comprising: acquiring current skin feature data in the current detailed skin image; wherein the current skin feature data comprises attribute data under a preset parameter, the preset parameter comprises one or more of pores, color spots and textures, and the attribute corresponding to the attribute data comprises one or more of color, size, position, distance and area; generating a feature vector corresponding to the current detailed skin image according to the current skin feature data.

4. The skin data processing method of claim 1, wherein, The previous treatment effect is determined according to the current detailed skin image and the previous detailed skin image, comprising: acquiring current skin feature data in the current detailed skin image and previous skin feature data in the previous detailed skin image; comparing the current skin feature data and the previous skin feature data to obtain a comparison result; determining a previous treatment effect according to the comparison result.

5. The skin data processing method of claim 1, wherein, The previous treatment effect comprises positive change, no change or negative change; the current treatment parameter of the skin beauty instrument is determined according to the previous treatment effect and the previous treatment parameter, comprising: when the previous treatment effect is positive change, the previous treatment parameter is determined as the current treatment parameter of the skin beauty instrument; when the previous treatment effect is no change, a treatment parameter obtained by increasing the previous treatment parameter by a first preset proportion is determined as the current treatment parameter of the skin beauty instrument; When the last treatment effect is a negative change, a treatment parameter obtained by reducing the last treatment parameter by a second preset ratio is determined as a current treatment parameter of the skin cosmetic instrument.

6. The skin data processing method of claim 1, wherein, After the current treatment parameter of the skin cosmetic instrument is determined according to the current detailed skin image and the current skin position, the method further comprises: The current detailed skin image, the current skin position and the current treatment parameter are sent to a preset processing device, so that the processing device generates a skin quantification data report; wherein the processing device is a user terminal and / or a cloud server corresponding to the skin cosmetic instrument.

7. The skin data processing method according to any one of claims 1 to 6, characterized by, The full-face skin image is obtained by a binocular multi-spectral imaging module; the current treatment parameter includes one or more of a skin care liquid usage, a skin care liquid penetration rate, a frequency of an activation signal and an energy of the activation signal, and the activation signal includes one or more of a radio frequency signal, a low frequency and red light.

8. A skin data processing apparatus characterized by comprising: The skin cosmetic instrument is applied to a front end configured with a high-speed multi-spectral imaging module; the skin data processing device comprises: An image acquisition module is configured to acquire a current detailed skin image collected by the high-speed multi-spectral imaging module; A position determination module is configured to determine a current skin position of the skin cosmetic instrument by comparing the current detailed skin image with a pre-acquired full-face skin image; A parameter determination module is configured to determine a current treatment parameter of the skin cosmetic instrument according to the current detailed skin image and the current skin position, including: acquiring a last detailed skin image and a last treatment parameter corresponding to the current skin position; wherein the last detailed skin image is a detailed skin image collected by the high-speed multi-spectral imaging module at the current skin position before the last treatment, and the last treatment parameter is a treatment parameter corresponding to the current skin position during the last treatment; determining a last treatment effect according to the current detailed skin image and the last detailed skin image; determining the current treatment parameter of the skin cosmetic instrument according to the last treatment effect and the last treatment parameter.

9. A skin cosmetic device, characterized by, The skin data processing device comprises a memory and a processor, the memory stores a computer program executable on the processor, and the processor executes the computer program to realize the skin data processing method in any one of claims 1-7.

10. A skin cosmetic system characterized by, The skin cosmetic instrument in claim 9 further comprises a user terminal and a cloud server connected to the skin cosmetic instrument respectively.

Images