Make-up matching method and system based on home Internet of Things and intelligent agent

Through the collaboration between the home Internet of Things and embodied intelligent bodies, the makeup solution is generated and pushed, which solves the problem of poor makeup convenience in the existing technology and improves the convenience of the makeup process.

CN119091167AInactive Publication Date: 2024-12-06GUANGDONG ENG POLYTECHNIC COLLEGE

Patent Information

Application Number
CN202411089324.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-12-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the Internet of Things at home, it is difficult for the existing technology to effectively use embodied intelligent bodies to improve the convenience of makeup. Users need to actively search and select makeup teaching materials, which is less convenient to use.

Method used

Through the Internet of Things home, the user's facial data, makeup intentions and destination information are obtained, and the body intelligent body generates concealer, base makeup and makeup solutions, and pushes makeup solutions to improve the convenience of makeup.

Benefits of technology

It realizes the independent generation of makeup solutions for embodied intelligent bodies, and combines user facial data and application scenarios to quickly generate makeup solutions that meet user needs, improving the convenience and accuracy of makeup.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119091167A_ABST
    Figure CN119091167A_ABST
Patent Text Reader

Abstract

The invention provides a makeup matching method and system based on a home internet of things and a body-fitting agent, and relates to the technical field of body-fitting agent application. The method comprises the steps that indoor environment parameters are acquired through the home Internet of Things, and face data, makeup intention, destination information and travel path information of a user are acquired through a body-equipped intelligent agent; the home internet of things adjusts the illumination condition according to the indoor environment parameters; according to the face data of the user, the makeup intention of the user, the destination information and the travel path information, generating a concealing scheme, a base makeup scheme, a color makeup scheme and a make-up refinement scheme; generating and displaying a corresponding makeup image according to the face data of the user, and displaying a concealing scheme, a base makeup scheme and a color makeup scheme by the body agent in sequence; and pushing the make-up refinement scheme to the intelligent mobile device of the user. According to the makeup matching method based on the home internet of things and the intelligent agent, the makeup modification convenience of people can be remarkably improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of embodied intelligent body applications, and in particular to a makeup matching method and system based on home Internet of Things and embodied intelligent body. Background Art

[0002] Embodied intelligence refers to a virtual intelligence or physical robot that can interact with the environment and make autonomous decisions like humans. The realization of embodied intelligence requires the comprehensive use of computer vision, natural language processing, robotics and other technologies, which is more complex than the general field of artificial intelligence. With the gradual development of the Internet of Things technology, the intersection of the Internet of Things technology and artificial intelligence technology is increasing. How to better integrate artificial intelligence technology and the Internet of Things technology has become a current research hotspot.

[0003] At present, in a common scenario, that is, setting up an embodied intelligent body in the home Internet of Things, how to use the embodied intelligent body and the home Internet of Things to make people's production and life more convenient is not only a typical research scenario for the integration of artificial intelligence technology and Internet of Things technology, but also an important landing point for the integration of artificial intelligence technology and Internet of Things technology.

[0004] Take makeup, an important part of people's production and life, for example. At present, with the assistance of artificial intelligence technology, people can obtain various makeup teaching materials (such as text, pictures, videos, etc.) in real time; and in the current artificial intelligence technology, there are various applications that assist people in makeup, aiming to help people practice makeup or refer to the effect of makeup. However, whether it is teaching materials or applications, they still rely on people to actively search, select, and obtain them using artificial intelligence technology, and their convenience of use still needs to be improved. Summary of the invention

[0005] In order to solve the technical problems in the related technologies, the present application provides a makeup matching method and system based on the home Internet of Things and embodied intelligent bodies. The makeup matching method based on the home Internet of Things and embodied intelligent bodies of the present application can be well adapted to the typical application scenario of the home Internet of Things and embodied intelligent bodies, which integrates artificial intelligence technology and the Internet of Things technology, and significantly improves the convenience of people in making up.

[0006] In order to achieve the above objectives, the technical solutions adopted in this application include:

[0007] According to the first aspect of the present application, a makeup matching method based on home Internet of Things and embodied intelligent body is provided, comprising the following steps:

[0008] Step S1: obtaining indoor environment parameters through the home IoT, and obtaining the user's facial data, the user's makeup intention, destination information and travel path information through the embodied intelligent body; wherein the indoor environment parameters include: indoor light source position; the user's facial data includes: facial image, facial contour, facial color abnormal area, eye contour, lip contour and nose contour; makeup intention includes makeup type; destination information includes destination category, destination temperature and humidity, destination weather conditions; travel path information includes travel distance, travel time, and travel transportation;

[0009] Step S2: the home IoT adjusts its lighting conditions according to the indoor environment parameters so that the lighting range of the indoor light source at the position of the embodied intelligent body can cover the user's face, so that the user can perform makeup modification;

[0010] Step S3: Generate a concealer solution for the user according to the user's facial data and the user's makeup intention; generate a base makeup solution for the user according to the concealer solution, the user's facial data, the user's makeup intention and the destination information; generate a color makeup solution for the user according to the base makeup solution, the user's facial data, the user's makeup intention and the destination information; generate a touch-up makeup solution for the user according to the color makeup solution, the user's destination information and the travel route information;

[0011] Step S4: Generate and display a corresponding bare face picture according to the user's facial data, and at the same time, the embodied intelligent body displays the concealer solution, base makeup solution and makeup solution in sequence;

[0012] Step S5: Push the makeup touch-up plan to the user's smart mobile device.

[0013] Optionally, the step S2 specifically includes:

[0014] Obtaining the position and shape of the embodied intelligent body, as well as the position and display direction of the display screen on the embodied intelligent body, and setting a reference point, wherein the reference point is set to be a simulated point located directly in front of the middle of the display screen and having a simulated distance from the display screen;

[0015] According to the position and shape of the embodied intelligent body, the position and display direction of the display screen on the embodied intelligent body, and the reference point, several indoor light sources that can be illuminated are screened out, wherein the position of the indoor light source that can be illuminated is collinear with a point on the edge of the embodied intelligent body and the reference point, and the embodied intelligent body is located between the indoor light source and the reference point.

[0016] Optionally, there are at least two indoor light sources that can be illuminated, and an angle A between lines connecting the two indoor light sources that can be illuminated and the reference point satisfies: 30°≤A≤90°.

[0017] Optionally, the step S3 specifically includes:

[0018] Generate concealer solution:

[0019] Step S3-1-1: Read the user's facial data and generate a basic facial model of the user based on the identified facial contour, eye contour, lip contour and nose contour;

[0020] Step S3-1-2: Identify the image color parameters of all areas except the facial contour, eye contour, lip contour and nose contour in the user's facial data, identify the normal skin color area and the abnormal skin color area according to the image color parameters, and divide all the abnormal areas into dark circle areas and common abnormal areas according to the minimum distance between each abnormal skin color area and the eye contour, wherein the dark circle area is an abnormal area whose minimum distance with the eye is less than or equal to a first threshold, and the common abnormal area is an abnormal area whose minimum distance with the eye is greater than a second threshold;

[0021] Step S3-1-3: Determine the total amount range of cosmetics required for the concealer scheme according to the plane size and depth information of the dark circle area and the common abnormal area, determine the color number range of the cosmetics required for the concealer scheme according to the color parameters of the dark circle area and the common abnormal area, and determine the recommended cosmetics sequence for the concealer scheme according to the color number range;

[0022] Generate makeup solution:

[0023] Step S3-2-1: Determine the total amount range of cosmetics required for the base makeup solution based on the plane size and depth information of the facial contour identified in step S3-1-1, determine the color number range of the cosmetics required for the base makeup solution in combination with the color parameters of the normal skin color area identified in step S3-1-2 and the recommended cosmetics sequence generated in step S3-1-3, and determine the recommended cosmetics sequence based on the color number range;

[0024] Step S3-2-2: according to the makeup intention of the user, delete the cosmetic categories that do not meet the makeup intention of the user in the recommended cosmetic sequence generated in step S3-2-1;

[0025] Step S3-2-3: According to the destination category and the destination weather conditions in the destination information, the cosmetic categories that do not conform to the destination category and the destination weather conditions in the recommended cosmetic sequence generated in step S3-2-2 are deleted to form a recommended cosmetic sequence for the base makeup solution;

[0026] Generate makeup plan:

[0027] Step S3-3-1: Determine the total amount range of cosmetics required for the base makeup solution according to the plane size and depth information of the facial contour identified in step S3-1-1, determine the color number range of cosmetics required for the makeup solution according to the recommended cosmetic sequence of the base makeup solution generated in step S3-2-3, and recommend a cosmetic sequence based on the color number range;

[0028] Step S3-3-2: according to the makeup intention of the user, delete the cosmetic categories that do not meet the makeup intention of the user in the recommended cosmetic sequence generated in step S3-3-1;

[0029] Step S3-3-3: According to the destination information, the cosmetics categories that do not conform to the destination category, the destination temperature and humidity, and the destination weather conditions are deleted from the recommended cosmetics sequence generated in step S3-3-2 to form a recommended cosmetics sequence for the makeup plan;

[0030] Generate makeup solution:

[0031] Step S3-4-1: Determine the color range of the cosmetics required for the makeup solution according to the recommended cosmetics sequence of the makeup solution generated in S3-3-3, and recommend a cosmetics sequence according to the color range;

[0032] Step S3-4-2: Determine the first makeup touch-up time according to the travel route information;

[0033] Step S3-4-3: Determine the second makeup touch-up time based on the travel time and destination information.

[0034] Optionally, the step S3-1-2 further includes:

[0035] Step S3-1-2-1: Compare the chromatogram of the image of the common abnormal area with the chromatogram of the image containing acne in the database, and generate a comparison score according to the Manhattan distance between the chromatograms of the corresponding blocks of the two. When the comparison score is less than or equal to the third threshold, the corresponding common abnormal area is identified as a general abnormal area; when the comparison score is greater than the fourth threshold, the corresponding common abnormal area is identified as acne;

[0036] Step S3-1-2-2: Generate a corresponding first concealer solution based on the difference between the color parameters of the common abnormal area and the color parameters of the normal skin color area; generate a corresponding second concealer solution based on the difference between the color parameters of the acne area and the color parameters of the normal skin color area.

[0037] Optionally, the makeup matching method based on home IoT and embodied intelligent body also includes:

[0038] Step S0: Establish a cosmetics database, which includes a number of matching sequences of each type of cosmetics with temperature, humidity, weather conditions and initial application time, and each matching sequence records the stable duration range value of the corresponding type of cosmetics.

[0039] Optionally, in step S3, the makeup touch-up plan is generated specifically as follows:

[0040] The cosmetics database generated in step S0 is read, and a makeup touch-up plan is determined according to the makeup plan, the destination temperature and humidity in the user's destination information, the destination weather conditions, and the travel route information.

[0041] Optionally, the step S4 specifically includes:

[0042] Step S4-1: Generate and display a corresponding bare face image according to the user's facial image;

[0043] Step S4-2: marking the facial contour, the facial color abnormality area, the eye contour, the lip contour and the nose contour in the plain face image, wherein the facial contour is always bright;

[0044] Step S4-3: First, make the brightness of the abnormal facial color area greater than the brightness of the eye contour, lip contour and nose contour, and display the concealer solution simultaneously; then adjust the overall bare face image to the same brightness, and display the base makeup solution at the same time; finally, display the makeup solution.

[0045] Optionally, the step S5 specifically includes:

[0046] Step S5-1: converting the generated makeup solution into text or picture format;

[0047] Step S5-2: Push to the user's smart mobile device in a scheduled manner.

[0048] According to the second aspect of the present application, a makeup matching system based on a home Internet of Things and an embodied intelligent body is also provided, which is used to execute the makeup matching method based on a home Internet of Things and an embodied intelligent body as described in any technical solution in the first aspect of the present application, including a home Internet of Things and an embodied intelligent body; wherein,

[0049] Home IoT is used to obtain indoor environmental parameters and adjust indoor lighting conditions;

[0050] The embodied intelligent body is used to obtain the user's facial data, the user's makeup intention, destination information and travel route information; and is used to generate and display bare face pictures, concealer plans, foundation plans, and makeup plans; and is used to generate and push touch-up plans.

[0051] Beneficial effects:

[0052] 1. Through the above technical solution, when the user needs to put on makeup, the indoor environment parameters can be obtained through the home IoT, and at the same time, the user's facial data, makeup intention, destination information, and travel path information can be obtained through the embodied intelligent body. In this way, the embodied intelligent body can quickly generate concealer solutions, base makeup solutions, color makeup solutions, and touch-up makeup solutions that meet the user's current situation and specific application scenarios by combining the above data and information, so as to improve the convenience of the user's makeup.

[0053] In addition, this application scenario can serve as a typical application scenario for the integration of artificial intelligence technology and Internet of Things technology, so that relevant technical personnel can use this scenario to form a certain reference for the relevant technical standards, testing standards and implementation standards for the integration of artificial intelligence technology and Internet of Things technology, thereby promoting the integration of artificial intelligence technology and Internet of Things technology.

[0054] 2. Other beneficial effects or advantages of the present application will be described in detail in the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative labor.

[0056] in:

[0057] Figure 1 It is a flowchart of the steps of a makeup matching method based on home Internet of Things and embodied intelligent body provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0058] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments.

[0059] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0060] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes other steps or units that are not listed, or optionally includes other steps or units that are inherent to these processes, methods, products or devices. Among them, it should also be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design solutions. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0061] The following first defines the relevant technical terms of this application.

[0062] The home Internet of Things uses the Internet of Things technology to connect the lighting, home appliances, health monitoring equipment, home entertainment equipment, etc. in the home living space under the same Internet of Things to achieve intelligent control and management.

[0063] Embodied intelligence and embodied intelligent agents. Embodied intelligence is a development area of ​​artificial intelligence, which refers to an intelligent system or machine that can interact with the environment in real time through perception and interaction. The overall architecture of embodied intelligence consists of a perception layer, an interaction layer, and a motion layer. The greatest feature of embodied intelligence is that it can perceive the physical world autonomously, learn with an anthropomorphic thinking path, and thus make behavioral feedback that humans expect, rather than passively waiting for data to be fed. The embodied intelligent agent is the physical form of embodied intelligence, which can be simply understood as a robot with an indeterminate form.

[0064] In order to facilitate relevant technical personnel to have a clearer and more accurate understanding of the technical solution of this application, the technical ideas of this application are briefly described below.

[0065] How to better integrate artificial intelligence technology and Internet of Things technology has become a current research hotspot. However, since it is in the preliminary research stage, the implementation of related technologies integrating artificial intelligence and Internet of Things and the promotion of typical cases are still issues that need to be broken through at this stage. At present, there is already such an application scenario, that is, home Internet of Things + embodied intelligent body. For this application scenario, it is not only a typical research scenario for the integration of artificial intelligence technology and Internet of Things technology, but also an important landing point for the integration of artificial intelligence technology and Internet of Things technology.

[0066] In the home scenario, there is an important part of people's production and life - makeup. How to use embodied intelligent bodies and home Internet of Things to make makeup more convenient has important practical and research significance.

[0067] At present, people can use artificial intelligence to search for various makeup teaching materials, and can also use applications based on artificial intelligence to practice makeup and refer to the effects of makeup. However, these artificial intelligence technologies still require people to actively search, select and obtain them, and their convenience of use is still poor.

[0068] In view of this, the present application provides a method that can make makeup more convenient in the application scenarios of embodied intelligent bodies and home Internet of Things, namely, the makeup matching method based on home Internet of Things and embodied intelligent bodies of the present application.

[0069] The inventive idea of ​​the method of the present application is:

[0070] Through the collaboration between home IoT and embodied intelligent bodies, not only can the convenience of people's makeup be effectively improved, but it can also serve as a typical scenario for the integration of artificial intelligence technology and IoT technology, so as to provide reference for relevant technical standards, testing standards and implementation standards for the integration of the two technologies.

[0071] The technical solution of the present application is described in detail below with reference to the accompanying drawings.

[0072] Example 1

[0073] like Figure 1 As shown, according to the first aspect of the present application, a makeup matching method based on home Internet of Things and embodied intelligent body is provided, comprising the following steps:

[0074] Step S1: Acquire indoor environmental parameters through the home Internet of Things, and acquire the user's facial data, the user's makeup intention, destination information and travel route information through the embodied intelligent body; wherein, the indoor environmental parameters include: the position of the indoor light source; the user's facial data includes: facial image, facial contour, facial color abnormality area, eye contour, lip contour and nose contour; makeup intention includes makeup type; destination information includes destination category, destination temperature and humidity, destination weather conditions; travel route information includes travel distance, travel time, and travel transportation.

[0075] Step S2: the home IoT adjusts its lighting conditions according to the indoor environment parameters so that the lighting range of the indoor light source at the position of the embodied intelligent body can cover the user's face, so that the user can perform makeup modification;

[0076] Step S3: Generate a concealer solution for the user according to the user's facial data and the user's makeup intention; generate a base makeup solution for the user according to the concealer solution, the user's facial data, the user's makeup intention and the destination information; generate a color makeup solution for the user according to the base makeup solution, the user's facial data, the user's makeup intention and the destination information; generate a touch-up makeup solution for the user according to the color makeup solution, the user's destination information and the travel route information;

[0077] Step S4: Generate and display a corresponding bare face picture according to the user's facial data, and at the same time, the embodied intelligent body displays the concealer solution, base makeup solution and makeup solution in sequence;

[0078] Step S5: Push the makeup touch-up plan to the user's smart mobile device.

[0079] Through the above technical solution, when the user needs to put on makeup, the indoor environment parameters can be obtained through the home IoT, and at the same time, the user's facial data, makeup intention, destination information, and travel path information can be obtained through the embodied intelligent body. In this way, the embodied intelligent body can quickly generate concealer solutions, base makeup solutions, color makeup solutions, and touch-up makeup solutions that meet the user's current situation and specific application scenarios by combining the above data and information, so as to improve the convenience of the user's makeup.

[0080] In addition, this application scenario can serve as a typical application scenario for the integration of artificial intelligence technology and Internet of Things technology, so that relevant technical personnel can use this scenario to form a certain reference for the relevant technical standards, testing standards and implementation standards for the integration of artificial intelligence technology and Internet of Things technology, thereby promoting the integration of artificial intelligence technology and Internet of Things technology.

[0081] In this embodiment, it should be noted that

[0082] First, the makeup scheme provided by the method of the present application is based on the user's current facial condition and is obtained autonomously through the embodied intelligent body. It has relatively strong objectivity. Compared with the existing related technologies in which users conduct keyword searches and selections based on subjective descriptions, it can more objectively provide a more suitable makeup scheme based on the user's current facial condition.

[0083] Second, the makeup scheme provided by the method of the present application is not only based on the objective facial data obtained autonomously by the embodied intelligent body, but also combines the makeup that the user subjectively wants (i.e., the user's makeup intention). This is not only conducive to limiting the generation conditions of makeup schemes to improve the speed of makeup scheme generation, but also conducive to ensuring that the final generated makeup scheme fits the user's needs, and can effectively avoid the different makeup schemes generated having a low degree of adaptability to the user's needs.

[0084] Third, the makeup scheme provided by the method of the present application also takes into account the continuity and stability of the makeup. In the present application, the destination information and travel route information obtained by the embodied intelligent body can be used as important factors affecting the continuity and stability of the makeup. For example, in the generated makeup scheme and touch-up scheme, the destination weather conditions in the destination information are taken into account (for example, when generating a makeup scheme, if the weather condition at the destination is rainy, the corresponding cosmetics with better stability in rainy days will be matched).

[0085] It can be understood that based on the autonomy of the embodied intelligent body, it can obtain the user's idea of ​​wanting to put on makeup in certain scenarios, thereby initiating the method of the present application. For example, when the user gets up in the morning and there is an outing schedule for the day in the electronic calendar, it can be known that the user wants to put on makeup, thereby initiating the method of the present application.

[0086] In addition, based on the interactivity of the embodied intelligent agent, it can obtain the user's idea of ​​wanting to put on makeup during the information interaction in certain scenarios, thereby initiating the method of the present application. For example, during a conversation between a user and the embodied intelligent agent, when the user directly or indirectly expresses the idea of ​​needing to put on makeup, the embodied intelligent agent can directly initiate the method of the present application when the user needs it.

[0087] Of course, it is understandable that in the present application, the embodied intelligent body plays the role of a control core, which is not only used to call or control the relevant indoor light source equipment of the home Internet of Things, but also plays the role of data collection, processing and transmission. That is to say, it has at least one data transmission device (for transmitting adjustment information to the home Internet of Things or sending a makeup solution to the user's smart mobile device), a data processing device (for generating corresponding concealer solutions, foundation solutions, makeup solutions and makeup solution), and a display device (for displaying bare face pictures, concealer solutions, foundation solutions and makeup solutions).

[0088] Optionally, step S2 may specifically include: obtaining the position and shape of the embodied intelligent body, the position of the display screen on the embodied intelligent body and its display direction, and setting a reference point, wherein the reference point is set to a simulated point located directly in front of the middle of the display screen and having a simulated distance from the display screen; based on the position and shape of the embodied intelligent body, the position of the display screen on the embodied intelligent body and its display direction, and the reference point, screening out a number of indoor light sources that can be illuminated, wherein the position of the indoor light source that can be illuminated is collinear with a point on the edge of the embodied intelligent body and the reference point, and the embodied intelligent body is located between the indoor light source and the reference point.

[0089] In this embodiment, the display screen of the embodied intelligent body is used as both an image display device and a makeup reference mirror for the user. In this way, the user can quickly and conveniently obtain a reference makeup plan in real time while putting on makeup, thereby further improving the convenience of makeup.

[0090] At the same time, in this embodiment, the bright indoor light source selected in this way can not only ensure the lighting effect on the face of the user who is putting on makeup in front of the display screen of the embodied intelligent body, so as to facilitate the user to put on makeup, but also help to reduce the impact of the light of the display screen on the user's vision.

[0091] In this embodiment, it can be understood that the specific value of the simulated spacing can be adjusted according to the shape of the actual embodied intelligent body and the size of the display screen, as well as the body shape of the user, and this application does not make any specific limitations on this.

[0092] Optionally, there are at least two indoor light sources that can be illuminated, and the angle A between the two indoor light sources and the line connecting the reference point satisfies: 30°≤A≤90°. In this way, through at least two indoor light sources, the light source on the user's face can be effectively directed from at least two different directions, and there is a certain angle between the two directions, so as to ensure that the user's face will not have light and shadow caused by the angle of the light source, thereby ensuring that the makeup plan is accurately and quickly generated.

[0093] In this embodiment, it can be understood that the angle A between the lines connecting the two brightly lit indoor light sources and the reference point should not be too large or too small. If the angle A is too large, it may easily cause the user's face to appear shadows or reflections under the illumination of the two brightly lit indoor light sources (for example, when the angle A is greater than 90°, it may cause the user's face to appear shadows or reflections). If the angle A is too small, it may easily cause the user's face to appear shadows under the illumination of the two brightly lit indoor light sources (for example, when the angle A is less than 30°, the illumination directions of the two brightly lit light sources are similar, which may cause the user's face to appear shadows due to the obstruction of the nose or brow bone).

[0094] Optionally, the step S3 specifically includes:

[0095] Generate concealer solution: Step S3-1-1: Read the user's facial data, and generate a basic facial model of the user according to the identified facial contour, eye contour, lip contour and nose contour;

[0096] Step S3-1-2: Identify the image color parameters of all areas except the facial contour, eye contour, lip contour and nose contour in the user's facial data, identify the normal skin color area and the abnormal skin color area according to the image color parameters, and divide all the abnormal areas into dark circle areas and common abnormal areas according to the minimum distance between each abnormal skin color area and the eye contour, wherein the dark circle area is an abnormal area whose minimum distance with the eye is less than or equal to a first threshold, and the common abnormal area is an abnormal area whose minimum distance with the eye is greater than a second threshold;

[0097] Step S3-1-3: Determine the total amount range of cosmetics required for the concealer scheme based on the planar size and depth information of the dark circle area and the common abnormal area, determine the color number range of the cosmetics required for the concealer scheme based on the color parameters of the dark circle area and the common abnormal area, and determine the recommended cosmetic sequence for the concealer scheme based on the color number range.

[0098] In this embodiment, the user's facial contour, eye contour, lip contour and nose contour are first identified by identifying feature areas and feature points, and then the image color parameters of other areas in the acquired user's facial data are used to identify whether there are areas with abnormal skin color, so as to generate a concealer solution that is more in line with the user's actual facial condition. Among them, since the concealer method for the dark circle area is different from the concealer method for other color abnormal areas, the two are distinguished, so as to generate a concealer solution that is more in line with the user's actual facial condition.

[0099] Generate a base makeup solution: Step S3-2-1: Determine the total amount range of cosmetics required for the base makeup solution based on the plane size and depth information of the facial contour identified in Step S3-1-1, combine the color parameters of the normal skin color area identified in Step S3-1-2 and the recommended cosmetic sequence generated in Step S3-1-3, determine the color number range of the cosmetics required for the base makeup solution, and determine the recommended cosmetic sequence based on the color number range;

[0100] Step S3-2-2: according to the makeup intention of the user, delete the cosmetic categories that do not meet the makeup intention of the user in the recommended cosmetic sequence generated in step S3-2-1;

[0101] Step S3-2-3: According to the destination category and destination weather conditions in the destination information, the cosmetic categories that do not conform to the destination category and destination weather conditions in the recommended cosmetic sequence generated in step S3-2-2 are deleted to form a recommended cosmetic sequence for the base makeup solution.

[0102] In this embodiment, the color range of the cosmetics in the foundation solution is determined based on the color parameters of the normal skin color area and the color range of the cosmetics in the concealer solution. This ensures that the foundation solution can not only be adapted to the user's actual normal skin color, but also avoid conflicts with the concealer solution, thereby ensuring that the foundation solution can also be well adapted to the user.

[0103] At the same time, the foundation plan also combines the destination category (for example, indoor environment and outdoor environment) and destination weather conditions (for example, rainy days or sunny days) in the destination information, and deletes the cosmetics categories that are not suitable for a certain destination category or weather conditions, thereby making the foundation more environmentally adaptable and ensuring the stability of the makeup effect.

[0104] Generate makeup scheme: Step S3-3-1: Determine the total amount range of cosmetics required for the base makeup scheme according to the plane size and depth information of the facial contour identified in step S3-1-1, determine the color number range of cosmetics required for the makeup scheme according to the recommended cosmetic sequence of the base makeup scheme generated in S3-2-3, and recommend a cosmetic sequence based on the color number range;

[0105] Step S3-3-2: according to the makeup intention of the user, delete the cosmetic categories that do not meet the makeup intention of the user in the recommended cosmetic sequence generated in step S3-3-1;

[0106] Step S3-3-3: According to the destination information, the cosmetic categories that do not conform to the destination category, destination temperature and humidity, and destination weather conditions are deleted from the recommended cosmetic sequence generated in step S3-3-2 to form a recommended cosmetic sequence for the makeup plan.

[0107] In this embodiment, similarly, the color range of the cosmetics in the makeup scheme is determined based on the color range of the cosmetics recommended by the base makeup scheme, and then screened according to the user's makeup intention, thereby ensuring that not only the makeup scheme can be adapted to the user's base makeup scheme, but also that the makeup scheme does not conflict with customer needs.

[0108] At the same time, the makeup plan also combines the destination category, destination temperature and humidity, and destination weather conditions in the destination information, and deletes the corresponding cosmetic categories that are not suitable for a certain destination category or weather conditions, so that the base makeup is more adaptable to the environment and thus ensures the stability of the makeup effect.

[0109] Generate a makeup touch-up plan: Step S3-4-1: Determine the color range of the cosmetics required for the makeup touch-up plan based on the recommended cosmetics sequence of the makeup plan generated in S3-3-3, and recommend a cosmetics sequence based on the color range;

[0110] Step S3-4-2: Determine the first makeup touch-up time according to the travel route information;

[0111] Step S3-4-3: Determine the second makeup touch-up time based on the travel time and destination information.

[0112] In this embodiment, the travel path information can be used to determine whether the first makeup touch-up time exists or its specific time point. For example, when the travel path is a walking path, makeup touch-ups may be required after a certain period of time due to the influence of external air flow, dust, weather, etc., that is, the first makeup touch-up time can be determined as a certain time point or time range. When the travel path is a vehicle path, no makeup touch-up is required during the entire travel path, and the first makeup touch-up time does not exist or there is no specific makeup touch-up time point.

[0113] Similarly, based on the travel time and destination information, it is possible to determine whether a second makeup touch-up time exists or its specific time point or time period.

[0114] In this way, the stability of the makeup can be effectively guaranteed.

[0115] In this embodiment, it can be understood that the makeup scheme of the present application does not directly limit a certain fixed makeup method or certain cosmetics, but is generated by using artificial intelligence combined with manual data annotation or artificial intelligence autonomous learning, and each final generated scheme contains optional steps and necessary steps. Similarly, the cosmetics in the makeup scheme are not divided by their brand or series, but by their color number range. Each cosmetic has a corresponding unique and determined color number range. In this way, the recommended sequence of cosmetics formed according to the color number range can better adapt to the different needs of different users.

[0116] Optionally, the step S3-1-2 further includes:

[0117] Step S3-1-2-1: Compare the chromatogram of the image of the common abnormal area with the chromatogram of the image containing acne in the database, and generate a comparison score according to the Manhattan distance between the chromatograms of the corresponding blocks of the two. When the comparison score is less than or equal to the third threshold, the corresponding common abnormal area is identified as a general abnormal area; when the comparison score is greater than the fourth threshold, the corresponding common abnormal area is identified as acne;

[0118] Step S3-1-2-2: Generate a corresponding first concealer solution based on the difference between the color parameters of the common abnormal area and the color parameters of the normal skin color area; generate a corresponding second concealer solution based on the difference between the color parameters of the acne area and the color parameters of the normal skin color area.

[0119] In this embodiment, in the color learning stage, the color spectrum of the acne can be extracted from the image containing the acne in the database. In the comparison stage, the color spectrum can be extracted from the target image (i.e., the image of the normal abnormal area), and the Manhattan distance between the color spectrums is compared, that is, the sum of the absolute values ​​of each color spectrum element. Correspondingly, a value representing the difference within a certain range (e.g., 0-1000) will be generated, and the lower end point of the range indicates that there is no similarity between the two color spectra, and the upper end point of the range indicates that the two color spectra are completely consistent.

[0120] In this way, acne areas and general abnormal areas (for example, local birthmarks) can be identified accurately and quickly accordingly, so that a first concealer solution and a second concealer solution that meet the actual facial condition of the user can be effectively generated.

[0121] Optionally, the makeup matching method based on home Internet of Things and embodied intelligent body may also include: Step S0: establishing a cosmetics database, which includes several matching sequences of each type of cosmetics with temperature, humidity, weather conditions and initial application time, and each matching sequence records the stable duration range value of the corresponding category of cosmetics.

[0122] In this way, the stable duration range value of each type of cosmetics can be obtained, which is the stable maintenance time under the corresponding temperature, humidity, weather conditions and initial application time conditions after applying the cosmetics of standard thickness on the simulated skin (i.e., the stable duration without changing the color range). In this way, the user can be recommended cosmetics that are more suitable for the actual situation of a destination, and the stability and sustainability of the makeup can be effectively increased.

[0123] Optionally, in step S3, the generation of the touch-up makeup plan may specifically include: reading the cosmetics database generated in step S0, and determining the touch-up makeup plan according to the makeup plan, the temperature and humidity of the destination in the user's destination information, the weather conditions of the destination, and the travel route information. In this way, through the above-mentioned cosmetics database, a touch-up makeup plan that is closer to actual needs can be determined according to the makeup plan, the temperature and humidity of the destination in the user's destination information, the weather conditions of the destination, and the travel route information, thereby ensuring the stability and sustainability of the makeup.

[0124] Optionally, the step S4 may specifically include: step S4-1: generating and displaying a corresponding bare face image according to the user's facial image; step S4-2: marking the facial contour, abnormal facial color area, eye contour, lip contour and nose contour in the bare face image, wherein the facial contour is always bright; step S4-3: first making the brightness of the abnormal facial color area greater than the brightness of the eye contour, lip contour and nose contour, and synchronously displaying the concealer solution; then adjusting the bare face image as a whole to the same brightness, and displaying the base makeup solution at the same time; finally displaying the makeup solution.

[0125] In this way, through the step S4 set in this way, it can be very reliable to fit the user's makeup sequence, and can provide the user with a real-time makeup plan reference to improve the user's makeup efficiency and convenience.

[0126] Optionally, the step S5 may specifically include: step S5-1: converting the generated makeup touch-up plan into text or picture format; step S5-2: pushing it to the user's smart mobile device in a scheduled manner.

[0127] In this way, the makeup touch-up solution can promptly and accurately remind the user when to touch up the makeup.

[0128] According to the second aspect of the present application, a makeup matching system based on a home Internet of Things and an embodied intelligent body is also provided, which is used to execute the makeup matching method based on a home Internet of Things and an embodied intelligent body as described in any technical solution in the first aspect of the present application, including a home Internet of Things and an embodied intelligent body; wherein,

[0129] Home IoT is used to obtain indoor environmental parameters and adjust indoor lighting conditions;

[0130] The embodied intelligent body is used to obtain the user's facial data, the user's makeup intention, destination information and travel route information; and is used to generate and display bare face pictures, concealer plans, foundation plans, and makeup plans; and is used to generate and push touch-up plans.

[0131] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A makeup matching method based on home IoT and embodied intelligence. It is characterized in that The steps include: Step S1: obtaining indoor environment parameters through the home IoT, and obtaining the user's facial data, the user's makeup intention, destination information and travel path information through the embodied intelligent body; wherein the indoor environment parameters include: indoor light source position; the user's facial data includes: facial image, facial contour, facial color abnormal area, eye contour, lip contour and nose contour; makeup intention includes makeup type; destination information includes destination category, destination temperature and humidity, destination weather conditions; travel path information includes travel distance, travel time, and travel transportation; Step S2: the home IoT adjusts its lighting conditions according to the indoor environment parameters so that the lighting range of the indoor light source at the position of the embodied intelligent body can cover the user's face, so that the user can perform makeup modification; Step S3: Generate a concealer solution for the user according to the user's facial data and the user's makeup intention; generate a base makeup solution for the user according to the concealer solution, the user's facial data, the user's makeup intention and the destination information; generate a color makeup solution for the user according to the base makeup solution, the user's facial data, the user's makeup intention and the destination information; generate a touch-up makeup solution for the user according to the color makeup solution, the user's destination information and the travel route information; Step S4: Generate and display a corresponding bare face picture according to the user's facial data, and at the same time, the embodied intelligent body displays the concealer solution, base makeup solution and makeup solution in sequence; Step S5: Push the makeup touch-up plan to the user's smart mobile device.

2. The makeup matching method based on home IoT and embodied intelligent body according to claim 1, It is characterized in that The step S2 specifically includes: Obtaining the position and shape of the embodied intelligent body, as well as the position and display direction of the display screen on the embodied intelligent body, and setting a reference point, where the reference point is set to a simulated point located directly in front of the middle of the display screen and having a simulated distance from the display screen; According to the position and shape of the embodied intelligent body, the position and display direction of the display screen on the embodied intelligent body, and the reference point, several indoor light sources that can be illuminated are screened out, wherein the position of the indoor light source that can be illuminated is collinear with a point on the edge of the embodied intelligent body and the reference point, and the embodied intelligent body is located between the indoor light source and the reference point.

3. The makeup matching method based on home IoT and embodied intelligent body according to claim 2, It is characterized in that There are at least two indoor light sources that can be illuminated, and an angle A between the two indoor light sources that can be illuminated and the reference point satisfies: 30°≤A≤90°.

4. The makeup matching method based on home IoT and embodied intelligent body according to claim 1, It is characterized in that The step S3 specifically includes: Generate concealer solution: Step S3-1-1: Read the user's facial data and generate a basic facial model of the user based on the identified facial contour, eye contour, lip contour and nose contour; Step S3-1-2: Identify the image color parameters of all areas except the facial contour, eye contour, lip contour and nose contour in the user's facial data, identify the normal skin color area and the abnormal skin color area according to the image color parameters, and divide all the abnormal areas into dark circle areas and common abnormal areas according to the minimum distance between each abnormal skin color area and the eye contour, wherein the dark circle area is an abnormal area whose minimum distance with the eye is less than or equal to a first threshold, and the common abnormal area is an abnormal area whose minimum distance with the eye is greater than a second threshold; Step S3-1-3: Determine the total amount range of cosmetics required for the concealer scheme according to the plane size and depth information of the dark circle area and the common abnormal area, determine the color number range of the cosmetics required for the concealer scheme according to the color parameters of the dark circle area and the common abnormal area, and determine the recommended cosmetics sequence for the concealer scheme according to the color number range; Generate makeup solution: Step S3-2-1: Determine the total amount range of cosmetics required for the base makeup solution based on the plane size and depth information of the facial contour identified in step S3-1-1, determine the color number range of the cosmetics required for the base makeup solution in combination with the color parameters of the normal skin color area identified in step S3-1-2 and the recommended cosmetics sequence generated in step S3-1-3, and determine the recommended cosmetics sequence based on the color number range; Step S3-2-2: according to the makeup intention of the user, delete the cosmetic categories that do not meet the makeup intention of the user in the recommended cosmetic sequence generated in step S3-2-1; Step S3-2-3: According to the destination category and the destination weather conditions in the destination information, the cosmetic categories that do not conform to the destination category and the destination weather conditions in the recommended cosmetic sequence generated in step S3-2-2 are deleted to form a recommended cosmetic sequence for the base makeup solution; Generate makeup plan: Step S3-3-1: Determine the total amount range of cosmetics required for the base makeup solution according to the plane size and depth information of the facial contour identified in step S3-1-1, determine the color number range of cosmetics required for the makeup solution according to the recommended cosmetic sequence of the base makeup solution generated in step S3-2-3, and recommend a cosmetic sequence based on the color number range; Step S3-3-2: according to the makeup intention of the user, delete the cosmetic categories that do not meet the makeup intention of the user in the recommended cosmetic sequence generated in step S3-3-1; Step S3-3-3: According to the destination information, the cosmetics categories that do not conform to the destination category, the destination temperature and humidity, and the destination weather conditions are deleted from the recommended cosmetics sequence generated in step S3-3-2 to form a recommended cosmetics sequence for the makeup plan; Generate makeup solution: Step S3-4-1: Determine the color range of the cosmetics required for the makeup solution according to the recommended cosmetics sequence of the makeup solution generated in S3-3-3, and recommend a cosmetics sequence according to the color range; Step S3-4-2: Determine the first makeup touch-up time according to the travel route information; Step S3-4-3: Determine the second makeup touch-up time based on the travel time and destination information.

5. The makeup matching method based on home IoT and embodied intelligent body according to claim 4, It is characterized in that The step S3-1-2 further includes: Step S3-1-2-1: Compare the chromatogram of the image of the common abnormal area with the chromatogram of the image containing acne in the database, and generate a comparison score according to the Manhattan distance between the chromatograms of the corresponding blocks of the two. When the comparison score is less than or equal to the third threshold, the corresponding common abnormal area is identified as a general abnormal area; when the comparison score is greater than the fourth threshold, the corresponding common abnormal area is identified as acne; Step S3-1-2-2: Generate a corresponding first concealer solution based on the difference between the color parameters of the common abnormal area and the color parameters of the normal skin color area; generate a corresponding second concealer solution based on the difference between the color parameters of the acne area and the color parameters of the normal skin color area.

6. The makeup matching method based on home IoT and embodied intelligent body according to claim 1, It is characterized in that The makeup matching method based on home IoT and embodied intelligent body also includes: Step S0: Establish a cosmetics database, which includes a number of matching sequences of each type of cosmetics with temperature, humidity, weather conditions and initial application time, and each matching sequence records the stable duration range value of the corresponding type of cosmetics.

7. The makeup matching method based on home IoT and embodied intelligent body according to claim 6, It is characterized in that In step S3, the makeup touch-up plan is generated specifically as follows: The cosmetics database generated in step S0 is read, and a makeup touch-up plan is determined according to the makeup plan, the destination temperature and humidity in the user's destination information, the destination weather conditions, and the travel route information.

8. The makeup matching method based on home IoT and embodied intelligent body according to claim 1, It is characterized in that The step S4 specifically includes: Step S4-1: Generate and display a corresponding bare face image according to the user's facial image; Step S4-2: marking the facial contour, the facial color abnormality area, the eye contour, the lip contour and the nose contour in the plain face image, wherein the facial contour is always bright; Step S4-3: First, make the brightness of the abnormal facial color area greater than the brightness of the eye contour, lip contour and nose contour, and display the concealer solution simultaneously; then adjust the overall bare face image to the same brightness, and display the base makeup solution at the same time; finally, display the makeup solution.

9. The makeup matching method based on home IoT and embodied intelligent body according to claim 1, It is characterized in that The step S5 specifically includes: Step S5-1: converting the generated makeup solution into text or picture format; Step S5-2: Push to the user's smart mobile device in a scheduled manner.

10. A makeup matching system based on home IoT and embodied intelligence. It is characterized in that Used to execute the makeup matching method based on home Internet of Things and embodied intelligent body according to any one of claims 1-9, including home Internet of Things and embodied intelligent body; wherein, Home IoT is used to obtain indoor environmental parameters and adjust indoor lighting conditions; The embodied intelligent body is used to obtain the user's facial data, the user's makeup intention, destination information and travel route information; and is used to generate and display bare face pictures, concealer plans, foundation plans, and makeup plans; and is used to generate and push touch-up plans.

Citation Information

Patent Citations

  • Cosmetic simulation control method and device, computer equipment and storage medium

    CN109685713A

  • Information pushing method and device based on Internet of Things operating system, and storage medium

    CN111064766A

  • Makeup matching method assisted by combining regional environment characteristics

    CN117473110A

  • Lipstick color matching selection analysis system based on Internet of Things

    CN118132842A

  • Make-up assistance method and apparatus and smart mirror

    US20220211163A1

Cited By

  • Robot control method and device, dexterous hand, robot, storage medium and program product

    CN122378742A

  • Robot control method, device, dexterous hand, robot, storage medium and program product

    CN122378742B

  • Robot control method and device, dexterous hand, robot, storage medium and program product

    CN122378746A