Makeup aids, devices, electronic equipment and vehicles

Abstract

This invention provides a makeup assistance method, device, electronic device, and vehicle, relating to the field of vehicle technology. First, it acquires a first facial image of the user and the types of cosmetics available in the vehicle cabin. Then, it acquires the first makeup style input by the user and determines the types of cosmetics required for that style. If the types of cosmetics available in the cabin do not meet the requirements for the first makeup style, a second makeup style is determined. Finally, a second facial image is generated based on the second makeup style and displayed to the user. In response to the user's selection of the second makeup style, a makeup tutorial corresponding to the second style and the types of cosmetics required for that tutorial are pushed to the user. This application selects the optimal makeup scheme and cosmetics based on the user's makeup needs and a limited selection of cosmetics, enabling the user to achieve the best makeup look under suitable conditions, greatly improving the user experience.

Description

Technical Field

[0001] This invention relates to the field of vehicle technology, and more particularly to a makeup assistance method, device, electronic device, and vehicle. Background Technology

[0002] Currently, when users apply makeup in their vehicles, the limited space restricts the variety and quantity of cosmetics they can carry. Furthermore, users cannot ascertain whether the available cosmetics meet their specific needs when choosing different makeup looks. Therefore, determining the optimal makeup solution and cosmetics selection based on user preferences and the limited availability is a pressing issue that needs to be addressed.

[0003] The relevant technologies do not provide a technical solution for selecting the best makeup scheme and types of cosmetics based on the user's makeup needs and the limited variety of cosmetics available. Summary of the Invention

[0004] This invention provides a makeup assistance method, device, electronic device, and vehicle, aiming to solve or partially solve the problems existing in the prior art.

[0005] To solve the above-mentioned technical problems, the present invention is implemented as follows:

[0006] In a first aspect, embodiments of the present invention provide a cosmetic assistance method, the method comprising:

[0007] Obtain the user's initial facial image and the types of cosmetics in the vehicle cabin;

[0008] Obtain the user's first makeup type, where the first makeup type is the user's ideal makeup type;

[0009] The types of cosmetics required for the first makeup type are determined. If the types of cosmetics in the cabin do not meet the requirements for the first makeup type, a second makeup type is determined based on the types of cosmetics in the cabin, the first makeup type, and the first facial image. The second makeup type is the makeup type recommended by the vehicle system.

[0010] A second facial image is generated based on the second makeup type and displayed to the user. The second facial image is a simulated facial image of the user after makeup.

[0011] In response to the user selecting a second makeup style, the system will push a makeup tutorial corresponding to the second makeup style and the types of cosmetics required for the tutorial to the user.

[0012] Optionally, the step of obtaining the user's first facial image includes:

[0013] Acquire multi-view facial images of the user;

[0014] Based on multi-view facial images, determine the user's multi-dimensional facial feature information and facial key point information;

[0015] Based on multi-dimensional facial feature information and facial key point information, multi-view facial images are integrated to generate a first facial image.

[0016] Optionally, the step of determining the second makeup type based on the types of cosmetics in the cabin, the first makeup type, and the first facial image includes:

[0017] Multiple candidate makeup types were determined based on the first facial image;

[0018] Calculate the matching score for each candidate makeup type based on the types of cosmetics in the cabin and the first makeup type;

[0019] The candidate makeup type with the highest matching score is selected as the second makeup type.

[0020] Optionally, the step of calculating the matching score for each candidate makeup type based on the types of cosmetics in the cabin and the first makeup type includes:

[0021] The first matching score of the candidate makeup type is calculated based on the degree of matching between the types of cosmetics required for the candidate makeup type and the types of cosmetics in the cabin.

[0022] Calculate the second matching score for the candidate makeup type based on the degree of matching between the candidate makeup type and the first makeup type;

[0023] The matching score for the candidate makeup type is calculated based on the first matching score and the second matching score.

[0024] Optionally, the method further includes:

[0025] Get the scene mode and weather mode;

[0026] The third matching score of the candidate makeup type is calculated based on the degree of matching between the candidate makeup type and the scene mode.

[0027] The fourth matching score for each candidate makeup type is calculated based on the degree of matching between the candidate makeup type and the weather pattern.

[0028] The matching score for the candidate makeup type is calculated based on the first matching score, the second matching score, the third matching score, and the fourth matching score.

[0029] Optionally, the steps of generating a second facial image based on a second makeup type and displaying the second facial image to the user include:

[0030] The makeup corresponding to the second makeup type is superimposed on the first facial image to generate a second facial image, which is then displayed to the user through a display device.

[0031] Optionally, the steps of pushing a makeup tutorial corresponding to the second makeup style and the types of cosmetics required for the tutorial to the user include:

[0032] The makeup tutorial is divided into multiple sub-steps, and the types of cosmetics required for each sub-step are determined.

[0033] The system pushes information to users in a step-by-step manner, including each sub-step and the types of cosmetics required for that step.

[0034] Secondly, embodiments of the present invention provide a cosmetic aid device, the device comprising:

[0035] The acquisition module is used to acquire the user's input of the destination location information and makeup requirement level;

[0036] The candidate path determination module is used to determine multiple candidate paths based on the destination location information and the current location information;

[0037] The scoring module is used to determine the score of the makeup segment in each candidate path based on the makeup requirement level;

[0038] The filtering module is used to determine the target route based on the road segment rating and road condition information;

[0039] The reminder module is used for vehicle navigation based on the target route and to issue a makeup reminder to the user when the vehicle reaches the makeup section of the target route.

[0040] Optionally, the scoring module includes:

[0041] The length determination submodule is used to determine the length of the makeup segment in each candidate path;

[0042] The rating coefficient determination submodule is used to determine the rating coefficient corresponding to the makeup requirement level;

[0043] The calculation submodule is used to determine the score of the makeup section in each candidate path based on the length of the makeup section and the scoring coefficient corresponding to the makeup requirement level.

[0044] A third aspect of this invention provides an electronic device, which includes:

[0045] At least one processor; and a memory communicatively connected to the at least one processor; wherein,

[0046] The memory stores instructions that can be executed by at least one processor, which enables the at least one processor to perform the method steps proposed in the first aspect of the present invention.

[0047] A fourth aspect of the present invention provides a vehicle, the vehicle including a processor, the processor being used to execute the method steps as provided in the first aspect of the present invention.

[0048] The embodiments of this invention include the following advantages: First, a first facial image of the user and the types of cosmetics available in the vehicle cabin are acquired. Then, a first makeup type input by the user is acquired, and the types of cosmetics required for the first makeup type are determined. If the types of cosmetics available in the vehicle cabin do not meet the requirements of the first makeup type, a second makeup type is determined based on the types of cosmetics available in the vehicle cabin, the first makeup type, and the first facial image. Finally, a second facial image is generated based on the second makeup type and displayed to the user. In response to the user's selection of the second makeup type, a makeup tutorial corresponding to the second makeup type and the types of cosmetics required for the tutorial are pushed to the user. This application selects the best makeup solution and types of cosmetics based on the user's makeup needs and the limited types of cosmetics available, helping the user achieve the optimal makeup look under relatively limited conditions, greatly improving the user experience.

[0049] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Attached Figure Description

[0050] Figure 1 This is a flowchart of the steps of a makeup assistance method according to an embodiment of the present invention;

[0051] Figure 2 This is a schematic diagram of a makeup aid device according to an embodiment of the present invention. Detailed Implementation

[0052] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0053] This invention provides a makeup assistance method applied to a vehicle's infotainment system. (See attached image.) Figure 1, Figure 1 This application illustrates a flowchart of a makeup assistance method according to an embodiment of the present application. The method includes:

[0054] S101: Obtain the user's first facial image and the types of cosmetics in the cabin.

[0055] In this embodiment, the first facial image refers to a frontal facial image captured when the user first enters the vehicle, without makeup. The types of cosmetics in the vehicle cabin refer to cosmetics commonly used by the user and placed in designated locations within the cabin. The specific types are selected according to the user's preferences, and this application does not limit this selection. The specific steps for obtaining the user's first facial image can be as follows:

[0056] S101-1: Acquire multi-view facial images of the user.

[0057] In this embodiment, during the process of acquiring multi-view facial images of the user, multiple cameras set in different positions in the cockpit can be used to acquire images, thereby obtaining facial image data of the user from different perspectives, i.e., multi-view facial images of the user to be identified.

[0058] As an example, this application can capture facial images of the passenger in the front passenger seat from four directions: front, left, bottom, and right, using cameras positioned at different locations within the cabin. While the original purpose of image capture equipment in a vehicle's cabin is for driver monitoring systems, thus monitoring the driver's behavior during driving, in this application, it is used as an image capture device for the user to be identified. Multiple cameras are used to capture images of the user from different perspectives, providing valuable data support for subsequent makeup type selection.

[0059] Continuing with the above embodiment, the basic application performs an image acquisition at t=0s, obtaining four images from four different perspectives: front, left, bottom, and right. This results in a set of multi-view images containing four facial images from these four perspectives. Similarly, at t=3s, another image acquisition is performed, resulting in another set of multi-view facial images consisting of four images from the same four perspectives. Through multiple acquisitions, more comprehensive user facial feature information and key facial point information can be obtained, thus avoiding missing user information and making the subsequent makeup recognition results more accurate.

[0060] S101-2: Determine the user's multidimensional facial feature information and facial key points based on multi-view facial images.

[0061] In this embodiment, after acquiring multiple facial images from different perspectives, facial key points and multidimensional facial feature information are acquired from each facial image. Multidimensional facial feature information refers to feature information of different dimensions such as the user's skin color, hairstyle, and hair color, which are used to evaluate the user's facial features. Facial key points refer to the points used to construct the user's facial image. Facial key points can reflect the facial features of various parts, including points of eyebrows, eyes, nose, mouth, and facial contour areas. Different point positions and numbers are set according to the accuracy.

[0062] S101-3: Based on multi-dimensional facial feature information and facial key point information, integrate multi-view facial images to generate a first facial image.

[0063] In this embodiment, since complete frontal facial information of the user is required, it is necessary to integrate facial key points and multi-dimensional facial feature information from facial images from different perspectives. That is, a complete and highly accurate user image is constructed from images from multiple perspectives that may be incomplete, and the user's skin color, hairstyle, hair color and other facial feature information of different dimensions are marked in the image.

[0064] The identification of the types of cosmetics in the cabin can also be achieved using the cameras installed in different locations within the cabin.

[0065] S102: Obtain the first makeup type input by the user, where the first makeup type is the user's ideal makeup type.

[0066] In this implementation, the user can input the makeup type they need at the current moment through the vehicle's HUT.

[0067] As an example, the user can input either an anime-style makeup look or a retro-style makeup look as their first makeup type.

[0068] S103: Determine the types of cosmetics required for the first makeup type. If the types of cosmetics in the cabin do not meet the requirements for the first makeup type, determine the second makeup type based on the types of cosmetics in the cabin, the first makeup type, and the first facial image.

[0069] In this embodiment, after obtaining the user's input of the first makeup type, an evaluation is performed based on the types of cosmetics required for the first makeup type and the types of cosmetics currently available in the vehicle cabin. The evaluation assesses whether the existing cosmetics in the cabin can support the user in applying the first makeup type. If the cosmetics in the cabin meet the requirements of the first makeup type, a makeup tutorial corresponding to the first makeup type can be pushed to the user. If the existing cosmetics in the cabin cannot support the user in applying the first makeup type, then a second makeup type needs to be determined based on the existing cosmetics in the cabin, the user's makeup requirements, and the first facial image. The specific steps include:

[0070] S103-1: Determine multiple candidate makeup types based on the first facial image.

[0071] In this embodiment, since the first facial image contains the user's frontal face image and multi-dimensional facial feature information, various candidate makeup types suitable for the user can be determined based on the multi-dimensional facial feature information, thereby generating a candidate makeup type list.

[0072] As an example, a user's facial model can be constructed based on their hair color, hairstyle, and facial features generated from key facial points. Then, a search is performed in a preset database, and makeup styles that match the user's facial model are recommended as candidate makeup styles. For example, if the system determines that the user's current suitable makeup style is retro makeup, then retro work makeup, retro light makeup, etc., can be recommended as candidate makeup styles to the user.

[0073] S103-2: Calculate the matching score for each candidate makeup type based on the types of cosmetics in the cabin and the first makeup type.

[0074] In this embodiment, the candidate makeup type is simply a makeup type recommended by the system based on the user's current facial feature information. Due to limitations in the types of cosmetics available, it is also necessary to consider the types of cosmetics in the vehicle cabin and the user's own makeup needs to determine the matching score of the candidate makeup type. The specific steps can be as follows:

[0075] S103-2-1: Calculate the first matching score of the candidate makeup type based on the degree of matching between the types of cosmetics required for the candidate makeup type and the types of cosmetics in the cabin.

[0076] In this embodiment, for any candidate makeup type, the first matching score of the selected makeup type is determined by the degree of matching between the types of cosmetics required and the types of cosmetics in the cabin.

[0077] As an example, for candidate makeup type A, the cosmetics required to complete candidate makeup type A include a, b, c, d, and e, a total of 5 types of cosmetics. The cosmetics currently available in the cabin are a, b, c, d, f, and g. Therefore, the matching degree between the cosmetics required to complete candidate makeup type A and the cosmetics currently available in the cabin is 80%, and the corresponding first matching score is 80 points.

[0078] S103-2-2: Calculate the second matching score of the candidate makeup type based on the degree of matching between the candidate makeup type and the first makeup type.

[0079] In this embodiment, the first makeup type entered by the user reflects the user's current favorite makeup type. Therefore, it is necessary to determine the second matching score of the selected makeup type by the degree of matching between the candidate makeup type and the first makeup type.

[0080] As an example, if the user enters "light makeup" as the first makeup type, and the candidate makeup type is "retro light makeup", it indicates a high degree of matching with the user, and the corresponding second matching score is 70 points.

[0081] S103-2-3: Calculate the matching score of the candidate makeup type based on the first matching score and the second matching score.

[0082] In the implementation, for any candidate makeup type, after determining its corresponding first matching score and second matching score, the final matching score of the candidate makeup type can be calculated based on the preset weighting coefficient corresponding to each score.

[0083] As an example, if the first matching score of candidate makeup type A is 80 points and the second matching score is 70 points, and since the user feels that their opinion is more important, the weighting coefficient corresponding to the second matching score is higher, which is 0.6, while the weighting coefficient corresponding to the first matching score is 0.4, then the final matching score of candidate makeup type A can be calculated to be 74.

[0084] S103-2-4: The candidate makeup type with the highest matching score is determined as the second makeup type.

[0085] In this implementation, after obtaining the matching scores of all candidate makeup types, the makeup type with the highest final matching score is selected and designated as the second makeup type. This second makeup type is then presented to the user as the selection result, allowing the user to make a choice.

[0086] Besides using users' makeup preferences and the types of cosmetics as filtering criteria to determine the final makeup look sent to them, another method is to combine weather factors and the user's usage scenario. The specific steps are as follows:

[0087] Get the scene mode and weather mode;

[0088] The third matching score of the candidate makeup type is calculated based on the degree of matching between the candidate makeup type and the scene mode.

[0089] The fourth matching score for each candidate makeup type is calculated based on the degree of matching between the candidate makeup type and the weather pattern.

[0090] The matching score for the candidate makeup type is calculated based on the first matching score, the second matching score, the third matching score, and the fourth matching score.

[0091] In this embodiment, for any candidate makeup type, after determining its corresponding first matching score and second matching score, its third matching score and fourth matching score can also be calculated based on its matching degree with the user's usage scenario and the matching degree with the weather.

[0092] For example, if the user inputs a scenario mode such as a formal and solemn occasion like a party, and candidate makeup type A is a two-dimensional style makeup type, then candidate makeup type A has a low degree of matching with the usage scenario, so the third matching score is low. If the user inputs a weather mode of hot weather, and candidate makeup type A is heavy makeup, then because the user will sweat a lot in hot weather, heavy makeup may smudge and cause an embarrassing situation. Therefore, candidate makeup type A has a low degree of matching with the weather mode, so the fourth matching score is low. After determining the first, second, third, and fourth matching scores of candidate makeup type A, the final matching score of the candidate makeup type can be calculated according to the preset weighting coefficient corresponding to each score.

[0093] S104: Generate a second facial image based on the second makeup type and display the second facial image to the user.

[0094] In this embodiment, after filtering out the second makeup type through multiple conditions, in order to help users better judge whether the second makeup type is suitable, a simulated facial image of the user after makeup can be generated and displayed to the user, so that the user can intuitively understand their makeup after makeup, and thus the user can choose whether to apply makeup according to the second makeup type based on their satisfaction level.

[0095] The steps for generating a second facial image based on the second makeup type can be as follows:

[0096] S104-1: Overlay the makeup corresponding to the second makeup type onto the first facial image to generate a second facial image, and display the second facial image to the user through a display device.

[0097] In this embodiment, the second makeup type is superimposed on the user's first facial image and displayed on a display device. The display device in this embodiment is a display formed by the mirror surface of a sun visor makeup mirror. When the user is satisfied with the makeup effect of the second makeup type, they can select the second makeup type through the sun visor makeup mirror. The user's selection of the second makeup type can be performed via touch operation, pressing a physical button, voice control, or shaking the electronic device. Touch operation can include touch click, touch long press, touch swipe, multi-touch, etc. This application does not limit the scope of the operation.

[0098] S105: In response to the user's selection of a second makeup style, push the makeup tutorial corresponding to the second makeup style and the types of cosmetics required for the makeup tutorial to the user.

[0099] In this embodiment, after receiving the user's instruction to select a second makeup style, the corresponding makeup tutorial and the types of cosmetics required for that tutorial need to be pushed to the user. However, existing makeup tutorial pushes often send the complete tutorial directly to the user. Since users' makeup speed often cannot keep up with the tutorial's pace, they need to pause multiple times and repeatedly adjust the progress bar to complete the makeup process, making the entire process cumbersome. Therefore, a step-by-step push method can be adopted. The steps for pushing the makeup tutorial and the required cosmetics for the second makeup style to the user in stages include:

[0100] S105-1: Divide the makeup tutorial into multiple sub-steps and determine the types of cosmetics required for each sub-step;

[0101] S105-2: Push each sub-step and the types of cosmetics required for each sub-step to the user in a step-by-step manner.

[0102] In the embodiments of S105-1 to S105-2, as an example, the makeup tutorial corresponding to the second makeup type is divided into four sub-steps: "A", "B", "C", and "D". Then, the video content corresponding to sub-step "A" and the types of cosmetics required for sub-step "A" are pushed and displayed through the mirror of the sun visor makeup mirror and played in a loop. After the user completes sub-step "A", they click to confirm via touch operation. Then, the video content corresponding to sub-step "B" and the types of cosmetics required for sub-step "B" are pushed and displayed through the mirror of the sun visor makeup mirror, and so on, until the complete makeup tutorial is completed.

[0103] This invention also provides a makeup aid device, see reference. Figure 2The diagram shows a functional block diagram of a cosmetic auxiliary device according to the present invention, which may include the following modules:

[0104] The first acquisition module 201 is used to acquire the user's first facial image and the types of cosmetics in the vehicle cabin;

[0105] The second acquisition module 202 is used to acquire the first makeup type input by the user, wherein the first makeup type is the user's ideal makeup type;

[0106] The makeup determination module 203 is used to determine the types of cosmetics required for the first makeup type. If the types of cosmetics in the cabin do not meet the requirements of the first makeup type, a second makeup type is determined based on the types of cosmetics in the cabin, the first makeup type, and the first facial image. The second makeup type is the makeup type recommended by the vehicle system.

[0107] The makeup display module 204 is used to generate a second facial image based on the second makeup type and display the second facial image to the user, wherein the second facial image is a simulated facial image of the user after makeup.

[0108] The push module 205 is used to respond to the user's selection of a second makeup type by pushing the makeup tutorial corresponding to the second makeup type and the types of cosmetics required for the makeup tutorial to the user.

[0109] In one feasible implementation, the first acquisition module includes:

[0110] The acquisition submodule is used to acquire multi-view facial images of the user;

[0111] The determination submodule is used to determine the user's multidimensional facial feature information and facial key point information based on multi-view facial images;

[0112] The integration submodule is used to integrate multi-view facial images based on multi-dimensional facial feature information and facial key point information to generate a first facial image.

[0113] In one feasible implementation, the makeup determination module includes:

[0114] The candidate makeup determination submodule is used to determine multiple candidate makeup types based on the first facial image;

[0115] The calculation submodule is used to calculate the matching score of each candidate makeup type based on the types of cosmetics in the cabin and the first makeup type.

[0116] The filtering submodule is used to identify the candidate makeup type with the highest matching score as the second makeup type.

[0117] In one feasible implementation, the computation submodule includes:

[0118] The first calculation unit is used to calculate the first matching score of the candidate makeup type based on the degree of matching between the types of cosmetics required for the candidate makeup type and the types of cosmetics in the cabin.

[0119] The second calculation unit is used to calculate the second matching score of the candidate makeup type based on the degree of matching between the candidate makeup type and the first makeup type;

[0120] The first integration unit is used to calculate the matching score of the candidate makeup type based on the first matching score and the second matching score.

[0121] In one feasible implementation, the computation submodule further includes:

[0122] The acquisition unit is used to acquire scene mode and weather mode;

[0123] The third calculation unit is used to calculate the third matching score of the candidate makeup type based on the degree of matching between the candidate makeup type and the scene mode.

[0124] The fourth calculation unit is used to calculate the fourth matching score of the candidate makeup type based on the degree of matching between the candidate makeup type and the weather pattern.

[0125] The second integration unit is used to calculate the matching score of the candidate makeup type based on the first matching score, the second matching score, the third matching score, and the fourth matching score.

[0126] In one feasible implementation, the makeup display module includes:

[0127] The image processing submodule is used to overlay the makeup corresponding to the second makeup type onto the first facial image to generate a second facial image, and then display the second facial image to the user through a display device.

[0128] In one feasible implementation, the push module includes:

[0129] Sub-modules are used to divide a makeup tutorial into multiple sub-steps and determine the types of cosmetics required for each sub-step;

[0130] The step-by-step push module is used to push each sub-step and the required cosmetics types to the user in a step-by-step manner.

[0131] In yet another embodiment of the present invention, a vehicle is also provided, the vehicle including a processor, the processor being configured to implement the method as proposed in the first aspect of the embodiments of the present invention when executing.

[0132] Based on the same inventive concept, another embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus.

[0133] Memory, used to store computer programs;

[0134] The processor, when executing a program stored in memory, implements the cosmetic assistance method of the present invention.

[0135] The communication bus mentioned above can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the diagram, but this does not indicate that there is only one bus or one type of bus. The communication interface is used for communication between the aforementioned terminal and other devices. The memory can include Random Access Memory (RAM) or non-volatile memory, such as at least one disk storage device. Optionally, the memory can also be at least one storage system located remotely from the aforementioned processor.

[0136] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0137] In addition, to achieve the above objectives, embodiments of this application also propose a computer-readable storage medium storing a computer program that, when executed by a processor, implements the makeup assistance method of embodiments of this application.

[0138] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, embodiments of the present invention can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, embodiments of the present invention can take the form of computer program products implemented on one or more computer-usable vehicles (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0139] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A system that specifies functions in one or more boxes.

[0140] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including an instruction set implemented in a process. Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0141] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0142] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. "And / or" indicates that either one or both can be chosen. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.

[0143] The above provides a detailed description of the makeup assistance method, device, electronic device, and vehicle provided by the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A makeup aid method, characterized in that, The method, applied to an in-vehicle infotainment system, includes: Obtain the user's initial facial image and the types of cosmetics in the vehicle cabin; Obtain the first makeup type input by the user, wherein the first makeup type is the user's ideal makeup type; The types of cosmetics required for the first makeup type are determined. If the types of cosmetics in the vehicle cabin do not meet the requirements for the first makeup type, a second makeup type is determined based on the types of cosmetics in the vehicle cabin, the first makeup type, and the first facial image. The second makeup type is the makeup type recommended by the vehicle system. A second facial image is generated based on the second makeup type and displayed to the user, wherein the second facial image is a simulated facial image of the user after makeup. In response to the user's selection of the second makeup type, a makeup tutorial corresponding to the second makeup type and the types of cosmetics required for the makeup tutorial are pushed to the user; The step of determining the second makeup type based on the types of cosmetics in the vehicle cabin, the first makeup type, and the first facial image includes: Multiple candidate makeup types are determined based on the first facial image; Based on the types of cosmetics in the cabin and the first makeup type, calculate the matching score for each candidate makeup type; The candidate makeup type with the highest matching score is determined as the second makeup type; The step of calculating the matching score for each candidate makeup type based on the types of cosmetics in the vehicle cabin and the first makeup type includes: The first matching score of the candidate makeup type is calculated based on the degree of matching between the types of cosmetics required for the candidate makeup type and the types of cosmetics in the vehicle cabin. Calculate a second matching score for the candidate makeup type based on the degree of matching between the candidate makeup type and the first makeup type; The matching score of the candidate makeup type is calculated based on the first matching score and the second matching score.

2. The makeup assistance method according to claim 1, characterized in that, The steps to obtain a user's first facial image include: Acquire multi-view facial images of the user; Based on the multi-view facial images, determine the user's multi-dimensional facial feature information and facial key point information; Based on the multi-dimensional facial feature information and the facial key point information, the multi-view facial images are integrated to generate the first facial image.

3. The makeup assistance method according to claim 1, characterized in that, The method further includes: Get the scene mode and weather mode; Calculate the third matching score of the candidate makeup type based on the degree of matching between the candidate makeup type and the scene mode; Calculate a fourth matching score for the candidate makeup type based on the degree of matching between the candidate makeup type and the weather pattern; The matching score of the candidate makeup type is calculated based on the first matching score, the second matching score, the third matching score, and the fourth matching score.

4. The makeup assistance method according to claim 1, characterized in that, The steps of generating a second facial image based on the second makeup type and displaying the second facial image to the user include: The makeup corresponding to the second makeup type is superimposed on the first facial image to generate the second facial image, and the second facial image is displayed to the user through a display device.

5. The makeup assistance method according to claim 1, characterized in that, The steps of pushing the makeup tutorial corresponding to the second makeup type and the types of cosmetics required for the makeup tutorial to the user include: The makeup tutorial is divided into multiple sub-steps, and the types of cosmetics required for each sub-step are determined. The system pushes each sub-step and the required cosmetic type to the user in a step-by-step manner.

6. A makeup aid device, characterized in that, The device includes: The first acquisition module is used to acquire the user's first facial image and the types of cosmetics in the vehicle cabin; The second acquisition module is used to acquire the first makeup type input by the user, wherein the first makeup type is the user's ideal makeup type; The makeup determination module is used to determine the types of cosmetics required for the first makeup type. If the types of cosmetics in the cabin do not meet the requirements of the first makeup type, a second makeup type is determined based on the types of cosmetics in the cabin, the first makeup type, and the first facial image. The second makeup type is a makeup type recommended by the vehicle system. The makeup display module is used to generate a second facial image based on the second makeup type and display the second facial image to the user, wherein the second facial image is a simulated facial image of the user after makeup. The push module is used to respond to the user's selection of the second makeup type by pushing the makeup tutorial corresponding to the second makeup type and the types of cosmetics required for the makeup tutorial to the user; The makeup determination module includes: The candidate makeup determination submodule is used to determine multiple candidate makeup types based on the first facial image; The calculation submodule is used to calculate the matching score of each candidate makeup type based on the types of cosmetics in the cabin and the first makeup type. The filtering submodule is used to determine the candidate makeup type with the highest matching score as the second makeup type; The computation submodule includes: The first calculation unit is used to calculate the first matching score of the candidate makeup type based on the degree of matching between the types of cosmetics required for the candidate makeup type and the types of cosmetics in the cabin. The second calculation unit is used to calculate the second matching score of the candidate makeup type based on the degree of matching between the candidate makeup type and the first makeup type; The first integration unit is used to calculate the matching score of the candidate makeup type based on the first matching score and the second matching score.

7. An electronic device, characterized in that, It includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, when executing a program stored in memory, implements the makeup assistance method as described in any one of claims 1-5.

8. A vehicle, characterized in that, It includes a processor and a memory, the memory storing machine-executable instructions that can be executed by the processor, the processor executing the machine-executable instructions to implement the makeup-assisted method as described in any one of claims 1-5.

Images