Intelligent pushing system and method for beauty makeup service

Abstract

The invention discloses an intelligent recommendation system and method for beauty makeup service. The system comprises a shared intelligent cabinet, an intelligent beauty makeup mirror arranged in the shared intelligent cabinet, mobile terminal equipment and a remote data processing platform. The intelligent beauty makeup mirror comprises a base and a man-machine interaction display screen; a main control module, a remote communication module and a local communication module are arranged in the base; the main control module is used for starting a first camera module in the shared intelligent cabinet to obtain a plurality of user face images at different shooting angles when the mobile terminal equipment scans the corresponding two-dimensional code to authorize login and succeeds; and the remote data processing platform is used for obtaining recommended makeup according to the plurality of user face images and a makeup model constructed in the system, so that the main control module displays the recommended makeup in the man-machine interaction display screen in a list manner and plays an animation video corresponding to the recommended makeup. According to the method, the shared intelligent cabinet is provided to extract the face image of the user, so that the makeup suitable for the user is recommended to the user, and automatic makeup recommendation is realized.

Description

Technical Field

[0001] The present invention relates to beauty and makeup services, and in particular to an intelligent push system and method for beauty and makeup services. Background Art

[0002] Currently, most people learn makeup through TV, some beauty apps, magazines and books, etc. However, due to the differences in face shape, users cannot judge which makeup is most suitable for them. They just try based on the recommendations of some bloggers. At the same time, due to the limited makeup skills of each person and the different cosmetics used, the actual effect may be different from that on TV or the Internet, resulting in failed attempts and inability to find makeup that suits them. Summary of the invention

[0003] In order to overcome the deficiencies of the prior art, one of the objects of the present invention is to provide an intelligent push system for beauty services, which can solve the problem that users cannot find makeup that suits them in the prior art.

[0004] The second object of the present invention is to provide an intelligent push method for beauty services, which can solve the problem in the prior art that users cannot find makeup that suits them.

[0005] The third object of the present invention is to provide a computer-readable storage medium, which can solve the problem that users cannot find a makeup look that suits them in the prior art.

[0006] One of the purposes of the present invention is achieved by the following technical solution:

[0007] An intelligent recommendation system for beauty and makeup services, the intelligent recommendation system comprising: a front-end interaction platform and a remote data processing platform; wherein the front-end interaction platform comprises a mobile terminal device, a shared smart cabinet and an intelligent beauty and makeup mirror disposed in the shared smart cabinet;

[0008] The smart makeup mirror comprises a base and a human-machine interactive display screen arranged on the base; a main control module, a remote communication module and a local communication module are arranged in the base, the main control module is connected to the remote data processing platform through the remote communication module, and the main control module is connected to the mobile terminal device through the local communication module;

[0009] The shared smart cabinet is also provided with a cabinet door, on which a first electronic lock is installed; the main control module is electrically connected to the first electronic lock, and is used to drive and control the first electronic lock to open the cabinet door when the mobile terminal device scans the WeChat applet QR code on the shared smart cabinet to authorize the login information, and after the login information is verified, the first electronic lock is driven to open the cabinet door;

[0010] A first camera module is provided in the shared smart cabinet; the main control module is electrically connected to the first camera module, and is used to start the first camera module to shoot the user's face at multiple angles to obtain multiple user face images at different shooting angles when the user enters the shared smart cabinet and the cabinet door of the shared smart cabinet is closed, and upload the multiple user face images to the remote data processing platform through the remote communication module;

[0011] The remote data processing platform is used to obtain matching results based on multiple user facial images and the makeup model constructed in the system, and then obtain recommended makeup based on the matching results and feed the recommended makeup back to the main control module, so that the main control module displays the recommended makeup in the form of a list on the human-computer interaction display screen and plays the corresponding recommended makeup animation video on the human-computer interaction display screen when the user selects the corresponding recommended makeup.

[0012] Furthermore, the shared smart cabinet is also provided with a second camera module, and the main control module is electrically connected to the second camera module, and is also used to obtain a full-body image of the user and send the full-body image of the user to the remote data processing platform, so that the remote data processing platform synthesizes each recommended makeup with the full-body image of the user to obtain an overall schematic diagram of the corresponding user after makeup; and when the user selects the corresponding recommended makeup, the overall schematic diagram of the corresponding user after makeup will also be displayed through the human-computer interaction display screen.

[0013] Furthermore, the remote data processing platform is also used to first derive several makeups based on multiple user facial images and a makeup model constructed in the system, and select the recommended makeup from the several makeups based on the user's dress requirements; the user's dress requirements are selected by the user through the interactive page of the WeChat applet of the mobile terminal device or are derived based on the user's full-body image.

[0014] Furthermore, the main control module is also used to send the login information authorized by the mobile terminal device to the remote data processing platform through the remote communication module, so that the remote data processing platform verifies the login information;

[0015] When the login information is verified, the remote data processing platform is further used to send a verification success notification to the main control module, so that the main control module drives and controls the first electronic lock to open according to the verification success notification.

[0016] Furthermore, the remote data processing platform is also used to split the makeup steps according to the final recommended makeup selected by the user to generate a number of makeup sub-steps, and obtain the tutorial of each makeup sub-step from the system to generate a makeup tutorial for the final recommended makeup selected by the user and feed it back to the main control module, so that the main control module plays the makeup tutorial through the human-computer interaction display screen.

[0017] Furthermore, a dressing table is provided on the top of the base, and a cosmetics placement area is provided on the dressing table. A smart cosmetics box is installed in the cosmetics placement area, and shared cosmetics are placed in the smart cosmetics box;

[0018] The main control module is also used to, when the user chooses to put on makeup by himself, control the second electronic lock of the smart makeup box to open the smart makeup box, provide shared cosmetics to the user, and enable the user to put on makeup according to the makeup tutorial of the final recommended makeup selected by the user; and when the user finishes putting on makeup, generate a makeup order and calculate the makeup fee to generate a makeup charging QR code, so that the user can pay the makeup fee by scanning the QR code; the main control module is also used to drive and control the first electronic lock of the cabinet door of the shared smart cabinet to open the cabinet door of the shared smart cabinet when the makeup fee payment is completed;

[0019] The main control module is also used to send the recommended makeup selected by the user, the area selected by the user and the appointment time desired by the user to the remote data processing platform through the remote communication module when the user chooses to make an appointment for makeup, so that the remote data processing platform is used to match the recommended makeup selected by the user with the makeup artists registered in the system to obtain a number of recommended makeup artists, and then generate a number of makeup appointment orders according to the area selected by the user, the appointment time desired by the user and the appointment status of each recommended makeup artist, and then sort the sorted makeup appointment orders according to preset rules and send them to the main control module; the main control module is used to display the sorted makeup appointment orders to the user so that the user can select the corresponding makeup appointment order, and when the user selects the corresponding makeup appointment order, generate an appointment notification and send it to the corresponding makeup artist and the user;

[0020] The main control module is also used to recommend cosmetics to the user based on the cosmetics used in the recommended makeup, so that the user can select the recommended cosmetics.

[0021] Furthermore, the remote data processing platform is also used to first perform facial feature analysis based on multiple user facial images to extract the user's facial features to construct the user's facial feature vector, and then match the constructed user's facial feature vector with the makeup model constructed in the system to obtain a matching facial feature vector, thereby obtaining the makeup corresponding to the corresponding facial image, and feeding it back to the main control module as a recommended makeup; wherein, by collecting multiple makeups and performing feature analysis on the facial images corresponding to each makeup to obtain the facial features corresponding to the facial images of each makeup; the facial features include the user's face shape, eye shape, eyebrow shape, lip shape, and skin color; and then using a neural network model to perform model training on each of the above makeups and the corresponding facial images and facial features to construct a correlation between the makeup and the facial features, thereby obtaining the makeup model.

[0022] The second object of the present invention is achieved by adopting the following technical solution:

[0023] An intelligent recommendation method for beauty and makeup services is applied to an intelligent recommendation system for beauty and makeup services as one of the purposes of the present invention, and the intelligent recommendation method comprises:

[0024] Login step: obtaining authorized login information and verifying the login information, and when the login information verification is successful, controlling the first electronic lock to open the door of the shared smart cabinet, so that the user can enter the shared smart cabinet;

[0025] Data acquisition step: photographing the user's face at multiple angles to obtain multiple user face images at different shooting angles;

[0026] Recommendation matching step: obtaining recommended makeup according to multiple user face images and the makeup model constructed in the system, and displaying the recommended makeup in a list through the human-computer interactive display screen; and when the user selects the corresponding recommended makeup, playing the corresponding recommended makeup in an animated video through the human-computer interactive display screen;

[0027] Display step: obtaining a full-body image of the user and synthesizing the final recommended makeup selected by the user with the full-body image of the user to generate an overall effect image of the user after makeup and displaying it through a human-computer interactive display screen.

[0028] Furthermore, the recommended matching step specifically includes:

[0029] Makeup matching step: deriving a plurality of makeups based on a plurality of user facial images and a makeup model constructed in the system, and selecting the recommended makeup from the plurality of makeups based on the user's dress requirements; the user's dress requirements are selected by the user through the interactive page of the WeChat applet on the mobile terminal device, the dress requirements set in the system, or extracted based on the user's full-body image;

[0030] Among them, obtaining several makeups according to multiple user facial images and the makeup model constructed in the system specifically includes: performing facial feature analysis according to multiple user facial images to extract the user's facial features to construct the user's facial feature vector, and then matching the constructed user's facial feature vector with the makeup model constructed in the system to obtain a matching facial feature vector, thereby obtaining a corresponding facial image, and obtaining a corresponding recommended makeup according to the corresponding facial image; wherein, by collecting multiple makeups, and performing feature analysis on the facial image corresponding to each makeup to obtain the facial features corresponding to the facial image of each makeup; the facial features include the user's face shape, eye shape, eyebrow shape, lip shape, and skin color; then using a neural network model to perform model training on each of the above makeups and the corresponding facial images and facial features to construct a correlation between the makeup and the facial features, thereby obtaining the makeup model;

[0031] Tutorial acquisition step: splitting the makeup steps according to the final recommended makeup selected by the user to generate a number of makeup sub-steps, and acquiring the tutorial of each makeup sub-step from the system to generate a makeup tutorial for the final recommended makeup selected by the user, and then playing the makeup tutorial for the final recommended makeup selected by the user through the human-computer interactive display screen;

[0032] Makeup steps: when the user chooses to put on makeup by himself, the first electronic lock of the smart makeup box is controlled to open the smart makeup box, and shared cosmetics are provided to the user, so that the user can put on makeup according to the makeup tutorial of the final recommended makeup selected by the user; and when the user finishes putting on makeup, a makeup order is generated and the makeup fee is calculated to generate a makeup charging QR code, so that the user can pay the makeup fee by scanning the QR code;

[0033] Reservation steps: when the user chooses to make an appointment for makeup, several recommended makeup artists are obtained according to the final recommended makeup selected by the user and the makeup artists registered in the system, and then several makeup appointment orders are generated according to the area selected by the user, the user's desired appointment time and the appointment status of each recommended makeup artist, and the makeup appointment orders are sorted according to the preset rules and then displayed to the user through the human-computer interactive display screen; and when the user selects the corresponding makeup appointment order, an appointment notification is generated and sent to the user and the corresponding makeup artist;

[0034] Cosmetics recommendation step: recommend corresponding cosmetics to the user based on the cosmetics used in the final recommended makeup selected by the user.

[0035] The third object of the present invention is achieved by adopting the following technical solution:

[0036] A computer-readable storage medium stores an intelligent recommendation program, which is a computer program. When the intelligent recommendation program is executed by a processor, it implements the steps of an intelligent recommendation method for beauty services as adopted in the second purpose of the present invention.

[0037] Compared with the prior art, the present invention has the following beneficial effects:

[0038] The present invention combines shared intelligent cabinets and collects data on the user's facial features to achieve the design of the user's makeup, thereby automatically matching the user with the makeup that suits him / herself, thereby avoiding the problem that the user cannot design the makeup that suits him / herself. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A module diagram of an intelligent push system for beauty services provided by the present invention;

[0040] Figure 2 A flow chart of an intelligent push method for beauty services provided by the present invention;

[0041] Figure 3 for Figure 2 Flow chart of step S3 in FIG. DETAILED DESCRIPTION

[0042] The present invention is further described below in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form a new embodiment.

[0043] Embodiment 1

[0044] The present invention provides an intelligent recommendation system for beauty services, which can solve the problem in the prior art that it is impossible to choose beauty makeup that suits oneself, such as Figure 1 As shown, the present invention provides a preferred embodiment, an intelligent recommendation system for beauty services, including: a front-end interaction platform and a remote data processing platform.

[0045] The front-end interactive platform includes a shared smart cabinet, a smart makeup mirror in the shared smart cabinet, and a mobile terminal. Specifically, the smart makeup mirror is installed in the shared smart cabinet and includes a base and a human-computer interaction display screen on the base. The base is equipped with a main control module, a remote communication module, and a local communication module.

[0046] The main control module is connected to the remote data processing platform through the remote communication module to realize data interaction, such as feeding back the collected data to the remote data processing platform, or receiving signals or data sent by the remote data processing platform. The main control module is connected to the mobile terminal device through the local communication module. Specifically, the local communication module is a Bluetooth communication module, and the mobile terminal device is connected to the main control module through the Bluetooth communication module to realize human-computer interaction. At the same time, when the mobile terminal device scans the QR code on the shared smart cabinet through WeChat and obtains the user's authorized login information, the login information sent by the mobile terminal device is obtained through the local communication module and the login information is sent to the remote data processing platform through the remote communication module, so that the remote data processing platform verifies the login information. After the mobile terminal device logs in successfully, it enters the WeChat applet to realize human-computer interaction.

[0047] When the login information is verified, the remote data processing platform sends a verification success signal to the main control module. The main control module drives and controls the first electronic lock to open the door of the shared smart cabinet, and the user can enter the shared smart cabinet. At the same time, the shared smart cabinet is manually closed.

[0048] When the shared smart cabinet is not closed, the devices in the shared smart cabinet, such as the camera module, human-computer interaction display screen, etc., will not enter the working state to avoid the situation where the user forgets to close the shared smart cabinet.

[0049] When the user enters the smart cabinet and manually closes the door of the shared smart cabinet, the main control module will control the voice module to play corresponding music or voice to make the user happy.

[0050] Preferably, the shared smart cabinet is provided with a cabinet door, and a first electronic lock is installed on the cabinet door, and the cabinet door is opened and closed by the first electronic lock. The main control module is electrically connected to the first electronic lock, and is used to drive and control the opening of the first electronic lock to control the opening and closing of the cabinet door. Under normal circumstances, the cabinet door of the shared smart cabinet is closed. When a user uses the shared smart cabinet, the main control module controls the first electronic lock to open, thereby opening the cabinet door of the shared smart cabinet.

[0051] More specifically, a first camera module is also provided in the shared smart cabinet. The main control module is electrically connected to the first camera module, and is used to start the first camera module to shoot the user's face at multiple angles to obtain multiple user face images at different shooting angles when a user enters the shared smart cabinet and the cabinet door of the shared smart cabinet is closed, and send the multiple user face images to the remote data processing platform through the remote communication module.

[0052] The remote data processing platform matches the received multiple user face images with the makeup model constructed in the system to obtain matching results, and then obtains recommended makeup based on the matching results and feeds the recommended makeup back to the main control module. The main control module is electrically connected to the human-computer interaction display screen, and is used to display the received recommended makeup in the form of a list on the human-computer interaction display screen, so as to provide it to the user for viewing.

[0053] More specifically, the main control module is also used to display the corresponding recommended makeup to the user in the form of an animated video on the human-computer interactive display screen when the user selects the corresponding recommended makeup. The present invention obtains the user's facial image by photographing the user's face, and then identifies the user's facial features. According to the user's facial features, a more suitable recommended makeup is identified for the user, thereby solving the problem in the prior art that the user cannot find a makeup that suits him / herself.

[0054] More specifically, a second camera module is also provided in the shared smart cabinet, and the second camera module is electrically connected to the main control module for obtaining a full-body image of the user. The main control module is used to send the full-body image of the user to the remote data processing platform. When the remote data processing platform obtains a recommended makeup, the remote data processing platform is also used to merge the obtained recommended makeup and the full-body image of the user to generate an overall effect image of the user after makeup.

[0055] More preferably, when deriving a recommended makeup, the backend data processing platform first obtains several makeups based on multiple user facial images and a makeup model constructed in the system, and selects a recommended makeup from the several makeups based on the user's dress requirements; the user's dress requirements are also selected by the user through the interactive page of the WeChat applet on the mobile terminal device, the dress requirements set in the system or the user's dress requirements extracted from the user's full-body image. Due to different dress requirements, the makeup that matches them is also different. Therefore, when considering the recommended makeup, the user's dress requirements also need to be considered.

[0056] More specifically, when the remote data processing platform in the present invention matches the user's facial image with the makeup model, it also specifically includes: firstly performing facial feature analysis based on multiple user facial images to extract the user's facial features, and then constructing the user's facial feature vector.

[0057] The facial features include but are not limited to the following features: face shape, eye shape, lip shape, skin color, etc. The facial feature vector of the user is constructed by extracting the above facial features.

[0058] Then the user's facial feature vector is matched with the makeup model constructed in the system to obtain a matching result. That is, a facial feature vector matching the user's facial feature vector is obtained, and then the makeup corresponding to the facial image corresponding to the matched facial feature vector is used as the recommended makeup.

[0059] In this embodiment, multiple makeups are collected, and the facial images corresponding to each makeup are analyzed to obtain the facial features corresponding to each makeup image. Then, a neural network model is used to train the model for each makeup and the corresponding facial images and facial features to construct the association between the makeup and the facial features, thereby obtaining a makeup model. At the same time, the user's dress requirements, hairstyle, etc. are also considered during model training.

[0060] Preferably, a voice module is also provided in the smart makeup mirror. When the user enters the shared smart cabinet and turns on the makeup design, the main control module can also start the voice module of the smart makeup mirror to remind the user how to operate by voice, and start the camera module to shoot the user at the same time to obtain the user's facial feature image and full-body image. More preferably, the user has multiple facial images and full-body images, and the camera module is rotated to clearly shoot the user's facial image, so that the user's facial features can be extracted based on the multiple facial images of the user. By shooting multiple facial images, the user's facial features can be extracted more accurately, because a certain part may not be clearly shot due to light or angle problems during shooting. Therefore, by shooting multiple facial images at different angles, the user's facial features can be more accurately obtained.

[0061] In addition, after the user scans the QR code through WeChat on the mobile terminal device, the user can register or log in and enter the WeChat applet to achieve human-computer interaction. That is, after the user enters the shared smart cabinet, he can also enter the corresponding interactive page of the WeChat applet through the mobile terminal device to interact with the main control module.

[0062] Preferably, the remote data processing platform is also used to split the makeup steps into several makeup sub-steps according to the final recommended makeup selected by the user, and obtain the tutorial of each makeup sub-step from the system, and then generate the makeup tutorial of the final recommended makeup according to the tutorials of all the makeup sub-steps and feed it back to the main control module, and the main control module pushes the makeup tutorial of the final recommended makeup to the human-computer interaction display screen for playback for the user's reference, so that the user can implement the makeup of the final recommended tutorial by referring to the tutorial.

[0063] More specifically, the tutorial for each makeup sub-step can be in the form of video or text. Of course, the tutorial can also be provided in detailed and simple versions according to actual needs for different users to choose from.

[0064] By providing users with suitable makeup and tutorials for suitable makeup, it is convenient for users to learn makeup skills according to the tutorials, avoiding users from blindly searching for some scattered makeup and makeup skills that are not suitable for themselves on TV or the Internet.

[0065] In addition, when the user chooses to put on makeup by himself, the present invention also provides shared cosmetics for the user to use. Specifically, a dressing table is also provided on the top of the base, and a cosmetics placement area is provided on the dressing table. A smart makeup box is installed in the cosmetics placement area, and shared cosmetics are placed in the smart makeup box. When the user chooses to put on makeup by himself, the main control module controls the second electronic lock of the smart makeup box in the cosmetics placement area to open the smart makeup box, and provides shared cosmetics to the user, so that the user can put on makeup according to the makeup tutorial of the final recommended makeup.

[0066] When the user has finished putting on makeup, the main control module is also used to generate a makeup order and calculate the makeup fee, and then generate a makeup fee QR code for the user to scan the QR code to pay the makeup fee. When calculating the makeup fee, the fee can be calculated based on the makeup design fee, shared cosmetics usage fee, and makeup time set by the system.

[0067] In addition, after the user has finished putting on makeup, they can also choose whether to purchase the corresponding cosmetics. That is, when the user needs to purchase the corresponding cosmetics, the cosmetics used in the corresponding makeup order can be recommended to the user for selection. After the purchase is successful, the user can pay the corresponding fee to generate a cosmetics order and fill in the mailing address. The background will mail the purchased cosmetics to the user's home according to the cosmetics order.

[0068] Furthermore, the main control module is also used to drive and control the first electronic lock of the shared smart cabinet door to open the shared smart cabinet door when the makeup fee payment is completed, thereby completing the makeup recommendation and makeup.

[0069] In addition, when the user does not know how to put on makeup or does not want to put on makeup by himself, he can also choose to make an appointment for makeup. That is, when the user chooses to make an appointment for makeup, the main control module sends the final recommended makeup selected by the user, the area selected by the user, the appointment time desired by the user and other appointment-related data to the remote data processing platform through the remote communication module. The remote data processing platform is used to match the final recommended makeup selected by the user with the makeup artists registered in the system to obtain several recommended makeup artists, and then generate several makeup appointment orders according to the area selected by the user, the appointment time desired by the user and the appointment status of each recommended makeup artist, and sort them according to preset rules, and then feed the sorted makeup appointment orders back to the main control module.

[0070] The main control module is used to display the sorted makeup appointment orders to the user through the human-computer interactive display screen so that the user can select the corresponding makeup appointment order. When the user selects the corresponding makeup appointment order, the main control module generates an appointment notification and sends it to the user and the corresponding makeup artist.

[0071] The present invention uses a shared smart cabinet to collect the user's facial features to provide the user with a makeup that suits him / her, and to achieve intelligent recommendations for the user's beauty services. It also provides a tutorial of the corresponding makeup for the user's reference, and also provides shared cosmetics, and provides makeup materials for users with a makeup foundation, so that they can directly apply makeup according to the selected recommended makeup, providing convenience; and provides tutorials for users who need to learn makeup skills, facilitating learning. At the same time, it also provides a platform appointment function for users without a makeup foundation, so that they can make an appointment with a professional makeup artist to apply makeup.

[0072] Embodiment 2

[0073] Based on the first embodiment, the present invention further provides an intelligent recommendation method for beauty services, which is applied to an intelligent recommendation system for beauty services provided in the first embodiment of the present invention. Figure 2 As shown, the intelligent recommendation method includes:

[0074] Step S1, obtain authorized login information and verify the login information, and when the login information verification is successful, control the first electronic lock to open the door of the shared smart cabinet, so that the user can enter the shared smart cabinet.

[0075] Specifically, the WeChat applet is entered by scanning with a mobile terminal device to authorize the login information so that the door of the shared smart cabinet can be opened after the login information is verified, allowing the user to enter the shared smart cabinet.

[0076] Step S2: photographing the user's face at multiple angles to obtain multiple facial images of the user at different shooting angles.

[0077] Specifically, when a user enters a shared smart cabinet and the door of the shared smart cabinet is closed, the user's face is photographed at multiple angles through the first camera module to obtain multiple user face images at different shooting angles.

[0078] Step S3: derive recommended makeup based on multiple user facial images and the makeup model constructed in the system, and display the recommended makeup to the user in a list.

[0079] Step S4: When the user selects a corresponding recommended makeup, the corresponding recommended makeup is displayed to the user in an animated video.

[0080] By recognizing the user's facial image and combining it with the makeup model built by the system, the recommended makeup is obtained to achieve intelligent recommendation of makeup suitable for the user, and at the same time display it to the user through the human-computer interactive display.

[0081] Step S5, obtaining a full-body image of the user and synthesizing the final recommended makeup selected by the user with the full-body image of the user to generate an overall effect image of the user after makeup and displaying it through a human-computer interactive display screen.

[0082] That is, the present invention also synthesizes the final recommended makeup with the user's full-body image to obtain the overall effect after makeup, allowing the user to observe the effect after makeup more intuitively.

[0083] More preferably, if Figure 3 As shown, step S3 also includes:

[0084] Step S31: derive several makeups based on multiple user facial images and a makeup model constructed in the system, and derive a recommended makeup based on the user's dress requirements and the several makeups.

[0085] The user's dress requirements are selected by the user through the interactive page of the WeChat applet on the mobile terminal device, the dress requirements set in the system are selected, or they are extracted based on the user's full-body image.

[0086] Among them, the facial features of the user in this embodiment include but are not limited to the following features: the user's face shape, eye shape, eyebrow shape, lip shape, skin color, etc.

[0087] More specifically, obtaining several makeups based on multiple user facial images and a makeup model constructed in the system specifically includes: performing facial feature analysis based on multiple user facial images to extract the user's facial features to construct the user's facial feature vector, and then matching the constructed user's facial feature vector with the makeup model constructed in the system to obtain a matching facial feature vector, thereby obtaining the makeup corresponding to the corresponding facial image, and using it as the recommended makeup; wherein, a plurality of makeups are collected, and feature analysis is performed on the facial image corresponding to each makeup to obtain the facial features corresponding to the facial image of each makeup; and then a neural network model is used to perform model training on each of the above makeups and the corresponding facial images and facial features to construct a correlation between the makeup and the facial features, thereby obtaining the makeup model.

[0088] By pre-building the association between makeup and facial features, intelligent recommendations for users' makeup can be made based on their facial features, so that users can choose makeup that is more suitable for them.

[0089] Step S32: Split the makeup steps according to the final recommended makeup selected by the user to generate several makeup sub-steps, obtain the tutorial of each makeup sub-step from the system, and then generate the makeup tutorial of the final recommended makeup selected by the user, and then play the makeup tutorial of the final recommended makeup selected by the user through the human-computer interaction display screen.

[0090] The present invention also provides a makeup tutorial to guide users to put on makeup, providing a reference for users to learn, and avoiding the problem that users blindly search for some makeup tutorials that are not suitable for them on the Internet or on TV.

[0091] Step S33: when the user chooses to put on makeup by herself, the first electronic lock of the smart makeup box is controlled to open the smart makeup box, and shared cosmetics are provided to the user, so that the user can put on makeup according to the makeup tutorial of the final recommended makeup selected by the user; and when the user finishes putting on makeup, a makeup order is generated and the makeup fee is calculated to generate a makeup charging QR code, so that the user can pay the makeup fee by scanning the QR code.

[0092] When users choose to put on makeup by themselves, they can do so according to makeup tutorials and the shared cosmetics provided, providing convenience for users.

[0093] Step S34: When the user chooses to make an appointment for makeup, several recommended makeup artists are obtained based on the final recommended makeup selected by the user and the makeup artists registered in the system. Then, several makeup appointment orders are generated based on the area selected by the user, the user's desired appointment time, and the appointment status of each recommended makeup artist. After the orders are sorted according to preset rules, the sorted makeup appointment orders are displayed to the user through a human-computer interaction display screen; and when the user selects a corresponding makeup appointment order, an appointment notification is generated and sent to the user and the corresponding makeup artist.

[0094] When a user needs to find a professional makeup artist, he can make an appointment for makeup through the platform to find a professional makeup artist to do his makeup. The present invention provides multiple options and is more suitable for users with different needs.

[0095] Embodiment 3

[0096] A computer-readable storage medium stores an intelligent recommendation program, which is a computer program. When the intelligent recommendation program is executed by a processor, the steps of an intelligent recommendation method for beauty services provided in Embodiment 2 of the present invention are implemented.

[0097] The above-mentioned embodiments are only preferred embodiments of the present invention and cannot be used to limit the scope of protection of the present invention. Any non-substantial changes and substitutions made by technicians in this field on the basis of the present invention shall fall within the scope of protection required by the present invention.

Claims

1. An intelligent recommendation system for beauty services, characterized in that: The intelligent recommendation system includes: a front-end interactive platform and a remote data processing platform; wherein the front-end interactive platform includes a mobile terminal device, a shared intelligent cabinet and an intelligent beauty mirror arranged in the shared intelligent cabinet; The smart makeup mirror comprises a base and a human-machine interactive display screen arranged on the base; a main control module, a remote communication module and a local communication module are arranged in the base, the main control module is connected to the remote data processing platform through the remote communication module, and the main control module is connected to the mobile terminal device through the local communication module; The shared smart cabinet is also provided with a cabinet door, on which a first electronic lock is installed; the main control module is electrically connected to the first electronic lock, and is used to drive and control the first electronic lock to open the cabinet door when the mobile terminal device scans the WeChat applet QR code on the shared smart cabinet to authorize the login information, and after the login information is verified, the first electronic lock is driven to open the cabinet door; A first camera module is provided in the shared smart cabinet; the main control module is electrically connected to the first camera module, and is used to start the first camera module to shoot the user's face at multiple angles to obtain multiple user face images at different shooting angles when the user enters the shared smart cabinet and the cabinet door of the shared smart cabinet is closed, and upload the multiple user face images to the remote data processing platform through the remote communication module; The remote data processing platform is used to obtain matching results based on multiple user facial images and the makeup model constructed in the system, and then obtain recommended makeup based on the matching results and feed the recommended makeup back to the main control module, so that the main control module displays the recommended makeup in the form of a list on the human-computer interaction display screen and plays the corresponding recommended makeup animation video on the human-computer interaction display screen when the user selects the corresponding recommended makeup.

2. The intelligent recommendation system for beauty services according to claim 1, characterized in that: The shared smart cabinet is also provided with a second camera module, the main control module is electrically connected to the second camera module, and is also used to obtain a full-body image of the user and send the full-body image of the user to the remote data processing platform, so that the remote data processing platform synthesizes each recommended makeup with the full-body image of the user to obtain an overall schematic diagram of the corresponding user after makeup; And when the user selects the corresponding recommended makeup, the overall schematic diagram of the corresponding user after makeup will also be displayed through the human-computer interaction display screen.

3. The intelligent recommendation system for beauty services according to claim 2, characterized in that: The remote data processing platform is further used to first obtain a plurality of makeups based on a plurality of user facial images and a makeup model constructed in the system, and select the recommended makeup from the plurality of makeups according to the user's dress requirements; The user's dress requirement is selected by the user through the interactive page of the WeChat applet of the mobile terminal device or is derived from the user's full-body image.

4. The intelligent recommendation system for beauty services according to claim 1, characterized in that: The main control module is further used to send the login information authorized by the mobile terminal device to the remote data processing platform through the remote communication module, so that the remote data processing platform verifies the login information; When the login information is verified, the remote data processing platform is further used to send a verification success notification to the main control module, so that the main control module drives and controls the first electronic lock to open according to the verification success notification.

5. The intelligent recommendation system for beauty services according to claim 1, characterized in that: The remote data processing platform is also used to split the makeup steps according to the final recommended makeup selected by the user to generate a number of makeup sub-steps, and obtain the tutorial of each makeup sub-step from the system to generate a makeup tutorial for the final recommended makeup selected by the user and feed it back to the main control module, so that the main control module plays the makeup tutorial through the human-computer interaction display screen.

6. The intelligent recommendation system for beauty services according to claim 5, characterized in that: A dressing table is also provided on the top of the base, and a cosmetics placement area is provided on the dressing table. A smart cosmetics box is installed in the cosmetics placement area, and shared cosmetics are placed in the smart cosmetics box; The main control module is also used to, when the user chooses to put on makeup by himself, control the second electronic lock of the smart makeup box to open the smart makeup box, provide shared cosmetics to the user, and enable the user to put on makeup according to the makeup tutorial of the final recommended makeup selected by the user; and when the user finishes putting on makeup, generate a makeup order and calculate the makeup fee to generate a makeup charging QR code, so that the user can pay the makeup fee by scanning the QR code; the main control module is also used to drive and control the first electronic lock of the cabinet door of the shared smart cabinet to open the cabinet door of the shared smart cabinet when the makeup fee payment is completed; The main control module is also used to send the recommended makeup selected by the user, the area selected by the user and the appointment time desired by the user to the remote data processing platform through the remote communication module when the user chooses to make an appointment for makeup, so that the remote data processing platform is used to match the recommended makeup selected by the user with the makeup artists registered in the system to obtain a number of recommended makeup artists, and then generate a number of makeup appointment orders according to the area selected by the user, the appointment time desired by the user and the appointment status of each recommended makeup artist, and after sorting them according to preset rules, send the sorted makeup appointment orders to the main control module; The main control module is used to display the sorted makeup reservation orders to the user so that the user can select the corresponding makeup reservation order, and when the user selects the corresponding makeup reservation order, generate a reservation notification and send it to the corresponding makeup artist and the user; The main control module is also used to recommend cosmetics to the user based on the cosmetics used in the recommended makeup, so that the user can select the recommended cosmetics.

7. The intelligent recommendation system for beauty services according to claim 1, characterized in that: The remote data processing platform is also used to first perform facial feature analysis based on multiple user facial images to extract the user's facial features to construct the user's facial feature vector, and then match the constructed user's facial feature vector with the makeup model constructed in the system to obtain a matching facial feature vector, thereby obtaining the makeup corresponding to the corresponding facial image, and feeding it back to the main control module as a recommended makeup; wherein, by collecting multiple makeups and performing feature analysis on the facial images corresponding to each makeup to obtain the facial features corresponding to the facial images of each makeup; the facial features include the user's face shape, eye shape, eyebrow shape, lip shape, and skin color; then a neural network model is used to perform model training on each of the above-mentioned makeups and the corresponding facial images and facial features to construct a correlation between the makeup and the facial features, thereby obtaining the makeup model.

8. An intelligent recommendation method for beauty services, applied to an intelligent recommendation system for beauty services as claimed in any one of claims 1 to 7, characterized in that: The intelligent recommendation method comprises: Login step: obtaining authorized login information and verifying the login information, and when the login information verification is successful, controlling the first electronic lock to open the door of the shared smart cabinet, so that the user can enter the shared smart cabinet; Data acquisition step: photographing the user's face at multiple angles to obtain multiple user face images at different shooting angles; Recommendation matching step: obtaining recommended makeup according to multiple user face images and the makeup model constructed in the system, and displaying the recommended makeup in a list through the human-computer interactive display screen; and when the user selects the corresponding recommended makeup, playing the corresponding recommended makeup in an animated video through the human-computer interactive display screen; Display step: obtaining a full-body image of the user and synthesizing the final recommended makeup selected by the user with the full-body image of the user to generate an overall effect image of the user after makeup and displaying it through a human-computer interactive display screen.

9. The intelligent recommendation method for beauty services according to claim 8, characterized in that: The recommended matching step specifically includes: Makeup matching step: deriving a plurality of makeups based on a plurality of user facial images and a makeup model constructed in the system, and selecting the recommended makeup from the plurality of makeups based on the user's dress requirements; the user's dress requirements are selected by the user through the interactive page of the WeChat applet on the mobile terminal device, the dress requirements set in the system, or extracted based on the user's full-body image; Among them, obtaining several makeups according to multiple user facial images and the makeup model constructed in the system specifically includes: performing facial feature analysis according to multiple user facial images to extract the user's facial features to construct the user's facial feature vector, and then matching the constructed user's facial feature vector with the makeup model constructed in the system to obtain a matching facial feature vector, thereby obtaining a corresponding facial image, and obtaining a corresponding recommended makeup according to the corresponding facial image; wherein, by collecting multiple makeups, and performing feature analysis on the facial image corresponding to each makeup to obtain the facial features corresponding to the facial image of each makeup; the facial features include the user's face shape, eye shape, eyebrow shape, lip shape, and skin color; then using a neural network model to perform model training on each of the above makeups and the corresponding facial images and facial features to construct a correlation between the makeup and the facial features, thereby obtaining the makeup model; Tutorial acquisition step: splitting the makeup steps according to the final recommended makeup selected by the user to generate a number of makeup sub-steps, and acquiring the tutorial of each makeup sub-step from the system to generate a makeup tutorial for the final recommended makeup selected by the user, and then playing the makeup tutorial for the final recommended makeup selected by the user through the human-computer interactive display screen; Makeup steps: when the user chooses to put on makeup by himself, the first electronic lock of the smart makeup box is controlled to open the smart makeup box, and shared cosmetics are provided to the user, so that the user can put on makeup according to the makeup tutorial of the final recommended makeup selected by the user; and when the user finishes putting on makeup, a makeup order is generated and the makeup fee is calculated to generate a makeup charging QR code, so that the user can pay the makeup fee by scanning the QR code; Reservation steps: when the user chooses to make an appointment for makeup, several recommended makeup artists are obtained according to the final recommended makeup selected by the user and the makeup artists registered in the system, and then several makeup appointment orders are generated according to the area selected by the user, the user's desired appointment time and the appointment status of each recommended makeup artist, and the makeup appointment orders are sorted according to the preset rules and then displayed to the user through the human-computer interactive display screen; and when the user selects the corresponding makeup appointment order, an appointment notification is generated and sent to the user and the corresponding makeup artist; Cosmetics recommendation step: recommend corresponding cosmetics to the user based on the cosmetics used in the final recommended makeup selected by the user.

10. A computer-readable storage medium having an intelligent recommendation program stored thereon, characterized in that: The intelligent recommendation program is a computer program, and when the intelligent recommendation program is executed by a processor, it implements the steps of an intelligent recommendation method for beauty services as described in any one of claims 1 to 8.

Images