An intelligent push system and method for beauty and makeup services
Through the combination of smart beauty mirrors and shared smart cabinets, users can identify facial features, recommend suitable makeup and provide makeup tutorials and services, solving the problem that users cannot find suitable makeup and improve makeup effects and convenience.
Patent Information
- Application Number
- CN202411354782.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-27
- Publication Date
- 2025-09-02
- Estimated Expiration
- 2044-09-27
AI Technical Summary
Users cannot find a makeup look that suits them, and the limited makeup technology leads to poor makeup effects.
It adopts smart beauty mirrors and shared smart cabinets, and uses facial feature recognition and makeup model matching, recommends suitable makeup, and provides makeup tutorials and cosmetics, supporting self-made makeup or appointment-based makeup artist services.
It has achieved personalized makeup recommendations, improved makeup effects, provided makeup tutorials and convenient makeup services to meet the needs of different users.
Smart Images

Figure CN119313428B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to beauty and makeup services, and in particular to an intelligent push system and method for beauty and makeup services. Background Art
[0002] Currently, most people learn makeup through television, some beauty apps, magazines and books. However, due to the differences in face shape, users cannot judge which makeup is most suitable for themselves. They just try according to the recommendations of some bloggers. At the same time, due to the limited makeup skills of each person and the different cosmetics used, the actual effect may be different from the effect on TV or the Internet, resulting in failed attempts and inability to find the makeup that suits them. Summary of the Invention
[0003] In order to overcome the shortcomings of the prior art, one of the purposes of the present invention is to provide an intelligent push system for beauty services, which can solve the problem that users cannot find makeup that suits them in the prior art.
[0004] The second purpose of the present invention is to provide an intelligent push method for beauty services, which can solve the problem in the prior art that users cannot find makeup that suits them.
[0005] The third object of the present invention is to provide a computer-readable storage medium that can solve the problem in the prior art that users cannot find a makeup look that suits them.
[0006] One of the purposes of the present invention is achieved by the following technical solution:
[0007] An intelligent recommendation system for beauty and cosmetic services, comprising: a front-end interactive platform and a remote data processing platform; wherein the front-end interactive platform comprises a mobile terminal device, a shared smart cabinet, and an intelligent beauty and cosmetic mirror disposed within the shared smart cabinet;
[0008] The smart makeup mirror includes a base and a human-computer interaction display screen provided on the base; a main control module, a remote communication module, and a local communication module are provided in the base; the main control module is connected to the remote data processing platform via the remote communication module, and the main control module is connected to the mobile terminal device via the local communication module;
[0009] The shared smart cabinet is further provided with a cabinet door, on which a first electronic lock is installed; the main control module is electrically connected to the first electronic lock, and is configured to drive and control the first electronic lock to open the cabinet door when the mobile terminal device scans the WeChat applet QR code on the shared smart cabinet to authorize login information, and after the login information is verified, drive and control the first electronic lock to open the cabinet door;
[0010] A first camera module is provided in the shared smart cabinet; the main control module is electrically connected to the first camera module, and is configured to activate the first camera module to shoot the user's face from multiple angles when the user enters the shared smart cabinet and the cabinet door of the shared smart cabinet is closed, so as to obtain multiple user facial images at different shooting angles, and upload the multiple user facial images to the remote data processing platform via the remote communication module;
[0011] The remote data processing platform is used to obtain matching results based on multiple user facial images and the makeup model constructed in the system, and then obtain recommended makeup based on the matching results and feed the recommended makeup back to the main control module, so that the main control module displays the recommended makeup in a list on the human-computer interaction display screen and plays the corresponding recommended makeup animation video on the human-computer interaction display screen when the user selects the corresponding recommended makeup.
[0012] Furthermore, the shared smart cabinet is also provided with a second camera module, and the main control module is electrically connected to the second camera module, and is also used to obtain the user's full-body image and send the user's full-body image to the remote data processing platform, so that the remote data processing platform can synthesize each recommended makeup with the user's full-body image to obtain an overall schematic diagram of the corresponding user after makeup; and when the user selects the corresponding recommended makeup, the overall schematic diagram of the corresponding user after makeup will also be displayed through the human-computer interaction display screen.
[0013] Furthermore, the remote data processing platform is also used to first derive several makeup looks based on multiple user facial images and a makeup model constructed in the system, and select the recommended makeup look from the several makeup looks based on the user's dress requirements; the user's dress requirements are selected by the user through the interactive page of the WeChat applet on the mobile terminal device or derived based on the user's full-body image.
[0014] Furthermore, the main control module is further configured to send the login information authorized by the mobile terminal device to the remote data processing platform via the remote communication module, so that the remote data processing platform verifies the login information;
[0015] When the login information is verified, the remote data processing platform is further configured to send a verification success notification to the main control module, so that the main control module drives and controls the first electronic lock to open according to the verification success notification.
[0016] Furthermore, the remote data processing platform is also used to split the makeup steps according to the final recommended makeup look selected by the user to generate several makeup sub-steps, and obtain the tutorial of each makeup sub-step from the system to generate a makeup tutorial for the final recommended makeup look selected by the user and feed it back to the main control module, so that the main control module plays the makeup tutorial through the human-computer interactive display screen.
[0017] Furthermore, a dressing table is provided on the top of the base, on which a cosmetics placement area is provided, and a smart cosmetics box is installed in the cosmetics placement area, in which shared cosmetics are placed;
[0018] The main control module is further configured to, when the user chooses to apply makeup by themselves, control the second electronic lock of the smart makeup box to open the smart makeup box, provide shared cosmetics to the user, and enable the user to apply makeup according to the makeup tutorial of the final recommended makeup look selected by the user; and when the user completes makeup, generate a makeup order and calculate the makeup fee to generate a makeup fee QR code, so that the user can pay the makeup fee by scanning the QR code; the main control module is further configured to, when the makeup fee payment is completed, drive and control the first electronic lock of the cabinet door of the shared smart cabinet to open the cabinet door of the shared smart cabinet;
[0019] The main control module is further configured to, when a user chooses to make an appointment for makeup, send the recommended makeup look selected by the user, the area selected by the user, and the time the user desires to make an appointment to the remote data processing platform via the remote communication module, so that the remote data processing platform is configured to match the recommended makeup look selected by the user with the makeup artists registered in the system to obtain a number of recommended makeup artists, and then generate a number of makeup appointment orders based on the area selected by the user, the time the user desires to make an appointment, and the appointment status of each recommended makeup artist, and then sort the orders according to preset rules and send the sorted makeup appointment orders to the main control module; the main control module is configured to display the sorted makeup appointment orders to the user so that the user can select the corresponding makeup appointment order, and when the user selects the corresponding makeup appointment order, generate an appointment notification and send it to the corresponding makeup artist and the user;
[0020] The main control module is further used to recommend cosmetics to the user based on the cosmetics used in the recommended makeup, so that the user can select the recommended cosmetics.
[0021] Furthermore, the remote data processing platform is also used to first perform facial feature analysis based on multiple user facial images to extract the user's facial features to construct the user's facial feature vector, and then match the constructed user's facial feature vector with the makeup model constructed in the system to obtain a matching facial feature vector, and then obtain the makeup corresponding to the corresponding facial image, and feed it back to the main control module as a recommended makeup; wherein, by collecting multiple makeups and performing feature analysis on the facial images corresponding to each makeup to obtain the facial features corresponding to the facial images of each makeup; the facial features include the user's face shape, eye shape, eyebrow shape, lip shape, and skin color; and then using a neural network model to perform model training on each of the above makeups and the corresponding facial images and facial features to construct a correlation between the makeup and the facial features, and then obtain the makeup model.
[0022] The second object of the present invention is achieved by adopting the following technical solution:
[0023] An intelligent recommendation method for beauty and cosmetics services, applied to an intelligent recommendation system for beauty and cosmetics services as one of the objectives of the present invention, the intelligent recommendation method comprising:
[0024] Login step: obtaining authorized login information and verifying the login information, and when the login information verification is successful, controlling the first electronic lock to open the door of the shared smart cabinet, thereby allowing the user to enter the shared smart cabinet;
[0025] Data acquisition step: photographing the user's face from multiple angles to obtain multiple facial images of the user at different shooting angles;
[0026] Recommendation matching step: based on multiple user facial images and the makeup model constructed in the system, a recommended makeup look is obtained, and the recommended makeup looks are displayed in a list on the human-computer interactive display screen; and when the user selects a corresponding recommended makeup look, the corresponding recommended makeup look is played as an animated video on the human-computer interactive display screen;
[0027] Display step: obtaining a full-body image of the user and synthesizing the final recommended makeup selected by the user with the full-body image of the user to generate an overall effect image of the user after makeup and displaying it through a human-computer interactive display screen.
[0028] Furthermore, the recommended matching step specifically includes:
[0029] Makeup matching step: deriving multiple makeup looks based on multiple user facial images and a makeup model constructed in the system, and selecting the recommended makeup look from the multiple makeup looks based on the user's dress code; the user's dress code is selected by the user through the interactive interface of the WeChat mini-program on the mobile terminal device, the dress code set in the system, or extracted based on the user's full-body image;
[0030] The method of obtaining a plurality of makeup looks based on a plurality of user facial images and a makeup model constructed in the system specifically includes: performing facial feature analysis on the plurality of user facial images to extract the user's facial features to construct a facial feature vector of the user, then matching the constructed facial feature vector of the user with the makeup model constructed in the system to obtain a matching facial feature vector, thereby obtaining a corresponding facial image, and obtaining a corresponding recommended makeup look based on the corresponding facial image; wherein, the method comprises collecting a plurality of makeup looks and performing feature analysis on the facial image corresponding to each makeup look to obtain the facial features corresponding to the facial image of each makeup look; the facial features include the user's face shape, eye shape, eyebrow shape, lip shape, and skin color; then using a neural network model to perform model training on each of the above makeup looks and the corresponding facial images and facial features to construct a correlation between the makeup looks and the facial features, thereby obtaining the makeup model;
[0031] Tutorial acquisition step: Split the makeup steps according to the final recommended makeup look selected by the user to generate several makeup sub-steps, obtain the tutorial of each makeup sub-step from the system, and then generate a makeup tutorial for the final recommended makeup look selected by the user, and then play the makeup tutorial for the final recommended makeup look selected by the user through the human-computer interactive display screen;
[0032] Makeup steps: When the user chooses to apply makeup by themselves, the first electronic lock of the smart makeup box is controlled to open the smart makeup box, providing shared cosmetics to the user, allowing the user to apply makeup according to the makeup tutorial of the final recommended makeup look selected by the user; and when the user completes the makeup, a makeup order is generated and the makeup fee is calculated to generate a makeup payment QR code, so that the user can pay the makeup fee by scanning the QR code;
[0033] Reservation steps: When a user chooses to make an appointment for makeup, a number of recommended makeup artists are generated based on the final recommended makeup look selected by the user and the makeup artists registered in the system. Then, a number of makeup appointment orders are generated based on the user's selected area, the user's desired appointment time, and the appointment status of each recommended makeup artist. After sorting according to preset rules, the sorted makeup appointment orders are displayed to the user through the human-computer interactive display screen; and when the user selects a corresponding makeup appointment order, an appointment notification is generated and sent to the user and the corresponding makeup artist;
[0034] Cosmetics recommendation step: Recommend corresponding cosmetics to the user based on the cosmetics used in the final recommended makeup selected by the user.
[0035] The third object of the present invention is achieved by adopting the following technical solution:
[0036] A computer-readable storage medium stores an intelligent recommendation program, which is a computer program. When the intelligent recommendation program is executed by a processor, it implements the steps of an intelligent recommendation method for beauty services as adopted in the second purpose of the present invention.
[0037] Compared with the prior art, the present invention has the following beneficial effects:
[0038] The present invention combines shared intelligent cabinets and collects data on the user's facial features to design the user's makeup, automatically matching the user with a makeup that suits him or her, and avoiding the problem that the user cannot design a makeup that suits him or her. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 This is a module diagram of an intelligent push system for beauty services provided by the present invention;
[0040] Figure 2 This is a flow chart of an intelligent push method for beauty services provided by the present invention;
[0041] Figure 3 for Figure 2 Flowchart of step S3 in FIG. DETAILED DESCRIPTION
[0042] The present invention will be further described below in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form new embodiments.
[0043] Example 1
[0044] The present invention provides an intelligent recommendation system for beauty and makeup services, which can solve the problem in the prior art that it is difficult to choose a beauty and makeup look that suits you. Figure 1 As shown, the present invention provides a preferred embodiment, an intelligent recommendation system for beauty services, including: a front-end interaction platform and a remote data processing platform.
[0045] The front-end interactive platform includes a shared smart cabinet, a smart makeup mirror installed within the cabinet, and a mobile terminal. Specifically, the smart makeup mirror, located within the shared smart cabinet, includes a base and a human-computer interaction display screen mounted on the base. The base houses a main control module, a remote communication module, and a local communication module.
[0046] The main control module is connected to the remote data processing platform through the remote communication module to realize data interaction, such as feeding back the collected data to the remote data processing platform, or receiving signals or data sent by the remote data processing platform. The main control module is connected to the mobile terminal device through the local communication module. Specifically, the local communication module is a Bluetooth communication module, and the mobile terminal device is connected to the main control module through the Bluetooth communication module to realize human-computer interaction. At the same time, when the mobile terminal device scans the QR code on the shared smart cabinet through WeChat and obtains the user's authorized login information, the login information sent by the mobile terminal device is obtained through the local communication module and the login information is sent to the remote data processing platform through the remote communication module, so that the remote data processing platform verifies the login information. After the mobile terminal device logs in successfully, it enters the WeChat applet to realize human-computer interaction.
[0047] When the login information is verified, the remote data processing platform sends a verification success signal to the main control module. The main control module drives the first electronic lock to open the door of the shared smart cabinet, allowing the user to enter the shared smart cabinet. At the same time, the shared smart cabinet can be manually closed.
[0048] When the shared smart cabinet is not closed, the devices in the shared smart cabinet, such as the camera module, human-computer interaction display screen, etc., will not enter the working state to avoid the situation where the user forgets to close the shared smart cabinet.
[0049] When the user enters the smart cabinet and manually closes the door of the shared smart cabinet, the main control module will control the voice module to play corresponding music or voice to make the user happy.
[0050] Preferably, the shared smart cabinet has a door with a first electronic lock installed on the door, which is used to open and close the door. The main control module is electrically connected to the first electronic lock and is used to drive and control the opening of the first electronic lock to control the opening and closing of the door. Under normal circumstances, the door of the shared smart cabinet is closed. When a user uses the shared smart cabinet, the main control module controls the first electronic lock to open, thereby opening the door of the shared smart cabinet.
[0051] More specifically, a first camera module is also provided in the shared smart cabinet. The main control module is electrically connected to the first camera module. When a user enters the shared smart cabinet and the cabinet door is closed, the first camera module is activated to capture the user's face from multiple angles to obtain multiple facial images of the user from different shooting angles. The multiple facial images of the user are then transmitted to the remote data processing platform via the remote communication module.
[0052] The remote data processing platform matches multiple received user facial images with the makeup models built by the system to generate matching results. It then generates recommended makeup looks based on these matching results and feeds these recommended looks back to the main control module. The main control module is electrically connected to the human-computer interaction display screen and displays the received recommended looks in a list format on the display screen for the user to review.
[0053] More specifically, the main control module is also configured to display the recommended makeup look to the user in the form of an animated video on the human-computer interactive display screen when the user selects the corresponding recommended makeup look. This invention captures the user's face to obtain a facial image, and then identifies the user's facial features. Based on these facial features, the invention identifies a more suitable makeup look for the user, thus resolving the existing problem of users being unable to find makeup that suits them.
[0054] More specifically, the shared smart cabinet is equipped with a second camera module, electrically connected to the main control module, for capturing a full-body image of the user. The main control module is responsible for transmitting the full-body image to a remote data processing platform. When the remote data processing platform generates a recommended makeup look, it is further responsible for merging the recommended look with the full-body image of the user to generate an overall image of the user's makeup application.
[0055] More preferably, when developing makeup recommendations, the backend data processing platform first derives several makeup looks based on multiple user facial images and a makeup model constructed in the system. The platform then selects a recommended makeup look from among these looks based on the user's dress code. The user's dress code is determined by selecting a dress code set in the system or extracted from a full-body image of the user through the interactive interface of the WeChat mini-program on their mobile device. Because different dress codes often require different makeup looks, the user's dress code must also be considered when developing makeup recommendations.
[0056] More specifically, when the remote data processing platform in the present invention matches the user's facial image with the makeup model, it also specifically includes: first performing facial feature analysis based on multiple user facial images to extract the user's facial features, and then constructing the user's facial feature vector.
[0057] The facial features include but are not limited to the following features: face shape, eye shape, lip shape, skin color, etc. The facial feature vector of the user is constructed by extracting the above facial features.
[0058] The user's facial feature vector is then matched with the makeup model constructed in the system to obtain a matching result. This means a facial feature vector that matches the user's facial feature vector is obtained, and then the makeup corresponding to the facial image corresponding to the matching facial feature vector is used as the recommended makeup.
[0059] This embodiment also collects multiple makeup looks and performs feature analysis on facial images corresponding to each makeup look to derive the facial features corresponding to each makeup look. A neural network model is then trained on each makeup look, its corresponding facial images, and its facial features to establish a correlation between the makeup looks and facial features, ultimately generating a makeup model. Furthermore, model training also takes into account factors such as the user's dress code and hairstyle.
[0060] Preferably, the smart makeup mirror is also equipped with a voice module. When the user enters the shared smart cabinet and turns on the makeup design, the main control module can also start the voice module of the smart makeup mirror to remind the user how to operate by voice, and at the same time start the camera module to shoot the user to obtain the user's facial feature image and full-body image. More preferably, there are multiple facial images and full-body images of the user, and the camera module is rotated to clearly shoot the user's facial image so that the user's facial features can be extracted based on the multiple facial images of the user. By shooting multiple facial images, the user's facial features can be extracted more accurately, because during shooting, a certain part may not be clearly shot due to problems with lighting or angle. Therefore, by shooting multiple facial images at different angles, the user's facial features can be more accurately obtained.
[0061] In addition, users can scan the QR code through WeChat on their mobile devices to register or log in, while also accessing the WeChat mini-program for human-computer interaction. That is, after entering the shared smart cabinet, users can also access the corresponding interactive page of the WeChat mini-program through their mobile devices to interact with the main control module.
[0062] Preferably, the remote data processing platform is also used to split the makeup steps according to the final recommended makeup look selected by the user to generate several makeup sub-steps, and obtain the tutorial of each makeup sub-step from the system, and then generate the makeup tutorial of the final recommended makeup look based on the tutorials of all makeup sub-steps and feed it back to the main control module. The main control module pushes the makeup tutorial of the final recommended makeup look to the human-computer interaction display screen for playback for the user's reference, so that the user can implement the makeup of the final recommended tutorial by referring to the tutorial.
[0063] More specifically, the tutorial for each makeup sub-step can be in the form of video or text. Of course, the tutorial can also be provided in detailed and simple versions according to actual needs for different users to choose from.
[0064] By providing users with suitable makeup and tutorials for suitable makeup, it is convenient for users to learn makeup skills according to the tutorials, avoiding users from blindly searching for some scattered makeup and makeup skills that are not suitable for themselves on TV or the Internet.
[0065] Furthermore, if the user chooses to apply their own makeup, the present invention also provides shared cosmetics for their use. Specifically, a dressing table is located on top of the base, which has a cosmetics placement area. This area houses a smart makeup box, which contains shared cosmetics. If the user chooses to apply their own makeup, the main control module controls the second electronic lock of the smart makeup box in the cosmetics placement area to open the smart makeup box, providing the user with shared cosmetics. The user can then apply their makeup according to the final recommended makeup tutorial.
[0066] When the user completes their makeup application, the main control module generates a makeup order, calculates the makeup fee, and then generates a makeup payment QR code for the user to scan and pay. The makeup fee calculation is based on system-defined factors such as the makeup design fee, shared cosmetics usage fee, and makeup duration.
[0067] In addition, after the user has finished applying makeup, they can also choose whether to purchase the corresponding cosmetics. That is, when the user wants to purchase the corresponding cosmetics, the user can be recommended the cosmetics used in the corresponding makeup order for purchase. After the user successfully purchases, the user can pay the corresponding fee to generate the cosmetics order and fill in the mailing address. The backend will then mail the purchased cosmetics to the user's home according to the cosmetics order.
[0068] Furthermore, the main control module is also used to drive and control the first electronic lock of the shared smart cabinet door to open the shared smart cabinet door when the makeup fee payment is completed, thereby completing the makeup recommendation and makeup.
[0069] Furthermore, when a user doesn't know how to apply makeup or doesn't want to do it themselves, they can choose to schedule a makeup appointment. Specifically, when a user chooses to schedule a makeup appointment, the main control module transmits the user's selected final recommended makeup look, the user's selected area, the user's desired appointment time, and other appointment-related data to the remote data processing platform via the remote communication module. The remote data processing platform then matches the user's selected final recommended makeup look with the makeup artists registered in the system to generate a number of recommended makeup artists. The platform then generates a number of makeup appointment orders based on the user's selected area, the user's desired appointment time, and the appointment status of each recommended makeup artist. The order is sorted according to preset rules and fed back to the main control module.
[0070] The main control module is used to display the sorted makeup appointment orders to the user through the human-computer interactive display screen, so that the user can select the corresponding makeup appointment order. When the user selects the corresponding makeup appointment order, the main control module generates an appointment notification and sends it to the user and the corresponding makeup artist.
[0071] This invention uses a shared smart cabinet to collect users' facial features and provide them with makeup that suits them. It also provides intelligent recommendations for beauty services, tutorials for corresponding makeup looks, and shared cosmetics. Users with a basic makeup foundation can use makeup materials to apply makeup directly based on the recommended look, providing convenience. Tutorials are also provided for users who need to learn makeup techniques. Furthermore, users without a basic makeup background can make appointments with professional makeup artists.
[0072] Example 2
[0073] Based on the first embodiment, the present invention further provides an intelligent recommendation method for beauty services, which is applied to an intelligent recommendation system for beauty services provided in the first embodiment of the present invention. Figure 2 As shown, the intelligent recommendation method includes:
[0074] Step S1: Obtain authorized login information and verify the login information, and when the login information verification is successful, control the first electronic lock to open to open the door of the shared smart cabinet, so that the user can enter the shared smart cabinet.
[0075] Specifically, the user enters the WeChat applet by scanning with a mobile terminal device to authorize the login information so that the door of the shared smart cabinet can be opened after the login information is verified, allowing the user to enter the shared smart cabinet.
[0076] Step S2: photographing the user's face from multiple angles to obtain multiple facial images of the user at different shooting angles.
[0077] Specifically, when a user enters a shared smart cabinet and the door of the shared smart cabinet is closed, the user's face is photographed at multiple angles through the first camera module to obtain multiple user facial images at different shooting angles.
[0078] Step S3: derive recommended makeup based on multiple user facial images and the makeup model constructed in the system, and display the recommended makeup to the user in a list.
[0079] Step S4: When the user selects a corresponding recommended makeup look, the corresponding recommended makeup look is displayed to the user in an animated video.
[0080] By recognizing the user's facial image and combining it with the makeup model built by the system, the recommended makeup is obtained to achieve intelligent recommendation of makeup suitable for the user, and at the same time display it to the user through the human-computer interactive display.
[0081] Step S5: Acquire the full-body image of the user and synthesize the final recommended makeup selected by the user with the full-body image of the user to generate an overall effect image of the user after makeup and display it on a human-computer interactive display screen.
[0082] That is, the present invention also synthesizes the final recommended makeup look with the user's full-body image to obtain the overall effect after makeup, allowing the user to observe the effect after makeup more intuitively.
[0083] More preferably, if Figure 3 As shown, step S3 also includes:
[0084] Step S31: derive several makeup looks based on multiple user facial images and a makeup model constructed in the system, and derive a recommended makeup look based on the user's dress requirements and the several makeup looks.
[0085] The user's dress code is selected by the user through the interactive page of the WeChat applet on the mobile terminal device, the dress code set in the system or extracted based on the user's full-body image.
[0086] The facial features of the user in this embodiment include but are not limited to the following features: the user's face shape, eye shape, eyebrow shape, lip shape, skin color, etc.
[0087] More specifically, obtaining several makeups based on multiple user facial images and a makeup model constructed in the system specifically includes: performing facial feature analysis based on multiple user facial images to extract the user's facial features to construct the user's facial feature vector, and then matching the constructed user's facial feature vector with the makeup model constructed in the system to obtain a matching facial feature vector, and then obtaining the makeup corresponding to the corresponding facial image, and using it as the recommended makeup; wherein, by collecting multiple makeups and performing feature analysis on the facial images corresponding to each makeup to obtain the facial features corresponding to the facial images of each makeup; and then using a neural network model to perform model training on each of the above makeups and the corresponding facial images and facial features to construct a correlation between the makeup and the facial features, and then obtaining the makeup model.
[0088] By pre-building the association between makeup and facial features, we can achieve intelligent recommendations for users' makeup based on their facial features, so that users can choose makeup that is more suitable for them.
[0089] Step S32: Split the makeup steps according to the final recommended makeup look selected by the user to generate several makeup sub-steps, obtain the tutorial of each makeup sub-step from the system, and then generate a makeup tutorial for the final recommended makeup look selected by the user, and then play the makeup tutorial for the final recommended makeup look selected by the user through the human-computer interactive display screen.
[0090] The present invention also provides makeup tutorials to guide users in applying makeup, providing a reference for users to learn, and avoiding the problem that users blindly search for makeup tutorials that are not suitable for them on the Internet or on TV.
[0091] Step S33: When the user chooses to put on makeup by herself, the first electronic lock of the smart makeup box is controlled to open the smart makeup box, and shared cosmetics are provided to the user, so that the user can put on makeup according to the makeup tutorial of the final recommended makeup look selected by the user; and when the user finishes putting on makeup, a makeup order is generated and the makeup fee is calculated to generate a makeup charging QR code, so that the user can pay the makeup fee by scanning the QR code.
[0092] When users choose to put on makeup by themselves, they can do so according to makeup tutorials and the shared cosmetics provided, providing convenience for users.
[0093] Step S34: When the user chooses to make an appointment for makeup, several recommended makeup artists are obtained based on the final recommended makeup selected by the user and the makeup artists registered in the system. Then, several makeup appointment orders are generated based on the area selected by the user, the user's desired appointment time, and the appointment status of each recommended makeup artist. The orders are sorted according to preset rules and then displayed to the user through the human-computer interactive display screen; and when the user selects a corresponding makeup appointment order, an appointment notification is generated and sent to the user and the corresponding makeup artist.
[0094] When users need to find a professional makeup artist, they can make an appointment through the platform to find a professional makeup artist to do their makeup. The present invention provides multiple options and is more suitable for users with different needs.
[0095] Example 3
[0096] A computer-readable storage medium stores an intelligent recommendation program, which is a computer program. When the intelligent recommendation program is executed by a processor, it implements the steps of an intelligent recommendation method for beauty services provided in Example 2 of the present invention.
[0097] The above embodiments are only preferred embodiments of the present invention and cannot be used to limit the scope of protection of the present invention. Any non-substantial changes and replacements made by technicians in this field on the basis of the present invention fall within the scope of protection required by the present invention.
Claims
1. An intelligent recommendation system for beauty services, characterized in that: The intelligent recommendation system includes: a front-end interactive platform and a remote data processing platform; wherein the front-end interactive platform includes a mobile terminal device, a shared smart cabinet and a smart beauty mirror provided in the shared smart cabinet; The smart makeup mirror includes a base and a human-computer interaction display screen provided on the base; a main control module, a remote communication module, and a local communication module are provided in the base; the main control module is connected to the remote data processing platform via the remote communication module, and the main control module is connected to the mobile terminal device via the local communication module; The shared smart cabinet is further provided with a cabinet door, on which a first electronic lock is installed; the main control module is electrically connected to the first electronic lock, and is configured to drive and control the first electronic lock to open the cabinet door when the mobile terminal device scans the WeChat applet QR code on the shared smart cabinet to authorize login information, and after the login information is verified, drive and control the first electronic lock to open the cabinet door; A first camera module is provided in the shared smart cabinet; the main control module is electrically connected to the first camera module, and is configured to activate the first camera module to shoot the user's face from multiple angles when the user enters the shared smart cabinet and the cabinet door of the shared smart cabinet is closed, so as to obtain multiple user facial images at different shooting angles, and upload the multiple user facial images to the remote data processing platform via the remote communication module; The remote data processing platform is used to obtain matching results based on multiple user facial images and the makeup model constructed in the system, and then obtain recommended makeup based on the matching results and feed the recommended makeup back to the main control module, so that the main control module displays the recommended makeup in a list on the human-computer interaction display screen and plays the corresponding recommended makeup animation video on the human-computer interaction display screen when the user selects the corresponding recommended makeup.
2. The intelligent recommendation system for beauty services according to claim 1, characterized in that: The shared smart cabinet is further provided with a second camera module, the main control module being electrically connected to the second camera module and further configured to capture a full-body image of the user and transmit the full-body image of the user to the remote data processing platform, so that the remote data processing platform synthesizes each recommended makeup look with the full-body image of the user to obtain an overall schematic diagram of the user after applying makeup; And when the user selects the corresponding recommended makeup, the overall schematic diagram of the corresponding user after makeup will also be displayed on the human-computer interaction display screen.
3. The intelligent recommendation system for beauty services according to claim 2, characterized in that: The remote data processing platform is further configured to first derive a plurality of makeup looks based on a plurality of user facial images and a makeup model constructed in the system, and select the recommended makeup look from the plurality of makeup looks based on the user's dress requirements; The user's dress code is selected by the user through the interactive page of the WeChat applet of the mobile terminal device or is derived based on the user's full-body image.
4. The intelligent recommendation system for beauty services according to claim 1, characterized in that: The main control module is further configured to send the login information authorized by the mobile terminal device to the remote data processing platform via the remote communication module, so that the remote data processing platform verifies the login information; When the login information is verified, the remote data processing platform is further configured to send a verification success notification to the main control module, so that the main control module drives and controls the first electronic lock to open according to the verification success notification.
5. The intelligent recommendation system for beauty services according to claim 1, characterized in that: The remote data processing platform is also used to split the makeup steps according to the final recommended makeup look selected by the user to generate several makeup sub-steps, and obtain the tutorial of each makeup sub-step from the system to generate a makeup tutorial for the final recommended makeup look selected by the user and feed it back to the main control module, so that the main control module plays the makeup tutorial through the human-computer interactive display screen.
6. The intelligent recommendation system for beauty services according to claim 5, characterized in that: A dressing table is also provided on the top of the base, which has a cosmetics placement area. A smart cosmetics box is installed in the cosmetics placement area, and shared cosmetics are placed in the smart cosmetics box. The main control module is further configured to, when the user chooses to apply makeup by themselves, control the second electronic lock of the smart makeup box to open the smart makeup box, provide shared cosmetics to the user, and enable the user to apply makeup according to the makeup tutorial of the final recommended makeup look selected by the user; and when the user completes makeup, generate a makeup order and calculate the makeup fee to generate a makeup fee QR code, so that the user can pay the makeup fee by scanning the QR code; the main control module is further configured to, when the makeup fee payment is completed, drive and control the first electronic lock of the cabinet door of the shared smart cabinet to open the cabinet door of the shared smart cabinet; The main control module is further configured to, when a user chooses to make an appointment for makeup, send the user's selected recommended makeup look, the user's selected area, and the user's desired appointment time to the remote data processing platform via the remote communication module, so that the remote data processing platform is configured to match the user's selected recommended makeup look with the makeup artists registered in the system to obtain a number of recommended makeup artists, and then generate a number of makeup appointment orders based on the user's selected area, the user's desired appointment time, and the appointment status of each recommended makeup artist, sort the orders according to preset rules, and then send the sorted makeup appointment orders to the main control module; The main control module is used to display the sorted makeup appointment orders to the user so that the user can select the corresponding makeup appointment order, and when the user selects the corresponding makeup appointment order, generate an appointment notification and send it to the corresponding makeup artist and the user; The main control module is further used to recommend cosmetics to the user based on the cosmetics used in the recommended makeup, so that the user can select the recommended cosmetics.
7. The intelligent recommendation system for beauty services according to claim 1, characterized in that: The remote data processing platform is also used to first perform facial feature analysis based on multiple user facial images to extract the user's facial features and construct the user's facial feature vector, and then match the constructed user's facial feature vector with the makeup model constructed in the system to obtain a matching facial feature vector, and then obtain the makeup corresponding to the corresponding facial image, and feed it back to the main control module as a recommended makeup; wherein, by collecting multiple makeups and performing feature analysis on the facial images corresponding to each makeup to obtain the facial features corresponding to the facial images of each makeup; the facial features include the user's face shape, eye shape, eyebrow shape, lip shape, and skin color; then a neural network model is used to perform model training on each of the above makeups and the corresponding facial images and facial features to construct a correlation between the makeup and the facial features, and then obtain the makeup model.
8. An intelligent recommendation method for beauty and cosmetics services, applied to an intelligent recommendation system for beauty and cosmetics services according to any one of claims 1 to 7, characterized in that: The intelligent recommendation method includes: Login step: obtaining authorized login information and verifying the login information, and when the login information verification is successful, controlling the first electronic lock to open the door of the shared smart cabinet, thereby allowing the user to enter the shared smart cabinet; Data acquisition step: photographing the user's face from multiple angles to obtain multiple facial images of the user at different shooting angles; Recommendation matching step: based on multiple user facial images and the makeup model constructed in the system, a recommended makeup look is obtained, and the recommended makeup looks are displayed in a list on the human-computer interactive display screen; and when the user selects a corresponding recommended makeup look, the corresponding recommended makeup look is played as an animated video on the human-computer interactive display screen; Display step: obtaining a full-body image of the user and synthesizing the final recommended makeup selected by the user with the full-body image of the user to generate an overall effect image of the user after makeup and displaying it through a human-computer interactive display screen.
9. The intelligent recommendation method for beauty services according to claim 8, characterized in that: The recommended matching step specifically includes: Makeup matching step: deriving multiple makeup looks based on multiple user facial images and a makeup model constructed in the system, and selecting the recommended makeup look from the multiple makeup looks based on the user's dress code; the user's dress code is selected by the user through the interactive interface of the WeChat mini-program on the mobile terminal device, the dress code set in the system, or extracted based on the user's full-body image; The method of obtaining a plurality of makeup looks based on a plurality of user facial images and a makeup model constructed in the system specifically includes: performing facial feature analysis on the plurality of user facial images to extract the user's facial features to construct a facial feature vector of the user, then matching the constructed facial feature vector of the user with the makeup model constructed in the system to obtain a matching facial feature vector, thereby obtaining a corresponding facial image, and obtaining a corresponding recommended makeup look based on the corresponding facial image; wherein, the method comprises collecting a plurality of makeup looks and performing feature analysis on the facial image corresponding to each makeup look to obtain the facial features corresponding to the facial image of each makeup look; the facial features include the user's face shape, eye shape, eyebrow shape, lip shape, and skin color; then using a neural network model to perform model training on each of the above makeup looks and the corresponding facial images and facial features to construct a correlation between the makeup looks and the facial features, thereby obtaining the makeup model; Tutorial acquisition step: Split the makeup steps according to the final recommended makeup look selected by the user to generate several makeup sub-steps, obtain the tutorial of each makeup sub-step from the system, and then generate a makeup tutorial for the final recommended makeup look selected by the user, and then play the makeup tutorial for the final recommended makeup look selected by the user through the human-computer interactive display screen; Makeup steps: When the user chooses to apply makeup by themselves, the first electronic lock of the smart makeup box is controlled to open the smart makeup box, providing shared cosmetics to the user, allowing the user to apply makeup according to the makeup tutorial of the final recommended makeup look selected by the user; and when the user completes the makeup, a makeup order is generated and the makeup fee is calculated to generate a makeup payment QR code, so that the user can pay the makeup fee by scanning the QR code; Reservation steps: When a user chooses to make an appointment for makeup, a number of recommended makeup artists are generated based on the final recommended makeup look selected by the user and the makeup artists registered in the system. Then, a number of makeup appointment orders are generated based on the user's selected area, the user's desired appointment time, and the appointment status of each recommended makeup artist. After sorting according to preset rules, the sorted makeup appointment orders are displayed to the user through the human-computer interactive display screen; and when the user selects a corresponding makeup appointment order, an appointment notification is generated and sent to the user and the corresponding makeup artist; Cosmetics recommendation step: Recommend corresponding cosmetics to the user based on the cosmetics used in the final recommended makeup selected by the user.
10. A computer-readable storage medium having an intelligent recommendation program stored thereon, characterized in that: The intelligent recommendation program is a computer program, and when the intelligent recommendation program is executed by a processor, it implements the steps of the intelligent recommendation method for beauty services as described in any one of claims 1 to 8.
Citation Information
Patent Citations
Intelligent makeup box and intelligent makeup method
CN106213751A
Information recommendation method, device and system and storage medium
CN112131457A