Intelligent makeup mirror and intelligent makeup method thereof

The intelligent makeup mirror, which combines a real-world mirror layer and a virtual display layer, uses a central processing unit and an image acquisition module to generate a 3D virtual model. This solves the problem of lacking real-time makeup comparison in existing technologies, enabling accurate guidance and improved efficiency in the makeup process.

CN114860073BActive Publication Date: 2025-11-21SHANDONG CARLSMY HOUSEWARE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210415605.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-19
Publication Date
2025-11-21
Estimated Expiration
2042-04-19

AI Technical Summary

Technical Problem

Existing smart makeup mirrors cannot provide real-time and effective guidance on the makeup process in a hybrid virtual and real-world manner, lacking accurate makeup comparison and real-time makeup process guidance.

Method used

By combining a real-world mirror layer and a virtual display layer, and through the cooperation of a central processing unit, an image acquisition module, and a lighting module, the system collects user facial data in real time, generates a 3D virtual model, and overlays virtual makeup images on the real-world mirror layer to achieve hybrid virtual reality makeup guidance.

Benefits of technology

It enables real-time and accurate makeup comparison and guidance during the makeup process, improving makeup efficiency and saving users' makeup time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114860073B_ABST
    Figure CN114860073B_ABST
Patent Text Reader

Abstract

The application discloses an intelligent cosmetic mirror, comprising a real mirror layer, a virtual image layer, an image acquisition module and a central processing unit, wherein the central processing unit is provided with cooperating modules, such as a makeup database, a user face 3D virtual model generation module, a makeup virtual image module and a real-time position module, external connection and data storage are realized, and a specific intelligent makeup method is also disclosed; the application can accurately collect face information of a user and establish a makeup file for the user; firstly, the skin state of the user is judged through the face image of the user, and multiple makeup schemes are recommended for the user to select; after the user selects a makeup scheme, makeup is completed according to the disassembly steps in the central processing unit in sequence and compared with the virtual image of the makeup effect in real time, online guidance is obtained, the makeup effect of the user is made to be as close as possible to the makeup effect displayed on the virtual image layer, and the makeup efficiency of the user is improved, and the makeup time of the user is saved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of cosmetic equipment technology, and more particularly to an intelligent cosmetic mirror, as well as an intelligent makeup method using the intelligent cosmetic mirror. Background Technology

[0002] With the continuous development and advancement of technology, more and more smart products are being developed and applied to people's work and life. Smart makeup mirrors are one such example. Composed of a mirror display glass, camera, and data processor, they can collect facial data and simulate the effect of makeup application. They are convenient and quick to use, reducing trial makeup time and improving makeup efficiency, making them popular among users. However, the technology of smart makeup mirrors currently on the market is still immature. They generally collect static facial images of the user, generate makeup effects in the background, and then project them onto a display that is separate from or directly covers / replaces the mirror. Therefore, customers can only choose to view the image presented on the display or directly turn off the display to restore the mirror function or state. They cannot effectively and continuously observe the entire makeup process in a hybrid virtual and real-world manner to obtain accurate makeup comparisons and guidance. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide an intelligent makeup mirror that can effectively observe the entire makeup process in real time in a hybrid virtual and real way, so as to obtain accurate makeup comparison and makeup process guidance.

[0004] To solve the above-mentioned technical problems, the technical solution of the present invention is: a smart makeup mirror, comprising:

[0005] The reality mirror layer is a mirror with reflectivity and light transmittance, which presents a realistic image of the user's face through reflection;

[0006] A virtual display layer is an electronic display device located behind the real mirror layer, used to display a virtual image of the user's makeup process, which is presented to the user through the real mirror layer.

[0007] An image acquisition module is arranged around the periphery and / or the rear of the real mirror layer, and is used to acquire the user's facial feature image data in real time.

[0008] The central processing unit (CPU) is connected to a makeup database for user selection. The CPU includes a user face 3D virtual model generation module that processes data from the image acquisition module to obtain a user face 3D virtual model. The CPU also includes a makeup virtual image module that adjusts and matches the user's selected makeup scheme with the user face 3D virtual model to generate a user face virtual image. The CPU further includes a module that uses the image acquisition module to acquire the real-time position of the user's face image on the real-world mirror layer. The CPU displays the user face virtual image on the real-time position of the user's face image through the virtual display layer, thus superimposing the user face virtual image onto the user's face image to form a visual image for the user.

[0009] The central processing unit (CPU) is equipped with a brightness adjustment module that adjusts the brightness of the virtual display layer and / or the user's virtual makeup image according to user instructions. The CPU's output terminal is also equipped with an illumination module, which is arranged around the periphery of the real-world mirror layer and / or behind it, to provide supplemental lighting to the user's face, thereby adjusting the brightness of the user's real-world facial image reflected by the real-world mirror layer. The brightness adjustment module and the illumination module work together to adjust the brightness ratio between the user's real-world facial image and the user's virtual makeup image, obtaining a makeup guidance screen as seen by the user's naked eye. This makeup guidance screen is the user's visual image composed of completely transmitted light, transmitted light dominance, a mixture of transmitted and reflected light, reflected light dominance, or completely reflected light.

[0010] The input terminal of the central processing unit is also equipped with a command input module, a voice interaction module, a network connection module, and a data storage module.

[0011] As a preferred technical solution, the real-world mirror layer is configured as mirror glass, a one-way mirror, a glass layer that is both transparent and reflective, or an acrylic layer that is both transparent and reflective.

[0012] As a preferred technical solution, the electronic display device is a display screen, a display coating, a display film, or a projection device.

[0013] As a preferred technical solution, the image acquisition module is configured as an angle-adjustable optical camera, an infrared camera, a rangefinder, a millimeter-wave radar, and / or a laser scanner.

[0014] As a preferred technical solution, the central processing unit is signal-connected to a remote server, and the makeup database is set on the central processing unit and / or the remote server.

[0015] As a preferred technical solution, the data storage module is configured as a local memory connected to the central processing unit and / or a remote memory connected to the remote server.

[0016] As a preferred technical solution, the virtual makeup image generated by the makeup virtual image module includes virtual makeup effect image, step-by-step makeup virtual image, and area-by-area makeup virtual image.

[0017] As a preferred technical solution, the command input module includes touch input, key input, voice input, gesture input, eye-tracking input, and / or smartphone app input.

[0018] As a preferred technical solution, the central processing unit also includes a makeup effect comparison and evaluation module.

[0019] This invention also relates to an intelligent makeup method using the intelligent makeup mirror, comprising the following steps:

[0020] SP1, User Identity Information Collection

[0021] When a user uses the system for the first time, the central processing unit collects and stores the user's gender, age, and preferences information in a question-and-answer manner through the command input module, the voice interaction module, and / or the network connection module, and establishes a user identity profile.

[0022] SP2, User Facial Information Database Establishment

[0023] SP 2-1 The central processing unit controls the lighting module to illuminate the user's face at different angles, brightness and / or colors, and the image acquisition module collects the user's facial feature image data and transmits it to the central processing unit. The central processing unit combines the light reflection data from the lighting module with the user's 3D virtual face model generation module to generate the user's 3D virtual face model and stores it in the central processing unit.

[0024] SP 2-2 The central processing unit analyzes the user's skin condition based on the facial feature image data collected by the image acquisition module, determines the user's current skin age group, and compares it with the user's actual age in the user identity file established in step SP1. The comparison result, the user's 3D virtual facial model, and the user identity file are stored together to obtain the user facial information database.

[0025] SP3, push makeup ideas and try-on makeup

[0026] SP 3-1The central processing unit pushes the makeup plan to the customer based on the information in the user's facial information database and displays it on the electronic display device for the user to view and select;

[0027] SP 3-2 Users can access and select makeup options displayed on the electronic display device through the command input module, the voice interaction module, and / or the network connection module.

[0028] SP 3-3 The central processing unit receives the makeup scheme instruction selected by the user, adjusts and matches the makeup scheme with the user's 3D virtual facial model using the makeup virtual image module to generate a makeup effect virtual image that fits the user's facial structure, and the central processing unit transmits the makeup effect virtual image to the electronic display device for display so that the user can preview it;

[0029] SP 3-4 After previewing the virtual image of the user's makeup, the user can see the makeup effect. If the user is satisfied with the makeup effect, the user can select the makeup plan and start the makeup process.

[0030] SP 3-5 The interactions between users and other users during this process will be included in a database that analyzes user preferences, thereby more accurately pushing makeup looks that users like.

[0031] SP4, Step-by-Step Makeup and Instructions

[0032] SP 4-1 The central processing unit breaks down the selected makeup scheme into step-by-step virtual makeup images according to the makeup steps, and projects the step-by-step virtual makeup images onto the electronic display device for display. The user then performs the makeup process according to the step-by-step virtual makeup images.

[0033] SP 4-2 The central processing unit (CPU) works with the real-time position module and the image acquisition module to obtain the real-time position of the user's facial image on the real-world mirror layer. The CPU displays the step-by-step makeup virtual image on the real-time position of the user's facial image through the electronic display device, thereby obtaining the user's visual image, which is formed by superimposing the step-by-step makeup virtual image and the user's facial image in real time. The CPU displays the user's visual image in real time through the electronic display device, and the user can see the real-time makeup effect through the user's visual image and perform makeup step by step.

[0034] SP 4-3During the user's makeup application process, the central processing unit (CPU) tracks the user's eyes in real time through the image acquisition module and dynamically analyzes the user's visual focus area. The user can selectively adjust the brightness of the user's real facial image reflected by the real mirror layer within the visual focus area through the CPU and the lighting module. The CPU and the brightness adjustment module can also selectively adjust the brightness of the electronic display device and / or the step-by-step makeup virtual image within the visual focus area to form a regional makeup virtual image. This allows for the adjustment of the brightness ratio between the local real facial image of the user within the visual focus area and the regional makeup virtual image, resulting in a makeup guidance screen that the user sees with their naked eye.

[0035] SP 4-4 During the user's makeup application process, the image acquisition module collects the user's facial color changes and current makeup image data in real time and transmits them to the central processing unit. The central processing unit compares the current makeup image data with the step-by-step virtual makeup image in real time, analyzes the makeup differences, and provides online prompts and guidance to the user.

[0036] SP 4-5 After completing each step of the makeup process, the user sends a command through the command input module, the voice interaction module, and / or the network connection module to proceed to the next step of the makeup process.

[0037] SP 4-6 After makeup is completed, the image acquisition module collects facial feature image data of the user after makeup and stores it in the central processing unit, forming a real image of the user's face after makeup in the central processing unit. The makeup effect comparison and evaluation module compares the real image of the user's face after makeup with the virtual image of makeup effect, and generates a makeup comparison evaluation based on the comparison results, and stores it together with the user's makeup process in the user's facial information database.

[0038] By adopting the above technical solution, the present invention has the following beneficial effects: through the cooperation of the central processing unit, the image acquisition module, and the lighting module, the user's facial information is accurately acquired, and a makeup profile is established for the user; firstly, the user's skin condition is judged based on the user's facial image, and multiple makeup schemes are recommended for the user to choose from; after the user selects a makeup scheme, the user completes the makeup application by following the disassembly steps in the central processing unit and compares the makeup effect with the virtual image in real time to obtain online guidance, so that the user's makeup effect is as close as possible to the makeup effect displayed in the virtual display layer, thereby improving the user's makeup efficiency and saving the user's makeup time. Attached Figure Description

[0039] The accompanying drawings are intended only to illustrate and explain the present invention and do not limit the scope of the invention.

[0040] in:

[0041] Figure 1 This is a simplified connection block diagram of the peripheral components of the central processing unit in an embodiment of the present invention;

[0042] Figure 2 This is a flowchart illustrating the process of an embodiment of the present invention. Detailed Implementation

[0043] The present invention will be further described below with reference to the accompanying drawings and embodiments. In the following detailed description, only certain exemplary embodiments of the invention are described by way of illustration. Undoubtedly, those skilled in the art will recognize that various modifications can be made to the described embodiments without departing from the spirit and scope of the invention. Therefore, the drawings and description are illustrative in nature and not intended to limit the scope of the claims.

[0044] like Figure 1 As shown, the smart makeup mirror includes a real-image layer, a virtual display layer, a central processing unit, an image acquisition module, and a lighting module. It enables users to select makeup schemes, preview makeup effects before application, and receive makeup guidance during the application process, thereby improving makeup efficiency and saving time. The real-image layer is a mirror with reflectivity and translucency, reflecting a real image of the user's face. It can be constructed from mirror glass, a one-way mirror, any glass layer with both translucency and reflectivity, any acrylic layer with both translucency and reflectivity, or any material with both translucency and reflectivity. Both have real-image imaging capabilities, differing only slightly in their translucency and reflectivity, as detailed in the table below.

[0045] name Light transmittance reflectivity One-way mirror 10% 90% Mirror glass 30% 70%

[0046] The virtual display layer is an electronic display device located behind the real mirror layer, used to display a virtual image of the user's makeup process. This virtual image is presented to the user through the real mirror layer. The electronic display device can be a display screen, a display coating, a display film, or a projection device. If it is a display screen, it consists of an LCD screen, backlight, LVDS / RGB color display, capacitive touch, etc., which is well-known to those skilled in the art and will not be described in detail here. The image acquisition module is arranged around the periphery and / or behind the real mirror layer, used to acquire the user's facial feature image data in real time. It can be an angle-adjustable optical camera, infrared camera, rangefinder, millimeter-wave radar, laser scanner, and / or other acquisition devices that can provide imaging or depth information. The number of modules can be determined according to specific usage. The central processing unit is connected to a makeup database for user selection. The central processing unit is signal-connected to a remote server. The makeup database is located on the central processing unit and / or the remote server, enabling shared use of the makeup database within the remote server. The central processing unit is equipped with a power connection module, which is used to provide the central processing unit with operating voltage, typically 12V DC voltage.

[0047] The central processing unit (CPU) includes a user face 3D virtual model generation module that processes the data from the image acquisition module to obtain a user face 3D virtual model. The CPU also includes a makeup virtual image module that adjusts and matches the user's selected makeup scheme with the user face 3D virtual model to generate a user makeup virtual image. Throughout the entire usage process of this embodiment, the user makeup virtual image generated by the makeup virtual image module includes a makeup effect virtual image, a step-by-step makeup virtual image, and a region-by-region makeup virtual image. Before applying makeup, the user selects a makeup style. The virtual makeup image module then adjusts and matches the selected style with the user's 3D facial virtual model, generating a virtual image of the makeup effect for the user to preview. During the makeup process, the virtual makeup image module adjusts and matches the selected style with the user's 3D facial virtual model, generating step-by-step virtual makeup images to allow the user to preview the makeup effect at each step. Additionally, during the makeup process, the virtual makeup image module adjusts and matches the selected style with the user's 3D facial virtual model, generating area-specific virtual makeup images so the user can monitor the makeup process in real time and make timely adjustments or modifications based on guidance.

[0048] The central processing unit (CPU) is equipped with a module that acquires the real-time position of the user's facial image on the real-world mirror layer via the image acquisition module. The CPU displays the user's virtual makeup image onto the real-time position of the user's facial image through the virtual display layer, thus superimposing the virtual makeup image onto the user's facial image to form a visual image for the user. During the makeup process, the cooperation between the real-time position module and the image acquisition module ensures that the step-by-step and area-by-area virtual makeup images can be accurately superimposed on the user's facial image in real time, facilitating a smooth makeup application.

[0049] The central processing unit (CPU) is equipped with a brightness adjustment module that adjusts the brightness of the virtual display layer and / or the user's virtual makeup image according to user instructions. The CPU's output also includes a lighting module, which is configured as a fill light and specifically arranged around the periphery and / or rear of the real-world mirror layer to provide fill light to the user's face, thereby adjusting the brightness of the user's facial image reflected by the real-world mirror layer. The brightness adjustment module and the lighting module work together to adjust the brightness ratio between the user's facial image and the user's virtual makeup image, obtaining a makeup guidance screen as seen by the user's naked eye. This makeup guidance screen is composed of completely transmitted light, transmitted light dominance, a mixture of transmitted and reflected light, reflected light dominance, or completely reflected light, meaning the ratio of transmitted light to reflected light in the makeup guidance screen can be infinitely varied from 0:100 to 100:0.

[0050] The central processing unit (CPU) also includes a command input module, a voice interaction module, a network connection module, and a data storage module. The command input module includes touch input, button input, voice input, gesture input, eye-tracking input, and / or smartphone app input, i.e., buttons, remote control input, and app input. Eye-tracking input determines the cursor position by tracking the user's eye focus area and is often used in VR technology, where virtual buttons are displayed on the virtual display layer. During use, if the user stares at the virtual buttons in front of the virtual display layer for more than a set time, such as 5 seconds, the CPU will determine that the user is performing a button operation and will control the response to the corresponding command, allowing the user to free their hands for makeup application, making it more convenient.

[0051] The data storage module is configured as a local storage device (such as a TF card) connected to the central processing unit (CPU), and / or a remote storage device (such as a 4G SIM card) connected to the remote server. The voice interaction module includes a microphone for sound pickup and a speaker for sound playback, connected to the CPU via an audio codec and a 12s output. The network connection module includes wireless communication interfaces based on technologies such as Wi-Fi and 5G. The CPU is also connected to a wired communication interface based on a USB interface, enabling external device and network connections through these wireless or wired communication interfaces. The fill light, cameras, and corresponding sensors can be connected to the CPU via MIPI, and the CPU controls the fill light via MIPI. The CPU also includes a makeup effect comparison and evaluation module for providing feedback on makeup results and opinions.

[0052] In this embodiment, the makeup database includes several makeup schemes pre-stored in the central processing unit, makeup schemes entered by the user, and / or makeup schemes shared by platforms in the same field. Each makeup scheme's breakdown of makeup steps includes corresponding hyperlinks for the user to choose from. These hyperlinks provide information such as the names, models, and purchase links of the cosmetics used in the corresponding makeup scheme, helping users quickly understand relevant information and make informed purchases, thus avoiding wasting time and effort searching manually.

[0053] like Figure 2 As shown, this embodiment also relates to a smart makeup method using the smart makeup mirror, including the following steps:

[0054] SP1, User Identity Information Collection

[0055] When a user uses the system for the first time, the central processing unit collects and stores information such as the user's gender, age, preferences, location, and environment in a question-and-answer manner through the command input module, the voice interaction module, and / or the network connection module, thereby establishing a user identity profile.

[0056] SP2, User Facial Information Database Establishment

[0057] SP 2-1 The central processing unit controls the lighting module to illuminate the user's face at different angles, brightnesses, and / or colors. The image acquisition module collects the user's facial feature image data and transmits it to the central processing unit. Specifically, the user's facial image is collected by the angle-adjustable optical camera or the infrared camera, etc. The data of light reflection from the lighting module is combined with the user's facial 3D virtual model generation module to generate the user's facial 3D virtual model and store it in the central processing unit.

[0058] SP 2-2 The central processing unit analyzes the user's skin condition based on the facial feature image data collected by the image acquisition module, determines the user's current skin age group, and compares it with the user's actual age in the user identity file established in step SP1. The comparison result, the user's 3D virtual facial model, and the user identity file are stored together to obtain the user facial information database.

[0059] SP3, push makeup ideas and try-on makeup

[0060] SP 3-1 The central processing unit (CPU) filters makeup schemes based on information from the user's facial information database, primarily using dimensions such as skin tone, regional environment, and preferences, and pushes these schemes to the customer for display on the electronic display device for viewing and selection. The makeup schemes pushed or delivered by the CPU can be preset by the operator, entered by the user, or shared by other users on the platform.

[0061] SP 3-2 Users can use the command input module, the voice interaction module, and / or the network connection module (such as a matching APP installed on a smartphone) to view the makeup schemes displayed on the electronic display device and select one or more favorite makeup schemes for trial makeup selection.

[0062] SP 3-3 The central processing unit receives the makeup scheme instruction selected by the user, adjusts and matches the makeup scheme with the user's 3D virtual facial model using the makeup virtual image module to generate a makeup effect virtual image that fits the user's facial structure, and the central processing unit transmits the makeup effect virtual image to the electronic display device for display so that the user can preview it.

[0063] SP 3-4 After previewing the virtual image of the user's makeup, the user can see the makeup effect. If the user is satisfied with the makeup effect, the user can select the makeup plan and start the makeup process.

[0064] SP 3-5 The interactions users share with other users during this process will be included in a database that analyzes user preferences, thereby enabling more accurate recommendations of makeup looks that users may like.

[0065] SP4, Step-by-Step Makeup and Instructions

[0066] SP 4-1The central processing unit breaks down the selected makeup scheme into step-by-step virtual makeup images, which are then projected onto the electronic display device for display. The user then performs the makeup process based on these virtual images. In other words, the makeup scheme consists of all the makeup steps and / or the entire scheme, and the effects can be created and recorded step-by-step through real-world operation (e.g., using this product, with professional photography equipment or other qualified photography scenarios) or software effects.

[0067] SP 4-2 The central processing unit (CPU) works with the real-time positioning module and the image acquisition module to acquire the real-time position of the user's facial image on the real-world mirror layer. The CPU then displays the step-by-step makeup virtual image onto the real-time position of the user's facial image through the electronic display device, thus obtaining the user's visual image, which is formed by superimposing the step-by-step makeup virtual image and the user's facial image in real time. The CPU displays the user's visual image in real time through the electronic display device, allowing the user to perceive the real-time makeup effect and perform the makeup step by step.

[0068] SP 4-3 During the user's makeup application process, the central processing unit (CPU) tracks the user's eyes in real time through the image acquisition module and dynamically analyzes the user's visual focus area. The user can selectively adjust the brightness of the real image of the user's face reflected by the real mirror layer within the visual focus area through the CPU and the lighting module. The CPU and the brightness adjustment module can also selectively adjust the brightness of the electronic display device and / or the step-by-step virtual makeup image within the visual focus area to form a regional virtual makeup image. This allows for the adjustment of the brightness ratio between the local real image of the user's face within the visual focus area and the regional virtual makeup image, resulting in a makeup guidance screen that the user sees with their naked eye.

[0069] SP 4-4 During the user's makeup application process, the image acquisition module collects real-time data on the user's facial color changes and current makeup image data and transmits it to the central processing unit. The central processing unit compares the current makeup image data with the step-by-step virtual makeup image in real time, analyzes the makeup differences, and provides online prompts and guidance to the user.

[0070] SP 4-5 After completing each step of the makeup process, the user can send instructions through the command input module, the voice interaction module, and / or the network connection module, i.e., via buttons, remote control, app, etc., to proceed to the next step of the makeup operation.

[0071] SP 4-6 After makeup is completed, the image acquisition module collects facial feature image data of the user after makeup and stores it in the central processing unit, forming a real image of the user's face after makeup in the central processing unit. The makeup effect comparison and evaluation module compares the real image of the user's face after makeup with the virtual image of makeup effect, and generates a makeup comparison evaluation based on the comparison results, and stores it together with the user's makeup process in the user's facial information database.

[0072] This embodiment also includes the following steps: SP5, after the user completes the makeup, including makeup schemes preset by the operator, entered by the user, or shared by other users on the platform, the user can take a screenshot through the image acquisition module and share it on the user's platform for other users to share or try.

[0073] SP6. In each makeup disassembly step displayed in the virtual display layer, the user or platform can simultaneously enter information about the cosmetics used. The names and models of the cosmetic products used, along with corresponding purchase or online trial links, will be displayed. The central processor can analyze user preferences to provide precise recommendations. Users can simultaneously access product information while selecting their desired makeup look and can purchase or try the products via purchase or online trial links.

[0074] This invention, through the cooperation of a central processing unit, an image acquisition module, and a lighting module, accurately captures the user's facial information and creates a makeup profile for the user. First, the user's facial image is used to determine their skin condition, and multiple makeup options are recommended for the user to choose from. After selecting a makeup option, the user completes the makeup process by following the steps within the central processing unit and compares the results in real-time with the virtual image of the makeup effect, receiving online guidance. This ensures that the user's makeup effect closely approximates the effect displayed on the virtual imaging layer, thereby improving makeup efficiency and saving the user's makeup time.

[0075] The description of this invention is given for illustrative and descriptive purposes only and is not intended to be exhaustive or to limit the invention to the forms disclosed. Many modifications and variations will be apparent to those skilled in the art. The embodiments were chosen and described in order to better illustrate the principles and practical application of the invention and to enable those skilled in the art to understand the invention and to design various embodiments with various modifications suitable for a particular purpose.

Claims

1. An intelligent makeup method comprising an intelligent makeup mirror, characterized in that, The intelligent cosmetic mirror comprises: a real mirror layer, which is a mirror surface with reflectivity and light transmittance, and presents a real image of a user's face by reflection; a virtual display layer, which is an electronic display device arranged behind the real mirror layer, and is used to display a virtual image of a makeup look of a user's makeup process, the virtual image being presented to the user through the real mirror layer; an image acquisition module, which is arranged at the periphery of the real mirror layer and / or behind the real mirror layer, and is used to acquire real-time facial feature image data of the user; a central processing unit, which is connected with a makeup look database for user selection; the central processing unit is provided with a user facial 3D virtual model generation module for processing data of the image acquisition module and obtaining a user facial 3D virtual model, and is further provided with a makeup virtual image module for adjusting and matching a user-selected makeup look scheme with the user facial 3D virtual model to generate a user makeup virtual image; the central processing unit is provided with a real-time position module for acquiring, through the image acquisition module, a real image of the user's face on the real mirror layer in real time, and displays the user makeup virtual image to the real-time position of the real image of the user's face through the virtual display layer, so as to realize superimposition of the user makeup virtual image on the real image of the user's face to form a user visual picture; the central processing unit is provided with a brightness adjustment module for adjusting the virtual display layer and / or adjusting brightness of the user makeup virtual image according to a user instruction; an output end of the central processing unit is further provided with an illumination module, which is arranged at the periphery of the real mirror layer and / or behind the real mirror layer, and is used to provide light to the user's face to adjust brightness of the real image of the user's face reflected by the real mirror layer; the brightness adjustment module and the illumination module cooperate to adjust the brightness ratio of the real image of the user's face and the user makeup virtual image, so as to obtain a makeup guidance picture viewed by the user's naked eye, the makeup guidance picture being the user visual picture composed of completely transmitted light, transmitted light dominated, mixed transmitted light and reflected light, reflected light dominated or completely reflected light; an input end of the central processing unit is further provided with a command input module, a voice interaction module, a network connection module and a data storage module; the method comprises the following steps: SP1, user identity information acquisition when a user uses the intelligent cosmetic mirror for the first time, the central processing unit acquires and stores gender, age and preference information of the user in a question-and-answer manner through the command input module, the voice interaction module and / or the network connection module, and establishes a user identity file; SP2, user facial information database filing SP 2-1 controlling the illumination module to illuminate the user's face at different angles, brightness and / or colors, and collecting facial feature image data of the user through the image collection module and transmitting to the central processor, combining the data of the light reflection of the illumination module and generating the 3D virtual model of the user's face through the 3D virtual model generation module of the user's face, and storing in the central processor; SP 2-2 SP1, the central processor analyzes the facial feature image data collected by the image acquisition module to analyze the skin state of the user, determine the age range of the current skin of the user, and compare the actual age of the user in the user identity file established in step SP1, store the comparison result, the 3D virtual model of the face of the user, and the user identity file together to obtain a user face information library. SP3, pushing a makeup look scheme and trying makeup SP 3-1 , the central processor pushes the makeup scheme to the customer according to the information in the user face information library and displays it on the electronic display device for the user to view and select; SP 3-2 , the user consults the makeup scheme displayed by the electronic display device through the command input module, the voice interaction module and / or the network connection module and selects; SP 3-3 The central processor receives the user-selected makeup scheme instruction, adjusts and matches the makeup scheme with the user's face 3D virtual model using the makeup virtual image module to generate a makeup effect virtual image that fits the user's face structure, and transmits the makeup effect virtual image to the electronic display device for display for the user to preview. SP 3-4 , the user learns the makeup effect after previewing the virtual image of the user makeup, and the makeup effect that is satisfactory can be used as a selected makeup scheme to start implementing makeup; SP 3-5 The interaction of the user with the content shared by other users in the process will be listed in the database for analyzing user preferences, so as to more accurately push the user's favorite makeup. SP4, step-by-step makeup and guidance SP 4-1 , the central processor disassembles the selected makeup scheme according to the makeup steps to form a sub-step makeup virtual image, and displays the sub-step makeup virtual image on the electronic display device, and the user implements the makeup process according to the sub-step makeup virtual image; SP 4-2 The central processor obtains the real-time position of the face real image of the user on the real mirror layer through the real-time position module and the image acquisition module. The central processor displays the step-by-step makeup virtual image on the real-time position of the face real image of the user through the electronic display device, and obtains the user visual picture formed by real-time superposition of the step-by-step makeup virtual image and the face real image of the user. The central processor displays the user visual picture through the electronic display device. The user knows the real-time makeup effect through the user visual picture, and implements makeup step by step. SP 4-3 , in the user implements the makeup process, the central processing unit through the image acquisition module real-time tracking user eyeball, and dynamic analysis user visual focus area; user can through the central processing processor and the lighting module selectively adjust visual focus area, the real mirror layer reflects the brightness of the user's face real image, through the central processor and the brightness adjustment module selectively adjust visual focus area the electronic display device and / or adjust the brightness of the step-by-step makeup virtual image forms sub-regional makeup virtual image, realize visual focus area inside local the user's face real image and the brightness proportion adjustment of sub-regional makeup virtual image, obtain the user naked eye watches the makeup guidance picture. SP 4-4 In the process of the user implementing makeup, the image acquisition module acquires the color change of the face of the user and current makeup image data in real time and transmits the current makeup image data to the central processor. The central processor compares the current makeup image data with the virtual image of the makeup in the steps in real time, analyzes the makeup difference, and provides online prompt and guidance to the user. SP 4-5 For each step of makeup, the user sends instructions through the command input module, the voice interaction module and / or the network connection module to enter the next step of makeup operation. SP 4-6 , after the makeup, the image acquisition module acquires the facial feature image data of the user after the makeup and stores in the central processor, and forms the real image of the face of the user after the makeup in the central processor, the makeup effect comparison and evaluation module compares the real image of the face of the user after the makeup with the virtual image of the makeup effect, and produces the makeup comparison and evaluation according to the comparison result, and stores the makeup process of the user together into the user face information library.

2. The intelligent makeup method of claim 1, wherein, the real mirror layer is arranged as a mirror glass, a single mirror, a glass layer with light transmittance and reflectivity, or an acrylic layer with light transmittance and reflectivity.

3. The intelligent makeup method of claim 1, wherein, the electronic display device is a display screen, a display coating, a display film or a projection device.

4. The intelligent makeup method of claim 1, wherein, The image acquisition module is an optical camera, an infrared camera, a range finder, a millimeter wave radar and / or a laser scanner.

5. The intelligent makeup method of claim 1, wherein, The central processor is connected with a remote server, and the makeup database is arranged on the central processor and / or the remote server.

6. The intelligent makeup method of claim 5, wherein, The data storage module is a local memory connected with the central processor and / or a remote memory connected with the remote server.

7. The intelligent makeup method of claim 1, wherein, The user makeup virtual image produced by the makeup virtual image module includes a makeup effect virtual image, a step-by-step makeup virtual image and a region-by-region makeup virtual image.

8. The intelligent makeup method of claim 1, wherein, The command input module includes a touch input, a key input, a voice input, a gesture input, an eye tracking input and / or a smartphone app input.

9. The intelligent makeup method according to any one of claims 1 to 8, wherein, The central processor further includes a makeup effect comparison and evaluation module.

Citation Information

Patent Citations

  • Intelligent cosmetic mirror

    CN108606453A

  • Mirror surface assembly, intelligent mirror surface and intelligent display equipment

    CN111434280A