Improved virtual makeup method, device and system

Abstract

The invention provides an improved virtual makeup method, device and system. The method comprises the following steps: receiving target face data from a binocular or monocular camera in combination with other sensors; performing algorithm processing on the data of the human face to obtain human face key points, skin data and a distance between the human face and a camera; the makeup effect based on the face looking into the mirror is constructed, the size of the face and the size of the display face are 1: 1, and the mirror imaging effect is met; the makeup effect is directly displayed on the semitransparent touch mirror surface screen; wherein when the semitransparent touch mirror surface screen is turned off, the semitransparent touch mirror surface screen is a mirror, and the screen can be touched and controlled; the effect of the face part needing makeup can be displayed on the display screen after makeup, and the corresponding part area of the part not needing makeup can be subjected to screen turn-off; the overall effect is the same as that of looking into a mirror, but the makeup effect of the corresponding area is directly displayed on the mirror during makeup.

Description

TECHNICAL FIELD

[0001] The present application relates to virtual makeup, in particular to a strategy method for displaying a mirror surface touch screen and display screen, capturing a real-time image stream through a camera, and realizing a mirror makeup effect by combining algorithm processing. BACKGROUND

[0002] In the prior art, a monocular camera is used to capture face data, and an algorithm is used to color makeup on the corresponding position of the face image. The makeup is directly displayed on the display, and the effect is real-time. However, the size of the face displayed on the display is inconsistent with the actual face size, and the display effect of the display screen and the mirror screen is also very different. How to realize the effect of virtual makeup displayed in the display to the effect of virtual makeup displayed in the mirror is a problem to be solved. SUMMARY

[0003] Therefore, the present application provides a strategy method for virtual makeup in an intelligent mirror, which comprises: extracting face key points and features from a visual image captured by a camera, determining a face region and a face part region in the image data; obtaining a distance from the face to the camera, calculating the actual size of the face using the distance from the face to the camera; coloring makeup in the corresponding region according to the actual size; displaying the color on the part that needs to be made up according to the makeup effect, and displaying the non-makeup part in black; according to the display effect, the makeup color will be attached to the corresponding face part in the mirror, and the non-makeup area will be covered by the mirror, and the actual effect is makeup in the mirror, but with color effect.

[0004] In particular, the visual image of the face key points and the face skin features is obtained from the visual image captured by the camera.

[0005] In particular, the actual distance from the face to the camera is measured by a binocular camera or a binocular camera combined with infrared and radar.

[0006] In particular, the actual distance from the face to the camera is measured by a monocular camera or a monocular camera combined with radar and infrared.

[0007] In particular, the actual size of the face and the actual size and area of different parts of the face are calculated according to the distance from the face to the camera.

[0008] In particular, the makeup region is displayed in color, and the non-makeup region is displayed in black. The color display effect will display the actual color in the mirror surface, and the black color will be covered by the mirror surface color in the mirror surface.

[0009] In particular, according to the actual effect, the effect is the same as looking in the mirror, but the makeup can be displayed in the mirror. Beneficial effects

[0010] The virtual makeup in the mirror can be realized based on the mirror virtual makeup, and the effect is better. DETAILED DESCRIPTION

[0011] The application will be described in detail below.

[0012] The application provides a virtual makeup strategy method in an intelligent mirror, and the overall process includes the following steps. Step 1, face key points and features are extracted from a visual image collected by a camera, and a face region and a face part region of the image data are determined; the visual image data can be collected based on a camera component configured by the intelligent mirror. The face key points and features are extracted from the visual image, and a semantic face visual image is obtained; Step 2, the face key points and features are obtained, the actual distance from the face to the camera is calculated by using the camera and other sensors, and then the actual size of the face and the face part region is calculated according to the actual distance; Step 3: according to the information of the face, the specified region of the actual face size is colored by an algorithm, and the non-makeup region is colored black. After coloring, the makeup effect in the mirror will be displayed in the mirror, the black will be covered by the color of the mirror, and the non-black will display the corresponding color, and the display effect is the makeup effect in the mirror To sum up, the above is only a preferred embodiment of the application, and is not used to limit the protection scope of the application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the application shall be included in the protection scope of the application.

[0013] It is obvious for those skilled in the art that the embodiments of the application are not limited to the details of the above exemplary embodiments, and the embodiments of the application can be implemented in other specific forms without departing from the spirit or essential characteristics of the embodiments of the application. Therefore, the embodiments should be regarded as exemplary and non-limiting, and the scope of the embodiments of the application is defined by the appended claims rather than the above description, and all changes falling within the meaning and scope of the equivalent elements of the claims are intended to be included in the embodiments of the application. Any mark in the claims should not be regarded as limiting the involved claims. In addition, it is obvious that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. The plurality of units, modules or devices stated in the system, device or terminal claims can also be implemented by the same unit, module or device through software or hardware. The words "first", "second" and the like are used to represent names, and do not represent any specific order.

[0014] It should be pointed out that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present application but not limit the present application. Although the embodiments of the present application are described in detail with reference to the above preferred embodiments, those skilled in the art should understand that the technical solutions of the embodiments of the present application can be modified or replaced equivalently without departing from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An improved method, apparatus, and system for virtual makeup, characterized in that, include: The smart mirror device collects facial data from video streams in real time; The makeup is displayed in real time on the mirror screen device after the facial data is processed by the algorithm. The smart mirror device is equipped with a display device to show the makeup status after the algorithm processing; The mirror screen device is a display device for a smart mirror, consisting of a monitor and a mirror touch screen; the makeup display method is a mirror effect display, the magnified display area of ​​the face is the same size as the actual face, the makeup part is displayed according to the corresponding color of the makeup, and the non-makeup parts are displayed in pure black. The makeup color displayed on the mirror screen is covered by the mirror color, and the mirror screen displays the effect of virtual makeup when looking in a mirror.

2. The improved virtual makeup method, apparatus, and system as described in claim 1, characterized in that, The data includes data received by sensors such as the binocular camera, monocular camera, radar, and infrared, demonstrating that the virtual makeup is a simulation display of makeup on a mirror screen using image processing algorithms and hardware.

3. The improved virtual makeup method, apparatus, and system as described in claim 1 or 2, characterized in that, The virtual makeup effect can be changed according to the actual situation.

4. An improved virtual makeup method, apparatus, and system as described in any one of claims 1-3, characterized in that, When in a virtual makeup state, the mirror makeup effect depends on sensor data (monocular, binocular, radar, infrared), mirror screen, display screen, and algorithm.

5. The apparatus according to any one of claims 1-4, characterized in that, It can be a sensor of various brands, sizes, and functions, and the function is implemented through the described logic process.