Virtual makeup trial method, device, electronic device and readable storage medium

Abstract

The present disclosure provides a virtual makeup trial method, including: obtaining a face image; in the case of receiving a makeup trial request, monitoring the target position on the face of the user pointed to by an operator and the number of operations of the operator at the target position; and displaying the makeup effect on the target part of the face image according to the target position and the number of operations. The present disclosure provides a virtual makeup trial device, an electronic device and a computer-readable storage medium.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and more specifically, to a virtual makeup trial method, a virtual makeup trial device, an electronic device, and a computer-readable storage medium. Background Art

[0002] With the development of image processing technology, users can use electronic devices to select cosmetics that suit them and conduct virtual makeup trials before putting on makeup. Through augmented reality (AR), the camera of an electronic device is converted into a makeup mirror, which can capture multiple data points on the face, allowing users to virtually try on a variety of cosmetics and see the effects of the products on their faces.

[0003] In the prior art, the makeup trial solution is generally to identify various parts of the face, click on different cosmetics, and then automatically display the makeup on the corresponding parts of the face to complete the makeup.

[0004] In the process of realizing the concept disclosed in the present invention, the inventors found that there are at least the following problems in the related technology: the existing technology standardizes the steps and effects of makeup, basically, when you click on a certain makeup, it will be automatically displayed, and the makeup applied by each person is basically the same, which cannot be customized and cannot achieve the ideal makeup trial effect. Summary of the invention

[0005] In view of this, the present disclosure provides a virtual makeup trial method, a virtual makeup trial device, an electronic device and a computer-readable storage medium.

[0006] One aspect of the present disclosure provides a virtual makeup trial method, including: acquiring a face image; upon receiving a makeup trial request, monitoring a target position on a user's face that an operating body points to and the number of operations performed by the operating body at the target position; and displaying a makeup effect on a target part of the face image according to the target position and the number of operations.

[0007] According to an embodiment of the present disclosure, displaying a makeup effect on a target part of the facial image according to the target position and the number of operations includes: determining the target part of the facial image according to the target position; and dynamically rendering the makeup effect on the target part according to the number of operations, wherein the makeup effect changes dynamically with the number of operations of the operating body at the target position.

[0008] According to an embodiment of the present disclosure, the above-mentioned makeup effect includes a degree of thickness.

[0009] According to an embodiment of the present disclosure, the above method also includes: in the process of monitoring the target position on the user's face that the operating body is pointing to, identifying the key points of the above facial image; and monitoring the target position on the user's face that the above operating body is pointing to based on the position information of the key points of the above facial image on the above facial image.

[0010] According to an embodiment of the present disclosure, the method further includes: in case of receiving a makeup trial request, monitoring an operation trajectory of the operating body on the face of the user.

[0011] Among them, showing the makeup effect on the target part of the above-mentioned face image according to the above-mentioned target position and the above-mentioned operation number includes: showing the makeup effect on the target part of the above-mentioned face image according to the above-mentioned target position, the above-mentioned operation number and the above-mentioned operation trajectory.

[0012] Another aspect of the present disclosure provides a virtual makeup trial device, comprising: an acquisition module, for acquiring a face image; a monitoring module, for monitoring, when receiving a makeup trial request, a target position on a user's face pointed to by an operating body and the number of times the operating body operates at the target position; and

[0013] A display module is used to display the makeup effect on the target part of the face image according to the target position and the number of operations.

[0014] According to an embodiment of the present disclosure, the above-mentioned display module includes: a determination unit, used to determine the target part of the above-mentioned facial image according to the above-mentioned target position; and a rendering unit, used to dynamically render the makeup effect on the above-mentioned target part according to the above-mentioned number of operations, wherein the above-mentioned makeup effect dynamically changes with the number of operations of the above-mentioned operating body on the above-mentioned target position.

[0015] According to an embodiment of the present disclosure, the above-mentioned device also includes: an identification module, which is used to identify key points of the above-mentioned facial image during the process of monitoring the target position on the user's face that the operating body is pointing to; wherein the above-mentioned monitoring module is used to monitor the target position on the user's face that the above-mentioned operating body is pointing to based on the position information of the key points of the above-mentioned facial image on the above-mentioned facial image.

[0016] Another aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method as described above.

[0017] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above method when executed.

[0018] Another aspect of the present disclosure provides a computer program, which includes computer executable instructions, and the instructions are used to implement the method described above when executed.

[0019] According to the embodiments of the present disclosure, when a makeup trial request is received, the target position on the user's face that the operating body points to and the number of operations of the operating body at the target position are monitored; and the makeup effect is displayed on the target part of the face image according to the target position and the number of operations. Since makeup can be added dynamically by identifying the moving position and the number of operations of an operating body such as a finger or a makeup tool on the face, different makeup methods of the user can produce different effects, so that the makeup can be customized, which improves the novelty of the product and can be more attractive to users. Therefore, the technical problem of the prior art that the steps and effects of makeup are standardized, resulting in basically the same makeup for everyone and the inability to customize the technology is at least partially overcome, thereby achieving the technical effect of simulating a real makeup scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0021] Figure 1 An exemplary system architecture to which the virtual makeup trial method and device according to an embodiment of the present disclosure can be applied is schematically shown;

[0022] Figure 2 A flowchart of a virtual makeup trial method according to an embodiment of the present disclosure is schematically shown;

[0023] Figure 3 A flowchart of displaying makeup effects on a target part of a face image according to a target position and a number of operations according to an embodiment of the present disclosure is schematically shown;

[0024] Figure 4 A flowchart of a virtual makeup trial method according to another embodiment of the present disclosure is schematically shown;

[0025] Figure 5 A flowchart of a virtual makeup trial method according to another embodiment of the present disclosure is schematically shown;

[0026] Figure 6 A block diagram schematically shows a virtual makeup trial device according to an embodiment of the present disclosure; and

[0027] Figure 7 A block diagram of a computer system suitable for implementing the method described above according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0028] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0029] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0030] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification, and should not be interpreted in an idealized or overly rigid manner.

[0031] In the case of using expressions such as "at least one of A, B, and C, etc.", it should generally be interpreted in accordance with the meaning of the expression generally understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.). In the case of using expressions such as "at least one of A, B, or C, etc.", it should generally be interpreted in accordance with the meaning of the expression generally understood by those skilled in the art (for example, "a system having at least one of A, B, or C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0032] An embodiment of the present disclosure provides a virtual makeup trial method, comprising: acquiring a facial image; upon receiving a makeup trial request, monitoring a target position on a user's face pointed to by an operating body and the number of operations of the operating body at the target position; and displaying a makeup effect on a target part of the facial image according to the target position and the number of operations.

[0033] Figure 1 The following schematically illustrates an exemplary system architecture to which the virtual makeup trial method and device according to an embodiment of the present disclosure can be applied. It should be noted that: Figure 1What is shown is merely an example of a system architecture to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0034] like Figure 1 As shown, the system architecture 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired and / or wireless communication links, etc.

[0035] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as shopping applications, web browser applications, search applications, instant messaging tools, photography applications and / or social platform software, etc. (only as examples).

[0036] The terminal devices 101 , 102 , and 103 may be various electronic devices with display screens, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0037] The server 105 may be a server that provides various services, such as a background management server (only an example) that provides support for websites browsed by users using the terminal devices 101, 102, and 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0038] It should be noted that the virtual makeup trial method provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the virtual makeup trial device provided in the embodiment of the present disclosure can generally be set in the server 105. The virtual makeup trial method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101, 102, 103 and / or the server 105. Correspondingly, the virtual makeup trial device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101, 102, 103 and / or the server 105. Alternatively, the virtual makeup trial method provided in the embodiment of the present disclosure can also be executed by the terminal devices 101, 102, or 103, or can also be executed by other terminal devices different from the terminal devices 101, 102, or 103. Accordingly, the virtual makeup trial device provided in the embodiments of the present disclosure may also be provided in the terminal device 101 , 102 , or 103 , or in other terminal devices different from the terminal device 101 , 102 , or 103 .

[0039] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0040] Figure 2 The flowchart of the virtual makeup trial method according to an embodiment of the present disclosure is schematically shown.

[0041] like Figure 2 As shown, the method includes operations S201 to S203.

[0042] In operation S201, a face image is acquired.

[0043] According to an embodiment of the present disclosure, for example, referring to Figure 1 The system architecture of the present invention is described, and the user can use the electronic device 101 to perform a virtual makeup trial. The electronic device 101 may be provided with a makeup trial application. After the user opens the makeup trial application, the makeup trial application may call an image acquisition device to acquire a face image. According to an embodiment of the present disclosure, the makeup trial application may be a shopping application or an image processing application. Among them, the shopping application may be, for example, a Jingdong shopping application, and the image processing application may be, for example, a Meitu Xiuxiu application.

[0044] According to an embodiment of the present disclosure, acquiring a facial image may be acquiring a facial image locally collected by the electronic device 101 , or may be a facial image collected by other electronic devices such as the electronic device 102 .

[0045] In operation S202 , when a makeup trial request is received, the target position on the user's face pointed to by the operating body and the number of operations of the operating body at the target position are monitored.

[0046] According to an embodiment of the present disclosure, during the virtual makeup trial, the user can select the makeup they want to apply. For example, they can first select a category, such as lipstick, blush, cosmetic contact lenses, eyebrow pencils, eye shadows, eyeliners, mascara, foundation, etc., and then select a makeup trial parameter such as color or texture. The electronic device can generate a makeup trial request based on the category and makeup trial parameter selected by the user.

[0047] According to an embodiment of the present disclosure, the operating body may be, for example, a finger of a user, or a makeup tool, for example, an eyebrow pencil or other tool.

[0048] According to the embodiments of the present disclosure, the image tracking technology can be used to track the operating body. The number of operations of the operating body at the target position can be the number of times the operating body slaps back and forth at the target position, or the number of times the operating body slides or rotates back and forth at the target position, etc.

[0049] According to the embodiments of the present disclosure, when a makeup trial request is received, the operating body is monitored, which can avoid the image acquisition device being in a working state all the time, thereby reducing system consumption.

[0050] Of course, even if no makeup trial request is received, the operating body can still be monitored to identify key points on the face.

[0051] In operation S203, a makeup effect is displayed on a target part of the face image according to the target position and the number of operations.

[0052] According to an embodiment of the present disclosure, for example, the electronic device can render makeup at the position where the finger has moved according to the selected makeup, and repeated tapping can make the makeup gradually darker and thicker.

[0053] According to an embodiment of the present disclosure, a makeup effect may be displayed at a position pointed to by the operating body according to the makeup trial parameter, and the makeup effect includes a degree of thickness.

[0054] According to the embodiment of the present disclosure, the more times the operating body is operated, the deeper and thicker the makeup may gradually become. Of course, the darkest and thickest shade may be set to avoid the makeup being inconsistent with the actual situation.

[0055] According to an embodiment of the present disclosure, a rendering engine may be utilized to ensure realistic makeup effects using facial recognition, 3D rendering, skin tone analysis, texture matching, and light balance.

[0056] According to the embodiments of the present disclosure, when a makeup trial request is received, the target position on the user's face that the operating body points to and the number of operations of the operating body at the target position are monitored; and the makeup effect is displayed on the target part of the face image according to the target position and the number of operations. Since makeup can be added dynamically by identifying the moving position and the number of operations of an operating body such as a finger or a makeup tool on the face, different makeup methods of the user can produce different effects, so that the makeup can be customized, which improves the novelty of the product and can be more attractive to users. Therefore, the technical problem of the prior art that the steps and effects of makeup are standardized, resulting in basically the same makeup for everyone and the inability to customize the technology is at least partially overcome, thereby achieving the technical effect of simulating a real makeup scene.

[0057] Reference below Figure 3 to Figure 5 , combined with specific embodiments Figure 2 The method shown is further explained.

[0058] Figure 3 The flowchart of showing makeup effects on a target part of a face image according to a target position and a number of operations according to an embodiment of the present disclosure is schematically shown.

[0059] like Figure 3 As shown, displaying the makeup effect on the target part of the face image according to the target position and the number of operations includes operations S301 to S302.

[0060] In operation S301, a target part of a face image is determined according to a target position.

[0061] According to the embodiments of the present disclosure, the part on the collected face image can be determined according to the face position actually pointed to by the operating body.

[0062] In operation S302, a makeup effect is dynamically rendered on the target part according to the number of operations, wherein the makeup effect changes dynamically with the number of operations of the operating body on the target position.

[0063] According to an embodiment of the present disclosure, taking the operating body as a user's finger as an example, each time the finger moves at the same position, the number of movements can be recorded, and according to the color of the makeup itself, the number of movements can be gradually accumulated to present a color superposition effect, giving the feeling that the makeup is getting thicker and thicker. The finger moves to different positions and moves back and forth different times, so makeup with different effects can be drawn, and it is no longer a stereotyped makeup.

[0064] According to the embodiments of the present disclosure, after a user clicks to select a certain category of cosmetics, makeup is not automatically applied to the user. Instead, the makeup effect on the target part is dynamically rendered according to the number of user operations, so that it can be closer to the actual makeup scene, allowing the user to have a better sense of immersion when doing virtual makeup, improving the novelty of the product, and attracting users to stay on the makeup product for a longer time.

[0065] Figure 4 The following schematically shows a flowchart of a virtual makeup trial method according to another embodiment of the present disclosure.

[0066] In this embodiment, in addition to operations S201 to S203, Figure 4 As shown, the method further includes operations S401 to S402. For the sake of brevity, operations S201 to S203 are not described here.

[0067] In operation S401 , while monitoring the target position on the user's face that the operating body is pointing to, key points of a face image are identified.

[0068] According to an embodiment of the present disclosure, a neural network may be used to identify key points of a face image. For example, a deep convolutional neural network may be used to identify key points of a face image. The deep convolutional neural network may include multiple convolutional layers, each of which may have corresponding weight parameters, and the number of convolutional layers may be determined based on actual recognition accuracy.

[0069] According to the embodiments of the present disclosure, a large number of face images can be used to train the initial convolutional neural network to obtain a convolutional neural network that can be used to identify key points of the face. The key points of the face include but are not limited to face shape, forehead, eyebrows, eyes, nose, mouth, chin, etc.

[0070] According to the embodiments of the present disclosure, N feature points can also be obtained through face detection and face alignment, and based on the face feature points, the face template is deformed and aligned to the facial features area. The deformation algorithm can be, for example, affine transformation.

[0071] In operation S402, a target position on the face of the user pointed by the operating body is monitored according to position information of key points of the face image on the face image.

[0072] According to the embodiments of the present disclosure, taking the operating body as a user's finger as an example, in general, makeup is applied wherever the finger moves. In principle, facial key point recognition is not required. However, through facial key point recognition, makeup can be displayed more realistically when the face or finger moves, the relative position relationship between the finger and the face can be determined, and the user can be prompted to apply better makeup based on the makeup category and the drawing position.

[0073] According to the embodiments of the present disclosure, the key points of the face image are identified through real-time facial detection technology, providing support for an accurate makeup experience. The facial detection technology can detect more than 100 facial monitoring points and can easily detect wide-angle facial features, facial expressions, and changes in light. Regardless of muscle changes, facial angles, or expressions, a more accurate and realistic makeup trial experience can be created.

[0074] Figure 5 The following schematically shows a flowchart of a virtual makeup trial method according to another embodiment of the present disclosure.

[0075] like Figure 5 As shown, the method further includes operations S501 to S503.

[0076] In operation S501, a face image is acquired.

[0077] In operation S502 , when a makeup trial request is received, the target position on the user's face pointed to by the operating body, the number of operations of the operating body at the target position, and the operation track of the operating body on the user's face are monitored.

[0078] In operation S503, a makeup effect is displayed on a target part of the face image according to the target position, the number of operations, and the operation track.

[0079] According to an embodiment of the present disclosure, for example, a user can use a finger to imitate the action of applying lipstick, the number of operations can be the number of times the lipstick is applied back and forth, and the target position can be the lips. The operation track of the operating body on the user's face can be the sliding track of the detected operating body on the user's face.

[0080] According to an embodiment of the present disclosure, displaying makeup effects on target parts of a face image according to target positions, operation times and operation tracks may be performed by moving the operating body to any target position, and then displaying the makeup effects at the target position.

[0081] According to the embodiments of the present disclosure, when a makeup trial request is received, the target position on the user's face that the operating body points to, the number of operations of the operating body at the target position, and the operation trajectory of the operating body are monitored; and the makeup effect is displayed on the target part of the face image according to the target position, the number of operations, and the operation trajectory. Since makeup can be added dynamically by identifying the movement trajectory and the number of operations of operating bodies such as fingers or certain makeup tools on the face, different makeup methods of users can produce different effects, so that makeup can be customized, which improves the novelty of the product and can be more attractive to users. Therefore, the technical problem that the existing technology standardizes the steps and effects of makeup, resulting in basically the same makeup for everyone and the inability to customize the technology is at least partially overcome, thereby achieving the technical effect of simulating a real makeup scene.

[0082] Figure 6 A block diagram of a virtual makeup trial device according to an embodiment of the present disclosure is schematically shown.

[0083] like Figure 6 As shown, the virtual makeup trial device 600 includes: an acquisition module 610 , a monitoring module 620 and a display module 630 .

[0084] The acquisition module 610 is used to acquire a face image.

[0085] The monitoring module 620 is used to monitor the target position on the user's face pointed by the operating body and the number of operations of the operating body at the target position when receiving a makeup trial request.

[0086] The display module 630 is used to display the makeup effect on the target part of the face image according to the target position and the number of operations.

[0087] According to the embodiments of the present disclosure, when a makeup trial request is received, the target position on the user's face that the operating body points to and the number of operations of the operating body at the target position are monitored; and the makeup effect is displayed on the target part of the face image according to the target position and the number of operations. Since makeup can be added dynamically by identifying the moving position and the number of operations of an operating body such as a finger or a makeup tool on the face, different makeup methods of the user can produce different effects, so that the makeup can be customized, which improves the novelty of the product and can be more attractive to users. Therefore, the technical problem of the prior art that the steps and effects of makeup are standardized, resulting in basically the same makeup for everyone and the inability to customize the technology is at least partially overcome, thereby achieving the technical effect of simulating a real makeup scene.

[0088] According to an embodiment of the present disclosure, the presentation module 630 includes: a determination unit and a rendering unit.

[0089] The determination unit is used to determine the target part of the face image according to the target position.

[0090] The rendering unit is used to dynamically render the makeup effect on the target part according to the number of operations, wherein the makeup effect changes dynamically with the number of operations of the operating body on the target position.

[0091] According to an embodiment of the present disclosure, the virtual makeup trial device 600 further includes a recognition module for recognizing key points of a facial image during the process of monitoring the target position on the user's face that the operating body is pointing to.

[0092] According to an embodiment of the present disclosure, the monitoring module 620 is used to monitor the target position on the user's face that the operating body points to based on the position information of the key points of the face image on the face image.

[0093] According to an embodiment of the present disclosure, the monitoring module 620 may also be configured to monitor the operation trajectory of the operating body on the user's face when a makeup trial request is received.

[0094] According to an embodiment of the present disclosure, the display module 630 may also be used to display a makeup effect on a target part of the face image according to the target position, the number of operations and the operation track.

[0095] According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits, or at least part of the functions of any one of them can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, submodules, units, and subunits can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be performed.

[0096] For example, any multiple of the acquisition module 610, the monitoring module 620, and the display module 630 can be combined in one module / unit / subunit for implementation, or any one of the modules / units / subunits can be split into multiple modules / units / subunits. Alternatively, at least part of the functions of one or more of these modules / units / subunits can be combined with at least part of the functions of other modules / units / subunits and implemented in one module / unit / subunit. According to an embodiment of the present disclosure, at least one of the acquisition module 610, the monitoring module 620, and the display module 630 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or by any one of the three implementation methods of software, hardware, and firmware, or by a suitable combination of any of them. Alternatively, at least one of the acquisition module 610 , the monitoring module 620 , and the display module 630 may be at least partially implemented as a computer program module, and when the computer program module is executed, the corresponding function may be executed.

[0097] It should be noted that the virtual makeup trial device part in the embodiment of the present disclosure corresponds to the virtual makeup trial method part in the embodiment of the present disclosure. The description of the virtual makeup trial device part specifically refers to the virtual makeup trial method part, which will not be repeated here.

[0098] Another embodiment of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the virtual makeup trial method as described above.

[0099] Figure 7 A block diagram of a computer system suitable for implementing the method described above according to an embodiment of the present disclosure is schematically shown. Figure 7 The computer system shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0100] like Figure 7 As shown, the computer system 700 according to the embodiment of the present disclosure includes a processor 701, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 702 or the program loaded from the storage part 708 to the random access memory (RAM) 703. The processor 701 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 701 may also include an onboard memory for caching purposes. The processor 701 may include a single processing unit or multiple processing units for performing different actions of the method flow according to the embodiment of the present disclosure.

[0101] In RAM 703, various programs and data required for the operation of system 700 are stored. Processor 701, ROM 702 and RAM 703 are connected to each other through bus 704. Processor 701 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 702 and / or RAM 703. It should be noted that the program can also be stored in one or more memories other than ROM 702 and RAM 703. Processor 701 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0102] According to an embodiment of the present disclosure, the system 700 may further include an input / output (I / O) interface 705, which is also connected to the bus 704. The system 700 may further include one or more of the following components connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage section 708 as needed.

[0103] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the processor 701, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0104] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0105] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include, but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.

[0106] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 702 and / or the RAM 703 described above and / or one or more memories other than the ROM 702 and the RAM 703 .

[0107] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0108] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways without departing from the spirit and teachings of the present disclosure. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0109] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A virtual makeup trial method, applied to a first electronic device, the method comprising: Acquire a facial image locally collected on the first electronic device, or acquire a facial image collected by a second electronic device, where the first electronic device is different from the second electronic device; In case of receiving a makeup trial request, monitoring the target position on the user's face pointed to by the operating body and the number of operations of the operating body at the target position, wherein the number of operations of the operating body at the target position includes at least one of the following: the number of times the operating body taps back and forth at the target position, the number of times the operating body slides back and forth at the target position, and the number of times the operating body rotates at the target position; and displaying a makeup effect on a target part of the face image according to the target position and the number of operations; Wherein, displaying the makeup effect on the target part of the face image according to the target position and the number of operations includes: Determining a target part of the face image according to the target position; and The makeup effect on the target part is dynamically rendered according to the number of operations, wherein the makeup effect changes dynamically with the number of operations of the operating body on the target position.

2. The method according to claim 1, wherein: The makeup effects include intensity.

3. The method according to claim 1, further comprising: In the process of monitoring the target position on the user's face that the operating body is pointing to, identifying key points of the face image; as well as The target position on the user's face pointed by the operating body is monitored according to the position information of the key points of the face image on the face image.

4. The method according to claim 1, further comprising: In case of receiving a makeup trial request, monitoring an operation track of the operating body on the user's face; Wherein, displaying the makeup effect on the target part of the face image according to the target position and the number of operations includes: A makeup effect is displayed on a target part of the face image according to the target position, the number of operations and the operation track.

5. A virtual makeup trial device, applied to a first electronic device, comprising: an acquisition module, configured to acquire a facial image locally acquired by the first electronic device, or acquire a facial image acquired by a second electronic device, the first electronic device being different from the second electronic device; a monitoring module, configured to monitor, when receiving a makeup trial request, a target position on the user's face pointed to by the operating body and the number of operations of the operating body at the target position, wherein the number of operations of the operating body at the target position includes at least one of the following: the number of times the operating body slaps back and forth at the target position, the number of times the operating body slides back and forth at the target position, and the number of times the operating body rotates at the target position; and A display module, used for displaying the makeup effect on the target part of the face image according to the target position and the number of operations; Wherein, the display module includes: a determining unit, configured to determine a target part of the face image according to the target position; and A rendering unit is used to dynamically render the makeup effect on the target part according to the number of operations, wherein the makeup effect changes dynamically with the number of operations of the operating body on the target position.

6. The apparatus according to claim 5, further comprising: A recognition module, used to recognize key points of the face image during the process of monitoring the target position on the user's face that the operating body is pointing to; The monitoring module is used to monitor the target position on the user's face that the operating body points to based on the position information of the key points of the face image on the face image.

7. An electronic device comprising: one or more processors; a memory for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 4.

8. A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, enables the processor to implement the method according to any one of claims 1 to 4.

Images