System for generating a presentation of eyebrow design

Abstract

In some embodiments, a computer-implemented method for presenting possible eyebrows is provided. A computing system receives a representation of an eyebrow mimic for a subject. The computing system places the eyebrow mimic on an image of the subject's face. The computing system determines the possible eyebrows by determining one or more modifications to the natural eyebrows of the subject within a maximum modification parameter to make the natural eyebrows of the subject more similar to the eyebrow mimic. The computing system generates a presentation of the possible eyebrows.

Description

Technical Field

[0001] Cross - Reference to Related Applications This application claims the benefit of U.S. Provisional Application No. 63 / 238,622, filed Aug. 30, 2021. This application also claims priority to French Application No. 2111759, filed Nov. 5, 2021. The entire disclosures of both applications are hereby incorporated by reference herein for all purposes.

Summary of the Invention

Means for Solving the Problems

[0002] This summary is provided to introduce a simplified form of a selection of concepts that are further described below in the detailed description of the embodiments. This summary is not intended to identify key features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

[0003] In some embodiments, an eyebrow generation system is provided. The system includes a circuit configured to predict static and dynamic information of a subject's eyebrow region and determine one or more eyebrow characteristics about the subject based on one or more images or videos of the subject's eyebrow region, a circuit configured to generate one or more digital instances of an eyebrow geometric shape, eyebrow color, eyebrow texture, or eyebrow location based on the static and dynamic information of the eyebrow region, and a circuit configured to generate one or more digital instances of user - selectable modifications to the eyebrow geometric shape, eyebrow color, eyebrow texture, or eyebrow location.

[0004] In some embodiments, a computer-implemented method is provided for presenting achievable eyebrows. A computing system receives a display of an eyebrow mimetic for a subject. The computing system places the eyebrow mimetic on an image of the subject's face. The computing system determines achievable eyebrows by determining one or more modifications to the subject's natural eyebrows within maximum modification parameters to make the natural eyebrows resemble the eyebrow mimetic. The computing system generates a presentation of the achievable eyebrows.

[0005] In some embodiments, a non-transitory computer-readable medium storing instructions is provided. In response to execution by one or more processors of a computing system, the instructions cause the computing system to receive a display of an eyebrow mimetic for a subject, place the eyebrow mimetic on an image of the subject's face, determine achievable eyebrows by determining one or more modifications to the subject's natural eyebrows within maximum modification parameters to make the natural eyebrows resemble the eyebrow mimetic, and generate a presentation of the achievable eyebrows.

[0006] In some embodiments, a system is provided that includes circuitry for receiving a display of an eyebrow mimetic for a subject, circuitry for placing the eyebrow mimetic on an image of the subject's face, circuitry for determining achievable eyebrows by determining one or more modifications to the subject's natural eyebrows within maximum modification parameters to make the natural eyebrows resemble the eyebrow mimetic, and circuitry for generating a presentation of the achievable eyebrows.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

DETAILED DESCRIPTION OF THE INVENTION

[0008] Many of the above aspects and attendant advantages of the present invention will become more readily appreciated as they become better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings.

[0009] One common application of cosmetic products is to enhance the appearance of the eyebrows. Generally, a brush, pencil, powder, wax, and / or mascara are used to fill in the area around the untreated eyebrows (or "natural eyebrows") to obtain a desired eyebrow shape. Sometimes, a concealer or hair removal may be used to reduce some parts of the natural eyebrows to obtain a desired eyebrow shape, but the most common change is created by applying a product to increase the dimensions of the natural eyebrows.

[0010] Some dramatic changes can be created in the appearance of the natural eyebrows, but there is a risk of overdoing it. People often try to shape their natural eyebrows to look like those of a celebrity, model, or others, but it has been revealed that attempting to overly change the size or shape of the natural eyebrows with the products used can result in eyebrows that look unnatural. Furthermore, it is not intuitively clear how much the natural eyebrows can change, and it takes time, wastes products, and may be beyond the skills of an average person to determine the maximum change to the natural eyebrows that will not look unnatural through trial and error. What is desired is an automated technique that can determine achievable eyebrows based on an eyebrow imitation that can be obtained by applying cosmetic products to the subject's natural eyebrows without looking unnatural, as well as a technique for presenting the achievable eyebrows to the subject.

[0011] FIG. 1 is a view of a portion of a subject's face according to various aspects of the present disclosure. The view of the face of the subject 102 shown in FIG. 1 may be a self-image or video (or a portion thereof) captured by the subject 102, an image or video of the subject 102 captured by a third party, or simply a drawing of the subject 102 for illustrative purposes of the concepts described above. In the figure, the natural eyebrows 104 of the subject 102 are visible and are shown in solid black.

[0012] Subject 102 may make their own eyebrows appear similar to the eyebrow imitation 106 shown by horizontal hatching. However, the eyebrow imitation 106 is considerably larger than the natural eyebrows 104, and if the space in between is filled with a given cosmetic product (or combination of products), the difference between the natural eyebrows 104 and the eyebrow imitation 106 may look unnatural due to the large difference. Therefore, embodiments of the present disclosure determine a feasible eyebrow 108, which is shown by diagonal hatching between the natural eyebrows 104 and the eyebrow imitation 106. The feasible eyebrow 108 is determined using the characteristics of the cosmetic product regarding how much the cosmetic product can enlarge the natural eyebrows 104 without looking unnatural, and is presented by embodiments of the present disclosure. Further details regarding how the feasible eyebrow 108 is determined and presented are shown below.

[0013] FIG. 2 is a block diagram showing aspects of an embodiment of a non-limiting example of an eyebrow visualization computing system according to various aspects of the present disclosure. The illustrated eyebrow visualization computing system 210 may be implemented by any computing device or collection of computing devices including, but not limited to, a desktop computing device, a laptop computing device, a mobile computing device, a server computing device, a computing device of a cloud computing system, and / or combinations thereof. The eyebrow visualization computing system 210 is configured to determine a feasible eyebrow for a subject and generate a presentation of the feasible eyebrow.

[0014] As shown, the eyebrow visualization computing system 210 includes one or more processors 202, one or more communication interfaces 204, an eyebrow imitation data store 208, a product data store 220, and a computer-readable medium 206.

[0015] In some embodiments, the processor 202 may include any suitable type of general-purpose computer processor. In some embodiments, the processor 202 may include one or more dedicated computer processors or AI accelerators optimized for specific computing tasks, including but not limited to a graphics processing unit (GPU), a vision processing unit (VPU), and a tensor processing unit (TPU).

[0016] In some embodiments, the communication interface 204 includes one or more hardware and / or software interfaces suitable for providing a communication link between components. The communication interface 204 may support one or more wired communication technologies (including but not limited to Ethernet, FireWire, and USB), one or more wireless communication technologies (including but not limited to Wi-Fi, WiMAX, Bluetooth, 2G, 3G, 4G, 5G, and LTE), and / or combinations thereof.

[0017] As shown, the computer-readable medium 206 stores thereon logic that causes the eyebrow visualization computing system 210 to provide a feature detection engine 212, an eyebrow correction engine 214, a presentation generation engine 216, and a user interface engine 218 in response to execution by one or more processors 202.

[0018] As used herein, "computer-readable medium" refers to a removable or non-removable device that implements any technology capable of storing information in a volatile or non-volatile manner for reading by a processor of a computing device, including but not limited to a hard drive, flash memory, solid-state drive, random access memory (RAM), read-only memory (ROM), CD-ROM, DVD, or other disk storage, magnetic cassette, magnetic tape, and magnetic disk storage.

[0019] In some embodiments, the feature detection engine 212 is configured to detect features in two-dimensional and / or three-dimensional face images, such as natural eyebrows and alignment features, using various computer vision techniques. The feature detection engine 212 may also be configured to construct a three-dimensional representation of the face image to generate more accurate results. In some embodiments, the eyebrow modification engine 214 is configured to determine changes to the natural eyebrows detected by the feature detection engine 212 that would look realistic, assuming that one or more selected cosmetic products are used. The characteristics of various cosmetic products may be stored in the product data store 220. In some embodiments, the presentation generation engine 216 is configured to generate one or more various types of presentations of the achievable eyebrows determined by the eyebrow modification engine 214.

[0020] In some embodiments, the user interface engine 218 is configured to receive input from a subject (or other user) provided to other components of the eyebrow visualization computing system 210. For example, the user interface engine 218 may present various eyebrow imitations stored in the eyebrow imitation data store 208 and receive a selection of an eyebrow imitation from the subject (or other user). In some embodiments, the eyebrow imitations may be bitmaps, meshes, and / or other representations of observed eyebrows of celebrities, models, or other people, and may be presented by the user interface engine 218 as sample images of other people for selection. In some embodiments, the user interface engine 218 may present a questionnaire and determine a template with a certain style (angle, roundness, etc.), texture, and color for the eyebrow imitation based on the questionnaire results. In some embodiments, the eyebrow imitation may be determined using a recommendation algorithm based on facial feature analysis.

[0021] A further description of the configuration of each of these components is provided below.

[0022] As used herein, "engine" refers to logic embodied in hardware or software instructions, such instructions being written in one or more programming languages including, but not limited to, C, C++, C#, COBOL, JAVA®, PHP, Perl, HTML, CSS, JavaScript, VBScript, ASPX, Go, and Python. The engine may be compiled into an executable program or may be written in an interpreted type programming language. The software engine may be callable from other engines or from itself. Generally, the engines described herein refer to logical modules that can be combined with other engines or split into sub-engines. The engine is implemented by logic stored in any type of computer-readable medium or computer storage device, stored on and executed by one or more general-purpose computers, and thus may form a dedicated computer configured to provide the engine or its functionality. The engine may be implemented by logic programmed into an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or another hardware device.

[0023] As used herein, "data store" refers to any suitable device configured to store data for access by a computing device. An example of a data store is a highly reliable, high-speed relational database management system (DBMS) that runs on one or more computing devices and is accessible over a high-speed network. Another example of a data store is a key-value store. However, any other suitable storage technique and / or device that can promptly and reliably provide the stored data in response to a query may be used, and the computing device may be accessible locally rather than over a network, or may be provided as a cloud-based service. The data store may also include data systematically stored on a computer-readable storage medium such as a hard disk drive, flash memory, RAM, ROM, or any other type of computer-readable storage medium. It will be appreciated by those skilled in the art that, without departing from the scope of the present disclosure, the separate data stores described herein may be combined into a single data store and / or the single data store described herein may be separated into multiple data stores.

[0024] FIG. 3 is a block diagram showing aspects of an exemplary computing device 300 suitable for use as a computing device of the present disclosure. Although multiple different types of computing devices have been described above, the exemplary computing device 300 represents various elements common to a number of different types of computing devices. Although FIG. 3 will be described with reference to a computing device implemented as a device on a network, the following description can be applied to servers, personal computers, mobile phones, smartphones, tablet computers, embedded computing devices, and other devices that can be used to implement portions of the embodiments of the present disclosure. Some embodiments of the computing device may be implemented in or may include application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other customized devices. Further, those skilled in the art will recognize that the computing device 300 may be either any number of currently available devices or any number of devices not yet developed.

[0025] In its most basic configuration, computing device 300 includes at least one processor 302 and system memory 310 connected by a communication bus 308. Depending on the exact configuration and type of the device, system memory 310 may be volatile memory, such as random access memory (RAM), read only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory, or the like, or non-volatile memory. Those skilled in the art will recognize that system memory 310 is generally immediately accessible to and / or stores data and / or program modules currently being processed by processor 302. In this regard, processor 302 may act as the computing center of computing device 300 by supporting the execution of instructions.

[0026] Furthermore, as shown in FIG. 3, computing device 300 may include a network interface 306 comprising one or more components for communicating with other devices through a network. Embodiments of the present disclosure may access basic services that utilize network interface 306 to perform communication using a common network protocol. Network interface 306 may also include a wireless network interface configured to communicate via one or more wireless communication protocols such as Wi-Fi, 2G, 3G, LTE, WiMAX, Bluetooth, Bluetooth low energy, etc. As will be appreciated by those skilled in the art, the network interface 306 shown in FIG. 3 may represent one or more wireless interfaces or physical communication interfaces described and illustrated above with respect to the particular components of computing device 300.

[0027] In the exemplary embodiment shown in FIG. 3, computing device 300 also includes a storage medium 304. However, services may be accessed using a computing device that does not include means for persisting data on a local storage medium. Accordingly, the storage medium 304 shown in FIG. 3 is represented by a dashed line to indicate that the storage medium 304 is optional. In any case, storage medium 304 may be volatile or non-volatile, removable or non-removable, and may be implemented using any technology capable of storing information, such as, but not limited to, hard drives, solid state drives, CD ROMs, DVDs, or other disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage, etc.

[0028] Suitable implementations of computing devices including a processor 302, a system memory 310, a communication bus 308, a storage medium 304, and a network interface 306 are known and commercially available. For ease of explanation and not being important for understanding the claimed subject matter, FIG. 3 does not show some of the representative components of many computing devices. In this regard, the computing device 300 may include input devices such as a keyboard, a keypad, a mouse, a microphone, a touch input device, a touch screen, a tablet, etc. Such input devices may be coupled to the computing device 300 by a wired or wireless connection including RF, infrared, serial, parallel, Bluetooth, Bluetooth low energy, USB, or other suitable connection protocols using a wireless or physical connection. Similarly, the computing device 300 may include output devices such as a display, a speaker, a printer, etc. Since these devices are well known in the art, they will not be further illustrated or described herein.

[0029] FIG. 4 is a flowchart showing an embodiment of a non-limiting example of a method for generating a presentable brow achievable according to various aspects of the present disclosure. In method 400, the brow visualization computing system 210 determines achievable brows based on natural brows and the performance of one or more selected cosmetic products, and generates a presentation of the achievable brows.

[0030] From the start block, method 400 proceeds to block 402 where the eyebrow visualization computing system 210 receives at least one facial image of the subject. In some embodiments, the eyebrow visualization computing system 210 may capture at least one facial image using a camera, scanner, or other device included in the eyebrow visualization computing system 210. In some embodiments, the eyebrow visualization computing system 210 may receive at least one facial image from a separate camera, scanner, or other device via the communication interface 204.

[0031] Any suitable type of data may be received for at least one facial image of the subject. In some embodiments, the at least one facial image may be one or more two-dimensional images captured by a conventional digital camera. In some embodiments, the at least one facial image may be one or more three-dimensional images captured by a stereo digital camera, a conventional digital camera augmented with a depth sensor, a laser scanner, a structured light camera system, or any other suitable device. In some embodiments, each image of the at least one facial image may be captured separately. In some embodiments, the images of the at least one facial image may be frames of a video received by the eyebrow visualization computing system 210.

[0032] In block 404, the feature detection engine 212 of the eyebrow visualization computing system 210 detects the position of the natural eyebrows in at least one face image. In some embodiments, the feature detection engine 212 uses a machine learning model such as a convolutional neural network (or another type of machine learning model or another type of computer vision technique) to find the position of the natural eyebrows. In some embodiments, the feature detection engine 212 may use Dlib, CLM-framework, or other available feature detection libraries to detect the natural eyebrows (and other features as described below) in at least one face image.

[0033] In some embodiments, the feature detection engine 212 may generate a mask, a path, or other representation of the location of the natural eyebrows in at least one face image. In some embodiments, the feature detection engine 212 may use depth information in at least one face image, or may use two or more face images captured from different locations to construct a three-dimensional representation of the face and / or the position of the natural eyebrows, and thus may construct a three-dimensional mesh or other three-dimensional representation of the position of the natural eyebrows. In some embodiments, the feature detection engine 212 may determine a three-dimensional representation of the position of the natural eyebrows by applying a mathematical transformation to a two-dimensional representation of the natural eyebrows.

[0034] FIG. 5 is a diagram of an embodiment of a non-limiting example of a face image received by the eyebrow visualization computing system 210 according to various aspects of the present disclosure. In the illustrated face image, the upper left portion of the subject 502 is shown together with the left raw eyebrow 504. The position of the raw eyebrow 504 within the face image is detected at block 404. FIG. 5 (and other explanatory diagrams within the present disclosure) shows only the upper left portion of the face of the subject 502 for clarity, but in some embodiments, a larger (but not limited to, including the upper half on both sides of the face or the entire face) portion of the face of the subject 502, or a smaller (but not limited to, including a smaller part of the upper portion of the face still including the features described herein) portion may be shown in the face image. In embodiments where both raw eyebrows are visible within the face image, the method 400 may operate on both raw eyebrows at once.

[0035] Returning to FIG. 4, at block 406, the eyebrow modification engine 214 of the eyebrow visualization computing system 210 receives a display of the eyebrow imitation. In some embodiments, the user interface engine 218 may present a set of images of celebrities, models, or other people with exemplary eyebrow styles, and the display of the eyebrow imitation may be provided by the subject selecting an image that includes those eyebrow imitations. In some embodiments, the user interface engine 218 may present a set of diagrams of various examples of eyebrow imitations rather than images of actual people. In some embodiments, the set of images and / or diagrams may be stored in the eyebrow imitation data store 208, and each image / diagram may be stored with a path, bitmap, mask, or other information that defines the position of the associated eyebrow imitation in the image / diagram. In some embodiments, the user interface engine 218 may receive an image that includes an eyebrow imitation from the subject. In some embodiments, the feature detection engine 212 may be used to detect the position of the eyebrow imitation in the displayed or received image. In some embodiments, the eyebrow imitation may be determined based on a questionnaire or a recommendation algorithm. In some embodiments, the eyebrow imitation may be a template having a certain style (angle, roundness, etc.), texture, and / or color.

[0036] At block 408, the feature detection engine 212 detects the positions of one or more alignment features in at least one face image. As described above, the feature detection engine 212 may use a convolutional neural network, different types of machine learning techniques, different types of computer vision techniques, available libraries, or any other suitable technique for finding alignment features.

[0037] The alignment feature is a feature of the face of the subject 502 that is used to place the eyebrow imitation. FIG. 6 is a diagram of an embodiment of a non-limiting example of placing an eyebrow imitation in a face image according to various aspects of the present disclosure. As shown, the alignment features are the nostrils 610, the outer portion of the iris 614 of the eye 612, and the outer canthus 616 of the eye 612. Although not shown in FIG. 6, the eyebrow ridge may also be used as an alignment feature.

[0038] Returning to FIG. 4, in block 410, the eyebrow modification engine 214 determines the position of the eyebrow imitation based on the positions of one or more alignment features. In some embodiments, the eyebrow modification engine 214 may use lines generated based on the alignment features to place the eyebrow imitation. As shown in FIG. 6, a vertical line 602 is extended from the nostrils 610 to establish the ideal location of the inner edge of the eyebrow imitation 608, an iris line 604 is extended from the nostrils 610 through the outer portion of the iris 614 to establish the ideal location of the arch of the eyebrow imitation 608, and a canthus line 606 is extended from the nostrils 610 through the outer canthus 616 to establish the ideal location of the outer edge of the eyebrow imitation 608. The eyebrow ridge may be used to establish the ideal vertical location of the eyebrow imitation 608. In some embodiments, the lines are projected onto the face image regardless of the three-dimensional curve of the face to account for the appearance of the eyebrows from the front. In some embodiments, the lines may be drawn taking into account the three-dimensional curvature of the face.

[0039] Once a line is established based on the alignment feature, the eyebrow modification engine 214 may position the eyebrow imitation 608 to minimize the total distance between each line and the corresponding landmark of the eyebrow imitation 608 (e.g., the distance between the inner edge of the eyebrow imitation 608 and the vertical line 602, the distance between the arch of the eyebrow imitation 608 and the iris line 604, the distance between the outer edge of the eyebrow imitation 608 and the canthal line 606, and the distance between the eyebrow imitation 608 and the supraorbital ridge). In some embodiments, the eyebrow modification engine 214 may vary the size of the eyebrow imitation 608 to fit the eyebrows at the desired position. In some embodiments, the eyebrow modification engine 214 may consider the amount of overlap between the natural eyebrow 504 and the eyebrow imitation 608 when determining the position of the eyebrow imitation 608.

[0040] Note that the specific alignment features and lines shown in FIG. 6 represent detailed eyebrow style guidelines that are generally considered desirable. In some embodiments, different eyebrow style guidelines using different alignment features and / or lines for positioning the eyebrow imitation 608 may be used.

[0041] Returning to FIG. 4, at block 412, the eyebrow modification engine 214 determines maximum modification parameters based on the characteristics of one or more products. In some embodiments, the user interface engine 218 may receive a display of one or more products, including but not limited to brushes, pencils, powders, waxes, and / or mascaras, that are applied to change the shape of the natural eyebrow 504. Each product may be associated with the maximum amount that the product (or a product in combination with other products) can be used to enhance the appearance of the natural eyebrow 504, and this information may be stored in the product data store 220.

[0042] Figure 7 is a diagram of an embodiment of a non-limiting example of maximum correction parameters according to various aspects of the present disclosure. As shown in Figure 7, a maximum amount of thickness adjustment 702 (the vertical thickness of the eyebrow), a maximum amount of length adjustment 704 (the position of the inner or outer end of the eyebrow), and a maximum amount of arch adjustment 706 (the overall shape of the eyebrow) may be provided for each product or combination of products. In some embodiments, the maximum amount may be determined empirically by using the product to increase the dimensions of the natural eyebrows of one or more samples and then obtaining a rating as to whether the result is satisfactory. In some embodiments, exemplary products with known characteristics (such as viscosity, opacity, color, etc.) may empirically determine the maximum amount, and these values may be inferred for other products with matching characteristics. In some embodiments, the maximum correction parameter may also include a change in intensity.

[0043] In some embodiments, the maximum correction parameter may have individual values indicating the amount by which the thickness, length, and arch can be increased, as contrasted with the amount by which the thickness, length, and arch can be decreased. Since many products can be used to increase the size of the natural eyebrows, in many products, the maximum decrease amount may be zero. In some products (such as concealers), the maximum increase amount may be zero, and the maximum decrease amount may be non-zero, but the maximum decrease amount is often small.

[0044] Returning to FIG. 4, at block 414, the brow modification engine 214 determines a feasible brow by modifying one or more of the length, arch, and thickness of the natural brow within the maximum modification parameters to approach the brow mimic. In some embodiments, the brow modification engine 214 modifies the length, arch, and / or thickness of the natural brow to maximize the extent of the natural brow 504 or the brow mimic 608 covered by either the natural brow or the product. In some embodiments, the brow modification engine 214 modifies the length, arch, and / or thickness of the natural brow 504 to minimize the overall distance between the boundaries of the feasible brow and the boundaries of the brow mimic 608. In some embodiments, the brow modification engine 214 modifies the length, arch, and / or thickness of the natural brow 504 to minimize the difference in shape between the feasible brow and the brow mimic 608. In some embodiments, some combination of these (and / or other) metrics may be used to determine the shape of the feasible brow. In some embodiments, the three-dimensional shape of the face is considered when determining the feasible brow shape.

[0045] At block 416, the presentation generation engine 216 of the brow visualization computing system 210 generates a presentation of the feasible brow. FIG. 8 is a diagram of an embodiment of a non-limiting example of a presentation of a feasible brow according to various aspects of the present disclosure. In FIG. 8, the presentation generation engine 216 generates a face image showing the feasible brow 802 superimposed over the natural brow 504. For clarity, the natural brow 504 is visible in FIG. 8, but in some embodiments, the face image generated by the presentation generation engine 216 may opaque superimpose the feasible brow 802 over the natural brow 504 so that the final result with the product applied is clear and can be evaluated by the subject 502.

[0046] In some embodiments, the presentation generation engine 216 may generate a digital image that includes a face image with the superimposed achievable eyebrows 802, and the digital image may be presented in any suitable manner, including, but not limited to, via a digital display device such as a mobile device, a desktop computing device, a laptop computing device, a web page screen, or any other digital display device, or a hard copy display device such as a printer. In some embodiments, the presentation generation engine 216 may generate an augmented reality view of the subject 502 with the achievable eyebrows 802 superimposed on a live image of the subject 502, and present the augmented reality view via a mobile device or any other suitable display device. In some embodiments, instead of superimposing the achievable eyebrows 802, the augmented reality view may include distorting the presentation of the natural eyebrows or replacing the natural eyebrows. In some embodiments, the presentation generation engine 216 may provide the achievable eyebrows 802 as a pattern or other instructions to a makeup printing device, which may then be used to apply the product to the subject's natural eyebrows 504 to create the shape, color, and texture of the achievable eyebrows 802. In some embodiments, the presentation generation engine 216 may use the achievable eyebrows 802 to generate a custom stencil, a custom stamp, coaching instructions, or other artifacts that enable the subject to apply the achievable eyebrows 802.

[0047] Returning to FIG. 4, the method 400 then proceeds to the end block and ends.

[0048] It will be understood that, although the exemplary embodiments have been shown and described, various changes may be made thereto without departing from the spirit and scope of the invention.

[0049] (Example) (Example 1) An eyebrow generation system, a circuit configured to predict static and dynamic information of the eyebrow region of a subject and to determine one or more eyebrow characteristics about the subject based on one or more images or videos of the eyebrow region of the subject; a circuit configured to generate one or more digital instances of an eyebrow geometric shape, eyebrow color, eyebrow texture, or eyebrow location based on the static and dynamic information of the eyebrow region; a circuit configured to generate one or more digital instances of user-selectable modifications to an eyebrow geometric shape, eyebrow color, eyebrow texture, or eyebrow location; and an eyebrow generation system comprising the same.

[0050] (Example 2) The eyebrow generation system of Example 1, further comprising a circuit configured to exchange one or more eyebrow parameters with a real-time eyebrow attachment device.

[0051] (Example 3) The eyebrow generation system of Example 1, wherein the one or more eyebrow parameters include eyebrow color parameters including one or more of an eyebrow hue parameter, an eyebrow shade parameter, an eyebrow tone parameter, and an eyebrow shadow parameter.

[0052] (Example 4) The eyebrow generation system of Example 1, wherein the one or more eyebrow parameters include one or more eyebrow geometric shape parameters, eyebrow color parameters, eyebrow texture parameters, or eyebrow location parameters.

[0053] (Example 5) The eyebrow generation system of Example 1, wherein the one or more eyebrow parameters include one or more eyebrow attachment parameters.

[0054] (Example 6) The eyebrow generation system of Example 1, wherein one or more eyebrow parameters include one or more modifications selected by one or more users to an eyebrow geometry, eyebrow color, eyebrow texture, or eyebrow location, or a combination thereof.

[0055] (Example 7) A circuit configured to generate eyebrow attachment parameters based on the user-selected eyebrow geometry, user-selected eyebrow color, user-selected eyebrow texture, or user-selected eyebrow location, or a combination thereof The eyebrow generation system of Example 1, further comprising, wherein the eyebrow attachment parameters include layer-by-layer material attachment parameters, cosmetic material attachment parameters, skin care formulation parameters, or a combination thereof.

[0056] (Example 8) A circuit configured to generate at least one digital image of an eyebrow within the subject's eyebrow region in response to one or more inputs indicating the modifications selected by the user The eyebrow generation system of Example 1, further comprising.

[0057] (Example 9) A circuit configured to generate eyebrow placement information and to generate at least one digital image of an eyebrow within the subject's eyebrow region The eyebrow generation system of Example 1, further comprising.

[0058] (Example 10) A computer-implemented method for presenting achievable eyebrows, comprising: Receiving, by a computing system, a display of an eyebrow imitation for a subject; Placing, by the computing system, the eyebrow imitation on an image of the subject's face; Determining, by the computing system, achievable eyebrows by determining one or more modifications to the subject's natural eyebrows within a maximum modification parameter to make the subject's natural eyebrows resemble the eyebrow imitation; A step of generating a presentable eyebrow by a computing system and A computer-implemented method including the above.

[0059] (Example 11) The computer-implemented method according to Example 10, wherein the step of placing an eyebrow imitation on an image of a subject's face includes a step of detecting one or more alignment features in the image of the subject's face.

[0060] (Example 12) One or more alignment features include nostrils, iris of the eye, eyebrow peak, and outer corner of the eye, The step of placing an eyebrow imitation on an image of a subject's face is The eyebrow imitation is aligned vertically with the eyebrow peak, The inner edge of the eyebrow imitation is aligned with a line extending vertically from the nostril, The arch of the eyebrow imitation is aligned with a line extending from the nostril through the iris, The outer edge of the eyebrow imitation is aligned with a line extending from the nostril through the outer corner of the eye The computer-implemented method according to Example 11, including the step of placing the eyebrow imitation at a position where the above conditions are met.

[0061] (Example 13) The computer-implemented method according to Example 10, wherein the step of determining one or more modifications to the natural eyebrow within the maximum modification parameters to make the natural eyebrow resemble the eyebrow imitation includes determining one or more of a change in length, a change in arch, and a change in thickness.

[0062] (Example 14) The computer-implemented method according to Example 10, wherein the step of determining the achievable eyebrow includes determining the maximum modification parameters based on the characteristics of one or more displayed cosmetic products.

[0063] (Example 15) The step of capturing one or more images of a subject's face by a computing system, The step of detecting raw eyebrows in one or more images of a subject's face by a computing system, and A computer-implemented method according to Example 10, further comprising.

[0064] (Example 16) The step of capturing one or more images of a subject's face comprises The step of capturing a two-dimensional video of the subject's face, and The step of capturing a three-dimensional image of the subject's face A computer-implemented method according to Example 15, including at least one of the above.

[0065] (Example 17) The step of generating a presentable eyebrow presentation comprises The step of generating an image of the subject's face with the presentable eyebrow superimposed on the raw eyebrow, The step of generating an augmented reality view of the subject's face with the presentable eyebrow superimposed on the raw eyebrow, and The step of providing instructions to a makeup printer to apply the presentable eyebrow to the subject's face A computer-implemented method according to Example 10, including at least one of the above.

[0066] (Example 18) A non-transitory computer-readable medium storing instructions, which, in response to execution by one or more processors of a computing system, The step of receiving, by the computing system, a display of an eyebrow imitation for a subject, The step of placing the eyebrow imitation on an image of the subject's face by the computing system, The step of determining a presentable eyebrow by determining one or more modifications to the raw eyebrow within a maximum modification parameter to make the subject's raw eyebrow resemble the eyebrow imitation by the computing system. A step of generating a presentable eyebrow by a computing system, and A non-transitory computer-readable medium that causes a computing system to perform actions including the above.

[0067] (Example 19) The step of placing an eyebrow imitation on an image of a subject's face includes a step of detecting one or more alignment features in the image of the subject's face, The one or more alignment features include nostrils, the irises of the eyes, the eyebrows, and the outer corners of the eyes, The step of placing an eyebrow imitation on an image of a subject's face, The eyebrow imitation is aligned vertically with the eyebrows, The inner edge of the eyebrow imitation is aligned with a line extending vertically from the nostrils, The arch of the eyebrow imitation is aligned with a line extending from the nostrils through the irises, The outer edge of the eyebrow imitation is aligned with a line extending from the nostrils through the outer corners of the eyes A computer-readable storage medium according to Example 18, including the step of placing an eyebrow imitation at a position where the above alignments are achieved.

[0068] (Example 20) A computer-readable storage medium according to Example 18, wherein the step of determining one or more modifications to the natural eyebrows within the maximum modification parameters to make the natural eyebrows of the subject resemble the eyebrow imitation includes the step of determining one or more of a change in length, a change in arch, and a change in thickness.

[0069] (Example 21) A computer-readable storage medium according to Example 18, wherein the step of determining the achievable eyebrows includes the step of determining the maximum modification parameters based on the characteristics of one or more displayed cosmetic products.

[0070] (Example 22) A computer-readable storage medium according to Example 18, wherein the action is A step of capturing one or more images of a subject's face by a computing system, A step of detecting raw eyebrows in one or more images of a subject's face by a computing system further comprising The step of capturing one or more images of a subject's face is A step of capturing a two-dimensional video of a subject's face, and A step of capturing a three-dimensional image of a subject's face The computer-readable storage medium of Example 18, including at least one of them.

[0071] (Example 23) The step of generating a presentable eyebrow presentation is A step of generating an image of a subject's face with a presentable eyebrow superimposed on a raw eyebrow, A step of generating an augmented reality view of a subject's face with a presentable eyebrow superimposed on a raw eyebrow, and A step of providing an instruction to a makeup printer to apply a presentable eyebrow to a subject's face The computer-readable storage medium of Example 18, including at least one of them.

[0072] (Example 24) A circuit for receiving a display of an eyebrow imitation for a subject, A circuit for placing an eyebrow imitation on an image of a subject's face, A circuit for determining a presentable eyebrow by determining one or more corrections to a raw eyebrow within a maximum correction parameter to make the subject's raw eyebrow resemble the eyebrow imitation, A circuit for generating a presentation of a presentable eyebrow A system comprising

[0073] (Example 25) The step of placing an eyebrow imitation on an image of a subject's face includes a step of detecting one or more alignment features in the image of the subject's face, One or more alignment features include the nostrils, the iris of the eye, the eyebrows, and the outer corners of the eyes, The step of placing an eyebrow imitation on an image of the subject's face The eyebrow imitation is aligned vertically with the eyebrows, The inner edge of the eyebrow imitation is aligned with a line extending vertically from the nostrils, The arch of the eyebrow imitation is aligned with a line extending from the nostrils through the iris, The outer edge of the eyebrow imitation is aligned with a line extending from the nostrils through the outer corner of the eye The system of Example 24, including the step of placing an eyebrow imitation at the position.

[0074] (Example 26) The system of Example 24, wherein the step of determining one or more modifications to the subject's natural eyebrows within the maximum modification parameters to make the natural eyebrows resemble the eyebrow imitation includes determining one or more of a change in length, a change in arch, and a change in thickness.

[0075] (Example 27) The system of Example 24, wherein the step of determining achievable eyebrows includes determining maximum modification parameters based on the characteristics of one or more displayed cosmetic products.

[0076] (Example 28) The step of capturing one or more images of the subject's face, The step of detecting the natural eyebrows in one or more images of the subject's face And further includes The step of capturing one or more images of the subject's face The step of capturing a two-dimensional video of the subject's face, and The step of capturing a three-dimensional image of the subject's face The system of Example 24, including at least one of them.

[0077] (Example 29) The step of generating a presentable eyebrow includes generating an image of the subject's face with the presentable eyebrow superimposed on the natural eyebrow, generating an augmented reality view of the subject's face with the presentable eyebrow superimposed on the natural eyebrow, and providing instructions to a makeup printer to apply the presentable eyebrow to the subject's face The system of Example 24 includes at least one of the above.

Description of Reference Numerals

[0078] 102 Subject 104 Natural eyebrow 106 Eyebrow imitation 108 Presentable eyebrow 202 Processor 204 Communication interface 206 Computer-readable medium 208 Eyebrow imitation data store 210 Eyebrow visualization computing system 212 Feature detection engine 214 Eyebrow correction engine 216 Presentation generation engine 218 User interface engine 220 Product data store 300 Computing device 302 Processor 304 Memory medium 306 Network interface 308 Communication bus 310 System memory 502 Subject 504 Natural eyebrow 602 Vertical line 604 Iris line 606 Outer corner line of eye 608 Eyebrow imitation 610 Nostril 612 Eye 614 Iris 616 Outer corner of eye 702 Thickness adjustment 704 Length adjustment 706 Arch adjustment 802 Achievable eyebrows

Claims

1. A computer-implemented method for presenting achievable eyebrows, comprising: receiving, by a computing system, a display of an eyebrow imitation for a subject; placing, by the computing system, the eyebrow imitation on an image of the subject's face; determining, by the computing system, achievable eyebrows by determining one or more modifications to the natural eyebrows within maximum modification parameters to make the natural eyebrows resemble the eyebrow imitation; generating, by the computing system, a presentation of the achievable eyebrows; and the step of determining the achievable eyebrows includes determining the maximum modification parameters based on the characteristics of one or more displayed cosmetic products, the maximum modification parameters include one or more of a maximum amount of thickness adjustment, a maximum amount of length adjustment, and a maximum amount of arch adjustment, a computer-implemented method.

2. The computer-implemented method according to claim 1, wherein the step of placing the eyebrow imitation on the image of the subject's face includes detecting one or more alignment features in the image of the subject's face.

3. The one or more alignment features include nostrils, irises of eyes, eyebrows, and outer corners of eyes, and the step of placing the eyebrow imitation on the image of the subject's face includes: aligning the eyebrow imitation vertically with the eyebrows, aligning the inner edge of the eyebrow imitation with a line extending vertically from the nostrils, aligning the arch of the eyebrow imitation with a line extending from the nostrils through the iris, The outer edge of the eyebrow imitation is aligned with a line extending from the nostril through the outer corner of the eye in front of the eye The computer-implemented method according to claim 2, comprising the step of arranging the eyebrow imitation at a position.

4. The step of determining one or more corrections to the natural eyebrow within the maximum correction parameter to mimic the natural eyebrow of the subject with the eyebrow imitation includes the step of determining one or more of a change in length, a change in arch, and a change in thickness. The computer-implemented method according to claim 1.

5. The step of capturing, by the computing system, one or more images of the face of the subject, and The step of detecting, by the computing system, the natural eyebrow in the one or more images of the face of the subject and The computer-implemented method according to claim 1, further comprising.

6. The step of capturing one or more images of the face of the subject includes The step of capturing a two-dimensional video of the face of the subject, and The step of capturing a three-dimensional image of the face of the subject The computer-implemented method according to claim 5, including at least one of.

7. The step of generating the presentation of the achievable eyebrows includes The step of generating an image of the face of the subject with the achievable eyebrows superimposed on the natural eyebrows, The step of generating an augmented reality view of the face of the subject with the achievable eyebrows superimposed on the natural eyebrows, and The step of providing an instruction to a makeup printer to apply the achievable eyebrows to the face of the subject The computer-implemented method according to claim 1, including at least one of.

8. A non-transitory computer-readable medium storing instructions that, responsive to execution by one or more processors of a computing system, cause the computing system to be executed as described in any one of claims 1 to 7. **Claim 9** A system comprising circuitry for performing the actions of the method of any one of claims 1 to 7.

Images