Information processing method

Abstract

To provide an information processing method with technology capable of presenting a type of eye makeup suitable for each user.SOLUTION: An information processing method for selecting a type of eye makeup cosmetic comprises steps of: acquiring face image information of a user, including eyes; extracting, on the basis of the image information, feature information including shape information related to an angle of an eyelid at an inner corner of an eye of the user; selecting, on the basis of the characteristic information, the type of the eye makeup cosmetic; and outputting type information related to the selected type.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a technique for selecting a type of eye makeup cosmetic product suited to a user's facial features. [Background technology]

[0002] In recent years, personalization, which provides appropriate products and information to each consumer, has become important. In the field of cosmetics, for example, as described in Patent Document 1, a method is known in which cosmetic packaging and cosmetic formulations are created according to the skin characteristics and instructions of a customer. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2020 / 194365 Summary of the Invention [Problem to be solved by the invention]

[0004] Eye makeup can have a significant impact on a person's impression. However, eye makeup cosmetics such as mascara come in many different types in terms of color and cosmetic effect, making it difficult for users to select a product of the type that best suits them.

[0005] The present invention relates to a technology that can present types of eye makeup cosmetics that are suitable for each user. [Means for solving the problem]

[0006] An information processing method according to one aspect of the present invention is an information processing method executed on a computer for selecting a type of eye makeup cosmetic product, acquiring image information of a user's face including the eyes; extracting feature information including shape information relating to an angle of an eyelid at the inner corner of the user's eye based on the image information; selecting the type of the eye makeup cosmetic product based on the characteristic information; outputting type information for the selected type; Includes.

[0007] An information processing device according to another aspect of the present invention is an information processing device for selecting a type of eye makeup cosmetic product, and includes a control unit. The control unit Acquire image information of the user's face, including the eyes; extracting feature information including shape information relating to an angle of an eyelid at the inner corner of the eye of the user based on the image information; selecting the type of the eye makeup cosmetic product based on the characteristic information; Type information about the selected type is output.

[0008] An information processing system according to yet another aspect of the present invention is an information processing system for selecting a type of eye makeup cosmetic product, comprising: an information processing device having a control unit; a user terminal connected to the information processing device; It is equipped with: The user terminal transmits image information of the user's face, including the eyes, to the information processing device. The control unit extracting feature information including shape information relating to an angle of an eyelid at the inner corner of the eye of the user based on the image information; selecting the type of the eye makeup cosmetic product based on the characteristic information; Type information about the selected type is transmitted to the user terminal. [Effects of the Invention]

[0009] According to the present invention, it is possible to present types of eye makeup cosmetics that are suitable for each user. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating a configuration of an information processing system according to a first embodiment of the present invention. [Figure 2] FIG. 1A is a diagram showing the hardware configuration of a server included in the system, and FIG. 1B is a diagram showing the hardware configuration of a user terminal included in the system. [Figure 3] FIG. 2 is a diagram showing a database (DB) configuration stored in a storage unit of the system. [Figure 4] FIG. 2 is a sequence diagram illustrating a processing flow of the system. [Figure 5] 10A and 10B are diagrams illustrating a method for extracting shape information in step S22 of the above process, where (A) illustrates the first angle and (B) illustrates the second angle. [Figure 6] FIG. 10 is a diagram illustrating a method for extracting placement information in step S22 of the above process. [Figure 7] FIG. 10 is a flowchart illustrating the flow of a type selection process based on shape information in step S23 of the above process. [Figure 8] 10A and 10B are diagrams illustrating examples of eye shape classifications generated based on the shape information. [Figure 9] FIG. 10 is a flowchart illustrating the flow of a type selection process based on facial features information in step S23 of the above process. [Figure 10] FIG. 10 is a diagram showing an example of a facial feature classification generated based on the facial feature information. [Figure 11] FIG. 10 is a flowchart illustrating the flow of a type selection process based on placement information in step S23 of the above process. [Figure 12] FIG. 10 is a diagram showing an example of a placement classification generated based on the placement information. [Figure 13] FIG. 1 is a diagram showing examples of applicator (brush) types when the eye makeup cosmetic product is mascara. [Figure 14] FIG. 10 is a diagram showing an example of a screen displayed in step S14 of the above process. [Figure 15] FIG. 10 is a diagram showing another example of the screen displayed in step S14 of the above process. [Figure 16] FIG. 10 is a diagram showing another example of the screen displayed in step S14 of the above process. [Figure 17] FIG. 10 is a sequence diagram illustrating a processing flow of a system according to a second embodiment of the present invention. [Figure 18] FIG. 10 is a sequence diagram illustrating a processing flow of a system according to a modified example of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] First Embodiment [System Configuration] The system according to the first embodiment of the present invention is configured as a system via the Internet, for example. In this embodiment, the system functions as an information processing system that allows users to select a type of eye makeup cosmetic product.

[0013] 1, the system according to this embodiment includes a server 100 on the Internet N and multiple user terminals 200 (200A, 200B, 200C, etc.). Although FIG. 1 shows an example in which the system includes three user terminals 200A, 200B, and 200C, the number of user terminals 200 is not limited to this.

[0014] The server 100 is a web server (information processing device) operated by an operator of a portal site (eye makeup information providing site) that can provide information about eye makeup. The server 100 is connected to a plurality of user terminals 200 via the Internet 50.

[0015] Server 100 provides an eye makeup information service on the portal site for users of user terminals 200. Specifically, server 100 acquires image information of the user's face from user terminal 200, and based on the image information, generates a web page that contains information about types of eye makeup cosmetics suitable for the user, and transmits the web page to user terminal 200.

[0016] The user terminals 200 (200A, 200B, 200C, etc.) are terminals used by users, such as smartphones, mobile phones, tablet PCs (Personal Computers), notebook PCs, and desktop PCs. The user terminals 200 access the server 100, receive the webpage, and display it on a screen using a browser or the like. The user terminals 200 also capture an image of the user's face based on the user's operation, and transmit information about the captured image to the server 100.

[0017] In this embodiment, the server 100 extracts facial feature information of the user based on image information acquired from the user terminal 200, and performs a type selection process to select type information of eye makeup cosmetics based on each piece of feature information. The type selection process of eye makeup cosmetics will be described later.

[0018] In this specification, eye makeup cosmetics include at least one selected from eye makeup cosmetics, cosmetic tools for applying them, and other eye makeup cosmetics. Furthermore, eye makeup cosmetics may be a single type of cosmetic, or may include multiple types of cosmetics, or multiple types of cosmetics may be combined to form a single cosmetic. Regarding classification by area, eye makeup cosmetics include, for example, at least one selected from eyelash cosmetics, eyebrow cosmetics, and eyelid cosmetics. Eyelash cosmetics include, for example, mascara, mascara base, mascara top coat, eyelash curler, etc. Eyebrow cosmetics include, for example, eyebrow powder, eyebrow pencil, eyebrow mascara, etc. Eyelid cosmetics include, for example, eyeshadow, eyeliner, etc.

[0019] As used herein, eye makeup refers to eye makeup cosmetics that are applied to the user's eyes. Examples of makeup tools for applying eye makeup include eyelash applicators, eyebrow brushes, eyeshadow brushes, tips, sponges, etc., which will be described later. Examples of cosmetics that combine eye makeup with a makeup tool for applying it include mascara and eyebrow mascara.

[0020] In this embodiment, the eye makeup cosmetic preferably includes eyelash cosmetics, and more specifically, more preferably includes mascara. In this case, the eyelash cosmetics preferably include an eyelash cosmetic (e.g., mascara liquid) and an applicator for applying the same. The applicator has, for example, a brush-shaped application portion. Mascara can vary the impression of the eyes in a variety of ways depending on the combination of the type of mascara liquid and the type of applicator. Therefore, by appropriately selecting these types, it is possible to achieve eye makeup that suits the user.

[0021] [Server hardware configuration] As shown in FIG. 2A, the server 100 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an input / output interface 15, and a bus 14 connecting these to each other.

[0022] The CPU 11 is a control unit that accesses the RAM 13 and the like as needed, and performs various arithmetic processing while controlling all of the blocks of the server 100. The ROM 12 is a non-volatile memory that permanently stores firmware such as the OS and various parameters to be executed by the CPU 11. The RAM 13 is used as a working area for the CPU 11, and temporarily stores parts of the OS that are not stored in the ROM 12, various applications, various data being processed, and the like.

[0023] The input / output interface 15 is connected to a display unit 16, an operation reception unit 17, a storage unit 18, a communication unit 19, and the like.

[0024] The display unit 16 is a display device that uses, for example, an LCD (Liquid Crystal Display), an OLED (Organic ElectroLuminescence Display), or the like.

[0025] The operation reception unit 17 is, for example, a pointing device such as a mouse, a keyboard, a touch panel, or other input device. When the operation reception unit 17 is a touch panel, the touch panel can be integrated with the display unit 16.

[0026] The storage unit 18 is a non-volatile memory such as a hard disk drive (HDD), a flash memory (SSD; solid state drive), or other solid-state memory. The OS, various applications, and various data are stored in the storage unit 18. As will be described later, in this embodiment in particular, the storage unit 18 has a feature information database and a type information database in addition to programs such as applications required for the processing described later.

[0027] The communication unit 19 is, for example, a NIC (Network Interface Card) for Ethernet or various modules for wireless communication such as wireless LAN, and is responsible for communication processing with the user terminal 200.

[0028] 2(B), like the server 100, the user terminal 200 also has, for example, a CPU 21, a ROM 22, a RAM 23, a bus 24, an input / output interface 25, a display unit 26, an operation reception unit 27, a storage unit 28, and a communication unit 29. Furthermore, the user terminal 200 has an imaging unit 30 connected to the input / output interface 25. The imaging unit 30 is, for example, a camera including an image sensor.

[0029] [Database configuration example] 3, the server 100 has a feature information database 31 and a type information database 32 in the storage unit 18. Note that each database may be stored in a storage device or server externally connected to the server 100, rather than in the storage unit 18.

[0030] The feature information database 31 stores feature information extracted from image information of each user's face. The feature information is information about facial features extracted from the image information by image analysis processing. The feature information includes shape information about the shape of the eyes. Furthermore, it is preferable that the feature information includes at least one of arrangement information about the arrangement of the eyes and facial feature information about the impression of the facial features.

[0031] The shape information is information about the angle of the eyelid at the inner corner of the user's eye. Specifically, the eyelid angle may be, for example, the angle between the upper and lower eyelids sandwiching the inner corner of the user's eye, or the rising angle (acute angle) from the inner corner of the eye to the upper eyelid with respect to a reference line extending in the left-right direction. Specific examples of the shape information will be described later.

[0032] Facial feature information includes, for example, information regarding the linearity of at least one shape element included in the face. The shape elements included in the face are elements including the shape characteristics of parts that make up the face (for example, eyes, mouth, nose, facial contour, eyebrows, etc.). For example, shape elements related to the eyes include the size of the eyes, the narrowness of the eyes, the shape of the eyelids (for example, single eyelid or double eyelid), the inclination of the outer corner of the eye relative to the inner corner of the eye, the shape of the eyelid contour, and the shape of the tear troughs. Shape elements related to the mouth include, for example, the thickness of the lips, the width of the mouth in the left-right direction, the shape of the lip contour, etc. Shape elements related to the nose include, for example, the length of the nose, the shape of the nostrils, and the height of the nose.

[0033] "Linearity of facial features" is an index of whether the features of each feature are linear and sharp, or rounded and soft. The criteria for whether a feature is linear or not can be set appropriately for each feature, but can be set based on, for example, the vertical thickness of each feature (for example, a thin feature is linear, while a thick feature is linear), the three-dimensionality of the feature (for example, a single eyelid is linear more than a double eyelid), or the curvature of the contour (for example, a sharply curved contour is linear, while a curved contour is linear less).

[0034] In this embodiment, the position information is information about the position of the user's eyes in the left-right direction of the face. "Information about the eye position" refers to information about the left-right position and position balance of the eyes. Specifically, the information about the left-right position of the eyes preferably includes at least one type of information selected from the distance between the inner corners of the left and right eyes, the distance between the eyes and the temples, the ratio of these distances to the left-right width of the eyes, and the ratio of these distances to the left-right width of the face. In this specification, "temples" refers to the facial contours outside the left and right corners of the eyes, extracted from the facial image.

[0035] In this embodiment, the feature information database 31 preferably further stores classification information on the user's facial feature classification generated based on the feature information. The feature information database 31 stores, for example, classification information that classifies faces in association with the feature information of each user. The stored facial feature classification may be of one type or of multiple types. In this embodiment, the classification information preferably includes an eye shape classification generated based on shape information, a facial feature classification generated based on facial feature information, and an eye arrangement classification generated based on arrangement information.

[0036] The type information database 32 stores, for example, types of eye makeup cosmetics and corresponding characteristic information and / or classification information. In this specification, the type of eye makeup cosmetics refers to a type for classifying eye makeup cosmetics according to their characteristics, and is determined for each type of eye makeup cosmetics, for example. Various types of eye makeup cosmetics may belong to one type, or may belong to multiple types and have the characteristics of these multiple types.

[0037] The types of eye makeup cosmetics preferably include types classified by at least one element selected from, for example, cosmetic effect, cosmetic staying power, color, texture (powder, cream, liquid, pencil, etc.), visually recognized texture (glitter, gloss, matte, etc.), and contained ingredients. Specifically, when the eye makeup cosmetics are eyelash cosmetics, the types of eyelash cosmetics preferably include at least one type selected from, for example, types classified by cosmetic effect, types classified by how well the cosmetics stay on the eyelashes (cosmetic staying power), and types classified by color.

[0038] When the eye makeup cosmetic tool includes an applicator for applying eyelash cosmetics, the types of eye makeup cosmetics preferably include types of applicators, which include types classified by at least one element selected from the type of applicator part (brush-shaped, comb-shaped, etc.), the size of the applicator part (length, thickness, etc.), the spacing between the bristles or comb of the applicator part, and the shape of the applicator part (arch-shaped, gourd-shaped, etc.).

[0039] These databases are used by mutual reference as needed in the type selection process by the server 100, which will be described later.

[0040] [System Operation] Next, the operation of the system configured as described above will be explained. This operation is performed by the cooperation of hardware such as CPU 11 and communication unit 19 of server 100 and software stored in storage unit 18. Similarly, the operation of user terminal 200 is performed by the cooperation of hardware such as CPU 21 and communication unit 29 and software stored in storage unit 28. For convenience, in the following explanation, CPU 11 and CPU 21 are considered to be the main actors in the operation.

[0041] In this operation example, the CPU 11 of the server 100 extracts predetermined feature information from image information of the user's face and selects a type of eye makeup cosmetic based on the extracted feature information. The eye makeup cosmetic is, for example, an eyelash cosmetic (e.g., mascara) including an eyelash cosmetic (e.g., mascara liquid) and an applicator (e.g., a brush). In this operation example, the server 100 transmits and receives information to and from the user terminal 200 via an eye makeup information providing site.

[0042] First, the imaging process will be described. The CPU 21 of the user terminal 200 controls the imaging unit 30 to capture an image of the user's face, including the eyes (S11). When capturing an image, the CPU 11 of the server 100 may transmit a webpage for guiding the image capture to the user terminal 200 in advance on an eye makeup information providing site. Furthermore, when capturing an image, the CPU 11 may determine, via the site, whether or not the image capture conditions, such as the illuminance of the image and the imaging range, are met. The image may be captured by a user's input operation, or may be captured automatically when the imaging conditions are met. The image is preferably an image of the user's face facing forward, and may include at least the eyes and their surroundings, but preferably includes the entire face.

[0043] The CPU 21 transmits the captured image information to the server 100 (S12). The CPU 11 of the server 100 receives (acquires) image information of the user's face, including the eyes (S21). In this operation example, the CPU 11 receives the image information via the Internet N. However, in this specification, the "acquisition" of information is a concept that includes the reception of information via the Internet N, the reception of information to another electronic device using short-range wireless communication or wired communication, and the acquisition of information input by a user's input operation, etc.

[0044] Next, the type selection process for selecting type information will be described. Prior to the type selection process, the CPU 21 extracts feature information based on image information (S22). In this embodiment, the feature information includes shape information, facial feature information, and layout information. The feature information extraction process can be performed using, for example, known image analysis technology.

[0045] In this embodiment, the shape information preferably includes, for example, a first angle indicating the angle of rise from the inner corner of the eye to the upper eyelid relative to a reference line extending in the left-right direction, and a second angle indicating the inclination of a line connecting the inner corner and outer corner of the eye relative to the reference line. Here, both the first angle and the second angle are acute angles. In the example shown in FIG. 5(A), the first angle θ1 is the angle between a reference line L1 extending parallel to the left-right direction Y from the inner corner 41 of the user's eye 40 and a virtual line L2 extending from the inner corner 41 to the upper eyelid 44 above the iris (black eye) 43. More specifically, the line L2 is the line connecting the inner corner 41 of the eye and an intersection 45 between the outline of the upper eyelid 44 and the iris (black eye) 43 on the inner corner 41 side. In the example shown in FIG. 5(B), the second angle θ2 is the angle between the reference line L1 and the line L3 connecting the inner corner 41 and outer corner 42 of the eye. In this specification, the "inner corner of the eye" is the point located on the innermost side of the eye (closer to the midline) in the left-right direction Y. The "outer corner of the eye" is the point located on the outermost side of the eye (closer to the temple) in the left-right direction Y. Note that the symbol X in FIG. 5 indicates the up-down direction.

[0046] By including the first angle θ1 in the shape information, it is possible to obtain information about the narrowness of the eyes according to the degree of opening of the upper eyelid. Furthermore, by including the second angle θ2 in the shape information in addition to the first angle θ1, it is possible to detect the overall tilt of the eyes relative to the horizontal direction, and it is possible to detect the narrowness and roundness of the eyes with greater accuracy. Furthermore, by using the second angle θ2, it is possible to obtain information about the impression of the eyes, such as slanted or droopy eyes.

[0047] In this embodiment, the facial feature information includes, for example, information regarding the linearity of at least one shape element on the face. In this embodiment, the facial feature information preferably includes, for example, information regarding the linearity of at least one shape element selected from the size of the eyes, the narrowness of the eyes, the shape of the eyelids (for example, single eyelid or double eyelid), the inclination of the outer corner of the eye relative to the inner corner of the eye, the thickness of the lips, the shape of the facial outline, the length of the nose, and the shape of the nostrils.

[0048] In this embodiment, the positioning information is information relating to the positioning of the user's eyes in the left-right direction of the face. In this embodiment, the positioning information preferably includes a first ratio, which is the ratio of the distance between the eyes and the temple to the width of the eyes in the left-right direction, and a second ratio, which is the ratio of the distance between the left and right eyes to the width of the eyes in the left-right direction.

[0049] As illustrated in FIG. 6, the CPU 11 extracts from the image the distance D1 between the inner corners 41 of the left and right eyes in the left-right direction Y, the width D2 between the inner corner 41 and outer corner 42 of the user's right eye 40R in the left-right direction Y, the width D3 between the inner corner 41 and outer corner 42 of the user's left eye 40L in the left-right direction Y, the distance D4 between the outer corner 42 of the user's right eye 40R and the right temple 51R in the left-right direction Y, and the distance D5 between the outer corner 42 of the user's left eye 40L and the left temple 51L in the left-right direction Y. Note that the distances referred to here do not need to be actual distances. In other words, the number of pixels on the image or the like can be used as the distances.

[0050] Next, the CPU 11 can calculate the first ratio by calculating the ratios (D4 / D2, D5 / D3) of the distances D4, D5 in the left-right direction Y between the outer corner 42 of the eye and the temples 51R, 51L to the widths D2, D3 in the left-right direction Y between the inner corner 41 of the eye and the outer corner 42 of the eye. The CPU 11 may use the average values ​​of D4 / D2 and D5 / D3 as the first ratio, or may calculate the ratio of the average values ​​of the distances D4, D5 to the average values ​​of the widths D2, D3 and use this value as the first ratio.

[0051] Furthermore, the CPU 11 can calculate the second ratio by calculating the ratio (D1 / D2, D1 / D3) of the distance D1 between the left and right inner corners 41 of the eyes in the left-right direction Y to the widths D2, D3 in the left-right direction Y between the inner corners 41 and outer corners 42 of the eyes. The CPU 11 may, for example, use the average values ​​of D1 / D2 and D1 / D3 as the second ratio, or may calculate the ratio of the distance D2 to the average value of the widths D2, D3 and use that value as the second ratio.

[0052] Next, the CPU 11 selects the type of eye makeup cosmetic based on the characteristic information obtained as described above (S24). In this embodiment, the CPU 11 selects the cosmetic type of eyelash cosmetic based on the shape information, the color type of eyelash cosmetic based on the facial feature information, and the applicator type based on the arrangement information, for example.

[0053] An example of type selection processing based on shape information will be described. For example, as shown in Fig. 7, the CPU 11 determines whether the first angle θ1 is equal to or less than a first threshold θa (S31). If it is determined that the first angle θ1 is equal to or less than the first threshold θa (Yes in S31), the CPU 11 selects a first cosmetic type suitable for narrow eyes (S32). On the other hand, if it is determined that the first angle θ1 is not equal to or less than the first threshold θa (No in S31), the CPU 11 determines whether the first angle θ1 is greater than a second threshold θb that is greater than the first threshold θa (S33). If it is determined that the first angle θ1 is greater than the second threshold θb (Yes in S33), the CPU 11 selects a second cosmetic type suitable for round eyes (S34).

[0054] By setting a first threshold value θa and a second threshold value θb for the first angle θ1, it is possible to classify the angular shapes of eyes into three types based on the tendency toward long, narrow eyes and round eyes. This makes it possible to select a first cosmetic type suitable for long, narrow eyes when the tendency toward long, narrow eyes is high, and a second cosmetic type suitable for round eyes when the tendency toward round eyes is high.

[0055] In this embodiment, the first threshold θa is a threshold for determining the upper limit of the first angle θ1 in the case of, for example, a slit-shaped eye, and the second threshold θb is a threshold for determining the lower limit of the first angle θ1 in the case of a round-shaped eye. The first threshold θa is preferably 37° or more and 40° or less, for example, 40°. The second threshold θb is preferably 45° or more and 48° or less, for example, 45°. In other words, the first angle θ1 in the case of a slit-shaped eye is less than the first threshold θa, the first angle θ1 in the case of an intermediate-shaped eye is greater than the first threshold θa and less than the second threshold θb, and the first angle θ1 in the case of a round-shaped eye is greater than the second threshold θb.

[0056] On the other hand, for an intermediate eye type that is neither highly prone to long, narrow eyes nor highly prone to round eyes, the impression of droopy and upturned eyes is stronger, so a cosmetic type can be selected based on the second angle θ2. That is, in this embodiment, if the CPU 11 determines that the first angle θ1 is not equal to or less than the first threshold θa and not greater than the second threshold θb (No in S33), that is, if the CPU 11 determines that the first angle θ1 is greater than the first threshold θa and not greater than the second threshold θb, it further determines whether the second angle θ2 is equal to or less than the third threshold θc (S35). If the CPU 11 determines that the second angle θ2 is equal to or less than the third threshold θc (Yes in S35), it selects a third cosmetic type suitable for the upturned eye type (S36). On the other hand, if the CPU 11 determines that the second angle θ2 is not equal to or less than the third threshold θc (No in S35), it selects a fourth cosmetic type suitable for the upturned eye type (S37).

[0057] By setting the third threshold value θc for the second angle θ2, it is possible to classify the inclination shapes of the eyes into two types based on the tendency for droopy eyes and upturned eyes. As a result, if the tendency for droopy eyes is high, it is possible to select the third cosmetic type suitable for upturned eyes, and if the tendency for upturned eyes is high, it is possible to select the fourth cosmetic type suitable for upturned eyes.

[0058] The third threshold θc is, for example, a threshold for determining the lower limit of the second angle θ2 in the case of the slanted eyes type, and is preferably 6° or more and 7° or less, for example, 6°. Furthermore, a predetermined threshold θd smaller than the third threshold θc may be set as a threshold for determining the upper limit of the second angle θ2 in the case of the droopy eyes type. This allows the eye inclination shapes to be essentially classified into three types: the slanted eyes type, the droopy eyes type, and a balanced type that is intermediate between the two. For example, the predetermined threshold θd is preferably 3.5° or more and 4.5° or less, for example, 4.5°. In other words, the second angle θ2 in the case of the slanted eyes type is equal to or less than the predetermined threshold θd, the second angle θ2 in the case of the balanced type is greater than the predetermined threshold θd and equal to or less than the third threshold θc, and the second angle θ2 in the case of the slanted eyes type is greater than the third threshold θc.

[0059] In this embodiment, the CPU 11 may generate an eye shape classification corresponding to the cosmetic type. In this case, the CPU 11 may generate an eye shape classification by a determination process (S31, S33, S35) using the first angle θ1 and the second angle θ2, and select a cosmetic type of eye makeup cosmetic corresponding to the generated shape classification. Alternatively, the CPU 11 may select a cosmetic type by a determination process using the first angle θ1 and the second angle θ2, and then generate an eye shape classification corresponding to the selected cosmetic type. The correspondence between the cosmetic type and the eye shape classification may be such that one shape classification corresponds to one cosmetic type, or that multiple shape classifications correspond to one cosmetic type. Note that the CPU 11 does not have to generate a shape classification.

[0060] An example of eye shape classification using the first angle θ1 and the second angle θ2 will be described with reference to FIG. 8. For example, if the first angle θ1 is equal to or less than the first threshold θa, the eyes can be classified as "slit eyes." If the first angle θ1 is greater than the first threshold θa and less than the second threshold θb, the eyes can be classified as "medium eyes." If the first angle θ1 is greater than the second threshold θb, the eyes can be classified as "round eyes." If the second angle θ2 is equal to or less than a predetermined threshold θd, the eyes can be classified as "droopy eyes." If the second angle θ2 is greater than the predetermined threshold θd and less than a third threshold θc, the eyes can be classified as "balanced eyes." If the second angle θ2 is greater than the third threshold θc, the eyes can be classified as "slanted eyes." By combining these, nine types of eye shape classifications can be generated, as shown in FIG. 8.

[0061] Specifically, for example, "slit-shaped" and "droopy-eyed" eyes can be classified as "narrow almond eyes," "slit-shaped" and "balanced" eyes can be classified as "almond eyes," and "slit-shaped" and "upward-slanted" eyes can be classified as "Asian eyes." Furthermore, "intermediate" and "droopy-eyed" eyes can be classified as "droopy half-open eyes," "intermediate" and "balanced" eyes can be classified as "round almond eyes," and "intermediate" and "upward-slanted" eyes can be classified as "half-open eyes." Furthermore, "round" and "droopy-eyed" eyes can be classified as "droopy eyes," "round" and "balanced" eyes can be classified as "round eyes," and "round" and "upward-slanted" eyes can be classified as "Asian round eyes." A detailed explanation of each classification is shown in Table 1. Note that the names of each classification are merely examples.

[0062] [Table 1]

[0063] In this embodiment, based on the eye shape classification, which is one piece of characteristic information, a cosmetic type indicating the cosmetic effect and other performance of the cosmetic from the type information is selected as follows: That is, after performing eye shape classification, the CPU 11 selects a first cosmetic type if the eyes are classified as "narrow almond eyes," "almond eyes," or "Asian eyes," which are all included in the "slit type," and selects a second cosmetic type if the eyes are classified as "droopy eyes," "round eyes," or "Asian round eyes," which are all included in the "round eye type." Furthermore, the CPU 11 selects a third cosmetic type if the eyes are classified as "medium type" "droopy half-open eyes" or "round almond eyes," and selects a fourth cosmetic type if the eyes are classified as "medium type" "half-open eyes."

[0064] For example, when the eye makeup cosmetic is a cosmetic for eyelashes, the types of the cosmetic for eyelashes preferably include at least one type classified by cosmetic effect or by cosmetic performance such as how well the cosmetic remains on the eyelashes, and more preferably include a combination of types classified by cosmetic effect and types classified by how well the cosmetic remains on the eyelashes. Examples of the cosmetic effect of eyelash cosmetics include making the eyelashes appear longer, increasing the volume of the eyelashes, and maintaining the curl of the eyelashes. Examples of how well the cosmetic remains on the eyelashes include resistance to moisture such as sweat and tears (waterproofness), resistance to oils such as sebum, and ease of removal with hot water or a cleanser (cleansing ability).

[0065] The types of eyelash cosmetics can be adjusted by the composition of the eyelash cosmetics. For example, eyelash cosmetics that have the effect of making eyelashes appear longer are called lengthening types and contain, for example, a water-soluble polymer with thread-forming properties or fibers for making eyelashes appear longer. Eyelash cosmetics that have the effect of increasing the volume of eyelashes are called volume types and contain, for example, a water-soluble polymer or a thickener for increasing viscosity. Eyelash cosmetics that have the effect of maintaining the curl of eyelashes are called curling types and contain, for example, a volatile component.

[0066] Furthermore, among eyelash cosmetics, examples of those that are highly resistant to moisture such as sweat and tears include oil-based types that contain a large amount of oily ingredients such as waxes, resins, and fats and oils. Examples of those that are easily removed with hot water or a cleanser (high cleansing properties) include emulsion types in which resins, colorants, etc. are emulsified and dispersed in aqueous components. Emulsion-type eyelash cosmetics not only adhere well to eyelashes, but also have excellent cleansing properties.

[0067] For example, the first cosmetic type for eyelashes suitable for narrow-slit eyes is preferably an oil-based cosmetic and a lengthening type that has the effect of making eyelashes appear longer. When a person has a high tendency for their eyes to be narrow, applying a lengthening type eyelash cosmetic can make their eyes appear larger vertically, making relatively narrow eyes appear rounder. Furthermore, in people with narrow-slit eyes, the upper eyelid tends to droop and come into contact with the eyelashes, so the applied eyelash cosmetic comes into contact with moisture such as sweat and tears, easily causing smudging on the lower eyelid. Therefore, applying an oil-based eyelash cosmetic can prevent color smudging on the lower eyelid.

[0068] For example, the second cosmetic type for eyelashes suitable for round eyes is preferably a milky lotion type and a volume type that has a cosmetic effect of enhancing the volume of eyelashes. Applying a volume type eyelash cosmetic to those with a high tendency to have round eyes can emphasize the shape of the round eyes. Furthermore, applying a milky lotion type eyelash cosmetic to round eyes, which generally do not tend to bleed, can form a smooth coating on the eyelashes, emphasizing their beauty. Furthermore, milky lotion type eyelash cosmetics can be easily washed off with a cleanser or the like, improving convenience when washing the face.

[0069] For example, the third cosmetic type for eyelashes suitable for droopy eyes is preferably a lotion type and a long type. For medium-shaped eyes with a tendency toward relatively droopy eyes, applying a long type eyelash cosmetic can elongate the eyelashes at the outer corner of the upper eye, thereby reducing the impression of droopy eyes. Furthermore, for eyes with this type of shape, color bleeding is generally less likely to occur than for eyes with narrowed or elongated eyes. Therefore, applying a lotion type eyelash cosmetic to eyes with this type of shape can form a smooth coating on the eyelashes, emphasizing their beauty, and can be easily washed off with a cleanser or the like, improving convenience when washing the face.

[0070] For example, the fourth cosmetic type for eyelashes suitable for eyes with slanted eyes is preferably an oil-based and volumizing type. For medium-sized eyes with a high tendency toward slanted eyes, applying a volumizing eyelash cosmetic can emphasize the eyelashes at the outer corner of the lower eye, for example, and reduce the impression of slanted eyes. Furthermore, for eyes with this type of shape, the upper eyelid tends to come into contact with the eyelashes somewhat, which can easily cause color bleeding. Therefore, applying an oil-based eyelash cosmetic can prevent color bleeding on the lower eyelid.

[0071] Furthermore, each cosmetic type of eyelash cosmetic may be classified based on the cosmetic effect desired for the eyelash cosmetic other than the properties exemplified above. Such cosmetic effects include, for example, a curl-sustaining effect, a film-forming effect, etc.

[0072] Next, an example of type selection processing based on facial feature information will be described.For example, as shown in Fig. 9, the CPU 11 determines whether or not at least one shape element on the face has high linearity (S41).

[0073] When there is only one shape element for judging linearity, the CPU 11 can, for example, determine whether the linearity is high based on the one shape element. Specifically, when a numerical value related to the linearity of the shape element can be calculated, the CPU 11 may set a threshold for judging linearity and compare the calculated value with the threshold. Alternatively, the CPU 11 may set a reference shape for judging linearity and judge the similarity or match between the reference shape and the obtained shape. Furthermore, when there are multiple shape elements for judging linearity, the CPU 11 can, for example, judge the linearity for each shape element and combine the judgment results of the multiple shape elements to determine linearity. Specifically, the CPU 11 can assign a score corresponding to the judgment result of each shape element (e.g., +1 point if linearity is high and -1 point if linearity is low) and compare the sum of these scores with a set threshold to determine linearity.

[0074] In this embodiment, the color type of the type information is selected as follows based on linearity, which is one of the characteristic information. If the linearity is determined to be high (Yes in S41), the CPU 11 selects a first color type corresponding to cool colors or colors with relatively low brightness (S42). If the linearity is determined to be low (No in S41), the CPU 11 selects a second color type corresponding to warm colors or colors with relatively high brightness (S43). A "cool color" refers to a color with a blue or near-blue hue on the color wheel, such as bluish or purple. A "warm color" refers to a color with a red or near-red hue on the color wheel, such as reddish, yellowish, or orange. A "relatively high or low brightness" refers to the brightness of the first color type compared to the second color type, with lower brightness corresponding to black. For example, if the eye makeup cosmetic is an eyelash cosmetic, the first color type preferably corresponds to black and the second color type preferably corresponds to brown.

[0075] Figure 10 shows examples of linear facial features, which are determined to have high linearity based on the shape elements of the eyes and lips, and examples of curved facial features, which are determined to have low linearity. As shown in the figure, linear facial features tend to have narrow eyes and thin lips, giving a cool and calm impression. Curved facial features tend to have round eyes and thick lips, giving a glamorous and soft impression.

[0076] Therefore, by selecting the first color type when linearity is high, it is possible to achieve cool eyes that match the impression of the facial features. For example, by making the color of the first color type eyelash cosmetic black, it is possible to make the eyelashes stand out and achieve firm eyes that match the impression of the facial features. Furthermore, by selecting the second color type when linearity is low, it is possible to achieve soft and warm eyes that match the impression of the facial features. For example, by making the color of the second color type eyelash cosmetic brown, it is possible to achieve eyes that have a natural and soft impression.

[0077] Furthermore, CPU 11 may generate a facial features classification corresponding to the color type of the eye makeup cosmetic product in conjunction with the linearity determination. For example, CPU 11 may classify the eye makeup cosmetic product into a straight line type and a curved line type in the linearity determination process (S41), and select a color type corresponding to the generated classification. Alternatively, CPU 11 may select a color type in the determination process of step S41, and then generate a facial features classification corresponding to the selected color type.

[0078] The CPU 11 may perform additional determination processing to classify the facial feature types in more detail. The additional determination processing may be determination processing using an additional determination criterion for linearity, or determination processing using a determination criterion for facial features other than linearity (for example, a child's face or an adult's face).

[0079] An example of type selection processing based on the arrangement information will be described. In this embodiment, the CPU 11 can select the type of applicator for the eyelash cosmetic based on the arrangement information. This allows the application mode of the eyelash cosmetic to be adapted to the uneven arrangement and width of the eyes.

[0080] 11, the CPU 11 first determines whether a first ratio, which is the ratio of the distance between the outer corner of the eye and the temple to the left-right width of the eye, is equal to or greater than a fourth threshold (S51). The fourth threshold is a threshold for determining the lower limit of the first ratio when, for example, the eyes are biased outward (toward the temple), and is preferably equal to or greater than 0.8 and equal to or less than 1.0, and may be 1, for example.

[0081] If it is determined that the first ratio is equal to or greater than the fourth threshold (Yes in S51), it is further determined whether the second ratio, which is the ratio of the distance between the left and right eyes to the width of the eyes in the left-right direction, is equal to or greater than a fifth threshold (S52). The fifth threshold is, for example, a threshold for determining the lower limit of the second ratio when the distance between the left and right eyes is wide, and is preferably equal to or greater than 1.2 and equal to or less than 1.5, for example, 1.5.

[0082] If it is determined that the second ratio is equal to or greater than the fifth threshold (Yes in S52), a first applicator type suitable for narrow eyes is selected (S53). If it is determined in this way, as shown in Fig. 12(A), the distance between the outer corner of the eye and the temple is wide, and the distance between the inner corners of the eyes is also wide, so the eye position is well balanced, but the face is considered to have narrow eyes.

[0083] If it is determined that the second ratio is not equal to or greater than the fifth threshold (No in S52), a second applicator type suitable for facial features with a narrow distance between the eyes is selected (S54). If it is determined in this way, as shown in Figure 12(B), the distance between the outer corner of the eye and the temple is wide and the distance between the inner corners of the eyes is narrow, so it is considered that the facial features have a narrow distance between the eyes.

[0084] On the other hand, if it is determined that the first ratio is not equal to or greater than the fourth threshold (No in S51), then, as in step S52, it is determined whether or not the second ratio, which is the ratio of the distance between the left and right eyes to the width of the eyes in the horizontal direction, is equal to or greater than the fifth threshold (S55). If it is determined that the second ratio is equal to or greater than the fifth threshold (Yes in S55), then a third applicator type suitable for facial features with a wide distance between the left and right eyes is selected (S56). If this determination is made, as shown in FIG. 12(C), the distance between the outer corner of the eye and the temple is narrow and the distance between the inner corners of the eyes is also wide, so it is considered that the facial features have a wide distance between the left and right eyes.

[0085] If it is determined that the second ratio is not equal to or greater than the fifth threshold (No in S55), a fourth applicator type suitable for wide eyes is selected (S57). If it is determined in this way, as shown in Figure 12(D), the distance between the outer corner of the eye and the temple is narrow, and the distance between the inner corners of the eyes is also narrow, so it is considered that the face has wide eyes.

[0086] In this embodiment, the CPU 11 may generate an eye placement classification corresponding to the applicator type. In this case, the CPU 11 may generate an eye placement classification by a determination process (S51, S52, S55) using the first ratio and the second ratio, and select an applicator type corresponding to the generated classification. Alternatively, the CPU 11 may select an applicator type by a determination process using the first ratio and the second ratio, and then generate an eye placement classification corresponding to the selected applicator type. As for the correspondence relationship between the applicator type and the eye placement classification, one classification may correspond to one applicator type, or multiple classifications may correspond to one applicator type. Note that the CPU 11 may select an applicator type without generating a classification.

[0087] An example of eye arrangement classification using the first ratio and the second ratio will be described using FIG. 12. For example, if the first ratio is equal to or greater than the fourth threshold and the second ratio is equal to or greater than the fifth threshold, the face can be classified as a "balanced small eye type." For example, if the first ratio is equal to or greater than the fourth threshold and the second ratio is smaller than the fifth threshold, the face can be classified as a "centripetal face type." For example, if the first ratio is smaller than the fourth threshold and the second ratio is equal to or greater than the fifth threshold, the face can be classified as a "centrifugal face type." For example, if the first ratio is smaller than the fourth threshold and the second ratio is smaller than the fifth threshold, the face can be classified as a "balanced wide eye type." A detailed explanation of each classification is shown in Table 2. Note that the names of each classification are merely examples.

[0088] [Table 2]

[0089] Specifically, the first applicator type is preferably a type in which the applicator portion 50A has a length D6 close to the width of the eye in the horizontal direction, as exemplified in FIG. 13(A). The "length of the applicator portion" refers to the maximum dimension along the direction in which the applicator portion extends. This type of applicator is also called a "long type" and can apply the liquid eyelash cosmetic to a wide range of eyelashes at once, making them appear uniformly long. Therefore, applying the first applicator type to narrow eyes can enhance the impression of the eyes. Note that the "length close to the width of the eye in the horizontal direction" here refers to the length along the direction in which the applicator extends. Specifically, it is a length between 75% and 120% of the widths D2 and D3 of the eyes shown in FIG. 6, for example, between 20 mm and 30 mm. For example, it can be 24 mm. Furthermore, the applicator portion 50A is preferably curved.

[0090] As shown in Figure 13(B), the second applicator type preferably has an applicator part 50B shaped to separate eyelashes more easily than applicator part 50A of the first applicator type. This type of applicator is also called a "separate type," and specifically, it can be configured, for example, as a brush with grooves between bristles, a brush with wide bristles, a brush with plastic bristles, a comb, or the like. Separation-type applicators separate eyelashes to achieve a finish that spreads outward, which has the effect of reducing the impression that the left and right eyes are close to each other.

[0091] As shown in FIG. 13(C), the third applicator type preferably has an applicator portion 50C that is thicker than the applicator portion 50A of the first applicator type. In other words, the thickness D8 of the applicator portion 50C is preferably thicker than the thickness D7 of the applicator portion 50A. The "thickness of the applicator portion" refers to the maximum dimension in the direction perpendicular to the extension direction of the applicator portion. This type of applicator is also called a "volume type" and has an applicator portion 50C with long tufts (the length of the tufts perpendicular to the extension direction of the applicator portion 50C). This allows for a large amount of liquid to be retained between the tufts, resulting in voluminous eyelashes. A volume type applicator enhances the presence of the eyes, even for facial features with a wide distance between the eyes, thereby reducing the impression of a wide distance between the eyes.

[0092] Specifically, as shown in Figure 13(D), the fourth applicator type preferably has an applicator part 50D that is shorter than applicator part 50A of the first applicator type. That is, the length D9 of applicator part 50D is preferably shorter than the length D6 of applicator part 50A. For example, this may be 18 mm. Furthermore, applicator part 50A is preferably linear. This type of applicator is also called a "delicate type" and can apply eyelash cosmetics to the eyelashes in small amounts. Therefore, by using the applicator unit 50D of the fourth applicator type for wide eyes, it is possible to create natural-looking eyelashes that are not too flashy. Furthermore, in order to achieve a more delicate look for the eyes, the applicator unit 50D preferably has a shape that has lower liquid retention than the applicator unit 50A of the first applicator type. For example, it is preferable that the applicator unit 50D has a shape with a higher density of bristles than the applicator unit 50A, or a shape with shorter bristles than the applicator unit 50A.

[0093] As described above, in step S23 of this embodiment, the user can select the cosmetic type, cosmetic color type, and applicator type for the eyelash cosmetics, thereby customizing the eyelash cosmetics combination suited to the user's facial features based on the feature information.

[0094] 4, the CPU 11 then transmits (outputs) type information about the selected type of eye makeup cosmetic to the user terminal 200 (S24). In this operational example, the CPU 11 transmits the type information to the user terminal 200 via the Internet N. However, the term "output" of information in this specification is a concept that broadly encompasses information output modes such as transmitting information via the Internet N, displaying on the display unit 26, and transmitting information to another electronic device using short-range wireless communication or wired communication.

[0095] The type information includes, for example, at least one piece of information selected from explanatory information for explaining the type of eye makeup cosmetic product selected, recommendation information for recommending eye makeup cosmetic products belonging to the type, and access information for accessing the explanatory information or the recommendation information. The explanatory information includes, for example, the type of eye makeup cosmetic product (e.g., "mascara"), the name of the selected type, and a description of the selected type (e.g., the reason for selecting the type and the cosmetic effects obtained). The recommendation information includes, for example, the name of the recommended eye makeup cosmetic product, an image of the eye makeup cosmetic product, a description of the eye makeup cosmetic product, the ingredients contained in the eye makeup cosmetic product, the price of the eye makeup cosmetic product, a hyperlink to a sales page for the eye makeup cosmetic product, etc. The access information includes, for example, a hyperlink, a two-dimensional barcode, a URL, etc. of a web page including the explanatory information and / or the recommendation information.

[0096] This type information may be stored, for example, in the type information database 32, and the CPU 11 may search for and extract type information about the type of the selected eye makeup cosmetic product. Alternatively, this type information may be generated based on type-related information (keywords, URL, etc.) stored in the type information database 32. In this case, the above-mentioned explanatory information and recommendation information may be generated, for example, from keywords related to the type using known writing techniques. As another example, a two-dimensional barcode may be generated from a URL related to the type.

[0097] Furthermore, in this step, in addition to the type information, CPU 11 can transmit classification information about the user's facial feature classification corresponding to the selected type of eye makeup cosmetic to user terminal 200. The classification information includes the name of the classification, a sample image (such as a photo or an image illustration of a model belonging to the selected classification), a description of the classification, etc.

[0098] As a specific process of this step, CPU 11 may, for example, generate a web page including this information and transmit it to user terminal 200. Alternatively, CPU 11 may transmit this information to user terminal 200 using other information transmission means such as email or SNS (Social Networking Service).

[0099] The CPU 21 of the user terminal 200 receives the type information and classification information (S14) and displays the received type information and classification information on the display unit 26 (S15). When a web page including the type information and classification information is received, the type information and classification information may be displayed on the same web page or on different web pages, for example. When displayed on different web pages, for example, a configuration may be adopted in which, while a web page including either the type information or the classification information is displayed on the display unit 26, the other web page is displayed by performing a predetermined input operation (for example, an operation to specify a hyperlink, a swipe operation, a flick operation, etc.). This improves convenience when viewing the type information and classification information.

[0100] FIG. 14 shows an example of a screen 60 displayed on the display unit 26. The screen 60 includes, for example, a facial image 61 of the user, category information 62, and type information 63. The category information 62 includes, for example, an eye shape classification based on shape information, a facial feature classification based on facial feature information, and an eye layout classification based on layout information. The type information 63 includes information about the type of the selected eye makeup cosmetic. The type information 63 includes, for example, information about the cosmetic type and color type of the eyelash cosmetic and the applicator type. Furthermore, the type information 63 may include, as recommended information, a hyperlink 64 to a purchase page for the eye makeup cosmetic belonging to the selected type. Displaying the category information 62 and the type information 63 on the same screen 60 makes it easy to cross-reference the selected type and the corresponding classification, thereby increasing the persuasiveness of the reasons for selecting the selected type.

[0101] On the other hand, by displaying the classification information and type information on different screens, it is possible to provide more abundant information. For example, FIG. 15 shows an example of a screen 70 containing detailed information about facial feature classification. Specifically, this screen 70 includes a name 71 of the generated facial feature classification, an image 72 of the user's face, a sample image 73 of the corresponding facial feature classification, a description 74 of the facial feature classification, a hyperlink 75 to other classification information, and a hyperlink 76 to type information. This allows the user to fully understand the facial feature classification results, and the reasons for selecting the recommended type can be made more persuasive.

[0102] As another method of displaying the classifications, web pages corresponding to multiple types of classifications and / or types may be overlapped and displayed by switching between these web pages using tabs. For example, a screen 80 shown in Fig. 16 includes a first tab 81 corresponding to shape classification, a second tab 82 corresponding to placement classification, a classification explanation field 83, a hyperlink 84 to an explanation of eye angle, a hyperlink 85 to type information, and a hyperlink 86 to facial feature classification information.

[0103] Each tab 81, 82 may be represented using characters, icons, or images. In this example, the background image of the tabs 81, 82 is a face image of the user, and an image of auxiliary lines used to extract feature information corresponding to each category is superimposed on the face image. This improves the visibility of the tabs 81, 82.

[0104] 16, the information displayed in the explanation field 83 can be switched by switching between the tabs 81 and 82 (for example, by tapping or swiping the tabs 81 and 82). The tabs 81 and 82 to be displayed are preferably visible by changing the color or display, and are indicated by a bold frame in the example shown in FIG.

[0105] As described above, according to this embodiment, by selecting a type of eye makeup cosmetics based on feature information extracted from image information of the user's face, it is possible to select a type of eye makeup cosmetics that is suitable for each user. This allows users to easily and accurately be presented with a type that suits them, thereby increasing user satisfaction. Furthermore, there are an extremely large number of eye makeup cosmetics products, and they change frequently. On the other hand, by selecting a type classified by features commonly found in various types of eye makeup cosmetics, it is possible to reduce the processing load on server 100 compared to searching for suitable products from a huge and frequently updated product database.

[0106] Furthermore, by selecting the cosmetic type of eye makeup cosmetics based on the shape information, it is possible to select a cosmetic type suited to each eye shape, which can cover concerns due to eye shape or make the eye look more prominent. In particular, for eyelash cosmetics such as mascara, the degree to which the cosmetics stays on the eyelashes and the desired cosmetic effect vary greatly depending on the eye shape, so it is possible to select an appropriate type taking these into consideration.

[0107] Furthermore, by selecting the color type of eye makeup cosmetics based on facial feature information, it is possible to present eye makeup cosmetics in colors that suit the impression of facial features.

[0108] Furthermore, if the eye makeup cosmetic is eyelash makeup such as mascara, for example, it is possible to select a cosmetic type for eyelash makeup based on shape information, a color type for eyelash makeup based on facial feature information, and an applicator type based on placement information. Generally, eyelash cosmetics such as mascara are sold as a combination of eyelash cosmetics and an applicator, and it is not possible to select a type individually. In contrast, in this embodiment, customization is possible by combining a type of eyelash makeup suitable for the shape and facial features of the eyes with a type of applicator suitable for the placement of the eyes. This makes it possible to present a type of eyelash makeup that is more suited to the individual eye features of each user.

[0109] Furthermore, while traditionally, emphasis has been placed on "long-lasting upward curl" and "volume" when it comes to mascara, in recent years, the needs have diversified due to the influence of social media, and the types of products have also diversified. According to this embodiment, by presenting suitable combinations of eyelash cosmetics and applicators, it is believed that the needs of users searching for eyelash makeup that suits them can be met.

[0110] Second Embodiment In the first embodiment described above, an example was described in which a type of eye makeup cosmetic product was selected based on feature information, but preference information regarding the user's preferences may also be taken into consideration in addition to the feature information. Note that in the following embodiments, components that are the same as or correspond to those in the above-described embodiment will be assigned the same reference numerals and descriptions thereof will be omitted.

[0111] In the example shown in FIG. 17 , after displaying the type information in step S14, the CPU 21 of the user terminal 200 acquires preference information about the user's preferences for eye makeup cosmetics (S15). The preference information includes, for example, at least one piece of information selected from an evaluation of the displayed type information, preferred makeup, preferred cosmetic effect, preferred impression, preferred cosmetic texture, preferred visually recognized cosmetic texture, and preferred cosmetic color. The evaluation of the type information may include, for example, a rating for all selected types or each type, or a questionnaire result regarding the evaluations of these. Preferred makeup can be expressed using terms related to the intensity of makeup or the occasion for applying makeup, such as heavy makeup, natural makeup, business makeup, casual makeup, or party makeup. Preferred cosmetic effects are preferably expressed using terms that specifically indicate the cosmetic effect for the eyes, such as long, voluminous, curled, and natural for eyelashes. The preferred impression may be expressed by words that describe the impression of facial features or eyes, such as cute, cool, soft, fresh, feminine, chic, cool, sharp, delicate, etc. It is preferable that such preference information is selected from predetermined options, but it may also be freely written.

[0112] Next, CPU 21 transmits the preference information to server 100 (S16). CPU 11 of server 100 receives (acquires) the preference information (S25) and selects a type of eye makeup cosmetic product based on the characteristic information and the preference information (S26). CPU 11 can, for example, change the type selected based on the characteristic information based on the information obtained from the preference information.

[0113] An example of eyelash cosmetics will be described. For example, when preference information regarding a preferred cosmetic effect or a preferred impression is acquired, the server 100 can change the type regarding the color and / or cosmetic effect while maintaining the type regarding the degree of staying power on the eyelashes (e.g., oil-based type, emulsion type, etc.). For example, when the preference information includes expressions that convey a curvaceous impression such as "cute" or "feminine," the server 100 can select a second brown color type that makes the eyes appear softer. Alternatively, when the preference information includes expressions that convey a linear impression such as "cool" or "fresh," the server 100 can select a first black color type that accentuates the eyes as the type of eyelash cosmetics.

[0114] Next, the CPU 11 of the server 100 transmits type information about the newly selected type of eye makeup cosmetic to the user terminal 200 (S27). The CPU 21 of the user terminal 200 receives the type information (S17) and displays this type information (S18).

[0115] This makes it possible to present eye makeup cosmetics of a type that is suited to the user's characteristics and that is closer to the user's ideal eye and facial impression, thereby satisfying the user's needs.

[0116] The timing of acquiring preference information is not limited to the above example. In the example shown in Fig. 18, the CPU 21 of the user terminal 200 may acquire preference information (S15) and transmit it (S16) before the step of capturing image information (S11). The CPU 11 of the server 100, which has received the preference information and image information, can select a type of eye makeup cosmetic product based on the feature information and preference information (S26). This also allows the CPU 11 to change the type in accordance with the preference information based on the type selected based on the feature information, thereby achieving the same effects as the above example.

[0117] <Other embodiments> Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and it goes without saying that various modifications can be made within the scope of the gist of the present invention.

[0118] In the above embodiment, an example has been described in which the CPU 11 of the server 100 selects a type based on the correspondence between feature information and types stored in the type information database 32, but this is not limiting. For example, the CPU 11 may select a type using a machine learning model that derives a type from feature information. Similarly, the CPU 11 is not limited to the example in which it generates a feature classification based on the correspondence between feature information and classification information stored in the feature information database 31, and may generate a feature classification using a machine learning model that derives a feature classification from feature information.

[0119] In the above-described embodiment, an example was given in which the feature information includes shape information, facial feature information, and placement information, but the feature information only needs to include at least shape information, and may include, for example, shape information and placement information, or shape information and facial feature information.

[0120] In the above-described embodiment, the eye makeup cosmetics are mainly described as eyelash cosmetics such as mascara, but are not limited thereto. For example, the eye makeup cosmetics may include eyelid cosmetics such as eye shadow and eyeliner, and eyebrow cosmetics such as eyebrow pencil. Furthermore, the eye makeup cosmetics may include multiple cosmetics, and in this case, the eye makeup cosmetics may be configured to allow customization of combinations of these types.

[0121] In the above embodiment, an example has been described in which the types include cosmetic type, color type, applicator type, etc., but the types, number, and contents of the types are not limited to these.

[0122] In the above embodiment, an example was described in which the server 100 transmits and receives information to and from the user terminal 200 via an eye makeup information providing site, but the user terminal 200 may also perform type selection processing, etc., using an application distributed from the server 100. [Explanation of symbols]

[0123] 11,21...CPU 18,28...Storage section 100...Server (information processing device) 200...User terminal

Claims

1. A computer-based information processing method for selecting types of eye makeup cosmetics, We obtain image information of the user's face, including their eyes. Based on the aforementioned image information, feature information including shape information relating to the angle of the eyelid at the inner corner of the user's eye is extracted. Based on the aforementioned characteristic information, select the aforementioned type of eye makeup cosmetic, Output type information for the selected type. Information processing methods.

2. The aforementioned eye makeup cosmetics include eye makeup products, Based on the shape information, select the type of eye makeup cosmetic. The information processing method according to claim 1.

3. The shape information is, A first angle indicating the angle of rise of the upper eyelid at the inner corner of the eye with respect to a reference line extending in the left-right direction, This includes a second angle indicating the slope of the line connecting the inner corner and outer corner of the eye with respect to the aforementioned reference line, Based on the first angle and the second angle, the type of the eye makeup cosmetic is selected. The information processing method according to claim 2.

4. If the first angle is determined to be below the first threshold, a first cosmetic type suitable for almond-shaped eyes is selected. If the first angle is determined to be not less than or equal to the first threshold, and greater than the second threshold which is greater than the first threshold, then a second cosmetic type suitable for round eyes is selected. If it is determined that the first angle is not less than or equal to the first threshold and is not greater than the second threshold, then, If the second angle is determined to be below the third threshold, a third cosmetic type suitable for droopy eyes is selected. If it is determined that the second angle is not below the third threshold, a fourth cosmetic type suitable for slanted eyes is selected. The information processing method according to claim 3.

5. The aforementioned eye makeup product is an eyelash makeup product, The first cosmetic type is an oil-based type and a long-lasting type that has the effect of making eyelashes appear longer. The second cosmetic type is a lotion type and a volume type that has the effect of increasing the volume of the eyelashes. The third cosmetic type is the emulsion type and the long type, The fourth cosmetic type is the oil-based type and the volume-type. The information processing method according to claim 4.

6. The aforementioned feature information further includes facial feature information having information about the linearity of at least one shape element included in the face, The aforementioned types of eye makeup cosmetics include types classified by the color of the eye makeup cosmetics, If, based on the facial features information, it is determined that the linearity of at least one shape element is high, a first color type corresponding to a cool color or a relatively low-luminosity color is selected. If, based on the facial features information, it is determined that the linearity of at least one of the shape elements is not high, a second color type corresponding to a warm color or a relatively bright color is selected. The information processing method according to any one of claims 2 to 5.

7. The aforementioned eye makeup product is an eyelash makeup product, The aforementioned first color type corresponds to black, The aforementioned second color type corresponds to brown. The information processing method according to claim 6.

8. The feature information further includes positional information relating to the arrangement of the user's eyes in the left-right direction of the face, The aforementioned eye makeup cosmetic comprises an eyelash cosmetic as the eye makeup cosmetic, and an applicator for applying the eyelash cosmetic. The applicator has a brush-shaped application part, Based on the shape information, select the type of eyelash cosmetic, Based on the aforementioned arrangement information, select the type of applicator. The information processing method according to any one of claims 2 to 5.

9. The aforementioned arrangement information is The first ratio is the ratio of the distance between the outer corner of the user's eye and their temple to the width of the eye in the left-right direction, This includes a second ratio, which is the ratio of the distance between the inner corners of the user's left and right eyes to the width of the eye in the left-right direction, Based on the first and second ratios, the applicator type is selected according to the characteristics of the coating portion. The information processing method according to claim 8.

10. If the first ratio is determined to be equal to or greater than the fourth threshold, and the second ratio is determined to be equal to or greater than the fifth threshold, a first applicator type is selected in which the coating portion has a length close to the width of the eye in the left-right direction. If it is determined that the first ratio is equal to or greater than the fourth threshold, and the second ratio is not equal to or greater than the fifth threshold, then a second applicator type is selected, which has an application part that is shaped to separate eyelashes more easily than the application part of the first applicator type. If it is determined that the first ratio is not below the fourth threshold and the second ratio is below the fifth threshold, a third applicator type having a coating portion that is thicker than the coating portion of the first applicator type is selected. If it is determined that the first ratio is not below the fourth threshold and the second ratio is not below the fifth threshold, a fourth applicator type having a shorter length than the coating portion of the first applicator type is selected. The information processing method according to claim 9.

11. The aforementioned type information is, Includes recommendation information for recommending eye makeup cosmetics belonging to the selected type. The information processing method according to any one of claims 1 to 5.

12. The system generates classification information for the facial features of the user corresponding to the selected type. Output the generated classification information. The information processing method according to any one of claims 1 to 5.

13. The user's preference information regarding the eye makeup cosmetics is obtained. Based on the aforementioned characteristic information and preference information, the aforementioned type of eye makeup cosmetic is selected. The information processing method according to any one of claims 1 to 5.

14. An information processing device for selecting types of eye makeup cosmetics, We obtain image information of the user's face, including their eyes. Based on the aforementioned image information, feature information including shape information relating to the angle of the eyelid at the inner corner of the user's eye is extracted. Based on the aforementioned characteristic information, Select the aforementioned type of eye makeup, Output type information for the selected type. control unit An information processing device equipped with the following.

15. An information processing system for selecting types of eye makeup cosmetics, An information processing device having a control unit, A user terminal connected to the aforementioned information processing device, It is equipped with, The user terminal transmits image information of the user's face, including their eyes, to the information processing device. The control unit, Based on the aforementioned image information, feature information including shape information relating to the angle of the eyelid at the inner corner of the user's eye is extracted. Based on the aforementioned characteristic information, select the aforementioned type of eye makeup cosmetic, Output type information for the selected type. Information processing system.

Images