Apparatus and method for providing image based personal color diagnosis information

Abstract

The present invention relates to an image-based personal color diagnosis information providing device, and the image-based personal color diagnosis information providing device may include: an acquisition unit that acquires a user image including a part of the user's face; a diagnosis unit that derives customized personal color diagnosis information tailored to the user by performing image analysis on the user image; and a providing unit that provides a result including the derived customized personal color diagnosis information.

Description

Technology Field

[0001] The present invention relates to an image-based personal color diagnosis information providing device and method. Background Technology

[0002] Personal color is a beauty theory that identifies the colors most suitable for a person's face; it can be described as a 'tone' representing the most ideal combination for all styling based on an individual's natural skin tone, mood, and appearance. Since a person's mood or image varies vastly depending on the colors applied, an increasing number of people are seeking to find their suitable personal color to look healthier and more beautiful.

[0003] Personal color is based on the fundamental concepts of color 'harmony' and 'combination,' and accordingly, a 'seasonal' classification method is used to represent the most harmonious color combinations in nature. The seasonal classification, which divides colors into spring, summer, autumn, and winter, is the most widely known classification of personal colors. However, classifying personal colors simply into four seasons has the problem of being unable to reflect the diverse characteristics of individuals.

[0004] Furthermore, a conventional method for users to receive a personal color diagnosis involves visiting an offline personal color analysis center and undergoing a diagnosis using color swatches. In this method, a color analyst at the center determines the suitability of the swatch for the individual; however, since this approach tends to be influenced by the analyst's subjective judgment, there is a problem in that personal color diagnosis results may vary depending on the analyst. Additionally, the conventional method of visiting a personal color analysis center is generally expensive, posing a financial burden on users. Moreover, because diagnosis typically requires scheduling an appointment before visiting, there are limitations regarding time and location.

[0005] The technology forming the background of the present invention is disclosed in Korean Published Patent Application No. 10-2023-0024791. The problem to be solved

[0006] The present invention aims to solve the problems of the aforementioned prior art and to provide an image-based personal color diagnostic information providing device and method capable of providing customized personal color diagnostic information that best suits the user through the analysis of the user's image.

[0007] The present invention aims to solve the problems of the aforementioned prior art and to provide an image-based personal color diagnostic information provision device and method that allows a user to receive personal color diagnostic information tailored to them at a low cost without being restricted by time or place.

[0008] However, the technical problems that the embodiments of the present invention aim to solve are not limited to the technical problems described above, and other technical problems may exist. means of solving the problem

[0009] As a technical means for achieving the above-mentioned technical problem, an image-based personal color diagnosis information providing device according to one embodiment of the present invention may include: an acquisition unit that acquires a user image including a face portion of the user; a diagnosis unit that derives customized personal color diagnosis information tailored to the user by performing image analysis on the user image; and a providing unit that provides a result including the derived customized personal color diagnosis information.

[0010] In addition, the diagnostic unit can extract color information for each body part for a pre-set body part within the user image through the performance of the image analysis, and derive personal color diagnostic information of a type that matches the extracted color information for each body part among multiple types of personal color diagnostic information as the customized personal color diagnostic information.

[0011] In addition, the above-mentioned pre-set body part may include at least one of skin, hair, and eyeball.

[0012] In addition, the diagnostic unit may display survey data for inputting self-diagnosis color information on a display unit to receive self-diagnosis color information from the user regarding a pre-set body part, and may derive the customized personal color diagnostic information by further considering the user's survey response value to the survey data.

[0013] In addition, the diagnostic unit may display color selection data for inputting preferred color information on the display unit to receive preferred color information preferred by the user, and the providing unit may generate and provide the result considering the user's preferred color response value to the color selection data.

[0014] In addition, the result includes the derived customized personal color diagnosis information and the user image obtained from the acquisition unit, and the providing unit may provide a photograph of the result in the form of a printed paper by printing the result on paper.

[0015] In addition, the above-mentioned result may further include a QR code (e.g., a first QR code) to enable consultation with an expert, and a QR code (e.g., a second QR code) to enable downloading of a result photo image corresponding to the result photo on a mobile device.

[0016] In addition, an image-based personal color diagnosis information providing device according to one embodiment of the present invention may further include a recommendation unit that recommends information on customized cosmetic products tailored to the user based on the results provided by the providing unit.

[0017] Meanwhile, a method for providing image-based personal color diagnosis information according to one embodiment of the present invention may include: a step of acquiring a user image including a face portion of the user in an acquisition unit; a step of deriving customized personal color diagnosis information tailored to the user by performing image analysis on the user image in a diagnosis unit; and a step of providing a result including the derived customized personal color diagnosis information in a providing unit.

[0018] The above-described means for solving the problem are merely exemplary and should not be interpreted as intended to limit the invention. In addition to the exemplary embodiments described above, additional embodiments may exist in the drawings and the detailed description of the invention. Effects of the invention

[0019] According to the means for solving the problem of the present invention described above, by providing an image-based personal color diagnosis information providing device and method, it is possible to provide customized personal color diagnosis information that best suits the user through the analysis of the user's image.

[0020] According to the means for solving the problem of the present invention described above, by providing an image-based personal color diagnosis information providing device and method, it is possible to enable a user to receive personal color diagnosis information suitable for them at a low cost without being restricted by time or place.

[0021] However, the effects obtainable from the present invention are not limited to those described above, and other effects may exist. Brief explanation of the drawing

[0022] FIG. 1 is a diagram showing the schematic configuration of an image-based personal color diagnosis information providing system including an image-based personal color diagnosis information providing device according to one embodiment of the present invention. FIGS. 2 to 14 are drawings for explaining an image-based personal color diagnosis information providing device according to an embodiment of the present invention. FIG. 15 is a flowchart of the operation of an image-based personal color diagnosis information provision method according to an embodiment of the present invention. Specific details for implementing the invention

[0023] Embodiments of the present invention are described below with reference to the attached drawings so that those skilled in the art can easily implement the invention. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0024] Throughout the specification of the present invention, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" or "indirectly connected" with other elements interposed between them.

[0025] Throughout the specification of the present invention, when a member is described as being located "on," "on the upper," "on the top," "under," "on the lower," or "on the bottom" of another member, this includes not only cases where the member is in contact with the other member, but also cases where another member exists between the two members.

[0026] Throughout the specification of the present invention, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0027] Throughout the specification of the present invention, some of the operations or functions described as being performed by a terminal, device, or device may instead be performed by a server connected to said terminal, device, or device. Likewise, some of the operations or functions described as being performed by a server may also be performed by a terminal, device, or device connected to said server.

[0028] Throughout the specification of the present invention, the term "at least one" may be defined as a term including both singular and plural forms, and it will be obvious that even if the term "at least one" is not present, each component may exist in a singular or plural form and may mean singular or plural. Furthermore, whether each component is provided in a singular or plural form may be changed according to the embodiment.

[0029] FIG. 1 is a diagram showing the schematic configuration of an image-based personal color diagnosis information providing system (1) including an image-based personal color diagnosis information providing device (10) according to one embodiment of the present invention.

[0030] For convenience of explanation, the image-based personal color diagnosis information providing device (10) according to one embodiment of the present invention will be referred to as the device (10), and the image-based personal color diagnosis information providing system (1) according to one embodiment of the present invention will be referred to as the system (1).

[0031] Referring to FIG. 1, the present system (1) may include the present device (10) and a user terminal (3).

[0032] The device (10) may be a device or server that provides a web page, app page, program, or application related to providing image-based personal color diagnosis information. Here, the program or application provided by the device (10) may be referred to as the program or the app for convenience of explanation in the present invention. Additionally, the device (10) may provide an image-based personal color diagnosis information provision service, which may be referred to as the service for convenience of explanation.

[0033] For example, a user may be able to use the service by installing the program or the app through a user terminal (3) they possess.

[0034] Here, the user terminal (3) is a personal terminal owned by the user and may include, for example, all types of wired and wireless communication devices such as PCS (Personal Communication System), GSM (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (WCode Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, smartphone, smartpad, tablet PC, laptop, wearable device, desktop PC, etc., but is not limited thereto.

[0035] The device (10) and the user terminal (3) can transmit and receive data by being interconnected through a network (2). Here, the network (2) may include, for example, a 3GPP (3rd Generation Partnership Project) network, an LTE (Long Term Evolution) network, a WIMAX (World Interoperability for Microwave Access) network, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a Bluetooth network, a NFC (Near Field Communication) network, a satellite broadcasting network, an analog broadcasting network, a DMB (Digital Multimedia Broadcasting) network, but is not limited thereto and may include various wired / wireless communication networks.

[0036] Additionally, although not illustrated in the drawings, the system (1) may include at least one self-photography terminal (not shown) operated and managed by a manager who manages the device (10). Here, the self-photography terminal may refer to a self-photographer (or instant camera) that is installed (provided) at a location designated by the manager on Earth (offline) and is provided so that a user can take a self-photograph when paying a pre-set usage fee (e.g., 5,000 won, 10,000 won, etc.), and may be a terminal provided in the form of an unmanned information terminal (i.e., a kiosk).

[0037] Conventionally, there are self-shooting terminals that allow users to take photos themselves, referred to by various names such as Life Four Cuts, instant cameras, self-photo machines, photo vending machines, self studios, and unmanned studios. However, these existing self-shooting terminals merely provide the function of capturing the user's current appearance, correcting the image as needed, and outputting it as a photo (real photo), and do not provide information regarding personal color. Accordingly, the present invention aims to provide a novel type of self-shooting terminal with added functionality to provide personal color diagnostic information to such conventional self-shooting terminals. That is, each of the at least one self-shooting terminal included in the present system (1) may refer to a novel type of self-shooting terminal newly created by adding (integrating) a function to provide personal color diagnostic information to a conventional self-shooting terminal.

[0038] The present program or the present app may be pre-installed by an administrator on each of these at least one self-photo shooting terminals. Through this, each of the at least one self-photo shooting terminal can provide the present service to a user.

[0039] That is, the device (10) may be provided as a separate configuration from the self-photo shooting terminal, or it may be provided as a configuration included in the self-photo shooting terminal. In other words, for example, if the device (10) is provided in the form of a server, the system (1) may include the device (10) in the form of a server, a user terminal (3), and at least one self-photo shooting terminal, and in this case, the device (10) may control the operation of each of the at least one self-photo shooting terminal (for example, remotely) and also control the operation of the user terminal (3) through the network (2). On the other hand, if the device (10) is provided as a configuration included in the self-photo shooting terminal, the system (1) may include the self-photo shooting terminal including the device (10) and the user terminal (3). In the following description of the device (10) with reference to FIG. 1, for the convenience of explanation, the device (10) will be described using the example where it is configured to be included within a self-photography terminal (i.e., the device (10) is itself a self-photography terminal). A more detailed description of the device (10) is as follows.

[0040] FIGS. 2 to 14 are drawings for explaining an image-based personal color diagnosis information providing device (10) according to an embodiment of the present invention. Even if the details shown (described) in the drawings are omitted below, they can be applied equally to the description of the device (10).

[0041] Referring to FIGS. 1 to 14, the device (10) is an image-based personal color diagnosis information providing device, and in particular, it may mean a device that can provide personal color diagnosis information together in conjunction with a self-photo shooting terminal (i.e., a self-photo camera), that is, a device that can provide a photo containing both personal color diagnosis information and a user image when providing a user image taken of a user.

[0042] The device (10) may include an acquisition unit (11), a diagnosis unit (12), a provision unit (13), a display unit (14), a recommendation unit (15), a control unit (16), and a database unit (17).

[0043] The acquisition unit (11) can acquire a user image including the user's face area.

[0044] For example, when the acquisition unit (11) detects that a user has paid a usage payment amount (e.g., 5,000 won, 10,000 won, etc.) that has been pre-set by the administrator, it can control the camera provided in one area of ​​the device (10) to be in a shooting active mode so that a real-time acquired image obtained through the camera is displayed on the display unit (14) provided in one area of ​​the device (10).

[0045] Additionally, the acquisition unit (11) can guide the user to take a user image by displaying photo shooting guide information on the display unit (14) when the camera is in shooting active mode. FIG. 2 illustrates an example of a screen displayed on the display unit (14) when the camera is in shooting active mode.

[0046] Referring to FIG. 2, the photo shooting guide information may include face position guideline information indicating the point where the user's face should be positioned, and guide text information. Here, the guide text information may be information such as, for example, 'Please keep turning your face at various angles until face recognition is complete.'

[0047] When a user wishes to use the service provided by the device (10), for example, payment for the usage amount may be made by inserting cash of a pre-set usage payment amount into a fee input section provided in one area of ​​the device (10), or payment for the usage amount may be made by using the simple payment function of the user terminal (3) based on NFC communication by contacting the user terminal (3) into the fee input section. Subsequently, when the camera is in a shooting active mode, the user may have their face recognized by the camera according to the photo shooting guide information, thereby causing the camera to take and acquire a user image. That is, based on the photo shooting guide information, the user may take a photo to acquire a user image by positioning their face at a location corresponding to the face position guide line information. Accordingly, the acquisition unit (11) can acquire a user image including the user's face area from the camera through the performance of shooting by the camera.

[0048] The diagnostic unit (12) can derive customized personal color diagnostic information tailored to the user by performing image analysis on the user image acquired from the acquisition unit (11). When performing image analysis, the diagnostic unit (12) can perform image analysis using various image analysis techniques that have been previously disclosed or will be developed in the future (e.g., object extraction techniques, color analysis techniques).

[0049] At this time, the diagnostic unit (12) can automatically extract color information for each body part for a pre-set body part within the user image through the performance of the image analysis, and based on the extracted color information for each body part, derive personal color diagnostic information of a type that matches the extracted color information for each body part among multiple types of personal color diagnostic information as customized personal color diagnostic information.

[0050] Here, the pre-defined body part may include at least one of skin, hair, and pupil. In this case, the skin may include facial skin, which is the skin of the face area, and neck skin, which is the skin of the neck area; however, this is merely an example to aid in understanding the present invention and is not limited thereto, and the skin may include skin of various body parts such as the forehead area, arm area, as well as the face area and neck area. In the present invention, it may be more preferable for the pre-defined body part to include skin, hair, and pupil. Hair may refer to the hair portion.

[0051] Specifically, the diagnostic unit (12) can extract color information for each body part, such as skin color information, hair color information, and eye color information, for pre-set body parts within the user image, by performing image analysis.

[0052] At this time, the skin color information may include facial skin color information and neck skin color information. Additionally, the skin color information may include skin brightness information and skin hue information in relation to each of the facial skin color information and neck skin color information.

[0053] Regarding skin brightness information, the diagnostic unit (12) can automatically extract, through the performance of image analysis, a color corresponding to a skin brightness level that matches the color of the user's skin (particularly the skin of the face and neck areas) identified within the user image among a plurality of predefined skin brightness levels, as illustrated in FIG. 3, for example, as skin brightness information of the user's skin. Here, the plurality of skin brightness levels may be set to be divided into eight levels, including, for example, levels 1 through 8, and may be set so that a lower level indicates a brighter color (i.e., a light color), and a higher level indicates a darker color (i.e., a dark color). At this time, the reference range of brightness values ​​for each skin brightness level to distinguish the plurality of skin brightness levels from one another may be pre-set, for example, by an administrator managing the device (10).

[0054] Regarding skin color information, the diagnostic unit (12) can automatically extract, through the performance of image analysis, a color corresponding to a skin color step that matches the color of the user's skin (especially the skin of the face and neck area) identified within the user image among a plurality of predefined skin color steps as illustrated in FIG. 3, as the user's skin color information. Here, the plurality of skin color steps may be set to be divided into nine steps, including, for example, steps 1 through 9, and may be set so that the lower the step, the warmer the color tone is closer to a yellow tone (i.e., warm tone color tone), and the higher the step, the cooler the color tone is closer to a pink tone (i.e., cool tone color tone). Here, for example, the skin color corresponding to step 5 is a color tone that is an intermediate tone between a warm tone and a cool tone, which can be referred to as a natural tone color tone. At this time, the standard range of color values ​​for each skin color step to distinguish the plurality of skin color steps from one another may be pre-set, for example, by an administrator managing the device (10).

[0055] Here, the skin of a user with a warm tone (yellow tone) has the characteristics of being yellowish, easily tanned in the sun, prone to freckles or blemishes, matte and thick-looking, oily, and suitable for gold. On the other hand, the skin of a user with a cool tone (pink tone) has the characteristics of being pinkish, easily tanned and reddened in the sun, thin skin with visible capillaries, pale or slightly grayish skin, dry skin, and suitable for silver, white, and gold.

[0056] In this way, the diagnostic unit (12) can automatically extract color information of the user's skin (i.e., color information of the user's skin including brightness information of the user's skin and color information of the user's skin) from the user image by performing a skin color matching (or skin tone color matching) process that identifies (determines) which color level the user's skin in the user image corresponds to within each of the multiple skin brightness levels and multiple skin color levels through image analysis.

[0057] Additionally, the diagnostic unit (12) can extract color information of hair within the user image, wherein the color information of the hair may include color tone information of the hair and texture information of the hair. Additionally, the color tone information of the hair may include color type information of the hair and brightness information of the hair.

[0058] Regarding the color information of the hair, the diagnostic unit (12) can automatically extract, through the performance of image analysis, a color type that matches the color of the user's hair identified within the user image among a plurality of predefined hair color types, as illustrated in FIG. 4, for example, as the user's hair color type information. Here, the plurality of predefined hair color types may include three hair color types, for example, a first color type that is yellowish brown, a second color type that is light blackish gray without yellow, and a third color type that is black without yellow, but are not limited thereto, and the number and types of the plurality of hair color types may be variously set and changed by the administrator managing the device (10). At this time, the standard range of color values ​​for each hair color type to distinguish the plurality of hair color types from one another may be pre-set by the administrator managing the device (10), for example.

[0059] Regarding hair brightness information, the diagnostic unit (12) can automatically extract, through the performance of image analysis, a color corresponding to a hair brightness level that matches the brightness of the user's hair identified within the user image among a plurality of predefined hair brightness levels, as illustrated in FIG. 4, for example, as the user's hair brightness information. Here, the plurality of hair brightness levels may be set to be divided into five levels, including, for example, levels 1 through 5, and may be set so that a lower level indicates a darker color and a higher level indicates a brighter color. At this time, the reference range of brightness values ​​for each hair brightness level to distinguish the plurality of hair brightness levels from one another may be pre-set, for example, by an administrator managing the device (10).

[0060] In addition, regarding hair texture information, the diagnostic unit (12) can automatically extract a hair texture type that matches the user's hair texture identified within the user image among a plurality of predefined hair texture types, as shown in FIG. 4, for example, as the user's hair texture information, through the performance of image analysis. Here, the plurality of predefined hair texture types may include, for example, a first hair texture type that is glossy, a second hair texture type that is dry and brittle without gloss, a third hair texture type that has thin hair thickness, and a fourth hair texture type that has thick hair thickness, totaling four hair texture types. At this time, judgment criteria information for each hair texture type to distinguish the plurality of hair texture types from one another (for example, a standard range of brightness values ​​or color values ​​for distinguishing hair texture types) may be pre-set by, for example, an administrator managing the device (10).

[0061] In this way, the diagnostic unit (12) can automatically extract color information of the user's hair (i.e., color information of the user's hair including color type information of the user's hair and brightness information of the user's hair, and color information of the user's hair including texture information of the user's hair) from the user image by performing a hair color matching process that identifies (determines) which stage or type the user's hair in the user image belongs to within each of the multiple hair color types, multiple hair brightness stages, and multiple hair texture types through image analysis.

[0062] Additionally, the diagnostic unit (12) can extract color information of the pupil (i.e., iris) within the user image, and the color information of the pupil may include color type information of the pupil and image type information of the eye.

[0063] Regarding the information on the color type of the pupil, the diagnostic unit (12) can automatically extract, through the performance of image analysis, a color type that matches the color of the user's pupil identified within the user image among a plurality of predefined pupil color types, as illustrated in FIG. 5, for example, as the user's pupil color type information. Here, the plurality of predefined pupil color types may include, for example, a first color type that is brown with yellow and / or green colors appearing in the pupil (iris), a second color type that is brown (or black) with red colors appearing, a third color type that is yellow with whites appearing, and a fourth color type that is blue with whites appearing, but are not limited thereto, and the number and types of the plurality of pupil color types may be set and changed in various ways by the administrator managing the device (10). At this time, the standard range of color values ​​for each color type of the pupil to distinguish between multiple pupil color types may be pre-set, for example, by a manager who manages the device (10).

[0064] Regarding the eye image type information, the diagnostic unit (12) can automatically extract an eye image type that matches the user's eye identified within the user image among a plurality of predefined eye image types, as illustrated in FIG. 5, for example, as the user's eye image type information, by performing image analysis. Here, the predefined plurality of eye image types may include three types of eye image types, for example, a first eye image type in which the pupil appears as a deep eye, a second eye image type in which the pupil is sparkling, and a third eye image type in which the color contrast between the pupil and the white of the eye is strong, but are not limited thereto, and the number and types of the plurality of eye image types may be variously set and changed by the administrator managing the device (10). At this time, the eye image type judgment criteria information for distinguishing the plurality of eye image types from one another (for example, reference range information for brightness values ​​or color values ​​for distinguishing eye image types, etc.) may be pre-set by the administrator managing the device (10), for example.

[0065] In this way, the diagnostic unit (12) can automatically extract color information of the user's pupils (i.e., color information of the user's pupils including color type information of the user's pupils and image type information of the eyes) from the user image by performing an eye color matching process to identify (determine) which type the user's eye in the user image belongs to within each of the multiple pupil color types and multiple eye image types through image analysis.

[0066] According to the above description, the diagnostic unit (12) can extract color information of the skin, hair, and eyes as color information for each body part through image analysis. Subsequently, the diagnostic unit (12) can perform image analysis on the user image and, based on the color information for each body part of the user automatically extracted from the user image, derive a type of personal color diagnostic information that matches the extracted color information for each body part of the user among the predefined multiple types of personal color diagnostic information as customized personal color diagnostic information tailored to the user.

[0067] Here, the number of types of personal color diagnosis information can be 12. For example, the multiple-type personal color diagnosis information includes: Type 1 personal color diagnosis information corresponding to Spring-Light among Spring Warm Tones; Type 2 personal color diagnosis information corresponding to Spring-Bright among Spring Warm Tones; Type 3 personal color diagnosis information corresponding to Spring-Vivid among Spring Warm Tones; Type 4 personal color diagnosis information corresponding to Summer-Light among Summer Cool Tones; Type 5 personal color diagnosis information corresponding to Summer-Mute among Summer Cool Tones; Type 6 personal color diagnosis information corresponding to Summer-Soft among Summer Cool Tones; Type 7 personal color diagnosis information corresponding to Autumn-Mute among Autumn Warm Tones; Type 8 personal color diagnosis information corresponding to Autumn-Soft among Autumn Warm Tones; Type 9 personal color diagnosis information corresponding to Autumn-Deep among Autumn Warm Tones; Type 10 personal color diagnosis information corresponding to Winter-Clear among Winter Cool Tones; and among Winter Cool Tones It may include personal color diagnosis information of Type 11 corresponding to Winter-Deep, and personal color diagnosis information of Type 12 corresponding to Winter-Bright among Winter Cool tones. However, this is merely an example to aid in understanding the present invention and is not limited thereto, and the number and types of personal color diagnosis information types may include those previously disclosed or those to be developed in the future.

[0068] In the database section (17), for example, diagnostic standard condition information that serves as a standard for diagnosing each type of personal color diagnostic information may be stored in conjunction with each of the multiple types of personal color diagnostic information. Here, the diagnostic standard condition information may include, for example, diagnostic standard condition information for each of the skin color information, hair color information, and pupil color information. As an example, the database section (17) may store [information regarding conditions where the skin color information is derived as the first information, the hair color information as the second information, and the pupil color information as the third information] as first diagnostic standard condition information corresponding to the first type of personal color diagnostic information. As another example, the database section (17) may store [information regarding conditions where the skin color information is derived as the fourth information, the hair color information as the fifth information, and the pupil color information as the sixth information] as second diagnostic standard condition information corresponding to the second type of personal color diagnostic information. In the database section (17), for each of the multiple types of personal color diagnosis information, at least one diagnosis standard condition information may be stored in a linked manner.

[0069] In addition, the diagnostic criteria condition information for each type of personal color diagnostic information stored in the database section (17) can be set by considering, for example, information regarding diagnostic conditions for types of personal color that have been previously announced or will be developed in the future.

[0070] According to this, the diagnostic unit (12) can derive a second type of personal color diagnostic information (i.e., a second type of personal color diagnostic information corresponding to Spring-Bright among Spring Warm Tones) as customized personal color diagnostic information for the user, when color information for each body part of the user extracted through image analysis of the user image, for example, [skin color information is the fourth information, hair color information is the fifth information, eye color information is the sixth information].

[0071] Subsequently, the providing unit (13) may provide a result including customized personal color diagnosis information derived from the diagnosis unit (12). Here, the result may include customized personal color diagnosis information derived from the diagnosis unit (12) and a user image acquired from the acquisition unit (11). The providing unit (13) may provide a photograph of the result in the form of a printed paper by printing the result onto paper.

[0072] That is, for example, as the device (10) is configured to be provided in the self-photo shooting terminal (i.e., self-photo camera) itself, the providing unit (13) can print the result on a prepared paper after customized personal color diagnosis information is derived from the diagnosis unit (12), and accordingly, can provide the result (result photo) of the paper on which the result is printed to the user. Here, various printing papers capable of printing images, such as synthetic paper, art paper, thermal paper, Deadlong paper, and A4 paper, may be used as the paper. Examples of results (result photos) provided by the providing unit (13) are illustrated in FIGS. 6 to 9.

[0073] With reference to this, the result (result photo) provided by the providing unit (13) may include not only the customized personal color diagnosis information derived from the diagnosis unit (12) and the user image obtained from the acquisition unit (11), but also a QR code (which may be referred to as the first QR code) to enable consultation with an expert (personal color diagnosis expert), and a QR code (which may be referred to as the second QR code) to enable the user to download the result photo image corresponding to the result photo on a mobile device. Here, mobile may refer to a user terminal (3) possessed by the user.

[0074] In particular, the result may include customized personal color diagnosis information displayed in a first area within the entire area of ​​the result (the entire front area of ​​the result), a user image displayed in a second area within the entire area of ​​the result, a first QR code displayed in a third area within the entire area of ​​the result, and a second QR code displayed in a fourth area within the entire area of ​​the result. At this time, each of the first to fourth areas within the entire area of ​​the result may be provided (placed) in a position that does not overlap with each other.

[0075] Here, the customized personal color diagnostic information within the result may refer to information regarding the personal color that best suits (matches) the color information of the user's body parts, based on color information of the user's body parts extracted through image analysis of the user's image (i.e., diagnostic information regarding the personal color diagnosed (analyzed) as best suiting).

[0076] This customized personal color diagnosis information may include, for example as illustrated in FIGS. 6 to 9, type information of personal color that matches the color information of the user's body parts (i.e., information on which type the user belongs to among multiple types of personal color diagnosis information (especially 12 types)), keywords, hair color, base color, eye shadow color, lip color, blush color, best color, worst color, and nail color.

[0077] Additionally, the user image included in the result may be i) an uncorrected user image in which the user image obtained from the acquisition unit (11) is applied as is without correction, or ii) a corrected user image generated by correcting the user image by taking into account the preferred color response value entered by the user when the preferred color response value for the color selection data for inputting preferred color information, which will be described later, is entered by the user.

[0078] Additionally, the first QR code within the result may represent a configuration provided to connect the user with an expert (personal color diagnosis expert) so that the user can consult with the expert about their personal color. For example, after receiving the result provided by the providing unit (13), if the user wishes to consult with an expert, the user can recognize (take a picture or scan) the first QR code provided within the result using the camera of the user terminal (3). In response to this, when the control unit (16) within the device (10) detects that the user has recognized the first QR code with the user terminal (3), it can control the connection to facilitate consultation (communication) between them by, for example, establishing a call connection between the expert terminal held by the expert and the user terminal (3), or establishing a chat room connection. Here, the expert terminal where the call connection or chat room connection is made may be, for example, one of the multiple expert terminals possessed by each of the multiple experts already registered in the database unit (17) of the device (10) (or multiple expert terminals corresponding to each of the multiple expert information already registered).

[0079] Additionally, the second QR code within the result may be configured to allow the user to download the image on the result (i.e., the result photo image) provided by the providing unit (13) to a personal mobile terminal (e.g., a personal terminal owned by the user, such as a smartphone, desktop PC, tablet PC, etc., user terminal (3)). For example, if the user wishes to download the result photo image after receiving the result, the user may recognize the second QR code provided within the result using the camera of the user terminal (3). In response to this, the control unit (16) within the device (10) may control the result photo image corresponding to the result to be immediately downloaded and stored within the user terminal (3) when it is detected that the user has recognized the second QR code with the user terminal (3), or may control the result photo image to be stored within the user terminal (3) in response to the user clicking the download button after displaying a download guide message on the screen of the user terminal (3).

[0080] For example, referring to FIG. 6, the diagnostic unit (12) performs image analysis on a user image so that color information for each body part of the user (i.e., color information for each of the skin, hair, and pupils) is extracted as one of the color information belonging to [extracted color information for each body part] as shown in FIG. 6 (or pre-set color for each body part). As a result of analyzing the extracted color information for each body part, the result of the analysis of the color information for each body part extracted from the user image (i.e., the result of the image analysis of the user image) is extracted as shown in the left picture of FIG. 6, for example, as “the skin is bright yellowish or medium tone. the pupils are yellowish-brown-brown.”

[0081] In other words, let us assume that the result of image analysis of a user image (image analysis result) is extracted as follows: i) in the case of skin (or skin color information), 'the skin brightness information is analyzed as belonging to the 1st skin brightness level (i.e., the brightest color) and the skin color tone information belongs to the 5th skin color tone level (i.e., a medium tone),' so that “the skin is bright and yellowish or medium tone”; and ii) in the case of pupil (or pupil color information), 'the pupil color type information is analyzed as belonging to the 1st color type, which is brown with yellow color appearing in the pupil,' so that “the pupil is light brown-brown”.

[0082] In this way, the diagnosis unit (12) can derive a customized personal color diagnosis information of the type that matches the analysis result among the previously defined multiple types (12 types) of personal color diagnosis information, such as the analysis result of the extracted color information for each body part (i.e., the result of image analysis), such as “skin is bright yellowish or medium tone. pupils are light brown-brown” as shown in the left figure of FIG. 6, and can derive a customized personal color diagnosis information of the type that matches the analysis result. For example, it can derive a customized personal color diagnosis information of the second type corresponding to Spring-Bright among Spring Warm tones. Afterwards, the providing unit (13) can provide the user with a result that includes the customized personal color diagnosis information (for example, the second type of personal color diagnosis information), such as the result shown in the left figure of FIG. 6 (i.e., a result corresponding to <Spring type user>-(1)).

[0083] FIGS. 6 to 9 illustrate examples of results derived based on color information of body parts of users of eight types (i.e., eight types including Spring-Bright, Spring-Light, Summer-Light, Summer-Soft, Autumn-Soft, Autumn-Deep, Winter-Deep, and Winter-Bright). Since the specific descriptions for each of these eight types can be understood as identical or similar to the descriptions given for <Spring type user>-(1) above, redundant descriptions below will be omitted.

[0084] In this way, the providing unit (13) can analyze color information by body part extracted through image analysis of the user image to determine which type of personal color diagnosis information the user corresponds to among multiple types of personal color diagnosis information (i.e., derive customized personal color diagnosis information), and can output and provide to the user a result (result photo) that includes the customized personal color diagnosis information and the user image together.

[0085] The display unit (14) refers to a screen display unit (liquid crystal panel) provided in one area of ​​the device (10), and may refer to a screen on which various information provided by the device (10) is displayed. The display unit (14) may be provided in the form of, for example, a touch panel, an LCD screen, etc.

[0086] Additionally, the diagnostic unit (12) can display survey data for inputting self-diagnosis color information on the display unit (14), as shown in FIG. 10, in order to receive self-diagnosis color information from the user regarding a pre-set body part when performing image analysis on the acquired user image (especially while performing image analysis), and can derive customized personal color diagnosis information by further considering the user's survey response value to the survey data (i.e., self-diagnosis color information entered by the user).

[0087] Here, the survey data for inputting self-diagnosis color information may refer to information provided to the user for the purpose of increasing the accuracy of the results of the customized personal color diagnosis information derived from the diagnosis unit (12) and providing customized personal color diagnosis information that is more targeted only at the user. The survey data may include multiple question information provided to allow the user to input information regarding self-diagnosis related to pre-set body parts (especially skin, hair, and pupils). The number and wording of the multiple question information within the survey data may be variously set and changed by the administrator managing the device (10).

[0088] For example, referring to Fig. 10, among the multiple item information in the survey data, the first item information may include question information such as "Please select the type closest to your skin type when exposed to sunlight for a long time" and multiple option information such as "01. Tans easily, 02. Burns red." The second item information may include question information such as "Please select the type closest to your skin type" and multiple option information such as "01. Dry (skin feels tight and itchy often, reacts immediately to external influences such as temperature), 02. Normal (pores are small and skin is soft, little moisture on the skin surface), 03. Oily (a lot of oil and skin is shiny, has a lot of sebum), 04. Combination (T-zone is particularly shiny, cheeks are normal or dry skin)." The third item information may include question information such as 'Please select your eye color' and multiple choice information such as '01. Light brown, 02. Dark brown, 03. Dark color'.

[0089] When the diagnostic unit (12) displays survey data on the display unit (14), for example, when a user image acquired from the acquisition unit (11) is exposed on the screen of the display unit (14), the survey data can be overlaid and displayed on the user image, and in particular, when the survey data is overlaid and displayed, only one item of information among multiple item information within the survey data can be overlaid and displayed. That is, when the diagnostic unit (12) displays survey data on the screen of the display unit (14), multiple item information can be displayed on the screen of the display unit (14) one item at a time.

[0090] The diagnostic unit (12) can derive customized personal color diagnostic information tailored to the user by comprehensively considering the user's survey response value to the survey data (i.e., self-diagnostic color information entered by the user through the survey data) and the results of image analysis automatically extracted (analyzed) through the performance of image analysis.

[0091] The user's survey response value for the survey data can be used to improve the accuracy of the image analysis results, for example, to correct the image analysis results. Since image analysis is a technology that is performed automatically by a device, in various situations such as when the quality of the acquired user image is poor or when the user applies too much makeup, the color information for each body part extracted by image analysis may differ significantly from the user's actual color information for each body part (i.e., accurate color information may not be extracted). Accordingly, the device (10) can derive more accurate customized personal color diagnosis information suitable for the user by providing survey data and receiving a survey response value (i.e., self-diagnosis color information) from the user, through an analysis that considers the received survey response value and the image analysis results together.

[0092] That is, the device (10) can obtain information such as the color of the user's pupils, which is somewhat difficult to measure accurately in the device, and information regarding whether the user's skin is of the tanning type, by performing a preliminary personal self-diagnosis process in which survey data is provided and survey response values ​​corresponding to the survey data are entered by the user, and by performing an analysis of the user's personal color considering the obtained survey response values ​​of the user, the accuracy of the customized personal color diagnosis information derived from the diagnosis unit (12) can be increased.

[0093] Additionally, the diagnostic unit (12) may display color selection data for inputting preferred color information on the display unit (14), as shown in FIG. 11, for example, in order to receive preferred color information preferred by the user when performing image analysis on a user image, for example (especially while performing image analysis). Afterward, the providing unit (13) may generate and provide a result that takes into account the user's preferred color response value to the color selection data.

[0094] At this time, the color selection data for inputting preferred color information may include, for example, multiple color selection data. Referring to FIG. 11, the multiple color selection data may include, for example, a first color selection data that allows the user to select a lip color they usually prefer, a second color selection data that allows the user to select a color they usually prefer, a third color selection data that allows the user to select a color scheme they usually prefer, and a fourth color selection data that allows the user to select a color background they prefer. At this time, the number and content of the multiple color selection data may be set and changed in various ways by an administrator managing the device (10).

[0095] Such color selection data may be data provided to allow the user to select a prior private color and style. By providing color selection data for inputting preferred color information, the device (10) allows the user to pre-select their private color and style before the result is generated, for example, as soon as the user's image is acquired by the acquisition unit (11), thereby naturally receiving (collecting) the user's preferred color information, and can generate and provide a result by taking into account the received user's preferred color information.

[0096] For example, when the diagnostic unit (12) detects that a response value for the color selection data (i.e., the user's preferred color response value) has been entered by the user after the diagnostic unit (12) displays the color selection data on the display unit (14), the providing unit (13) corrects the user image obtained by the acquiring unit (11) by taking into account the preferred color response value entered by the user (i.e., corrects the user image so that the color corresponding to the preferred color response value is reflected in the user image obtained by the acquiring unit), and then provides the user with a result generated to include the corrected user image and the derived customized personal color diagnostic information.

[0097] The recommendation unit (15) can recommend information on customized cosmetic products tailored to the user based on the result (result photo) provided by the providing unit (13). In particular, the recommendation unit (15) can recommend information on cosmetic products having a color corresponding to the customized personal color diagnosis information to the user as information on customized cosmetic products based on the customized personal color diagnosis information within the result provided by the providing unit.

[0098] The recommendation unit (15) may recommend to the user by i) displaying information about the customized cosmetic product on the screen of the display unit (14), or ii) when it is detected that the user has entered the user's mobile phone number (i.e., the phone number of the user terminal (3)) through the display unit (14), it may recommend to the user by displaying information about the customized cosmetic product on the screen of the terminal corresponding to the entered mobile phone number (i.e., the user terminal (3) possessed by the user).

[0099] Here, the types of cosmetic products corresponding to the information of customized cosmetic products recommended by the recommendation unit (15) may include, for example, BB cream, eye shadow, lipstick, nail polish, etc., but are not limited to these, and various types of cosmetic products may be considered.

[0100] In addition, the device (10) may be a component included within a self-photography terminal as previously mentioned (i.e., the device (10) itself may be a self-photography terminal), and although not shown in the drawing, the device (10) may include a cosmetics sales section (not shown) provided in a portion of the internal space of the body part of the device (10).

[0101] The cosmetic sales section (not shown) may include multiple types of cosmetic products already displayed in the internal space. When the recommendation section (15) recommends information on customized cosmetic products to the user, the cosmetic sales section may subsequently provide (supply) cosmetic products that match the recommended information on customized cosmetic products so that the user can purchase them. The cosmetic sales section (not shown) may be referred to by other terms such as cosmetic vending machine, cosmetic vending machine, cosmetic vending machine, etc.

[0102] The control unit (16), for example, after the recommendation unit (15) recommends information on customized cosmetic products to the user, can subsequently identify a cosmetic product that matches (corresponds to) the information of the recommended customized cosmetic product among the multiple types of cosmetic products already displayed in the internal space of the cosmetic sales unit (not shown), and control the operation of the cosmetic sales unit (not shown) so that the identified cosmetic product can be shown (exposed) to the user. Subsequently, after the identified cosmetic product is exposed to the user through the cosmetic sales unit (not shown), if the control unit (16) detects that payment of a pre-set sales amount for the identified cosmetic product has been made by the user, it can subsequently control the operation of the cosmetic sales unit (not shown) so that the identified cosmetic product is discharged (outputted) through a discharge port provided in one area of ​​the cosmetic sales unit. Through this, the user can use the identified cosmetic product discharged through the discharge port.

[0103] That is, the user can receive a photo (result photo) containing personalized personal color diagnosis information and the user's image through the device (10), and can also receive recommendations for cosmetic products that match the personalized personal color diagnosis information as personalized cosmetic information, and furthermore, can immediately purchase actual cosmetic products corresponding to the recommended personalized cosmetic products through a cosmetic sales department (not shown).

[0104] The control unit (16) can control the operation of each part included in the device (10). Additionally, the control unit (16) can control the operation (e.g., screen display) of a user terminal (3) connected to the device (10) via a network (2). Furthermore, if the device (10) is provided in the form of a server, the control unit (16) can control the operation of each of at least one self-photography terminal (not shown) connected to the device (10) via a network (2).

[0105] The database section (17) may store various data considered in the device (10). Additionally, as previously mentioned, the database section (17) may store, for example, diagnostic standard condition information that serves as a standard for diagnosing each type of personal color diagnostic information for each type of personal color diagnostic information.

[0106] According to the above description, the device (10) relates to a device that provides personal color information in conjunction with a self-photo camera (self-photo shooting terminal), and may refer to a technology in which personal color is incorporated into a self-photo camera. When a user takes a photo (i.e., when a photo is taken to acquire a user image), the device (10) performs image analysis on the user image acquired by the photo, and based on the color information of each body part of the user extracted by the image analysis, performs an analysis (diagnosis) of the user's current state (current color state) including the user's face part within the user image, derives customized personal color diagnostic information suitable for the user based on the analysis result (result of image analysis), and subsequently provides a result containing the derived customized personal color diagnostic information and the user image together (i.e., a result photo containing the content together on paper through printing). At this time, a first QR code for consultation with an expert may be included in one area within the result. In addition, the device (10) may also recommend information on cosmetics (customized cosmetic products) to the user based on the derived customized personal color diagnosis information.

[0107] That is, by providing this service, the device (10) analyzes the user's image to find the color that best suits the user, finds all beauty elements for branding the user such as makeup, hair, clothes, and nails, provides color curation, and can find their own identity by customizing only for the user.

[0108] The device (10) can provide content that customizes clothes, lips, hair, lenses, nails, etc. based on colors that suit the user. Additionally, the device (10) can provide situational makeup guides, and specifically, it can recommend makeup suitable for the user or provide self-makeup guides based on the user's current appearance (the user's current situation) within the user image. Additionally, the device (10) can provide a function that automatically recommends a personal background (i.e., a background within the user image inserted into the result) that best matches the user's current appearance (the user's current makeup state, styling state) so that a daily identity can be captured.

[0109] The device (10) can provide reliability to the user through professional personal color diagnosis and customization, and can provide practicality by providing virtual makeup functions, studio functions, etc.

[0110] FIG. 12 is a diagram showing an example of a screen display displayed on a display unit (14). Referring to FIG. 12, for example, the device (10) can induce the user to take a photo for a personal color diagnosis. Afterward, when the user image is obtained through the photo capture, the device (10) derives customized personal color diagnosis information through image analysis. At this time, before the customized personal color diagnosis information is derived, the device can control the display unit (14) to display a diagnosis guidance message (for example, a message such as 'personal color diagnosis in progress') on the screen during the loading time. Additionally, the device can control the display unit (14) to display today's makeup tip information on the screen during the loading time.

[0111] For example, today's makeup tip information may be such as, "Try using lipstick as blush; it will match the overall tone of your face and complete a more atmospheric makeup look." Subsequently, the device (10) can provide the user with a result including customized personal color diagnosis information derived from the diagnosis unit (12). In addition, the device (10) may control the customized personal color diagnosis information derived from the diagnosis unit (12) to be displayed on the screen of the display unit (14) or the screen of the user terminal (3), such as the diagnosis result shown in 4) of FIG. 12, for example.

[0112] The device (10) can provide perfect customized beauty curation through personal color diagnosis as well as analysis of the user's facial features, and can also provide a virtual makeup function by finding all of the user's beauty elements (e.g., clothes, hair, lenses, nails, etc.) and analyzing the perfect branding color so that the mood can be visually seen without actually trying on makeup.

[0113] FIG. 13 shows an example of screen display of information on customized cosmetic products recommended by the recommendation unit (15). That is, the recommendation unit (15) can recommend information on customized cosmetic products (especially color information of customized cosmetic products) customized to the user based on the results by displaying (providing) it on the screen of the display unit (14) or the screen of the user terminal (3) as shown in FIG. 13.

[0114] The recommendation unit (15) can recommend lip products or lip product color information based on the color of the user's clothes in the user image, for example, based on the results provided by the provision unit (13) (especially based on customized personal color diagnosis information), and can also recommend hair color, lens color, nail color, etc. based on personal color.

[0115] In addition, the recommendation unit (15) may go beyond recommending information on customized cosmetic products and provide a virtual makeup function that allows the user to perform a simulation of applying the recommended information on customized cosmetic products (or color information of customized cosmetic products) to the user's image based on the recommended information on customized cosmetic products. By providing such a virtual makeup function, the device (10) can enable the user to purchase a satisfactory cosmetic product that suits them without trying it out directly when purchasing a specific cosmetic product, thereby reducing the probability of a failed purchase of cosmetic products.

[0116] In addition, the device (10) may provide a daily personal color background color as the final step for recording the branding of the day, providing a function to take a photo with a background that matches the makeup of the day, and may also provide a function to conveniently use the smart mirror for everything from Photoshop to SNS sharing. The device (10) may also provide a community hub function that allows convenient use from Photoshop to SNS sharing after taking a photo. Meanwhile, the device (10) may provide the following functions.

[0117] As previously mentioned, the recommendation unit (15) can recommend information on customized cosmetic products tailored to the user based on the results (result photos) provided by the provision unit (13).

[0118] At this time, for example, the recommendation unit (15) can detect that the user clicks a product recommendation button provided in a specific area of ​​the screen of the display unit (14) after the result is provided by the providing unit (13) and the user's mobile phone number is entered through the display unit (14). In response to the user's click input on the product recommendation button, the recommendation unit (15) can extract cosmetic products that have color information (color) corresponding to the customized personal color diagnosis information in the result from among the multiple cosmetic products already registered in the database unit (17) as information on multiple customized cosmetic products, and can generate a list containing the extracted information on multiple customized cosmetic products and provide (display) it on the screen of the user terminal (3).

[0119] Subsequently, the user may make a purchase by comparing the information of multiple customized cosmetic products within the list based on the list displayed on the user terminal (3), and by making a payment for a cosmetic product corresponding to the information of at least one customized cosmetic product among the information of multiple customized cosmetic products within the list. The list provided to the user terminal (3) is recommendation information recommended by the recommendation unit (15) (i.e., a list of information of recommended customized cosmetic products), and may be referred to by other terms such as recommendation list.

[0120] At this time, the recommendation unit (15) may provide a comparison candidate storage unit (50), such as illustrated in FIG. 14, to enable the user to compare information on multiple customized cosmetic products in the list more conveniently.

[0121] That is, when a user performs purchase and payment by finally selecting the information of one of the most preferred customized cosmetic products among the information of multiple customized cosmetic products included in a list, for example, the user may consider which cosmetic product information to finally select from among the information of multiple candidate cosmetic products that the user likes (i.e., information of multiple candidate customized cosmetic products that the user likes among the information of multiple customized cosmetic products in the list). At this time, to facilitate data comparison between the information of multiple cosmetic products during consideration, the recommendation unit (15) may provide a comparison candidate storage unit (50).

[0122] FIG. 14 is a drawing for explaining a comparison candidate storage unit (50) provided by a recommendation unit (15) within the device (10).

[0123] Referring to FIG. 14, in response to a user's click input on the product recommendation button, cosmetic products having color information (color) corresponding to (matching) the customized personal color diagnosis information in the result are extracted from among the multiple cosmetic products already registered in the database unit (17) as information (41, 42, 43, …) of multiple customized cosmetic products, and a list containing the extracted information (41, 42, 43, …) of multiple customized cosmetic products is generated and provided (displayed) on the screen of the user terminal (3). At this time, when providing the list, a comparison candidate storage unit (50) may be provided together in one area of ​​the screen of the user terminal (3).

[0124] At this time, the recommendation unit (15) can provide a list and a comparison candidate storage unit (50) on one screen of the user terminal (3), and thereby, when the user finally selects, for example, the information of the first customized cosmetic product (41) as the information of the most preferred customized cosmetic product among the information of multiple customized cosmetic products (41, 42, 43, …), if, during the process, the user likes the information of some customized cosmetic products (for example, the information of the first customized cosmetic product and the information of the third customized cosmetic product) among the information of multiple customized cosmetic products (41, 42, 43, …) in the list, the information of the preferred some customized cosmetic products is temporarily stored in the comparison candidate storage unit (50) as information of candidate customized cosmetic products of interest, and the information of some customized cosmetic products temporarily stored in the comparison candidate storage unit (50) (i.e., information of some candidate customized cosmetic products of interest) and the information of multiple customized cosmetic products (41, 42, 43, …) in the list are displayed together (simultaneously) on one screen of the user terminal (3). By looking at and comparing, you can make a final selection of the information on the customized cosmetic product you like (for example, the information on the first customized cosmetic product (41)).

[0125] To this end, specifically, while the user checks the information (41, 42, 43, …) of multiple customized cosmetic products in the list, if the user wishes to temporarily save, for example, the information (41) of the first customized cosmetic product as information of a candidate customized cosmetic product of interest, the user may press the information (41) of the first customized cosmetic product for a preset time (for example, 2 seconds), and in response to this, the recommendation unit (15) may temporarily save the information (41) of the first customized cosmetic product pressed by the user for the preset time to the first candidate storage area (51) among the multiple empty candidate storage areas (51, 52, …) in the comparison candidate storage unit (50).

[0126] Afterwards, if the user wishes to temporarily save the information of the third customized cosmetic product (43) among the information of multiple customized cosmetic products (41, 42, 43, …) in the list as an additional candidate customized cosmetic product information while checking the list, the user may press the information of the third customized cosmetic product (43) for a preset time, and in response to this, the recommendation unit (15) may temporarily save the information of the third customized cosmetic product (43) in the second candidate storage area (52) within the comparison candidate storage unit (50).

[0127] At this time, the comparison candidate storage unit (50) may be in a basic state as shown in (a) of FIG. 14. At this time, if the user wishes to check the information of multiple customized cosmetic products (i.e., information of multiple customized cosmetic products) that the user has temporarily saved as information of the candidate customized cosmetic products, the user may click the expansion field (50a) within the comparison candidate storage unit (50) in the basic state. At this time, in response to the user's click input on the expansion field (50a), the recommendation unit (15) may control the operation of the user terminal (3) so that the comparison candidate storage unit (50) in the basic state is displayed as the comparison candidate storage unit (50') in the expanded state as shown in (b) of FIG. 14.

[0128] Through the comparison candidate storage unit (50') in the expanded state, the user can check the information of multiple candidate customized cosmetic products that they have temporarily stored (for example, the information of the first customized cosmetic product and the information of the third customized cosmetic product). That is, within the comparison candidate storage unit (50') in the expanded state, information regarding the information (41) of the first customized cosmetic product may be displayed (exposed) in the first candidate storage area (51), and information regarding the information (43) of the third customized cosmetic product may be displayed in the second candidate storage area (52).

[0129] At this time, the recommendation unit (15) can control the display (exposure) of representative images of information for multiple candidate customized cosmetic products that are temporarily stored, for example, through each candidate storage area within the comparison candidate storage unit (50') in the expanded state (for example, the representative image of the information (41) of the first customized cosmetic product in the first candidate storage area (51), and the representative image of the information (43) of the third customized cosmetic product in the second candidate storage area (52).

[0130] Here, the recommendation unit (15) can control the representative image of the information of the customized cosmetic product (especially the information of the candidate customized cosmetic product of interest) displayed (exposed) in each candidate storage area within the comparison candidate storage unit (50') in the expanded state to be set as: i) a first case in which the information of the customized cosmetic product (i.e., the information of the candidate customized cosmetic product of interest) is automatically set as a thumbnail image that has been pre-set by the user who has registered the information of the customized cosmetic product (i.e., the seller who uploads and sells the information of the customized cosmetic product to the device (10); ii) a second case in which, when there are multiple images included in the information of the customized cosmetic product, the representative image is set as one of the multiple images selected by the user among the multiple images in the information of the customized cosmetic product; or iii) a third case in which the representative image is set as an image corresponding to a drag area (rectangular drag area) directly designated by the user on the user terminal (3) so that some content among the detailed description information of the information of the customized cosmetic product that the user wants to set as the representative image is included.

[0131] At this time, in the present invention, it may be more preferable that the representative image displayed in each candidate storage area within the comparison candidate storage unit (50) (or the comparison candidate storage unit (50') in an expanded state) be set to the third case described above, for example, and it may be more preferable that when there is no representative image set by the user (i.e., when the representative image is not set to the third case or the second case), it be set to the first case described above.

[0132] Generally, websites selling products provide a service that allows users to check products they are interested in using a shopping cart or wishlist function. However, conventional shopping cart or wishlist functions required users to move to a separate shopping cart page or wishlist settings page to check products they had registered as products of interest. Consequently, the structure made it impossible to simultaneously view information about the products currently being viewed and information about wishlisted products (or products added to the shopping cart) on a single screen, which caused inconvenience to users.

[0133] In addition, the representative image of the items of interest typically displayed on the shopping cart page or wishlist page is usually a representative image pre-set by the uploader (i.e., the seller) who uploaded the item of interest. In such cases, when a user has saved multiple items of interest, it is difficult to intuitively determine what aspects of the information the user liked and why they designated it as an item of interest based solely on the representative image (i.e., the representative image set by the seller). Consequently, there was the inconvenience of having to check each of the items of interest the user had saved individually in order to find out why they liked the item and designated it as an item of interest.

[0134] Taking these problems into account, the recommendation unit (15) can temporarily store some of the information of the customized cosmetic products among the information of multiple customized cosmetic products (41, 42, 43, …) as information of the customized cosmetic products of interest in the candidate storage area within the comparison candidate storage unit (50). At this time, as the representative image of the information of the customized cosmetic product stored in each candidate storage area (i.e., information of the customized cosmetic product of interest), instead of the representative image that is already set for the information of the customized cosmetic product (i.e., information of the customized cosmetic product of interest) (i.e., the representative image that the seller has set when uploading the information of the customized cosmetic product), an image set by specifying a drag area to include some content desired by the user (i.e., an image corresponding to the drag area specified by the user through drag input among the contents of the detailed description information of the customized cosmetic product of interest) can be applied and displayed.

[0135] Through this, the device (10) can provide a comparison candidate storage unit (50) so that the user can intuitively check and compare only the images (representative images) of information on multiple candidate customized cosmetic products that the user is interested in on the screen of the user terminal (3) where the list is displayed, and can provide convenience during comparison by allowing the user to check the information on candidate customized cosmetic products that they have temporarily saved as information of interest at a glance on one screen on the current screen where the list of information on customized cosmetic products is displayed without moving to a separate page.

[0136] Additionally, the information on multiple cosmetic products already registered in the database unit (17) may be information on multiple cosmetic products registered not only by the manager managing the device (10) but also by multiple other sellers using the device (10) and the manager. According to this, for example, the information on multiple cosmetic products already registered in the database unit (17) may include information on duplicate cosmetic products uploaded by multiple different sellers (two or more different sellers) that have the same cosmetic product model name.

[0137] Here, as mentioned earlier, the types of cosmetic products may include various types of cosmetic-related products such as BB cream, eye shadow, and lipstick.

[0138] For example, the database section (17) may include information on a first cosmetic product uploaded by a first seller (which may be, for example, an administrator managing the device (10)) among multiple sellers, information on a second cosmetic product uploaded by a second seller, information on a third cosmetic product uploaded by a third seller, information on a fourth cosmetic product uploaded by a fourth seller, etc., and for example, the information on the first cosmetic product to the information on the third cosmetic product may be information on cosmetic products of the same type having the same cosmetic product model name, even though the sellers are different, and the information on the first cosmetic product to the information on the third cosmetic product may each have different prices or at least some of the same prices.

[0139] At this time, the comparison candidate storage unit (50) may include a duplicate exclusion button provided in a single area. The recommendation unit (15) may, for example, temporarily store the information (41) of the first customized cosmetic product among the information (41, 42, 43, …) of a plurality of customized cosmetic products in a list for a preset time, thereby storing it in the first candidate storage area (51) as the information of the first candidate customized cosmetic product of interest, and then, when it is detected that the user has clicked the duplicate exclusion button in the comparison candidate storage unit (50), update the list in response to the user's click input on the duplicate control button, so that the updated list is displayed on the screen of the user terminal (3).

[0140] At this time, the updated list may mean a list generated by excluding information of the same type of customized cosmetic products that have the same cosmetic product model name as the information of the candidate customized cosmetic products temporarily stored in each of the multiple candidate storage areas (51, 52, …) within the comparison candidate storage unit (50) from among the information (41, 42, 43, …) of multiple customized cosmetic products in the list (list before update).

[0141] For example, let’s assume that the list provided by the recommendation unit (15) contains information on 40 customized cosmetic products (41, 42, 43, …), and among the information on 40 customized cosmetic products, 5 pieces of information on customized cosmetic products (e.g., information on the 1st customized cosmetic product, information on the 6th customized cosmetic product, information on the 7th customized cosmetic product, information on the 23rd customized cosmetic product, and information on the 39th customized cosmetic product) are information on cosmetic products of the same type that have the same cosmetic product model name but different sellers (i.e., information on customized cosmetic products of the same type). At this time, the user temporarily stores the information of the first customized cosmetic product among the information of 40 customized cosmetic products in the list as information of the candidate customized cosmetic product of interest in the first candidate storage area (51), and then clicks the duplicate exclusion button in the comparison candidate storage unit (50), then the recommendation unit (15) excludes the information of the 5 customized cosmetic products (i.e., the information of the 5 customized cosmetic products that are of the same type and have the same cosmetic product model name as the information of the candidate customized cosmetic product of interest stored in the first candidate storage area (51)) from the information of the 40 customized cosmetic products in the list, thereby creating a list from which the information of the 5 customized cosmetic products has been excluded (i.e., a list containing information of a total of 35 customized cosmetic products) as an updated list and providing it to the screen of the user terminal (3).

[0142] Subsequently, let us assume that within an updated list containing information on 35 customized cosmetic products, the user temporarily stores information on a second customized cosmetic product as information on a candidate customized cosmetic product of interest in the second candidate storage area (52) within the comparison candidate storage unit (50), and then clicks the duplicate exclusion button within the comparison candidate storage unit (50) again. Furthermore, let us assume that within the information on the 35 customized cosmetic products, there are a total of three customized cosmetic product information items, including the information on the second customized cosmetic product, that are information on customized cosmetic products of the same type with different sellers but identical cosmetic product model names. In this case, when the recommendation unit (15) detects that the user has temporarily stored information on the second customized cosmetic product in the second candidate storage area (52) and then clicked the duplicate exclusion button again, it can generate a list containing information on 32 customized cosmetic products, excluding information on a total of three customized cosmetic products from the information on the 35 customized cosmetic products, as a renewed updated list and provide it to the screen of the user terminal (3).

[0143] According to this, the recommendation unit (15) can continuously update and provide a list (i.e., an updated list) by providing a duplicate exclusion button, so that whenever a user temporarily stores information of a candidate customized cosmetic product in multiple candidate storage areas (51, 52, …) among the information of multiple customized cosmetic products included in the list, the user can exclude information of the same type of customized cosmetic product that is duplicated with the temporarily stored information of the candidate customized cosmetic product. When a user views information of multiple cosmetic products through the list, it is possible to check the information of the remaining cosmetic products excluding the information of cosmetic products that the user has already designated as a candidate of interest (i.e., temporarily stored in the candidate storage area as information of a candidate customized cosmetic product), thereby preventing wasted time due to checking duplicate cosmetic product information, and through this, efficient comparison of information and efficient purchasing among cosmetic product information is possible.

[0144] Additionally, the comparison candidate storage unit (50) may include a lowest price display button provided in a single area.

[0145] The recommendation unit (15) can, for example, detect when a user clicks the lowest price display button in the comparison candidate storage unit (50) while the user has temporarily stored information on three customized cosmetic products of interest in multiple candidate storage areas (51, 52, …) as information on customized cosmetic products of interest, then targeting the database unit (17) and other online shopping malls, perform a batch search for the lowest price of information on cosmetic products of the same type that have the same cosmetic product model name as the information on each of the three customized cosmetic products of interest, and then based on the results of the batch search for the lowest price, display the lowest price amount information for each of the three customized cosmetic products of interest in the bottom area of ​​the three candidate storage areas corresponding to each of the information on the three customized cosmetic products of interest.

[0146] For example, let us assume that the information on three candidate cosmetic products temporarily stored in each of the first candidate storage area to the third candidate storage area is all lipstick products, but is of different brands (i.e., three lipstick products with different cosmetic product model names), and includes a lipstick product of the first brand, a lipstick product of the second brand, and a lipstick product of the third brand. At this time, when the user clicks the lowest price display button, the recommendation unit (15) can perform a batch search for the lowest price of the information on cosmetic products of the same type corresponding to each of the information on the three candidate cosmetic products by targeting the database unit (17) and other online shopping malls.

[0147] At this time, let us assume that, for example, when a batch search for the lowest price is performed, the database unit (17) and other online shopping malls find that i) regarding the lipstick product of the first brand, it is being sold at three different prices including 10,000 won, 12,000 won, and 15,000 won at different online shopping malls (e.g., Coupang, 11st, Naver), ii) regarding the lipstick product of the second brand, it is being sold at four different prices including 41,000 won, 48,000 won, 52,000 won, and 55,000 won, and iii) regarding the lipstick product of the third brand, it is being sold at two different prices including 23,000 won and 25,000 won.

[0148] In this case, the recommendation unit (15) may display the lowest price information for each of the three candidate cosmetic products of interest in the lower area of ​​the first candidate storage area to the third candidate storage area within the comparison candidate storage unit (50), based on the results of the lowest price batch search. That is, the recommendation unit (15) may display, for example, 10,000 won as the lowest price for a lipstick product of the first brand in the lower area of ​​the first candidate storage area, 41,000 won as the lowest price for a lipstick product of the second brand in the lower area of ​​the second candidate storage area, and 23,000 won for a lipstick product of the third brand in the lower area of ​​the third candidate storage area, based on the results of the lowest price batch search.

[0149] According to this, the device (10) provides a lowest price display button, thereby enabling the lowest price for each of the information on multiple cosmetic products designated as candidates of interest by the user (i.e., information on multiple customized cosmetic products of interest temporarily stored in the candidate storage area) to be searched and verified collectively. This allows the user to make a final purchase decision by considering the lowest price of each of the information on the customized cosmetic products of interest when deciding which cosmetic product to finally select and purchase, thereby enabling more rational consumption / purchase regarding cosmetic products.

[0150] Below, we will briefly examine the operation flow of the present invention based on the details described above.

[0151] FIG. 15 is a flowchart of the operation of an image-based personal color diagnosis information provision method according to an embodiment of the present invention.

[0152] The image-based personal color diagnosis information provision method illustrated in FIG. 15 can be performed by the device (10) described above. Therefore, even if the content described below is omitted, the description of the device (10) can be equally applied to the description of the image-based personal color diagnosis information provision method.

[0153] Referring to FIG. 15, in step S11, the acquisition unit can acquire a user image including a portion of the user's face.

[0154] Next, in step S12, the diagnostic unit can derive customized personal color diagnostic information tailored to the user by performing image analysis on the user image.

[0155] Next, in step S13, the providing unit may provide a result including the customized personal color diagnosis information derived above.

[0156] At this time, in step S12, the diagnostic unit extracts color information for each body part for a pre-set body part within the user image through the performance of the image analysis, and among multiple types of personal color diagnostic information, the type of personal color diagnostic information that matches the extracted color information for each body part can be derived as the customized personal color diagnostic information.

[0157] In addition, the above-mentioned pre-set body part may include at least one of skin, hair, and eyeball.

[0158] In addition, at step S12, the diagnostic unit may display survey data for inputting self-diagnosis color information on the display unit to receive self-diagnosis color information from the user regarding a pre-set body part, and may derive the customized personal color diagnosis information by further considering the user's survey response value to the survey data.

[0159] Additionally, although not illustrated in the drawings, the image-based personal color diagnosis information provision method according to one embodiment of the present invention may include, after step S13, a recommendation unit recommending information on customized cosmetic products tailored to the user based on the results provided by the providing unit.

[0160] In the description above, steps S11 to S13 may be further divided into additional steps or combined into fewer steps, depending on an embodiment of the present invention. Additionally, some steps may be omitted as necessary, and the order between steps may be changed.

[0161] A method for providing image-based personal color diagnostic information according to one embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either individually or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The above-described hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

[0162] In addition, the aforementioned method for providing image-based personal color diagnosis information may also be implemented in the form of a computer program or application executed by a computer that is stored on a recording medium.

[0163] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0164] The scope of the present invention is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present invention.

Claims

Claim 1 An image-based personal color diagnosis information providing device comprising: an acquisition unit for acquiring a user image including a portion of the user's face; a diagnosis unit for deriving customized personal color diagnosis information tailored to the user by performing image analysis on the user image; a providing unit for providing a result including the derived customized personal color diagnosis information; a recommendation unit for recommending information on customized cosmetic products tailored to the user based on the result provided by the providing unit; and a cosmetic sales unit provided in a portion of the internal space of the body part of the image-based personal color diagnosis information providing device, comprising a plurality of types of cosmetic products already displayed in the internal space. and includes a control unit that controls the operation of the image-based personal color diagnosis information providing device, wherein the image-based personal color diagnosis information providing device is a device provided to be included in a self-photo shooting terminal in the form of a kiosk that allows self-photo shooting when a preset usage payment amount is paid, and the acquisition unit controls a camera provided in one area of ​​the image-based personal color diagnosis information providing device to a shooting active mode when it is detected that a user has made a payment by paying a preset usage payment amount, thereby controlling the real-time acquired image obtained in real-time through the camera to be displayed on the display unit, and when the camera is in the shooting active mode, displays photo shooting guide information on the display unit to induce the user to take a user image according to the photo shooting guide information, wherein the photo shooting guide information includes face position guide line information indicating the point where the user's face should be located and guide text information instructing the user to continuously turn the face at various angles until face recognition is completed, and acquires the user image from the camera through shooting by the camera, and the diagnosis unit, through the performance of the image analysis, skin, within the user image,Color information for each body part is automatically extracted for pre-set body parts including hair and eyes, and based on the extracted color information for each body part, personal color diagnostic information of a type that matches the extracted color information for each body part among multiple types of personal color diagnostic information is derived as the customized personal color diagnostic information; the color information for each body part includes skin color information, hair color information, and eye color information; the skin color information includes facial skin color information, neck skin color information, skin brightness information and skin tone information related to the color information of the facial skin and neck skin, respectively; the hair color information includes hair tone information including hair color type information and hair brightness information, and hair texture information; the eye color information includes eye color type information and eye image type information; and the multiple types of personal color diagnostic information include personal color diagnostic information of type 1 corresponding to Spring-Light among Spring Warm Tones, personal color diagnostic information of type 2 corresponding to Spring-Bright among Spring Warm Tones, and among Spring Warm Tones Personal color diagnostic information of Type 3 corresponding to Spring-Vivid, personal color diagnostic information of Type 4 corresponding to Summer-Light among Summer Cool Tones, personal color diagnostic information of Type 5 corresponding to Summer-Mute among Summer Cool Tones, personal color diagnostic information of Type 6 corresponding to Summer-Soft among Summer Cool Tones, personal color diagnostic information of Type 7 corresponding to Autumn-Mute among Autumn Warm Tones, personal color diagnostic information of Type 8 corresponding to Autumn-Soft among Autumn Warm Tones, personal color diagnostic information of Type 9 corresponding to Autumn-Deep among Autumn Warm Tones, personal color diagnostic information of Type 10 corresponding to Winter-Clear among Winter Cool Tones, personal color diagnostic information of Type 11 corresponding to Winter-Deep among Winter Cool Tones, and personal color diagnostic information of Type 12 corresponding to Winter-Bright among Winter Cool Tones, provided by the above providing unit.The above result includes the derived customized personal color diagnosis information and the user image obtained from the acquisition unit, and by printing the above result on a prepared paper, a result photograph, which is the paper on which the result is printed, is output and provided to the user. The above result includes the derived customized personal color diagnosis information displayed in a first area within the entire area of ​​the result, the user image displayed in a second area within the entire area of ​​the result, a first QR code displayed in a third area within the entire area of ​​the result provided for connecting with a personal color diagnosis expert so that the user can consult with the expert about their personal color, and a second QR code displayed in a fourth area within the entire area of ​​the result provided to allow the user to download the image of the result photograph to a personal mobile terminal. Within the entire area of ​​the result, each of the first to fourth areas is positioned so as not to overlap with one another. The recommendation unit recommends to the user by displaying information on customized cosmetic products on the screen of the display unit, or, when it is detected that the user has entered their mobile phone number through the display unit, displays information on customized cosmetic products on the screen of the terminal corresponding to the entered mobile phone number to the user. The control unit recommends, and after the recommendation unit recommends information on customized cosmetic products to the user, the control unit then controls the cosmetic sales unit to identify a cosmetic product that matches the information of the recommended customized cosmetic product among multiple types of cosmetic products already displayed in the internal space, and then controls the cosmetic sales unit to expose the identified cosmetic product to the user. Subsequently, after the identified cosmetic product is exposed to the user through the cosmetic sales unit, if it is detected that payment of a pre-set sales amount for the identified cosmetic product has been made by the user, the control unit then controls the cosmetic product to be dispensed through a discharge port provided in a specific area of ​​the cosmetic sales unit.An image-based personal color diagnosis information providing device that enables a user to immediately purchase and use the identified cosmetic product dispensed through the outlet. Claim 2 delete Claim 3 delete Claim 4 An image-based personal color diagnosis information providing device according to claim 1, wherein the diagnosis unit displays survey data for inputting self-diagnosis color information on a display unit to receive self-diagnosis color information from a user regarding a pre-set body part, and derives the customized personal color diagnosis information by further considering the user's survey response value to the survey data. Claim 5 delete Claim 6 delete Claim 7 delete Claim 8 A method for providing image-based personal color diagnosis information by an image-based personal color diagnosis information providing device of claim 1, comprising: a step of acquiring a user image including a face portion of the user in an acquisition unit; a step of deriving customized personal color diagnosis information tailored to the user by performing image analysis on the user image in a diagnosis unit; and a step of providing a result including the derived customized personal color diagnosis information in a providing unit.

Images