Apparatus and method for skin diagnosis and recommendation

KR103014302B1Active Publication Date: 2026-09-04SQI SOFT
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
KR1020230134957
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-10-11
Publication Date
2026-09-04
Estimated Expiration
2043-10-11

Smart Images

  • Figure 112023111145013-PAT00001_ABST
    Figure 112023111145013-PAT00001_ABST
Patent Text Reader

Abstract

The present invention relates to a skin diagnosis and recommendation device, and more specifically, to a device that diagnoses skin based on image recognition and recommends related personalized solutions. According to an embodiment of the present invention, first, a differentiated product with an applied AI solution can be developed. By rapidly analyzing a customer's skin type with the product equipped with the AI ​​solution, necessary information and methods can be provided to the customer, thereby preventing the use of skin care products or treatments unsuitable for the customer's skin type. Second, a personalized recommendation service can be provided to satisfy the needs and interests of potential customers. Knowledge information regarding an individual's skin type and characteristics can be provided, and a specialist-level prediction service regarding skin diseases can be offered to users who are hesitating to visit a hospital. Furthermore, a product recommendation service can be provided to determine whether a product is personalized for a beauty care purchase that the customer is hesitating to buy, and cost information regarding products and procedures of interest can be received. Third, an on-site personalized experience service can be provided to convert loyal customers into VIP customers. Unlike the existing method that relied on consultations with agents, beauty care recommendation services utilizing an AI model can be directly experienced on-site using a smart mirror-type product. Furthermore, it is possible to classify skin types based on MBTI through image recognition and simple questionnaires, and to predict skin conditions in body parts closely related to beauty, such as pigmentation, atopy, melasma, and dermatitis, by performing close-up skin scans. This allows users to receive various personalized beauty recommendation services with a simple touch (e.g., a smart mirror). Fourth, revenue can be increased through the diversity of business models.Sales can be increased through the analysis of customer preferences and the provision of customized recommendation services, such as converting potential customers into loyal customers and loyal customers into VIP customers. Furthermore, it can be expanded into platform services through the generation of commission revenue from matching and linking demanders (customers) with suppliers (hospitals, product manufacturers), and into beauty care content services by expanding the beauty care recommendation service platform.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a skin diagnosis and recommendation device, and more specifically, to a device that diagnoses skin based on image recognition and recommends a personalized solution related thereto. Background Technology

[0002] Skin diagnosis is being actively utilized in the cosmetics industry and related research fields, in addition to for medical purposes. With the development of online markets and personalized services, there is an increasing demand for methods to perform skin diagnoses more easily and accurately. Furthermore, this is a field expected to grow due to the emergence of new consumption trends and the diverse potential for development in distribution channels. Companies are launching products utilizing advanced technologies, such as smart packaging, 3D color cosmetics, and face masks, by applying AI (Artificial Intelligence) and IoT (Internet of Things). Both domestic and global market sizes are increasing every year, and there is a growing demand for cosmeceuticals—functional cosmetics containing medically verified ingredients and customized services that combine cutting-edge technology with consumer needs for personal taste and individuality. Along with this, there is a need for research on customized solutions, including products, clinics, and procedures, that enable consumers to diagnose their skin appropriately based on information such as their actual lifestyle patterns, preferences, and personal characteristics, tailored to specific situations and timings.

[0003] The background technology of the present invention is disclosed in Korean Published Patent No. 2023-0054286. The problem to be solved

[0005] The objective of the present invention is to provide a method and apparatus for diagnosing skin based on image recognition and recommending a personalized solution related thereto.

[0006] Through facial recognition, AI analyzes the degree of skin pores, wrinkles, sensitivity, and pigmentation, enabling the classification of skin types based on this analysis. Furthermore, by utilizing image extraction and identification, we aim to provide full-cycle skin disease diagnostic services—such as for atopic dermatitis and hyperpigmentation—and offer an app service that allows individual users to conveniently perform skin diagnoses anytime and anywhere, while preserving diagnostic data and history. Additionally, we can provide smart mirror-style kiosk products that enable hospitals and skin care shops to conduct customer skin diagnoses and utilize them for consultations and prognosis records.

[0007] The technical problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art to which the present invention belongs from the description below. means of solving the problem

[0009] According to one aspect of the present invention, a skin diagnosis and recommendation device is provided.

[0010] A skin diagnosis and recommendation device according to one embodiment of the present invention may include an input unit that captures and inputs an image or video, a skin diagnosis unit that receives a skin disease image and a facial image and diagnoses the skin, a result generation unit that extracts a skin type or skin disease result from the diagnosed skin, and a recommendation unit that recommends a clinic and a product.

[0011] According to another aspect of the present invention, a skin diagnosis and recommendation method and a computer program for executing the same are provided. A skin diagnosis and recommendation method according to one embodiment of the present invention may include the steps of capturing and inputting an image or video, receiving a skin disease image and a facial image to diagnose the skin, extracting a skin type or skin disease result from the diagnosed skin, and recommending a clinic and a product. Effects of the invention

[0013] According to an embodiment of the present invention, first, a differentiated product with an AI solution applied can be developed. By rapidly analyzing a customer's skin type with the product with the AI ​​solution applied, necessary information and methods can be provided to the customer, thereby preventing the customer from receiving skin care products or treatments that are not suitable for their skin type.

[0014] Second, it can provide personalized recommendation services to meet the needs and interests of potential customers. It can provide knowledge and information regarding individual skin types and characteristics, and offer specialist-level predictive services for skin conditions to users hesitating to visit a hospital. Furthermore, it can provide product recommendation services that help determine whether beauty care products are suitable for the individual, and allow users to receive cost information regarding products and procedures of interest.

[0015] Third, it is possible to provide on-site, customized experiential services that can elevate loyal customers to VIP status. Unlike the traditional method relying on agent consultations, beauty care recommendation services powered by AI models can be directly experienced on-site using smart mirror-type products. Furthermore, it can classify skin types based on MBTI through image recognition and simple questionnaires, and predict skin conditions closely related to beauty, such as pigmentation, atopic dermatitis, melasma, and dermatitis, by performing close-up skin scans. This allows users to receive a variety of personalized beauty recommendation services with a simple touch (e.g., on a smart mirror).

[0016] Fourth, revenue can be increased through the diversification of business models. Sales can be boosted by analyzing customer preferences and providing customized recommendation services, such as converting potential customers into loyal customers and loyal customers into VIP customers. Furthermore, the business can expand into platform services generating commission revenue through the matching and linkage of demanders (customers) and suppliers (hospitals, product manufacturers), as well as beauty care content services by expanding the beauty care recommendation service platform.

[0017] The effects of the present invention are not limited to the effects described above, and should be understood to include all effects that can be inferred from the composition of the invention described in the description or claims of the present invention. Brief explanation of the drawing

[0019] FIG. 1 is a drawing for illustrating a skin diagnosis and recommendation device according to an embodiment of the present invention. FIG. 2 is a drawing for explaining the skin diagnosis unit of a skin diagnosis and recommendation device according to one embodiment of the present invention. FIG. 3 is a diagram illustrating a flowchart of a skin diagnosis and recommendation device according to an embodiment of the present invention. FIGS. 4 and 5 are drawings for explaining skin types of a skin diagnosis and recommendation device according to an embodiment of the present invention. FIGS. 6 to 8 are examples for explaining the execution process of a skin diagnosis and recommendation device according to an embodiment of the present invention. FIG. 9 is a drawing illustrating a skin diagnosis and recommendation method according to an embodiment of the present invention. Specific details for implementing the invention

[0020] The present invention is susceptible to various modifications and may have various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that it includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention. In describing the present invention, detailed descriptions of related prior art are omitted if it is determined that such detailed descriptions would unnecessarily obscure the essence of the invention. Furthermore, singular expressions used in this specification and claims should generally be interpreted as meaning "one or more" unless otherwise stated.

[0021] Throughout the specification, when it is stated that a part is "connected (connected, in contact, combined)" with another part, this includes not only cases where they are "directly connected," but also cases where they are "indirectly connected" with other members interposed between them. Furthermore, when it is stated that a part "includes" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but rather allows for the inclusion of additional components.

[0022] The terms used herein are merely for describing specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as “comprising” or “having” are intended to indicate the presence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0023] The present invention will be described below with reference to the attached drawings. However, the present invention may be implemented in various different forms and is therefore not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification have been given similar reference numerals.

[0025] FIG. 1 is a drawing for explaining a skin diagnosis and recommendation device according to one embodiment of the present invention.

[0026] Referring to FIG. 1, the skin diagnosis and recommendation device may include an input unit (110), a skin diagnosis unit (130), a result output unit (150), and a recommendation unit (170).

[0027] The input unit (110) can input an image or video by capturing it. The input unit (110) can receive input in the form of a camera, but is not limited thereto. Additionally, the image input unit (110) may be at least one. Furthermore, the input unit (110) can directly capture an image or video, or receive a previously captured image or video.

[0028] The skin diagnosis unit (130) receives a skin disease image or a facial image and diagnoses the skin. The skin diagnosis unit (130) can diagnose skin types and can diagnose skin diseases. The skin diagnosis unit (130) may include a skin type classification unit (131) and a skin disease diagnosis unit (133). The skin diagnosis unit (130) can diagnose using an AI algorithm. The skin diagnosis unit (130) will be described in more detail below in FIG. 2.

[0029] The result output unit (150) extracts skin type or skin disease results from the skin diagnosed by the skin diagnosis unit (130). From the diagnosis results produced by the result output unit (150), clinics, procedures, and products can be recommended.

[0030] The recommendation unit (170) receives the diagnosis results generated from the result generation unit (150) and can recommend clinics, procedures, and products to the user. The recommendation unit (170) may include a clinic recommendation unit (171) and a product recommendation unit (173). The clinic recommendation unit (171) can recommend a clinic based on skin disease or skin type. In this case, if a skin disease or condition is predicted, it can recommend a skin disease clinic and connect to a dermatology hospital reservation site. If a skin MBTI is diagnosed based on skin type, it can recommend a clinic or provide treatment recommendation information based on the skin type diagnosis result. Afterward, it can connect to a clinic reservation site. The product recommendation unit (173) can recommend related products if a skin MBTI is diagnosed based on skin type.

[0032] FIG. 2 is a drawing for explaining the skin diagnosis unit of a skin diagnosis and recommendation device according to one embodiment of the present invention.

[0033] Referring to FIG. 2, the skin diagnosis unit (130) may include a skin type classification unit (131) and a skin disease diagnosis unit (133).

[0034] The skin type classification unit (131) diagnoses the skin type. The skin type classification unit (131) can classify the skin type by recognizing images or videos from the input unit (110), completing a medical questionnaire or survey, and synthesizing them. At this time, the classified skin type can be classified according to criteria such as dry / oily, sensitive / non-sensitive, pigmented / non-pigmented, and prone to wrinkling / difficult to wrinkle. These can be indicated by English abbreviations D / O, S / R, P / N, and W / T, and can be classified into a total of 16 types. The 16 classified types are DRPT, DRPW, DRNT, DRNW, DSPT, DSPW, DSNT, DSNW, ORPT, ORPW, ORNT, ORNW, OSPT, OSPW, OSNT, and OSNW. The skin type classification unit (131) can predict the skin MBTI through the completion of a questionnaire or survey. For example, the questions in the questionnaire can be composed of various questions such as, "After cleansing, if you look in the mirror under bright light after 2 to 3 hours without applying anything, how do your forehead and cheeks look and feel?" Additionally, the classified skin type results may provide detailed information such as skin age, skin score, skin type, skin concern keywords, oiliness, pigmentation, sensitivity, etc., along with numbers or low / average / high.

[0035] The skin disease diagnosis unit (133) diagnoses skin diseases. The skin disease diagnosis unit (133) receives guidance on capturing skin diseases from the input unit (110), recognizes the captured image or video of the skin disease condition, and can diagnose the skin disease using an AI algorithm. The result of the skin disease diagnosed by the skin disease diagnosis unit (133) can be predicted by the result output unit (150). For example, the skin disease prediction result may consist of skin diseases most similar to the symptoms, such as eczema, warts, and milia, and may also be provided with a percentage. At this time, if one wishes to check detailed information about the corresponding skin disease, one can press the button for the skin disease in the prediction result to check information about the skin disease and receive recommendations for a relevant clinic that can resolve the skin disease.

[0037] FIG. 3 is a diagram illustrating a flowchart of a skin diagnosis and recommendation device according to one embodiment of the present invention.

[0038] Referring to Fig. 3, the skin diagnosis and recommendation device can be used through membership registration. The skin diagnosis and recommendation device can be used as a mobile service, such as an application or the web, but is not limited thereto. After registering and logging in, users can receive a diagnosis regarding skin diseases and skin types, specifically the Skin MBTI. If a user wishes to receive a diagnosis regarding the Skin MBTI, they select "Predict Skin MBTI" and are guided to photograph their skin. Subsequently, they take a photo of their face and fill out a questionnaire to receive a diagnosis of their skin type through AI. Based on the diagnosis results, they can receive recommendations for products, clinics, or procedures. If a clinic is recommended, the user may be connected to a clinic reservation site, and if a product is recommended, they may be connected to the homepage of a shopping mall selling the product. If a user wishes to receive a diagnosis regarding a skin disease, they select "Predict Skin Disease" and are guided to photograph the skin disease. Subsequently, they photograph the affected area of ​​their skin and receive a diagnosis of the skin disease through AI. Based on the skin disease prediction results, the device has the advantage of providing recommendation services to the user by recommending clinics related to the skin disease or connecting them to a dermatology hospital reservation site. Skin diagnosis and recommendation devices can also provide information related to predicted skin care history. Users can check predicted history such as wishlist management, skin change monitoring, and skin MBTI analysis history, and the device includes features that allow users to purchase products or select clinics based on this history.

[0040] FIGS. 4 and 5 are drawings for explaining the skin type of a skin diagnosis and recommendation device according to one embodiment of the present invention.

[0041] Referring to Figure 4, the predicted results corresponding to the skin type being Dry can be confirmed. As illustrated in Figure 4, the types can be classified into DRPT, DRPW, DRNT, DRNW, DSPT, DSPW, DSNT, and DSNW. For example, the DRPT type is dry, has low sensitivity, no pigmentation, and does not wrinkle easily. This type is naturally "egg-like" skin with no visible acne or pores; while it possesses strengths such as a fine skin texture and almost no inflammatory reactions, it has weaknesses such as being dry and vulnerable to UV rays. Therefore, solutions provided to this type include sunscreen with SPF 30+ or ​​higher and moisturizers containing brightening ingredients, and such products can be recommended. This is just one example, and the descriptions of solutions and types are not limited.

[0043] Referring to Figure 5, the predicted results corresponding to the oily skin type can be confirmed. As illustrated in Figure 5, the types can be classified into ORPT, ORPW, ORNT, ORNW, OSPT, OSPW, OSNT, and OSNW. For example, the ORPW type is oily, has low sensitivity, pigmentation, and many wrinkles. This type has large pores but does not easily develop acne; while it possesses the advantage of being resistant to irritation, it has the weaknesses of being shiny, having an uneven skin tone, and having large pores. Therefore, for this type, products containing sunscreen with SPF 30+ or ​​higher and antioxidants can be recommended. This is just one example, and the description of solutions and types is not limited.

[0045] FIGS. 6 to 8 are examples for explaining the execution process of a skin diagnosis and recommendation device according to one embodiment of the present invention.

[0046] Figure 6 is an example of an execution process screen that can predict skin diseases using a skin diagnosis and recommendation device. Referring to Figure 6, Figure 6 (a) is the initial screen for the skin diagnosis and recommendation device to diagnose the skin, where the user can select "Predict Skin Disease." After selecting "Predict Skin Disease," the user can photograph and crop the skin of the affected area using the device's camera. Subsequently, the skin diagnosis and recommendation device provides a skin disease prediction result for the photographed affected area. At this time, as shown in Figure 6 (c), the device can identify various skin diseases most similar to the symptoms of the skin disease and display the probability of the corresponding skin disease as a percentage. As shown in Figure 6 (d), if the user wishes to obtain more detailed information by selecting a predicted skin disease, they can select the corresponding skin disease button and receive a recommendation for a clinic.

[0048] Figure 7 is an example of an execution process screen that can predict skin type using a skin diagnosis and recommendation device. Referring to Figure 7, by selecting "Predict Skin MBTI" on the screen of Figure 6 (a), the user's face can be photographed through the device's camera as shown in Figure 7 (e), and a simple survey or medical questionnaire can be completed as shown in Figure 7 (h). At this time, guide lines for positioning the face can be displayed to ensure the facial photo is taken accurately, and instructions to ensure even lighting, look straight ahead, and keep the mouth closed can also be displayed. Subsequently, the skin diagnosis and recommendation device can check the user's skin MBTI results as shown in Figure 7 (f). Along with the skin type, detailed information regarding skin age, skin score, skin concern keywords, oiliness, pigmentation, sensitivity, etc., can also be provided in the form of numbers or indicators such as low, medium, or high. Figure 7 (g) allows for recommendations of products, treatments, and clinics based on the predicted skin type results.

[0050] Figure 8 is an example of an execution process screen that allows checking a wishlist, skin change management, and prediction history using a skin diagnosis and recommendation device. Figure 8 (i) is a page where one can check skin change reports or skin MBTI analysis history, and also check how many days have passed since the skin disease diagnosis. Figure 8 (j) is an example page for product purchase and shopping mall homepage that recommends products, and Figure 8 (k) is an example page that recommends clinics by region. Figure 8 (l) is an example page in My Page where one can check the user's wishlist, skin change graph, and prediction history.

[0052] FIG. 9 is a drawing for explaining a skin diagnosis and recommendation method according to one embodiment of the present invention.

[0053] Referring to FIG. 9, in step S910, the skin diagnosis and recommendation device may input an image or video by capturing it. It may be received in the form of a camera, but is not limited thereto, and there may be at least one method of input. Additionally, the skin diagnosis and recommendation device may directly capture an image or video, or receive a previously captured image or video.

[0054] In step S930, the skin diagnosis and recommendation device receives an image of a skin disease or a facial image as input to diagnose the skin. The skin diagnosis and recommendation device can perform the diagnosis by utilizing an AI algorithm. At this stage, it can diagnose skin types and skin diseases. From step S910, it recognizes images or videos, completes medical questionnaires or surveys, and synthesizes this information to classify skin types. At this stage, the classified skin types can be categorized based on dry / oily, sensitive / non-sensitive, pigmented / non-pigmented, and prone to wrinkling / difficult to wrinkle criteria. These can be denoted by the English abbreviations D / O, S / R, P / N, and W / T, and can be classified into a total of 16 types. The 16 classified types are DRPT, DRPW, DRNT, DRNW, DSPT, DSPW, DSNT, DSNW, ORPT, ORPW, ORNT, ORNW, OSPT, OSPW, OSNT, and OSNW. The skin diagnosis and recommendation device can predict the skin MBTI by capturing facial images and completing medical questionnaires simultaneously. Additionally, it receives guidance on capturing skin diseases from step S910, recognizes the captured video or image containing the skin disease atmosphere, and diagnoses the skin disease using an AI algorithm. The results of the skin disease diagnosed in step S930 can be predicted in step S950. For example, the predicted skin disease results may consist of the skin diseases most similar to the symptoms, such as eczema, warts, and milia, and may also be provided with a percentage.

[0055] In step S950, the skin diagnosis and recommendation device extracts skin type or skin disease results from the skin diagnosed in step S930. Subsequently, the skin diagnosis and recommendation device can recommend clinics, procedures, and products based on the diagnosis results generated in step S950.

[0056] In the S970 stage, the skin diagnosis and recommendation device receives the diagnosis results generated from the S950 stage and can recommend clinics, procedures, and products to the user. In the S970 stage, the device can recommend clinics based on skin diseases or skin types. In this case, if a skin disease or condition is predicted, it can recommend a skin disease clinic and connect the user to a dermatology hospital appointment site. If a skin MBTI is diagnosed based on skin type, it can recommend a clinic or provide information on recommended procedures based on the skin type diagnosis results. Subsequently, it can connect the user to a clinic appointment site. Additionally, in the S970 stage, if a skin MBTI is diagnosed based on skin type, the skin diagnosis and recommendation device can recommend related products.

[0058] Although it has been described above that all components constituting an embodiment of the present invention are combined or operate as a single unit, the present invention is not necessarily limited to such an embodiment. That is, within the scope of the purpose of the present invention, all components may be selectively combined in one or more ways to operate.

[0059] Although operations are depicted in a specific order in the drawings, it should not be understood that the operations must necessarily be executed in the specific order depicted or in a sequential order, or that all depicted operations must be executed to obtain the desired result. In certain situations, multitasking and parallel processing may be advantageous. Furthermore, the separation of various configurations in the embodiments described above should not be understood as necessarily required, and it should be understood that the described program components and systems can generally be integrated together into a single software product or packaged into multiple software products.

[0060] The present invention has been described above with reference to its embodiments. Those skilled in the art will understand that the present invention may be implemented in modified forms without departing from the essential characteristics of the invention. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention is defined by the claims, not by the foregoing description, and all variations within the scope of the claims should be interpreted as being included in the invention. Explanation of the symbols

[0062] 100: Skin Diagnosis and Recommendation Device 110: Input section 130: Skin Diagnosis Division 150: Result Output Unit 170: Recommendation Section

Claims

Claim 1 A skin diagnosis and recommendation device comprises: an input unit for capturing and inputting an image or video; a skin diagnosis unit for receiving a skin disease image and a facial image and diagnosing the skin; a result generation unit for extracting a skin type or skin disease result from the diagnosed skin; and a recommendation unit for recommending clinics and products, wherein the skin diagnosis unit includes a skin type classification unit for diagnosing skin types; The system includes a skin disease diagnosis unit that diagnoses skin diseases, wherein the skin type classification unit recognizes a video or image from the input unit and classifies it into 16 skin MBTI types by completing a questionnaire, wherein the skin types are classified based on dry / oily, sensitive / non-sensitive, pigmented / non-pigmented, and prone to wrinkling / difficult to wrinkle, and are represented by the English abbreviations D / O, S / R, P / N, and W / T to form 16 skin MBTI types: DRPT, DRPW, DRNT, DRNW, DSPT, DSPW, DSNT, DSNW, ORPT, ORPW, ORNT, ORNW, OSPT, OSPW, OSNT, and OSNW, wherein the skin type classification result provides detailed information regarding skin type, skin age, skin score, skin concern keywords, oiliness, pigmentation, and sensitivity, and the result output unit provides a skin disease prediction result that identifies various skin diseases most similar to the skin disease symptoms and indicates the probability of the corresponding skin disease as a percentage. The recommendation section is a clinic recommendation section that recommends a clinic according to the above-mentioned skin disease or skin type;A skin diagnosis and recommendation device comprising a product recommendation unit that recommends products according to the above skin type, wherein the product recommendation unit recommends a moisturizer product containing SPF 30+ or ​​higher sunscreen and brightening ingredients to the DRPT type among the above skin MBTI types, and recommends a product containing SPF 30+ or ​​higher sunscreen and antioxidants to the ORPW type among the above skin MBTI types, and the clinic recommendation unit recommends a skin disease clinic and makes a reservation for a dermatology hospital according to the above skin diagnosis prediction result, and provides treatment recommendation information according to the above skin type diagnosis result. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete Claim 6 A skin diagnosis and recommendation device for a method of diagnosing and recommending skin comprises: a step of capturing and inputting an image or video; a step of receiving a skin disease image and a facial image to diagnose the skin; a step of extracting a skin type or skin disease result from the diagnosed skin; and a step of recommending a clinic and a product, wherein the step of receiving the skin disease image and the facial image to diagnose the skin comprises a step of diagnosing a skin type; The method includes a step of diagnosing skin diseases, wherein the step of diagnosing the skin type recognizes the image or video from the step of capturing and inputting the image or video, completes a questionnaire, and classifies it into 16 skin MBTI types, wherein the skin types are classified based on dry / oily, sensitive / non-sensitive, pigmented / non-pigmented, and prone to wrinkling / difficult to wrinkle, and are represented by the English abbreviations D / O, S / R, P / N, and W / T to form 16 skin MBTI types: DRPT, DRPW, DRNT, DRNW, DSPT, DSPW, DSNT, DSNW, ORPT, ORPW, ORNT, ORNW, OSPT, OSPW, OSNT, and OSNW; wherein the skin type classification result provides detailed information regarding skin type, skin age, skin score, skin concern keywords, oiliness, pigmentation, and sensitivity; and the step of extracting skin type or skin disease results from the diagnosed skin provides various skin diseases most similar to the skin disease symptoms and the probability of the corresponding skin disease The step of providing skin disease prediction results expressed together as percentages and recommending the clinic and product includes the step of recommending a clinic according to the skin disease or skin type;A skin diagnosis and recommendation method comprising the step of recommending products according to the skin type, wherein the step of recommending products according to the skin type recommends a moisturizer containing SPF 30+ or ​​higher sunscreen and brightening ingredients to the DRPT type among the skin MBTI types, and recommends a product containing SPF 30+ or ​​higher sunscreen and antioxidants to the ORPW type among the skin MBTI types, and the step of recommending a clinic according to the skin disease or skin type recommends a skin disease clinic and makes an appointment at a dermatology hospital based on the skin diagnosis prediction result, and provides treatment recommendation information based on the skin type diagnosis result. Claim 7 delete Claim 8 delete Claim 9 delete Claim 10 delete Claim 11 A computer program that performs the skin diagnosis and recommendation method of paragraph 6 and is recorded on a computer-readable recording medium.

Citation Information

Patent Citations

  • Skin analysis and automatic prescription matching system

    KR1020220077277A

  • Method and apparatus for diagnosing of skin diseases using chatbot

    KR1020230021202A

  • Method and apparatus for predicting disease through wrinkle detection

    KR102445752B1