System for providing precise personal atopic dermatitis care service
The atopy care service system empowers users to analyze their atopic dermatitis through IoT devices and AI, providing personalized results and microbiome analysis, addressing the limitations of conventional services by enabling non-expert users to manage their atopic conditions effectively.
Patent Information
- Application Number
- PCT/KR2024/008016
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-19
- Filing Date
- 2024-06-12
- Publication Date
- 2024-12-26
AI Technical Summary
Conventional atopy care services lack the ability to provide customized analysis results for affected skin areas without expert assistance and do not allow users to check analysis results non-face-to-face, particularly for infants and young children who are significantly affected by atopic dermatitis.
An atopy care service provision system utilizing IoT devices with cameras and AI models for users to photograph affected skin areas, determining lesion types and severity, and providing microbiome analysis services, allowing non-expert users to obtain personalized analysis results and recommendations through a user terminal.
Enables users to independently photograph and analyze their atopic dermatitis affected areas, receive personalized analysis results, and access microbiome analysis, improving atopy management and health monitoring without the need for expert assistance.
Smart Images

Figure KR2024008016_26122024_PF_FP_ABST
Abstract
Description
Atopic dermatitis personal precision care service provision system
[0001] The present invention relates to an atopic care service providing system that allows a user to check the analysis results of his or her own skin.
[0002] Changes in living environments due to socioeconomic growth are contributing to and exacerbating allergic diseases, and the number of patients with allergic diseases has been steadily increasing since 2000. Atopic dermatitis is a representative allergic disease, along with allergic rhinitis and asthma. According to disease statistics from the Health Insurance Review and Assessment Service, the number of patients with atopic dermatitis was estimated at approximately 970,000 as of 2020. Of these, infants and young children account for approximately 33.9%, and teenagers and adolescents account for approximately 16.8%, showing that infants and young children account for a significant proportion.
[0003] Meanwhile, the existing method of providing analysis services for atopic symptoms only provides disease information, personal lifestyle habits, skin photos and hospital treatment history records, graphs / charts, and product recommendations, but has the problem that individual service users cannot easily receive customized analysis results for their affected area without being limited to a specific location.
[0004] The present invention provides an atopic care service providing system and a control method of the atopic care service providing system, which enable a user to take a picture of an atopic dermatitis area by himself or herself without the help of a professional and to check the analysis results of his or her atopic dermatitis area remotely.
[0005] In addition, the present invention provides an atopic care service providing system and a control method of the atopic care service providing system that can assist a non-expert user in properly photographing an atopic dermatitis area.
[0006] In addition, the present invention provides an atopic care service providing system including an IoT device capable of appropriately photographing an atopic dermatitis area and a control method of the atopic care service providing system.
[0007] In addition, the present invention provides an atopic disease care service providing system and a control method of the atopic care service providing system that can additionally provide a microbiome analysis service to a user who has analyzed an atopic dermatitis area.
[0008] An atopic care service providing system according to one aspect of the disclosed invention may include a skin information receiving unit configured to receive a skin lesion image of a user from a camera; an atopic type determining unit configured to determine an atopic lesion type for the skin lesion image using a first artificial intelligence model based on the skin lesion image; an atopic severity determining unit configured to determine an atopic severity for the skin lesion image using a second artificial intelligence model based on the skin lesion image; and a display display screen generating unit configured to generate information of an analysis result screen to be displayed on a display of a user terminal based on the atopic lesion type for the skin lesion image and the atopic severity for the skin lesion image.
[0009] In addition, the camera is provided and a skin information measuring device configured to transmit the skin affected area image to the skin information receiving unit is further included, and the skin information measuring device may include: an SCH sensor for obtaining skin moisture information and skin oil information of the user; and a TEWL sensor for obtaining transepidermal water loss information of the user.
[0010] In addition, the skin information measuring device may further include: a light-emitting element that generates light; and a measuring device processor that controls the light-emitting element to irradiate light toward the user's skin when the camera acquires a skin lesion image.
[0011] In addition, the skin information measuring device further includes a distance sensor configured to obtain distance information between the user's skin and the camera when the camera obtains a skin lesion image, and the measuring device processor can control the light emitting element so that the intensity of light generated by the light emitting element increases as the distance between the user's skin and the camera increases based on the distance information between the user's skin and the camera.
[0012] In addition, the skin information measuring device may further include a communication unit configured to transmit the skin affected area image, the skin moisture information, the skin oil information, and the transdermal moisture loss information to the skin information receiving unit using at least one of a Wi-Fi communication method and a Bluetooth communication method.
[0013] In addition, the device may further include an affected area extraction unit configured to extract an affected area image, which is an image of an area where atopic lesions are distributed, from the skin affected area image using a third artificial intelligence model based on the skin affected area image, and the atopic type determination unit may be configured to determine an atopic lesion type for the skin affected area image using the first artificial intelligence model based on the affected area image, and the atopic severity determination unit may be configured to determine atopic severity for the skin affected area image using the second artificial intelligence model based on the affected area image.
[0014] In addition, the method may further include a machine learning unit configured to generate the third artificial intelligence model through a machine learning method by setting a plurality of learning skin lesion images as input variables and a learning lesion area image corresponding to each learning skin lesion image as an output variable.
[0015] In addition, the skin information receiving unit is configured to receive a skin affected area image acquired in real time by the camera, and the display display screen generating unit: generates information of an affected area photographing auxiliary screen that includes the skin affected area image acquired in real time and is displayed on the display of the user terminal; and generates information of the affected area photographing auxiliary screen so that information for inducing the camera to move to a position where an affected area image of an appropriate size can be acquired based on a relative size of the extracted affected area image to the skin affected area image is displayed on the display of the user terminal.
[0016] In addition, the display screen generation unit may be configured to: generate information of the affected area photographing auxiliary screen so that information indicating to position the camera closer to the user's skin is displayed on the display of the user terminal when the relative size of the affected area image to the skin affected area image is less than a first reference ratio; and generate information of the affected area photographing auxiliary screen so that information indicating to position the camera farther from the user's skin is displayed on the display of the user terminal when the relative size of the affected area image to the skin affected area image is greater than or equal to a second reference ratio.
[0017] In addition, the method may further include a machine learning unit configured to generate the first artificial intelligence model through a machine learning method by setting a plurality of learning skin lesion images as input variables and a learning atopic lesion type preset to correspond to each learning skin lesion image as an output variable.
[0018] In addition, the method may further include a machine learning unit configured to generate the second artificial intelligence model through a machine learning method by using a plurality of learning skin lesion images as input variables and setting a predetermined learning atopy severity level corresponding to each learning skin lesion image as an output variable.
[0019] In addition, the display screen generation unit may be configured to generate information on the analysis result screen so that information on whether a dermatological examination is necessary, recommended medicine information, recommended cosmetics information, and recommended food information corresponding to the atopic lesion type and the atopic dermatitis severity are displayed on the display of the user terminal.
[0020] In addition, the display screen generation unit may be configured to generate information on the analysis result screen so that information recommending microbiome analysis to the user is displayed on the display of the user terminal.
[0021] In addition, the display screen generation unit may be configured to generate information on the analysis result screen so that, if the atopic severity of the skin affected area image is higher than the standard severity, information recommending microbiome analysis for the user is displayed on the display of the user terminal.
[0022] In addition, the system may further include a user input receiving unit configured to receive input information input through the user terminal; and a fecal analysis result receiving unit configured to receive first fecal analysis result information generated based on the microbiome analysis result for the first feces of the user and input through the administrator terminal after the user input receiving unit receives the microbiome analysis request information.
[0023] In addition, the display screen generation unit may be configured to generate information of a microbiome analysis result screen displayed on the display of the user terminal, including the first stool analysis result information and recommended medicine information, recommended cosmetic information, and recommended food information corresponding to the first stool analysis result information.
[0024] In addition, the fecal analysis result receiving unit may be configured to receive secondary fecal analysis result information generated based on the microbiome analysis result for the second feces of the user and input through the administrator terminal after receiving the first fecal analysis result information.
[0025] In addition, the display screen generation unit may be configured to generate information on a microbiome analysis result screen displayed on a display of the user terminal, including information on whether the user's health has improved between the time of acquisition of the first feces and the time of acquisition of the second feces, based on the first feces analysis result information and the second feces analysis result information.
[0026] In addition, the skin information receiving unit, the user input receiving unit, the stool analysis result receiving unit, the affected area extracting unit, the atopy type determining unit, the atopy severity determining unit, and the display screen generating unit may be any one processor among a plurality of processors included in the eating habit atopy care service providing system.
[0027] A control method of an atopic care service providing system according to one aspect of the disclosed invention comprises the steps of: receiving, by a skin information receiving unit, a user's skin lesion image from a camera; extracting, by a lesion area extracting unit, an area in which an atopic lesion is distributed from the skin lesion image as an lesion area image based on the skin lesion image using a third artificial intelligence model; determining, by an atopic type determining unit, an atopic lesion type for the skin lesion image using a first artificial intelligence model based on the lesion area image; determining, by an atopic severity determining unit, the atopic severity for the skin lesion image using a second artificial intelligence model based on the lesion area image; generating, by a display screen generating unit, information of an analysis result screen to be displayed on a display of a user terminal based on the atopic lesion type for the skin lesion image and the atopic severity for the skin lesion image; receiving, by the skin information receiving unit, a skin lesion image acquired by the camera in real time; A step of generating information of an auxiliary screen for photographing a skin affected area, which includes the skin affected area image acquired in real time, by the display screen generating unit, and displayed on the display of the user terminal; A step of generating information of an auxiliary screen for photographing a skin affected area, such that information for inducing the camera to move to a position where an image of an affected area of an appropriate size can be acquired, based on the relative size of the extracted image of the affected area with respect to the image of the skin affected area, is displayed on the display of the user terminal;A step of generating information of the affected area photographing auxiliary screen so that, if the relative size of the affected area image to the skin affected area image is less than a first reference ratio, information indicating that a camera should be positioned closer to the user's skin is displayed on the display of the user terminal by the display display screen generating unit; A step of generating information of the affected area photographing auxiliary screen so that, if the relative size of the affected area image to the skin affected area image is greater than or equal to a second reference ratio, information indicating that a camera should be positioned further from the user's skin is displayed on the display of the user terminal by the display display screen generating unit; A step of generating information of the analysis result screen so that, if the relative size of the affected area image to the skin affected area image is greater than or equal to a second reference ratio, information indicating that a dermatological examination is necessary, recommended medicine information, recommended cosmetic information, and recommended food information corresponding to the atopic lesion type and the atopic dermatitis severity are displayed on the display of the user terminal by the display display screen generating unit; A step for generating information of an analysis result screen so that, if the atopic severity of the skin lesion image is higher than the reference severity, information recommending a microbiome analysis for the user is displayed on the display of the user terminal by the display screen generating unit; A step for receiving input information input through the user terminal by the user input receiving unit; A step for receiving, by the user input receiving unit, first fecal analysis result information generated based on the microbiome analysis result for the first feces of the user and input through the administrator terminal after the user input receiving unit receives the microbiome analysis request information; A step for generating, by the display screen generating unit, information of a microbiome analysis result screen that includes the first fecal analysis result information and recommended medicine information, recommended cosmetic information, and recommended food information corresponding to the first fecal analysis result information and displayed on the display of the user terminal;After receiving the first fecal analysis result information, a step of receiving, by the fecal analysis result receiving unit, second fecal analysis result information generated based on the microbiome analysis result for the second feces for the user and input through the administrator terminal; and a step of generating, by the display display screen generating unit, information on a microbiome analysis result screen displayed on the display of the user terminal, including information on whether the user's health has improved between the time of acquisition of the first feces and the time of acquisition of the second feces, based on the first fecal analysis result information and the second fecal analysis result information.
[0028] A computer program according to one aspect of the disclosed invention can be stored in a computer-readable, non-transitory recording medium to execute a control method of the atopic care service providing system.
[0029] According to one aspect of the disclosed invention, a user can take a picture of an atopic dermatitis area by himself or herself without the assistance of a professional, and check the analysis results of his or her atopic dermatitis area remotely.
[0030] In addition, according to an embodiment of the present invention, it is possible to assist a non-expert user in properly photographing an atopic dermatitis area.
[0031] In addition, according to an embodiment of the present invention, an IoT device capable of appropriately photographing an atopic dermatitis area may be included.
[0032] Additionally, according to an embodiment of the present invention, a microbiome analysis service can be additionally provided to a user who has analyzed an atopic dermatitis area.
[0033] Figure 1 is a control block diagram of an atopic care service providing system according to one embodiment.
[0034] FIG. 2 is a diagram illustrating a skin information measuring device according to one embodiment.
[0035] FIG. 3 is a diagram illustrating a process for performing analysis on an atopic dermatitis area according to one embodiment.
[0036] FIG. 4 is a drawing for explaining a refund photography assistance screen that displays information intended to guide a camera to approach a refund according to one embodiment.
[0037] FIG. 5 is a drawing for explaining a refund photography assistance screen that displays information intended to induce the camera to move away from the refund according to one embodiment.
[0038] Figure 6 is a drawing for explaining an analysis result screen according to one embodiment.
[0039] FIG. 7 is a diagram illustrating a process for performing microbiome-based analysis according to one embodiment.
[0040] FIG. 8 is a diagram illustrating a screen of a microbiome-based analysis result according to one embodiment.
[0041] FIG. 9 is a diagram illustrating a process of displaying an analysis result screen by a healthcare app according to one embodiment.
[0042] FIG. 10 is a diagram illustrating a configuration displayed in an app of an atopic care service according to one embodiment.
[0043] FIG. 11 is a diagram illustrating an analysis result screen on which recommended food information is displayed according to one embodiment.
[0044] FIG. 12 is a diagram illustrating an analysis result screen that provides stress care service according to one embodiment.
[0045] FIG. 13 is a diagram illustrating an analysis result screen displaying analysis results for beneficial bacteria according to one embodiment.
[0046] Figure 14 is a flowchart of a method for providing an atopic care service according to one embodiment.
[0047] Figure 15 is a flowchart of a method for providing a microbiome analysis service according to one embodiment.
[0048] Like reference numerals refer to like elements throughout the specification. This specification does not describe all elements of the embodiments, and general information within the technical field to which the disclosed invention pertains or information that overlaps between the embodiments is omitted.
[0049] Additionally, when a part is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless otherwise specifically stated.
[0050] As used herein, the term "~unit" refers to a unit that processes at least one function or operation, and may refer to, for example, software, an FPGA, or a hardware component. The function provided by the "~unit" may be performed separately by multiple components, or may be integrated with other additional components. The "~unit" of this specification is not necessarily limited to software or hardware, and may be configured to be located in an addressable storage medium, or may be configured to play one or more processors. According to embodiments, multiple "~units" may be implemented as a single component, or a single "~unit" may include multiple components.
[0051] The terms first, second, etc. are used to distinguish one component from another, and the components are not limited by the aforementioned terms.
[0052] Singular expressions include plural expressions unless the context clearly indicates otherwise.
[0053] The identification codes for each step are used for convenience of explanation and do not describe the order of each step. Each step may be performed in a different order than specified unless the context clearly indicates a specific order.
[0054] The operating principle and embodiments of the disclosed invention will be described with reference to the attached drawings below.
[0055] Figure 1 is a control block diagram of an atopic care service providing system according to one embodiment.
[0056] The atopic care service providing system (100) may be a system configured to allow a user to take a picture of his or her own or another user's skin, analyze the type or severity of atopic dermatitis of the taken skin image, and generate an analysis result screen (400) that can be displayed on a display or includes the analysis result. However, the type of atopic dermatitis that the atopic care service providing system (100) can analyze is not necessarily limited to atopic dermatitis.
[0057] The atopic care service provision system (100) is provided on a server and can communicate with at least one user terminal (500) and an administrator terminal via wired or wireless communication.
[0058] The user terminal (500) may be a terminal used by a user who wishes to obtain analysis results for atopic symptoms using the atopic care service provision system (100). The user may check the analysis result screen (400) generated by the atopic care service provision system (100) through the display of the user terminal (500). The administrator terminal may be a terminal of an administrator who provides atopic care services.
[0059] Meanwhile, the atopic care service providing system (100) according to one embodiment is not necessarily limited to being provided on a server and transmitting analysis result data or information of an analysis result screen (400) to the user terminal (500) through communication with the user terminal (500). For example, if the user terminal (500) downloads the atopic care service providing system (100) by downloading an application from a server, the atopic care service providing system (100) may be provided on the user terminal (500). That is, as long as the user can take a picture of a skin lesion image (300) through a camera (210) and check an analysis result screen (400) for the skin lesion image (300) through the user terminal (500), the atopic care service providing system (100) may be provided on any terminal or server and may be operated in any manner.
[0060] Referring to FIG. 1, an atopic care service providing system (100) may include a skin information receiving unit (111), a user input receiving unit (112), a stool analysis result receiving unit (113), an affected area extracting unit (120), an atopic type determining unit (130), an atopic severity determining unit (140), a display screen generating unit (150), a memory (160), a machine learning unit (170), and a skin information measuring device (200).
[0061] The skin information receiving unit (111) can receive an image (300) of the user's skin from the camera (210). The image (300) of the skin may be an image of the user's skin suspected of having atopic symptoms.
[0062] When the atopic care service provision system (100) is provided on a server, the skin information receiving unit (111) can receive a skin affected area image (300) acquired by a camera (210) provided in the skin information measuring device (200) from the skin information measuring device (200). Alternatively, the skin information receiving unit (111) can receive a skin affected area image (300) acquired by a camera (210) provided in the user terminal (500) from the user terminal (500).
[0063] If the atopic care service providing system (100) is provided in the user terminal (500), the skin information receiving unit (111) can receive the skin affected area image (300) acquired by the camera (210) provided in the skin information measuring device (200) from the skin information measuring device (200). Alternatively, the skin information receiving unit (111) can also directly receive the skin affected area image (300) acquired by the camera (210) provided in the user terminal (500) from the camera (210) of the user terminal (500) without going through another device or server. In other words, it does not matter how the image receiving unit (110) receives the skin affected area image (300).
[0064] The skin information receiving unit (111) can transmit the skin affected area image (300) to the affected area extraction unit (120), the atopic type determination unit (130), or the atopic severity determination unit (140).
[0065] The atopic type determination unit (130) can determine the atopic lesion type for the skin lesion image (300) using the first artificial intelligence model (161) based on the skin lesion image (300). The first artificial intelligence model (161) may be an artificial intelligence model used to determine the atopic lesion type corresponding to the input skin lesion image (300).
[0066] Atopic lesion types can be categorized into four general types of atopic dermatitis. For example, the atopic lesion types of a specific atopic dermatitis can be acute atopic dermatitis, chronic atopic dermatitis, infantile eczema, or non-atopic eczema. However, the types of atopic lesions are not necessarily limited to these four types or the aforementioned types.
[0067] The atopic type determination unit (130) can transmit the determined atopic lesion type to the display screen generation unit (150).
[0068] The atopic severity determination unit (140) can determine the atopic severity for the skin affected area image (300) using the second artificial intelligence model (162) based on the skin affected area image (300). The second artificial intelligence model (162) may be an artificial intelligence model used to determine the atopic severity corresponding to the input skin affected area image (300).
[0069] Atopic dermatitis severity can be categorized into four general stages, which can be categorized by the severity of symptoms. For example, a specific atopic dermatitis severity might fall into one of four categories: stage 1, which does not interfere with daily life; stage 2, which involves severe itching and skin inflammation; stage 3, which involves severe itching, dryness, cracking, and the risk of skin infection; and stage 4, which involves severe dryness and cracking, severely limiting daily life. However, the severity of atopic dermatitis lesions is not necessarily limited to these four stages or even to the aforementioned stages.
[0070] The atopy severity judgment unit (140) can transmit the determined atopy severity to the display screen generation unit (150).
[0071] The display display screen generation unit (150) can generate information of the analysis result screen (400) based on the atopic lesion type for the skin lesion image (300) and the atopic lesion severity for the skin lesion image (300). Specifically, the display display screen generation unit (150) can generate signals or information necessary to generate the analysis result screen (400). The user terminal (500) can display the analysis result screen (400) on the display based on the information of the analysis result screen (400).
[0072] The analysis result screen (400) may be a screen displayed on the display of the user terminal (500). The analysis result screen (400) may be a screen including information on whether a dermatological examination is necessary corresponding to the atopic lesion type and atopic dermatitis severity corresponding to the skin lesion image (300) taken by the user, information on recommended medicines, information on recommended cosmetics, and information on recommended foods.
[0073] When the atopic care service system is provided on a server, the server can transmit information on the analysis result screen (400) to the user terminal (500) so that the analysis result screen (400) can be displayed on the display of the user terminal (500). When the atopic care service system is provided on the user terminal (500), the display screen generation unit (150) can directly transmit information on the analysis result screen (400) to the processor that controls the display of the user terminal (500).
[0074] Artificial intelligence models such as the first artificial intelligence model (161), the second artificial intelligence model (162), and the third artificial intelligence model (163) may be stored in the memory (160) of the atopic care service providing system (100). Meanwhile, each artificial intelligence model such as the first artificial intelligence model (161), the second artificial intelligence model (162), and the third artificial intelligence model (163) is not necessarily a separate artificial intelligence model that is distinct from each other. For example, the first artificial intelligence model (161), the second artificial intelligence model (162), and the third artificial intelligence model (163) may be completely the same artificial intelligence model, and each artificial intelligence model may be expressed differently, and there is only one artificial intelligence model according to the present invention, and one artificial intelligence model may perform all deep learning operations of the present invention.
[0075] The machine learning unit (170) can generate a first artificial intelligence model (161) through a machine learning method by using multiple learning skin lesion images as input variables and setting a learning atopic lesion type that is preset to correspond to each learning skin lesion image as an output variable.
[0076] The machine learning unit (170) can create a second artificial intelligence model (162) through a machine learning method by using multiple learning skin lesion images as input variables and setting a learning atopy severity level that is preset to correspond to each learning skin lesion image as an output variable.
[0077] Machine learning utilizes models composed of multiple parameters and can mean optimizing those parameters based on given data. Depending on the type of learning problem, machine learning can include supervised learning, unsupervised learning, and reinforcement learning. Supervised learning learns mappings between inputs and outputs and is applicable when input-output pairs are given as data. Unsupervised learning is applicable when there are only inputs and no outputs, and can identify patterns between inputs, etc.
[0078] The machine learning unit (170) can generate an artificial intelligence model in various ways. For example, the machine learning unit (170) can learn features extracted from learning skin lesion images using a deep learning-based learning method. At this time, a CNN (Convolutional Neural Networks) structure that stacks multiple stages of convolution layers can be utilized to learn a method of extracting features from learning skin lesion images. However, the learning method of the machine learning unit (170) is not necessarily limited to a method utilizing the CNN structure. For example, the learning method of the machine learning unit (170) can be a method through a machine learning algorithm including an artificial neural network (ANN) or a recurrent neural network (RNN).
[0079] The user may take a picture of the skin affected area (300) for which he or she wishes to analyze atopic symptoms through his or her user terminal (500), but may also take a picture through a camera (210) provided in an IOT device specialized in taking pictures of the skin affected area.
[0080] FIG. 2 is a diagram illustrating a skin information measuring device according to one embodiment.
[0081] Referring to FIGS. 1 and 2, a skin information measuring device (200) may be provided with a camera (210) and may include an SCH sensor (220), a TEWL sensor (230), a distance sensor (240), and a light-emitting element (250).
[0082] The skin information measuring device (200) can transmit a skin affected area image (300) acquired through a camera (210) to a skin information receiving unit (111).
[0083] The SCH sensor (220) can obtain information on the user's skin moisture and oil content. Specifically, the SCH sensor (220) measures the electrical characteristics of the skin by contacting the electrode with the skin, and calculates the skin moisture content based on this, thereby measuring skin moisture information. In addition, the SCH sensor (220) can measure skin oil content information by measuring the amount of oil absorbed from the skin in contact with an oil absorbent paper over a certain period of time.
[0084] The TEWL sensor (230) can obtain the user's transepidermal water loss (TEWL) information. Although the transepidermal water loss information is not a parameter that directly indicates the moisture in the stratum corneum, it is closely related to the barrier function and moisturizing function. The TEWL sensor (230) can measure the integrity of the skin barrier and the moisture protection function by measuring the rate at which moisture on the skin surface evaporates into the environment. For example, the TEWL sensor (230) can measure the amount of moisture evaporating from the epidermis by calculating the vapor pressure for moisture diffusing into the air from the skin surface. In general, the TEWL value increases as the skin gets drier, and the TEWL value may increase due to damage to the skin barrier or skin disease.
[0085] The light-emitting element (250) can generate light. The light-emitting element (250) can include a daylight LED (251) that generates light in the visible light range and a UV LED (252) that generates light in the ultraviolet light range.
[0086] The measuring device processor (270) can control the light emitting element (250) to direct light toward the user's skin when the camera (210) acquires a skin lesion image (300). The light in the visible light range or ultraviolet light range incident on the skin can illuminate the skin so that the camera (210) can acquire an image of an appropriate brightness when capturing a skin lesion.
[0087] The distance sensor (240) can obtain distance information between the user's skin and the camera (210) when the camera (210) obtains a skin lesion image (300). The distance sensor (240) can obtain distance information between the user's skin and the camera (210) when the camera (210) is turned on. The method by which the distance sensor (240) obtains distance information may be a method of measuring the time it takes for the ultrasound or light generated by the distance sensor (240) to reflect from the skin and return, but is not limited thereto.
[0088] It may be desirable for the camera (210) to obtain a skin lesion image (300) of consistent brightness regardless of the distance from the skin.
[0089] The measuring device processor (270) can control the light emitting element (250) so that the intensity of light generated by the light emitting element (250) increases as the distance between the user's skin and the camera (210) increases based on distance information between the user's skin and the camera (210). In addition, the measuring device processor (270) can control the light emitting element (250) so that the intensity of light generated by the light emitting element (250) decreases as the distance between the user's skin and the camera (210) decreases based on distance information between the user's skin and the camera (210).
[0090] The communication unit (260) provided in the skin information measuring device (200) can transmit skin affected area image (300), skin moisture information, skin oil information, and transdermal moisture loss information to the skin information receiving unit (111) using at least one of a Wi-Fi communication method and a Bluetooth communication method. However, the communication method by which the communication unit (260) transmits information is not limited thereto.
[0091] The display screen generation unit (150) can generate information of an analysis result screen (400) including a skin affected area image (300), skin moisture information, skin oil information, and transepidermal moisture loss information.
[0092] FIG. 3 is a diagram illustrating a process for performing analysis on an atopic dermatitis area according to one embodiment.
[0093] Referring to FIG. 3, it can be confirmed that the skin lesion image (300) acquired by the user through the camera (210) is displayed in real time on the display of the user terminal (500).
[0094] After completing the shooting of the affected area with the camera (210), the affected area image (301), which is an image of the area where the atopic dermatitis is distributed, may be displayed as a box in the acquired skin affected area image (300). The skin affected area image (300) is an image acquired by the user, and if it is acquired by shooting an appropriate affected area at an appropriate location, it may be appropriate as a target of analysis. However, a problem may arise when an excessively large area is shot compared to the affected area. The affected area image (301) may be an image of the area where the affected area is distributed that can be used as a target of analysis in the skin affected area image (300).
[0095] Thereafter, the atopic care service providing system (100) can perform analysis on the skin affected area image (300) or affected area image (301) and display the analysis results on the display of the user terminal (500).
[0096] Specifically, the display screen generation unit (150) can generate information on the analysis result screen (400) so that information on whether a dermatological examination is necessary, recommended medicine information, recommended cosmetics information, and recommended food information corresponding to the atopic lesion type and atopic dermatitis severity of the skin lesion image (300), is displayed on the display of the user terminal (500).
[0097] Referring to FIGS. 1 and 3, the affected area extraction unit (120) can extract an affected area image (301) from the affected area image (300) using the third artificial intelligence model (163) based on the affected area image (300).
[0098] The third artificial intelligence model (163) may be an artificial intelligence model used to extract an affected area image (301) corresponding to the input skin affected area image (300).
[0099] The machine learning unit (170) can generate a third artificial intelligence model (163) through a machine learning method by using multiple learning skin lesion images as input variables and setting the learning lesion area image (301) corresponding to each learning skin lesion image as an output variable.
[0100] The atopic type determination unit (130) can determine the atopic lesion type for the skin affected area image (300) using the first artificial intelligence model (161) based on the affected area image (301). The atopic severity determination unit (140) can determine the atopic severity for the skin affected area image (300) using the second artificial intelligence model (162) based on the affected area image (301).
[0101] Meanwhile, users seeking to analyze atopic symptoms are likely to be non-experts on atopic dermatitis. Such users may be unsure of the most appropriate location for capturing skin lesion images (300) via the camera (210) for analysis.
[0102] FIG. 4 is a drawing for explaining a wound photography auxiliary screen (302) on which information for inducing a camera to approach a wound according to one embodiment is displayed, and FIG. 5 is a drawing for explaining a wound photography auxiliary screen (302) on which information for inducing a camera to move away from a wound according to one embodiment is displayed.
[0103] Referring to FIGS. 4 and 5, it can be seen that a camera assist screen (302) for photographing a wound, which assists the user in photographing the wound, is displayed on the display of the user terminal (500). At this time, the camera (210) used by the user may be provided in the user terminal (500) or may be provided in the skin information measuring device (200).
[0104] The skin information receiving unit (111) can receive a skin affected area image (300) acquired in real time by the camera (210).
[0105] The display screen generation unit (150) can generate information of a skin lesion image (300) acquired in real time and displayed on the display of a user terminal (500) on a skin lesion photographing auxiliary screen (302). The user terminal (500) can display a skin lesion photographing auxiliary screen (302) on the display, which displays a skin lesion image (300) that the user is photographing in real time through a camera (210), based on the information of the skin lesion photographing auxiliary screen (302).
[0106] The display screen generation unit (150) can generate information on the affected area shooting auxiliary screen (302) so that information for inducing the camera (210) to move to a position where an affected area image (301) of an appropriate size can be acquired based on the relative size of the extracted affected area image (301) to the skin affected area image (300) is displayed on the display of the user terminal (500).
[0107] The display display screen generation unit (150) can generate information of the affected area photographing auxiliary screen (302) so that information indicating that the camera (210) should be positioned closer to the user's skin is displayed on the display of the user terminal (500) when the relative size of the affected area image (301) to the affected area image (300) is less than the first reference ratio.
[0108] For example, if the relative size of the affected area image (301) to the affected area image (300) is less than the first reference ratio, the display display screen generation unit (150) can generate information on the affected area photographing auxiliary screen (302) that displays the message “Move the camera closer to the affected area.”
[0109] The relative size of the affected area image (301) to the affected area image (300) may be the area of the affected area image (300) relative to the area of the affected area image (301), or may be the horizontal or vertical length of the affected area image (300) relative to the horizontal or vertical length of the affected area image (301).
[0110] The first reference ratio may be a preset ratio that serves as a reference for determining whether the camera (210) acquires a skin lesion image (300) from too far away.
[0111] The display display screen generation unit (150) can generate information of the affected area photographing auxiliary screen (302) so that information indicating that the camera (210) should be positioned further from the user's skin is displayed on the display of the user terminal (500) when the relative size of the affected area image (301) to the affected area image (300) is greater than or equal to the second reference ratio.
[0112] For example, the display display screen generation unit (150) can generate information on a skin area photographing auxiliary screen (302) that displays a message saying “Move the camera slightly away from the skin area” when the relative size of the skin area image (300) of the skin area image (301) is greater than or equal to the second reference ratio.
[0113] The second reference ratio may be a preset ratio that serves as a reference for determining whether the camera (210) is acquiring a skin lesion image (300) too close.
[0114] Figure 6 is a drawing for explaining an analysis result screen according to one embodiment.
[0115] Referring to FIGS. 1 and 6, the display screen generation unit (150) can generate information on the analysis result screen (400) so that information recommending microbiome analysis to the user is displayed on the display of the user terminal (500).
[0116] For example, the display display screen generation unit (150) can generate information on the analysis result screen (400) that displays the message “We recommend microbiome analysis.”
[0117] Microbiome analysis is a method for studying and analyzing an organism's microbiome, i.e., the microbial communities that inhabit the interior or surface of that organism. The microbiome can refer to the diverse collection of microorganisms, including bacteria, fungi, and viruses, that exist within the human body. Microbiome analysis can be performed using a variety of methods to understand and explain the composition, diversity, and functions of the microbiome. Commonly used analytical techniques include 16S ribosomal RNA gene sequencing, metagenomic sequencing, genome analysis, genome functional analysis, and protein analysis.
[0118] Meanwhile, microbiome analysis can be performed by analyzing human feces. For example, studying the microbiome through fecal analysis can help analyze the individual's health and disease, immune system, nutrient absorption, and digestive processes.
[0119] The user inputs microbiome analysis request information to request microbiome analysis through his / her user terminal (500), transmits his / her feces to the administrator of the atopic care service provision system (100), and then the administrator can check the microbiome analysis results entered through his / her user terminal (500).
[0120] The display screen generation unit (150) can generate information on the analysis result screen (400) so that information recommending microbiome analysis to the user is displayed on the display of the user terminal (500) when the atopic severity for the skin lesion image (300) is higher than the reference severity. The reference severity may be a preset atopic severity that serves as a standard for recommending microbiome analysis.
[0121] For example, if the atopic severity for the skin lesion image (300) is stage 3 and the standard severity is stage 2, the display screen generation unit (150) can generate information on the analysis result screen (400) that displays the message “We recommend microbiome analysis.”
[0122] FIG. 7 is a diagram illustrating a process for performing microbiome-based analysis according to one embodiment.
[0123] Referring to FIG. 1 and FIG. 7, the user input receiving unit (112) can receive input information input through the user terminal (500).
[0124] The user input receiving unit (112) can transmit the received input information to the display screen generating unit (150) and the fecal analysis result receiving unit (113).
[0125] When the user input receiving unit (112) receives microbiome analysis request information, the atopic care service providing system (100) can transmit information or a message to the administrator terminal to perform a microbiome-based analysis on the user's feces.
[0126] After receiving information or a message requesting a microbiome-based analysis, the administrator can analyze the user's stool. The stool initially received by the administrator may be the user's first stool sample.
[0127] Administrators can generate primary fecal analysis results based on the microbiome analysis results for a user's primary fecal sample. The administrator terminal can receive primary fecal analysis results via the administrator terminal.
[0128] Specifically, the fecal analysis result receiving unit (113) can receive the first fecal analysis result information from the administrator terminal after the user input receiving unit (112) receives the microbiome analysis request information.
[0129] The display display screen generation unit (150) can generate information of a microbiome analysis result screen (401) displayed on the display of a user terminal (500) while including the first stool analysis result information and recommended medicine information, recommended cosmetics information, and recommended food information corresponding to the first stool analysis result information.
[0130] After receiving the results of the first microbiome analysis and managing their health with recommended products, users may want to perform a second microbiome analysis to see if there is any improvement.
[0131] After conducting the initial microbiome-based analysis, the administrator can analyze the user's stool samples received from the user after a certain period of time. The second stool sample received by the administrator may be a secondary stool sample from the user.
[0132] Administrators can generate secondary fecal analysis results based on microbiome analysis results for a user's secondary feces. The administrator terminal can receive secondary fecal analysis results via the administrator terminal.
[0133] Specifically, the fecal analysis result receiving unit (113) can receive secondary fecal analysis result information generated based on the microbiome analysis result for the second feces of the user and input through the administrator terminal after receiving the primary fecal analysis result information.
[0134] The display display screen generation unit (150) can generate information on a microbiome analysis result screen (401) displayed on the display of a user terminal (500) based on the first stool analysis result information and the second stool analysis result information, including information on whether the user's health has improved between the time of acquisition of the first stool and the time of acquisition of the second stool.
[0135] FIG. 8 is a diagram illustrating a screen of a microbiome-based analysis result according to one embodiment.
[0136] Referring to FIG. 8, the configuration of the microbiome analysis result screen (401) displayed on the display of the user terminal (500) can be confirmed.
[0137] For example, the display of the user terminal (500) may display the value of the harmful bacteria index for the user, information on whether the value is high compared to the average harmful bacteria index of a specific group, and risk information of the value.
[0138] When a user touches 'Check recommended lactic acid bacteria' displayed on the microbiome analysis results screen (401) and inputs it as input information, information such as the type and effectiveness of the recommended lactic acid bacteria product can be displayed on the microbiome analysis results screen (401).
[0139] In addition, when a user touches 'Purchase Product' on the microbiome analysis result screen (401) showing the recommended lactic acid bacteria product and inputs the information, a purchase service for the corresponding lactic acid bacteria product can be provided.
[0140] The microbiome analysis result screen (401) can display the improved effects after the user purchases and takes the probiotic product in the form of a report on harmful or beneficial bacteria.
[0141] FIG. 9 is a diagram illustrating a process of displaying an analysis result screen by a healthcare app according to one embodiment, and FIG. 10 is a diagram illustrating a configuration displayed in an app of an atopic care service according to one embodiment.
[0142] Referring to FIG. 9, a user can use the healthcare app service provided by the atopic care service providing system (100) through his / her user terminal (500).
[0143] The display screen generation unit (150) can generate information on a chatbot chat screen that allows a user to exchange messages with a chatbot. The user terminal (500) can display the chatbot chat screen on the display based on the information on the chatbot chat screen.
[0144] A user can input a message of their choice as input information while viewing the chatbot chat screen. The user input receiving unit (112) can receive input information entered through the user terminal (500) from the user terminal (500).
[0145] The user input receiving unit (112) may be configured to receive input according to the user's intention to manipulate the screen displayed on the display of the user terminal (500). The user may input input information according to his / her intention into the user terminal (500) through the screen displayed on the display.
[0146] The user input receiving unit (112) may receive input information by physically applying force to a keyboard, button, or mouse provided on a user terminal (500) equipped with a display, or by inputting input information by touch input on the display, but is not limited thereto. In addition, when the atopic care service providing system (100) is provided on a server, the user input receiving unit (112) may receive input by transmitting a signal of an input received by the communication module of the server from the user terminal (500) to the user input receiving unit (112) from the communication module of the server.
[0147] Users can input general information about their skin condition as a message via the chatbot chat screen. The atopic care service provision system (100) can analyze the user's skin condition by analyzing the message entered via the chatbot chat screen.
[0148] The atopic care service provision system may further include a unit for determining whether or not to analyze atopic dermatitis.
[0149] The atopy analysis decision unit can use a message analysis artificial intelligence model to determine whether an atopy analysis is necessary based on the message entered by the user through the chatbot chat screen.
[0150] The message analysis artificial intelligence model may be a pre-trained artificial intelligence model that sets a message related to atopy as an input variable and sets the need for a pre-set atopy analysis for the person who entered the message as an output variable. The message analysis artificial intelligence model may be stored in memory (160).
[0151] If the atopy analysis decision unit determines that atopy analysis is necessary for a message entered through the chatbot chat screen, the display display screen generation unit (150) can generate information on the display display screen so that an image acquired through the camera (210) is displayed in real time on the display of the user terminal (500). For example, if the atopy analysis decision unit determines that atopy analysis is necessary for a message entered through the chatbot chat screen, the display display screen generation unit (150) can generate information on an affected area photographing auxiliary screen (302) that includes an affected area image (300) acquired in real time and is displayed on the display of the user terminal (500).
[0152] Thereafter, the atopic care service providing system (100) may perform an analysis on the skin affected area image (300) or affected area image (301) and display the analysis results on the display of the user terminal (500). For example, the information displayed on the display may include that the atopic severity of the user is 'moderate', the atopic type is 'atopic dermatitis', and the prescription for the user is 'apply a prescription moisturizer three times a day'.
[0153] Additionally, the atopic care service provision system (100) can display information on recommended services for the user. Recommended services may include care programs, recommended products, microbiome analysis, and hospital treatment.
[0154] Referring to Figure 10, you can check the configurations displayed in the atopic care service app.
[0155] The atopic care service providing system (100) can control the atopic care service app so that the analysis results for each of a plurality of skin affected area images (300) are displayed on the display. In addition, the atopic care service app can be controlled so that the analysis results, care guides, analysis reports, recommended products, etc. for each skin affected area image (300) are displayed. At this time, the image, product name, and price of the recommended product for each skin affected area image (300) can be displayed on the display. In addition, the type of test recommended for each skin affected area image (300) and a description of the content of each test can be displayed on the display.
[0156] The user input receiving unit (112) can receive information on the patient's diet, sleep, drinking, and smoking. The display screen generation unit (150) can generate information on the analysis result screen (400) that displays recommended food information or provides stress care services based on the information on the patient's diet, sleep, drinking, and smoking.
[0157] FIG. 11 is a diagram illustrating an analysis result screen displaying recommended food information according to one embodiment, and FIG. 12 is a diagram illustrating an analysis result screen providing a stress care service according to one embodiment.
[0158] Referring to FIG. 11, it can be confirmed that a recommended diet for a skin lesion image (300) is displayed on the analysis results screen (400). At this time, if the user touches 'Check alternative diet' displayed on the display and inputs it as input information, the recommended alternative diet can be displayed on the analysis results screen (400).
[0159] Additionally, when a user touches 'Purchase Product' on the analysis results screen (400) showing a recommended alternative diet and inputs the information, a purchase service for the product can be provided.
[0160] Referring to FIG. 12, it can be confirmed that a stress relief program for a skin lesion image (300) is displayed on the analysis results screen (400). At this time, if the user touches "Request Stress Test" displayed on the display and inputs the information, a recommended stress relief program may be displayed on the analysis results screen (400). For example, if the user touches "Request Stress Test," "Temple Stay" may be displayed on the display as a recommended stress relief program.
[0161] In addition, if a user inputs information indicating that he or she wishes to apply for a stress relief program on the analysis results screen (400) showing the recommended stress relief program, a purchase service for the program may be provided.
[0162] FIG. 13 is a diagram illustrating an analysis result screen displaying analysis results for beneficial bacteria according to one embodiment.
[0163] Referring to FIG. 13, the atopic care service provision system (100) can display information on non-face-to-face treatment services and doctor consultation services for skin lesion images (300) taken by the user.
[0164] For example, the display screen generation unit (150) can generate screen information for a non-face-to-face medical consultation reservation for a skin lesion image (300) taken by a user, or generate screen information for a doctor consultation.
[0165] At least one component may be added or deleted in response to the performance of the components described above. Furthermore, those skilled in the art will readily understand that the relative positions of the components may be altered in response to the performance or structure of the system.
[0166] Figure 14 is a flowchart of a method for providing atopic care services according to one embodiment. This is merely a preferred embodiment for achieving the purpose of the present invention, and it is understood that certain components may be added or deleted as needed.
[0167] Referring to FIG. 14, the skin information receiving unit (111) can receive a skin affected area image (300) of the user from the camera (210) (1001). The skin information receiving unit (111) can transmit the skin affected area image (300) to the affected area extraction unit (120).
[0168] The affected area extraction unit (120) can extract the area where the atopic dermatitis is distributed from the skin affected area image (300) as an affected area image (301) using the third artificial intelligence model (163) based on the skin affected area image (300) (1002).
[0169] The display display screen generation unit (150) can generate a skin lesion image (300) acquired in real time and a skin lesion photographing auxiliary screen (302) displayed on the display of the user terminal (500) (1003). At this time, the display display screen generation unit (150) can generate the skin lesion photographing auxiliary screen (302) so that information for inducing the camera (210) to move to a position where an appropriately sized skin lesion image (301) can be acquired based on the relative size of the extracted skin lesion image (300) can be displayed on the display of the user terminal (500).
[0170] The atopic type determination unit (130) can determine the atopic lesion type for the skin lesion image (300) using the first artificial intelligence model (161) based on the skin lesion image (300) (1004).
[0171] The atopic severity judgment unit (140) can determine the atopic severity for the skin affected area image (300) using the second artificial intelligence model (162) based on the skin affected area image (300) (1005).
[0172] The display screen generation unit (150) can generate information on the analysis result screen (400) based on the atopic lesion type for the skin affected area image (300) and the atopic lesion severity for the skin affected area image (300) (1006).
[0173] The user terminal (500) can display an analysis result screen on the display (1007).
[0174] Figure 15 is a flowchart of a method for providing a microbiome analysis service according to one embodiment.
[0175] Referring to FIG. 15, the user terminal (500) can display information on the analysis result screen (400) that displays information recommending microbiome analysis to the user (2001).
[0176] A user can input microbiome analysis request information requesting microbiome analysis through his / her user terminal (500). The user input receiving unit (112) can receive the microbiome analysis request information (2002). When the user input receiving unit (112) receives the microbiome analysis request information, the atopic care service providing system (100) can transmit information or a message to the administrator terminal requesting a microbiome-based analysis of the user's stool.
[0177] The fecal analysis result receiving unit (113) can receive the first fecal analysis result information from the administrator terminal after the user input receiving unit (112) receives the microbiome analysis request information (2003).
[0178] The display of the user terminal (500) can display a microbiome analysis result screen (401) including first stool analysis result information and recommended medicine information, recommended cosmetics information, and recommended food information corresponding to the first stool analysis result information (2004).
[0179] The fecal analysis result receiving unit (113) can receive secondary fecal analysis result information generated based on the microbiome analysis result for the second feces of the user and input through the administrator terminal after receiving the primary fecal analysis result information (2005).
[0180] The display of the user terminal (500) can display a microbiome analysis result screen (401) including information on whether the user's health has improved between the time of obtaining the first stool and the time of obtaining the second stool (2006).
[0181] The skin information receiving unit (111), the user input receiving unit (112), the stool analysis result receiving unit (113), the affected area extracting unit (120), the atopic type determining unit (130), the atopic severity determining unit (140), the display screen generating unit (150), the machine learning unit (170), the communication unit (260), and the measuring device processor (270) may include any one of a plurality of processors included in the atopic care service providing system (100). In addition, the atopic care service providing method according to the embodiments of the present invention described so far and the embodiments to be described hereinafter may be implemented in the form of a program that can be driven by a processor.
[0182] Here, the program may include program commands, data files, and data structures, either singly or in combination. The program may be designed and produced using machine language code or high-level language code. The program may be specifically designed to implement the atopic care service provision method described above, or may be implemented using various functions or definitions that are known and available to those skilled in the art of computer software. The program for implementing the atopic care service provision method described above may be recorded on a recording medium readable by a processor. In this case, the recording medium may be memory (160).
[0183] The memory (160) can store a program that performs the operations described above and the operations described below, and the memory (160) can execute the stored program. In the case where there are multiple processors and memories (160), they can be integrated into a single chip or provided in physically separate locations. The memory (160) can include volatile memory such as Static Random Access Memory (S-RAM) and Dynamic Random Access Memory (D-RAM) for temporarily storing data. In addition, the memory (160) can include nonvolatile memory such as Read Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), and Electrically Erasable Programmable Read Only Memory (EEPROM) for long-term storage of control programs and control data.
[0184] The processor may include various logic circuits and operation circuits, process data according to a program provided from memory (160), and generate a control signal according to the processing result.
[0185] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present invention can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.
Claims
1. A skin information receiving unit configured to receive an image of a user's skin area from a camera; An atopic type determination unit configured to determine an atopic lesion type for the skin lesion image using a first artificial intelligence model based on the skin lesion image; An atopic severity determination unit configured to determine the atopic severity for the skin affected area image using a second artificial intelligence model based on the skin affected area image; and An atopic care service providing system including a display screen generation unit configured to generate information on an analysis result screen displayed on a display of a user terminal based on the atopic lesion type for the above skin lesion image and the atopic lesion severity for the above skin lesion image.
2. In paragraph 1, The above camera is provided and further includes a skin information measuring device configured to transmit the skin affected area image to the skin information receiving unit, The above skin information measuring device: An SCH sensor that obtains skin moisture information and skin oil information of the user; and An atopic care service providing system including a TEWL sensor that obtains transepidermal water loss information of the user.
3. In paragraph 2, The above skin information measuring device: a light-emitting element that generates light; and An atopic care service providing system further comprising a measuring device processor that controls the light-emitting element to irradiate light toward the user's skin when the camera acquires a skin lesion image.
4. In paragraph 3, The above skin information measuring device, When the above camera acquires a skin area image, it further includes a distance sensor configured to acquire distance information between the user's skin and the camera, The above measuring device processor, An atopic care service providing system that controls the light-emitting element so that the intensity of light generated by the light-emitting element increases as the distance between the user's skin and the camera increases based on distance information between the user's skin and the camera.
5. In paragraph 4, The above skin information measuring device, An atopic care service providing system further comprising a communication unit configured to transmit the skin affected area image, the skin moisture information, the skin oil information, and the transdermal moisture loss information to the skin information receiving unit using at least one of a Wi-Fi communication method and a Bluetooth communication method.
6. In paragraph 1, Based on the above skin affected area image, the third artificial intelligence model is used to further include an affected area extraction unit configured to extract an affected area image, which is an image of an area where atopic dermatitis is distributed, from the skin affected area image. The above atopic type determination unit is, It is configured to determine the atopic lesion type for the skin affected area image using the first artificial intelligence model based on the affected area image, The above atopic severity assessment section is: An atopic care service providing system configured to determine the severity of atopic dermatitis for the skin affected area image using the second artificial intelligence model based on the affected area image.
7. In paragraph 6, An atopic care service providing system further comprising a machine learning unit configured to generate the third artificial intelligence model through a machine learning method by setting a plurality of learning skin lesion images as input variables and a learning lesion area image corresponding to each learning skin lesion image as an output variable.
8. In paragraph 6, The above skin information receiving unit, The above camera is configured to receive a skin affected area image acquired in real time, The above display screen generation unit: Generating a skin area photographing auxiliary screen displayed on the display of the user terminal, including the skin area image acquired in real time; and An atopic care service providing system configured to generate the affected area photographing auxiliary screen so that information for inducing the camera to move to a position where an affected area image of an appropriate size can be acquired based on the relative size of the extracted affected area image to the skin affected area image is displayed on the display of the user terminal.
9. In paragraph 8, The above display screen generation unit: If the relative size of the affected area image to the skin affected area image is less than the first reference ratio, the affected area photographing auxiliary screen is generated so that information indicating that the camera should be positioned closer to the user's skin is displayed on the display of the user terminal; and An atopic care service providing system configured to generate an auxiliary screen for photographing the affected area so that information indicating that the camera should be positioned further from the user's skin is displayed on the display of the user terminal when the relative size of the affected area image to the skin affected area image is greater than or equal to a second reference ratio.
10. In paragraph 1, An atopic care service providing system further comprising a machine learning unit configured to generate the first artificial intelligence model through a machine learning method by setting a plurality of learning skin lesion images as input variables and a preset learning atopic lesion type corresponding to each learning skin lesion image as an output variable.
11. In paragraph 1, An atopic care service providing system further comprising a machine learning unit configured to generate the second artificial intelligence model through a machine learning method by setting a plurality of learning skin lesion images as input variables and a learning atopic dermatitis severity level set in advance to correspond to each learning skin lesion image as an output variable.
12. In paragraph 1, The above display screen generation unit, An atopic care service providing system configured to generate information on the analysis result screen so that information on whether a dermatological examination is necessary, information on recommended medicines, information on recommended cosmetics, and information on recommended foods corresponding to the atopic lesion type and the atopic dermatitis severity are displayed on the display of the user terminal.
13. In paragraph 1, The above display screen generation unit, An atopic care service providing system configured to generate information on the analysis result screen so that information recommending microbiome analysis for the user is displayed on the display of the user terminal.
14. In paragraph 13, The above display screen generation unit, An atopic care service providing system configured to generate information on the analysis result screen so that, if the atopic severity of the above skin lesion image is higher than the standard severity, information recommending microbiome analysis for the user is displayed on the display of the user terminal.
15. In paragraph 13, A user input receiving unit configured to receive input information input through the user terminal; and An atopic care service providing system further comprising a fecal analysis result receiving unit configured to receive first fecal analysis result information generated based on the microbiome analysis result for the first feces of the user and input through an administrator terminal after the user input receiving unit receives microbiome analysis request information.
16. In paragraph 15, The above display screen generation unit, An atopic care service providing system configured to generate information on a microbiome analysis result screen displayed on a display of the user terminal, including the first fecal analysis result information and recommended medicine information, recommended cosmetic information, and recommended food information corresponding to the first fecal analysis result information.
17. In paragraph 16, The receiving unit of the above stool analysis results is, An atopic care service providing system configured to receive secondary fecal analysis result information generated based on the microbiome analysis result for the second feces of the user and input through the administrator terminal after receiving the first fecal analysis result information.
18. In paragraph 17, The above display screen generation unit, An atopic care service providing system configured to generate information on a microbiome analysis result screen displayed on a display of the user terminal, including information on whether the user's health has improved between the time of acquisition of the first feces and the time of acquisition of the second feces, based on the first feces analysis result information and the second feces analysis result information.
19. A control method of an atopic care service providing system controlled by at least one processor, A step of receiving an image of a user's skin affected area from a camera by a skin information receiving unit; A step of extracting an area where an atopic dermatitis lesion is distributed from the skin lesion image as an lesion area image using a third artificial intelligence model based on the skin lesion image by a lesion area extraction unit; A step of determining an atopic lesion type for the skin affected area image using a first artificial intelligence model based on the affected area image by an atopic type determination unit; A step of determining the severity of atopy for the skin affected area image using a second artificial intelligence model based on the affected area image by an atopy severity judgment unit; A step of generating information of an analysis result screen displayed on a display of a user terminal based on the atopic lesion type for the skin affected area image and the atopic lesion severity for the skin affected area image by a display display screen generating unit; A step of receiving a skin affected area image acquired in real time by the camera by the skin information receiving unit; A step of generating a skin area photographing auxiliary screen that includes the skin area image acquired in real time by the display display screen generating unit and is displayed on the display of the user terminal; A step of generating the auxiliary screen for photographing the affected area so that information for inducing the camera to move to a position where an image of the affected area of an appropriate size can be obtained based on the relative size of the extracted affected area image to the skin affected area image is displayed on the display of the user terminal by the display display screen generating unit; A step of generating the auxiliary screen for photographing the affected area so that information indicating that the camera should be positioned closer to the user's skin is displayed on the display of the user terminal when the relative size of the affected area image to the skin affected area image is less than a first reference ratio by the display display screen generating unit; A step of generating the auxiliary screen for photographing the affected area so that information indicating that the camera should be positioned further from the user's skin is displayed on the display of the user terminal when the relative size of the affected area image to the skin affected area image is greater than or equal to a second reference ratio, by the display display screen generating unit; A step of generating information on the analysis result screen so that information on whether a dermatological examination is necessary, information on recommended medicines, information on recommended cosmetics, and information on recommended foods corresponding to the atopic lesion type and the atopic dermatitis severity are displayed on the display of the user terminal by the display display screen generating unit; A step of generating information on the analysis result screen so that, if the atopic severity of the skin affected area image is higher than the standard severity, information recommending microbiome analysis for the user is displayed on the display of the user terminal by the display display screen generating unit; A step of receiving input information input through the user terminal by a user input receiving unit; A step of receiving, by the user input receiving unit, microbiome analysis request information, and then receiving, by the fecal analysis result receiving unit, first fecal analysis result information generated based on the microbiome analysis result for the first feces of the user and input through the administrator terminal; A step of generating information of a microbiome analysis result screen displayed on a display of the user terminal, the information including the first fecal analysis result information and recommended medicine information, recommended cosmetic information, and recommended food information corresponding to the first fecal analysis result information, by the display display screen generating unit; After receiving the first stool analysis result information, a step of receiving second stool analysis result information generated based on the microbiome analysis result for the second stool for the user and input through the administrator terminal by the stool analysis result receiving unit; and A control method for an atopic care service providing system, comprising a step of generating information on a microbiome analysis result screen displayed on a display of the user terminal, including information on whether the user's health has improved between the time of acquiring the first feces and the time of acquiring the second feces, based on the first feces analysis result information and the second feces analysis result information, by the display display screen generating unit.
20. A non-transitory recording medium storing a computer-readable computer program for executing the control method of the atopic care service provision system of Article 19.
Citation Information
Patent Citations
Electronic device and method for analysis of face information in electronic device
KR1020160052309A
Radial flow adsorption vessel with an integrated loading device
KR1020210158798A
Shredding unit of shredding apparatus for waste mask
KR1020230122306A
Method, device and computer program to provide optimized advertising automatic generation of advertising meterial
KR1020230158277A
Apparatus for skin lesion diagnosis based on neural network and method for aiding skin lesion diagnosis
KR102128910B1
