Skin disease measuring system and skin disease management method using a portable terminal

The portable terminal-based skin disease measuring system addresses the inaccuracies and inefficiencies of current diagnostic methods by using image analysis and machine learning to quickly and accurately diagnose skin conditions in companion animals, enhancing their health management.

JP7665227B2Active Publication Date: 2025-04-21AIFORPET CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2023509402
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-08-07
Filing Date
2020-10-30
Publication Date
2025-04-21
Estimated Expiration
2040-10-30

AI Technical Summary

Technical Problem

Current methods for diagnosing skin diseases in companion animals are often inaccurate and time-consuming, relying on incorrect information from surrounding individuals or lengthy hospital visits.

Method used

A portable terminal-based skin disease measuring system that uses image analysis and machine learning algorithms to quickly and accurately diagnose skin conditions by comparing user-inputted skin images with standard health data.

Benefits of technology

Enables rapid and reliable detection of skin diseases, providing immediate medical guidance and reducing the need for unnecessary hospital visits, thus improving the health management of companion animals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007665227000001
    Figure 0007665227000001
  • Figure 0007665227000002
    Figure 0007665227000002
  • Figure 0007665227000003
    Figure 0007665227000003
Patent Text Reader

Abstract

The present invention provides a skin disease measurement system and a skin disease management method using a portable terminal, the method being performed by a management server and including the steps of: generating skin health standard data by matching basic skin condition information and basic skin result data; receiving skin condition measurement information for a skin disease of a test subject from a user terminal; and generating skin health result data by comparing and analyzing the skin condition measurement information with the skin health standard data, wherein the step of generating skin health standard data includes the steps of preprocessing images included in basic skin photograph information included in the basic skin condition information; extracting site-specific analysis images from the preprocessed images; analyzing a characteristic distribution map from the site-specific analysis images; and quantifying and assessing the severity of the skin disease of the test subject using the analyzed characteristic distribution map.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a skin disease measuring system and a skin disease management method using a portable terminal, and more particularly to a skin disease measuring system and a skin disease management method using a portable terminal that can quickly determine the presence or absence of a skin disease in an early stage and provide prompt medical treatment when a skin disease occurs. [Background technology]

[0002] As the population ages and single-person households increase, people are becoming increasingly self-centered and mentally destitute. As a result, the number of people who view pets as family members or companions is increasing, and the companion animal market is also growing steadily.

[0003] When such pets develop abnormal symptoms that are not normally seen, most people have either taken the pet to a veterinary hospital for treatment or resolved the abnormal symptoms based on information obtained from people around them, the Internet, telephone, etc.

[0004] However, the information obtained from people around them or through the Internet or telephone is often incorrect, which can make it difficult to receive treatment. Even if patients visit hospitals directly, they often have to wait a long time, and due to the hospital's heavy workload, customers are often not provided with proper service. Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide a skin disease measuring system and a skin disease management method using a portable terminal.

[0006] The problems to be solved by the present invention are not limited to those mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description. [Means for solving the problem]

[0007] A skin disease measuring method using a portable terminal according to one embodiment of the present invention for solving the above-mentioned problems, in a skin disease measuring method using a portable terminal performed by a management server, includes the steps of: matching basic skin condition information and basic skin result data to generate skin health standard data; receiving skin condition measurement information for a skin disease of a test subject from a user terminal; and comparing and analyzing the skin condition measurement information based on the skin health standard data to generate skin health result data; wherein the step of generating the skin health standard data includes the steps of preprocessing an image included in basic skin photography information included in the basic skin condition information; extracting an analysis image for each area from the preprocessed image; analyzing a characteristic distribution map from the analysis image for each area; and evaluating the severity of the skin disease of the test subject by quantifying it using the analyzed characteristic distribution map.

[0008] In one embodiment of the present invention, the step of analyzing the characteristic distribution map may use a Multiple-Residual Concatenation (MRC) algorithm to analyze a characteristic distribution map for at least one skin disease selected from erythema, abrasion, and lichenification from the area-specific analysis image.

[0009] In one embodiment of the present invention, the severity of the erythema can be evaluated using a distribution chart of average R(red) calculated from the analysis image for each region, the severity of the abrasion can be evaluated using a distribution chart of the area of ​​the wound site versus the total area calculated from the analysis image for each region, and the severity of the lichenification can be numerically evaluated using a distribution chart of the number of wrinkles and white spots calculated from the analysis image for each region.

[0010] In one embodiment of the present invention, generating the skin health standard data may include repeatedly learning and verifying the baseline skin result data corresponding to the baseline skin condition information.

[0011] In one embodiment of the present invention, the step of generating the skin health result data may include the steps of: extracting and correcting actual analysis images for each area from actual skin photography information included in the skin condition measurement information; analyzing a characteristic distribution map from the actual analysis images for each area; and generating the skin health result data by comparing and analyzing the characteristic distribution map and the skin health standard data to numerically evaluate the severity of the skin disease of the test subject.

[0012] In one embodiment of the present invention, the method may further include transmitting / receiving medical management data generated in response to the skin health result data to / from the user terminal.

[0013] In one embodiment of the present invention, the method may further include transmitting and receiving the medical management data between the user terminal and a service link terminal.

[0014] In one embodiment of the present invention, the method may further include updating the skin health standard data in real time in response to the skin health result data.

[0015] In addition, a skin disease management method using a portable terminal according to another embodiment of the present invention for solving the above-mentioned problems is a skin disease management method using a portable terminal performed by a management server, the method including: generating skin health management data corresponding to skin condition measurement information for a skin disease of a test subject received from a user terminal; sharing the skin health management data with a service linking terminal; transmitting recommendation information generated corresponding to the skin health management data based on hospital information received from the service linking terminal to the user terminal; transmitting and receiving reservation management information between the user terminal and the service linking terminal; and generating medical treatment management data corresponding to the skin health result data by the service linking terminal, wherein the service linking terminal can periodically transmit notification information for the test subject to the user terminal.

[0016] In addition, a skin disease measurement system using a portable terminal according to another embodiment of the present invention for solving the above-mentioned problems includes a user terminal that generates skin condition measurement information including actual skin image information for skin diseases obtained from a test subject; and a health management server that learns skin health standard data generated by matching basic skin condition information with basic skin result data, analyzes the skin condition measurement information, and generates skin health result data by quantifying the severity of the skin disease of the test subject, and the health management server can generate the skin health result data by analyzing a characteristic distribution map for at least one skin disease selected from erythema, abrasion, and lichenification using analysis images by area extracted from the actual skin image information.

[0017] In one embodiment of the present invention, a service linking terminal for sharing medical management data generated in response to the skin health result data may be included.

[0018] In one embodiment of the present invention, the system may further include an administrator terminal that receives the skin condition measurement information from the user terminal and, when receiving the skin health standard data from the health management server, repeatedly learns the skin health standard data to generate the skin health result data corresponding to the skin condition measurement information.

[0019] A program according to one embodiment of the present invention is stored in a computer-readable recording medium so as to be combined with a computer, which is hardware, and to perform a method for measuring skin disease using a portable terminal and a method for managing skin disease using a portable terminal.

[0020] Further details of the invention are contained in the detailed description and the drawings. Effect of the Invention

[0021] According to the present invention, when an abnormality occurs in the skin of a subject to be examined, particularly a companion animal, the current condition of the companion animal can be quickly and accurately determined using a portable terminal, thereby providing a sense of confidence to the guardian of the companion animal.

[0022] According to the present invention, the current condition of a companion animal can be accurately diagnosed in real time using a portable terminal, thereby improving the convenience and reliability of the user.

[0023] According to the present invention, by receiving hospital information regarding the current condition of a companion animal, the companion animal's illness can be treated early at a hospital that can treat the illness, thereby protecting the health of the companion animal.

[0024] According to the present invention, notification information about companion animals is continuously provided to the guardians, thereby encouraging them to return to the veterinary clinic and preventing them from abandoning the clinic. According to the present invention, the result data of companion animals is shared with the linking service, so that the condition of companion animals can be more accurately understood and dealt with, thereby giving the guardians of companion animals a sense of trust.

[0025] The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description. [Brief description of the drawings]

[0026] [Figure 1] 1 is a conceptual diagram illustrating a skin disease measuring system using a portable terminal according to an embodiment of the present invention. [Diagram 2] 2 is a diagram illustrating a detailed configuration of a skin disease measuring system using the portable terminal illustrated in FIG. 1; [Diagram 3] 4 is a diagram illustrating basic skin result data for basic skin photograph information according to an embodiment of the present invention. [Figure 4] 1 is a diagram for analyzing a smear of erythema included in an image according to an embodiment of the present invention. [Diagram 5] 1 is a diagram illustrating a distribution map of abrasions included in an image according to an embodiment of the present invention; [Figure 6]1 is a diagram illustrating a distribution map of lichenification included in an image according to an embodiment of the present invention. [Figure 7] 1 is a diagram illustrating a method for measuring a skin disease using a portable terminal according to an embodiment of the present invention. [Figure 8] 8 is a detailed diagram for explaining a method for generating skin health standard data shown in FIG. 7. [Figure 9] 8 is a diagram for explaining the skin health result data shown in FIG. 7. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] The advantages and features of the present invention, and the methods for achieving them, will become clear from the following detailed description of the embodiments in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, and may be embodied in various different forms, but the embodiments are provided to complete the disclosure of the present invention and to fully inform those skilled in the art of the present invention of the scope of the present invention, and the present invention is defined only by the scope of the claims.

[0028] The terms used in the present specification are for the purpose of describing the embodiments and are not intended to limit the present invention. In the present specification, the singular includes the plural unless otherwise specified in the text. The terms "comprises" and / or "comprising" used in the specification do not exclude the presence or addition of one or more other elements in addition to the elements mentioned. The same reference numerals refer to the same elements throughout the specification, and "and / or" includes each and every combination of one or more of the elements mentioned. Although "first", "second", etc. are used to describe various elements, it is understood that these elements are not limited by these terms. These terms are used merely to distinguish one element from another element. Therefore, it is understood that the first element mentioned below may be the second element within the technical concept of the present invention.

[0029] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in the sense commonly understood by a person of ordinary skill in the art to which the present invention belongs. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless specifically and explicitly defined.

[0030] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0031] FIG. 1 is a conceptual diagram for explaining a skin disease measurement system using a portable terminal according to one embodiment of the present invention, FIG. 2 is a diagram for explaining a detailed configuration of the skin disease measurement system using the portable terminal shown in FIG. 1, FIG. 3 is a diagram for explaining basic skin result data for basic skin photography information according to one embodiment of the present invention, FIG. 4 is a diagram for analyzing the application of erythema included in an image according to one embodiment of the present invention, FIG. 5 is a diagram for explaining a distribution map of abrasions included in an image according to one embodiment of the present invention, and FIG. 6 is a diagram for explaining a distribution map of lichenification included in an image according to one embodiment of the present invention.

[0032] 1 and 2, a skin disease measuring system 1000 using a portable terminal according to an embodiment of the present invention may include a user terminal 10, a health management server 20, a service link terminal 30, and an administrator terminal 40. In this case, the administrator terminal 40 may be omitted.

[0033] Here, the user terminal 10, the health management server 20, the service link terminal 30 and the manager terminal 40 can transmit and receive data in real time in synchronization using a wireless communication network. The wireless communication network may support various long distance communication methods, such as Wireless LAN (WLAN), Digital Living Network Alliance (DLNA), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (EV-DO), Wideband CDMA (WCDMA), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTEA), Wireless Mobile Broadband Service (WMBS), Bluetooth Low Energy (BLE), and other standards. Various communication methods such as, but not limited to, IEEE 802.11b (IEEE 802.11b), ...

[0034] First, in this embodiment, the skin disease measuring system 1000 using a portable terminal is disclosed as a system for photographing the skin of companion animals, particularly puppies, to determine the severity of skin disease, but is not limited thereto. For example, it is possible to measure skin diseases of various animals including vertebrates such as mammals, birds, reptiles, amphibians, and fish, and invertebrates such as arthropods and mollusks living with a guardian, companion, or dog owner (hereinafter referred to as guardian), as well as human skin diseases.

[0035] The user terminal 10 is a portable terminal carried by the guardian of the companion animal 1 and can operate using an application program (or application) in the present disclosure, and such application program can be downloaded from an external server or a health management server 20 via wireless communication. For example, the user terminal 10 can include various terminals such as a smart phone, a PDA (Personal Digital Assistant), a tablet, a wearable device (including, for example, a smartwatch, a smart glass, a head mounted display (HMD), etc.), and various Internet of Things (IoT) terminals, but is not limited thereto.

[0036] The user terminal 10 may include a photographing unit 100, a transceiver unit 110, a memory unit 120, a display unit 130, and a terminal control unit 140, as shown in FIG.

[0037] The photographing unit 100 can obtain actual skin photographing information by recognizing and photographing the skin of the companion animal 1 using a camera (not shown) provided in the user terminal 10. Here, the actual skin photographing information can include photographing information on the condition that requires management of the companion animal 1. For example, the actual skin photographing information can include, but is not limited to, photos or videos photographing the skin condition of the companion animal 1.

[0038] According to the embodiment, the photographing unit 100 can select a skin part of the companion animal 1 to be diagnosed and obtain actual skin photographing information for the selected part of the skin.

[0039] The transceiver 110 can transmit skin condition measurement information to the health management server 20 and receive skin health management data generated based on the skin health standard data from the health management server 20. At this time, the skin health standard data can be updated in real time according to the skin health result data.

[0040] Here, the skin condition measurement information may include photos and videos whose brightness, clarity, etc. are automatically adjusted in consideration of the surrounding environment, shaking, etc. based on the actual skin photographing information.

[0041] In addition, the skin health standard data may be data generated by matching the basic skin condition information of the companion animal 1 with the basic skin result data.

[0042] The basic skin condition information may include basic information and basic skin photography information. The basic information may include guardian information, abandonment information, hospital record information, unique identification number, breed, sex, age, weight, whether neutered, etc., the guardian information may include contact information, etc., and the hospital record information may include vaccination information, medical information, whether allergies are present, etc. In this case, depending on the embodiment, the hospital record information may include beauty information.

[0043] The basic skin result data corresponds to basic skin condition information, and may be data obtained by extracting images included in the basic skin photograph information, and converting the images into numerical values ​​to evaluate the severity of skin diseases. In this case, skin diseases may be classified into erythema, abrasion, and lichenification according to the diagnosis site, and the severity of skin diseases may be classified into 4 grades (grade 0 to grade 3), but is not limited thereto.

[0044] The health result data may be result data in which the severity of a skin disease of the companion animal 1 is quantified using skin condition measurement information based on the skin health standard data.

[0045] According to an embodiment, the transceiver 110 can receive skin health standard data from the health management server 20 and transmit skin health result data to the health management server 20 .

[0046] According to an embodiment, when the transceiver 110 transmits skin condition measurement information from the user terminal 10 to the health management server 20 , the transceiver 110 can receive skin health result data from the health management server 20 .

[0047] The transceiver 110 can transmit and receive medical care management data. Here, the medical care management data can include, but is not limited to, recommendation information that can be recommended based on the current state or disease state of the companion animal 1, reservation management information, veterinary clinic link information, and clinic record information.

[0048] The memory unit 120 can store data transmitted and received through the transceiver unit 110 and data supporting various functions of the user terminal 10 .

[0049] The memory unit 120 can store a number of application programs (or applications) operated by the user terminal 10, and data and commands for the operation of the user terminal 10. At least some of these application programs can be downloaded from an external server through wireless communication.

[0050] The display unit 130 is a means for visually and audibly displaying the current operating status of the user terminal 10, and may include a display that can output symbols, letters, numbers, etc. on a screen depending on the operating status, a lamp that outputs by changing colors or blinking, or a speaker that outputs audio.

[0051] For example, when skin health result data corresponding to the skin condition measurement information is output after the skin disease measurement of the companion animal 1 is completed, the display unit 130 may display the presence or absence of a skin disease as O / X, flash the screen in red or green, display a guide message such as "normal" or "we recommend you go to the hospital", or display dictionary information about the skin disease. At this time, the display unit 130 may provide a voice guide message to allow the guardian to accurately check the results of the skin disease of the companion animal 1.

[0052] In addition, when outputting medical treatment management data, hospital information such as the location, contact information, and available reservation dates of the hospital corresponding to the recommendation information generated based on the veterinary hospital link information can be displayed along with a road view, map, or calendar, hospital record information including medical treatment details and preventive information can be displayed, and reservation management information including a reservation completion signal received in response to a reservation request signal from the user terminal device 10 can be displayed on the screen.

[0053] The terminal control unit 140 can operate the photographing unit 100 according to a manual operation of the parent or guardian to generate skin condition measurement information, and can receive and output skin health result data for the skin condition measurement information.

[0054] Specifically, the terminal control unit 140 can automatically correct actual skin photographing information acquired by photographing the skin of the companion animal 1 to generate skin condition measurement information. At this time, the skin condition measurement information can include actual basic information and actual skin photographing information. Here, the actual basic information includes guardian information, hospital record information, unique identification number, breed, sex, age, weight, whether or not the dog has been neutered, etc., the guardian information includes contact information, etc., and the hospital record information can include vaccination information, medical information, whether or not the dog has allergies, etc. At this time, depending on the embodiment, the hospital record information can include beauty information.

[0055] The real skin photograph information may include photos and videos generated by automatically adjusting brightness and clarity from the real skin photograph information in consideration of the surrounding environment, shaking, etc. Here, the photos may be at least one and the videos may be at least 10 seconds long, but are not limited thereto.

[0056] In other words, the terminal control unit 140 can receive skin health result data on skin condition measurement information regardless of time and place using the portable user terminal 10, and accurately determine the type of skin disease of the companion animal 1. Accordingly, the skin disease of the companion animal 1 can be treated in an early stage to protect the health of the companion animal 1, thereby respecting the diversity of guardians and increasing convenience and reliability.

[0057] According to an embodiment, when the terminal controller 140 receives the skin health standard data from the health management server 20, the terminal controller 140 can compare and analyze the skin condition measurement information based on the skin health standard data to generate skin health result data.

[0058] In addition, the terminal control unit 140 can transmit and receive medical management data corresponding to the current or disease state of the companion animal 1 based on the skin health result data.

[0059] Specifically, the terminal control unit 140 generates a reservation request signal including a request for selecting a hospital and making a reservation at the hospital according to recommendation information recommended based on the skin health result data based on the veterinary hospital linkage information, and transmits the signal to the health management server 20 or the service linkage terminal 30, and receives a reservation completion signal corresponding to the reservation request signal from the health management server 20 or the service linkage terminal 30. In addition, the terminal control unit 140 can receive hospital record information of the companion animal 1 from the health management server 20 or the service linkage terminal 30.

[0060] The health management server 20 may include a communication unit 200 , a database unit 210 , a monitoring unit 220 , a disease data management unit 230 , a medical data management unit 240 , and a management control unit 250 .

[0061] When the communication unit 200 receives the skin condition measurement information from the user terminal 10 , the communication unit 200 can transmit skin health result data to the user terminal 10 .

[0062] According to an embodiment, when the communication unit 200 transmits the skin health standard data to the user terminal 10, the communication unit 200 may receive the skin health result data from the user terminal 10.

[0063] In addition, the communication unit 200 can transmit and receive skin medical care management data between the user terminal 10 and the health management server 20 .

[0064] According to an embodiment, the communication unit 200 can transmit and receive medical management data between the user terminal 10 and the service link terminal 30 .

[0065] The database unit 210 can store data transmitted and received to and from the user terminal 10 and the service linking terminal 30 through a wireless communication network. At this time, the skin health standard data can be updated in real time corresponding to the skin health result data and stored.

[0066] The database unit 210 can store data supporting various functions of the health management server 20. The database unit 210 can store a number of application programs (or applications) operated by the health management server 20, and data and commands for the operation of the health management server 20. At least some of these application programs can be downloaded from an external server via wireless communication.

[0067] Meanwhile, the basic skin condition information, skin condition measurement information, skin health result data, and skin health standard data used in this embodiment stored in the database unit 210 may be embodied in the form of a corresponding mapping table, but is not limited thereto.

[0068] The monitoring unit 220 can monitor the operating state of the user terminal 10, the operating state of the health management server 20, and data transmitted and received between the user terminal 10 and the health management server 20 through a screen. That is, by checking the usage state of the user terminal 10 in real time, it is possible to make parental use more convenient and to give parental confidence.

[0069] The disease data management unit 230 can generate basic skin result data by acquiring basic skin condition information from a plurality of companion animals 1 and analyzing the acquired basic skin condition information. At this time, the basic skin condition information can be information acquired from puppies in separate facilities such as abandoned dog centers and shelters, but is not limited thereto.

[0070] The basic skin condition information may include basic information for a plurality of companion animals 1 and basic skin imaging information for various skin sites of the companion animal 1 based on the basic information. In this case, the basic skin imaging information may include photos or videos.

[0071] The basic skin imaging information may include actual skin imaging information for various skin sites of the companion animal 1 such as the face, head, abdomen, legs, chest, and back.

[0072] The disease data management unit 230 can extract images from basic skin imaging information based on CADESI (canine atopic dermatitis extent and severity index), analyze a characteristic distribution map from the extracted images, and evaluate the severity of the skin disease by quantifying it, but is not limited to this.

[0073] For example, the disease data management unit 230 sets diagnostic areas from basic skin imaging information in which various areas such as ears, abdomen, and feet are photographed, extracts images for each set diagnostic area, analyzes and calculates a characteristic distribution map from the extracted analysis images for each area using an MRC (Multiple-Residual Concatenation) algorithm, compares and analyzes the calculated characteristic distribution map with the CADESI symptom index, quantifies the severity of atopic dermatitis, and evaluates it into four grades, thereby generating basic skin result data for the basic skin imaging information as shown in FIG. 3.

[0074] In this case, the characteristic distribution map can be calculated by judging the distribution map for erythema, abrasion, and lichenification and converting the severity into a numerical value.

[0075] For example, referring to FIG. 4, the severity of erythema can be evaluated using a distribution map of average R(red) calculated from the analysis image for each region, referring to FIG. 5, the severity of abrasions can be evaluated using a distribution map of the area of ​​the wound site versus the total area calculated from the analysis image for each region, and referring to FIG. 6, the severity of lichenification can be calculated using a distribution map of the number of wrinkles and white spots calculated from the analysis image for each region.

[0076] In other words, the disease data management unit 230 can compare and analyze the degree of progression of erythema, abrasions, and lichenification for imaging information of the ears, abdomen, feet, etc. with the CADESI symptom index to evaluate the severity of atopic dermatitis by quantifying it, and generate basic skin result data for the basic skin imaging information.

[0077] Meanwhile, when the basal skin image information is a photograph, the disease data management unit 230 can generate basal skin result data for the basal skin image information using one photograph. In contrast, when the basal skin image information is a video, the disease data management unit 230 can generate basal skin result data for the basal skin image information by determining normal images from the video through a filtering step and extracting at least 10 images. In this case, the filtering can be performed using a Laplacian filter to obtain normal images, but is not limited thereto.

[0078] The medical data management unit 240 can manage medical management data transmitted between the user terminal 10 and the service link terminal 30 based on the skin health result data. Here, the medical management data can include recommendation information that can be recommended depending on the current state or disease state of the companion animal 1, reservation management information, veterinary clinic link information, and clinic record information.

[0079] For example, when medical treatment is required based on the actual diagnosis data, the medical data management unit 240 can provide the user terminal 10 with the main information generated based on the hospital information. In this case, the recommendation information can be information recommending the hospital information corresponding to the skin health result data using the veterinary clinic link information generated based on the hospital information provided from the service link terminal 30.

[0080] In addition, the medical data management unit 240 can transmit and receive reservation management information between the user terminal 10 and the service link terminal 30 .

[0081] For example, the medical data management unit 240 can transmit a reservation request signal received from the user terminal 10 to the service linking terminal 30, and can transmit a reservation completion signal generated in response to the reservation request signal from the service linking terminal 30 to the user terminal 10.

[0082] In addition, the medical data management unit 240 can transmit the hospital record information from the user terminal 10. At this time, the medical data management unit 240 can receive the hospital record information from the service link terminal 30.

[0083] For example, after the medical treatment of the companion animal 1 is completed, the medical data management unit 240 may transmit hospital record information including medical treatment details information to the user terminal 10, and in general, may transmit hospital record information including preventive information or cosmetic information to the user terminal 10. In addition, the medical data management unit 240 may transmit notification information regarding the companion animal 1 to the user terminal 10. At this time, the notification information is information generated by the service link terminal 30, and may be, but is not limited to, notification information regarding the medical treatment or cosmetic treatment of the companion animal 1.

[0084] Depending on the embodiment, the medical data management unit 240 can share hospital record information with other servers.

[0085] The management control unit 250 can generate skin health standard data by matching the basic skin condition information with the basic skin result data using deep learning. Although the present embodiment is described as using deep learning, the present invention is not limited to this, and machine learning techniques such as Random Forest and Support Vector Machine can be used. At this time, the management control unit 250 can update the skin health standard data in real time in response to the skin health result data.

[0086] Specifically, the management control unit 250 can repeatedly learn the basic skin condition information and the basic skin result data based on a CNN (Convolutional Neural Network) algorithm, verify the suitability, and generate the skin health standard data. At this time, the process of verifying the skin health standard data can be cross-verified by veterinarians and researchers of a contracted research institution, for example, at least three specialists, but is not limited thereto.

[0087] In addition, when the management control unit 250 receives the skin condition measurement information from the user terminal 10, it can generate skin health result data based on the skin health standard data.

[0088] Specifically, the management and control unit 250 pre-processes the photos and / or videos included in the skin condition measurement information to extract actual analysis images for each set diagnosis area, analyzes and calculates actual characteristic distribution charts from the extracted actual analysis images for each area using the MRC algorithm, and compares and analyzes the calculated actual characteristic distribution chart with the skin health standard data to generate skin health result data in which the severity of skin diseases is quantified. At this time, skin diseases can be classified into erythema, abrasion, and lichenification for about 20 diagnosis areas, and the severity of skin diseases can be classified into 4 grades (grades 0 to 3), but is not limited thereto.

[0089] In other words, the management control unit 250 extracts an actual analysis image that can be analyzed by taking into account the surrounding environment, shaking, etc. from the photo or video included in the actual skin shooting information, automatically corrects the brightness, clarity, etc. of the extracted actual analysis image for each part to calculate an actual characteristic distribution map, and compares and analyzes the actual characteristic distribution map with the skin health standard data to generate skin health result data including the severity of the skin disease.

[0090] Meanwhile, when the real skin photograph information is a photograph, the management controller 250 can generate skin health result data corresponding to the skin condition measurement information based on the skin health standard data using one photograph. On the other hand, when the real skin photograph information is a video, the management controller 250 can determine normal images from the video through a filtering step, extract at least 10 images, and generate skin health result data corresponding to the skin condition measurement information based on the skin health standard data. In this case, the filtering can be performed by filtering the degree of shaking of images included in the video using a Laplace filter to obtain a normal image, but is not limited thereto.

[0091] According to an embodiment, when the management control unit 250 transmits the skin health standard data to the user terminal 10, the management control unit 250 can receive skin health result data corresponding to the skin condition measurement information of the companion animal 1.

[0092] According to an embodiment, the management control unit 250 can insert advertisement information into data transmitted and received from the user terminal 10, the service link terminal 30, and / or the administrator terminal 40. Accordingly, separate advertising revenue can be generated to support facilities such as abandoned dog centers and shelters.

[0093] The health management server 20 with this structure can automatically extract diagnosis areas from skin condition measurement information acquired through the user terminal 10 based on verified skin health standard data by repeatedly learning basic skin result data generated in response to basic skin condition information acquired from a plurality of companion animals 1, and generate skin health result data in which the severity of skin diseases is classified into four grades (grade 0 to grade 3) by comparing and analyzing the extracted actual analysis images for each area. This can solve problems such as unnecessary hospital visits and neglect that may occur when the condition of companion animals 1 is judged only by images with the naked eye.

[0094] In addition, the health management server 20 provides recommended information to the user terminal 10 according to the current state or disease state of the companion animal 1, thereby enabling the companion animal 1 to be managed quickly and accurately.

[0095] The health management server 20 may be implemented by hardware circuits (e.g., CMOS-based logic circuits), firmware, software, or a combination thereof. For example, the health management server 20 may be implemented using transistors, logic gates, and electronic circuits in the form of various electrical structures.

[0096] The service link terminal 30 may be a plurality of veterinary clinics that manage and treat the health of the companion animal 1, and may use the skin health result data to more quickly treat the companion animal 1.

[0097] The service link terminal 30 can share the hospital record information with the user terminal 10, the health management server 20 and a separate server.

[0098] The service linking terminal 30 can provide hospital information and notification information to the user terminal 10 and / or the health management server 20.

[0099] According to an embodiment, the service linking terminal 30 may include a separate facility such as a stray dog ​​center or a shelter.

[0100] The manager terminal 40 is a terminal owned by a separate manager, and can transmit and receive data in real time by synchronizing with the user terminal 10, the health management server 20, and the service link terminal 30 through a wireless communication network. At this time, the manager terminal 40 can transmit and receive data using an application program.

[0101] The administrator terminal 40 can learn the skin health standard data received from the health management server 20, and analyze the skin condition measurement information received from the user terminal 10 to generate skin health result data.

[0102] According to an embodiment, when the administrator terminal 40 receives skin condition measurement information from the user terminal 10, the administrator terminal 40 can compare and analyze the skin condition measurement information based on the skin health standard data to generate skin health result data.

[0103] According to the embodiment, when skin health result data is generated in the user terminal 10, the administrator terminal 40 can receive the skin health result data from the user terminal 10 and transmit it to the health management server 20. Also, when skin health result data is generated in the health management server 20, the administrator terminal 40 can receive the skin health result data from the health management server 20 and transmit it to the user terminal 10.

[0104] According to an embodiment, the manager terminal 40 can transmit and receive medical management data corresponding to the current or disease state of the companion animal 1 based on the skin health result data with at least one of the user terminal 10, the health management server 20, and the service link terminal 30.

[0105] The administrator terminal 40 may include various portable electronic communication devices that support communication with the user terminal 10, the health management server 20, and the service linking terminal 30. For example, as separate smart devices, various terminals such as a smart phone, a PDA (Personal Digital Assistant), a tablet, a wearable device (including a smartwatch, a smart glass, a HMD (Head Mounted Display), etc.) and various Internet of Things (IoT) terminals may be included, but are not limited thereto.

[0106] The operation of the skin disease measuring system using a portable terminal according to an embodiment of the present invention having the above-mentioned structure is as follows: Figure 7 is a diagram for explaining a skin disease measuring method using a portable terminal according to an embodiment of the present invention, Figure 8 is a detailed diagram for explaining a method for generating skin health standard data shown in Figure 7, and Figure 9 is a diagram for explaining skin health result data shown in Figure 7.

[0107] First, in the embodiment of the present invention, the method of extracting an image of the skin of a puppy among companion animals 1 and judging and quantifying the severity of atopy has been disclosed, but the present invention is not limited to this.

[0108] As shown in FIG. 7, the health management server 20 can generate skin health standard data (S10).

[0109] 8, the health management server 20 can acquire basic information from a plurality of companion animals 1 (S100). Here, the basic information can include, but is not limited to, guardian information, abandonment information, hospital record information, unique identification number, breed, sex, age, weight, neutered or not, etc.

[0110] For example, the disease data management unit 230 can input basic information of the companion animal 1 using a separate mobile terminal.

[0111] Next, the health management server 20 can take an image of the skin of the companion animal 1 based on the basic information (S110).

[0112] For example, the disease data management unit 230 can photograph the skin of the abdomen, ears, and legs of the companion animal 1 to obtain basic skin photographing information.

[0113] In this embodiment, the photographing regions are set to the abdomen, ears, and legs among the body parts of the companion animal 1, but the photographing regions are not limited to these, and various other regions such as the face, chest, back, and tail can be selected.

[0114] Next, the health management server 20 can generate basic skin condition information using the basic information and the basic skin image information (S120). At this time, the basic skin image information can include at least one photo and at least 10 seconds of video.

[0115] Next, the health management server 20 can extract and correct an analysis image that can be analyzed by region from the basic skin photograph information (S130).

[0116] Specifically, when the photographed information included in the basic skin photographing information is a photograph, the health management server 20 can verify whether the photograph is an analyzable image.

[0117] For example, the disease data management unit 230 may extract an analysis image that can be analyzed by region, taking into account the surrounding environment, vibration, etc. At this time, the extracted analysis image by region may be corrected.

[0118] In addition, if the photographing information included in the basic skin photographing information is a moving image, the health management server 20 can extract a normal image by filtering the degree of shaking of the image included in the moving image. For example, the disease data management unit 230 can determine a normal image from the moving image through a filtering step using a Laplace filter and extract at least 10 images.

[0119] Next, the health management server 20 can calculate a characteristic distribution map for the analysis image for each part (S140).

[0120] For example, the disease data management unit 230 can digitize and calculate characteristic distribution maps for erythema, abrasions, and lichenification from the analysis images for each part using the MRC algorithm.

[0121] Next, the health management server 20 can compare and analyze the degree of progression of erythema, abrasions, and lichenification with the CADESI symptom index to generate basic skin result data corresponding to the basic skin condition information (S150).

[0122] Next, the health management server 20 matches the basic skin condition information with the basic skin result data (S160), and can verify compatibility and generate skin health standard data by iteratively learning based on a Convolutional Neural Network (CNN) algorithm (S170, S180).

[0123] Next, when the caregiver requests a diagnosis of the current condition or disease state of the companion animal 1, the user terminal 10 can obtain actual skin photograph information of the body part of the companion animal 1 (S12).

[0124] In this embodiment, the actual skin photographing information of the ears, abdomen, and legs of the companion animal 1 is acquired, but the present invention is not limited thereto.

[0125] Next, the user terminal 10 can input real basic information and generate skin condition measurement information using the real basic information and the real skin photograph information (S14).

[0126] Next, the health management server 20 can generate skin health result data corresponding to the skin condition measurement information based on the skin health standard data (S16).

[0127] Specifically, the management control unit 250 pre-processes the photos and / or videos included in the skin condition measurement information to extract actual analysis images for each area, analyzes and calculates a characteristic distribution map for the actual analysis images using the MRC algorithm, and compares and analyzes the same with the skin health standard data to generate skin health result data that quantifies the severity of atopic dermatitis (see FIG. 9).

[0128] Next, the user terminal 10 can receive skin health result data corresponding to the skin condition measurement information from the health management server 20 (S18).

[0129] Next, the service linking terminal 30 can provide hospital information based on the skin health standard data (S20).

[0130] Here, the step of providing the hospital information may be performed previously.

[0131] Next, the health management server 20 can generate veterinary clinic linkage information based on the hospital information (S22).

[0132] Here, the step of generating veterinary clinic linkage information may be performed previously.

[0133] Next, the health management server 20 can generate recommendation information corresponding to the skin health result data based on the veterinary clinic link information and transmit the recommendation information to the user terminal 10 (S24).

[0134] Next, the health management server 20 can generate reservation management information (S26).

[0135] For example, the health management server 20 can receive a reservation request signal generated based on custom-made information from the user terminal 10, and can receive reservation management information corresponding to the reservation request signal from the service link terminal 30 and transmit it to the user terminal 10.

[0136] Next, the service link terminal 30 can generate and share hospital record information including details of medical treatment for the companion animal 1 (S28).

[0137] At this time, the hospital record information can be transmitted to the user terminal 10 and the health management server 20 .

[0138] Finally, the health management server 20 can update the skin health standard data in real time in response to the skin health result data (S30).

[0139] The steps of a method or algorithm described in connection with the embodiments of the present invention may be embodied directly in hardware, or as a software module executed by hardware, or a combination thereof. The software module may reside in a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), a Flash Memory, a hard disk, a removable disk, a CD-ROM, or any other form of computer readable recording medium commonly known in the art to which the present invention pertains.

[0140] Although the embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art to which the present invention pertains will understand that the present invention can be embodied in other specific forms without changing the technical spirit or essential features of the present invention. Therefore, the embodiments described above should be understood to be illustrative in all respects and not restrictive.

Claims

1. A method for measuring a skin disease using a portable terminal performed by a management server, The first step is to generate skin health standard data by performing machine learning using existing baseline skin condition information and baseline skin outcome data; A second step of receiving skin condition measurement information for a skin disease of the subject from a user terminal; and A third step of comparing and analyzing the skin condition measurement information based on the skin health standard data to generate skin health result data. It is composed of The first stage comprises: A first step of pre-processing an image included in the basic skin photograph information included in the basic skin condition information; A first and second step of selecting a plurality of images corresponding to specific regions from the plurality of preprocessed images and outputting the images as region-specific analysis images; Steps 1-3 of generating a characteristic distribution map by quantifying the severity of each disease of erythema, abrasion, and lichenification from the site-specific analysis image using a predetermined algorithm; and and (1) to (4) steps of quantifying and evaluating the severity of the skin disease of the test subject using the characteristic distribution map; The third stage is A 3-1 step of extracting and correcting an actual analysis image for each part from the actual skin photograph information included in the skin condition measurement information; A third-2 step of analyzing a characteristic distribution map from the actual analysis image of each part; and a 3-3 step of generating skin health result data by comparing and analyzing the characteristic distribution map and the skin health standard data to evaluate the severity of the skin disease of the test subject by quantifying the severity of the skin disease of the test subject; The first to fourth stages are assessing the severity of the erythema using a distribution map of average R(red) calculated from the analyzed images for each area; assessing the severity of the abrasion using a distribution map of the area of ​​the abrasion relative to the total area calculated from the analysis image of each part; Evaluating the severity of the lichenification numerically using the distribution of the number of wrinkles and white spots calculated from the analysis images for each area; The stage consists of: A method for measuring skin diseases using a portable terminal.

2. The first step of generating the skin health standard data comprises: The method of claim 1 , further comprising repeatedly learning and verifying the basic skin result data corresponding to the basic skin condition information.

3. 2. The method of claim 1, further comprising transmitting and receiving medical management data generated in response to the skin health result data to and from the user terminal.

4. 4. The method of claim 3, further comprising transmitting and receiving the medical management data between the user terminal and a service linking terminal.

5. The method of claim 1 , further comprising updating the skin health standard data in real time in response to the skin health result data.

6. A user terminal for generating skin condition measurement information including actual skin photograph information for skin diseases obtained from a test subject; and a health management server for learning skin health standard data generated by matching basic skin condition information with basic skin result data, analyzing the skin condition measurement information, and generating skin health result data by quantifying the severity of a skin disease of the test subject; The health management server performs the following processes: A first step of generating the skin health standard data by performing machine learning using the baseline skin condition information and the baseline skin result data; A second step of receiving the skin condition measurement information for the skin disease of the test subject from a user terminal; and A third step of comparing and analyzing the skin condition measurement information based on the skin health standard data to generate skin health result data. Run The first stage comprises: A first step of pre-processing an image included in the basic skin photograph information included in the basic skin condition information; A first and second step of selecting a plurality of images corresponding to specific regions from the plurality of preprocessed images and outputting the images as region-specific analysis images; Steps 1-3 of generating a characteristic distribution map by quantifying the severity of each disease of erythema, abrasion, and lichenification from the site-specific analysis image using a predetermined algorithm; and and (1) to (4) steps of quantifying and evaluating the severity of the skin disease of the test subject using the characteristic distribution map; The third stage is A 3-1 step of extracting and correcting an actual analysis image for each part from the actual skin photograph information included in the skin condition measurement information; A third-2 step of analyzing a characteristic distribution map from the actual analysis image of each part; and a 3-3 step of generating skin health result data by comparing and analyzing the characteristic distribution map and the skin health standard data to evaluate the severity of the skin disease of the test subject by quantifying the severity of the skin disease of the test subject; The first to fourth stages are assessing the severity of the erythema using a distribution map of average R(red) calculated from the analyzed images for each area; assessing the severity of the abrasion using a distribution map of the area of ​​the abrasion relative to the total area calculated from the analysis image of each part; Evaluating the severity of the lichenification numerically using the distribution of the number of wrinkles and white spots calculated from the analysis images for each area; The stage consists of: A skin disease measurement system using a portable terminal.

7. The system for measuring skin disease using a portable terminal according to claim 6, further comprising a service linking terminal for sharing medical management data generated in response to the skin health result data.

8. 8. The skin disease measurement system according to claim 7, further comprising: an administrator terminal that receives the skin condition measurement information from the user terminal, and when receiving the skin health standard data from the health management server, repeatedly learns the skin health standard data to generate the skin health result data corresponding to the skin condition measurement information.

9. A computer program stored on a computer-readable recording medium so as to be combined with a computer that is hardware and capable of carrying out the method according to claim 1.

Citation Information

Patent Citations

  • Method and system for leucoderma state diagnoses and therapeutic effect evaluation based on image processing

    CN107049263A

  • Method for measuring skin erythema

    JP2010227571A

  • Pet health check apparatus, pet health check method, and program

    JP2014223063A

  • Apparatus and method for determining skin inflammation levels

    JP2014512900A

  • Imaging apparatus, and control method and control program therefor

    JP2016076850A