Skin diagnosis system

A portable skin diagnosis system with a user terminal and detachable device captures diagnostic images in different modes to provide accurate and easy-to-use skin condition monitoring, addressing the limitations of existing methods.

JP2024541115AInactive Publication Date: 2024-11-06CHOWIS CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024547390
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-10-15
Publication Date
2024-11-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing skin diagnosis methods are not highly accurate and often depend on personal experience, and existing devices are expensive and primarily used in specialized settings, lacking portability and ease of use for continuous monitoring.

Method used

A portable skin diagnosis system comprising a user terminal with a camera and a detachable skin measuring device that includes lenses, light sources, and sensors, capable of capturing diagnostic images in different modes and calculating diagnostic scores based on image analysis.

Benefits of technology

The system provides accurate, portable, and user-friendly skin condition monitoring, enabling easy and continuous diagnosis without discomfort, suitable for personal use.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024541115000001_ABST
    Figure 2024541115000001_ABST
Patent Text Reader

Abstract

One embodiment of the present invention includes a user terminal including a camera and a dedicated application, and a skin measurement device detachable from the user terminal, the skin measurement device including a body part formed to be detachable from the user terminal, an optical part disposed on the body part and including one or more lenses, which focuses measurement light reflected from a target body onto the camera when the body part is attached to the user terminal, a light source module including a white light source part that emits white light and a UV light source part that emits UV light, and irradiates the white light or the UV light toward the target body, a communication part capable of communicating with the user terminal, and a power supply part that provides power, and the dedicated application can be automatically activated when communication is connected with the skin measurement device attached to the user terminal.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] An embodiment of the present invention relates to a skin diagnosis system. [Background technology]

[0002] In recent years, with the increase in life expectancy, health diagnosis and management have become one of the essential tasks.

[0003] As the body's surface element, the skin contains various metabolic products and components and can sometimes be an indicator of health. For example, a poor complexion can be a sign of blood circulation or digestive disorders. Another example is skin problems, which can be a sign of mental stress.

[0004] In the past, such skin condition diagnosis was generally performed by visual or tactile methods. Specifically, skin elasticity can be visually identified through an optical microscope, and skin water content can be identified by touch. However, such identification methods are not very accurate and often depend on the experience of the person making the identification.

[0005] Meanwhile, skin monitoring for diagnosing health conditions must be performed continuously. Accordingly, there is a demand for a skin condition diagnosis device and method that can perform monitoring and diagnosis more easily without causing discomfort to the person being diagnosed. Accordingly, there have been recent attempts to irradiate light onto the skin, photograph it, and analyze the light information to examine the skin condition. However, such diagnosis devices are mostly expensive, and are therefore mainly used in specialized places such as skin esthetics and dermatology hospitals.

[0006] Therefore, there is a demand for a device that can accurately monitor the skin and is easy to use. Summary of the Invention [Problem to be solved by the invention]

[0007] An object of an embodiment of the present invention is to provide a skin diagnostic system that is portable, easy to use, and capable of accurately monitoring skin conditions. [Means for solving the problem]

[0008] As a means for achieving the above-mentioned technical problem, one embodiment of the present invention includes a user terminal including a camera and a dedicated application, and a skin measurement device detachable from the user terminal, the skin measurement device including a body part formed to be detachable from the user terminal, an optical part disposed on the body part and including one or more lenses, which focuses measurement light reflected from a target body on the camera when the body part is attached to the user terminal, a light source module including a white light source part that emits white light and a UV light source part that emits UV light, and irradiates the white light or the UV light toward the target body, a communication part capable of communicating with the user terminal, and a power supply part that provides power, and the dedicated application can be automatically activated when communication is connected with the skin measurement device attached to the user terminal.

[0009] In one embodiment, the user terminal generates a photography event signal when a photography event is detected while the dedicated application is activated, and when the photography event signal is generated, the user terminal can control the camera and the light source module using the dedicated application to obtain a plurality of diagnostic images for diagnosing the skin of the subject.

[0010] In one embodiment, the user terminal can extract an analysis object from the plurality of diagnostic images while the dedicated application is activated, and calculate a diagnostic score for the analysis object of the object based on image information for the analysis object and basic information for the object.

[0011] In one embodiment, the diagnostic score of the analytes may be calculated using one or more of the individual scores of the analytes extracted from one or more images related to the subject, the number of the analytes, a distribution map of the analytes, and basic information related to the subject.

[0012] In one embodiment, the user terminal can acquire a facial image of a subject through the camera, identify an area corresponding to the eyes in the acquired facial image of the subject to determine whether the eyes are closed, and generate the photographing event signal if it is determined that the eyes are closed.

[0013] In one embodiment, the plurality of diagnostic images include a first mode image, a second mode image and a third mode image, and the user terminal can sequentially acquire the first mode image, the second mode image and the third mode image when the shooting event signal is generated.

[0014] In an embodiment, the first mode image, the second mode image, and the third mode image may be images captured in different modes among a UV mode, a polarized light mode, and a white light mode.

[0015] In one embodiment, the body parts, including first and second opposing bodies that are hinged to each other, can be attached to and detached from the user terminal in a clip-type manner.

[0016] In an embodiment, the skin measuring device may further include a sensor unit that senses moisture of the subject.

[0017] In one embodiment, the user terminal may be configured to generate a notification using at least one of a speaker, a display and a vibration device of the user terminal.

[0018] Other aspects, features and advantages in addition to those described above will become apparent from the following drawings, claims and detailed description of the invention. Effect of the Invention

[0019] The skin diagnostic system according to the embodiment of the present invention is portable, easy to use, and capable of accurately monitoring skin conditions. [Brief description of the drawings]

[0020] [Figure 1] 1 is a diagram illustrating a schematic diagram of a skin diagnosis system according to an embodiment of the present invention. [Figure 2A] 1 is a perspective view of a skin measurement device according to an embodiment of the present invention. [Figure 2B] 1 is a perspective view of a skin measurement device according to an embodiment of the present invention. [Diagram 3] FIG. 3 is a plan view of the skin measurement device in FIG. 2. [Figure 4] FIG. 3 is a front view of the skin measurement device in FIG. 2. [Figure 5A] FIG. 2 is a diagram showing a state in which a skin measurement device according to an embodiment of the present invention is attached to a user terminal. [Figure 5B] FIG. 2 is a diagram showing a state in which a skin measurement device according to an embodiment of the present invention is attached to a user terminal. [Figure 5C] FIG. 2 is a diagram showing a state in which a skin measurement device according to an embodiment of the present invention is attached to a user terminal. [Figure 6] FIG. 2 is a schematic block diagram of the user terminal of FIG. [Figure 7] 4 is a flowchart relating to the operation of the skin diagnosis system according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, the following embodiments will be described in detail with reference to the accompanying drawings. In the description with reference to the drawings, the same or corresponding components are given the same reference numerals, and duplicate descriptions thereof will be omitted.

[0022] Since the embodiments of the present invention can be modified in various ways, specific embodiments are illustrated in the drawings and described in detail in the detailed description. The effects and features of the embodiments of the present invention, as well as methods for achieving them, will become apparent by referring to the following detailed description in conjunction with the drawings. However, the embodiments of the present invention are not limited to the embodiments disclosed below, and can be realized in various forms.

[0023] In the following embodiments, the terms "first", "second", etc. are not used in a limiting sense but are used for the purpose of distinguishing one component from another component.

[0024] In the following embodiments, the singular expression includes the plural expression unless otherwise clearly indicated in the context.

[0025] In the following embodiments, terms such as "comprise" and "have" mean the presence of features or components described in the specification, and do not preclude the possibility that one or more other features or components may be added.

[0026] In the following embodiments, when a part such as a unit, region, or component is said to be on or above another part, this includes not only the case where it is directly on top of the other part, but also the case where there is another unit, region, component, etc. in between.

[0027] In the following embodiments, unless the context clearly indicates otherwise, terms such as "connect" and "couple" do not necessarily mean a direct and / or fixed connection or coupling between two members, and do not exclude the presence of other members between the two members.

[0028] It is intended to imply the presence of a feature or component described in the specification, without precluding the possibility that one or more other features or components may be added.

[0029] In the drawings, the size of components may be exaggerated or reduced for convenience of explanation. For example, the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of explanation, and the following embodiments are not necessarily limited to those shown in the drawings.

[0030] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will now be described in detail with reference to the accompanying drawings, in which: FIG.

[0031] FIG. 1 is a diagram illustrating a schematic diagram of a skin measurement system according to an embodiment of the present invention.

[0032] 1, a skin measurement system 1 according to an embodiment of the present invention may include a skin measurement device 10 and a user terminal 20. Although not shown, the skin measurement system 1 may further include a plurality of user terminals 20 and a server (not shown) connected to the plurality of user terminals 20 via a network.

[0033] Here, the server (not shown) may be a server that collects image information of the analysis target, basic information related to the target, and diagnostic information on the analysis target of the target based on the image information, acquired through each user terminal 20, processes the collected information, and provides it to the user terminal 20. Of course, there may be a plurality of servers (not shown) depending on the number of connections or the amount of data.

[0034] The skin measurement device 10 according to an embodiment of the present invention is formed in a form that can be attached to a user terminal 20 including a camera, and can measure the skin condition by operating while being connected to and communicating with the user terminal 20 in a worn state. The skin measurement device 10 will be described later.

[0035] The user terminal 20 may include a camera and may have a dedicated application for skin diagnosis installed. The user terminal refers to a communication terminal that can use web services in a wired or wireless communication environment. Here, the user terminal 20 may include a smartphone, a PDA (personal digital assistant), a PMP (portable multimedia player), a navigation system, a tablet PC, a kiosk, and the like.

[0036] The camera of the user terminal 20 may include a lens and an image sensor, and the image sensor may capture an image of an object within a capture area using, for example, a complementary metal-oxide semiconductor (CMOS) module or a charge coupled device (CCD) module.

[0037] The input image frame is provided to the CMOS module or CCD module through the camera lens, and the CMOS module or CCD module can convert the optical signal of the object passing through the lens into an electrical signal and output it.

[0038] The user terminal 20 may include a storage medium capable of storing data converted by the image sensor. Here, the storage medium may include a magnetic storage medium or a flash storage medium, but the scope of the present invention is not limited thereto. Such a storage medium may include an internal memory and / or an external memory, and may include a volatile memory such as a DRAM, SRAM, or SDRAM, a non-volatile memory such as an OTPROM (one time programmable ROM), a PROM, an EPROM, an EEPROM, a mask ROM, a flash ROM, a NAND flash memory, or a NOR flash memory, a flash drive such as an SSD, a compact flash (CF) card, an SD card, a Micro-SD card, a Mini-SD card, an Xd card, or a memory stick, or a storage device such as an HDD.

[0039] The network is a connection structure that enables information exchange between the skin measurement device 10 and the user terminal 20, and includes a short-range communication network (LAN: Local Area Network), a wide area communication network (WAN: Wide Area Network), the Internet (WWW: World Wide Web), a wired and wireless data communication network, a telephone network, a wired and wireless television communication network, etc.

[0040] Examples of wireless data communication networks may include 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, Bluetooth communication, infrared communication, ultrasonic communication, visible light communication (VLC), LiFi, etc.

[0041] Hereinafter, a skin measurement device according to an embodiment of the present invention will be described in more detail with reference to the drawings.

[0042] Fig. 2a is a perspective view of a skin measurement device 10 according to an embodiment of the present invention, and Fig. 2b is a diagram showing a state in which a lid 103 is separated from the skin measurement device 10 of Fig. 2a. Fig. 3 is a plan view of the skin measurement device 10 of Fig. 2, and Fig. 4 is a front view of the skin measurement device 10 of Fig. 2. And Figs. 5a to 5c are diagrams showing steps in which the skin measurement device 10 according to an embodiment of the present invention is attached to a user terminal 20.

[0043] 2 to 5, the skin measurement device 10 may include a body unit 100, an optical unit 110, a light source module 120, a switch unit 130, a sensor unit 140 and an illuminance sensor 150 installed in the body unit 100, as shown.

[0044] The body part 100 of the skin measurement device 10 according to an embodiment of the present invention forms the exterior of the skin measurement device 10 as a housing for the skin measurement device 10, and the skin measurement device 10 can be configured to be attachable to a user terminal.

[0045] The body part 100 may be divided into two main bodies 101 and 102, and a connecting part 100a may be formed at which the two main bodies 101 and 102 are connected.

[0046] To allow the skin measurement device 10 to be attached to a user terminal, the body part 100 may be provided with a grip part 100c that can be gripped by a user, and an attachment part 100b into which the user terminal is inserted.

[0047] The gripping parts 100c may be provided, for example, on the front and rear surfaces of the upper side of the body part 100, or on each of the two main bodies 101, 102.

[0048] The mounting portion 100b may be provided with buffer portions 1010, 1020.

[0049] The buffer parts 1010 and 1020 are made of a material such as silicon, and can improve the adhesion between the skin measurement device and the user terminal inserted into the wearing part 100b, and can prevent scratches on the surface of the user terminal when worn.

[0050] For example, the body part 100 formed of two bodies 101, 102 may have a mounting part 100b between the two bodies 101, 102, and each body 101, 102 may be provided with a buffer part 1010, 1020 made of silicone material, respectively.

[0051] The body portion 100 has an internal storage space for storing a PCB and a power supply unit.

[0052] The body unit 100 can provide a space in which the optical unit 110, the light source module 120, the switch unit 130 and the sensor unit 140 can be installed.

[0053] The skin measurement device 10 may include a circular lid 103 disposed on the front side. The lid 103 is disposed on the front side of the body unit 100 so as to be detachable from the body unit 100, and can protect the light source units 121 to 123 and the optical unit 110. The lid 103 may be made of a transparent material so that light irradiated from the light source units 121 to 123 and light reflected from the target body and flowing into the optical unit 110 can be transmitted through the lid 103. At least one through-hole 103a penetrating the lid 103 may be formed in a portion of the lid 103 corresponding to at least one of the optical unit and the light source units 121 to 123 so that light for the optical unit 110 or the light source units 121 to 123 can reach the target body directly without passing through the lid 103.

[0054] The optical unit 110 of the skin measurement device 10 according to an embodiment of the present invention is disposed in the body unit 100 and may include one or more lenses.

[0055] For example, the optical unit 110 can include a wide-angle lens and a close-up lens, and can include a fixing member to which these lenses can be fixed.

[0056] The optical unit 110 can magnify the surface image of the target object using a wide-angle lens and a close-up lens, and can be fixed to the body unit 100 to maintain a constant focal length. The target object can be a part of the body such as the user's face or arm, and preferably the user's skin.

[0057] When the skin measurement device 10 is attached to a user terminal, the optical unit 110 can be positioned to correspond to the camera. Preferably, when the body unit 100 is attached to the user terminal, the focus of the measurement light reflected from the target object can be adjusted to the camera of the user terminal. As a result, the measurement light reflected from the target object is transmitted to the camera of the user terminal through the lens of the optical unit 110, making it possible to obtain an image of the target object.

[0058] The light source module 120 of the skin measurement device according to the embodiment of the present invention can irradiate light and can be disposed adjacent to the optical unit 110.

[0059] The light source module 120 may include a plurality of light source units spaced apart at regular intervals and arranged to surround the optical unit 110, and in one embodiment, may include a first light source unit 121, a second light source unit 122, and a third light source unit 123.

[0060] The first light source unit 121 to the third light source unit 123 may each include a light source for emitting general light, UV light, and polarized light. For example, the first light source unit 121 to the third light source unit 123 may include a white light source for emitting white light, a UV light source for emitting UV light, and an LED light source of a specific wavelength band for emitting polarized light. The white light is light realized by a continuous spectrum over the entire visible light range, and the UV light may be light corresponding to a wavelength in the range of about 10 to 400 nm. Meanwhile, the third light source unit 123 for emitting polarized light may include a polarizing filter together with an LED light source.

[0061] As an embodiment, the first light source units 121 may be arranged at a predetermined distance from each other with the optical unit 110 at the center. Also, the second light source unit 122 and the third light source unit 133 may be arranged as one unit. For example, as shown in FIG. 4, one unit may be composed of one second light source unit 122 and two third light source units 123 arranged on both sides of the second light source unit 122.

[0062] The light source module 120 can control the operation of each of the light source units 121 to 123 or control the intensity of each light source for skin condition diagnosis.

[0063] For example, copropolypyrrin 3, one of the porphyrins produced in the skin by the bacteria that cause acne vulgaris (Propionibacterium acne; P. acne), has an absorption spectrum with a peak at 407 nm. When light in the blue light band (400-440 nm) is applied to the skin, the porphyrin strongly absorbs the energy of light in the blue wavelength band and fluoresces light in a unique wavelength band different from the absorbed wavelength. By analyzing such absorption spectra, the skin condition of the subject can be diagnosed.

[0064] The sensor unit 140 of the skin measuring device according to an embodiment of the present invention may include a predetermined sensor 141 so as to obtain more skin diagnostic information.

[0065] For example, the sensor unit 140 may include a moisture sensor 141 that detects the moisture level of the subject. The moisture sensor 141 may be a static sensor that contacts the skin surface and changes depending on the moisture distribution.

[0066] The change in capacitance can be measured via a precision capacitor. The sensor unit 140 can include an oil sensor (not shown) for detecting the oiliness of the subject and a pH sensor (not shown) for measuring the pH level. The sensor unit 140 can detect at least one of the skin condition, moisture level, oiliness level, and pH level of the subject and generate a measurement signal.

[0067] In order to prevent the sensor unit 140 from being damaged when the skin measurement device is held to attach it to a user terminal, the sensor unit 140 may be formed on one side of the body part 100 that is independent of the part where the skin measurement device is held. For example, the sensor unit 140 may be formed on the upper side of the body part 100.

[0068] The power supply unit of the skin measurement device according to an embodiment of the present invention may supply power to the sensor unit 140 and the light source unit 121, and the switch unit 130 may be configured to select the on / off state of the skin measurement device by connecting or disconnecting the power supply unit. The power supply unit may include a secondary battery such as a lithium ion battery.

[0069] The illuminance sensor 150 of the skin measurement device 10 according to an embodiment of the present invention may be formed on one side of the body part 100, preferably on the upper side of the body part 100. Since the skin measurement device 10 may be used in various environments, the illuminance sensor 150 may control the operation of each of the light source units 121-123 or control the intensity of each light source to respond to changes in illuminance according to the surrounding environment in order to prevent the consistency of analysis from decreasing depending on the environment. For example, when the illuminance of the environment in which the skin measurement device 10 is used is relatively high, the intensity of the light source may be reduced through each of the light source units 121-123, and when the illuminance of the environment in which the skin measurement device 10 is used is relatively low, the intensity of the light source may be increased through each of the light source units 121-123.

[0070] In addition, the illuminance information measured via the illuminance sensor 150 can be transferred to a user terminal via a network, and the illuminance of the environment in which the skin measurement device is used can be adjusted by utilizing a lighting device provided in the user terminal based on the transferred illuminance information.

[0071] 5a to 5c are diagrams showing a state in which a skin measurement device 10 according to an embodiment of the present invention is attached to a user terminal 20. With reference to these figures, the skin measurement device 10 according to an embodiment of the present invention can be detachably attached to the user terminal 20.

[0072] For example, the skin measurement device 10 can be attached to and detached from the user terminal 20 in a clip format.

[0073] At this time, the body part 100 may include a first body 101 and a second body 102. The first body 101 and the second body 102 may face each other and be hinged to each other at one side. The first body 101 and the second body 102 may rotate relatively around the hinged portion.

[0074] 5a, the first body 101 and the second body 102 may be hinged to each other at a connecting portion 100a. An elastic body may be provided at the connecting portion 100a so that the skin measurement device may maintain the same state as in FIG. 5a.

[0075] A gripping part 100c may be formed on one side of the connecting part 100a, and a mounting part 100b may be formed on the other side. The gripping part 100c is a part that is gripped by a user and applies force. The mounting part 100b is a part into which a user terminal is inserted and mounted.

[0076] 5b, when a force greater than the elastic force of the elastic body is applied in the direction F to the gripping part 100c, the gap between the first body 101 and the second body 102 at the mounting part 100b can be expanded by the principle of leverage with the connecting part 100a as a fulcrum. Due to the expanded gap, a part of the user terminal can be easily inserted into the mounting part 100b formed between the first body 101 and the second body 102.

[0077] Referring to FIG. 5c, when the force applied from the gripping portion 100c is removed, the elastic body provided in the connecting portion 100a causes the distance between the first body 101 and the second body 102 to return to the same state as in FIG. 5a, so that the user terminal can be attached and fixed to the attachment portion 100b.

[0078] In this case, the first buffer 1010 of the first body 101 may be supported in contact with one side of the user terminal 20, and the second buffer 1020 of the second body 102 may be supported in contact with the other side of the user terminal 20, respectively.

[0079] The switch section may be provided separately in the body section 100, or may be provided in at least one of the first buffer section 1010 and the second buffer section 1020.

[0080] The switch sections provided in the buffer sections 1010 and 1020 can be operated in response to a change in load applied by the user terminal.

[0081] For example, the switch unit provided in the buffer units 1010 and 1020 can recognize an increase in load applied to the buffer units 1010 and 1020 by the user terminal in the state shown in Fig. 5c, and can operate to turn the skin measurement device 10 to the on state. On the other hand, when there is no load applied to the buffer units 1010 and 1020 in the state shown in Fig. 5a, the switch unit can operate to turn the skin measurement device 10 to the off state.

[0082] FIG. 6 is a block diagram that illustrates the user terminal 20 of FIG.

[0083] Referring to FIG. 6, the user terminal 20 may include a dedicated application that can be linked with the skin measurement device 10.

[0084] The dedicated application can be configured to be automatically activated when the skin measurement device 10 is connected to a network while attached to a user terminal.

[0085] The skin measurement device 10 can transmit and receive data to and from the user terminal 20 via the communication unit.

[0086] As shown, the user terminal 20 may include a dedicated application 21, a transceiver unit 22 and a notification unit 23.

[0087] The dedicated application 21 can perform tasks such as acquiring an image including an object received from the camera of the user terminal 20 and extracting an analysis object from the image, and calculating a diagnostic score for the analysis object of the object based on image information for the analysis object and basic information related to the object.

[0088] Here, the analysis target may include diagnostic items indicating the skin condition of the subject, such as pores, wrinkles, pigmentation, skin flushing, sebum, keratin, skin sensitivity, blackheads, and the like.

[0089] In addition, the basic information related to the subject may include the subject's age, the subject's sex, the subject's race, the subject's previous condition information and / or diagnosis information, condition information and / or diagnosis information of other subject groups similar to the subject, an image of the subject, etc. The dedicated application 21 may obtain the basic information related to the subject through a medical interview or through a database stored in a server (not shown).

[0090] The transmitting / receiving unit 22 enables the user terminal 20 to connect to the skin measurement device 10 via a network, and can provide a communication interface required for providing transmitted and received signals between the user terminal 20 and the skin measurement device in the form of packet data.

[0091] The user terminal 20 can receive an on / off state signal of the skin measurement device 10 via the transceiver unit 22.

[0092] For example, when the switch unit connects the power supply unit and turns the skin measurement device on, or when the switch unit disconnects the power supply unit and turns the skin measurement device off, the user terminal 20 can receive a signal regarding the on / off state of the skin measurement device via the transceiver unit 22.

[0093] The dedicated application 21 may be configured to be automatically activated in the user terminal 20 under a predetermined condition in relation to a signal received by the transceiver 22. For example, when the skin measurement device is operating, the dedicated application 21 can be automatically activated by receiving a signal for an on state of the skin measurement device via the transceiver 22.

[0094] Also, the user can directly activate the dedicated application 21 using the UI provided on the user terminal 20 .

[0095] When a photographing event is detected while the dedicated application 21 is active, the user terminal 20 can generate a signal for the photographing event. The photographing event can be detected, for example, by recognizing a state in which the user's eyes are closed, the user's voice, or the pressing of a button formed on the user terminal.

[0096] The user terminal 20 may be configured to control the camera using a dedicated application 21 when a photography event signal is generated, and to automatically acquire multiple diagnostic images for diagnosing the subject's skin.

[0097] At this time, the user terminal 20 can transmit a signal for controlling the light source module to the skin measurement device 10 via the communication unit.

[0098] In response to a signal transmitted from the user terminal 20, the light source module 120 of the skin measurement device 10 can sequentially control the first light source unit 121, the second light source unit 122, and the third light source unit 123 to sequentially irradiate white light, UV light, and polarized light. However, this is merely an example, and it goes without saying that the order in which the light source module 120 irradiates may be changed.

[0099] According to one embodiment of the present invention, the dedicated application 21 may include an acquisition unit 211 , an identification unit 212 and a scoring unit 213 .

[0100] The acquisition unit 211 of the dedicated application 21 can acquire one or more diagnostic images related to the target object via the camera in response to a photographing event signal generated by the user terminal 20 .

[0101] Here, the diagnostic image related to the object may be a whole image of the object, a partial image of the object according to the photographing position in the object, a partial image of the object according to the photographing time order, etc. For example, it may be a whole image of a user's face, a partial image of a part of a user's face photographed by a photographing device, etc.

[0102] Alternatively, the diagnostic image may include a first mode image, a second mode image, and a third mode image sequentially captured by a camera, where the first mode image, the second mode image, and the third mode image may be images captured in different modes among a UV mode, a polarized light mode, and a white light mode, respectively.

[0103] Polarization mode images can be captured with a polarizing film placed over the optics, and the polarizing film can be configured to be automatically placed over the optics by a motor.

[0104] The identification unit 212 of the dedicated application 21 can identify an area corresponding to the user's eyes from an image of a target object recognized through the camera, and can determine whether the user's eyes are closed or not through the identified image.

[0105] When the user terminal 20, using the dedicated application 21, determines via the identification unit 212 that the user's eyes are closed, it generates a shooting event signal and can acquire multiple diagnostic images via the acquisition unit 211 for diagnosing the target body's skin.

[0106] As an embodiment, when a photographing event signal is generated using the dedicated application 21, the user terminal 20 can transfer a control signal for controlling the light source module 120 of the skin measurement device 10. The light source module 120 can control the first light source unit 121 to the third light source unit 123 so that white light, polarized light, and UV light are sequentially emitted at preset time intervals.

[0107] The scoring unit 213 of the dedicated application 21 can extract an analysis target from the acquired diagnostic image. Here, the analysis target can be a diagnostic item indicating the user's skin condition, such as pores, wrinkles, pigmentation, acne, etc.

[0108] For example, when the analysis target is a pore, the scoring unit 213 can generate image information of the pore including the pore area using a plurality of diagnostic images.

[0109] The image information of the analysis object may include size information of the analysis object, color information of the analysis object, depth information of the analysis object, etc. For example, if the analysis object is a pore, it may mean information indicating the size, color, depth of the pore, etc. The image information of the analysis object may include information on the number of analysis objects per unit area, distribution information of the analysis objects in the entire object, etc.

[0110] In addition, the scoring unit 213 may contact a moisture sensor to the skin surface to generate the condition information of the subject containing moisture, and may calculate the amount of moisture on the skin surface by measuring the change in capacitance that changes according to the moisture distribution through a precision capacitor. Then, new condition information of the subject may be generated by comparing the generated condition information of the subject with basic information about the subject. In this case, the basic information about the subject may include previous condition information of the subject and / or condition information of other subject groups similar to the subject. Thus, the scoring unit 213 may generate a change in the condition information of the subject as a result of comparing the current condition information of the subject with the previous condition information of the subject, and may generate a change in the condition information of the subject as a result of comparing the condition information of the subject with the condition information of other subject groups similar to the subject. Here, the new condition information of the subject and the change in the condition information of the subject may all be included in the condition information of the subject.

[0111] The scoring unit 213 may calculate a diagnostic score for the analysis target of the object based on image information for the analysis target and state information and basic information related to the object. The scoring unit 213 may calculate a diagnostic score for the analysis target by applying basic information related to image information for the analysis target to a preset analysis criterion. Here, the analysis criterion may be a different formula or algorithm depending on the analysis target.

[0112] The diagnostic score of the analysis object may be calculated using one or more of the individual scores of each analysis object extracted from the diagnostic image, the number of analysis objects, a distribution map of the analysis objects, and basic information related to the objects.

[0113] In one embodiment, when the analysis target is pores, the analysis criteria may include a score for a first pore P1 having a size equal to or larger than a certain size, a score for a second pore P2 having a size smaller than a certain size, a first weight for the first pore P1, a second weight for the second pore P2, a third weight for the total number of pores, and a fourth weight for the pore distribution, to calculate a diagnostic score. Here, the analysis criteria may further include a fifth weight for basic information related to the target in addition to the first to fourth weights.

[0114] The scoring unit 213 classifies the first pores P1 having a size equal to or larger than a preset size from the image information of the analysis target, and calculates a score for the first pores P1 using the depth information of the classified first pores P1, the average size of the first pores P1, the color information of the first pores P1, etc. Similarly, the scoring unit 213 can calculate a score for the second pores P2 using the depth information of the classified second pores P2, the average size of the second pores P2, the color information of the second pores P2, etc. The above description is merely an example of pores among the analysis targets, and when the analysis target is wrinkles, pigmentation, or acne, the diagnostic score can be calculated according to other analysis standards.

[0115] The diagnostic score can be expressed as a number from 1 to 99 or on a five-level scale.

[0116] On the other hand, the notification unit 23 of the user terminal 20 may be configured to generate a notification using at least one of a speaker, a display, and a vibration device of the user terminal 20.

[0117] For example, when the user terminal 20 determines through the identification unit 212 that the user's eyes are not closed, it can generate at least one of an auditory, tactile, and visual signal using a device provided in the user terminal 20.

[0118] FIG. 7 is a flowchart relating to the operation of the skin diagnosis system according to one embodiment of the present invention.

[0119] As shown, in step S710, the dedicated application may be activated. The dedicated application may be activated by receiving a signal related to an on state of the skin measuring device via the transceiver when the skin measuring device is in operation, or the user may directly activate the dedicated application using a UI provided on the user terminal.

[0120] In step S720, when the dedicated application is activated, a photography event signal may be generated. The photography event signal by the user terminal may be generated by, for example, recognizing that the user's eyes are closed, detecting the user's voice, or pressing a button formed on the user terminal.

[0121] In step S730, when the photography event signal is generated, a diagnostic image can be acquired, which can be at least one of a UV mode image, a polarization mode image, and a white light mode image for diagnosing the skin of the subject.

[0122] In step S740, once the diagnostic image is acquired, an analysis target can be extracted from the diagnostic image, where the analysis target may be a diagnostic item indicating the user's skin condition, such as pores, wrinkles, pigmentation, acne, etc.

[0123] In step S750, when the analysis objects are extracted, a diagnostic score for the analysis objects can be calculated. The diagnostic score for the analysis objects can be calculated using one or more of the individual scores of each analysis object extracted from the diagnostic image, the number of analysis objects, a distribution map of the analysis objects, and basic information related to the objects. The calculated diagnostic score can be displayed as a number from 1 to 99 or a 5-level scale on the display of the user terminal.

[0124] In the above description, steps S710 to S750 may be further divided into additional steps or combined into fewer steps according to an embodiment of the present invention, or some steps may be omitted or the order between steps may be changed as necessary.

[0125] Thus, the present invention has been described with reference to one embodiment shown in the drawings, but this is merely illustrative, and those skilled in the art will appreciate that various modifications and variations of the embodiment are possible. Therefore, the true technical scope of the present invention should be determined by the technical ideas of the appended claims.

Claims

1. A user terminal including a camera and a dedicated application; A skin measurement device is included which is detachable from the user terminal, The skin measurement device includes: a body portion formed so as to be detachable from the user terminal; an optical unit disposed in the body part, the optical unit including one or more lenses, for focusing measurement light reflected from a target object on the camera when the body part is attached to the user terminal; a light source module including a white light source unit that emits white light and a UV light source unit that emits UV light, the light source module irradiating the white light or the UV light toward the target object; A communication unit capable of communicating with the user terminal; A power supply unit for supplying power, the dedicated application is automatically activated when communication is established with the skin measurement device attached to the user terminal; Skin diagnostic system.

2. The skin diagnosis system of claim 1, wherein the user terminal generates a photography event signal when a photography event is detected while the dedicated application is activated, and when the photography event signal is generated, controls the camera and the light source module using the dedicated application to obtain a plurality of diagnostic images for diagnosing the skin of the subject.

3. 3. The skin diagnosis system of claim 2, wherein the user terminal extracts an analysis object from the plurality of diagnostic images while the dedicated application is activated, and calculates a diagnostic score for the analysis object of the object based on image information for the analysis object and basic information related to the object.

4. The diagnostic score of the analyte is The skin diagnosis system according to claim 3, wherein the calculation is performed using one or more of an individual score of each of the analysis objects extracted from one or more images related to the subject, the number of the analysis objects, a distribution map of the analysis objects, and basic information related to the subject.

5. 3. The skin diagnosis system of claim 2, wherein the user terminal acquires a facial image of a subject through the camera, identifies an area corresponding to an eye from the acquired facial image of the subject to determine whether the eyes are closed, and generates the photography event signal when it is determined that the eyes are closed.

6. the plurality of diagnostic images includes a first mode image, a second mode image, and a third mode image; The skin diagnosis system according to claim 2 , wherein the user terminal sequentially acquires the first mode image, the second mode image, and the third mode image when the photographing event signal is generated.

7. The skin diagnostic system of claim 6 , wherein the first mode image, the second mode image, and the third mode image are images captured in different modes among a UV mode, a polarized light mode, and a white light mode.

8. The body portion includes a first body and a second body that are hinged to each other and opposed to each other, and is attachable to and detachable from the user terminal in a clip manner. The skin diagnostic system according to claim 1.

9. The skin diagnostic system according to claim 1 , wherein the skin measurement device further includes a sensor unit that senses moisture of the subject.

10. The skin diagnosis system according to claim 1 , wherein the user terminal is configured to generate a notification using at least one of a speaker, a display, and a vibration device of the user terminal.

Citation Information

Patent Citations

  • Imaging operation terminal, imaging system, imaging operation method, and program

    JP2014175729A

  • Imaging system, imaging method, camera adapter, and program

    JP2019141321A

  • Systems and methods for skin analysis using electronic devices - Patent Application 20070122997

    JP2019518573A

  • Analyte sensor related notes and event log information

    JP2021511913A

  • Apparatus of measuring condition of skin using mobile device

    KR1020170138677A