Method for providing nail management solution

Abstract

The method for providing a nail management solution according to an embodiment of the present invention comprises the steps, performed by at least one computing device, of: receiving a nail image of a customer; deriving the nail state of the customer by processing the received nail image of the customer using a nail analysis model; and providing a management solution according to the derived nail state of the customer.

Description

Method of providing nail care solutions

[0001] The present invention relates to a method for providing a nail care solution.

[0002] As interest in beauty grows, so does interest in fingernails and toenails. Furthermore, due to lifestyles that place strain on the hands and feet, fingernail and toenail diseases are also on the rise.

[0003]

[0004] Despite the growing demand for nail care, nail services are primarily provided offline. Those seeking nail care or treatment visit specialized salons or hospitals or use various beauty equipment.

[0005]

[0006] Accordingly, the demand for services that provide convenient online solutions for nail care is increasing.

[0007] A method for providing a nail care solution according to an embodiment of the present invention is intended to facilitate nail care.

[0008] The subject matter of the present application is not limited to the subjects mentioned above, and other subjects not mentioned will be clearly understood by those skilled in the art from the description below.

[0009] According to one aspect of the present invention, a method for providing a nail care solution is provided, comprising: a step of transmitting an image of a customer's nail by one or more computing devices; a step of processing the received image of the customer's nail by a nail analysis model to derive a state of the customer's nail by the one or more computing devices; and a step of providing a management solution based on the derived state of the customer's nail by the one or more computing devices.

[0010] The one or more computing devices can machine learn a set of image data for each nail condition to create a nail analysis model according to a nail pattern for each nail condition.

[0011] The one or more computing devices can process the transmitted customer's fingernail image through a fingernail analysis model to derive the customer's fingernail pattern, and derive the customer's fingernail condition corresponding to the derived fingernail pattern.

[0012] The above nail pattern may be a pattern for at least one of the color, shape, form, and thickness of the nail.

[0013] The one or more computing devices may provide a chemical management solution and a physical management solution based on the derived nail condition of the customer, wherein the chemical management solution may include at least one of a moisturizer and a nutrient, a medicine and a cosmetic, and the physical management solution may include at least one of a drill, a curette, an artificial nail, a corrector and a surgical operation.

[0014] The one or more computing devices may store the customer's job information and provide the management solution that matches the customer's job information.

[0015] If the customer's occupation is a fisherman, cook, or construction worker, the one or more computing devices may provide the customer with a management solution that includes information about reducing the effects of moisture through the wearing of toe socks or toe spacers.

[0016] If the customer's occupation is an office worker, the one or more computing devices may provide a management solution that includes lifting information according to deformation of the shape of the toenail due to pressure or tightness of shoes or heels.

[0017] If the customer's occupation is a mother, the one or more computing devices may provide a management solution including information about functional socks to prevent ingrown toenails due to swelling.

[0018] The one or more computing devices may provide a customized lifestyle management solution for the customer by adding a questionnaire about the customer's lifestyle pattern based on the occupational information.

[0019] The one or more computing devices can receive an image of the customer's fingernails and toenails from the customer's mobile device, the customer's mobile device can display an optimal shooting frame required for capturing the image of the customer's fingernails and toenails, and the customer's mobile device can automatically set camera shooting conditions to suit shooting the fingernails and toenails.

[0020] The one or more computing devices can receive solution performance information of the customer according to the management solution from an electronic device to which the customer has logged in, and transmit feedback information on the solution performance information to the electronic device to which the customer has logged in.

[0021] A method for providing a nail care solution according to an embodiment of the present invention can conveniently manage nails by processing a customer's nail image through a nail analysis model.

[0022] The effects of the present application are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

[0023] FIG. 1 illustrates an example of the structure of a computing device that implements a method for providing a nail care solution according to an embodiment of the present invention.

[0024] Figure 2 shows an example of an image data set by fingernail condition.

[0025] Figures 3 to 6 are tables summarizing examples of management solutions for each nail condition.

[0026] Figure 7 shows an example of a fingernail image displayed on a customer's mobile device.

[0027] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. However, the attached drawings are provided solely to more easily disclose the contents of the present invention, and those skilled in the art will readily understand that the scope of the present invention is not limited to the scope of the attached drawings.

[0028] Additionally, the terminology used in this application is solely for the purpose of describing specific embodiments and is not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0029] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0030]

[0031] Next, a method for providing a nail care solution according to an embodiment of the present invention will be described with reference to the drawings.

[0032]

[0033] FIG. 1 illustrates an example of the structure of a computing device that implements a method for providing a nail care solution (hereinafter, “providing method”) according to an embodiment of the present invention.

[0034] FIG. 1 illustrates an embodiment of a computing device (101) capable of implementing a providing method according to an embodiment of the present invention. However, implementation of the providing method according to an embodiment of the present invention is not limited to the computing device (101) illustrated in FIG. 1.

[0035] The present invention may be implemented through a single computing device (101) or through multiple computing devices (101). For example, when the present invention is implemented through multiple computing devices (101), the multiple computing devices (101) may share and implement the steps included in the present invention. Alternatively, a single step included in the present invention may be implemented through multiple computing devices (101) working together.

[0036] The computing device (101) includes a processor (120), a memory (130), and may further include at least one of a bus (110), an input / output interface (150), a display (160), and a communication interface (170). In some embodiments, the electronic device (101) may omit at least one of the above components or may additionally include other components.

[0037] The bus (110) may include, for example, circuitry that connects the components to each other and transmits communication (e.g., control messages and / or data) between the components.

[0038] The processor (120) includes at least one of an MCU (Micro Controller Unit), a CPU (Central Processing Unit), and an AP (Application Processor), and may further include one or more of a CP (Communication Processor), a GPU (Graphics Processing Unit), an NPU (Neural Processing Unit), and a DPU (Data Processing Unit). The processor (120) may, for example, execute operations or data processing related to control and / or communication of at least one other component of the computing device (101).

[0039] The memory (130) may include non-volatile memory. For example, the non-volatile memory may include, but is not limited to, at least one of ROM, HDD, ODD, SDD, and flash memory.

[0040] The memory (130) may store, for example, at least one of commands, logic, and data related to at least one other component of the computing device (101). According to one embodiment, the memory (130) may store software and / or programs (140).

[0041] In addition to the memory (130), the device of the present invention may include volatile memory such as RAM.

[0042] Although the drawing shows that the memory (130) communicates with the processor (120) via a bus (110), the present invention is not limited thereto. For example, the processor (120) may be connected to an external or remotely located memory (130) via a network (162), a communication interface (170), or an input / output interface (150) to receive and process at least one of a command, logic, and data. In addition, the processor (120) may receive and execute software and / or a program (140) from an external or remotely located memory (130).

[0043] The program (140) may include, for example, a kernel (141), middleware (143), an application programming interface (API) (145), and / or an application program (or “application”) (147). At least a portion of the kernel (141), middleware (143), or API (145) may be referred to as an operating system (OS).

[0044] The kernel (141) may control or manage system resources (e.g., a bus (110), a processor (120), or a memory (130)) used to execute operations or functions implemented in other programs (e.g., middleware (143), API (145), or application programs (147)). In addition, the kernel (141) may provide an interface that allows the middleware (143), API (145), or application programs (147) to control or manage system resources by accessing individual components of the computing device (101).

[0045] The middleware (143) may, for example, act as an intermediary to enable an API (145) or an application program (147) to communicate with the kernel (141) to exchange data. In addition, the middleware (143) may, in relation to work requests received from the application program (147), perform control (e.g., scheduling or load balancing) on ​​work requests by, for example, assigning a priority for using system resources (e.g., a bus (110), a processor (120), or a memory (130)) of the computing device (101) to at least one application among the application programs (147).

[0046] API (145) is, for example, an interface for an application (147) to control functions provided by the kernel (141) or middleware (143), and may include at least one interface or function (e.g., command) for, for example, file control, window control, image processing, or character control.

[0047] The input / output interface (150) may serve as an interface that can transmit, for example, a command or data input from a user or another external device to other component(s) of the computing device (101). In addition, the input / output interface (150) may output a command or data received from other component(s) of the computing device (101) to the user or other external device. For example, the input / output interface (150) may be, but is not limited to, a serial port, a parallel port, PS / 2, ADB (Apple Desktop Bus), SCSI (Small Computer System Interface), USB, HDMI, DVI-I, or Thunderbolt.

[0048] The display (160) may include, for example, at least one of a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical systems (MEMS) display, an electronic paper display, or a beam projector. The display (160) may, for example, display various contents (e.g., text, images, videos, icons, symbols, etc.) to the user. The display (160) may include a touch screen and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body.

[0049] The communication interface (170) can establish communication between, for example, the computing device (101) and an external device. For example, the communication interface (170) can be connected to a network (162) via wireless communication or wired communication to communicate with an external device (e.g., an external electronic device (104) or a server (106)).

[0050] Wireless or wired communication may be, for example, but is not limited to, at least one of Bluetooth communication, NFC communication, Zigbee communication, Wi-Fi communication, cellular communication, and wired LAN. Cellular communication may be, for example, but is not limited to, at least one of LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, GSM, or IMT-2020.

[0051] The network (162) may include, but is not limited to, at least one of a LAN, a WAN, the Internet, an intranet, a telephone network, a mobile communication network, and a blockchain.

[0052] The network (162) may include, but is not limited to, at least one of a LAN, a WAN, the Internet, an intranet, a telephone network, a mobile communication network, and a blockchain.

[0053]

[0054] Meanwhile, a method according to an embodiment of the present invention includes a step of transmitting an image of a customer's fingernail or toenail to one or more computing devices (101). The customer's fingernail or toenail may refer to at least one of the customer's fingernail or toenail.

[0055] One or more computing devices (101) may receive nail images from a customer's electronic device (104). The customer's electronic device (104) may be, but is not limited to, a smartphone, a mobile phone, a camera, a laptop computer, a desktop computer, a tablet computer, a wearable device, etc.

[0056]

[0057] A method according to an embodiment of the present invention includes a step of processing a customer's nail image received by one or more computing devices (101) through a nail analysis model to derive the condition of the customer's nail.

[0058] One or more computing devices (101) can generate a nail analysis model according to a nail pattern for each nail condition by performing machine learning on a set of image data for each nail condition. For example, as illustrated in FIG. 2, image data sets for various nail conditions are collected, and one or more computing devices (101) can generate a nail analysis model according to a nail pattern for each nail condition by performing machine learning on the set of image data for each condition. The nail analysis model can be stored in a memory (130) in the form of a program or logic.

[0059] The number of images included in the image data set may range from thousands to tens of thousands, but the present invention is not limited to this number of images. The fingernail images included in the image data set may be collected from a customer's electronic device (104), or may be collected from an electronic device (104) of a hospital for fingernail treatment or a specialized shop for fingernail care, but the present invention is not limited thereto.

[0060] Machine learning may utilize, for example, a decision tree, a Bayesian network, a support vector machine (SVM), an artificial neural network (ANN), or a convolutional neural network (CNN), but the present invention is not limited thereto.

[0061] Nail conditions may include, but are not limited to, ingrown toenails, athlete's foot, dewclaws, fungus, moisture, dryness, malnutrition, and physical impact (deformation / breakage).

[0062] The nail analysis model formed in this way can process a customer's nail image and derive the customer's nail condition based on the pattern of the nail image.

[0063]

[0064] A method according to an embodiment of the present invention comprises a step of providing, by one or more computing devices (101), a management solution according to the identified nail condition of a customer. Figures 3 to 6 are tables summarizing examples of management solutions for each nail condition. While Figures 3 to 6 illustrate the management solutions in text form, the present invention is not limited thereto. For example, the management solutions may be provided in at least one of text, voice, still images, and video.

[0065] Furthermore, the contents of the management solution provided by the present invention are not limited to the contents of FIGS. 3 to 6. The management solution may include some of the contents of FIGS. 3 to 6 or may include additional contents.

[0066]

[0067] Meanwhile, one or more computing devices (101) can process the transmitted customer's fingernail image through a fingernail analysis model to derive the customer's fingernail pattern and derive the customer's fingernail condition corresponding to the derived fingernail pattern.

[0068] That is, the nail analysis model can process a customer's nail image and derive a nail pattern corresponding to the characteristics of the customer's nail. The nail pattern can be a pattern regarding the color, shape, form, and thickness of the nail.

[0069] One or more computing devices (101) may provide chemical and physical care solutions based on the identified nail condition of the customer. The chemical care solution may include at least one of a moisturizer and a nutrient, a medicine, and a cosmetic. The medicine may be, but is not limited to, an anti-inflammatory agent that can reduce nail inflammation or an antibacterial agent that can eliminate nail fungi. The cosmetic may provide an aesthetic feel to the nail along with moisturizing and nourishing properties. The physical care solution may include at least one of a drill, a curette, an artificial nail, a brace, and a surgical tool. The brace may be a tool that hooks onto both sides of the nail and lifts both sides of the nail.

[0070] The present invention is not limited to the types of chemical management solutions and physical management solutions described above.

[0071]

[0072] Meanwhile, one or more computing devices (101) can store a customer's occupational information and provide a management solution tailored to the customer's occupational information. The one or more computing devices (101) can receive and store the occupational information during the customer's registration process. In addition to occupational information, the one or more computing devices (101) can store the customer's personal information, such as name, age, gender, and address. However, the present invention is not limited to such personal information.

[0073]

[0074] If the customer's occupation is a fisherman, cook, or construction worker, one or more computing devices (101) may provide the customer with a management solution that includes information on reducing the effects of moisture through the use of toe socks or toe spacers.

[0075] Providing a management solution to a customer here may mean transmitting the management solution to the customer's electronic device (104). The customer's electronic device (104) may be, but is not limited to, the customer's desktop computer, laptop computer, mobile phone, smart phone, tablet computer, wearable device, etc.

[0076] If your occupation involves fishermen, chefs, athletes, or construction workers, you may be in a position where you wear non-ventilated boots or work shoes. The present invention can suggest a management solution that involves wearing toe socks made of absorbent material to reduce the effects of moisture, or toe spacers to prevent toes from touching each other. Toe spacers are inserted between the toes and can be made of silicone or soft plastic.

[0077] Additionally, one or more computing devices (101) may provide a care solution for a customer who is a fisherman, a cook, or a construction worker, including information on moisturizing and nourishing the toe socks or toe spacers.

[0078] Additionally, if the customer's nail condition is determined to be an ingrown toenail, onychomycosis, tinea versicolor, or pseudomonas aeruginosa discolored toenail and the customer's occupation is a fisherman, a cook, an athlete, or a construction worker, one or more computing devices (101) may additionally provide suggestions for oral medication (anti-inflammatory or antibacterial) requiring a prescription from a dermatologist or podiatrist, and care solutions related to restoration of lost toenails using gel or artificial nails.

[0079]

[0080] Meanwhile, if the customer's occupation is an office worker, one or more computing devices (101) may provide a management solution including lifting information according to deformation of the shape of the toenails due to pressure or tightness of shoes or heels.

[0081] Office workers may wear a lot of shoes or heels, but the toe area of ​​these shoes is narrow, so the shoes or heels may put pressure or constriction on the customer's toes, which may cause the toenails to become deformed into a C shape.

[0082] Accordingly, one or more computing devices (101) may propose a care solution, such as a lifting solution, that can restore the shape of the toenail. Furthermore, one or more computing devices (101) may propose a care solution that uses supplementary cosmetics (anti-inflammatory, antibacterial, moisturizing, and nourishing). Antibacterial may be used to control athlete's foot, and anti-inflammatory may be used to control inflammation resulting from an ingrown toenail.

[0083] Additionally, in shoes or heels, nail beds, nail bed bleeding, and horizontal white nails can frequently occur. Therefore, if a customer's nail condition is diagnosed as hallux valgus, nail bed bleeding, or horizontal white nails, and the customer works in an office, management solutions for these conditions, along with additional solutions that include lifting information, can be provided.

[0084]

[0085] Meanwhile, if the customer's occupation is a pregnant woman, one or more computing devices (101) may provide a management solution including information on functional socks to prevent ingrown toenails due to edema.

[0086] In the case of pregnant women, foot swelling can occur, which can lead to ingrown toenails. Therefore, pregnant women can be provided with management solutions for ingrown toenails, including functional socks that minimize contact between toenails, wick moisture away, and provide pressure to the feet.

[0087]

[0088] Meanwhile, for those who work as housewives or students, toenails or fingernails may become partially broken or bruised due to the influence of shoes, etc., or may develop vertical or horizontal lines due to nutritional imbalances. Accordingly, one or more computing devices (101) may provide a management solution that partially restores broken fingernails and toenails.

[0089]

[0090] Meanwhile, one or more computing devices (101) can provide a customized management solution for the customer's life by adding a questionnaire on the customer's life pattern according to occupational information.

[0091] One or more computing devices (101) can perform a questionnaire based on lifestyle patterns or health conditions derived from nail condition and provide a management solution based on the questionnaire results.

[0092] For example, if a customer is a fisherman, cook, or construction worker, their care solution may vary based on the survey results, including the amount of time they wear boots or work boots, how often and how they dry their feet after washing, and whether they wear socks at home. If they wear boots or work boots excessively, management solutions could include recommending that they remove them during breaks and frequently dry their feet, recommending that they use a hair dryer after washing their feet, or recommending that they not wear socks at home.

[0093] If the customer's occupation is office work, management solutions may vary based on the survey results regarding the amount of time spent wearing shoes or heels and the width of the front of the shoes or heels. If the customer spends excessive amounts of time wearing shoes or heels, management solutions may include recommending the use of slippers indoors or sneakers during commuting.

[0094]

[0095] Meanwhile, one or more computing devices (101) receive an image of the customer's fingernails and toenails from the customer's mobile device, the customer's mobile device displays an optimal shooting frame required for capturing the image of the customer's fingernails and toenails, and the customer's mobile device can automatically set the camera shooting conditions to suit capturing the fingernails and toenails.

[0096] The customer's mobile device may be included in the customer's electronic device (104) described above. A dedicated application program for the method of providing the present invention may be installed on the customer's mobile device. The customer's mobile device may download and install the dedicated application program from an app market such as the Google Play Store or the Apple App Store.

[0097] A dedicated application program can capture a customer's fingernails and toenails via the mobile device's camera. The dedicated application program can display the optimal shooting frame for capturing the fingernail images, as illustrated in Figure 7.

[0098] If the distance between the mobile device's camera and the customer's fingernails is not appropriate, the nail image may be excessively small or large, or the focus may not be appropriate, resulting in a poorly clear image. The optimal shooting frame allows the customer to move the mobile device so that the subject's fingernails are within the optimal shooting frame, resulting in a clear, appropriately sized nail image.

[0099] Additionally, the dedicated application program can automatically set camera shooting conditions optimized for processing by the nail analysis model. These camera shooting conditions may include, but are not limited to, resolution, image file size, image format, digital filter deactivation, or the type of digital filter automatically set.

[0100] Camera conditions may not be suitable for nail analysis models to process nail images. For example, if the image file resolution or size is excessively large or small, processing time may increase excessively due to the amount of information to be processed, or the information may be too small, preventing proper image analysis.

[0101] Additionally, image analysis may be difficult if the nail analysis model is an image in a format other than the desired image format (e.g., jpg or tiff).

[0102] Additionally, if digital filters are set by applications other than the dedicated application program, the nail analysis model may process the nail image, resulting in incorrect nail condition information or making nail image analysis difficult. Accordingly, the dedicated application program can disable unauthorized digital filters or automatically set the necessary digital filters.

[0103]

[0104] Meanwhile, one or more computing devices (101) can receive customer solution performance information according to the management solution from an electronic device to which the customer has logged in, and transmit feedback information on the solution performance information to the electronic device to which the customer has logged in.

[0105] For example, if the nail condition is an ingrown toenail as shown in FIGS. 3 to 6, a management solution such as "It mainly manifests as inflammation and pain around the nail. It can be caused by hyperhidrosis, improper nail care, congenital abnormalities, and hypertrophy of the lateral folds. First, take measures to relieve inflammation and infection at the hospital, then remove the infringing toenail, disinfect the surrounding skin, and provide continuous management" can be provided to the customer.

[0106] In the case of ingrown toenails, since constant skin disinfection is required, one or more computer devices can provide a skin disinfection schedule management solution and can perform verification to determine whether the customer has disinfected the skin according to the skin disinfection schedule.

[0107] That is, one or more computing devices (101) can verify whether a customer is performing nail care normally, depending on the management solution. To this end, one or more computing devices (101) can receive photos or videos of the customer performing nail care.

[0108]

[0109] As described above, embodiments of the present invention have been described. It will be apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit or scope thereof, in addition to the embodiments described above. Therefore, the above-described embodiments should be considered illustrative rather than restrictive, and accordingly, the present invention is not limited to the above description, but may be modified within the scope of the appended claims and their equivalents.

Claims

1. A step in which one or more computing devices receive an image of a customer's fingernails and toenails; A step in which the one or more computing devices process the transmitted customer's fingernail image through a fingernail analysis model to derive the customer's fingernail condition; and A step in which the one or more computing devices provide a management solution according to the derived customer's fingernail condition. A method for providing a nail care solution comprising:

2. In paragraph 1, A method for providing a nail care solution, characterized in that the one or more computing devices generate a nail analysis model according to the nail pattern according to the nail condition by performing machine learning on a set of image data for each nail condition.

3. In paragraph 2, The one or more computing devices The customer's fingernail image received above is processed through a fingernail analysis model to derive the customer's fingernail pattern, A method for providing a nail care solution, characterized by deriving a customer's nail condition corresponding to the above-described nail pattern.

4. In paragraph 2 or 3, A method for providing a nail care solution, characterized in that the above nail pattern is a pattern for at least one of the color, shape, form, and thickness of the nail.

5. In paragraph 4, The one or more computing devices provide chemical management solutions and physical management solutions according to the derived customer's nail condition, The above chemical management solution comprises at least one of a moisturizer and a nutrient, a pharmaceutical and a cosmetic, A method for providing a nail care solution, characterized in that the physical care solution comprises at least one of a drill, a curette, an artificial nail, a corrector, and a surgical operation.

6. In paragraph 1, The one or more computing devices A method for providing a nail care solution, characterized by storing the customer's occupational information and providing the management solution suited to the customer's occupational information.

7. In paragraph 6, If the above customer's occupation is a fisherman, cook, or construction worker, The one or more computing devices A method for providing a nail care solution, characterized in that the method comprises providing the customer with a care solution including information on reducing the effects of moisture through wearing toe socks or toe spacers.

8. In paragraph 6, If the above customer's occupation is an office worker, A method for providing a nail care solution, characterized in that the one or more computing devices provide a management solution including lifting information according to shape deformation of the nail due to pressure or tightening of a shoe or heel.

9. In paragraph 6, If the above customer's occupation is a pregnant woman, The one or more computing devices A method for providing a nail care solution, characterized in that it provides a care solution including information on functional socks for preventing ingrown toenails due to edema.

10. In any one of paragraphs 6 to 9, The one or more computing devices A method for providing a fingernail and toenail care solution, characterized in that it provides a customized care solution for the customer's life by adding a questionnaire on the customer's lifestyle pattern according to the above occupational information.

11. In paragraph 1, wherein said one or more computing devices receive an image of the customer's fingernails and toenails from said customer's mobile device; The customer's mobile device displays the optimal shooting frame required to capture the customer's fingernail image, A method for providing a nail care solution, characterized in that the customer's mobile device automatically sets the camera shooting conditions to suit nail shooting.

12. In any one of paragraphs 1 to 9 and paragraph 11, The one or more computing devices A method for providing a nail care solution, characterized in that the customer's solution performance information according to the management solution is received from the electronic device through which the customer is logged in, and feedback information on the solution performance information is transmitted to the electronic device through which the customer is logged in.

Images