Skin color unevenness display method, display object, skin color unevenness display device, and skin color unevenness display program

The method and device calculate and display an unevenness index for skin images, enabling the simultaneous visualization of microscopic and macroscopic color unevenness, facilitating intuitive evaluation and comparison of skin tone changes.

JP7581575B2Active Publication Date: 2024-11-13POLA CHEMICAL INDUSTRIES INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2020211427
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-12-21
Publication Date
2024-11-13
Estimated Expiration
2040-12-21

AI Technical Summary

Technical Problem

Existing methods fail to effectively express and evaluate uneven skin tone, lacking the ability to display both microscopic and macroscopic color unevenness simultaneously.

Method used

A method and device for calculating an unevenness index for each unit block of a skin image, displaying evaluation results corresponding to the unit blocks in a predetermined area, and generating an evaluation chart that shows both microscopic and macroscopic color unevenness.

Benefits of technology

Enables the simultaneous display and evaluation of microscopic and macroscopic color unevenness, allowing for intuitive recognition and comparison of skin tone changes over time or across different regions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007581575000001
    Figure 0007581575000001
  • Figure 0007581575000002
    Figure 0007581575000002
  • Figure 0007581575000003
    Figure 0007581575000003
Patent Text Reader

Abstract

To provide a new technique for expressing and evaluating variations of color unevenness of the skin.SOLUTION: A skin color unevenness display method comprises: an unevenness index calculation step of calculating an unevenness index of a color component for each unit block obtained by uniformly dividing an evaluation region of a skin image of a subject; and a display step of displaying an evaluation result based on each unevenness index in a prescribed display region for the plurality of any unit blocks in the evaluation region. In the display step, an evaluation chart is generated by displaying the evaluation display that indicates the evaluation result at a position in the display region corresponding to the position of the unit block in the evaluation region.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a skin color unevenness display method, a skin color unevenness evaluation method, a display object, a skin color unevenness display device, and a skin color unevenness display program. [Background technology]

[0002] In recent years, image analysis of images including skin has been performed to evaluate skin condition, apparent facial age, etc. Patent Document 1 describes a method of calculating two or more feature indices such as wrinkles from a skin image and determining a sensory evaluation of the skin based on the two or more feature amounts.

[0003] Patent document 2 describes a method for evaluating skin condition in which a digital image of the skin of a test subject is captured, color differences are calculated from color information between a unit area of ​​the image and adjacent areas, and the frequency distribution of the color differences is determined.

[0004] Furthermore, Patent Document 3 describes a method for evaluating skin unevenness by acquiring color component values ​​expressed in a Cartesian coordinate system in three-dimensional space from an image of the skin, calculating multiple movement vectors for an arbitrary pixel and its eight adjacent pixels, and calculating the average value of the movement vectors.

[0005] Patent Document 4 discloses a method for calculating skin color unevenness as a means for evaluating skin dullness. Specifically, the method describes a method for acquiring skin color information from a skin image, acquiring a color unevenness index from the skin color information, and evaluating the skin dullness corresponding to the skin image based on the color unevenness index. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent No. 6345176 [Patent Document 2] Patent No. 4088081 [Patent Document 3] JP 2018-60532 A [Patent Document 4] Patent No. 6214914 Summary of the Invention [Problem to be solved by the invention]

[0007] In view of the above-mentioned prior art, an object of the present invention is to provide a new technique for expressing and evaluating skin tone unevenness. [Means for solving the problem]

[0008] The present invention solves the above problems, an unevenness index calculation step of calculating an unevenness index of a color component for each unit block obtained by equally dividing an evaluation area of ​​a skin image of a subject; a display step of displaying, in a predetermined display area, an evaluation result based on each of the unevenness indexes for any of a plurality of the unit blocks in the evaluation area; The display step is a method for displaying skin color unevenness, the method comprising: generating an evaluation chart by displaying an evaluation display showing the evaluation result at a position in the display area corresponding to the position of the unit block in the evaluation area.

[0009] The skin color unevenness display method of the present invention can display microscopic color unevenness by displaying the evaluation result corresponding to the unevenness index for each unit block, and can simultaneously display macroscopic color unevenness overlooking the entire evaluation area by displaying the evaluation results for multiple unit blocks in the evaluation area together with their position information.

[0010] In a preferred embodiment of the present invention, the unevenness index calculation step includes a step of calculating a first unevenness index at a first time point, and a step of calculating a second unevenness index at a second time point after the first time point, In the display step, a first evaluation chart showing an evaluation result based on the first unevenness index and a second evaluation chart showing an evaluation result based on the second unevenness index are displayed side by side. By displaying evaluation charts relating to a number of time points side by side in this manner, it is possible to easily express changes in skin tone unevenness over time.

[0011] In a preferred embodiment of the present invention, the evaluation indication is an indication showing the magnitude of the unevenness index. By indicating the magnitude of the unevenness index, unevenness in skin color can be appropriately expressed.

[0012] In a preferred embodiment of the present invention, the unevenness index calculation step includes a step of calculating a first unevenness index at a first time point, and a step of calculating a second unevenness index at a second time point after the first time point, The evaluation indication is an indication showing the difference between the first unevenness index and the second unevenness index. By showing the difference in unevenness index, it is possible to easily express the change in skin unevenness over time.

[0013] In a preferred embodiment of the present invention, the evaluation indication is provided by coloring sections obtained by dividing the display area, and the evaluation result for each unit block is indicated by different colors. By adopting such a configuration, the visibility of color unevenness can be improved.

[0014] In a preferred embodiment of the present invention, the difference in color is expressed by a difference in brightness, and the section is colored in a color with a higher brightness as the evaluation result is better. By adopting such a configuration, uneven skin tone can be intuitively recognized.

[0015] In a preferred embodiment of the present invention, the display step includes displaying the skin image related to the evaluation region alongside the evaluation chart. By displaying the skin images side by side, it is possible to compare the skin tone unevenness intuitively recognized from the skin images with the objective skin tone unevenness based on the unevenness index.

[0016] The present invention relates to an unevenness index calculation step of calculating an unevenness index of a color component for each unit block obtained by dividing an evaluation area of ​​a skin image of a subject; The present invention also relates to a method for evaluating skin color unevenness, comprising an evaluation step of evaluating color unevenness in the evaluation area based on the unevenness index for each unit block. By using the method for evaluating skin color unevenness of the present invention, it is possible to evaluate microscopic color unevenness, and further to evaluate color unevenness of the entire evaluation area of ​​the skin as a collection of microscopic color unevenness.

[0017] In a preferred embodiment of the invention, the unevenness index calculation step includes a step of calculating a first unevenness index at a first time point, and a step of calculating a second unevenness index at a second time point after the first time point, The evaluation step includes evaluating a change in color unevenness in the evaluation area based on a comparison between the first unevenness index and the second unevenness index. By comparing the unevenness index at different points in time, changes in skin unevenness can be properly evaluated.

[0018] The present invention also provides a method for producing a method for manufacturing a semiconductor device comprising the steps of: A display that displays an evaluation result of color unevenness based on a skin image of a subject, an evaluation chart that displays the evaluation results by coloring sections that are obtained by equally dividing a predetermined display area; The evaluation chart also relates to a display object in which the sections correspond to unit blocks obtained by dividing the evaluation area of ​​the skin image, and the evaluation results of the unit blocks are shown in the corresponding sections. According to the display of the present invention, it is possible to simultaneously display microscopic color unevenness based on the unevenness index for each unit block and macroscopic color unevenness for the entire evaluation area.

[0019] In a preferred embodiment of the present invention, the apparatus further includes a color panel showing the correspondence between the color used for the coloring and the evaluation result. By including the color panel, the meaning of the evaluation results can be easily seen.

[0020] In a preferred embodiment of the present invention, the skin image relating to the evaluation area is included, and the skin image and the evaluation chart are displayed side by side. By displaying the skin image and the evaluation chart side by side, it is possible to compare the skin tone unevenness perceived intuitively from the skin image with the objective skin tone unevenness based on the unevenness index.

[0021] The present invention also provides a method for producing a method for manufacturing a semiconductor device comprising the steps of: an image processing means for identifying an evaluation area from a skin image of a subject and dividing the evaluation area into predetermined unit blocks; an unevenness index calculation means for calculating an unevenness index of a color component for each of the unit blocks obtained by the image processing means; a display means for displaying, in a predetermined display area, an evaluation result based on the unevenness index calculated by the unevenness index calculation means for any of a plurality of the unit blocks in the evaluation area, The display means is a skin color unevenness display device that displays an evaluation display showing the evaluation result at a position in the display area corresponding to the position of the unit block in the evaluation area, thereby generating an evaluation chart.

[0022] The present invention also provides a method for producing a method for manufacturing a semiconductor device comprising the steps of: Computer, an image processing means for identifying an evaluation area from a skin image of a subject and dividing the evaluation area into predetermined unit blocks; an unevenness index calculation means for calculating an unevenness index of a color component for each of the unit blocks obtained by the image processing means; a display unit that displays, in a predetermined display area, an evaluation result based on the unevenness index calculated in the unevenness index calculation step for any plurality of unit blocks in the evaluation area, The display means is a skin color unevenness display program that displays an evaluation display showing the evaluation result at a position in the display area corresponding to the position of the unit block in the evaluation area, thereby generating an evaluation chart. Effect of the Invention

[0023] According to the present invention, a new technique for evaluating and expressing skin color unevenness can be provided. In particular, the present invention is capable of evaluating and displaying microscopic color unevenness as well as macroscopic color unevenness over the entire evaluation area. [Brief description of the drawings]

[0024] [Figure 1] 5 is an explanatory diagram showing a method for displaying the evaluation result of color unevenness in a display area in the method for displaying skin color unevenness of the present invention. FIG. [Diagram 2] FIG. 13 is a diagram showing a display result (display) of uneven skin color of a subject in an example. [Diagram 3] 1 is a hardware block diagram showing an embodiment of a skin color unevenness display device of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] <1> How to display color unevenness Hereinafter, an embodiment of a method for displaying skin color unevenness (hereinafter, also referred to as a "method for displaying skin color unevenness") according to the present invention will be described in detail. The color unevenness display method of this embodiment includes an image acquisition step of acquiring a skin image of a subject, an image processing step of identifying an evaluation area from the skin image and dividing the evaluation area into unit blocks of equal size, an unevenness index calculation step of calculating an unevenness index of a color component for each unit block, and a display step of displaying, in a specified display area, evaluation results based on each unevenness index for any multiple unit blocks within the evaluation area.

[0026] Hereinafter, the present invention will be described in detail with reference to an embodiment of a color unevenness display method according to the present invention.

[0027] (1) Image acquisition process In the image acquisition step, a skin image of the subject is acquired. As the skin image, a skin image of the cheek region is preferably used. Here, the skin image may be an image captured by a general video camera or digital camera, but it is preferable that the image has a resolution sufficient for image analysis in a later step. Here, it is preferable to acquire a color image.

[0028] The color unevenness display method of the present invention does not necessarily include the step of capturing a skin image, and the following steps may be performed using a previously acquired skin image.

[0029] (2) Image processing An evaluation area for evaluating color unevenness is specified for the acquired skin image. Preferably, the evaluation area is divided by providing a frame or the like on the skin image. The evaluation area is preferably 1×1 cm or more, more preferably 3×3 cm or more, and even more preferably 5×5 cm or more in size as the actual skin area of ​​the subject, and is preferably rectangular or square in shape.

[0030] Next, the specified evaluation area is divided equally, and each of them is defined as a unit block. The area of ​​the unit block is preferably 1 / 900 to 1 / 4 of the area of ​​the evaluation area, more preferably 1 / 784 to 1 / 64, more preferably 1 / 625 to 1 / 100, and even more preferably 1 / 625 to 1 / 400. The size of the unit block is preferably 0.1 x 0.1 mm to 25 x 25 mm, more preferably 0.3 x 0.3 mm to 10 x 10 mm, more preferably 0.5 x 0.5 mm to 5 x 5 mm, more preferably 1 x 1 mm to 3 x 3 mm, and even more preferably 1.5 x 1.5 mm to 2.5 x 2.5 mm, based on the size of the subject's actual skin area. Furthermore, the size of a unit block is preferably 1 to 80,000 pixels, more preferably 1 to 10,000 pixels, more preferably 350 to 5,000 pixels, more preferably 400 to 3,000 pixels, more preferably 450 to 1,000 pixels, and even more preferably 480 to 750 pixels. By making the unit block have the above area or size, it is possible to obtain a unit block large enough to calculate microscopic skin color unevenness. Furthermore, in the display process described below, the microscopic color unevenness calculated for each unit block is displayed as an evaluation display, so long as the unit block is within the above range, the evaluation display for the evaluation area will not be too fine, and the visibility of the evaluation display can be ensured.

[0031] In addition, the color component values ​​of the colors constituting the unit block are extracted. Specifically, the color component values ​​of the pixels included in the evaluation area are extracted. The color component values ​​may be R, G, and B values ​​of the RGB color system, or CIEL * a * b * Color space L * Value, a * Value, b * These include the value, the Munsell color system's lightness, hue, and saturation, among others. * It is preferable to extract the value.

[0032] Here, RGB images captured by a digital camera etc. are * a * b * When converting to an image, existing conversion formulas can be used. That is, a standard skin color chart of 325 colors (a color chart that covers all skin colors produced by the Japan Color Research Institute (L * 45.6~85.9, a * 0.5~26.1, b * 1.8~40.7)) and calculate the luminance of RGB by multiple regression analysis. * a * b * The conversion formula (below) for converting the RGB image into a L value was found, and this was incorporated into the image analysis application software. * a * b * In formula 1, the correlation with the actual measurement value is L * a * b * This refers to the correlation between the results of image analysis and the results of RGB analysis.

[0033] (Number 1) L * =0.049R+0.186G+0.089B+26.17 (Correlation with actual measurements r=0.9988, P<0.001) a * =0.414R-0.483G+0.101B+0.486 (Correlation with actual measurements r=0.9032, P<0.001) b * =-0.027R+0.918G-0.856B+0.711 (Correlation with actual measurements r=0.8965, P<0.001)

[0034] (3) Unevenness index calculation process Furthermore, the unevenness index is calculated for each unit block using the extracted color component values. In the present invention, the "unevenness index" may be any index that indicates the degree of unevenness or variation in skin color, and for example, the dispersion of the extracted color components may be used. Examples of the dispersion include variance, standard deviation, average deviation, and coefficient of variation. Among these, it is preferable to use the standard deviation or coefficient of variation, and it is particularly preferable to use the coefficient of variation. By using the coefficient of variation or standard deviation as the unevenness index, it is possible to more accurately calculate the microscopic color unevenness for each unit block.

[0035] For example, when calculating the coefficient of variation as an unevenness index, the coefficient of variation of the color component for each unit block can be obtained by applying the color component values ​​extracted for each specific pixel (for example, every 25 x 25 pixels) contained in the unit block to a specified calculation formula.

[0036] (4)Display process Next, for the plurality of unit blocks for which the unevenness indexes have been calculated, the evaluation results based on each unevenness index are displayed in a predetermined display area. The evaluation results are displayed by generating an evaluation chart showing evaluation indications. Here, the evaluation indications are displayed at predetermined positions in the display area in correspondence with the positions (relative positions) of the unit blocks in the evaluation area (see FIG. 1).

[0037] Specifically, a display area corresponding to the evaluation area is displayed, this display area is divided into sections of the same number and shape as the number of unit blocks, and an evaluation display based on the unevenness index of the unit block is displayed in each divided section in correspondence with the position of the unit block in the evaluation area. At this time, the size of the display area and the sections of the evaluation chart can be determined so that the size of the display area and the sections are relatively equal to the size of the evaluation area and the unit blocks.

[0038] The position of the evaluation indication can be associated with the following procedure. That is, as shown in Fig. 1, when performing an evaluation indication for unit block A, an unevenness index is calculated for unit block A, and an evaluation indication based on the unevenness index is displayed in section A of the display area. Similarly, evaluation indications for unit blocks B and C can be displayed in sections B and C, respectively.

[0039] Examples of the evaluation indication include coloring the compartments, displaying a numerical level within the compartments, and displaying an evaluation symbol (◯, △, ×, etc.) within the compartments, with coloring the compartments being preferred.

[0040] As a specific example of coloring, for example, the evaluation results and colors are previously associated so that the color changes stepwise according to the evaluation results (for example, the magnitude of the unevenness index), and the sections are colored in the color corresponding to the evaluation results. In this way, it is preferable to display the evaluation results by different colors.

[0041] In addition, as a mode of gradual change in color, it is preferable to change the brightness of any color in a gradual manner. In other words, it is preferable that the difference in color of the sections is expressed by the difference in brightness. Furthermore, it is preferable that the higher the brightness of the color, the better the evaluation result for skin unevenness. Here, a good evaluation result for color unevenness is one in which the unevenness index is small.

[0042] When determining a color based on the magnitude of the unevenness index, it is preferable to previously associate the unevenness index with a color so that the larger the unevenness index value, the lower the luminance and the closer to black the color will be, and the smaller the unevenness index value, the higher the luminance and the closer to white the color will be. By displaying the color corresponding to the unevenness index as an evaluation indicator in this manner, it is possible to generate an evaluation chart that allows the skin color unevenness to be intuitively recognized.

[0043] The difference in color between the sections may be such that a predetermined hue is set in advance and the luminance of the hue is changed in stages. As an example, the correspondence between the unevenness index and the color in the HSL color space, where the value of the predetermined hue is 0 (red), will be described. First, a red gradation panel is created by fixing the value of the hue to 0 (red) and varying the brightness (L) stepwise in the range of 0 to 255. Next, the red gradation panel is associated with the unevenness index value. At this time, the red gradation panel is associated with the unevenness index so that the smaller the unevenness index, the higher the brightness and the closer to white the color is, and the larger the unevenness index, the lower the brightness and the closer to black the color is. Note that the brightness may be set so that the minimum value of the unevenness index is a brightness value of 255 (white) and the maximum value of the unevenness index is a brightness value of 0 (black). As an evaluation result, a color selected from the red gradation panel based on the unevenness index can be displayed in the section of the display area. By adopting this form, the section with the intermediate unevenness index is displayed in a specified hue (red in the above example), and the color unevenness can be expressed in a color selected from a three-color gradation of black, the specified hue, and white. Also, by displaying the color unevenness in a color selected from a gradation in which the luminance of the specified hue is changed, the difference in color unevenness can be more clearly recognized than when the color unevenness is displayed using a two-color gradation.

[0044] A color panel showing the correspondence between the unevenness index and color may be displayed together with the evaluation chart. The color panel shown on the right side of Fig. 2 shows an aspect in which the coefficient of variation (unevenness index) value, which is expressed as a value from 0 to 0.1, corresponds to the color such that the larger the coefficient of variation, the lower the luminance (closer to black), and the smaller the coefficient of variation, the higher the luminance (closer to white).

[0045] In this way, in the color unevenness display method of the present invention, by displaying the evaluation result based on the unevenness index of the unit block in the skin image, it is possible to easily visually recognize the micro color unevenness. Also, by displaying the evaluation result for each of the unit blocks in the evaluation area in correspondence with the position of the unit block in the display area, it is possible to visually recognize the macro color unevenness in the entire evaluation area. In other words, it is possible to display the micro color unevenness based on the unevenness index and the macro color unevenness which is a collection of the micro color unevenness as a single display.

[0046] It is not necessary to display all the evaluation results of the unit blocks in the evaluation area. For example, if there are unit blocks in the evaluation area that contain moles, scars, etc., the unit blocks can be excluded from the evaluation display. For the unit blocks excluded in this way, a figure (e.g., a - or an x ​​mark) indicating that they are excluded blocks can be added to the corresponding section.

[0047] In addition, in the display step, it is preferable to display the above-mentioned evaluation chart and a skin image related to the evaluation region side by side. Fig. 2 shows an embodiment in which a skin image (left side of Fig. 2) and an evaluation chart (right side of Fig. 2) are displayed side by side. By displaying the skin image to be evaluated alongside the evaluation chart, it is possible to compare the skin color unevenness intuitively recognized from the skin image with the objective skin color unevenness based on the unevenness index.

[0048] As an embodiment of the present invention, a form in which a plurality of evaluation charts are generated using a plurality of skin images is also preferably cited. This form will be described in detail below. Note that the explanation of each step described above is also applicable to this form, so the explanation will be omitted as appropriate.

[0049] The color unevenness display method of this embodiment calculates an unevenness index from each of a plurality of skin images, and generates a plurality of evaluation charts based on the obtained evaluation results. The plurality of skin images may be obtained from different skin regions of the same subject, or may be obtained from the same skin region of the same subject.

[0050] When using skin images obtained from the same skin area, a skin image can be obtained from a specific skin area at a certain point in time (a first point in time), and then a skin image can be obtained again from the same skin area later (i.e., a second point in time), and evaluation charts generated based on the unevenness index calculated from each skin image can be displayed side by side.

[0051] An example of the above embodiment is a form in which uneven skin tone before and after the use of a cosmetic product is compared. For example, Fig. 2 shows an embodiment in which a skin image and an evaluation chart (top of Fig. 2) showing uneven skin tone before the use of a cosmetic product and a skin image and an evaluation chart (bottom of Fig. 2) showing uneven skin tone one month after the use of a cosmetic product (serum) are displayed.

[0052] By displaying the evaluation charts before and after the use of the cosmetic side by side in this way, it is possible to express the change in uneven skin tone caused by the use of the cosmetic.

[0053] The above-mentioned cosmetic may be any of basic cosmetic products used for skin care, such as lotion, milky lotion, and serum, and makeup cosmetic products, such as foundation and foundation, but the present invention is preferably used to display uneven skin tone before and after the use of a basic cosmetic product. In other words, it is suitable for displaying uneven skin tone.

[0054] Here, the color unevenness display method of the present invention is not limited to a form in which only one set of evaluation charts at the first and second time points is displayed, and two or more sets of evaluation charts at the first and second time points may be displayed. In other words, skin images of the same region of a subject may be obtained two or more times over time, and multiple evaluation charts created for each time point may be displayed side by side.

[0055] In addition, by calculating the unevenness index from the skin at multiple points in time, such as before using the cosmetic product, one week after use, and two weeks after use, and then displaying evaluation charts based on each unevenness index side by side, it is possible to show the change in skin color unevenness due to the use of the cosmetic product.

[0056] In this way, by generating evaluation charts for the same skin area over time and displaying them side by side, it becomes possible to visually grasp the change in skin tone unevenness over time. This display method can be used, for example, to evaluate whether there is a change in skin tone unevenness when skin care products, medicines, etc. are used continuously.

[0057] The color unevenness display method of the present invention can also be configured to display evaluation charts related to different skin regions side by side. For example, by displaying an evaluation chart based on an image acquired from a specific skin region (first skin region) and an evaluation chart based on an image acquired from a skin region (second skin region) different from the first skin region side by side, color unevenness for each skin region can be displayed in a comparative manner.

[0058] For example, by creating an evaluation chart for each of the right and left cheeks and comparing them side by side, the difference in uneven skin tone between the two cheeks can be recognized at a glance.

[0059] Furthermore, the color unevenness display method of the present invention can be configured to display skin color unevenness in one evaluation chart using skin images captured from the same region at different times. That is, in the above-mentioned (1) image acquisition step, a skin image is acquired from a specific skin region at a certain time (first time), and then a skin image is acquired again from the same skin region after that (i.e., second time). Then, after the above-mentioned (2) image processing step, in the (3) unevenness index calculation step, a first unevenness index and a second unevenness index are calculated for each unit block based on the acquired images, and further a difference between the calculated unevenness indexes is calculated. Finally, in the (4) display step, an evaluation display showing the difference can be displayed.

[0060] In the above embodiment, when the evaluation display is performed by coloring the sections obtained by dividing the display area, the difference and the color are previously associated so that the color changes stepwise according to the difference in the unevenness index (evaluation result), and the color is changed according to the difference. In this way, it is preferable to display the evaluation result by different colors. As the gradual change in color, it is preferable that the luminance is changed in stages. Furthermore, it is preferable that the color with higher luminance is configured to show a better evaluation result for skin unevenness. Here, a good evaluation result for the difference in color unevenness means that the difference in the unevenness index is large.

[0061] When determining a color based on the difference in the unevenness index, it is preferable to previously associate the difference with the color so that the smaller the difference value, the lower the luminance and the color is closer to black, and the larger the difference value, the higher the luminance and the color is closer to white. By making such a correspondence, it is possible to generate an evaluation chart that allows the user to intuitively recognize skin color unevenness.

[0062] It is also preferable that the difference in the unevenness index corresponds to a stepwise change in luminance for a specific hue. By adopting such a form, it is possible to express the unevenness in a gradation of three colors: black, the specific hue, and white.

[0063] The color for coloring the sections may be preset so as to highlight sections related to differences exceeding a predetermined value. At this time, colors of different hues may be combined to show differences in the colors of the sections. For example, a reference value for the difference in the unevenness index may be preset, and a section of interest related to a difference exceeding the reference value may be colored in a color with high saturation (e.g., red with color code #F91737), and a section related to a difference not meeting the reference value may be colored in a color different from the section of interest (e.g., light yellow with color code #FDF6CB). By coloring the sections in this manner, it is possible to generate an evaluation chart in which sections in which the difference in unevenness index exceeds the reference value and the color unevenness has changed can be easily visually identified.

[0064] <2> display object By using the above-mentioned display method of the present invention, an object for displaying uneven skin tone can be produced, and the present invention also relates to this object. In other words, the display of the present invention includes an evaluation chart that displays the evaluation results of the subject's skin color unevenness by coloring equal sections that divide a specified display area, and the evaluation chart corresponds the sections to unit blocks that divide the evaluation area of ​​the skin image, and shows the evaluation results of the unit blocks in the corresponding sections.

[0065] The display object in the present invention is a flat object that is not particularly limited as long as it is capable of displaying characters and figures, but is preferably displayed on paper or a display.

[0066] Moreover, the display of the present invention preferably includes a color panel that indicates a preset correspondence between the color used for the coloring and the evaluation result. This color panel is preferably configured to display a gradation in which only the brightness of a predetermined hue is changed, and a color with a higher brightness indicates a better evaluation result for skin unevenness.

[0067] The display of the present invention may be in a form in which a plurality of evaluation charts are displayed side by side.

[0068] The display of the present invention may be in a form in which a skin image relating to the evaluation region is displayed alongside an evaluation chart.

[0069] When multiple evaluation charts are displayed side by side, it is preferable to display the multiple evaluation charts vertically. Furthermore, when a skin image is also displayed, it is preferable to display the corresponding skin image on either the left or right side of each evaluation chart. By displaying the evaluation chart and skin image in this arrangement, the skin image and the evaluation chart can be visually recognized at the same time, and the evaluation results of a plurality of skin images can be easily compared.

[0070] Furthermore, the display object of the present invention does not need to satisfy all of the above configurations, and may be in a form in which, for example, only an evaluation chart is displayed.

[0071] A preferred embodiment of the evaluation chart in the display of the present invention is as follows: <1> The description of the display method of the present invention is incorporated herein by reference.

[0072] <3> Color unevenness evaluation method The skin color unevenness evaluation method (hereinafter also referred to as "color unevenness evaluation method") of the present invention includes an evaluation step of evaluating color unevenness in an evaluation area based on the unevenness index calculated in the unevenness index calculation step in the above-mentioned color unevenness display method. <1> The description in the above is incorporated herein by reference.

[0073] The evaluation steps in the color unevenness evaluation method of the present invention will be described in detail below.

[0074] In the evaluation step, the subject's skin color unevenness is evaluated for the evaluation area of ​​the skin image based on the unevenness index obtained by the above-mentioned method. When the evaluation is performed using a single skin image, the skin color unevenness can be evaluated based on the unevenness index per unit block. For example, a value of the unevenness index for determining uneven color can be determined in advance, and a unit block with the predetermined unevenness index can be evaluated as having uneven color. In this way, uneven color can be determined for each unit block, thereby making it possible to evaluate uneven skin color.

[0075] In addition, by determining in advance an unevenness index for determining color unevenness as described above and calculating the percentage of unit blocks that are greater than the predetermined unevenness index, the degree of color unevenness within the evaluation area can be evaluated by the number of unit blocks that are determined to have color unevenness or the percentage (%) of the total.

[0076] In a preferred embodiment, <1> Color unevenness may be evaluated based on an evaluation chart generated by the color unevenness display method. For example, skin color unevenness may be evaluated based on the number of sections with high unevenness indexes in the evaluation chart, the number of regions where such sections are concentrated, the number of unit blocks in the regions, etc.

[0077] The method for evaluating color unevenness of the present invention may be configured to evaluate skin color unevenness by using a plurality of skin images. The plurality of skin images may be acquired from different skin regions or may be acquired from the same skin region.

[0078] An embodiment in which color unevenness is evaluated using a plurality of skin images will be described in detail below.

[0079] When multiple skin images are obtained from the same skin area, for example, an unevenness index (first unevenness index) is calculated from a skin image taken at a certain point in time (first point in time), and then an unevenness index (second unevenness index) is calculated from a skin image taken of the same skin area later (second point in time), and skin color unevenness within the evaluation area can be evaluated based on the changes in each unevenness index.

[0080] Specifically, when the second unevenness index is smaller than the first unevenness index for each unit block, it can be determined that the color unevenness of the unit block to which the unevenness index belongs has been improved. In other words, it is possible to evaluate the microscopic color unevenness of each unit block.

[0081] In addition, by calculating the percentage of the number of unit blocks in which it is determined that color unevenness has been improved by comparing the first unevenness index with the second unevenness index and calculating the improvement rate of color unevenness, it is also possible to evaluate from a macroscopic perspective the change in skin color unevenness over time.

[0082] Here, the color unevenness evaluation method of the present invention is not limited to a form in which one set of the first and second unevenness indexes are compared, and may be a form in which two or more sets of the first and second unevenness indexes are compared. In other words, skin images of a subject may be obtained two or more times over time, and changes in skin color unevenness over time may be evaluated based on the multiple unevenness indices obtained from the skin images.

[0083] In one embodiment of the color unevenness evaluation method of the present invention, the first unevenness index is calculated using a skin image taken of the skin before use of the cosmetic product, and the second unevenness index is calculated using a skin image taken of the skin after use of the cosmetic product.

[0084] The above-mentioned cosmetic material may be <1> As in the above, any basic cosmetic product used for skin care, such as a lotion, milky lotion, or serum, or a makeup cosmetic product, such as a foundation or base, may be used, but the present invention is preferably used to evaluate uneven skin tone before and after the use of a basic cosmetic product. In other words, it is preferably used to evaluate uneven skin tone.

[0085] The color unevenness evaluation method of the present invention can also be embodied as an evaluation method by comparing color unevenness in different skin regions. For example, the color unevenness of both regions can be compared based on a first unevenness index calculated based on an image acquired from a specific skin region (first skin region) and a second unevenness index calculated based on an image acquired from a skin region (second skin region) different from the first skin region.

[0086] Specifically, an unevenness index for determining color unevenness is determined in advance, and the ratio of unit blocks that have the predetermined unevenness index is calculated for each skin image acquired from different skin regions. A skin region with a smaller ratio of unit blocks that have the predetermined unevenness index can be determined to have less skin color unevenness. In other words, when comparing and evaluating different skin regions, the evaluation is performed on color unevenness from a macroscopic perspective of the entire evaluation region.

[0087] <4> Color unevenness display device The skin color unevenness display device of the present invention (hereinafter, also referred to as a "color unevenness display device") will be described below with reference to FIG. <1> The present invention is an apparatus for implementing the color unevenness display method described in the above item. <1> and <1> It is the result of <2> The above description also applies to the following devices:

[0088] As shown in Figure 3, the color unevenness display device 1 of the present invention comprises an image acquisition means 11 that acquires a skin image of a subject, an image processing means 12 that identifies an evaluation area from the skin image and divides the evaluation area into specified unit blocks, an unevenness index calculation means 13 that calculates the unevenness index of a color component for each unit block obtained by the image processing means 12, a memory unit 14 that stores various formulas necessary for calculating the unevenness index, and a display means 15 that displays, in a specified display area, an evaluation result based on the unevenness index calculated by the unevenness index calculation means 13 for any unit block in the evaluation area.

[0089] The image acquisition means 11 is for capturing an image of the surface of the skin, inputting the image of the surface of the skin and converting it into a signal that quantifies the color elements. The signal is not particularly limited as long as it can represent the skin condition, but for example, RGB signals, Munsell signals, L * a * b * Examples of such signals include a signal (JIS Z8729), an XYZ signal, a signal representing brightness, hue and saturation, etc. As the image acquisition means 11, a general video camera or digital camera can be used.

[0090] The image processing means 12 specifies an evaluation area from the skin image output from the image acquisition means 11, and divides the evaluation area into predetermined unit blocks. * a * b * The image signal may be converted to a different format.

[0091] The unevenness index calculation means 13 calculates an unevenness index for each unit block of the skin image input from the image processing means 12. Here, the unevenness index calculation means 13 may further include a step of calculating a difference between two or more unevenness indexes.

[0092] The storage unit 14 stores programs necessary for the functioning of the color unevenness display device of the present invention, and various formulas necessary for calculating the unevenness index.

[0093] The display means 15 determines an evaluation indication based on the unevenness index calculated by the unevenness index calculation means 13, and displays the evaluation indication in a predetermined display area. At this time, the evaluation indication is displayed in correspondence with the position of the unit block in the evaluation area of ​​the skin image, and an evaluation chart in which a plurality of evaluation indications are displayed in the display area is generated. Here, the evaluation indication based on the unevenness index can be determined not only by using the unevenness index value itself, but also by using the difference between the unevenness indexes.

[0094] The display means 15 also issues an instruction to display the evaluation chart on an arbitrary display device such as a liquid crystal display.

[0095] It should be noted that the present invention does not necessarily have to have the above-mentioned configuration, and may instead take the form of a color unevenness display device that includes, for example, image processing means 12 that identifies an evaluation area from a skin image and divides the evaluation area into specified unit blocks, unevenness index calculation means 13 that calculates the unevenness index of a color component for each unit block obtained by the image processing means 12, and display means 15 that displays, in a specified display area, an evaluation result based on the unevenness index calculated by the unevenness index calculation means 13 for any unit block within the evaluation area.

[0096] <5> Color unevenness display program The skin color unevenness display program of the present invention (hereinafter also referred to as the "color unevenness display program") causes a computer or other device, machine, etc. to function as an image acquisition means 11 that acquires a skin image of a subject, an image processing means 12 that identifies an evaluation area from the skin image and divides the evaluation area into specified unit blocks, an unevenness index calculation means 13 that calculates the unevenness index of a color component for each unit block obtained by the image processing means 12, a memory unit 14 that stores various formulas necessary for calculating the unevenness index, and a display means 15 that displays, for any unit block within the evaluation area, an evaluation result based on the unevenness index calculated by the unevenness index calculation means 13 in a specified display area (see Figure 3). Here, the display means is characterized in that it displays an evaluation display showing the evaluation result at a position in the display area corresponding to the position of the unit block in the evaluation area, thereby generating an evaluation chart.

[0097] In the present invention, the program does not necessarily cause all of the above components to function. For example, the program may be in the form of a color unevenness display program that causes a computer, other device, machine, etc. to function as: image processing means 12 that identifies an evaluation area from a skin image of a subject and divides the evaluation area into specified unit blocks; unevenness index calculation means 13 that calculates the unevenness index of a color component for each unit block obtained by the image processing means 12; and display means 15 that displays, in a specified display area, an evaluation result based on the unevenness index calculated by the unevenness index calculation means 13 for any unit block within the evaluation area.

[0098] The color unevenness display program of the present invention is <1> and <4> The present invention relates to a color unevenness display method and a color unevenness display device described in the above item. <1> <2> , <4> The above description is also applicable to the color unevenness display program of the present invention. [Industrial Applicability]

[0099] The present invention can be applied to a method for diagnosing skin conditions in the fields of cosmetics and medicine, a method for evaluating the effectiveness of cosmetics, and devices used in these methods. [Explanation of symbols]

[0100] 1. Color unevenness display device 11 Image acquisition method 12 Image processing means 13. Method of calculating the unevenness index 14 Storage section 15 Display means

Claims

1. an unevenness index calculation step of calculating an unevenness index of a color component for each unit block obtained by equally dividing an evaluation area of ​​a skin image of a subject; a display step of displaying, in a predetermined display area, an evaluation result based on the unevenness index for any of a plurality of the unit blocks in the evaluation area; the display step includes displaying an evaluation display showing the evaluation result in a section that is provided in a position within the display area corresponding to a position of the unit block in the evaluation area and that is obtained by equally dividing the display area, thereby generating an evaluation chart; The unit block has an area of ​​1 / 784 to 1 / 64 of the area of ​​the evaluation region, the unevenness index calculation step includes a step of calculating a first unevenness index at a first time point, a step of calculating a second unevenness index at a second time point after the first time point for the same skin region as the skin region for which the first unevenness index was calculated, and a step of calculating a difference between the first unevenness index and the second unevenness index, the evaluation indication is a coloring of the section such that the brightness of a predetermined hue changes stepwise in accordance with the value of the difference, The difference and the color of the predetermined hue are previously associated with each other so that the smaller the difference value is, the lower the luminance is, and the color is closer to black, and the larger the difference value is, the higher the luminance is, and the color is closer to white, In the display step, the section is colored in the corresponding predetermined hue in accordance with the difference value.

2. A method for displaying skin color unevenness as described in claim 1, wherein the evaluation area is rectangular or square.

3. A method for displaying skin color unevenness as described in claim 1 or 2, wherein the evaluation area is square and is 3 x 3 cm or more.

4. A method for displaying skin color unevenness described in any one of claims 1 to 3, wherein the unit block is 1 x 1 mm to 3 x 3 mm.

5. A method for displaying skin color unevenness as described in any one of claims 1 to 4, wherein the evaluation display is displayed in a manner that highlights the area related to the difference that exceeds a reference value.

6. A method for displaying skin color unevenness described in any one of claims 1 to 5, wherein the first point in time is before use of a cosmetic, skin care product and / or medicine, and the second point in time is after use of the cosmetic, skin care product and / or medicine.

7. A method for displaying skin color unevenness described in any one of claims 1 to 6, wherein the skin image is a skin image of the cheek area.

8. A display that displays an evaluation result of color unevenness based on a skin image of a subject, an evaluation chart that displays the evaluation results by coloring sections that are obtained by equally dividing a predetermined display area; the evaluation chart corresponds to unit blocks obtained by equally dividing an evaluation area of ​​the skin image, and indicates evaluation results of the unit blocks in the corresponding units, The unit block has an area of ​​1 / 784 to 1 / 64 of the area of ​​the evaluation region, the evaluation result indicates a difference between a first unevenness index calculated using a skin image at a first time point and a second unevenness index calculated using a skin image at a second time point after the first time point for the same skin region as the skin region for which the first unevenness index was calculated, by coloring the section; The difference is associated in advance with a color of a predetermined hue so that the smaller the difference value is, the lower the luminance is, and the closer the color is to black, and the larger the difference value is, the higher the luminance is, and the closer the color is to white, The section is colored in the predetermined hue corresponding to the value of the difference.

9. The display object according to claim 8 , further comprising a color panel indicating a correspondence between the color used for said coloring and the value of said difference.

10. an image processing means for identifying an evaluation area from a skin image of a subject and dividing the evaluation area into predetermined unit blocks; an unevenness index calculation means for calculating an unevenness index of a color component for each of the unit blocks obtained by the image processing means; a display means for displaying, in a predetermined display area, an evaluation result based on the unevenness index calculated by the unevenness index calculation means for any of a plurality of the unit blocks in the evaluation area, The unit block has an area of ​​1 / 784 to 1 / 64 of the area of ​​the evaluation region, the unevenness index calculation means includes means for calculating a first unevenness index at a first time point, means for calculating a second unevenness index at a second time point after the first time point for the same skin region as the skin region for which the first unevenness index has been calculated, and means for calculating a difference between the first unevenness index and the second unevenness index; the display means is provided at a position within the display area corresponding to a position of the unit block in the evaluation area, and displays an evaluation display showing the evaluation result in a section obtained by equally dividing the display area to generate an evaluation chart; the evaluation indication is a coloring of the section such that the brightness of a predetermined hue changes stepwise in accordance with the value of the difference, The difference and the color of the predetermined hue are previously associated with each other so that the smaller the difference value is, the lower the luminance is, and the color is closer to black, and the larger the difference value is, the higher the luminance is, and the color is closer to white, The display means colors the section in the corresponding predetermined hue in accordance with the value of the difference.

11. Computer, an image processing means for identifying an evaluation area from a skin image of a subject and dividing the evaluation area into predetermined unit blocks; an unevenness index calculation means for calculating an unevenness index of a color component for each of the unit blocks obtained by the image processing means; a display means for displaying, in a predetermined display area, an evaluation result based on the unevenness index calculated by the unevenness index calculation means for any plurality of unit blocks in the evaluation area, The unit block has an area of ​​1 / 784 to 1 / 64 of the area of ​​the evaluation region, the unevenness index calculation means includes means for calculating a first unevenness index at a first time point, means for calculating a second unevenness index at a second time point after the first time point for the same skin region as the skin region for which the first unevenness index has been calculated, and means for calculating a difference between the first unevenness index and the second unevenness index; the display means is provided at a position within the display area corresponding to a position of the unit block in the evaluation area, and displays an evaluation display showing the evaluation result in a section obtained by equally dividing the display area to generate an evaluation chart; the evaluation indication is a coloring of the section such that the brightness of a predetermined hue changes stepwise in accordance with the value of the difference, The difference and the color of the predetermined hue are previously associated with each other so that the smaller the difference value is, the lower the luminance is, and the color is closer to black, and the larger the difference value is, the higher the luminance is, and the color is closer to white, The display means is a skin unevenness display program that colors the section in the corresponding predetermined hue according to the value of the difference.

Citation Information

Patent Citations

  • Method and apparatus for filtering fluid

    JP1987014914A

  • Slurry for cast forming boron nitride powder

    JP1988045176A

  • Apparatus, method and system for processing image, skin evaluation method

    JP2011118671A

  • Skin evaluation method

    JP2018060532A

  • Skin condition evaluation method

    JP4088081B2