Evaluation device, evaluation system, evaluation method, and program

Abstract

An evaluation device (10) is provided with: an acquisition unit (11) that acquires an ultraviolet image obtained by imaging an object on the surface of which a coating film of an ultraviolet protective agent is disposed; an image processing unit (12) that uses the learning model to generate a processed image in which a component of the regular reflection light is removed from the ultraviolet image; an evaluation unit (13) that generates evaluation result data indicating the result of evaluation relating to the ultraviolet protective agent on the basis of the processed image; and an output unit (14) that outputs evaluation result data.

Description

Technical Field

[0001] The present invention relates to an evaluation device, an evaluation system, an evaluation method, and a program. Background Art

[0002] Technologies related to the present invention are disclosed in Patent Documents 1 and 2.

[0003] Patent document 1 discloses an evaluation device having an illumination unit, a detection unit, and an analysis unit. The illumination unit has a first filter that transmits light of a given wavelength band, and irradiates a subject coated with an ultraviolet protective agent with ultraviolet light of a given wavelength band. The detection unit has a second filter that transmits light of a given wavelength band, and detects reflected light of a given wavelength band. The analysis unit estimates the transmittance of ultraviolet light of the ultraviolet protective agent based on the detection result.

[0004] Patent Document 2 discloses a technique for calculating the reflection characteristics (such as the specular reflection component indicating gloss) of an object by inputting an image file (object information) into a learning model that has performed machine learning.

[0005] Prior Art Literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent No. 6742108

[0008] Patent Document 2: Japanese Patent No. 6982910 Summary of the invention

[0009] According to the present invention, there is provided an evaluation device, the evaluation device comprising:

[0010] an acquisition unit that acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protection agent disposed on a surface thereof;

[0011] an image processing unit that generates a processed image by removing a component of regular reflected light from the ultraviolet image using a learning model;

[0012] an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and

[0013] The output unit outputs the evaluation result data.

[0014] Furthermore, according to the present invention, there can be provided an evaluation system, the evaluation system comprising:

[0015] an acquisition unit that acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on a surface thereof;

[0016] an image processing unit that generates a processed image by removing a component of regular reflected light from the ultraviolet image using a learning model;

[0017] an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and

[0018] The output unit outputs the evaluation result data.

[0019] Furthermore, according to the present invention, there can be provided an evaluation method,

[0020] The computer does the following:

[0021] Acquiring an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface,

[0022] using a learning model to generate a processed image in which a component of regular reflection light is removed from the ultraviolet image,

[0023] generating evaluation result data indicating the result of evaluation related to the ultraviolet protection agent based on the processed image,

[0024] The evaluation result data is output.

[0025] Furthermore, according to the present invention, there can be provided a program for causing a computer to function as the following means:

[0026] An acquisition unit acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protection agent disposed on a surface thereof;

[0027] an image processing unit that uses a learning model to generate a processed image obtained by removing a component of regular reflected light from the ultraviolet image;

[0028] an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and

[0029] The output unit outputs the evaluation result data. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 This is a block diagram showing one embodiment of an evaluation device.

[0031] Figure 2 This is a diagram for explaining the processing of the evaluation device.

[0032] Figure 3 This is a diagram for explaining an example of the hardware configuration of the evaluation device.

[0033] Figure 4This is an example of a functional block diagram of an evaluation device.

[0034] Figure 5 This is a diagram for explaining teaching data.

[0035] Figure 6 FIG. 1 is a diagram showing an example of an image output by the evaluation device.

[0036] Figure 7 This is a flowchart showing an example of the flow of processing of the evaluation device.

[0037] Figure 8 This is a block diagram showing another embodiment of the evaluation device.

[0038] Fig. 9 FIG. 1 is a diagram showing an example of an image displayed on a user terminal during image capture.

[0039] Fig.10 is an example of a functional block diagram of an evaluation system.

[0040] Fig.11 This is a diagram for explaining the evaluation criteria.

[0041] Fig.12 An example of "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image not containing a component of regular reflection light" and "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image removing a component of regular reflection light (an image generated by a generator)". DETAILED DESCRIPTION

[0042] A technology that can easily perform various evaluations (evaluation of uneven coating, performance evaluation, etc.) related to ultraviolet protection agents is desired. In the case of the technology disclosed in Patent Document 1, each user who performs various evaluations related to ultraviolet protection agents needs to have a large-scale device such as disclosed in Patent Document 1. The technology disclosed in Patent Document 2 does not directly perform various evaluations related to ultraviolet protection agents.

[0043] An object of the present invention is to provide a technique for easily performing various evaluations related to ultraviolet protection agents.

[0044] According to the present invention, a technique for easily performing various evaluations related to ultraviolet shielding agents can be realized.

[0045] <First embodiment>

[0046] "summary"

[0047] The overview of the evaluation device of this embodiment is described below. Figure 1As shown, the evaluation device 10 of this embodiment is a server 1. The evaluation device 10 cooperates with the user terminal 20 to perform various evaluations related to the ultraviolet protective agent and provides a service (hereinafter, sometimes referred to as "evaluation service"), which provides results. The various evaluations are uneven coating evaluation of the ultraviolet protective agent, performance evaluation, etc. For example, the user can use the evaluation service to confirm whether the ultraviolet protective agent can be accurately applied (that is, whether there is no uneven coating). In addition, the user can use the evaluation service to confirm the performance of a given ultraviolet protective agent.

[0048] The user uses an ultraviolet camera to take a picture of his / her own face etc. on which the ultraviolet protective agent is applied. Then, the user sends the ultraviolet image generated by the ultraviolet camera to the evaluation device 10 via the user terminal 20. The evaluation device 10 performs the above-mentioned various evaluations based on the received ultraviolet image and sends the evaluation results to the user terminal 20.

[0049] However, if Figure 2 As shown, when an object having a coating film of an ultraviolet protective agent disposed on its surface is irradiated with ultraviolet rays, the following components can be generated: regular reflection light (1) regularly reflected on the surface of the coating film of the ultraviolet protective agent, regular reflection light (2) regularly reflected on the surface of the object after entering the ultraviolet protective agent, and internal scattered light components scattered inside the object. Furthermore, the above three components can be included in the ultraviolet image of the object. The evaluation device 10 of this embodiment performs various evaluations such as coating unevenness evaluation and performance evaluation based on the intensity of the internal scattered light, and the regular reflection light (1) and the regular reflection light (2) become unnecessary components. For this purpose, the evaluation device 10 uses a pre-prepared learning model to remove the regular reflection light (1) and the regular reflection light (2) components from the ultraviolet image, and performs the above various evaluations based on the ultraviolet image after these components are removed.

[0050] According to the system including such processing device 10 and user terminal 20, the user can easily perform various evaluations related to the ultraviolet shielding agent.

[0051] "Hardware Structure"

[0052] Next, an example of the hardware structure of the evaluation device 10 is described. Each functional unit of the evaluation device 10 is realized by an arbitrary combination of hardware and software, centered on a CPU (Central Processing Unit) of an arbitrary computer, a memory, a program loaded into the memory, a storage unit such as a hard disk storing the program (in addition to the program stored in advance at the factory stage of the device, it can also store programs downloaded from a storage medium such as a CD (Compact Disc), a server on the Internet, etc.), and a network connection interface. In addition, it can be understood by those skilled in the art that there are various variations of its implementation method and device.

[0053] Figure 3 2 is a block diagram illustrating the hardware structure of the evaluation device 10. Figure 3 As shown, the evaluation device 10 includes: a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The evaluation device 10 may not include the peripheral circuit 4A. In addition, the evaluation device 10 may also be composed of multiple devices that are physically and / or logically separated. In this case, the multiple devices can each have the above-mentioned hardware structure.

[0054] The bus 5A is a data transmission path for the processor 1A, the memory 2A, the peripheral circuit 4A and the input / output interface 3A to send and receive data to each other. The processor 1A is, for example, a CPU, a GPU (Graphics Processing Unit) or other computing processing device. The memory 2A is, for example, a RAM (Random Access Memory), a ROM (Read Only Memory) or other memory. The input / output interface 3A includes an interface for obtaining information from an input device, an external device, an external server, an external sensor, a camera (a normal camera, an ultraviolet camera, etc.), and an interface for outputting information to an output device, an external device, an external server, etc. The input device is, for example, a keyboard, a mouse, a microphone, a physical button, a touch panel, etc. The output device is, for example, a display, a speaker, a printer, etc. The processor 1A can issue instructions to each module and perform calculations based on their calculation results.

[0055] "Functional Structure"

[0056] Next, the functional structure of the evaluation device 10 of this embodiment will be described in detail. Figure 4 2 shows an example of a functional block diagram of the evaluation device 10. As shown in the figure, the evaluation device 10 includes an acquisition unit 11, an image processing unit 12, an evaluation unit 13, and an output unit 14.

[0057] The acquisition unit 11 acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface. The acquisition unit 11 acquires the ultraviolet image sent by the user of the above-mentioned evaluation service using the user terminal 20. In addition, in this evaluation service, when photographing the ultraviolet image, the user does not need to perform an operation for removing the components of regular reflection light (1) and regular reflection light (2). That is, the user does not need to perform the process disclosed in Patent Document 1 of removing the components of regular reflection light (1) and regular reflection light (2) using a polarizing plate. Therefore, the user can easily use this evaluation service. Due to this premise, the ultraviolet image acquired by the acquisition unit 11 can include not only the components of internal scattered light, but also the components of regular reflection light (1) and regular reflection light (2).

[0058] “Ultraviolet protection agents” include preparations containing ultraviolet absorbers (2-ethylhexyl p-methoxycinnamate, tert-butyl methoxydibenzoylmethane, etc.) and / or ultraviolet scatterers (microparticle titanium oxide, microparticle zinc oxide, etc.). Preparations may be in the form of liquid, gel, semisolid, solid, foam, mist, or sheet. The present invention can be applied to all ultraviolet protection agents, but is particularly preferably applied to the case where an ultraviolet protection agent containing an ultraviolet absorber is disposed on the surface of an object.

[0059] The “object” is exemplified as a living body such as a human body, but is not limited thereto and may be other objects.

[0060] The “surface of the object” is exemplified by the outer surface of a living body such as skin, hair, nails, and eyes, but is not limited thereto and may be the outer surface of another object.

[0061] "Disposition" refers to the state in which the coating film of the ultraviolet protection agent is placed in contact with the surface of the object. The placement method can be any means such as coating, pasting, bonding, etc.

[0062] The acquisition unit 11 acquires the ultraviolet image transmitted from the user terminal 20 .

[0063] Examples of the “user terminal 20 ” include a smartphone, a tablet terminal, a mobile phone, a portable game console, a personal computer, a smartphone, a smart mirror, a digital camera, etc., but the present invention is not limited thereto.

[0064] The “ultraviolet image” is an image captured / generated by an ultraviolet camera having a sensor for detecting ultraviolet rays.

[0065] The user terminal 20 may also have an ultraviolet camera function for photographing ultraviolet images. This function may be realized by connecting a given device to the user terminal 20 or installing given software, or may be pre-set in the user terminal 20 from the factory stage. After the user uses the user terminal 20 to photograph the ultraviolet image, the user may send the ultraviolet image from the user terminal 20 to the evaluation device 10. In addition, since indoor lighting generally does not contain ultraviolet rays, a light source containing ultraviolet rays is used in indoor photography. For example, an LED containing ultraviolet rays may be installed in the user terminal 20 for use.

[0066] In addition, the user may also use an ultraviolet camera as an external device logically and / or physically separated from the user terminal 20 to capture the ultraviolet image. Furthermore, the user may input the ultraviolet image to the user terminal 20 by any means, and transmit the ultraviolet image from the user terminal 20 to the evaluation device 10. A light source containing ultraviolet light is used in indoor video recording. For example, an LED containing ultraviolet light may be installed in the ultraviolet camera for use.

[0067] like Figure 1 As shown, the evaluation device 10 and the user terminal 20 are connected to a communication network 30 such as the Internet. The transmission and reception of the ultraviolet image between the user terminal 20 and the evaluation device 10 is achieved via the communication network 30. For example, an application (software) dedicated to the evaluation service may be installed in the user terminal 20. Furthermore, the transmission (upload) of the ultraviolet image from the user terminal 20 to the evaluation device 10 may be achieved via the function installed in the application. In addition, a web page dedicated to the evaluation service may be prepared. Furthermore, after accessing the web page via a web browser installed in the user terminal 20, the transmission (upload) of the ultraviolet image from the user terminal 20 to the evaluation device 10 may be achieved via the function installed in the web page. In addition, the transmission and reception of the ultraviolet image may be achieved by other means such as the transmission and reception of an attached file as an e-mail.

[0068] The image processing unit 12 generates a processed image by removing the component of regular reflection light from the ultraviolet image using the learning model. Figure 2 Components of regular reflection light (1) and regular reflection light (2) are described.

[0069] A learning model is prepared in advance for generating “an image in which components of regular reflection light are removed” from “an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protection agent disposed on the surface”.

[0070] The means for generating the learning model is not particularly limited, and all means can be used. For example, the technology disclosed in Patent Document 2 can also be used. An example of the means for generating the learning model will be described below.

[0071] A learning model is generated by machine learning based on multiple teaching data, wherein the teaching data sets a pair of "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image containing a component of regular reflection light" and "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image not containing a component of regular reflection light".

[0072] exist Figure 5 An example of teaching data is shown in FIG. Figure 5 The image (A) is “an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image including a component of regular reflection light”. Figure 5 The image (B) is "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, and the ultraviolet image does not contain a component of regular reflection light." A commercially available O / W type ultraviolet protective agent was added at 1.0 mg / cm 2 When the amount of application is applied to the face, the light source uses a general xenon light source containing ultraviolet rays, and the camera uses a general ultraviolet camera equipped with a bandpass filter of 315nm to 325nm in the ultraviolet region, thereby capturing the image.

[0073] The means for generating the teaching data is not particularly limited, but it can usually be generated using a light source, an ultraviolet camera, and a polarizing plate. For example, the technology disclosed in Patent Document 1 can be used. By properly adjusting the first polarizing plate and the second polarizing plate in the technology disclosed in Patent Document 1, the component of the regular reflection light can be transmitted or removed. In the case where the adjustment is made to transmit the component of the regular reflection light, it is possible to capture "an ultraviolet image obtained by capturing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image containing the component of the regular reflection light". On the other hand, in the case where the adjustment is made to remove the component of the regular reflection light, it is possible to capture "an ultraviolet image obtained by capturing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image not containing the component of the regular reflection light".

[0074] In addition, when "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image does not include a component of regular reflection light" is used as teaching data, the brightness of the generated "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image does not include a component of regular reflection light" can be adjusted for use.

[0075] As an example of a learning method, a case of using a generator and a discriminator is described.

[0076] The generator is composed of, for example, a multi-stage convolutional neural network (CCN) so that "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image containing a component of regular reflection light" is generated as teaching data: "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image having the component of regular reflection light removed."

[0077] The identifier is configured to obtain a difference image between "an ultraviolet image obtained by photographing an object with a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image not containing a component of regular reflection light" as teaching data and "an ultraviolet image obtained by photographing an object with a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image removing a component of regular reflection light" generated by a generator, and to identify the two images as different when a rule for judging that the difference is large is not satisfied, such as when the degree of consistency is above a given ratio.

[0078] Furthermore, the parameters of the recognizer, i.e., the given value of the difference, are adjusted so that the two images can be recognized, and the parameters of the generator are adjusted so that an image that the recognizer cannot correctly recognize can be generated. The generator having the parameters obtained after the adjustment becomes the learning model used in the present invention.

[0079] In addition, a commercial product A (EVITA Moisture Protection UV by Kao Corporation) containing a UV absorber as a UV protection agent was added at 1 mg / cm 2 Apply to a 4 cm square portion of the face. Under the condition that the applied area and the unapplied area are included, "an ultraviolet image obtained by photographing an object with a coating of an ultraviolet protective agent disposed on the surface, the ultraviolet image does not contain the component of regular reflection light" and "an ultraviolet image obtained by photographing an object with a coating of an ultraviolet protective agent disposed on the surface, the ultraviolet image removes the component of regular reflection light (image generated by the generator)" are obtained. A total of 3 images are used to confirm their consistency, and the consistency is about 80.0%. Fig.12An example of two images with a consistency of about 80.0% is shown in the figure. The "image that does not contain regular reflection light through the polarizing plate" is "an ultraviolet image obtained by photographing an object with a coating of ultraviolet protective agent configured on the surface, and the ultraviolet image does not contain the component of regular reflection light". And, the "image obtained by removing regular reflection light through machine learning" is "an ultraviolet image obtained by photographing an object with a coating of ultraviolet protective agent configured on the surface, and the ultraviolet image removes the component of regular reflection light (image generated by the generator)". The consistency is calculated by the following steps.

[0080] (1) Using ImageJ, luminance value data of an area of ​​80×80 pixels with uneven coating (including uncoated areas) were extracted from an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image not including a component of regular reflection light.

[0081] (2) Use Excel to create a graph with brightness on the horizontal axis and number of pixels on the vertical axis. Calculate the moving average of the five nearby points and set the point where the difference with the adjacent cell switches from negative to positive as the minimum value.

[0082] (3) The integrated value from the brightness value 0 to the minimum brightness value is defined as the painted area (integral value 1), and the ratio (integral value 1 / integral value 2) of the integrated value of the entire histogram (integral value 2) is calculated.

[0083] (4) For the range extracted in the above (1), "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image having the component of regular reflected light removed (an image generated by a generator)", the steps from (2) to (4) are similarly performed to obtain a ratio. The range arbitrarily extracted in the above (1) exists in three locations for one image.

[0084] (5) Compare the ratio calculated from "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image not containing a component of regular reflection light" and the ratio calculated from "an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, the ultraviolet image having removed a component of regular reflection light (an image generated by a generator)", and calculate the degree of consistency.

[0085] Similarly, when commercial product B (Sensai Silky Bronze Cellular Protective Cream for Body manufactured by Kao Corporation) containing an ultraviolet absorber and an ultraviolet scatterer was used, the degree of consistency was about 70.0%.

[0086] The image processing unit 12 inputs the ultraviolet image acquired by the acquisition unit 11 to the learning model, and acquires a “processed image obtained by removing the component of regular reflection light from the ultraviolet image” output from the learning model.

[0087] The evaluation unit 13 evaluates the ultraviolet shielding agent based on the processed image generated by the image processing unit 12 , and generates evaluation result data indicating the result of the evaluation.

[0088] The evaluation unit 13 performs at least one of the evaluation of uneven coating of the ultraviolet protective agent and the evaluation of the performance of the ultraviolet protective agent as an evaluation related to the ultraviolet protective agent. The evaluation unit 13 may be configured to perform only one of the evaluation of uneven coating of the ultraviolet protective agent and the evaluation of the performance of the ultraviolet protective agent, or may be configured to perform both. Each of them will be described below.

[0089] - Evaluation of uneven coating of UV protection agent -

[0090] In the evaluation of coating unevenness of this embodiment, the following evaluations can be performed:

[0091] Evaluation to identify coated and uncoated areas, and

[0092] Evaluation is performed to identify, among the coated areas, areas where the coating amount is appropriate (not too much or too little) and areas where the coating amount is inappropriate (too much or too little).

[0093] In the processed image obtained by removing the component of regular reflected light from the ultraviolet image, the state of each part of the surface of the object shown in the processed image represents the degree of intensity of the internal scattered light reflected at each part. The degree of intensity of the internal scattered light reflected at each part corresponds to the amount of ultraviolet protective agent applied at each part. The greater the amount of ultraviolet protective agent applied, the weaker the intensity of the reflected internal scattered light. In addition, the degree of intensity of ultraviolet rays (internal scattered light) reflected at each part, that is, the degree of ultraviolet protective agent applied at each part, can be evaluated using the brightness value of the processed image. Fig.11 As shown in FIG. 1 , when the amount of UV protectant applied is small, the intensity of internal scattered light becomes strong and the brightness value becomes large. On the other hand, when the amount of UV protectant applied is large, the intensity of internal scattered light becomes weak and the brightness value becomes small. An appropriate threshold is set based on the brightness value of the processed image of the part where the UV protectant is applied in an appropriate amount, and by comparing the brightness value of each part of the processed image with the threshold, it is possible to determine whether the amount of UV protectant applied in each part is appropriate.

[0094] like Fig.11As shown, when the upper limit of the brightness value of the portion where the appropriate amount of ultraviolet protective agent is applied is set as the first threshold value, the portion where the intensity of the detected internal scattered light (brightness value) is greater than the first threshold value is a portion where the ultraviolet protective agent is not applied at all, or a portion where the ultraviolet protective agent is applied but the amount applied is inappropriate (too little). In addition, when the lower limit of the brightness value of the portion where the appropriate amount of ultraviolet protective agent is applied is set as the second threshold value, the portion where the intensity of the detected internal scattered light (brightness value) is less than the second threshold value is a portion where the ultraviolet protective agent is applied but the amount applied is inappropriate (too much). The portion where the intensity of the detected internal scattered light (brightness value) is between the first threshold value and the second threshold value is a portion where the ultraviolet protective agent is applied and the amount applied is appropriate.

[0095] The evaluation unit 13 can detect a portion where the intensity (brightness value) of ultraviolet rays scattered in the object (internal scattered light) is greater than the first threshold value as a portion where the amount of ultraviolet protection agent applied is less than the first reference. The evaluation unit 13 can also generate evaluation result data indicating the detection result.

[0096] The "first criterion" is a criterion for judging whether the amount of UV protection agent applied is acceptable (the portion with less application). The first criterion is judged based on the first threshold value. The first threshold value is defined by the brightness value of the processed image. The first threshold value is the brightness value of the processed image of the portion where the UV protection agent is applied in the lower limit amount within the appropriate amount range. Fig.11 As shown in FIG. 1 , the first threshold is the upper limit of the unqualified level judged as an inappropriate (too little) amount of application. In other words, the first threshold is the lower limit of the qualified level judged as an appropriate amount of application. In the processed image, the portion with a brightness value greater than the first threshold (brightness value) is judged as an inappropriate (small) amount of application of the ultraviolet protection agent. The portion with too little application cannot obtain a sufficient ultraviolet protection effect.

[0097] The evaluation unit 13 can generate an image in which the result of the uneven application evaluation of the ultraviolet protection agent is superimposed on the image representing the object as the evaluation result data. Specifically, the evaluation unit 13 can superimpose information indicating a portion where the amount of ultraviolet protection agent applied is less than the first reference (a portion where the brightness value is greater than the first threshold value) on the image representing the object, and generate an image in which the portion is prominently identifiable and displayed.

[0098] Figure 6 An example of an image generated by the evaluation unit 13 is schematically shown. Figure 6, the image generated by the evaluation unit 13 is shown as being displayed on the display D of the user terminal 20. In the example shown in the figure, the object is a human body. In addition, a frame M with a part of the area surrounded by a dotted line is superimposed on the image representing the object. The portion surrounded by the frame M is a portion where the amount of ultraviolet protective agent applied is less than the first reference. In the example shown in the figure, a suggestion for applying a little more ultraviolet protective agent is also displayed in the portion surrounded by the frame M.

[0099] In the example shown in the figure, the given part is conspicuously displayed by being surrounded by a frame M. Alternatively, the given part may be colored or an icon or stamp may be displayed on the given part to make it conspicuously displayed.

[0100] The “image representing the object” may be an ultraviolet image acquired by the acquisition unit 11 or a processed image generated by the image processing unit 12. In addition to the ultraviolet image, the acquisition unit 11 may also acquire an image obtained by photographing the object by a normal camera (a camera having a sensor that detects light in the visible light region) from the user terminal 20. And, the image may be used as the above-mentioned “image representing the object”. In addition, the image displayed on the viewfinder (display) of the user terminal 20 when the camera function is activated may be used as the above-mentioned “image representing the object”.

[0101] As another example, Fig.11 As shown, the evaluation unit 13 can detect a portion where the intensity (brightness value) of ultraviolet rays scattered in the object (internal scattered light) is smaller than the second threshold value as a portion where the amount of ultraviolet protection agent applied is greater than the second reference. Furthermore, the evaluation unit 13 can generate evaluation result data indicating the detection result.

[0102] The "second criterion" is another criterion for judging whether the amount of UV protection agent applied is acceptable (the portion with a larger amount of application). The second criterion is judged based on the second threshold value. The second threshold value is defined by the brightness value of the processed image. The second threshold value is the brightness value of the processed image where the UV protection agent of the upper limit of the appropriate amount range is applied. Fig.11 As shown, the second threshold is the lower limit value of the unqualified level judged as an inappropriate (large) amount of application. In other words, the second threshold is the upper limit value of the qualified level judged as an appropriate amount of application. The portion with a brightness value smaller than the second threshold (brightness value) in the processed image is judged as an inappropriate (excessive) amount of application of the ultraviolet protective agent. The portion with excessive application becomes the cause of the deterioration of the feeling of use. In addition, excessive consumption will cause unnecessary purchase of ultraviolet protective agents (wasteful use), or excessive application will cause the washing of excessive ultraviolet protective agents, thereby increasing the environmental load, which is not preferred from the perspective of SDGs.

[0103] The evaluation unit 13 can be used with Figure 6 The evaluation result data representing the detection result is generated by the same method as that shown in . In the case of this example, the evaluation unit 13 can overlap the information (frame M) representing the part where the amount of ultraviolet protective agent applied is greater than the second reference on the image representing the object, and generate an image that allows the part to be conspicuously identified and displayed. In the case of this example, it is also possible to notify that excessive ultraviolet protective agent has been applied to the part surrounded by the frame M, and also display a suggestion to apply a little more ultraviolet protective agent to other parts. In addition, the evaluation unit 13 can also be used in conjunction with Figure 6 The same method as that shown in the figure is used to generate and output an image in which both the portion where the amount of ultraviolet protection agent applied is less than the first reference (failure: too little) and the portion where the amount of ultraviolet protection agent applied is more than the second reference (failure: too much) are prominently displayed for identification. For example, the evaluation unit 13 may generate and output an image in which both the portion where the amount of ultraviolet protection agent applied is less than the first reference (failure: too little) and the portion where the amount of ultraviolet protection agent applied is more than the second reference (failure: too much) are identifiably displayed on the same screen.

[0104] The evaluation unit 13 determines that the amount of ultraviolet protective agent applied is appropriate (qualified: not too much, not too little) in a portion where the degree (brightness value) of the detected intensity of ultraviolet rays (internal scattered light) is smaller than the first threshold value (the amount of ultraviolet protective agent applied is more than the first reference) and larger than the second threshold value (the amount of ultraviolet protective agent applied is less than the second reference).

[0105] -Performance Evaluation-

[0106] The evaluation unit 13 can divide the detected ultraviolet rays by an arbitrary value to detect the ultraviolet reflectivity. The lower the ultraviolet reflectivity, the higher the ultraviolet protection effect. The evaluation unit 13 can generate evaluation result data representing the ultraviolet reflectivity. In addition, the ultraviolet protection effect of the ultraviolet protective agent can be evaluated based on the ultraviolet reflectivity. In addition, as an arbitrary value, it can be the average ultraviolet reflection intensity of human bare skin, etc., or it can be the ultraviolet reflection intensity of the object before the ultraviolet protective agent is applied. For example, it can be calculated using any of the following mathematical formulas.

[0107] (UV reflectivity) = (UV reflectivity of skin with UV protection agent applied) / (average UV reflectivity of bare skin without UV protection agent applied)

[0108] (Ultraviolet reflectivity) = (Ultraviolet reflection intensity of the object coated with the UV protective agent) / (Ultraviolet reflection intensity of the object between the UV protective agents)

[0109] Return to Figure 4 The output unit 14 outputs the evaluation result data generated by the evaluation unit 13. The output unit 14 sends the evaluation result data to the user terminal 20. The user terminal 20 outputs the received evaluation result data via an output device such as a display, a projector, or a printer.

[0110] Next, use Figure 7 An example of the process flow of the evaluation device 10 will be described with reference to the flowchart of FIG.

[0111] First, the evaluation device 10 acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface ( S10 ). The evaluation device 10 acquires the ultraviolet image transmitted from the user terminal 20 .

[0112] Next, the evaluation device 10 generates a processed image by removing the component of regular reflection light from the ultraviolet image using the learning model ( S11 ). Next, the evaluation device 10 evaluates the ultraviolet shielding agent based on the processed image and generates evaluation result data indicating the evaluation result ( S12 ).

[0113] Then, the evaluation device 10 outputs the evaluation result data generated in S12 (S13). The evaluation device 10 transmits the evaluation result data to the user terminal 20. The user terminal 20 outputs the received evaluation result data via an output device such as a display, a projector, or a printer (see Figure 6 ).

[0114] "Effects"

[0115] According to the evaluation device 10 of this embodiment, the user can perform various evaluations related to the ultraviolet protective agent, specifically, coating unevenness evaluation and performance evaluation, by taking a photo of the ultraviolet image and sending the ultraviolet image to the evaluation device 10. In this way, according to the evaluation device 10 of this embodiment, the user can easily perform various evaluations related to the ultraviolet protective agent.

[0116] Furthermore, according to the evaluation device 10 of this embodiment, Figure 6 As shown, an image can be generated and outputted in which at least one of a portion where the amount of UV protection agent applied is less than the first reference and a portion where the amount of UV protection agent applied is more than the second reference is prominently displayed. Based on the image, the user can intuitively understand the portion where the UV protection agent is insufficiently applied and the portion where the UV protection agent is excessively applied. In addition, an ideal coating state with less uneven coating can be obtained.

[0117] In addition, the evaluation device 10, which uses a learning model to generate a "processed image obtained by removing the component of regular reflected light from the ultraviolet image" and performs an evaluation related to the ultraviolet protectant based on the processed image, can generate an ultraviolet image from which the component of regular reflected light is removed without using a polarizing plate, and perform an evaluation related to the ultraviolet protectant based on the ultraviolet image.

[0118] <Second embodiment>

[0119] As described in the first embodiment, the evaluation device 10 of this embodiment detects a portion where the intensity (brightness value) of the ultraviolet rays scattered in the object (internal scattered light) is greater than the first threshold as a portion where the amount of ultraviolet protection agent applied is less than the first reference (a portion where the amount of application is too small). In addition, the evaluation device 10 detects a portion where the intensity (brightness value) of the ultraviolet rays scattered in the object (internal scattered light) is less than the second threshold as a portion where the amount of ultraviolet protection agent applied is more than the second reference (a portion where the amount of application is too large). In addition, the evaluation device can dynamically change the first threshold and the second threshold. This will be described in detail below.

[0120] As described in the first embodiment, the evaluation unit 13 can detect a portion where the intensity (brightness value) of ultraviolet rays scattered in the object (internally scattered light) is greater than the first threshold value as a portion where the amount of ultraviolet protection agent applied is less than the first reference (a portion where the amount of application is too small).

[0121] Furthermore, the evaluation unit 13 determines the first threshold value based on at least one of the date and time of the evaluation and the forecast of the ultraviolet amount. That is, the first threshold value for judging whether the application amount is "appropriate" or "insufficient (too little)" is determined based on at least one of the date and time of the evaluation and the forecast of the ultraviolet amount.

[0122] In addition, as described in the first embodiment, the evaluation unit 13 is able to detect a portion where the intensity (brightness value) of ultraviolet rays scattered in the object (internally scattered light) is smaller than the second threshold value as a portion where the amount of ultraviolet protection agent applied is greater than the second reference (a portion where the amount of application is excessive).

[0123] The evaluation unit 13 determines the second threshold value based on at least one of the date and time of evaluation and the forecast of the ultraviolet amount. In other words, the evaluation unit 13 determines the second threshold value for judging that the amount of application is excessive based on at least one of the date and time of evaluation and the forecast of the ultraviolet amount.

[0124] The amount of ultraviolet rays irradiated to the ground varies according to the season. Therefore, as a countermeasure against ultraviolet rays, the amount of ultraviolet protection agent to be applied to the human body, etc., also varies according to the season. By performing the uneven coating evaluation described in the first embodiment with an appropriate benchmark corresponding to the season at the time of evaluation, it is possible to provide the user with an appropriate evaluation result corresponding to the season.

[0125] Correspondence information in which a date is associated with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10. In the correspondence information, the first threshold value is smaller in a season with more ultraviolet rays, and the first threshold value is larger in a season with less ultraviolet rays. In addition, in the correspondence information, the second threshold value is smaller in a season with more ultraviolet rays, and the second threshold value is larger in a season with less ultraviolet rays.

[0126] After obtaining the date of evaluation by any means, the evaluation unit 13 obtains at least one of the first threshold and the second threshold corresponding to the obtained date from the corresponding information, and uses at least one of the obtained first threshold and the second threshold to perform the evaluation described in the first embodiment.

[0127] In addition, the amount of ultraviolet rays irradiated on the ground varies depending on the time. Therefore, as a countermeasure against ultraviolet rays, the amount of ultraviolet protection agent to be applied to the human body, etc., also varies depending on the time. By performing the uneven coating evaluation described in the first embodiment with an appropriate benchmark corresponding to the time of evaluation, an appropriate evaluation result can be provided to the user.

[0128] Correspondence information that associates the time with at least one of the first threshold value and the second threshold value is generated in advance and registered in the evaluation device 10. In the correspondence information, the more the ultraviolet light amount is, the smaller the first threshold value is, and the less the ultraviolet light amount is, the larger the first threshold value is. In addition, in the correspondence information, the more the ultraviolet light amount is, the smaller the second threshold value is, and the less the ultraviolet light amount is, the larger the second threshold value is.

[0129] After obtaining the time of evaluation by any means, the evaluation unit 13 obtains at least one of the first threshold and the second threshold corresponding to the obtained time from the corresponding information, and uses at least one of the obtained first threshold and the second threshold to perform the evaluation described in the first embodiment.

[0130] In recent years, a forecast of ultraviolet light (called an ultraviolet index) has been published. By performing the coating unevenness evaluation described in the first embodiment with an appropriate criterion according to the content of the forecast, an appropriate evaluation result can be provided to the user.

[0131] Correspondence information is generated in advance, which corresponds the amount of ultraviolet rays indicated in the forecast to at least one of the first threshold value and the second threshold value, and is registered in the evaluation device 10. In the correspondence information, the larger the predicted amount of ultraviolet rays, the smaller the first threshold value, and the smaller the predicted amount of ultraviolet rays, the larger the first threshold value. In addition, in the correspondence information, the larger the predicted amount of ultraviolet rays, the smaller the second threshold value, and the smaller the predicted amount of ultraviolet rays, the larger the second threshold value.

[0132] After obtaining the contents of the forecast at the time of evaluation by any means, the evaluation unit 13 obtains at least one of the first threshold value and the second threshold value corresponding to the contents of the obtained forecast from the corresponding information, and uses at least one of the obtained first threshold value and the second threshold value to perform the evaluation described in the first embodiment. In addition, the amount of ultraviolet rays shown in the forecast may be expressed in "mW / cm 2 ” or the like, or may be expressed in any other way such as “strong, relatively strong, normal, relatively weak, weak” or the like.

[0133] As described above, the evaluation unit 13 can determine at least one of the first threshold value and the second threshold value, and can evaluate the uneven application of the ultraviolet protection agent based on the determined content. The other configurations of the evaluation device 10 of this embodiment are the same as those of the first embodiment.

[0134] According to the evaluation device 10 of this embodiment, the same effects as those of the evaluation device 10 of the first embodiment can be achieved. In addition, according to the evaluation device 10 of this embodiment, the coating unevenness evaluation can be performed with appropriate criteria corresponding to the season, time, content of the forecast of the ultraviolet amount, etc. As a result, the user can be provided with appropriate evaluation results corresponding to the current situation.

[0135] <Third embodiment>

[0136] The evaluation device 10 of this embodiment can dynamically change the first threshold and the second threshold related to the degree (brightness value) of the “intensity of the detected ultraviolet light (internal scattered light)” described in the first embodiment in a different method from the second embodiment. This will be described in detail below.

[0137] The evaluation unit 13 acquires information indicating the planned action input by the user. The information indicates at least one of the length of time for going out and the time of going out. The user operates the user terminal 20 to input the information. Then, the information is transmitted from the user terminal 20 to the evaluation device 10.

[0138] The means for accepting the user input can be implemented using any technology. For example, it can also be implemented using an application (software) dedicated to the evaluation service installed on the user terminal 20. In addition, an input form for accepting the input of the information can also be set on a web page dedicated to the evaluation service.

[0139] Correspondence information that associates the length of time spent out with at least one of the first threshold and the second threshold is generated in advance and registered in the evaluation device 10. In the correspondence information, the longer the time spent out, the smaller the first threshold, and the shorter the time spent out, the larger the first threshold. In addition, in the correspondence information, the longer the time spent out, the smaller the second threshold, and the shorter the time spent out, the larger the second threshold.

[0140] After determining the length of time spent away from home based on the information indicating the planned action input by the user, the evaluation unit 13 obtains at least one of a first threshold and a second threshold corresponding to the determined length of time from the corresponding information, and uses at least one of the first threshold and the second threshold obtained to perform the evaluation described in the first embodiment.

[0141] In addition, correspondence information is generated in advance to associate the time of going out with at least one of the first threshold value and the second threshold value, and is registered in the evaluation device 10. In the correspondence information, the more the ultraviolet light amount is, the smaller the first threshold value is, and the less the ultraviolet light amount is, the larger the first threshold value is. In addition, in the correspondence information, the more the ultraviolet light amount is, the smaller the second threshold value is, and the less the ultraviolet light amount is, the larger the second threshold value is.

[0142] After determining the time of going out based on the information indicating the planned action input by the user, the evaluation unit 13 obtains at least one of the first threshold value and the second threshold value corresponding to the determined time from the corresponding information. In addition, when the time of going out is long and there are many times of going out, the minimum value among the multiple first threshold values ​​corresponding to these times can also be obtained. In addition, when the time of going out is long and there are many times of going out, the minimum value among the multiple second threshold values ​​corresponding to these times can also be obtained. And the evaluation unit 13 uses at least one of the first threshold value and the second threshold value obtained to perform the evaluation described in the first embodiment.

[0143] The other structures of the evaluation device 10 of this embodiment are the same as those of the first embodiment and the second embodiment.

[0144] According to the evaluation device 10 of this embodiment, the same effects as those of the evaluation device 10 of the first embodiment and the second embodiment can be achieved. In addition, according to the evaluation device 10 of this embodiment, the coating unevenness evaluation can be performed with an appropriate criterion corresponding to the user's action plan. As a result, the user can be provided with an appropriate evaluation result corresponding to the situation.

[0145] <Fourth embodiment>

[0146] like Figure 8 As shown, the evaluation device 10 of this embodiment is not the server 1 but the user terminal 20, which is different from the first to third embodiments.

[0147] By installing an application (software) dedicated to the evaluation service in the user terminal 20 , the evaluation device 10 including the acquisition unit 11 , the image processing unit 12 , the evaluation unit 13 , and the output unit 14 can be realized in the user terminal 20 .

[0148] The acquisition unit 11 of this embodiment acquires the ultraviolet image by photographing the ultraviolet image using the ultraviolet camera function of the user terminal 20 (evaluation device 10). The functions of the image processing unit 12 and the evaluation unit 13 are as described in the first to third embodiments. The output unit 14 outputs the evaluation result data via an output device such as a display, a projector, or a printer (see Figure 6 ). In addition, since indoor lighting generally does not contain ultraviolet rays in many cases, a light source containing ultraviolet rays is used in indoor imaging. For example, an LED containing ultraviolet rays can also be installed in the user terminal 20 (evaluation device 10) for use.

[0149] The other structures of the evaluation device 10 of this embodiment are the same as those of the first to third embodiments.

[0150] According to the evaluation device 10 of this embodiment, the same effects as those of the evaluation device 10 of the first to third embodiments can be achieved. In addition, according to the evaluation device 10 of this embodiment, all processing can be completed within the evaluation device 10. Therefore, even in a situation where communication with an external device is impossible, the user can use the evaluation service.

[0151] <Fifth embodiment>

[0152] like Fig.10As shown, in this embodiment, the evaluation device of the present invention has an acquisition unit 11, an image processing unit 12, an evaluation unit 13, and an output unit 14, which constitute an evaluation system 100. The evaluation system 100 is composed of a plurality of devices, and the plurality of devices are connected to each other in a communicable manner via a communication network 30 composed of a dedicated line or a public line. As an example, the evaluation system 100 is composed of a server 1 and at least one, preferably a plurality of user terminals 20.

[0153] The plurality of functional units (acquisition unit 11, image processing unit 12, evaluation unit 13, and output unit 14) of the evaluation system 100 include any of a plurality of devices. As an example, the plurality of user terminals 20 may include the acquisition unit 11 and the output unit 14, respectively, and the server 1 may include the image processing unit 12 and the evaluation unit 13. As another example, the plurality of user terminals 20 may include the acquisition unit 11, the image processing unit 12, and the output unit 14, respectively, and the server 1 may include the evaluation unit 13. As another example, the plurality of user terminals 20 may include the acquisition unit 11, the evaluation unit 13, and the output unit 14, respectively, and the server 1 may include the image processing unit 12. In addition, the combination illustrated here is only an example, and the evaluation system 100 can adopt all combinations. For the ease of replacing the learning model, the server 1 preferably includes the image processing unit 12 that includes at least the learning model. In addition, since there are many cases where indoor lighting does not generally contain ultraviolet rays, a light source containing ultraviolet rays is used in indoor video. For example, an LED including ultraviolet light may be installed in the user terminal 20 (evaluation device 10 ) and used.

[0154] The configuration and function of the acquisition unit 11 , the image processing unit 12 , the evaluation unit 13 , and the output unit 14 of this embodiment are the same as those of the first to fourth embodiments.

[0155] According to the evaluation system 100 of the present embodiment, it is possible to achieve the same operational effects as those of the evaluation device 10 of the first to fourth embodiments.

[0156] <Modification>

[0157] Hereinafter, modified examples applicable to the first to fifth embodiments will be described.

[0158] "Variant 1"

[0159] like Fig. 9 As shown, when an ultraviolet image is captured using the ultraviolet camera function of the user terminal 20 , a frame W of an appropriate size for guiding the position and size of the face may be superimposed on the image displayed on the viewfinder (display).

[0160] By capturing the face so that it is contained within the frame W, the distance between the camera and the face and the viewing angle can be naturally adjusted to an appropriate state. As a result, an ultraviolet image that enables the evaluation section 13 to perform evaluation with high accuracy can be captured.

[0161] For example, a function of photographing ultraviolet images may be provided in an application (software) dedicated to the evaluation service installed in the user terminal 20. Furthermore, when the application dedicated to the evaluation service is started and the function of photographing ultraviolet images is turned on, the display of the user terminal 20 may become a viewfinder, a real-time photographed image may be displayed in the viewfinder, and the frame W may be superimposed on the image displayed in the viewfinder.

[0162] In addition, a function of photographing ultraviolet images in a web page dedicated to the evaluation service may be provided. Furthermore, when the web page dedicated to the evaluation service is accessed and the function of photographing ultraviolet images is turned on, the display of the user terminal 20 may become a viewfinder, a real-time photographed image may be displayed on the viewfinder, and the frame W may be superimposed on the image displayed on the viewfinder.

[0163] "Variant 2"

[0164] The user can also take a video so that the object and the standard patch are included in the ultraviolet image. For example, the user can take a video with the standard patch attached to the surface of the object, or can take a video with the standard patch attached to a given object. The reflectivity of the standard patch to ultraviolet rays is known.

[0165] Furthermore, the user applies the UV protectant until the brightness of the UV image after the UV protectant is applied becomes darker than that of the standard patch. For example, if a patch having the same reflectivity as that of the UV protectant applied in the recommended amount is prepared as the standard patch, the user can apply the UV protectant in an amount exceeding the recommended amount by applying the UV protectant until the brightness of the UV image becomes darker than that of the standard patch as described above.

[0166] "Variant 3"

[0167] When an ultraviolet image is captured by the user terminal 20 , a target color may be displayed as a guide on the image displayed on the viewfinder (display).

[0168] Then, the user applies the ultraviolet protective agent until the color of the ultraviolet image after the ultraviolet protective agent is applied becomes the same color tone as the color guide, similarly to Modification 2. For example, if a guide having the same color as the state where the recommended amount of ultraviolet protective agent is applied is prepared in advance as a color guide, the user can apply the ultraviolet protective agent in an amount exceeding the recommended amount by applying the ultraviolet protective agent until the color of the ultraviolet image becomes the same color tone as the standard patch as described above.

[0169] "Variant 4"

[0170] When the ultraviolet image is photographed using the user terminal 20, the proportion of saturated pixels in the multiple images included in the ultraviolet image can also be adjusted to be less than a predetermined value (for example, 50%, 40%, 30%, 20%, etc.). For example, when the brightness of the image is expressed in the range of 0 to 255 (in addition, 0 is the darkest and 255 is the brightest), pixels with a brightness of 255 or more are saturated pixels. In this way, the brightness of the ultraviolet image is adjusted and becomes easier to visually recognize. The proportion of the above-mentioned saturated pixels varies depending on whether a light source is reflected, the distance between the camera and the subject, the angle of the camera, etc. For example, saturated pixels are likely to occur when there is a light source, when the camera is close to the subject, or when the angle of the camera detects more regular reflected light. The user adjusts the camera environment by himself so that the proportion of the above-mentioned saturated pixels is less than a predetermined value.

[0171] For example, the server 1 or the user terminal 20 may also analyze the ultraviolet image to determine whether the proportion of saturated pixels is below a predetermined value. Furthermore, when it is determined that the proportion of saturated pixels is not below a predetermined value, the user terminal 20 may also output suggestions such as "please do not reflect the light source", "please move the camera away from the subject", or "please change the angle of the camera" to the user.

[0172] "Variant 5"

[0173] The output unit 14 may also output product introduction information determined based on the evaluation result. For example, in the case of an evaluation result such as "removal by friction", the output unit 14 may output product introduction information introducing products that are difficult to remove by friction. This evaluation is performed, for example, by obtaining processed images before and after friction of an object coated with an ultraviolet protective agent, and based on the rate of change of brightness of the processed images before and after friction. When the rate of change is greater than a threshold value (predetermined value), it can be evaluated that the object is removed by friction.

[0174] Correspondence information in which a plurality of evaluation results that can be calculated by the evaluation unit 13 are associated with recommended products for each evaluation result is stored in advance in the evaluation device 10 or the evaluation system 100. The output unit 14 determines the product to be introduced for each evaluation result based on the correspondence information.

[0175] "Variant 6"

[0176] The output unit 14 may also output the care information corresponding to the season at the time of evaluation. Correspondence information in which a plurality of seasons are respectively associated with care information indicating the content of skin care recommended in each season is stored in the evaluation device 10 or the evaluation system 100. The output unit 14 determines the care information to be introduced at the time of evaluation based on the correspondence information.

[0177] "Variant 7"

[0178] The evaluation device 10 or the evaluation system 100 may acquire the forecast of the ultraviolet light amount by any means. Furthermore, the output unit 14 may output information indicating the content of the forecast.

[0179] "Variant 8"

[0180] The acquisition unit 11 may acquire an image of an object having no coating film of an ultraviolet protection agent disposed on its surface by using a common camera (a camera having a sensor for detecting light in the visible light region). The evaluation unit 13 may use the image to make melanin conspicuously visible.

[0181] Melanin is captured with a lower brightness value than bare skin. That is, the brightness value of the melanin area in the image is lower than the brightness value of the surrounding bare skin area. When capturing bare skin (= an object without a coating of an ultraviolet protection agent on the surface), an area below a certain brightness value is defined as a melanin area, and the inside of the melanin area and the outer edge of the melanin area are colored in the image, so that the melanin area can be visualized prominently.

[0182] Since melanin is a biological pigment that absorbs ultraviolet light, the brightness value of the ultraviolet image becomes lower in an area with more melanin (for example, an area with spots on the face) than in a surrounding area with less melanin. That is, the brightness value of the area with more melanin in the ultraviolet image is lower than that of the surrounding bare skin area with less melanin. An area below a certain brightness value of the captured ultraviolet image is set as an area with more melanin, and the area or the outer edge of the area is colored on the ultraviolet image or the visible light image, so that it can be conspicuously visualized.

[0183] "Variant 9"

[0184] The evaluation unit 13 can generate evaluation result data indicating the result of the evaluation on the ultraviolet protection agent based on the processed image. Specifically, the evaluation unit 13 can use the processed image itself as the evaluation result data. In this modification, the output unit 14 outputs the processed image as the evaluation result data.

[0185] The embodiments of the present invention have been described above with reference to the accompanying drawings, but these are illustrative of the present invention, and various structures other than the above can also be adopted. The structures of the above-mentioned embodiments can also be combined with each other, or a part of the structure can be replaced with another structure. In addition, the structures of the above-mentioned embodiments can also be subjected to various changes within the scope of not departing from the main purpose. In addition, the structures and processes disclosed in the above-mentioned embodiments and modified examples can also be combined with each other.

[0186] In addition, in the flowchart used in the above description, a plurality of processes (processes) are sequentially recorded, but the execution order of the processes performed by each embodiment is not limited to the order of the records. In each embodiment, the order of the processes shown in the diagram can be changed within the scope of no obstacles in the content. In addition, the above embodiments can be combined within the scope of no contradiction in the content.

[0187] A part or all of the above-mentioned embodiments may be described as follows, but the present invention is not limited thereto.

[0188] 1. An evaluation device comprising:

[0189] an acquisition unit that acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on a surface thereof;

[0190] an image processing unit that generates a processed image by removing a component of regular reflected light from the ultraviolet image using a learning model;

[0191] an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and

[0192] The output unit outputs the evaluation result data.

[0193] 2. In the evaluation device described in 1,

[0194] The evaluation section evaluates uneven application of the ultraviolet shielding agent as an evaluation related to the ultraviolet shielding agent.

[0195] 3. In the evaluation device described in 2,

[0196] The evaluation unit generates an image in which a result of uneven application evaluation of the ultraviolet shielding agent is superimposed on an image representing the object, as the evaluation result data.

[0197] 4. In the evaluation device described in 3,

[0198] The evaluation unit generates the image for identifying and displaying one or both of a portion where the amount of the ultraviolet protection agent applied is less than a first reference and a portion where the amount of the ultraviolet protection agent applied is more than a second reference.

[0199] 5. In the evaluation device described in 4,

[0200] The evaluation unit determines at least one of the first criterion and the second criterion based on at least one of a date and time at the time of evaluation and a forecast of an ultraviolet amount.

[0201] 6. In the evaluation device described in 4 or 5,

[0202] The evaluation department performs the following operations:

[0203] Get the information entered by the user indicating the action plan,

[0204] At least one of the first criterion and the second criterion is determined based on the planned action.

[0205] 7. In the evaluation device described in any one of 1 to 6,

[0206] The evaluation section performs performance evaluation of the ultraviolet shielding agent as evaluation related to the ultraviolet shielding agent.

[0207] 8. In the evaluation device described in 1,

[0208] The evaluation section performs evaluation of uneven application of the ultraviolet shielding agent and performance of the ultraviolet shielding agent as evaluations related to the ultraviolet shielding agent.

[0209] 9. In the evaluation device described in 1,

[0210] The acquisition unit acquires the ultraviolet image without performing a process of removing a component of regular reflected light using a polarizing plate,

[0211] The image processing unit generates the processed image from the ultraviolet image.

[0212] 10. In the evaluation device described in 1,

[0213] The evaluation device is a user terminal.

[0214] 11. An evaluation system comprising:

[0215] an acquisition unit that acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on a surface thereof;

[0216] The image processing unit generates a processed image by removing a component of regular reflection light from the ultraviolet image using a learning model,

[0217] an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and

[0218] The output unit outputs the evaluation result data.

[0219] 12. An evaluation method,

[0220] The computer does the following:

[0221] Acquiring an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface,

[0222] using a learning model to generate a processed image in which a component of regular reflection light is removed from the ultraviolet image,

[0223] generating evaluation result data indicating the result of evaluation related to the ultraviolet protection agent based on the processed image,

[0224] The evaluation result data is output.

[0225] 13. A program that causes a computer to function as:

[0226] An acquisition unit acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protection agent disposed on a surface thereof;

[0227] an image processing unit that uses a learning model to generate a processed image obtained by removing a component of regular reflected light from the ultraviolet image;

[0228] an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and

[0229] The output unit outputs the evaluation result data.

[0230] -Explanation of symbols-

[0231] 1A Processor

[0232] 2A Memory

[0233] 3A Input and Output I / F

[0234] 4A Peripheral Circuit

[0235] 5A Bus

[0236] 1 Server

[0237] 10 Evaluation device

[0238] 11 Acquisition Department

[0239] 12 Image processing department

[0240] 13 Evaluation Department

[0241] 14 Output section

[0242] 20 User Terminal

[0243] 30 Communication Network

[0244] 100 rating system.

Claims

1. An evaluation device, characterized in that: have: an acquisition unit that acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protection agent disposed on a surface thereof; an image processing unit that generates a processed image by removing a component of regular reflected light from the ultraviolet image using a learning model; an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and The output unit outputs the evaluation result data.

2. The evaluation device according to claim 1, wherein: The evaluation section evaluates uneven application of the ultraviolet shielding agent as an evaluation related to the ultraviolet shielding agent.

3. The evaluation device according to claim 2, wherein: The evaluation unit generates an image in which a result of uneven application evaluation of the ultraviolet shielding agent is superimposed on an image representing the object, as the evaluation result data.

4. The evaluation device according to claim 3, wherein: The evaluation unit generates the image for identifying and displaying one or both of a portion where the amount of the ultraviolet protection agent applied is less than a first reference and a portion where the amount of the ultraviolet protection agent applied is more than a second reference.

5. The evaluation device according to claim 4, wherein: The evaluation unit determines at least one of the first criterion and the second criterion based on at least one of a date and time at the time of evaluation and a forecast of an ultraviolet amount.

6. The evaluation device according to claim 4 or 5, wherein: The evaluation department performs the following operations: Get the information entered by the user indicating the action plan, At least one of the first criterion and the second criterion is determined based on the planned action.

7. The evaluation device according to claim 1, wherein: The evaluation section performs performance evaluation of the ultraviolet shielding agent as evaluation related to the ultraviolet shielding agent.

8. The evaluation device according to claim 1, wherein: The evaluation section performs evaluation of uneven application of the ultraviolet shielding agent and performance of the ultraviolet shielding agent as evaluations related to the ultraviolet shielding agent.

9. The evaluation device according to claim 1, wherein: The acquisition unit acquires the ultraviolet image without performing a process of removing a component of regular reflected light using a polarizing plate, The image processing unit generates the processed image from the ultraviolet image.

10. The evaluation device according to claim 1, wherein: The evaluation device is a user terminal.

11. An evaluation system, characterized in that: have: an acquisition unit that acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protection agent disposed on a surface thereof; an image processing unit that generates a processed image by removing a component of regular reflected light from the ultraviolet image using a learning model; an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and The output unit outputs the evaluation result data.

12. An evaluation method, characterized in that: The computer does the following: Acquiring an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protective agent disposed on the surface, using a learning model to generate a processed image in which a component of regular reflection light is removed from the ultraviolet image, generating evaluation result data indicating the result of evaluation related to the ultraviolet protection agent based on the processed image, The evaluation result data is output.

13. A program, characterized in that The program causes the computer to function as the following units: An acquisition unit acquires an ultraviolet image obtained by photographing an object having a coating film of an ultraviolet protection agent disposed on a surface thereof; an image processing unit that uses a learning model to generate a processed image obtained by removing a component of regular reflected light from the ultraviolet image; an evaluation unit that generates evaluation result data indicating a result of an evaluation related to the ultraviolet protection agent based on the processed image; and The output unit outputs the evaluation result data.

Images