Behavioral assessment methods, programs, and systems

Abstract

To evaluate behavior of applying material.SOLUTION: A behavior evaluation method includes the steps of: acquiring sound information showing sound caused by application of material; on the basis of the sound information, estimating whether or not at least one of strength of the application and speed of the application is within a predetermined range; and outputting a result of the estimation.SELECTED DRAWING: Figure 3

Description

Technical Field

[0006] , ,

[0007] , , ,

[0001] The present invention relates to a behavior evaluation method, a program, and a system.

Background Art

[0002] Conventionally, in the act of applying a substance such as a cosmetic, an appropriate application method may be defined in advance (Patent Document 1, etc.). For example, in the case of a cosmetic, the effect of the cosmetic can be enhanced by following an appropriate application method.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, it has been difficult for a person applying a substance to determine whether their application method is an appropriate application method.

[0005] Therefore, an object of the present invention is to evaluate the act of applying a substance.

Means for Solving the Problems

[0006] A behavior evaluation method according to an embodiment of the present invention includes a step of acquiring sound information indicating a sound generated by applying a substance, a step of estimating whether at least one of the application strength and the application speed is within a predetermined range based on the sound information, and a step of outputting the estimated result.

Effects of the Invention

[0007] In the present invention, the act of applying a substance can be evaluated.

Brief Description of the Drawings

[0008] [Figure 1] This diagram shows the overall configuration of one embodiment of the present invention. [Figure 2] This figure shows the functional block of an information processing system according to one embodiment of the present invention. [Figure 3] This flowchart shows the processing flow for behavioral evaluation related to one embodiment of the present invention. [Figure 4] This figure shows the hardware configuration of an information processing device according to one embodiment of the present invention. [Modes for carrying out the invention]

[0009] Each embodiment will be described below with reference to the attached drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant descriptions will be omitted.

[0010] This specification describes embodiments for evaluating cosmetic behavior (specifically, the application of cosmetics), but is not limited thereto, and the present invention can be applied to the evaluation of any behavior (specifically, the application of any substance). Cosmetics may be any basic skincare products or makeup products, such as lotions, emulsions, creams, serums, sunscreens, primers, and foundations. This specification describes an embodiment using earphones with a microphone, but is not limited to this; any sensor capable of measuring sound, such as an accelerometer, MEMS sensor, sensor with an oscillator, or piezoelectric sensor, may be used.

[0011] <Overall Structure> Figure 1 shows the overall configuration of one embodiment of the present invention. The information processing system 1 includes an information processing device 10 and an earphone with a microphone 20. The information processing device 10 can send and receive data with the earphone with a microphone 20. Each of these will be described below.

[0012] The information processing device 10 estimates whether at least one of the coating strength and coating speed is within a predetermined range based on the sound information (hereinafter referred to as "sound information") that the microphone-equipped earphone 20 measures when a substance is applied, and outputs the estimated result. For example, the information processing device 10 may be a smartphone, tablet, personal computer, server, etc.

[0013] The earphone with microphone 20 measures vibrations (sound) caused by the application of a substance.

[0014] <Functional blocks of Information Processing System 1> Figure 2 shows the functional blocks of an information processing system 1 according to one embodiment of the present invention. The information processing device 10 and the earphone with microphone 20 will be described separately below.

[0015] <<Information Processing Device 10>> The information processing device 10 may include a transmitting / receiving unit 100 (the transmitting / receiving unit 100 includes an acquisition unit 101 and an output unit 106), a cosmetic behavior classification unit (also simply called a behavior classification unit) 102, a cosmetic behavior start detection unit (also simply called a behavior start detection unit) 103, a feedback judgment unit 104, and an output data generation unit 105. Furthermore, by executing a program, the information processing device 10 can function as the transmitting / receiving unit 100, the cosmetic behavior classification unit 102, the cosmetic behavior start detection unit 103, the feedback judgment unit 104, and the output data generation unit 105. Each of these will be described below.

[0016] The acquisition unit 101 acquires sound information indicating the sound produced by the application of a substance. The acquisition unit 101 can also acquire sound information indicating the sound produced on skin where no cosmetic is applied. For example, the acquisition unit 101 receives sound information from the microphone-equipped earphone 20. The sound is measured at one or more locations, such as a person's face.

[0017] The makeup action classification unit 102 estimates whether at least one of the application strength of substances such as cosmetics and the application speed of substances such as cosmetics is within a predetermined range based on the sound information acquired by the acquisition unit 101.

[0018] Specifically, the makeup action classification unit 102 evaluates the presence or absence of an action, the application strength of a substance, the application speed of a substance, etc. based on the correspondence between the characteristics of the sound information (vibration data) indicating the sound and the group classified for actions such as makeup actions (specifically, the application of substances such as cosmetics). For example, the characteristics of the sound information (vibration data) indicating the sound are the frequency of the sound, the intensity, the length of the signal continuation, the signal difference between the left ear (L) and right ear (R) microphones, the characteristics of the signal obtained by machine learning, etc. Note that the correspondence may be a pre-determined database or a machine-learned trained model. The database has the characteristics of the sound information (vibration data) indicating the sound linked to the group (too strong / optimal / too weak, too fast / optimal / too slow, etc.). Also, the trained model is a prediction model that outputs a group (too strong / optimal / too weak, too fast / optimal / too slow, etc.) when the sound information (vibration data) indicating the sound is input.

[0019] Hereinafter, the <presence or absence of an action>, <evaluation of the application strength of a substance>, and <evaluation of the application speed of a substance> will be described.

[0020] <Presence or absence of an action> The makeup action classification unit 102 determines whether the sound information belongs to either "there is an action such as a makeup action (that is, there is an application of a substance such as cosmetics)" or "there is no action such as a makeup action (that is, there is no application of a substance such as cosmetics)". Specifically, the makeup action classification unit 102 evaluates the presence or absence of an action based on the presence or absence of the generation of sound (if there is sound generation, there is an action; if there is no sound generation, there is no action).

[0021] <Evaluation of the application strength of a substance> The cosmetic behavior classification unit 102 determines whether the sound information falls into one of the following categories: "the application of the cosmetic substance is too strong," "the application of the cosmetic substance is too weak," or "the application of the cosmetic substance is optimal." Specifically, the cosmetic behavior classification unit 102 evaluates the strength of the substance application based on the loudness of the sound (louder sound indicates stronger application, quieter sound indicates weaker application).

[0022] <Evaluation of the speed of substance application> The cosmetic behavior classification unit 102 determines whether the sound information belongs to one of the following categories: "the application of the cosmetic substance is too fast," "the application of the cosmetic substance is too slow," or "the application speed of the cosmetic substance is optimal." Specifically, the cosmetic behavior classification unit 102 evaluates the speed of substance application based on the distance traveled by the sound source and the time it takes for the sound to occur (a larger distance / time ratio indicates a faster application, and a smaller distance / time ratio indicates a slower application).

[0023] The makeup action initiation detection unit 103 determines whether or not an action such as makeup has been initiated. Specifically, the makeup action initiation detection unit 103 determines that an action such as makeup has been initiated if the sound information is determined to belong to the category of "an action such as makeup has been initiated (i.e., application of a substance such as a cosmetic product has been performed)." In addition, based on the sound information, it is also possible to estimate not only the start of cosmetic product application but also the end of cosmetic product application.

[0024] The feedback determination unit 104 determines whether or not to provide feedback to the user based on the results estimated by the cosmetic behavior classification unit 102. For example, if the feedback determination unit 104 determines that the sound information belongs to both "the strength of application of the cosmetic substance is optimal" and "the speed of application of the cosmetic substance is optimal," it decides not to provide feedback. Alternatively, if the feedback determination unit 104 determines that the sound information belongs to at least one of the following: "the application of the cosmetic substance is too strong," "the application of the cosmetic substance is too weak," "the application of the cosmetic substance is too fast," or "the application of the cosmetic substance is too slow," it decides to provide feedback.

[0025] <Feedback Prioritization> Furthermore, the feedback judgment unit 104 can set a priority order for the content of the feedback for each cosmetic product (for example, sunscreen prioritizes warnings about incomplete application, while lotion prioritizes warnings about the application strength).

[0026] The output data generation unit 105 generates the data to be output by the output unit 106 (for example, data to be transmitted to the microphone-equipped earphone 20). For example, the data to be output can be any sound, such as a warning sound (beep) or a sound produced by the application of a substance. For example, the output data generation unit 105 can generate data linked to the application of a substance (a loud sound if it is too strong, a quiet sound if it is too weak, a fast sound if it is too fast, and a slow sound if it is too slow).

[0027] Furthermore, the output data is not limited to sound; it may also include vibrations, flashing lights, stimulation of the vestibular organs of the inner ear, displays on a screen, etc.

[0028] The output unit 106 outputs the results estimated by the cosmetic behavior classification unit 102. For example, the output unit 106 transmits the results estimated by the cosmetic behavior classification unit 102 to the earphone with microphone 20. Alternatively, the output unit 106 may be configured to output to any device other than the earphone with microphone 20, such as a smartphone.

[0029] The following describes various evaluation methods.

[0030] <Evaluation by application location> When sound is measured at two or more locations, the makeup behavior classification unit 102 can estimate whether at least one of the application strength or application speed is within a predetermined range for each application location (e.g., right cheek, left cheek, right forehead, left forehead, around the right eye, around the left eye, right nose, left nose, around the right mouth, around the left mouth, right jaw, left jaw, etc.). Specifically, the makeup behavior classification unit 102 determines the location where the sound is generated (i.e., the application location) based on the time difference and the difference in sound intensity of the sounds reaching multiple microphones.

[0031] <Locations where application is incomplete> The cosmetic behavior classification unit 102 can estimate that there are locations where application is not yet complete. Specifically, the cosmetic behavior classification unit 102 determines the location where sound is generated (i.e., the application location) based on the time difference and difference in sound intensity of sounds reaching multiple microphones.

[0032] <Estimation of the number of application sessions> The cosmetic behavior classification unit 102 can estimate the number of times a substance is applied based on sound information. Specifically, the cosmetic behavior classification unit 102 estimates the number of times a substance is applied based on the number of times a continuous sound occurs. For example, the cosmetic behavior classification unit 102 can estimate the number of times a substance is applied for each application location (e.g., right cheek, left cheek, right forehead, left forehead, around the right eye, around the left eye, right nose, left nose, around the right mouth, around the left mouth, right jaw, left jaw, etc.).

[0033] <Estimated Cosmetics> The cosmetic behavior classification unit 102 can estimate the type of cosmetic product (e.g., lotion, emulsion, cream, serum, sunscreen, primer, foundation, etc.) based on sound information. Specifically, the cosmetic behavior classification unit 102 estimates the type of cosmetic product based on the frequency of the sound. In addition, the cosmetic behavior classification unit 102 can estimate whether at least one of the application strength, application speed, and number of applications is within a predetermined range set for each type of cosmetic product.

[0034] <Estimation of the method of applying cosmetics> The cosmetic behavior classification unit 102 can estimate the method of applying cosmetics (e.g., strokes with cotton, strokes with fingers, pressing with cotton, pressing with fingers, patting with cotton, patting with fingers, etc.) based on sound information. Specifically, the cosmetic behavior classification unit 102 estimates strokes, pressing, patting, etc., based on the rhythm and distance of the sound. The cosmetic behavior classification unit 102 estimates the presence or absence of cotton based on the frequency of the sound. In addition, the cosmetic behavior classification unit 102 can estimate whether at least one of the application strength, application speed, and number of applications is within a predetermined range set for each cosmetic application method.

[0035] <Evaluation of the amount of cosmetics> The cosmetic behavior classification unit 102 can estimate, based on sound information, whether the amount of applied cosmetic is within a predetermined range. Specifically, the cosmetic behavior classification unit 102 estimates the amount of applied cosmetic based on the amount of displacement from the initial sound frequency (or frequency spectrum). In the initial state, a large amount of cosmetic is absorbed into the cotton. As the cosmetic is applied, the amount of cosmetic absorbed into the cotton gradually decreases as it blends into the skin, approaching the state of the cotton in its natural state. As a result, the frictional resistance between the skin and the cotton changes, and the sound frequency changes. If the amount of cosmetic is sufficient, the amount of displacement is small; if the amount of cosmetic is small, the amount of displacement is large.

[0036] <Evaluation of the pace of makeup application> The makeup behavior classification unit 102 can estimate the tempo of makeup application based on sound information. Specifically, the makeup behavior classification unit 102 can estimate the tempo as the ratio of the duration of one action during makeup application (one stroke, one press, one pat, etc.) to the period after one action when the hands are not in contact with the face (i.e., the period when no sound is produced), or the ratio of the period when the hands are not in contact with the face (i.e., the period when no sound is produced) to the speed of application.

[0037] <Estimation of skin condition> The cosmetic behavior classification unit 102 can estimate the skin condition (e.g., dry skin, oily skin, combination skin, normal skin, etc.) based on sound information indicating sounds produced on skin without cosmetic application in skin condition diagnosis mode. The cosmetic behavior classification unit 102 can also estimate whether at least one of the application strength or application speed is within a predetermined range set for each skin condition. Specifically, the cosmetic behavior classification unit 102 estimates the skin condition by frequency (or frequency spectrum). Since frictional resistance changes significantly depending on whether or not cosmetic is applied, the frequency (or frequency spectrum) changes significantly. Furthermore, even when no cosmetic is applied, frictional resistance changes depending on the skin condition, so the skin condition is classified by frequency (or frequency spectrum). In other words, after classifying whether or not cosmetic is applied by frequency (or frequency spectrum), the skin condition is further subdivided by further classifying the frequency (or frequency spectrum) of those classified as not having cosmetic applied. If the skin's frequency (or frequency spectrum) classifications for dry, normal, and oily skin vary depending on the area, or if the skin's frequency (or frequency spectrum) classification changes from day to day, the user is classified as having combination skin.

[0038] <Management of time information> The cosmetic behavior classification unit 102 can manage time information when a sound is measured. For example, if the same cosmetic behavior is performed at each time of day (morning, evening, etc.) for a certain period, the cosmetic behavior classification unit 102 can manage this as routine information, and if a cosmetic behavior different from the routine information is performed, it may provide feedback to the user. Also, if a cosmetic product (such as a sample) that is not in the routine information is estimated, feedback may not be provided to the user. Furthermore, feedback may be provided to the user so that those who have the same routine information can communicate with each other on social media, etc.

[0039] <Management of vital signs> The makeup behavior classification unit 102 can manage vital information (e.g., heart rate and respiration) when sound is measured. For example, the makeup behavior classification unit 102 can link and manage the group of makeup behavior classified with information such as heart rate, and determine whether the sound information belongs to "makeup behavior that stabilizes the heart rate" or "makeup behavior that makes the heart rate unstable". If the makeup behavior makes the heart rate unstable, feedback may be given to the user to guide them towards makeup behavior that stabilizes the heart rate. In addition, the system may be able to switch between a mode that prioritizes comfort and a mode that prioritizes correct makeup behavior, according to the user's specification. Furthermore, if the degree of heart rate instability exceeds a threshold (e.g., which the user can set for each time period), the system may be able to switch to a mode that prioritizes comfort. In addition, by utilizing the tempo information of the makeup behavior, feedback may be given to the user based on the tempo classification in the comfort-prioritizing mode, while feedback may not be given to the user based on the tempo classification in the correct makeup behavior-prioritizing mode.

[0040] <Mode Management> The makeup behavior classification unit 102 can manage each mode (makeup mode, skin condition diagnosis mode, etc.). Each mode may be switched by user specification or by automatic switching. For example, the makeup mode can be started when the sound of applying cosmetics is detected, and the makeup mode can be ended when the sound of applying cosmetics is no longer detected, or when the user's distance from the location where the makeup behavior started exceeds a certain distance calculated by an acceleration sensor or the like.

[0041] In one embodiment of the present invention, the user may input information to identify the behavior (for example, the type of cosmetic product) to simplify the estimation process.

[0042] <<Earphones with microphone 20>> The microphone-equipped earphone 20 consists of two parts: one for the left ear (L) and one for the right ear (R). The microphone-equipped earphone 20 can include a CPU unit 201, a microphone unit 202, an AD unit 203, a transmitting / receiving unit 204, a DA unit 205, and a speaker unit 206. Each of these will be described below.

[0043] The CPU (Central Processing Unit) 201 controls the earphone with microphone 20.

[0044] The microphone unit 202 measures vibrations (sound). Specifically, the microphone unit 202 measures vibrations (sound) caused by the application of a substance (for example, cosmetics).

[0045] The AD (Analog to Digital) unit 203 converts an analog signal (i.e., sound) into a digital signal.

[0046] The transmitting / receiving unit 204 transmits and receives data with the information processing device 10.

[0047] The DA (Digital to Analog) section 205 converts a digital signal into an analog signal (i.e., sound).

[0048] The speaker unit 206 reproduces sound. Specifically, the speaker unit 206 reproduces feedback from the information processing device 10.

[0049] <Processing method> Figure 3 is a flowchart showing the processing flow of behavioral evaluation according to one embodiment of the present invention. The user wears a microphone-equipped earphone 20 and performs the action of applying a substance such as cosmetics.

[0050] In step 1 (S1), the acquisition unit 101 determines whether or not it has received vibration data measured by the microphone-equipped earphone 20 (i.e., sound information indicating the sound produced by the application of a substance such as cosmetics) from the microphone-equipped earphone 20. If it has received the data, it proceeds to step 2; otherwise, it terminates the process.

[0051] In step 2 (S2), the cosmetic behavior classification unit 102 estimates, based on the sound information acquired in S1, whether at least one of the strength of application of the cosmetic substance or the speed of application of the cosmetic substance is within a predetermined range.

[0052] Specifically, the cosmetic behavior classification unit 102 determines whether the sound information acquired in S1 falls under "cosmetic behavior, etc., is present (i.e., application of cosmetic substances, etc.)" or "cosmetic behavior, etc., is absent (i.e., no application of cosmetic substances, etc.)". The cosmetic behavior classification unit 102 also determines whether the sound information acquired in S1 falls under "application of cosmetic substances, etc., is too strong," "application of cosmetic substances, etc., is too weak," or "the strength of application of cosmetic substances, etc., is optimal." The cosmetic behavior classification unit 102 also determines whether the sound information acquired in S1 falls under "application of cosmetic substances, etc., is too fast," "application of cosmetic substances, etc., is too slow," or "the speed of application of cosmetic substances, etc., is optimal."

[0053] In step 3 (S3), the makeup action initiation detection unit 103 determines whether or not an action such as makeup has been initiated. Specifically, if the sound information in S2 is determined to be "an action such as makeup has occurred (i.e., application of a substance such as cosmetics has occurred)", the makeup action initiation detection unit 103 determines that an action such as makeup has been initiated. If the action has been initiated, the process proceeds to step 4; otherwise, the process returns to step 1.

[0054] In step 4 (S4), the feedback determination unit 104 determines whether the action is optimal (for example, applying makeup) or not (i.e., whether or not to provide feedback to the user). For example, if the feedback determination unit 104 determines in S2 that the sound information belongs to both "the strength of application of the cosmetic substance is optimal" and "the speed of application of the cosmetic substance is optimal," it decides not to provide feedback. Alternatively, if the feedback determination unit 104 determines in S2 that the sound information belongs to at least one of the following: "the application of the cosmetic substance is too strong," "the application of the cosmetic substance is too weak," "the application of the cosmetic substance is too fast," or "the application of the cosmetic substance is too slow," it decides to provide feedback. If no feedback is provided, the process returns to step 1; if feedback is provided, the process proceeds to step 5.

[0055] In step 5 (S5), the output unit 106 outputs the results estimated by the cosmetic behavior classification unit 102. For example, the output unit 106 can warn that the application of the cosmetic substance is too strong or too weak. For example, the output unit 106 can warn that the application of the cosmetic substance is too fast or too slow.

[0056] <Effects> Thus, in one embodiment of the present invention, it is possible to estimate whether the user's makeup application is appropriate based on the sound produced when the user applies the cosmetic product, and to provide feedback to the user. As a result, the user can easily know whether their application is too strong (or too weak), too fast (or too slow).

[0057] <Hardware Configuration> Figure 4 is a diagram showing the hardware configuration of an information processing device 10 according to one embodiment of the present invention.

[0058] The information processing device 10 includes a CPU (Central Processing Unit) 1001, a ROM (Read Only Memory) 1002, and a RAM (Random Access Memory) 1003. The CPU 1001, ROM 1002, and RAM 1003 form what is known as a computer.

[0059] Furthermore, the information processing device 10 may include an auxiliary storage device 1004, a display device 1005, an operating device 1006, an I / F (Interface) device 1007, and a drive device 1008.

[0060] Furthermore, each piece of hardware in the information processing device 10 is interconnected via bus B.

[0061] The CPU 1001 is a computing device that executes various programs installed on the auxiliary storage device 1004.

[0062] ROM1002 is non-volatile memory. ROM1002 functions as a main memory device that stores various programs, data, etc., necessary for the CPU1001 to execute the various programs installed on the auxiliary storage device 1004. Specifically, ROM1002 functions as a main memory device that stores boot programs such as BIOS (Basic Input / Output System) and EFI (Extensible Firmware Interface).

[0063] RAM1003 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). RAM1003 functions as a main memory device that provides a working area that is expanded when various programs installed on the auxiliary storage device 1004 are executed by the CPU 1001.

[0064] The auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when various programs are executed.

[0065] The display device 1005 is a display device that displays the internal state of the information processing device 10, etc.

[0066] The operating device 1006 is an input device that allows the operator of the information processing device 10 to input various instructions to the information processing device 10.

[0067] The I / F device 1007 is a communication device that connects to a network and communicates with other devices.

[0068] The drive device 1008 is a device for setting the storage medium 1009. The storage medium 1009 here includes media that record information optically, electrically, or magnetically, such as CD-ROMs, flexible disks, and magneto-optical disks. The storage medium 1009 may also include semiconductor memories that record information electrically, such as EPROMs (Erasable Programmable Read Only Memory) and flash memory.

[0069] The various programs to be installed in the auxiliary storage device 1004 are installed, for example, when the distributed storage medium 1009 is set in the drive device 1008, and the various programs recorded on the storage medium 1009 are read by the drive device 1008. Alternatively, the various programs to be installed in the auxiliary storage device 1004 may be installed by downloading them from the network via the I / F device 1007.

[0070] Although embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and changes are possible within the scope of the gist of the present invention as described in the claims. [Explanation of symbols]

[0071] 1. Information Processing System 10 Information Processing Devices 20 Earphones with Microphone 100 Transmitter / Receiver Unit 101 Acquisition Department 102 Cosmetic Behavior Classification Department 103 Makeup Action Initiation Detection Unit 104 Feedback Judgment Unit 105 Output data generation unit 106 Output section 201 CPU section 202 Microphone section 203 AD Department 204 Transmitter / Receiver Unit 205 DA Department 206 Speaker section 1001 CPU 1002 ROM 1003 RAM 1004 Auxiliary storage device 1005 Display device 1006 Operating device 1007 I / F device 1008 Drive unit 1009 Storage medium

Claims

1. A step of acquiring sound information indicating the sound produced by the application of a substance, A step of estimating whether at least one of the following is within a predetermined range: the strength of the coating evaluated based on the loudness of the sound, and the speed of the coating evaluated based on the distance traveled by the position where the sound is generated and the time it takes for the sound to be generated. The step of outputting the estimated result A method for evaluating the behavior of applying a substance containing [a certain substance].

2. The aforementioned sound was measured at two or more locations. The method for evaluating the action of applying a substance according to claim 1, wherein the estimation step involves estimating whether, for each application location, at least one of the application strength and the application speed is within a predetermined range.

3. A method for evaluating an action of applying a substance according to claim 2, wherein the output step further includes outputting that there are areas where the application is not completed.

4. A method for evaluating the act of applying the substance according to any one of claims 1 to 3, wherein the substance is a cosmetic.

5. The estimation step further includes estimating the type of cosmetic based on the sound information, A method for evaluating the action of applying the substance according to claim 4, wherein the predetermined range is set for each type of cosmetic.

6. The estimation step further includes estimating the method of applying the cosmetic based on the sound information, A method for evaluating the action of applying the substance according to claim 4, wherein the predetermined range is set for each method of applying the cosmetic.

7. A method for evaluating an action of applying a substance according to claim 4, wherein the estimation step further comprises estimating, based on the sound information, whether the amount of the applied cosmetic is within a predetermined range.

8. A step of acquiring sound information indicating sounds produced on skin to which the aforementioned cosmetic has not been applied, The method further includes the step of estimating the condition of the skin based on sound information indicating sounds produced on skin to which the cosmetic has not been applied, A method for evaluating the action of applying the substance according to claim 4, wherein the predetermined range is set according to the skin condition.

9. A method for evaluating an action of applying a substance according to claim 4, wherein the estimation step further comprises estimating the start or end of the application of the cosmetic based on the sound information.

10. A method for evaluating an action of applying a substance according to any one of claims 1 to 9, further comprising the step of managing time information when the sound was measured.

11. A method for evaluating the act of applying a substance according to any one of claims 1 to 9, further comprising the step of managing vital information when the sound is measured.

12. Computer An acquisition unit that acquires sound information indicating the sound produced by the application of a substance. A behavioral classification unit that estimates whether at least one of the following is within a predetermined range: the strength of the coating evaluated based on the loudness of the sound, and the speed of the coating evaluated based on the distance traveled by the location where the sound is generated and the time it takes for the sound to be generated. Output unit that outputs the estimated result A program that evaluates the behavior of applying a substance to make it function as intended.

13. A system including a microphone and a computer, wherein the microphone measures sound produced by the application of a substance. An acquisition unit that acquires sound information indicating the sound produced by the application of the aforementioned substance, A behavioral classification unit that estimates whether at least one of the following is within a predetermined range: the strength of the coating evaluated based on the loudness of the sound, and the speed of the coating evaluated based on the distance traveled by the location where the sound is generated and the time it takes for the sound to be generated. An output unit that outputs the estimated result and A system for evaluating the act of applying a substance that possesses [a certain characteristic].

Images