Evaluation method, evaluation device, and evaluation system

Abstract

In the present invention, the psychological state upon stimulation of the five senses is evaluated. A method according to an embodiment of the present invention includes: stimulating a subject's senses when the senses have returned to a baseline state; acquiring the subject's response when the subject's senses are stimulated; and evaluating, on the basis of the response, the subject's psychological state when the subject's senses are stimulated.

Description

Evaluation Method, Evaluation Device, and Evaluation System

[0001] The present invention relates to an evaluation method, an evaluation device, and an evaluation system.

[0002] Conventionally, it has been considered that giving stimuli to the five senses (taste, smell, touch, vision, hearing) of a human has some influence on the mental state of that person.

[0003] Japanese Patent Application Laid-Open No. 2024-53804

[0004] However, the characteristics of the five senses are difficult to understand, and it is not easy to grasp what kind of mental state one will be in due to the stimuli to the five senses and control the mental state.

[0005] An object of the present invention is to evaluate the mental state when the five senses are stimulated.

[0006] A method according to an embodiment of the present invention includes applying a stimulus to the sensation of a subject when the sensation of the subject is in a reset state, obtaining a reaction of the subject when the sensation of the subject is stimulated, and evaluating the mental state of the subject when the sensation of the subject is stimulated based on the reaction.

[0007] According to the present invention, it is possible to evaluate the mental state when the five senses are stimulated.

[0008] This is a diagram illustrating the mapping of responses when the senses are stimulated according to one embodiment of the present invention. This is an example of a map display according to one embodiment of the present invention. This is an example of a map display for multiple senses according to one embodiment of the present invention. This is a diagram illustrating the evaluation of susceptibility to emotional influence (whether one is easily moved or not) according to one embodiment of the present invention. This is an example of a display of susceptibility to emotional influence according to one embodiment of the present invention. This is an example of a display of susceptibility to emotional influence for multiple senses according to one embodiment of the present invention. This is an example of a map display according to one embodiment of the present invention. This is an example of a display of susceptibility to emotional influence according to one embodiment of the present invention. This is an example of a display of the mind and touch according to one embodiment of the present invention. This is an example of a display of a comparison between subjective and objective responses according to one embodiment of the present invention. This is a flowchart of the evaluation process according to one embodiment of the present invention. This is a flowchart of the evaluation process according to one embodiment of the present invention. This is a flowchart of the evaluation process according to one embodiment of the present invention. This is an example of the overall configuration according to one embodiment of the present invention. This is a functional block diagram of the evaluation system according to one embodiment of the present invention. This is a functional block diagram of the evaluation device according to one embodiment of the present invention. This is a hardware configuration diagram of the user terminal, server, and evaluation device according to one embodiment of the present invention.

[0009] Embodiments of the present invention will be described below with reference to the drawings.

[0010] <Explanation of Terms> - "Sense" refers to one or more of the five senses (taste, smell, touch, sight, hearing). - "Sense reset state" refers to a state in which the influence of stimuli previously applied to the sense has been reduced, and in which a given stimulus to the sense can be evaluated without being influenced by any other stimulus. In this state, it is required that a certain consistency can be obtained even when evaluations are performed repeatedly, and that the influence of stimuli received before the evaluation has almost disappeared. Note that a sense reset state can include cases where the sense is reset by some stimulus (for example, resetting taste by drinking water or gargling, resetting smell by smelling oneself, resetting touch by washing hands, resetting vision by looking at a gray screen or noise image, static image or mosaic image, looking at a point of fixation, or closing the eyes, resetting hearing by creating silence or listening to masking sounds such as white noise, pink noise, or ambient sounds), or cases where the sense is reset by the passage of time. A "stimulus" can be anything that stimulates the senses, and generally refers to objects that are eaten, drunk, smelled, touched, seen, observed, or heard. Examples include beverages, fragrances, tableware, cosmetics, music, audio data including natural sounds and environmental sounds, textile materials, woven or knitted fabrics, and products made from them, plants including flowers, leaves, and stems, and their imitations, pictures, images (still images, moving images), optical illusions and art content, food, skin, face, the subject's own face, the subject's own body, or the subject's own skin. It also includes, but is not limited to, temperature changes, vibrations, pressure, light intensity, color, sound frequency, texture, wind, humidity, electrical stimulation, magnetic stimulation, and even digital content using virtual or augmented reality. - One pattern for presenting stimuli is to present one or more different types of stimuli one by one within the same category (for example, within the beverage category, any stimuli with different flavors are acceptable, such as presenting green tea, barley tea, and brown rice tea in sequence; within the tableware category, any tableware with different materials is acceptable, such as presenting metal, plastic, and ceramic in sequence). Alternatively, two or more different types of stimuli within the same category may be presented consecutively or simultaneously without resetting.Furthermore, within the same category, stimuli with different characteristics may be presented one by one (e.g., three stimuli with progressively different bitterness levels using green tea; in the case of tableware, roughness, hardness, coldness, weight, etc., may vary progressively). Furthermore, within the same category, stimuli with different characteristics may be presented consecutively or simultaneously without resetting (e.g., comparing a standard bitterness with progressively varied bitterness). In this case, characteristics refer to sensory evaluation items or physical properties. These methods can also be applied across multiple categories. In addition, when stimulating one sense with one stimulus, it is possible to mask senses that should not be stimulated. It is also possible to stimulate multiple senses with one stimulus (e.g., a beverage that stimulates aroma and taste simultaneously), and to stimulate one sense with multiple stimuli (e.g., stimulating hearing with different music). It is also conceivable to stimulate multiple senses with multiple stimuli (e.g., stimulating sight and hearing simultaneously by combining video and music). The "subject's response" may be a subjective response (e.g., questionnaire answers) or an objective response (e.g., physiological indicator values). For example, physiological indicators include, but are not limited to, heart rate, heart rate variability, skin electrical activity, electroencephalogram (EEG), cerebral blood flow (e.g., changes in cerebral blood flow), blood pressure, respiration, pulse (e.g., changes in pulse), facial muscles, electromyography (EMG), skin temperature, and pupil diameter. "Psychological state" refers to the mental and emotional state of the subject when their senses are stimulated. "Sensory sensitivity" refers to whether or not the subject felt the stimulus, the intensity of the stimulus, the pleasantness or unpleasantness of the stimulus, preference for the stimulus, the duration of the stimulus, and subjective equivalence points: physical values ​​that different conditions are perceived as equivalent by the senses. In evaluating sensory sensitivity, an evaluation of sensitivity is performed to obtain the subject's response when they are stimulated. For example, the types of sensitivity evaluations are as follows: Threshold evaluation (perception threshold): the minimum intensity at which a stimulus can be felt. Threshold evaluation (difference threshold): the minimum difference in intensity between different stimuli that can be recognized. Pleasure / displeasure evaluation: an evaluation of subjective comfort or discomfort with respect to the stimulus. • Preference evaluation: An evaluation of preference for the stimulus. • Intensity evaluation: A subjective evaluation of the intensity of the stimulus (e.g., very weak, weak, normal, strong, very strong).• Persistence assessment: Duration of sensation from a stimulus and changes in response to the stimulus over time. • Affective response assessment: Emotional response to a stimulus (e.g., joy, surprise, disgust). • Physiological response assessment: Assessment using physiological indicators such as heart rate, skin electrical response, and electroencephalogram. • Cognitive assessment: Cognitive response to a stimulus and level of understanding (e.g., recognition of the meaning and relevance of the stimulus).

[0011] <Outline of the Invention> First, an overview of the present invention will be provided. In this invention, the subject's senses are stimulated when they are in a reset state. The subject's response to the sensory stimulation is then obtained. This response can include qualitative evaluations (e.g., questionnaires and self-reports) and quantitative evaluations (e.g., instrumental measurements and sensory evaluations using a Visual Analog Scale (VAS)). Furthermore, quantitative evaluations can include psychological and sensory evaluation methods such as the Likert scale, Semantic Differential (SD) method, magnitude estimation method, and pairwise comparison method. This makes it possible to evaluate the subject's psychological state or sensory sensitivity from multiple perspectives when their senses are stimulated.

[0012] For example, one sense (e.g., taste) can be evaluated by applying multiple types of stimuli (e.g., drinking black tea, coffee, rooibos tea, roasted green tea, etc.), or multiple senses (e.g., taste and smell) can be evaluated by applying multiple types of stimuli to each sense (e.g., drinking black tea, coffee, rooibos tea, roasted green tea, etc. for taste; smelling scents such as rose, rosemary, vanilla, eucalyptus, lavender, etc.).

[0013] For example, one way to provide multiple stimuli to a single sense is to stimulate the sense of taste with different types of beverages. The types of beverages could be those with different flavors or concentrations. Examples of beverages with different flavors include black tea, coffee, rooibos tea, and roasted green tea. This is not limited to beverages; it could also include food or condiments (such as gum). Examples of beverages with different concentrations include strong, medium, and weak roasted green tea; the concentration levels are not specified. Another way to provide one or more stimuli to each of the multiple senses is to stimulate the sense of taste and smell with different types of beverages and different scents, respectively. For taste, it could be black tea, as mentioned above, and for scent, it could be rose, rosemary, vanilla, eucalyptus, or lavender. For scent, for example, perfume could be sprayed or a sheet coated with fragrance could be provided to the subject.

[0014] For example, after a participant has provided an evaluation response regarding a stimulus (i.e., an evaluation response regarding their psychological state or sensory sensitivity), instructions on how to reset their senses may be provided (for example, displayed on the user terminal 11 or evaluation device 10 (described in detail later)). For example, after drinking tea and providing an evaluation, the participant may be prompted to drink water to reset their sense of taste, or they may be prompted to smell their own scent (specifically, cover their nose with their hand and take three deep breaths) to reset their sense of smell. To ensure that the participant does not forget to perform the action to reset their senses, instructions for resetting may be provided at the time the evaluation of a stimulus is completed. In addition to instructions, the user interface of the user terminal 11 or evaluation device 10 may be set to allow a waiting time for sensory resetting, and the user may not proceed to the next screen until the waiting time has elapsed. Stimuli that can be reset may be interspersed between responses.

[0015] The response to the stimulus evaluation and the act of resetting may be performed after the evaluation, or vice versa, but it is preferable to reset after the evaluation to avoid forgetting the sensation. The evaluation is one of the sensory evaluation methods described above. The reset method may be, for example, prompting the user to drink water to reset their sense of taste after drinking tea and giving a response, or prompting them to smell their own scent (specifically, covering their nose with their hand and taking about three deep breaths) to reset their sense of smell. When resetting, the subject should be instructed on the timing and method of resetting. The method of instruction is not limited to, for example, displaying text or images on the user terminal 11 or evaluation device 10 (described in detail later), using voice, or verbally communicating by the observer. To prevent the subject from forgetting the action to reset their senses, instruction on resetting may be given at the time when the evaluation of one stimulus is completed. In addition to instruction, the user terminal 11 or evaluation device 10 may also have a user interface that sets a waiting time for sensory resetting and does not transition to the next screen until the waiting time has elapsed.

[0016] Referring to Figures 1 to 11, we will explain examples of evaluating the psychological state of a subject (the person being evaluated) when their senses are stimulated.

[0017] <Participant Responses> In one embodiment of the present invention, the responses of a questionnaire are used as the participant's response when their senses are stimulated. For example, the questionnaire includes the following: [Arousal and Sleepiness], [Pleasure and Displeasure], [Excitement and Sedation], [Clarity of Mind], [Mood Congruence], and [Sensory Familiarity]. Details are explained below.

[0018] In addition, various other items can be used as emotional categories, such as [stress], [happiness], [anger], [sadness], [satisfaction], [vitality], [loneliness], and [confidence].

[0019] Various evaluation methods can be used for answering questionnaires, including VAS (Visual Analog Scale), SD method (Semantic Differential), pairwise comparison method, and magnitude estimation method. The following describes a method using VAS, but it is not the only method that can be used.

[0020] [Arousal and Sleepiness] Participants can respond to sensory stimulation by moving a bar (also called a slide bar or slider) displayed on the user terminal 11 or evaluation device 10 (described in detail later) to the left or right (for example, by responding with a numerical value (also called a score) from 0 to 100). For example, the negative side of the bar indicates "feeling sleepy," and the positive side of the bar indicates "feeling awake." From the participant's responses, it is possible to evaluate whether both the body and consciousness are aroused when sensory stimulation is applied.

[0021] [Pleasure / Displeasure] Participants can respond to a stimulus by moving a bar displayed on the user terminal 11 or evaluation device 10 left or right to indicate whether they feel pleasure or displeasure. For example, a negative bar indicates "displeasure," and a positive bar indicates "pleasantness." From the participant's response, it is possible to evaluate whether their emotions were positive or negative when their senses were stimulated.

[0022] [Excitement and Calmness] Participants can respond to sensory stimulation by moving a bar displayed on the user terminal 11 or evaluation device 10 left or right to indicate excitement and calmness. For example, a negative bar indicates "calm and peaceful (calm)," while a positive bar indicates "excited and intense (exhilarated)." From the participant's responses, it is possible to evaluate whether there are physical reactions such as a racing heart, rapid breathing, or increased blood flow when the sensory system is stimulated.

[0023] [Clarity of Consciousness] Participants can indicate the clarity of their consciousness when their senses are stimulated by moving a bar displayed on the user terminal 11 or evaluation device 10 left or right. For example, a negative value on the bar indicates "feeling drowsy," while a positive value indicates "feeling mentally sharp." From the participant's responses, it is possible to evaluate whether their consciousness is clear and their mind is sharp when their senses are stimulated.

[0024] [Matching Mood] Participants can respond by moving a bar displayed on the user terminal 11 or evaluation device 10 left or right to indicate how well it matches their mood when their senses are stimulated. For example, a negative position on the bar indicates "does not match current mood," and a positive position indicates "matches current mood." From the participant's response, it is possible to evaluate whether the stimulus they receive is what they are currently seeking.

[0025] [Sensory Familiarity] Participants can indicate their sensory familiarity with a stimulus by moving a bar displayed on the user terminal 11 or evaluation device 10 left or right. For example, a negative bar indicates "unfamiliarity (e.g., never drunk, never smelled, never touched)," and a positive bar indicates "familiarity (e.g., have drunk, smelled, or touched)." From the participant's responses, it is possible to evaluate whether they have experience with and are familiar with the stimulus.

[0026] <Evaluation of Psychological State> In one embodiment of the present invention, the subject's response to each of several types of stimuli is evaluated (for example, the response to drinking black tea, the response to drinking coffee, the response to drinking rooibos tea, the response to drinking roasted green tea, etc.). For example, the subject's response to each of several types of stimuli may be mapped, or the subject's susceptibility to emotional influence (whether they are easily influenced or not) may be evaluated based on the variability of the subject's response to each of several types of stimuli.

[0027] [Mapping] Figure 1 is a diagram illustrating the mapping of responses to sensory stimuli according to one embodiment of the present invention. The map is not limited as long as it can represent different psychological states using indicators related to emotions. For example, the subject's response is divided into four quadrants by two axes indicating emotions (for example, a diagram (also called a map) that represents Russell's circle of emotion model in four quadrants). For example, the two axes are an axis indicating arousal and sleepiness and an axis indicating pleasure and displeasure. Furthermore, when plotting psychological states on the map, the form of the plot (e.g., size, color, shape, etc.) may be changed based on response values ​​using indicators different from the axes of the map. This makes it possible to represent psychological states based on the axes and psychological states different from those based on these axes in a single map. Indicators different from the axes of the map include, for example, whether the stimulus matches the subject's current mood or not.

[0028] This mapping is not limited to two dimensions; it can also utilize three-dimensional space or even more multidimensional representations. The coordinate values ​​for each axis can be determined from a single item, or by combining the response values ​​from multiple items. The coordinate values ​​can be determined using the values ​​obtained from the questionnaire directly, or they can be transformed based on specific calculation formulas.

[0029] For example, scores obtained using a VAS scale from 0 to 100 can be scaled to a range of -100 to 100. Standardization methods include Z-score standardization, maximum-minimum standardization, and logarithmic transformation. Scaling can be performed using responses to a single stimulus or scores from multiple stimuli.

[0030] As shown in Figure 1, the vertical axis of the four quadrants represents wakefulness and sleepiness. The positive (+) direction indicates that sensory stimulation causes wakefulness, and the negative (-) direction indicates that sensory stimulation causes sleepiness. More specifically, it indicates whether both the body and consciousness are awake. The position along the vertical axis is determined based on the responses to the [Wakefulness and Sleepiness] question in the aforementioned questionnaire. Specifically, the coordinates along the vertical axis are determined based on the scores of the responses to the [Wakefulness and Sleepiness] question in the aforementioned questionnaire. Alternatively, the VAS (Visual Analog Scale) score, which has been converted to 0-100, may be linearly converted to -100-100 and that value may be used. Furthermore, it is not necessarily required to be linear; logarithmic transformations may also be used.

[0031] Furthermore, evaluation methods other than VAS may be used to obtain quantitative values. For example, sensory evaluation methods such as the Likert scale, SD method, magnitude estimation method, and pairwise comparison method can be used. It is also possible to obtain quantitative values ​​by conducting qualitative evaluations such as free-response texts and interviews and analyzing the text information obtained therefrom. Specifically, quantitative indicators can be derived by analyzing the frequency of word occurrences using text mining techniques and performing sentiment analysis. In addition, methods for calculating sentiment scores from text information using natural language processing techniques can also be considered. This makes it possible to perform quantitative evaluations even from qualitative data.

[0032] As shown in Figure 1, the horizontal axis of the four quadrants represents pleasure or displeasure. The positive (+) direction indicates a pleasant sensory stimulus, and the negative (-) direction indicates an unpleasant sensory stimulus. More specifically, it indicates whether the emotion is positive or negative. The position on the horizontal axis is determined based on the [pleasant / unpleasant] responses in the aforementioned questionnaire. Specifically, the coordinates on the horizontal axis are determined based on the scores of the [pleasant / unpleasant] responses in the aforementioned questionnaire. Alternatively, the VAS (Visual Analog Scale) score, which has been converted to 0-100, may be linearly converted to -100-100 and that value may be used. Furthermore, it is not necessarily required to be linear; logarithmic transformations may also be used.

[0033] If a subject is plotted in the upper right quadrant of the four quadrants in Figure 1, it indicates that their psychological state is active. If they are plotted in the lower right quadrant, it indicates that their psychological state is relaxed. If they are plotted in the upper left quadrant, it indicates that their psychological state is stressed. If they are plotted in the lower left quadrant, it indicates that their psychological state is ennui (a feeling of boredom and melancholy).

[0034] As shown in Figure 1, the participants' responses are plotted based on their answers to the "Mood Matching" question in the aforementioned questionnaire, with the size of the stimulus representing whether or not it matches the participant's current mood. For example, the larger the area a participant feels a stimulus matches their current mood, the larger the area they represent; the smaller the area a participant feels a stimulus does not match their current mood, the smaller the area they represent. Note that the size of this area (the size of the circle in Figure 1) is not limited to whether or not the stimulus matches the participant's current mood, but may also be based on the results of other questionnaire items, sensory evaluations, preference evaluations, or physiologically measured values ​​of physiological indicators.

[0035] Figure 2 shows an example of a map display according to one embodiment of the present invention. Figure 2 shows a case where multiple types of stimuli are applied to one sense (in the example of Figure 2, taste (drinking tea)) (in the example of Figure 2, drinking teas 1, 2, 3, 4, 5, and 6), and the subject's questionnaire responses when each stimulus is applied are plotted. In this way, the subject can easily understand which stimuli match their current mood and what psychological state they are in when given those stimuli, and which stimuli do not match their current mood and what psychological state they are in when given those stimuli. Note that the size of the area (the size of the circle in Figure 2) is not limited to the size based on whether the stimulus matches the subject's current mood or not, but may also be based on the results of other questionnaire items, sensory evaluations, preference evaluations, or physiologically measured values ​​of physiological indicators.

[0036] Furthermore, techniques such as radar charts, heatmaps, scatter plots, and bubble charts can be used to visualize responses to multiple sensory stimuli. This allows for a multifaceted analysis of the subject's responses and a visual understanding of their psychological state and sensory sensitivity to each stimulus. Radar charts, in particular, are suitable for simultaneously comparing multiple evaluation items and are useful for understanding the overall picture of the subject's responses to each stimulus at a glance. Heatmaps, on the other hand, can represent the intensity of responses to stimuli using shades of color, making them easy to understand visually and intuitively.

[0037] Figure 3 is an example of a map displaying multiple senses according to one embodiment of the present invention. Figure 3 shows the case in which multiple types of stimuli are applied to each of the multiple types of senses (in the example of Figure 3, taste (drinking tea) and smell (smelling fragrances)). (In the example of Figure 3, for taste, the subjects drink teas 1, 2, 3, 4, 5, and 6. For smell, the subjects smell fragrances 1, 2, 3, 4, 5, and 6.) The subjects' questionnaire responses when each stimulus is applied are plotted so that they can be compared between senses. In this way, subjects can grasp the differences between senses.

[0038] [Ease of being moved] Referring to Figures 4 to 6, we will explain how to assess ease of being moved (how easily one's mind is moved or not easily moved by sensory stimulation).

[0039] Figure 4 is a diagram illustrating the evaluation of susceptibility to emotional influence according to one embodiment of the present invention. In one embodiment of the present invention, susceptibility to emotional influence can be evaluated based on the variability (also called dispersion) of the subject's response when given each of several types of stimuli (in the example in Figure 4, the subject drank teas 1, 2, 3, 4, 5, and 6).

[0040] As shown in Figure 4 under "[Cases where the mind is not easily moved]", when the variability in the subject's response to each of multiple types of stimuli is small (i.e., when the difference between each response is small (when they are concentrated on the map)), it can be evaluated that stimulating that sense (taste in the example of Figure 4) will not easily move the mind. This is because, since the response is similar regardless of the stimulus, it cannot be said that the mind is reacting (being moved) by stimulating that sense.

[0041] As shown in Figure 4 under "[Cases where the mind is easily moved]", when there is a large variation in the subject's response to each of several types of stimuli (i.e., when there is a large difference between each response (distributed and arranged on the map)), it can be evaluated that the mind is easily moved by stimulating that sense (taste in the example of Figure 4). This is because the response differs depending on the type of stimulus given, and therefore it can be said that the mind is reacting (being moved) by stimulating that sense.

[0042] In the example in Figure 4, susceptibility to emotional influence is evaluated based on the variability of two items in the above questionnaire ([Arousal and Sleepiness] and [Pleasure and Displeasure]), but susceptibility to emotional influence may also be evaluated based on the variability of all items in the above questionnaire ([Arousal and Sleepiness], [Pleasure and Displeasure], [Excitement and Sedation], [Clarity of Mind], [Mood Congruence], and [Sensory Familiarity]).

[0043] The case of using a plurality of variations will be described in detail. As follows, the average value of the variations in each item (any representative value such as the average value or the median value may be used) can be used. 1. For each item of evaluation (for example, [Awakening and Drowsiness], [Pleasure and Displeasure], [Excitement and Calmness], [Clarity of Consciousness], [Conformity with Mood], [Familiarity of Sensation]), calculate the standard deviation of the evaluation (for example, the score of the questionnaire answer) for all types of stimuli (for example, 6 types such as Tea 1, Tea 2, Tea 3, Tea 4, Tea 5, and Tea 6). For example, for [Awakening and Drowsiness], calculate the variation for all types (that is, the standard deviation of the scores of Tea 1, Tea 2, Tea 3, Tea 4, Tea 5, and Tea 6). The same process is also performed for [Pleasure and Displeasure], [Excitement and Calmness], [Clarity of Consciousness], [Conformity with Mood], and [Familiarity of Sensation]. 2. Calculate the average value of the standard deviations of each item (that is, the average value of the standard deviation of [Awakening and Drowsiness], the standard deviation of [Pleasure and Displeasure], the standard deviation of [Excitement and Calmness], the standard deviation of [Clarity of Consciousness], the standard deviation of [Conformity with Mood], and the standard deviation of [Familiarity of Sensation]). 3. Use the average value calculated in 2. as the score of the ease of being emotionally moved of the subject.

[0044] Note that it is not limited to the variation between each of the plurality of stimuli, and the mental state may be evaluated based on any statistic (for example, variance, standard deviation, average value, median value, etc.) between each stimulus.

[0045] FIG. 5 is an example of displaying the ease of being emotionally moved according to an embodiment of the present invention. For example, as shown in FIG. 5, the degree of ease of being emotionally moved and the degree of difficulty of being emotionally moved can be displayed by bars.

[0046] FIG. 6 is an example of displaying the ease of being emotionally moved for a plurality of sensations according to an embodiment of the present invention. For example, as shown in FIG. 6, for each sensation, the degree of ease of being emotionally moved and the degree of difficulty of being emotionally moved can be displayed by bars.

[0047] Note that, as shown in FIGS. 5 and 6, instead of displaying with bars, the degree of ease of moving the heart and the degree of difficulty of moving the heart may be displayed as numerical values, text, etc. Furthermore, as a method for visualizing the differences in responses for each of a plurality of sensations, methods such as a radar chart, a heat map, a scatter diagram, a bubble chart, etc. can be used. Thereby, it becomes possible to analyze the responses of the subject from various angles and visually grasp the mental state and the sensitivity of the sensations to each stimulus. In particular, a radar chart is suitable for simultaneously comparing a plurality of evaluation items and is useful for understanding at a glance the overall image of the subject's response to each stimulus. Also, by using a heat map, the strength of the response to a stimulus can be represented by the shade of a color, making it easy to understand visually and intuitively.

[0048] [Evaluation of Sensory Sensitivity] In one embodiment of the present invention, it is possible to evaluate the sensory sensitivity of a subject when the subject's senses are stimulated. In this case, as the response of the subject when the subject's senses are stimulated, answers to a questionnaire regarding sensitivity (for example, whether the tea is strong or weak), results of sensory evaluation (for example, whether the tea is bitter or sweet), etc. can be used.

[0049] In the evaluation of sensory sensitivity, in order to obtain the response of the subject when the subject is stimulated, an evaluation regarding sensitivity is performed. For example, the types of evaluations regarding sensitivity are as follows. - Threshold evaluation (perception threshold): The minimum intensity at which a stimulus can be felt. - Threshold evaluation (difference threshold): The minimum difference in the intensities of different stimuli that can be recognized. - Pleasant / unpleasant evaluation: Evaluation of subjective comfort or discomfort with respect to a stimulus. - Preference evaluation: Evaluation of preference for a stimulus. - Intensity evaluation: Subjective evaluation of the intensity of a stimulus (e.g., very weak, weak, normal, strong, very strong). - Duration evaluation: The duration of feeling a stimulus or the change in response to a continuous stimulus. - Emotional response evaluation: Emotional response to a stimulus (e.g., joy, surprise, disgust, etc.). - Physiological response evaluation: Evaluation using physiological indices such as heart rate, skin conductance response, electroencephalogram, etc. - Cognitive evaluation: Cognitive response or degree of understanding with respect to a stimulus (e.g., recognition of the meaning and relevance of a stimulus).

[0050] When evaluating sensory sensitivity, it is desirable to select stimuli in which only specific types of characteristic values ​​are changed. This allows for a clear evaluation of how the subject's response changes in response to specific characteristics, enabling accurate measurement of sensitivity. Examples include sweetness in taste, stickiness in touch, and brightness in vision. The characteristic values ​​of the stimuli may be determined based on the results of separately conducted sensory evaluations or sensitivity evaluations. Alternatively, they may be determined based on physical properties measured using other evaluation equipment.

[0051] It is desirable to present stimuli randomly. Evaluation may be performed using absolute evaluation of the presented stimuli. Alternatively, a reference stimulus and the stimulus being evaluated may be presented, and relative evaluation may be performed. There are no particular restrictions on the evaluation method. Specifically, various evaluation methods can be used for sensory evaluation, such as the Semantic Differential (SD) method, paired comparison method, and magnitude estimation method. Physiological measurements may be used to obtain responses to stimuli. The effect of the previous stimulus may be reset between stimulus presentations. Stimulus evaluation may be repeated. Repeated evaluation can increase the reliability of the evaluation.

[0052] Sensory sensitivity may be evaluated based on the statistical data of the subject's response to each stimulus when given multiple types of stimuli. This evaluation of sensory sensitivity is not limited to the variability between stimuli, but may also be based on any statistical data between stimuli (e.g., variance, standard deviation, mean, median, etc.). By understanding the differences in sensory sensitivity between stimuli, the subject 20 can be recommended appropriate stimuli based on those differences in sensitivity.

[0053] The evaluation of sensory sensitivity may be made comparable between senses based on statistical data of the subject's response to each stimulus when given multiple types of stimuli. This comparison between senses is not limited to the variability between multiple stimuli for a given sense, but may also be based on any statistical data between stimuli (e.g., variance, standard deviation, mean, median, etc.). By understanding the differences in sensory sensitivity between senses, subject 20 can be recommended appropriate senses and stimuli based on those differences in sensitivity.

[0054] The following explanation will describe the case where the sensation is touch, referring to Figures 7 to 10.

[0055] Figure 7 shows an example of a map display according to one embodiment of the present invention. Similar to Figure 2, Figure 7 shows a case where multiple types of stimuli are applied to one sense (in the example of Figure 7, touch (touching dishes, etc.)) (in the example of Figure 7, touching dishes 1, 2, 3, 4, 5, and 6), and the subject's questionnaire responses when each stimulus is applied are plotted. In this way, the subject can easily understand which stimuli match their current mood and what psychological state they are in when given those stimuli, and which stimuli do not match their current mood and what psychological state they are in when given those stimuli. Note that the size of the area (the size of the circle in Figure 7) is not limited to the size based on whether the stimulus matches the subject's current mood or not, but may also be based on the results of other questionnaire items, sensory evaluations, preference evaluations, or physiologically measured values ​​of physiological indicators.

[0056] Figure 8 shows an example of a map display according to one embodiment of the present invention. Similar to Figure 7, Figure 8 shows a case where multiple types of stimuli are applied to one sense (in the example of Figure 8, touch (touching dishes, etc.)) (in the example of Figure 8, touching dishes 1, 2, 3, 4, 5, and 6).

[0057] The two axes of the map are based on prior characteristic evaluations of things that stimulate the senses (generally objects that are eaten, drunk, smelled, touched, seen, observed, heard, etc.) (in Figure 8, these axes are smoothness and temperature). The prior characteristic evaluation may be based on sensory evaluation, measured physical properties, or values ​​reported by the subjects.

[0058] In Figure 8, "zarahiya" represents a rough and cold feeling, "tsuruhiya" represents a smooth and cold feeling, "zarahowa" represents a rough and warm feeling, and "tsuruhowa" represents a smooth and warm feeling.

[0059] Based on the responses to the "Mood Matching" question in the aforementioned questionnaire, stimuli are plotted with a size that reflects whether or not they match the subject's current mood. For example, the larger the area a subject feels a stimulus matches their current mood, the larger the area they represent; the smaller the area a subject feels a stimulus does not match their current mood. Note that the size of this area (the size of the circles in Figure 8) is not limited to whether or not the stimulus matches the subject's current mood; it may also be based on the results of other questionnaire items, sensory evaluations, preference evaluations, or physiologically measured values ​​of physiological indicators.

[0060] In this way, the subject can easily understand which stimuli (textures) suit their current mood and what kind of stimuli (textures) those stimuli are, and which stimuli (textures) do not suit their current mood and what kind of stimuli those stimuli are.

[0061] Figure 9 shows an example of displaying susceptibility to emotional influence according to one embodiment of the present invention. For example, as shown in Figure 9, the degree to which one is easily moved and the degree to which one is not easily moved can be displayed using bars.

[0062] Figure 10 shows an example of a display of mind and touch sensation according to one embodiment of the present invention. As shown in Figure 10, the relationship between the score of the response to [Arousal and Sleepiness] in the questionnaire or the score of the response to [Pleasure and Displeasure] in the questionnaire and each of the two axes (for example, smoothness and warmth / coldness) based on prior characteristic evaluations of things that stimulate the senses (generally objects that are eaten, drunk, smelled, touched, seen, observed, heard, etc.) is determined and shown based on correlation coefficients, etc. In other words, it shows which prior characteristic evaluations are related to the psychological state.

[0063] [Comparison of Subjective and Objective Responses] Figure 11 shows an example of a comparison of subjective and objective responses according to one embodiment of the present invention.

[0064] Figure 11, showing "emotional responses (i.e., subjective reactions)," similar to Figure 2, illustrates a case where multiple types of stimuli are applied to a single sense (in the example of Figure 11, the sense of smell (smelling)) (in the example of Figure 11, smelling scents 1, 2, and 3). The subject's questionnaire responses for each stimulus are plotted. For example, the larger the area a stimulus occupies, the more the subject feels it matches their current mood; the smaller the area a stimulus occupies, the less the subject feels it matches their current mood. In this way, subjects can easily understand which stimuli they like and what psychological state they experience when given those stimuli, and which stimuli they dislike and what psychological state they experience when given those stimuli.

[0065] Figure 11, showing "bodily responses (i.e., objective responses)," illustrates the case where multiple types of stimuli are applied to a single sense (in the example of Figure 11, the sense of smell (smelling)) (in the example of Figure 11, smelling scents 1, 2, and 3). The values ​​measured by the subject's physiological measurement device (values ​​of physiologically measured physiological indicators) when each stimulus is applied are plotted. For example, the more the subject feels that a stimulus matches their current mood (i.e., the subject likes the stimulus), the larger the area represented by that stimulus. The more the subject feels that a stimulus does not match their current mood (i.e., the subject dislikes the stimulus), the smaller the area represented by that stimulus. In this way, the subject can easily understand which stimuli they like and how their body reacts when they are given those stimuli, and which stimuli they dislike and how their body reacts when they are given those stimuli.

[0066] In Figure 11, the horizontal axis of "Body Response" is calculated from the magnitude of the change in cerebral blood flow. If the activity on the right side of the frontal lobe (change in cerebral blood flow) is relatively high, it moves towards discomfort (to the left), and if the activity on the left side of the frontal lobe (change in cerebral blood flow) is relatively high, it moves towards comfort (to the right). The vertical axis is calculated from the change in pulse rate from resting. If it is high, it moves towards the upward direction, and if it is low, it moves towards the downward direction. In addition to the change in pulse rate derived from cerebral blood flow, other pulse waves such as those from the earlobe or heart rate derived from an electrocardiogram (ECG) may also be used.

[0067] As shown in Figure 11, the degree to which the mind is easily moved (i.e., subjective response) and the degree to which the mind is not easily moved (i.e., objective response) can be displayed using bars.

[0068] As shown in Figure 11, the relationship between the scores for the "Arousal and Sleepiness" response or the "Pleasure / Displeasure" response in the "Mental Response (i.e., subjective reaction)" questionnaire and the "Physical Response (difference in activity between the right and left frontal lobes, change in pulse rate)" is determined and shown based on correlation coefficients, etc.

[0069] <Method> Figure 12 is a flowchart of the evaluation process according to one embodiment of the present invention. Note that a person other than the subject may operate the user terminal 11 or the evaluation device 10.

[0070] In step 11 (S11), the subject selects one of the five senses (taste, smell, touch, sight, hearing). For example, the subject selects and inputs a desired sense from among several senses displayed on the user terminal 11 or evaluation device 10 (described in detail later). Pre-defined senses may also be used.

[0071] In Step 11, after selecting your five senses, you select a category that is appropriate for those senses. Note that in Step 11, you may choose only a category.

[0072] In step 12 (S12), the participant selects a stimulus (specifically, the type of stimulus for the sensation selected in S11 (for example, the type of tea)). For example, the participant selects and inputs a desired type of stimulus (for example, tea 1) from among several types of stimuli displayed on the user terminal 11 or evaluation device 10 (for example, tea 1, tea 2, tea 3, tea 4, tea 5, and tea 6). Alternatively, predetermined types of stimuli may be used.

[0073] Furthermore, the type of stimulus may be based on differences in the quality of the stimulus (i.e., each stimulus has a different quality (e.g., green tea and brown rice tea)) or on differences in intensity (i.e., each stimulus has the same quality but a different intensity (e.g., strong green tea and weak green tea)).

[0074] The step of confirming whether the subject can drink or not may be performed before S11, when selecting a category in S11, or at any point during S12.

[0075] In step 13 (S13), the subject inputs their response to the stimulus in S12. For example, the subject inputs their answers to a questionnaire into the user terminal 11 or evaluation device 10. The subject's response may also be the value of physiologically measured physiological indicators (for example, information measured by NIRS (Near Infrared Spectroscopy) (e.g., changes in cerebral blood flow), information on heart rate (e.g., changes in pulse rate), etc.).

[0076] In step 14 (S14), the number of stimuli already given to the senses is counted. If the predetermined number of stimuli has been reached (i.e., all stimuli have been given), the process proceeds to step 15. If the predetermined number of stimuli has not been reached (i.e., there are still stimuli to be given), the process returns to step 12.

[0077] In step 15 (S15), the number of sensations that have already been stimulated is counted. If the predetermined number of sensations has been reached (i.e., all sensations have been stimulated), the process proceeds to step 16. If the predetermined number of sensations has not been reached (i.e., there are still sensations that need to be stimulated), the process returns to step 11.

[0078] In step 16 (S16), the subject's response in S13 is plotted on four quadrants separated by two axes representing emotions, as explained in Figures 1 and 2, in a manner (for example, size; color, shape, etc.) based on whether the stimulus matches the subject's current mood.

[0079] In step 17 (S17), the subjects' responses to each stimulus are compared. For example, as explained in Figures 4 and 5, susceptibility to emotional influence (how easily or unaffected a person is) is evaluated and displayed based on whether the responses to each stimulus are varied or not.

[0080] In step 18 (S18), a comparison is made between the subject's five senses. For example, as explained in Figure 3, maps for each sense are created and displayed in a comparable manner (created and displayed using the same method). For example, as explained in Figure 6, the susceptibility to emotional influence in each sense is evaluated and displayed in a comparable manner (evaluated and displayed using the same method).

[0081] In the evaluation process, both steps 17 and 18 may be performed, or either one may be performed.

[0082] Furthermore, after S18, the psychological state of the subject when their senses were stimulated, or the sensitivity of the subject's senses, is displayed on the user terminal 11 or evaluation device 10. Recommendations may also be made based on the subject's psychological state when their senses were stimulated, or the sensitivity of the subject's senses.

[0083] <Other evaluations (changes over a predetermined period)> In one embodiment of the present invention, the subject's response when stimulated in the subject's senses is repeatedly obtained at intervals of a certain period, and the subject's psychological state or the subject's sensory sensitivity may be evaluated based on the difference between the current response and the previous response (for example, the change from the previous to the current response is evaluated).

[0084] <Other evaluations (changes before and after evaluation)> In one embodiment of the present invention, the subject's response before and after sensory stimulation is obtained, and the subject's psychological state or sensory sensitivity is evaluated based on the difference between the pre-stimulation and post-stimulation responses (for example, evaluating the change from before to after stimulation). It is also possible to compare with the average value (for example, the average value of the group to which the subject belongs).

[0085] When evaluating a subject's response to multiple stimuli, a method can be employed to estimate the response based on previously acquired response data to the stimuli, thereby reducing the response burden. The specific processing method is shown below.

[0086] First, using response data to stimuli acquired in advance, the response patterns of the subjects are classified using clustering analysis. In this process, each response data is treated as a feature, and data with similar response patterns are classified into the same cluster. By obtaining representative response patterns, the center point (representative value) of each cluster is calculated.

[0087] Next, we evaluate the similarity to determine which cluster the newly obtained response data to stimuli is closest to. Specifically, we use methods such as Euclidean distance and cosine similarity to calculate the distance between the new response data of the subjects and the representative values ​​of each cluster.

[0088] If a certain degree of similarity is exceeded, the participant's response is estimated using the representative value of the identified cluster, making it possible to omit the evaluation of the stimulus. This reduces the participant's response burden and enables efficient evaluation.

[0089] When evaluating a subject's response to multiple stimuli, a method can be employed to estimate the response based on previously acquired response data to the stimuli, thereby reducing the response burden. The specific processing method is shown below.

[0090] First, a regression model is constructed using response data to stimuli acquired in advance. In this model, the subject's response is set as the dependent variable, and the characteristics of the stimulus (intensity, type, etc.) are set as independent variables. For example, methods such as linear regression, ridge regression, and lasso regression can be used.

[0091] Next, the constructed regression model is used to predict responses based on the characteristics of newly obtained stimuli. Specifically, the characteristics of the newly presented stimuli are input into the model, and the predicted response is calculated.

[0092] To evaluate how closely newly acquired response data to stimuli matches past data, the goodness of fit of the model is calculated. Specifically, the coefficient of determination (R) is used. ２ The prediction accuracy of the model is evaluated using metrics such as the mean squared error (MSE).

[0093] If the goodness of fit exceeds a certain threshold, it becomes possible to omit obtaining responses to additional stimuli. This reduces the response burden on participants and enables efficient evaluation. Conversely, if the goodness of fit falls below the threshold, it is recommended to obtain responses to additional stimuli and collect data to improve the accuracy of the model.

[0094] In addition to the above, the following methods other than machine learning may also be used: 1. Statistical methods: For example, multiple regression analysis or analysis of variance (ANOVA) can be used to estimate responses to new stimuli from past response data. 2. Heuristic methods: Based on the subject's past response patterns, it is possible to estimate responses to similar stimuli by utilizing expert knowledge and rules of thumb. 3. Simulation methods: A model can be built to simulate the subject's responses and predict responses to different stimuli. 4. Heuristic methods: It is also possible to adopt a method that estimates the subject's responses based on simple rules or intuition.

[0095] By using these methods, it becomes possible to estimate the subject's response and reduce the number of stimuli presented. This streamlines the evaluation process and reduces the burden on the subject.

[0096] Figure 13 is a flowchart of the evaluation process according to one embodiment of the present invention. Unlike Figure 12, in Figure 13, a reset determination is made, the response to the stimulus is estimated, and the required number of stimuli is determined.

[0097] Figure 14 is a flowchart of the evaluation process according to one embodiment of the present invention.

[0098] In step 201 (S201), the subject or another person selects one of the five senses (taste, smell, touch, sight, hearing). For example, the subject or another person selects and inputs a desired sense from among several senses displayed on the user terminal 11 or evaluation device 10 (described in detail later). Pre-defined senses may also be used. For example, tea, fragrance, or tableware may be selected.

[0099] In step 201, after selecting one of the five senses, you select a category that is appropriate for that sense. Note that in step 201, selecting only a category is also acceptable.

[0100] In step 202 (S202), the subject or another person selects a stimulus (specifically, the type of stimulus for the sensation selected in S201 (for example, the type of tea)). For example, the subject or another person selects and inputs a desired type of stimulus (for example, tea 1) from among several types of stimuli (for example, tea 1, tea 2, tea 3, tea 4, tea 5, tea 6) displayed on the user terminal 11 or evaluation device 10. Alternatively, predetermined types of stimuli may be used.

[0101] Furthermore, the type of stimulus may be based on differences in the quality of the stimulus (i.e., each stimulus has a different quality (e.g., green tea and brown rice tea)) or on differences in intensity (i.e., each stimulus has the same quality but a different intensity (e.g., strong green tea and weak green tea)).

[0102] In step 203 (S203), the subject or a person other than the subject inputs their response to the stimulus in S202. For example, the subject or a person other than the subject inputs their answers to the questionnaire into the user terminal 11 or evaluation device 10. The subject's response may be the value of physiologically measured physiological indicators (for example, information measured by NIRS (Near Infrared Spectroscopy) (e.g., changes in cerebral blood flow), information related to heart rate such as pulse rate (e.g., changes in pulse rate), etc.).

[0103] Furthermore, rest periods will be provided before and after measuring cerebral blood flow.

[0104] In step 204 (S204), a reset action is performed (for example, drinking water, taking a deep breath, wiping hands with a wet towel or similar item).

[0105] In step 205 (S205), the number of stimuli already given to the senses is counted. If the predetermined number of stimuli has been reached (i.e., all stimuli have been given), the process proceeds to step 206. If the predetermined number of stimuli has not been reached (i.e., there are still stimuli to be given), the process returns to step 202.

[0106] In step 206 (S206), the number of sensations that have already been stimulated is counted. If the predetermined number of sensations has been reached (i.e., all sensations have been stimulated), the process proceeds to step 207. If the predetermined number of sensations has not been reached (i.e., there are still sensations that need to be stimulated), the process returns to step 201.

[0107] In step 207 (S207), the analysis is performed.

[0108] In step 208 (S208), the subjects' responses to each stimulus are compared. For example, as explained in Figures 4 and 5, the susceptibility to emotional influence (how easily or unaffected the subject is) is evaluated and displayed based on whether the responses to each stimulus are varied or not.

[0109] In step 209 (S209), a comparison is made between the subject's five senses. For example, as explained in Figure 3, maps for each sense are created and displayed in a comparable manner (created and displayed using the same method). For example, as explained in Figure 6, the susceptibility to emotional influence in each sense is evaluated and displayed in a comparable manner (evaluated and displayed using the same method).

[0110] Furthermore, in S209, a comparison is made between responses. Specifically, a comparison is made between subjective responses (i.e., the mental responses in Figure 11) and objective responses (i.e., the physical responses in Figure 11), as explained in Figure 11 (i.e., the relationship between the mental responses and physical responses in Figure 11 is determined based on correlation coefficients, etc.).

[0111] In step 210 (S210), as explained in Figure 8, the correspondence between stimulus characteristics (prior evaluation of the characteristics of the sensory stimuli) and responses is analyzed. In addition, the relationships between responses are analyzed (as explained in Figure 10, the relationship between questionnaire responses and prior evaluation of the characteristics of the sensory stimuli is determined based on correlation coefficients, etc.).

[0112] <Overall Configuration Example> Figure 15 shows an overall configuration example according to one embodiment of the present invention.

[0113] [Example 1] The evaluation system 1 includes a user terminal 11 and a server 12. The user terminal 11 and the server 12 can send and receive data from each other.

[0114] In Example 1, the server 12 evaluates the psychological state of the subject 20 when their senses are stimulated, or the sensitivity of the subject 20's senses, and the user terminal 11 displays the evaluation results (the psychological state of the subject 20 when their senses are stimulated, or the sensitivity of the subject 20's senses).

[0115] <<User Terminal>> The user terminal 11 is a terminal operated by the subject 20. For example, the user terminal 11 may be a personal computer, tablet, smartphone, etc.

[0116] <<Server>> Server 12 is a server that can connect to one or more user terminals 11. Server 12 consists of one or more computers.

[0117] [Example 2] In Example 2, the evaluation device 10 evaluates and displays the psychological state of the subject 20 when their senses are stimulated, or the sensitivity of the subject 20's senses.

[0118] <<Evaluation Device>> The evaluation device 10 is a terminal operated by the subject 20. For example, the evaluation device 10 is a personal computer, tablet terminal, smartphone, etc.

[0119] <Functional Blocks> The functional configuration of the evaluation system 1 will be explained below with reference to Figure 16, and the functional configuration of the evaluation device 10 will be explained with reference to Figure 17.

[0120] Figure 16 is a functional block diagram of an evaluation system 1 according to one embodiment of the present invention.

[0121] <<Server>> Server 12 may include an acquisition unit 102, an evaluation unit 103, an evaluation result output unit 104, a recommendation unit 105, and an estimation unit 106. By executing a program, Server 12 can function as the acquisition unit 102, evaluation unit 103, evaluation result output unit 104, recommendation unit 105, and estimation unit 106.

[0122] The acquisition unit 102 acquires the subject 20's response when the subject 20's senses are stimulated. For example, the acquisition unit 102 acquires the subject 20's questionnaire responses entered into the user terminal 11 from the user terminal 11. For example, the acquisition unit 102 acquires the subject 20's physiological indicator values ​​from the user terminal 11.

[0123] For example, responses may include questionnaire answers or values ​​of physiologically measured physiological indicators (e.g., information measured by NIRS (Near Infrared Spectroscopy) (e.g., changes in cerebral blood flow), information on heart rate (e.g., changes in pulse rate), etc.). Physiological indicator values ​​include, but are not limited to, heart rate, heart rate variability, skin electrical activity, electroencephalogram (EEG), cerebral blood flow (e.g., changes in cerebral blood flow), blood pressure, respiration, pulse (e.g., changes in pulse rate), facial muscle activity, electromyography (EMG), skin temperature, and pupil diameter.

[0124] The evaluation unit 103 evaluates the psychological state of the subject 20 or the sensitivity of the subject 20's senses when the subject 20's senses are stimulated, based on the subject 20's response acquired by the acquisition unit 102. For example, the evaluation unit 103 can perform the evaluation described with reference to Figures 1 to 14.

[0125] The evaluation result output unit 104 outputs (for example, transmits to the user terminal 11) the results evaluated by the evaluation unit 103 (i.e., the psychological state of the subject 20 when their senses were stimulated, or the sensitivity of the subject 20's senses). The evaluation result output unit 104 may also output the evaluation results of the subject 20 in a manner that allows comparison with the average of the evaluations.

[0126] The recommendation unit 105 makes recommendations based on the evaluation results from the evaluation unit 103 (i.e., the psychological state of the subject 20 when their senses are stimulated, or the sensitivity of the subject 20's senses). For example, the recommendation unit 105 transmits beauty information (e.g., information on cosmetics, beauty devices, beauty methods, food and beverages, etc.) to the user terminal 11. For example, based on the evaluation results, the recommendation unit 105 selects appropriate stimuli and conditions for stimulation to change the subject's psychological state and presents them to the subject. The subject can change their psychological state on a daily basis by receiving recommended stimuli (e.g., a specific beverage, a specific scent, etc.) when they want to change their psychological state (e.g., when they want to be more active).

[0127] <<User Terminal>> The user terminal 11 may include a five-sensory stimulus presentation unit 201, a reception unit 202, a transmission unit 203, a receiving unit 204, and a display unit 205. By executing a program, the user terminal 11 can function as the five-sensory stimulus presentation unit 201, the reception unit 202, the transmission unit 203, the receiving unit 204, and the display unit 205.

[0128] The five-sensory stimulation display unit 201 presents (for example, displays) information necessary when stimulating one or more of the senses (taste, smell, touch, sight, and hearing).

[0129] For example, the five-sensory stimulation presentation unit 201 presents multiple sensations to the subject 20 in S11 of Figure 12, allowing the subject 20 to select one of the sensations, and then presents multiple stimuli (stimuli for the sensation selected in S11) to the subject 20 in S12 of Figure 12, allowing the subject 20 to select one of the stimuli.

[0130] [In the case of taste] For example, the sensory stimulation display unit 201 displays information about food and drink to stimulate the sense of taste (for example, the type of tea to drink (for example, green tea)).

[0131] [In the case of the sense of smell] For example, the sensory stimulus presentation unit 201 presents information about objects that emit scents to stimulate the sense of smell (for example, the type of scent to smell (for example, the scent of oranges)).

[0132] [In the case of touch] For example, the five-sense stimulus presentation unit 201 presents information about objects to stimulate the sense of touch (for example, the type of tableware to be touched, the type of cosmetics, the containers and tools of cosmetics, clothing, bedding).

[0133] [In the case of vision] For example, the sensory stimulation display unit 201 presents information to stimulate the vision (for example, presenting tableware to be looked at, displaying light, images (still images or moving images)).

[0134] [In the case of hearing] For example, the sensory stimulation presentation unit 201 presents information to stimulate hearing (for example, presenting the sound of tableware to be heard, playing music, etc.).

[0135] The reception unit 202 receives the subject 20's response when the subject 20's senses are stimulated. For example, the reception unit 202 receives the subject 20's answers to a questionnaire that the subject 20 has entered into the evaluation device 10. Alternatively, the reception unit 202 may receive the subject 20's response by receiving the subject 20's physiological indicator values ​​from a physiological measurement device.

[0136] The transmitting unit 203 transmits the response of the subject 20 received by the receiving unit 202 to the server 12.

[0137] The receiving unit 204 receives the evaluation results (i.e., the psychological state of the subject 20 when their senses are stimulated, or the sensitivity of the subject 20's senses), recommendation information from the recommendation unit 105, and estimation results from the estimation unit 106 (i.e., at least one of the subject 20's skin condition, physical condition, and mental state) from the server 12.

[0138] The display unit 205 displays the evaluation results received by the receiving unit 204 (i.e., the psychological state of the subject 20 when their senses were stimulated, or the sensitivity of the subject 20's senses), the recommendation information from the recommendation unit 105, and the estimation results from the estimation unit 106 (i.e., at least one of the subject 20's skin condition, physical condition, and mental state) on the user terminal 11.

[0139] <<Evaluation Device>> Figure 17 is a functional block diagram of an evaluation device 10 according to one embodiment of the present invention. The evaluation device 10 may include a five-sensory stimulus presentation unit 101, an acquisition unit 102, an evaluation unit 103, an evaluation result output unit 104, a recommendation unit 105, and an estimation unit 106. By executing a program, the evaluation device 10 can function as the five-sensory stimulus presentation unit 101, the acquisition unit 102, the evaluation unit 103, the evaluation result output unit 104, the recommendation unit 105, and the estimation unit 106.

[0140] The five-sensory stimulation display unit 101 presents (for example, displays) information necessary when stimulating one or more of the senses (taste, smell, touch, sight, and hearing).

[0141] For example, the five-sensory stimulation presentation unit 101 presents multiple sensations to the subject 20 in S11 of Figure 12, allowing the subject 20 to select one of the sensations, and then presents multiple stimuli (stimuli for the sensation selected in S11) to the subject 20 in S12 of Figure 12, allowing the subject 20 to select one of the stimuli.

[0142] [In the case of taste] For example, the sensory stimulation display unit 101 displays information about food and drink to stimulate the sense of taste (for example, the type of tea to drink (for example, green tea)).

[0143] [In the case of the sense of smell] For example, the sensory stimulus presentation unit 101 presents information about objects that emit scents to stimulate the sense of smell (for example, the type of scent to smell (for example, the scent of oranges)).

[0144] [In the case of touch] For example, the five-sensory stimulus presentation unit 101 presents information about objects that stimulate the sense of touch (for example, the type of tableware to be touched, the type of cosmetics).

[0145] [In the case of vision] For example, the sensory stimulation display unit 101 presents information to stimulate the vision (for example, presenting tableware to be seen, displaying light, images (still images or moving images)).

[0146] [In the case of hearing] For example, the sensory stimulation presentation unit 101 presents information to stimulate hearing (for example, presenting the sound of tableware to be heard, playing music, etc.).

[0147] The acquisition unit 102 acquires the subject 20's response when the subject 20's senses are stimulated. For example, the acquisition unit 102 receives the subject 20's answers to a questionnaire that the subject 20 inputs into the evaluation device 10. Alternatively, the acquisition unit 102 may receive the subject 20's response by receiving values ​​of the subject 20's physiological indicators from a physiological measurement device.

[0148] For example, responses may include questionnaire answers or values ​​of physiologically measured physiological indicators (e.g., information measured by NIRS (Near Infrared Spectroscopy) (e.g., changes in cerebral blood flow), information on heart rate (e.g., changes in pulse rate), etc.).

[0149] The evaluation unit 103 evaluates the psychological state of the subject 20 or the sensitivity of the subject 20's senses when the subject 20's senses are stimulated, based on the subject 20's response acquired by the acquisition unit 102. For example, the evaluation unit 103 can perform the evaluation described with reference to Figures 1 to 14.

[0150] The evaluation result output unit 104 outputs (for example, displayed on the evaluation device 10) the results evaluated by the evaluation unit 103 (i.e., the psychological state of the subject 20 when their senses are stimulated, or the sensitivity of the subject 20's senses). The evaluation result output unit 104 may compare the evaluation results of one subject 20 with the evaluation results of other subjects 20. The evaluation results of other subjects 20 may include the evaluation result of one person, the average value of multiple evaluation results, variability, percentiles, maximum value, minimum value, etc. By comparing among subjects 20, the individuality of the changes in a particular subject 20's psychological state can be understood.

[0151] The recommendation unit 105 makes recommendations based on the results evaluated by the evaluation unit 103 (i.e., the psychological state of the subject 20 when their senses are stimulated, or the sensitivity of the subject 20's senses). For example, the recommendation unit 105 displays beauty information (e.g., information on cosmetics, beauty devices, beauty methods, food and beverages, etc.) on the evaluation device 10.

[0152] The estimation unit 106 estimates at least one of the subject 20's skin condition, physical condition, and mental state, according to the subject 20's sensory sensitivity. The estimation unit 106 also displays the estimated result (i.e., at least one of the subject 20's skin condition, physical condition, and mental state) on the evaluation device 10.

[0153] Alternatively, the subject's senses may be stimulated beforehand when they are in a reset state, and their response to the stimulation may be recorded and stored. The evaluation may then be performed using the stored response of the subject.

[0154] <Effects> In one embodiment of the present invention, the subject can learn about the characteristics of their own five senses, the tendencies of changes in their psychological state in response to sensory stimuli, and the differences between subjective evaluation and instrumental measurement. This enables them to select stimuli that suit their psychological state and to control their own psychological state.

[0155] <Hardware Configuration> Figure 18 is a hardware configuration diagram of a user terminal 11, a server 12, and an evaluation device 10 according to one embodiment of the present invention. The user terminal 11, server 12, and evaluation device 10 may include a control unit 1001, a main memory unit 1002, an auxiliary memory unit 1003, an input unit 1004, an output unit 1005, and an interface unit 1006. Each of these will be described below.

[0156] The control unit 1001 is a processor (for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc.) that executes various programs installed in the auxiliary storage unit 1003.

[0157] The main memory unit 1002 includes non-volatile memory (ROM (Read Only Memory)) and volatile memory (RAM (Random Access Memory)). The ROM stores various programs, data, etc. necessary for the control unit 1001 to execute various programs installed in the auxiliary memory unit 1003. The RAM provides a work area that is expanded when various programs installed in the auxiliary memory unit 1003 are executed by the control unit 1001.

[0158] The auxiliary storage unit 1003 is an auxiliary storage device that stores various programs and information used when various programs are executed.

[0159] The input unit 1004 is an input device that allows operators of the user terminal 11, server 12, and evaluation device 10 to input various instructions to the user terminal 11, server 12, and evaluation device 10.

[0160] The output unit 1005 is an output device that outputs the internal status of the user terminal 11, server 12, evaluation device 10, etc.

[0161] The interface unit 1006 is a communication device for connecting to a network and communicating with other devices.

[0162] Although embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and changes are possible within the scope of the gist of the present invention as described in the claims.

[0163] This international application claims priority under Japanese Patent Application No. 2025-003797, filed on 9 January 2025, and the entire contents of No. 2025-003797 are incorporated herein by reference.

[0164] 1 Evaluation System 11 User Terminal 12 Server 10 Evaluation Device 20 Subject 101 Sensory Stimulus Presentation Unit 102 Acquisition Unit 103 Evaluation Unit 104 Evaluation Result Output Unit 105 Recommendation Unit 106 Estimation Unit 201 Sensory Stimulus Presentation Unit 202 Reception Unit 203 Transmission Unit 204 Receiving Unit 205 Display Unit 1001 Control Unit 1002 Main Memory Unit 1003 Auxiliary Memory Unit 1004 Input Unit 1005 Output Unit 1006 Interface Unit

Claims

1. A method comprising: obtaining the subject's response when the subject's senses are stimulated while the subject's senses are in a reset state; and evaluating the subject's psychological state when the subject's senses are stimulated, based on the response.

2. The method according to claim 1, wherein stimulating the sense means providing multiple types of stimuli to a single sense.

3. The method according to claim 2, wherein the evaluation involves quantitatively evaluating the subject's response when each of the plurality of types of stimuli is administered.

4. The method according to claim 3, further comprising outputting the psychological state of the subject, wherein the subject's response to each of the plurality of types of stimuli is plotted on a plurality of classifications separated by two or more axes of an index indicating emotion.

5. The method according to claim 4, wherein the output of the psychological state is plotted in different forms based on the subject's response values ​​on the plurality of classifications using an index that shows an emotion different from the axis.

6. The method according to claim 3, wherein the evaluation involves assessing the psychological state based on the statistical quantities between each stimulus of the subject's response when each of the plurality of types of stimuli is given.

7. The method according to claim 1, wherein stimulating the senses means providing multiple types of stimuli to each of the multiple types of senses.

8. The method according to claim 5, wherein the evaluation involves comparing the psychological state between sensations based on statistical quantities between the responses of the subject to each of the plurality of types of stimuli.

9. The method according to claim 1, further comprising outputting the evaluation results of the subject in a manner that allows for comparison with the evaluation results of a subject different from the subject.

10. The method according to claim 1, further comprising providing recommendations in accordance with the psychological state of the subject.

11. The method according to claim 1, wherein the sense is one or more of the senses of taste, smell, touch, sight, and hearing.

12. The method according to claim 1, wherein the stimulus is an article, visual information, or the human body.

13. The method according to claim 1, wherein the stimulus is any of the following: a beverage, a fragrance, cosmetics, music, images, videos, food, tableware, clothing, bedding, cosmetic tools, cosmetic containers, plants, skin, face, the subject's own face, the subject's own body, or the subject's own skin.

14. An evaluation device comprising: an acquisition unit that acquires the subject's response when the subject's senses are stimulated while the subject's senses are in a reset state; and an evaluation unit that evaluates the subject's psychological state when the subject's senses are stimulated based on the response.

15. A system including a server, wherein the server acquires the subject's response when the subject's senses are stimulated while the subject's senses are in a reset state, evaluates the subject's psychological state when the subject's senses are stimulated based on the response, and outputs the subject's psychological state.

16. A method comprising: obtaining the subject's response when the subject's senses are stimulated while the subject's senses are in a reset state; and evaluating the sensitivity of the subject's senses when stimulated, based on the response.

17. The method according to claim 16, wherein the subject's response when the subject's senses are stimulated is a physiological indicator.

18. The method according to claim 16, wherein the evaluation involves evaluating sensory sensitivity based on the interstatistical values ​​of the subject's response to each stimulus when each of several types of stimuli is applied.

19. The method according to claim 16, wherein the evaluation involves comparing the sensitivity of sensations between sensations based on statistical quantities between the responses of the subject to each stimulus when each of a plurality of types of stimuli is applied.

Images