Evaluation method and evaluation device

JPWO2023188698A5Pending Publication Date: 2024-11-19
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2024511274
Authority / Receiving Office
JP · JP
Patent Type
Applications
Filing Date
2024-09-13
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

Existing methods for evaluating subject reactions to products or services lack specificity in obtaining feedback, as they do not effectively utilize biological information to identify key moments during tasks that provide insightful feedback.

Method used

An evaluation method and device that acquire task-related information and biological data, such as myoelectric potential signals, to specify timing when biological conditions are met, allowing for targeted output of task information and subsequent feedback input from subjects.

Benefits of technology

This approach enables more specific and accurate feedback from subjects by correlating biological responses with task performance, enhancing the evaluation of subject reactions.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

This evaluation method includes: a step for acquiring information related to a task to be executed by a subject (step S10); a step for acquiring biological information of the subject (step S12); a step for specifying a timing at which the biological information satisfies a predetermined condition (step S14); a step for outputting a portion that is of the information related to the task and that corresponds to the specified timing (step S24); and a step for accepting input of feedback related to the task (step S26).
Need to check novelty before this filing date? Find Prior Art

Description

Evaluation method, evaluation device, and program

[0001] The present invention relates to the assessment of subject responses using feedback from the subject.

[0002] Traditionally, product or service providers have used feedback from subjects (e.g., customers of the products or services) to evaluate the subjects' reactions to the products or services. Regarding feedback acquisition, for example, U.S. Patent Application Publication No. 2002 / 0044687 (Patent Document 1) discloses a technique for having customers electronically submit a form on which they have written their feedback information and their address, electronically processing the feedback information, and using the address to provide incentives to the customers. Various techniques for acquiring information on brain activity and evaluating it as feedback have also been studied (see Non-Patent Documents 1, 2, and 3).

[0003] US Patent Application Publication No. 2002 / 0044687

[0004] “Bringing Neuromarketing Closer to You – Kansei Analyzer (KANSEI_Analyzer),” [online], [Retrieved October 14, 2021], Dentsu Science Jam, <URL: https: / / www.dentsusciencejam.com / kansei-analyzer / > “Information about Valance-Arousal_Analyzer,” [online], [Retrieved October 14, 2021], Dentsu Science Jam, <URL: https: / / www.dentsusciencejam.com / VAA / > “The Flow of Neuromarketing and Kansei Evaluation,” [online], [Retrieved October 14, 2021], Dentsu Science Jam, <https: / / neu-brains.co.jp / service / neuro-marketing / flow / >

[0005] While prior art techniques can objectively assess a subject's response to a product or service, the system as a whole leaves room for improvement in obtaining specific feedback from subjects.

[0006] The present invention has been devised in view of the above circumstances, and its purpose is to provide a technique for obtaining more specific feedback from a subject when evaluating the subject's response.

[0007] An evaluation method according to an aspect of the present disclosure includes the steps of acquiring information related to a task performed by a subject, acquiring biometric information of the subject performing the task over time, identifying a time when the biometric information satisfies a predetermined condition, outputting a portion of the information related to the task that corresponds to the identified time, and receiving feedback input related to the task from the subject.

[0008] An evaluation method according to another aspect of the present disclosure includes the steps of acquiring information regarding a task performed by a subject; identifying, from at least one of the subject performing the task and an observer observing the subject, a timing at which a marker input is received while the subject is performing the task; outputting a portion of the information regarding the task that corresponds to the identified timing; and receiving feedback input regarding the task from the subject.

[0009] An evaluation device according to one aspect of the present disclosure includes an interface for acquiring task-related information and biometric information of a subject performing a task, a memory for storing conditions related to features in the biometric information and information specifying the conditions, and a processor for specifying the timing at which the features in the biometric information satisfy the conditions, wherein the processor outputs a portion of the task-related information corresponding to the specified timing and accepts input of feedback related to the task.

[0010] An evaluation device according to another aspect of the present disclosure includes an interface for acquiring task-related information and biometric information of a subject performing a task, and a processor for identifying the timing at which a marker input is received from at least one of the subject performing the task and an observer observing the subject while the subject is performing the task, and the processor outputs a portion of the task-related information corresponding to the identified timing and receives feedback input regarding the task.

[0011] A program according to an aspect of the present disclosure causes a computer to perform the steps of acquiring information regarding a task to be performed by a subject, acquiring biometric information of the subject, identifying a timing at which the biometric information satisfies a predetermined condition, providing a portion of the information regarding the task that corresponds to the identified timing, and accepting feedback input regarding the task.

[0012] A program according to another aspect of the present disclosure, when executed by a computer, causes the computer to perform the steps of acquiring information regarding a task performed by a subject; identifying the timing at which marker input is received from at least one of the subject performing the task and an observer observing the subject while the subject is performing the task; outputting a portion of the information regarding the task that corresponds to the identified timing; and receiving feedback input regarding the task from the subject.

[0013] According to one aspect of the present disclosure, more specific feedback is obtained from the subject in assessing the subject's response.

[0014] FIG. 1 is a diagram showing an overview of an evaluation system including an evaluation device according to the present disclosure. FIG. 2 is a diagram showing an example of a scene in which a subject 200 inputs feedback regarding a task in the evaluation system. FIG. 3 is a diagram showing a schematic block configuration of the evaluation system. FIG. 4 is a diagram for explaining attachment positions of a first myoelectric potential sensor 11 and a second myoelectric potential sensor 12. FIG. 5 is a diagram showing an overview of an example of processing carried out in the evaluation system 100. FIG. 6 is a flowchart of processing carried out by a computer 90 to obtain feedback from a subject 200 performing a task. FIG. 7 is a diagram showing an example of an input screen. FIG. 8 is a diagram showing another example of an input screen.

[0015] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals, and description thereof will not be repeated.

[0016] [Outline of Evaluation Method] Fig. 1 is a diagram showing an outline of an evaluation system including an evaluation device according to the present disclosure. In the evaluation system, a computer 90 is an example of the evaluation device.

[0017] The subject 200 performs a task to input feedback. In the example of Figure 1, the subject 200 is assembling a shelf as an example of the task.

[0018] The computer 90 acquires information about a task being performed by the subject 200. In the example of Fig. 1 , as an example of the information about the task, an image (bird's-eye view image) of the space in which the subject 200 is performing the task is captured by the camera 210 and transmitted to the computer 90. As an example of the information about the task, audio in the space may be acquired by the microphone 220 and transmitted to the computer 90.

[0019] The computer 90 also acquires biological information of the subject 200. In the example of Fig. 1, a myoelectric potential signal of the subject 200 is acquired as an example of the biological information.

[0020] More specifically, the computer 90 acquires a myoelectric potential signal of the subject 200 via the user device 10. The subject 200 wears the user device 10. The user device 10 includes one or more myoelectric potential sensors (a first myoelectric potential sensor 11 and a second myoelectric potential sensor 12, which will be described later with reference to FIG. 3 and the like). The myoelectric potential signal is acquired by the one or more myoelectric potential sensors.

[0021] The computer 90 identifies the timing at which the feature amount of the biometric information satisfies a predetermined condition, and provides the portion of the information related to the task that corresponds to the identified timing to the subject 200. The computer 90 may identify, as the timing, the timing at which one or more buttons included in the button unit 240 or the button unit 250 are operated. The button unit 240 includes two buttons 241 and 242 that are operated by the subject 200. The button unit 250 includes two buttons 251 and 252 that are operated by the observer 300.

[0022] 2 is a diagram showing an example of a scene in which the subject 200 inputs feedback regarding a task in the evaluation system. In the example of FIG. 2, the subject 200 acquires the above-mentioned portion of the information regarding the task provided by the computer 90 using a smartphone 290. In one implementation example, the portion is a video captured by the camera 210 at the timing specified above. The subject 200 inputs feedback regarding the task while checking the portion on the smartphone 290 and transmits the feedback to the computer 90.

[0023] [Block Configuration] Fig. 3 is a diagram showing a schematic block configuration of the evaluation system. As shown in Fig. 3, the evaluation system 100 includes a user device 10 and a computer 90. In one implementation example, the user device 10 may include a wearable terminal worn by the subject. The computer 90 may be installed in the environment surrounding the subject. The user device 10 and the computer 90 are configured to be capable of two-way communication. Each configuration will be described below.

[0024] <User Device 10> The user device 10 includes a sensor unit 1, a signal processing circuit 2, a controller 3, a communication module 4, a battery 5, and a housing 6. The housing 6 houses the signal processing circuit 2, the controller 3, the communication module 4, and the battery 5 therein.

[0025] The sensor unit 1 includes a first myoelectric potential sensor 11 and a second myoelectric potential sensor 12. The first myoelectric potential sensor 11 and / or the second myoelectric potential sensor 12 is worn on the face of the subject, and detects a myoelectric potential signal at the wearing site.

[0026] A myoelectric potential signal refers to a weak electrical signal generated when a muscle moves. In the present disclosure, the "face" of a subject is not limited to the facial surface (front or side of the face) and may include the subject's neck. For example, the sensor unit 1 may be attached to the subject's throat to detect myoelectric potential changes accompanying the subject's swallowing action.

[0027] The sensor unit 1 may include multiple sensors. The multiple sensors may be attached to different types of muscles. The type of muscle may be identified by the location where the sensor is attached. In the first embodiment, the muscle type is identified without being limited to the composition or structure of the muscle. If the sensor is attached to different locations, myoelectric potential signals of different types of muscles may be acquired.

[0028] Fig. 4 is a diagram for explaining the attachment positions of the first myoelectric potential sensor 11 and the second myoelectric potential sensor 12. One aspect of the configuration and use of the first myoelectric potential sensor 11 and the second myoelectric potential sensor 12 will be described with reference to Fig. 4 .

[0029] The first myoelectric potential sensor 11 is attached to the cheek of the subject. The first myoelectric potential sensor 11 includes a working electrode 111 and a reference electrode 112. The working electrode 111 is incorporated into a pad 151, and the reference electrode 112 is incorporated into a pad 152.

[0030] The first myoelectric potential sensor 11 detects myoelectric potential signals of muscles near the cheeks by attaching the pad 151 directly above the laughing muscles and the pad 152 directly above the zygomatic major muscle. More specifically, the first myoelectric potential sensor 11 detects the potential of the working electrode 111 relative to the potential of the reference electrode 112 as the myoelectric potential signal of muscles near the cheeks. The attachment positions of the pads 151 and 152 (the working electrode 111 and the reference electrode 112) may be slightly shifted from directly above the laughing muscles and the zygomatic major muscle, respectively, as long as they are near these muscles. The first myoelectric potential sensor 11 outputs the myoelectric potential signals to the signal processing circuit 2 of the user device 10 as myoelectric potential signals indicating the activity of the facial muscles in the cheek area.

[0031] The second myoelectric potential sensor 12 is attached to the subject's eyebrow. The second myoelectric potential sensor 12 includes a working electrode 121 and a reference electrode 122. The working electrode 121 is incorporated into a pad 171, and the reference electrode 122 is incorporated into a pad 172.

[0032] The second myoelectric potential sensor 12 detects myoelectric potential signals of muscles near the eyebrows (for example, the corrugator supercilii) by attaching the pads 171 and 172 directly above the corrugator supercilii. More specifically, the second myoelectric potential sensor 12 detects the potential of the working electrode 121 relative to the potential of the reference electrode 122 as a myoelectric potential signal of the muscles near the eyebrows. The attachment positions of the pads 171 and 172 (the working electrode 121 and the reference electrode 122) may be slightly shifted from directly above the corrugator supercilii as long as they are near the corrugator supercilii. The second myoelectric potential sensor 12 outputs the myoelectric potential signal to the signal processing circuit 2 as a myoelectric potential signal indicating the activity of the corrugator supercilii.

[0033] 4, the laughing muscle, zygomaticus major muscle, and corrugator supercilii muscle are examples of facial muscles. More specifically, the laughing muscle and zygomaticus major muscle are examples of muscles near the cheek. The corrugator supercilii muscle is an example of a muscle near the eyebrow.

[0034] 3 again, the signal processing circuit 2 performs predetermined signal processing (noise removal, rectification, amplification, digitization, etc.) on each of the myoelectric potential signals acquired from the sensor unit 1, and outputs each of the processed signals to the controller 3. Although not shown in the figure, the signal processing circuit 2 includes a filter, an amplifier, and an A / D converter.

[0035] In FIG. 3, the myoelectric signal from the first myoelectric sensor 11 processed by the signal processing circuit 2 is described as a "myoelectric signal MS1," and the myoelectric signal from the second myoelectric sensor 12 processed by the signal processing circuit 2 is described as a "myoelectric signal MS2."

[0036] The controller 3 is an arithmetic device including a processor 31, a memory 32, and an input / output port 33. The processor 31 is realized, for example, by a CPU (Central Processing Unit). The memory 32 is realized, for example, by a ROM (Read Only Memory) and a RAM (Random Access Memory). The input / output port 33 is an interface for inputting and outputting data to and from the controller 3. The controller 3 executes arithmetic processing for evaluating the facial expression of the subject based on the myoelectric potential signals MS1 and MS2.

[0037] The communication module 4 allows the user device 10 to communicate with external devices, and is implemented by, for example, a communication device conforming to a short-range wireless communication standard. The controller 3 controls the communication module 4 to control the exchange of information between the user device 10 and external devices (such as a computer 90).

[0038] The battery 5 is a secondary battery such as a lithium ion secondary battery, and supplies operating voltage to each device in the user device 10.

[0039] The user device 10 further includes a speaker 21 and a display 22. The controller 3 outputs a control signal ("signal SS" in FIG. 1) to each of the speaker 21 and the display 22, thereby outputting sound via the speaker 21.

[0040] The user device 10 further includes a content providing device 23. The content providing device 23 is a device that provides content. In one implementation, the content providing device 23 may provide tastes to the subject 200. For example, such a device is configured to electrically sense five tastes: sweet, salty, sour, bitter, and umami, and adjusts the taste provided by changing the ratio of these tastes. More specifically, such a device, known as the Norimaki Synthesizer (https: / / research.miyashita.com / papers / I42 / paper.pdf), contains five types of gels containing electrolytes that sense each of the five tastes, and adjusts the amount of electricity applied to the five types of gels to adjust the taste provided. In one implementation, the content providing device 23 may provide a sensation to the subject 200. Such a device adjusts the tactile sensation provided by controlling the surface condition of a given object. In one implementation, the content providing device 23 may provide an odor to the subject 200. Such devices adjust the amount of one or more substances contained in the air supply to control the odor provided.

[0041] In the evaluation system 100, information about a task to be performed by the subject 200 is acquired. Then, a portion of the acquired information corresponding to the timing at which the biological information of the subject 200 satisfies a predetermined condition is provided to the subject 200.

[0042] The information about the task may be an image. In one example, the space in which the task is performed is photographed as the information about the task. In another example, the information about the task is recorded as an image provided to the subject 200 while the task is being performed. In this case, the image is provided to the subject 200 as part of the information about the task. The image is provided via the display 22 (or a display device other than the user device 10).

[0043] The information about the task may be audio. In one example, the information about the task is recorded as audio in the space where the task is performed. In another example, the information about the task is recorded as audio provided to the subject 200 while the task is being performed. In this case, the audio is provided to the subject 200 as the above-mentioned portion. The audio is provided via the speaker 21 (or a speaker other than the user device 10).

[0044] The information about the task may be information that identifies a smell. In one example, the smell of the space in which the task is performed is recorded as information about the task, for example, the composition of the air. In another example, the information about the task is the smell provided to the subject 200 while the task is being performed, for example, the composition of the air. In yet another example, images and / or sounds provided to the subject 200 while the task is being performed, and / or substances identified from images and / or sounds recorded in the space are recorded. In this case, as the above part, a smell reproduced based on the identified information (e.g., the composition of the air or the substance) is provided to the subject 200. For example, if the name of a substance, "peach," is identified from sounds recorded in the space, the smell of peach may be reproduced and provided. The smell is provided via the content providing device 23.

[0045] The information about the task may be information specifying a feel. In one example, the feel (surface state of an object) provided to the subject 200 while the task is being performed is recorded as the information about the task. In another example, images and / or sounds provided to the subject 200 while the task is being performed, and / or a substance identified from images and / or sounds recorded in the space is recorded. In this case, a feel reproduced based on the identified information is provided to the subject 200 as the part. For example, if the name of a substance, "peach," is identified from sounds recorded in the space, a predetermined surface state may be reproduced and provided as the feel of the surface of a peach. The feel is provided via the content providing device 23.

[0046] The information about the task may be information specifying a taste. In one example, the information about the task includes a taste (such as the name of a food or information specifying the composition of the food) provided to the subject 200 while the task is being performed. In another example, images and / or sounds provided to the subject 200 while the task is being performed and / or a substance identified from images and / or sounds recorded in the space are recorded. In this case, a taste reproduced based on the identified information is provided to the subject 200 as the part. For example, if the name of a substance, "peach," is identified from sounds recorded in the space, a taste predetermined as the taste of peach (a combination of five tastes, namely, sweetness, saltiness, sourness, bitterness, and umami) may be reproduced and provided. The taste is provided via the content providing device 23.

[0047] The information related to the task may be a combination of two or more of the five types of information (image, sound, smell, touch, and taste) described above. The content providing device 23 may include a unit capable of reproducing each of two or more types of information among smell, touch, and taste.

[0048] <Computer 90> The computer 90 is, for example, a PC (Personal Computer) or a server. The computer 90 communicates with the user device 10 via a communication module (not shown) and receives a signal indicating the calculation result of the controller 3. The computer 90 includes a controller 91 and a communication module 92.

[0049] Like the controller 3, the controller 91 includes a processor 95, a memory 96, and an input / output port 97, and executes various types of arithmetic processing. Like the communication module 4, the communication module 92 is realized by, for example, a communication device that complies with a short-range wireless communication standard. In other words, the communication module 92 allows the computer 90 to communicate with other devices.

[0050] The computer 90 is connected to a camera 210, a microphone 220, an odor sensor 230, and button units 240 and 250. The camera 210 takes an image of the space where the task is to be performed and transmits it to the computer 90. The microphone 220 acquires sound in the space where the task is to be performed and transmits it to the computer 90. The odor sensor 230 acquires the composition of the air in the space where the task is to be performed and transmits it to the computer 90. The button unit 240 detects an operation on button 241 or 242 and transmits the detection result to the computer 90. The button unit 250 detects an operation on button 251 or 252 and transmits the detection result to the computer 90.

[0051] [Processing Overview] FIG. 5 is a diagram showing an overview of an example of processing performed in the evaluation system 100. As shown in FIG.

[0052] 5 shows six types of data during a period when subject 200 is performing a certain task. The six types of data include feature amounts of two types of biometric information (biometric information (1) and (2)), the respective states (ON / OFF) of the subject marker and observer marker, video analysis indices, and related information.

[0053] Biometric information (1) represents, for example, the myoelectric potential signal of a muscle near the cheek. The change in the feature amount of biometric information (1) is represented by line L1. Biometric information (2) represents, for example, the myoelectric potential signal of a muscle near the eyebrow. The change in the feature amount of biometric information (2) is represented by line L2.

[0054] The subject marker indicates the operation state of, for example, buttons 241 and 242. When button 241 is operated, the value of the subject marker becomes ON, and when button 242 is operated, the value of the subject marker becomes OFF. The change in the subject marker is indicated by line L3.

[0055] The observer marker represents the operation state of, for example, buttons 251 and 252. When button 251 is operated, the value of the observer marker becomes ON, and when button 252 is operated, the value of the observer marker becomes OFF. The change in the observer marker is represented by line L4.

[0056] The video analysis index represents a feature amount obtained from an image captured by the camera 210. An example of a feature amount is the distance traveled by at least a part of the body of the subject 200 within a predetermined unit time. The video analysis index is affected by the movement of the body of the subject 200 in the captured image. In this sense, the video analysis index can be said to be an example of a feature amount of the biometric information of the subject 200. The change in the video analysis index is represented by the line L5.

[0057] The related information represents information acquired as information related to the task. An example of the related information is an image captured by the camera 210.

[0058] The computer 90 provides a portion of the related information corresponding to a given timing to the subject 200. In the example of Fig. 5, seven timings (TM11 to TM17) are shown as timings for specifying the portion to be provided.

[0059] More specifically, the computer 90 specifies the timing at which the value of the subject marker becomes ON as TM11.

[0060] The computer 90 identifies the timing at which the value of the biological information (2) reaches a given threshold (Th22) as TM12.

[0061] The computer 90 identifies, as TM13, the timing at which the value of the biological information (1) reaches (falls to) a given threshold (Th11).

[0062] The computer 90 specifies the timing at which the value of the observer marker becomes ON as TM14.

[0063] The computer 90 identifies, as TM15, the timing at which the value of the biological information (1) reaches a given threshold value (Th11).

[0064] The computer 90 identifies the timing at which the value of the video analysis index reaches a given threshold (Th13) as TM16.

[0065] The computer 90 identifies, as TM17, the timing at which the value of the biological information (2) reaches (or falls to) a given threshold (Th22).

[0066] For each of the seven identified timings, the computer 90 identifies a period including a certain amount of time before and after the timings as the period for the information to be provided to the subject 200. As a result, periods PT11 to PT17 are identified for each of the timings TM11 to TM17. Then, after the task is completed, the computer 90 provides the relevant information for each of the periods PT11 to PT17 to the subject 200. The "certain amount of time" is, for example, two seconds. In this case, four seconds of video are provided to the subject 200 as each of the periods PT11 to PT17.

[0067] <Timing at which task-related information is provided> In the process described with reference to Figure 6, after the task is completed, an input screen including the above-described portion is generated, and the input screen is provided to the subject 200. The timing at which the input screen is provided is not limited to after the task is completed. The computer 90 may generate an input screen and provide it to the subject 200 each time such timing as described above is identified. In other words, when the computer 90 identifies timing TM1, it may provide the subject 200 with information related to the period PT11 without waiting for the identification of the next timing TM2.

[0068] <Period Corresponding to the Provided Information> The period corresponding to the above-described portion does not have to be a period including a certain time before and after the identified timing. That is, the period corresponding to the above-described portion may be a certain time before and after the identified timing, or the identified timing and a certain time immediately before it, or only the identified timing. Thus, for example, when the timing at which the biometric information (1) reaches a given threshold is identified, video for a certain time before and after the identified timing, video for the identified timing and a certain time immediately before it, or an image at the identified timing is provided to the subject 200.

[0069] <Method of Determining "Timing" and Types of Biometric Information> Instead of or in addition to the detection value of the biometric information or the value of the video analysis index reaching a given threshold, the computer 90 may also determine the timing by determining that the detection value of the biometric information or the value of the video analysis index is saturated (the amount of change is equal to or less than a given value for a given period of time). In this sense, the detection value of the biometric information and the value of the video analysis index are each an example of a feature of the biometric information. Furthermore, the saturation of a value is an example of the value being maintained within a given range.

[0070] Note that the above-mentioned "reaching the threshold" may refer to either reaching the threshold from below or reaching the threshold from above (decreasing toward the threshold).

[0071] In the example of FIG. 5 , specific examples of biometric feature quantities include electromyographic signals of muscles near the cheeks, electromyographic signals of muscles near the eyebrows, and video analysis indices determined from images of the subject 200. Note that the biometric feature quantities may also be other types of information, such as the subject's 200 blood pressure, electroencephalogram (EEG), cardiac potential, respiratory rate, and / or heart rate. For example, with regard to electroencephalograms, the match rate between the subject's electroencephalogram pattern and a predetermined waveform pattern may be used as a biometric feature quantity. In other words, any information that reflects the subject's state (emotion, etc.) can be used as a biometric feature quantity. In the evaluation system 100, the computer 90 is configured to not only determine timing based on biometric information, but also determine timing based on button operation by the subject 200 or observer 300. This allows the computer 90 to provide the subject 200 with information corresponding to timing that the subject 200 or observer 300 determines is likely to be useful for feedback.

[0072] <Related Information (Information Related to a Task)> Information acquired as related information may be information about the atmosphere of the space in which the task is performed. The information about the atmosphere of the space is, for example, an image (video) captured by the camera 210, audio captured by the microphone 220, and / or information specifying the composition of the air captured by the odor sensor 230. Note that, as the information about the atmosphere of the space, the camera 210 may capture an image of the field of view of the subject 200. In this case, the camera 210 is worn on the head of the subject 200 to capture the field of view of the subject 200.

[0073] <Method of Acquiring Related Information> The related information may be acquired continuously, at regular intervals, or whenever a given event occurs. In one example, the camera 210 may continuously capture video during the execution of a task, as the related information. In another example, the camera 210 may capture images (photographs) at regular intervals during the execution of a task, as the related information. In yet another example, the camera 210 may capture images (photographs) every time the subject 200 operates the button 241 and / or every time the observer 300 operates the button 251, as the related information.

[0074] <Information Provided as Part of the Related Information> The information provided as part of the related information (part corresponding to periods PT11 to PT17) may be a part of the related information itself, or may be information reproduced based on information identified from a part of the related information. That is, the information provided to subject 200 may be information secondarily generated based on the related information. For example, if the related information is an image, when it is identified that the image at a specified timing contains a "peach," subject 200 may be provided with the image itself containing the "peach," a sound representing the "peach," air (smell) with a predetermined composition corresponding to the "peach," a taste with a predetermined composition corresponding to the "peach," or a texture predetermined to correspond to the "peach."

[0075] <Task> In the evaluation system 100, the subject 200 performs a task and inputs feedback about the task. The computer 90 acquires the feedback from the subject 200. The task performed by the subject 200 is not limited to the task of building a shelf as described with reference to FIG. 1 , but may be of any type.

[0076] Another example of a task is a task in which the subject 200 plays a video game. When the subject 200 plays a video game as a task, the visual field image of the subject 200 as an example of the related information may be an image of the video game instead of an image captured by the camera 210. The image of the video game may be identified by the progress of the game. Therefore, the computer 90 may acquire the progress of the game as the related information corresponding to the timing at which the biometric information satisfies a given condition, instead of the image itself at such timing.

[0077] When generating an input screen described later with reference to Fig. 7 etc., the computer 90 may reconstruct the screen based on the progress of the game. Then, the computer 90 may provide the reconstructed screen to the subject 200 by incorporating it into the input screen.

[0078] [Processing Flow] Fig. 6 is a flowchart of processing performed by the computer 90 to obtain feedback from the subject 200 performing a task. The computer 90 starts the processing of Fig. 6, for example, in response to input of a notification to the computer 90 that the subject 200 is about to start the task. In one implementation example, the processing of Fig. 6 is performed by the processor 95 of the computer 90 executing a given program. The program may be non-temporarily stored in the memory 96.

[0079] In step S10, the computer 90 starts acquiring related information. In one implementation example, the computer 90 instructs the camera 210 to start recording.

[0080] In step S12, the computer 90 acquires biological information. In one implementation example, the computer 90 requests the user device 10 to transmit the myoelectric potential signal acquired by the sensor unit 1. In response to the request, the user device 10 transmits the myoelectric potential signal to the computer 90.

[0081] In step S14, the computer 90 determines whether a specific state has occurred. A specific state is a state in which the biometric information satisfies a given condition, such as timing TM13 or TM15 identified for biometric information (1) in Fig. 5. If the computer 90 determines that a specific state has occurred (YES in step S14), the computer 90 proceeds to control step S16; otherwise (NO in step S14), the computer 90 returns control to step S12.

[0082] In step S16, the computer 90 registers the current time as a reference point in the memory 96. Instead of the current time, the time elapsed since the start of the task may be registered.

[0083] In step S18, computer 90 determines whether the task has ended. In one implementation example, when the task has ended, subject 200 operates button 242. When computer 90 detects that button 242 has been operated, it determines that the task has ended. If computer 90 determines that the task has ended (YES in step S18), it proceeds to step S20; otherwise (NO in step S18), it returns control to step S12.

[0084] In step S20, the computer 90 ends the acquisition of related information that began in step S10. In one implementation example, the computer 90 instructs the camera 210 to stop capturing images.

[0085] In step S22, the computer 90 generates an input screen, which is provided to the subject 200 for inputting feedback.

[0086] 7 shows an example of an input screen. A screen 700 includes a frame 710, a key 711, frames 721 to 725, and a frame 730.

[0087] Box 710 includes the message "These are videos taken during this experience. Please refer to them and write your impressions of this experience." "Videos taken during this experience" refers to the videos displayed in boxes 721 to 725, which will be described later. That is, the message in box 710 is an example of a message that prompts subject 200 to refer to the videos provided when entering feedback. Computer 90 generates an input screen by fitting the message into box 710. The provided videos are an example of a portion of the related information acquired during task execution that corresponds to the "timing" described with reference to FIG. 5.

[0088] The key 711 is operated to transmit information entered in a box 730 (to be described later) to the computer 90 .

[0089] Each of the frames 721 to 725 displays a video. The displayed video is a portion of the video (an example of related information) acquired during task execution that corresponds to the "timing" described with reference to FIG. 5. This "timing" is acquired as a "reference point" in the processing of FIG. 6. In each of the frames 721 to 725, playback of the video begins in response to a touch operation.

[0090] The computer 90 generates content to be provided as the "portion" corresponding to the "timing" by extracting portions corresponding to the above-mentioned "timing" from a video (an example of related information) acquired during the execution of the task. The computer 90 then generates an input screen by fitting each of the generated contents into frames 721 to 725, respectively.

[0091] The number of frames for displaying related information such as videos included in the input screen is not limited to "5" as shown in Fig. 7. In one implementation example, the number of frames is the number of "timings" identified during the execution of the task.

[0092] Frame 730 accepts feedback input from subject 200. Returning to Fig. 6 , after generating the input screen in step S22, computer 90 transmits the input screen to subject 200 in step S24. As described above, the input screen incorporates the portion of the related information corresponding to the "timing" described with reference to Fig. 5 . In this sense, computer 90 provides subject 200 with the above portion by transmitting the input screen to subject 200.

[0093] In one implementation example, at the start of the task, the computer 90 obtains the email address of the subject 200 along with information identifying the subject 200. In step S24, the computer 90 sends an email containing the input screen generated as described above to the email address. The subject 200 receives the email on the smartphone 290 ( FIG. 2 ). As a result, the subject 200 views the input screen on the smartphone 290. Note that the content described here is merely one embodiment of transmitting the input screen to the subject 200. The input screen can be transmitted to the subject 200 in any manner.

[0094] In step S26, the computer 90 obtains feedback from the subject 200. In one implementation example, the subject 200 inputs feedback as text in a frame 730 on the screen 700 displayed on the smartphone 290, and then operates the key 711. In response to this, the smartphone 290 transmits the text input in the frame 730 to the computer 90. The computer 90 obtains the feedback by receiving the text transmitted in this manner.

[0095] In step S28, the computer 90 registers the obtained feedback in the memory 96. Thereafter, the computer 90 ends the processing of FIG.

[0096] Through the process described above, the computer 90 provides the subject 200 with a portion of the related information acquired during the execution of the task that corresponds to the timing identified using the biological information of the subject 200. The subject 200 inputs feedback regarding the task while referring to the portion, and transmits the feedback to the computer 90. In this way, the computer 90 acquires feedback regarding the task from the subject 200.

[0097] 6 , the subject 200 can input feedback after receiving a portion of the task-related information (related information) that corresponds to the timing when the subject's 200 biometric information satisfied a given condition. This allows the subject 200 to more specifically recall the subject's 200 state at the timing. Therefore, the computer 90 can obtain more specific feedback from the subject 200, and the obtained feedback reflects the subject's true impressions with high accuracy.

[0098] [Modification] <Providing "portions" of related information without waiting for completion of task> In the process of Fig. 6, a screen 700 including frames 721 to 725 is provided to the subject 200 after completion of the task. Each of the frames 721 to 725 displays a portion of a video (an example of related information) acquired during the execution of the task, which corresponds to the "timing" described with reference to Fig. 5. In other words, in the process of Fig. 6, two or more portions are provided to the subject 200 all at once after completion of the task.

[0099] In contrast, each of the two or more parts may be provided to the subject 200 without waiting for the completion of the task. For example, when the computer 90 identifies the above-mentioned "timing," it extracts a part corresponding to the "timing" from the related information and transmits it to the subject 200 without waiting for the completion of the task. This is expected to enable the subject 200 to continue the task while being aware of the situation when the biological information of the subject 200 satisfies a given condition, even while the task is being performed, and to easily output the content that should be input as feedback.

[0100] <Number of "portions" of related information included in one input screen> Screen 700 in Fig. 7 provides multiple portions corresponding to multiple timings, respectively, to subject 200 collectively as five frames 721 to 725. Note that the input screen may present multiple portions corresponding to multiple timings one by one to subject 200, and one frame for inputting feedback may be displayed for each portion. In other words, if five portions are provided to subject 200 for a certain task, five screens are provided as the input screen. Each of the five input screens includes one frame for displaying the portion and one frame for inputting feedback while referring to that portion.

[0101] <Output of subject's condition> When generating the input screen, the computer 90 may identify the condition of the subject 200 by analyzing the contents of the above-mentioned "part" provided to the subject 200, and include the identified condition in the input screen.

[0102] 8 is a diagram showing another example of the input screen. The screen 800 includes a frame 730 and keys 711, similar to the screen 700 in FIG.

[0103] Screen 800 includes a frame 810 instead of frame 710 on screen 700. The message displayed in frame 810 includes the phrase "Please input the degree of condition at each time point" in addition to the message displayed in frame 710. This phrase prompts subject 200 to input the degree of condition of subject 200 at the time when the video displayed in frames 840 and 850 (described later) was captured.

[0104] Screen 800 includes frames 840 and 850. Each of frames 840 and 850 displays a moving image, similar to frames 721 to 725 in Fig. 7. The displayed moving image is a portion of the moving image (an example of related information) acquired during the execution of a task, which corresponds to the "timing" described with reference to Fig. 5.

[0105] The screen 800 includes columns 841 and 851. Each of the columns 841 and 851 displays the state of the subject 200 identified from the video displayed in the frame 840 and the frame displayed at an intermediate point, respectively. In one implementation example, the computer 90 extracts a specific frame (such as the first frame displayed or a frame displayed at an intermediate point) from the video displayed in the frame 840, identifies a facial region from the image of the frame, and identifies the emotion corresponding to the facial image by analyzing the image of the identified facial region. The computer 90 then embeds the identified emotion in the column 841 as the state of the subject 200. The computer 90 similarly identifies the emotion of the subject 200 from the frame 850 and embeds it in the column 851 as the state of the subject 200.

[0106] Screen 800 includes fields 842 and 843. Field 842 is a field for inputting the degree of the condition displayed in field 841. Field 843 is a pull-down menu that displays candidates for the degree to be input into field 842. In the example of FIG. 8 , field 841 displays the condition "distressing." Field 843 displays three candidates for the degree of the condition "distressing," namely, "very distressing," "slightly distressing," and "not distressing." Subject 200 selects one of the candidates displayed in field 843. The selected candidate is input into field 842.

[0107] Screen 800 includes fields 852 and 853. Field 852 is a field for inputting the degree of the state displayed in field 851. Field 853 is a pull-down menu that displays candidates for the degree to be input into field 852. In the example of FIG. 8 , field 851 displays the state "fun." Field 853 displays three candidates for the degree of the state "fun": "very fun," "somewhat fun," and "not fun." Subject 200 selects one of the candidates displayed in field 853. The selected candidate is input into field 852.

[0108] By transmitting key 711 on screen 800, the degree of the state input in fields 842 and 852, in addition to the text input in frame 730, is transmitted to computer 90. As a result, in step S26, computer 90 obtains the degree of the state input in fields 842 and 852, in addition to the text input in frame 730, as feedback.

[0109] In the above embodiment, an example has been described in which each step is performed by one computer 90. The present invention is not limited to this, and each step may be performed by a different computer using a plurality of computers connected to each other so as to be able to communicate with each other.

[0110] Aspects It will be appreciated by those skilled in the art that the exemplary embodiments described above are examples of the following aspects.

[0111] (Item 1) An evaluation method according to one aspect may include the steps of acquiring information about a task performed by a subject, acquiring biometric information about the subject performing the task over time, identifying a timing at which the biometric information satisfies a predetermined condition, outputting a portion of the information about the task that corresponds to the identified timing, and receiving feedback input about the task from the subject.

[0112] According to the evaluation method described in paragraph 1, more specific feedback from the subject is obtained in the evaluation of the subject's response.

[0113] (Clause 2) In the evaluation method described in paragraph 1, the biometric information may include at least one of an electromyographic signal of the facial muscles of the subject, a blood pressure value of the subject, an electroencephalogram of the subject, an electrocardiogram of the subject, a respiratory rate of the subject, a heart rate of the subject, and an index identified from an image including the subject.

[0114] According to the evaluation method described in paragraph 2, the state of the subject is accurately reflected in the biological information.

[0115] (Clause 3) In the evaluation method described in paragraph 1 or 2, the predetermined condition may include at least one of the following: a feature in the biometric information has reached a given threshold; and a state in which the change in the feature in the biometric information is equal to or less than a given value continues for a predetermined period of time or more.

[0116] According to the evaluation method described in the third aspect, it is possible to easily determine whether or not the feature amount of the biometric information satisfies a predetermined condition.

[0117] (4) In the evaluation method described in any one of paragraphs 1 to 3, the predetermined condition may include that a feature in the biometric information is maintained within a given range for a given period of time or more.

[0118] According to the evaluation method described in Section 4, it is possible to easily determine whether or not the feature amount of biometric information satisfies a predetermined condition.

[0119] (Clause 5) The evaluation method described in any one of clauses 1 to 4 may further include a step of accepting marker input from at least one of the subject and an observer observing the subject while the subject is performing a task, and the outputting step may include providing a portion of information about the task that corresponds to the time when the marker was added.

[0120] According to the evaluation method described in Section 5, information can also be provided to the subject regarding the portion corresponding to the timing desired by the subject or observer.

[0121] (Clause 6) An evaluation method according to one aspect may include the steps of acquiring information about a task performed by a subject; identifying, from at least one of the subject performing the task and an observer observing the subject, a timing at which a marker input was received while the subject was performing the task; outputting a portion of the information about the task that corresponds to the identified timing; and receiving feedback input about the task from the subject.

[0122] According to the evaluation method described in Section 6, more specific feedback from the subject is obtained in the evaluation of the subject's response.

[0123] (Clause 7) In the evaluation method described in any one of clauses 1 to 6, the information about the task may include at least one of information about the atmosphere of the space in which the task is performed and information about the content provided to the subject in the task.

[0124] According to the evaluation method described in Section 7, the state of the subject is accurately reflected in the information about the task.

[0125] (Clause 8) In the evaluation method described in Clause 7, the information about the task includes information about the atmosphere of the space, and the information about the atmosphere of the space may include at least one of a captured image of the space where the task is performed, a recording of audio from the space where the task is performed, and an odor from the space where the task is performed.

[0126] According to the evaluation method described in Section 8, the information about the task more accurately reflects the state of the subject.

[0127] (Clause 9) In the evaluation method described in Clause 7, the information about the task may include information about the atmosphere of the space, the information about the atmosphere of the space may include a captured image of the space, and the captured image of the space may include at least one of an image including a subject performing the task and an image of the subject's line of sight performing the task.

[0128] According to the evaluation method described in Section 9, the information about the task more accurately reflects the state of the subject.

[0129] (Clause 10) In the evaluation method described in any one of clauses 7 to 9, the information about the task may include information about the content, and the output portion may include at least one of an image, a sound, a smell, a texture, and a taste.

[0130] The evaluation method described in paragraph 10 provides the subject with information useful for inputting specific feedback.

[0131] (Clause 11) In the evaluation method described in any one of clauses 1 to 10, the acquiring step may include acquiring information about the task at regular intervals during execution of the task.

[0132] According to the evaluation method described in paragraph 11, the amount of data handled in obtaining information about the task is minimized.

[0133] (12) In the evaluation method according to any one of the first to eleventh paragraphs, the portion to be output may correspond to the timing and a given period before and after the timing.

[0134] According to the evaluation method described in paragraph 12, detailed information can be provided to the subject to remind them of the situation at the above timing.

[0135] (13) In the evaluation method according to any one of paragraphs 1 to 12, the outputting step may include providing the portion after completion of the task.

[0136] According to the evaluation method described in paragraph 13, even after the task is completed, the subject can be reminded of the situation during the task execution.

[0137] (Clause 14) In the evaluation method described in any one of clauses 1 to 13, the outputting step may include providing the portion in response to the timing being identified, without waiting for the task to end.

[0138] According to the evaluation method described in item 14, it is possible to more reliably remind the subject of his / her condition at the timing mentioned above.

[0139] (Clause 15) In the evaluation method described in any one of clauses 1 to 14, the outputting step may include identifying the condition of the subject by analyzing the output portion, and outputting the condition of the subject.

[0140] According to the evaluation method described in paragraph 15, more specific information about the subject is provided to the subject.

[0141] (Clause 16) In the evaluation method described in Clause 15, the outputting step may include outputting information prompting the subject to input the degree of the subject's condition, and the receiving step may include obtaining the input of the degree of the subject's condition.

[0142] According to the evaluation method described in item 16, the degree of the subject's condition can be managed in a computer that performs the evaluation method.

[0143] (Clause 17) In the evaluation method described in clauses 1 to 16, the outputting step may include, when a first timing and a second timing are identified as the timing, providing a portion corresponding to the first timing as well as a portion corresponding to the second timing.

[0144] According to the evaluation method described in paragraph 17, comprehensive information can be provided to the subject. (paragraph 18) In the evaluation method described in any one of paragraphs 1 to 17, the outputting step may include, when a first timing and a second timing are specified as the timing, providing a portion corresponding to the first timing and then providing a portion corresponding to the second timing.

[0145] According to the evaluation method described in item 18, the subject is provided with information regarding the first timing and the second timing separately.

[0146] (Clause 19) In the evaluation method described in any one of clauses 1 to 18, the outputting step may include outputting a message to the subject prompting the subject to refer to the portion output in the feedback input.

[0147] According to the evaluation method described in paragraph 19, it is possible to reliably allow the subject to refer to the information in the above-mentioned portion.

[0148] (Clause 20) An evaluation device according to one embodiment includes an interface for acquiring information about a task and biometric information of a subject performing the task, a memory for storing information specifying conditions related to a feature in the biometric information, and a processor for specifying a timing at which the feature in the biometric information satisfies the condition, and the processor may output a portion of the information about the task that corresponds to the specified timing, and may receive feedback input about the task.

[0149] According to the evaluation device described in paragraph 20, more specific feedback can be obtained from the subject in evaluating the subject's response.

[0150] (Clause 21) An evaluation device according to one embodiment includes an interface for acquiring information about a task and biometric information of a subject performing a task, and a processor for identifying a timing at which a marker input is received from at least one of the subject performing the task and an observer observing the subject while the subject is performing the task, and the processor may output a portion of the information about the task that corresponds to the identified timing, and may receive feedback input about the task.

[0151] According to the evaluation device described in paragraph 21, more specific feedback can be obtained from the subject in evaluating the subject's response.

[0152] (Clause 22) A program according to one aspect may be executed by a computer to cause the computer to perform the steps of acquiring information about a task to be performed by a subject, acquiring biometric information about the subject, identifying a timing at which the biometric information satisfies a predetermined condition, outputting a portion of the information about the task that corresponds to the identified timing, and accepting feedback input regarding the task.

[0153] According to the program described in paragraph 22, more specific feedback is obtained from the subject in evaluating the subject's response.

[0154] (Clause 23) A program according to one aspect may be executed by a computer to cause the computer to perform the following steps: acquiring information about a task performed by a subject; identifying a timing at which a marker input is received from at least one of the subject performing the task and an observer observing the subject while the subject is performing the task; outputting a portion of the information about the task that corresponds to the identified timing; and receiving feedback input about the task from the subject.

[0155] According to the program described in paragraph 23, more specific feedback is obtained from the subject in evaluating the subject's response.

[0156] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present disclosure is defined by the claims, not by the description of the above-described embodiments, and is intended to include all modifications within the meaning and scope of the claims. Furthermore, it is intended that each technique in the embodiments can be implemented alone or, if necessary, in combination with other techniques in the embodiments to the extent possible.

[0157] 1 Sensor unit, 3, 91 Controller, 4, 92 Communication module, 5 Battery, 6 Housing, 10 User device, 11 First myoelectric potential sensor, 12 Second myoelectric potential sensor, 21 Speaker, 22 Display, 23 Content providing device, 31, 95 Processor, 32, 96 Memory, 33, 97 Input / output port, 90 Computer, 100 Evaluation system, 111, 121 Working electrode, 112, 122 Reference electrode, 151, 152, 171, 172 Pad, 200 Subject, 210 Camera, 220 Microphone, 230 Odor sensor, 240, 250 Button unit, 241, 242, 251, 252 Button, 290 Smartphone, 300 Observer, 700, 800 Screen, 710, 721, 725, 730, 810, 840, 850 Frame, 711 Key, 841, 842, 843, 851, 852, 853 Column.

Claims

1. obtaining information regarding a task to be performed by a subject; acquiring biological information over time of a subject performing the task; Identifying a timing at which the biological information satisfies a predetermined condition; outputting a portion of information about the task that corresponds to the identified timing; generating an input screen for the subject to input feedback regarding the task; and receiving feedback regarding the task from the subject via the input screen.

2. The predetermined condition is: The feature amount in the biometric information reaches a given threshold value; and The evaluation method according to claim 1 , further comprising: a state in which a change in a feature amount in the biometric information is equal to or smaller than a given value continues for a predetermined period of time or longer.

3. The evaluation method according to claim 1 , wherein the predetermined condition includes that a feature amount in the biometric information is maintained within a given range for a given period of time or more.

4. The method further includes a step of receiving a marker input from at least one of the subject and an observer observing the subject while the subject is performing a task; The evaluation method according to claim 1 , wherein the step of outputting includes providing a portion of the information about the task that corresponds to a time point at which the marker was attached.

5. The information regarding the task includes: Ambient information of the space in which the task is performed; and information about the content provided to the subject in the task; At least one of The information about the task includes information about the atmosphere of the space; The information on the atmosphere of the space is an image of the space in which the task is performed; - a recording of the audio of the space in which the task is performed; and the smell of the space in which the task is performed; The evaluation method according to claim 1 , comprising at least one of the following:

6. The information regarding the task includes: Ambient information of the space in which the task is performed; and information about the content provided to the subject in the task; At least one of The information about the task includes information about the atmosphere of the space; The information about the atmosphere of the space includes a captured image of the space, The captured image of the space is an image including a subject performing the task; and A gaze image of a subject performing the task; The evaluation method according to claim 1 , comprising at least one of the following:

7. The information regarding the task includes: Ambient information of the space in which the task is performed; and information about the content provided to the subject in the task; At least one of The information about the task includes information about the content, The evaluation method according to claim 1 , wherein the output portion includes at least one of an image, a sound, an odor, a texture, and a taste.

8. The evaluation method according to claim 1 , wherein the acquiring step includes acquiring information about the task at regular time intervals during execution of the task.

9. The evaluation method of claim 1 , wherein the portion that is output corresponds to the timing and a given period before and after the timing.

10. The outputting step includes: analyzing the output portion to identify a condition of the subject; and The evaluation method according to claim 1 , further comprising: outputting a state of the subject.

11. The outputting step includes: outputting information prompting the subject to input a degree of the subject's condition; The receiving step includes: The evaluation method according to claim 10 , further comprising obtaining an input of a degree of the subject's condition.

12. 2. The evaluation method according to claim 1, wherein the outputting step includes, when a first timing and a second timing are identified as the timing, providing a portion corresponding to the first timing as well as a portion corresponding to the second timing.

13. 2. The evaluation method according to claim 1, wherein, when a first timing and a second timing are identified as the timings, the outputting step includes outputting a portion corresponding to the first timing and then providing a portion corresponding to the second timing.

14. obtaining information regarding a task to be performed by a subject; identifying a timing at which a marker input is received from at least one of a subject performing the task and an observer observing the subject while the subject is performing the task; outputting a portion of information about the task that corresponds to the identified timing; generating an input screen for the subject to input feedback regarding the task; and receiving feedback regarding the task from the subject via the input screen.

15. an interface for acquiring information about a task and biometric information of a subject performing a task; a memory for storing information specifying conditions related to features in the biometric information; a processor for identifying a timing at which a feature amount in the biometric information satisfies the condition, The processor, outputting a portion of the information about the task that corresponds to the identified timing; generating an input screen for the subject to input feedback regarding the task; an evaluation device that receives feedback regarding the task from the subject via an input screen;