Evaluation method, evaluation device, and program
By obtaining biological information and marking inputs during the task of the subject, determining the feature quantity and outputting the information related to the task, the problem of inconspicuous feedback in the prior art is solved, and more detailed and accurate evaluation is achieved.
Patent Information
- Application Number
- CN202380032237.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-31
- Filing Date
- 2023-01-13
- Publication Date
- 2024-11-26
AI Technical Summary
The prior art is difficult to objectively obtain specific feedback from the subject on goods or services, resulting in insufficient detailed evaluation.
By obtaining information related to the subject's task execution, including biological information and marker input during the task, it is determined that the feature quantity meets the pre-determined conditions, outputs the information part related to the task, and receives feedback from the subject.
More specific feedback on the respondents was achieved, and the detailed and accurate evaluation was improved.
Smart Images

Figure CN119032372A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an evaluation of a subject's reaction using feedback from the subject. Background Art
[0002] Conventionally, providers of products or services have used feedback from subjects (e.g., customers of products or services) to evaluate the subjects' reactions to the products or services. Regarding the acquisition of feedback, for example, U.S. Patent Application Publication No. 2002 / 0044687 (Patent Document 1) discloses the following technique: having customers electronically send a sheet filled with feedback information and the customers' addresses, electronically processing the feedback information, and providing incentives to the customers using the addresses. In addition, various studies have been conducted on techniques for acquiring information related to brain activity and evaluating this information as feedback (see Non-Patent Document 1, Non-Patent Document 2, and Non-Patent Document 3).
[0003] Prior Art Documents
[0004] Patent Documents
[0005] Patent Document 1: U.S. Patent Application Publication No. 2002 / 0044687
[0006] Non-Patent Documents
[0007] Non-Patent Document 1: "Making Neuromarketing Closer - KANSEI Analyzer", [online], [searched on October 14, 2021], Dentsu Science Jam, <URL:https: / / www.dentsusciencejam.com / kansei-analyzer / >
[0008] Non-Patent Document 2: "Guide to Valance-Arousal Analyzer", [online], [searched on October 14, 2021], Dentsu Science Jam, <URL:https: / / www.dentsuscience jam.com / VAA / >
[0009] Non-Patent Document 3: "Procedure for Conducting Neuromarketing - Sensory Evaluation", [online], [searched on October 14, 2021], Dentsu Science Jam, <https: / / neu-brain s.co.jp / service / neuro-marketing / flow / > Summary of the Invention
[0010] Problems to be Solved by the Invention
[0011] According to the prior art, it is possible to objectively evaluate the reaction of the subjects to the product or service. However, the system as a whole has room for improvement in terms of obtaining specific feedback from the subjects.
[0012] The present invention has been conceived in view of such actual circumstances, and an object of the present invention is to provide a technique for obtaining more specific feedback from a subject in evaluating the subject's response.
[0013] Solutions for solving problems
[0014] An evaluation method according to an aspect of the present disclosure includes the following steps: obtaining information related to a task performed by a subject; obtaining biological information of the subject performing the task over time; determining the timing at which the biological information satisfies a predetermined condition; outputting a portion of the task-related information corresponding to the determined timing; and accepting input of feedback related to the task from the subject.
[0015] An evaluation method according to another aspect of the present disclosure includes the following steps: acquiring information related to a task performed by a subject; determining a timing for accepting input to a mark from at least one of the subject and an observer observing the subject while the subject is performing the task; outputting a portion of the task-related information corresponding to the determined timing; and accepting input of feedback related to the task from the subject.
[0016] According to one aspect of the present disclosure, an evaluation device comprises: an interface for acquiring task-related information and biological information of a subject performing a task; a memory for storing conditions and determined information related to feature quantities in the biological information; and a processor for determining a timing at which a feature quantity in the biological information satisfies the condition, wherein the processor performs the following processing: outputting a portion of the task-related information corresponding to the determined timing; and accepting input of feedback related to the task.
[0017] According to another aspect of the present invention, an evaluation device comprises: an interface for acquiring task-related information and biological information of a subject performing a task; and a processor for determining a timing for accepting input of a mark from at least one of the subject and an observer observing the subject while the subject performing the task is performing the task, wherein the processor performs the following processing: outputting a portion of the task-related information corresponding to the determined timing; and accepting input of feedback related to the task.
[0018] A program according to an aspect of the present disclosure causes a computer to perform the following steps: obtaining information related to a task performed by a subject; obtaining biological information of the subject; determining the timing at which the biological information satisfies a predetermined condition; providing a portion of the task-related information corresponding to the determined timing; and accepting input of feedback related to the task.
[0019] According to another aspect of the present disclosure, a program is executed by a computer to cause the computer to perform the following steps: obtaining information related to a task performed by a subject; determining a timing for accepting input to a mark from at least one of the subject and an observer observing the subject while the subject is performing the task; outputting a portion of the information related to the task that corresponds to the determined timing; and accepting input of feedback related to the task from the subject.
[0020] Effects of the Invention
[0021] According to a certain aspect of the present disclosure, more specific feedback is obtained from the subject in the evaluation of the subject's response. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 It is a diagram showing an overview of an evaluation system including an evaluation device according to the present disclosure.
[0023] Figure 2 1 is a diagram showing an example of a scenario in which the subject 200 inputs feedback related to a task in the evaluation system.
[0024] Figure 3 This is a diagram schematically showing a block configuration of an evaluation system.
[0025] Figure 4 It is a diagram for explaining the attachment positions of the first myoelectric potential sensor 11 and the second myoelectric potential sensor 12 .
[0026] Figure 5 This is a diagram showing an overview of an example of processing performed in the evaluation system 100 .
[0027] Figure 6 4 is a flowchart of a process performed by computer 90 to obtain feedback from subject 200 performing a task.
[0028] Figure 7 This is a diagram showing an example of an input screen.
[0029] Figure 8 It is a diagram showing another example of the input screen. DETAILED DESCRIPTION
[0030] Next, refer to the attached Figure 1In addition, the same or corresponding parts in the drawings are denoted by the same reference numerals, and their description will not be repeated.
[0031] [Overview of evaluation method]
[0032] Figure 1 1 is a diagram showing an overview of an evaluation system including an evaluation device according to the present disclosure. In the evaluation system, a computer 90 is an example of an evaluation device.
[0033] The subject 200 performs the task to input feedback. Figure 1 In the example of FIG. 2 , subject 200 assembles a shelf as an example of a task.
[0034] The computer 90 obtains information related to the task being performed by the subject 200. Figure 1 In the example of FIG. 1 , as an example of information related to the task, an image (a bird's-eye view image) of the space in which the subject 200 is performing the task is captured by the camera 210, and the image is sent to the computer 90. As an example of information related to the task, the sound of the space may be acquired by the microphone 220 and the sound may be sent to the computer 90.
[0035] The computer 90 also acquires biological information of the subject 200. Figure 1 In the example, as an example of biological information, the myoelectric potential signal of the subject 200 is acquired.
[0036] More specifically, the computer 90 acquires the myoelectric potential signal of the subject 200 via the user device 10. The subject 200 is equipped with the user device 10. The user device 10 includes one or more myoelectric potential sensors (see Figure 3 The myopotential signals are acquired by the one or more myopotential sensors.
[0037] The computer 90 determines the timing at which the feature quantity of the above-mentioned biological information satisfies a predetermined condition, and provides the subject 200 with a portion of the information related to the above-mentioned task corresponding to the determined timing. The computer 90 may also determine the timing at which one or more buttons included in the button unit 240 or the button unit 250 are operated as the timing as described above. The button unit 240 includes two buttons 241 and 242 operated by the subject 200. The button unit 250 includes two buttons 251 and 252 operated by the observer 300.
[0038] Figure 2 FIG. 2 is a diagram showing an example of a scenario in which a subject 200 inputs feedback related to a task in the evaluation system. Figure 2In the example, the subject 200 uses the smartphone 290 to obtain the above-mentioned part of the information related to the task provided by the computer 90. In one implementation example, the part is a moving image captured by the camera 210 at the timing determined as described above. The subject 200 inputs feedback related to the task while confirming the part through the smartphone 290, and sends the feedback to the computer 90.
[0039] [Block structure]
[0040] Figure 3 FIG. 1 is a diagram schematically showing the block structure of the evaluation system. Figure 3 As shown, the evaluation system 100 includes a user device 10 and a computer 90. In one implementation example, the user device 10 may also include a wearable terminal installed on the subject. The computer 90 may also be set in the environment around the subject. The user device 10 and the computer 90 are configured to enable two-way communication. The following describes each structure.
[0041] <User device 10>
[0042] The user device 10 includes a sensor unit 1, a signal processing circuit 2, a controller 3, a communication module 4, a battery 5, and a housing 6. The housing 6 accommodates the signal processing circuit 2, the controller 3, the communication module 4, and the battery 5 therein.
[0043] The sensor unit 1 includes a first myoelectric potential sensor 11 and a second myoelectric potential sensor 12. The first myoelectric potential sensor 11 and / or the second myoelectric potential sensor 12 are mounted on the face of the subject to detect myoelectric potential signals at the mounted locations.
[0044] Myoelectric potential signals refer to weak electrical signals generated when muscles are activated. In the present disclosure, the "face" of the subject is not limited to the face surface (the front or side of the face), and can include the neck of the subject. For example, the sensor unit 1 can also be installed in the throat of the subject to detect changes in myoelectric potential caused by the swallowing action of the subject.
[0045] The sensor unit 1 may also include a plurality of sensors. The plurality of sensors may also be installed on muscles of different types. The type of muscle can be determined based on the location where the sensor is installed. In embodiment 1, when determining the type of muscle, it is not necessary to limit it to the composition or structure of the muscle. If the location where the sensor is installed is different, the myoelectric potential signals of different types of muscles can be obtained.
[0046] Figure 4 1 is a diagram for explaining the installation positions of the first myoelectric potential sensor 11 and the second myoelectric potential sensor 12. Figure 4The structure and one mode of use of the first myoelectric potential sensor 11 and the second myoelectric potential sensor 12 will be described.
[0047] The first myoelectric potential sensor 11 is attached to the cheek of the subject. The first myoelectric potential sensor 11 includes a working electrode 111 and a reference electrode 112. The working electrode 111 is incorporated into a spacer 151, and the reference electrode 112 is incorporated into a spacer 152.
[0048] The first myopotential sensor 11 detects myopotential signals of muscles near the cheeks by installing the pad 151 just above the zygomatic muscle and the pad 152 just above the zygomatic major muscle. More specifically, the first myopotential sensor 11 detects the potential of the working electrode 111 based on the potential of the reference electrode 112 as the myopotential signal of muscles near the cheeks. The respective installation positions of the pad 151 and the pad 152 (the working electrode 111 and the reference electrode 112) can be near the zygomatic muscle and the zygomatic major muscle respectively, and can also be slightly deviated from just above these muscles. The first myopotential sensor 11 outputs the above-mentioned myopotential signal as a myopotential signal representing the activity of the facial expression muscles to the signal processing circuit 2 of the user device 10.
[0049] The second myoelectric potential sensor 12 is attached to the eyebrow of the subject. The second myoelectric potential sensor 12 includes a working electrode 121 and a reference electrode 122. The working electrode 121 is incorporated into a spacer 171, and the reference electrode 122 is incorporated into a spacer 172.
[0050] The second myoelectric potential sensor 12 is installed just above the corrugator supercilii muscle through the pads 171 and 172 to detect the myoelectric potential signal of the muscle near the eyebrow (for example, the corrugator supercilii muscle). More specifically, the second myoelectric potential sensor 12 detects the potential of the working electrode 121 based on the potential of the reference electrode 122 as the myoelectric potential signal of the muscle near the eyebrow. The installation position of the pads 171 and 172 (the working electrode 121 and the reference electrode 122) only needs to be near the corrugator supercilii muscle, and can also be slightly deviated from just above the corrugator supercilii muscle. The second myoelectric potential sensor 12 outputs the above-mentioned myoelectric potential signal to the signal processing circuit 2 as a myoelectric potential signal representing the activity of the corrugator supercilii muscle.
[0051] exist Figure 4 In the example, the risorius muscle, the zygomaticus major muscle and the corrugator supercilii muscle are each an example of a facial expression muscle. More specifically, the risorius muscle and the zygomaticus major muscle are each an example of a muscle near the cheek. The corrugator supercilii muscle is an example of a muscle near the eyebrow.
[0052] Refer again Figure 3The signal processing circuit 2 performs predetermined signal processing (noise removal, rectification, amplification, digitization, etc.) on the myoelectric potential signals acquired from the sensor unit 1, and outputs the processed signals to the controller 3. Although not shown in the figure, the signal processing circuit 2 includes a filter, an amplifier, and an A / D converter.
[0053] exist Figure 3 In the embodiment, the signal obtained by processing the myoelectric potential signal from the first myoelectric potential sensor 11 by the signal processing circuit 2 is recorded as " Myopotential signal MS1" , ” The signal obtained by processing the myoelectric signal from the second myoelectric sensor 12 by the signal processing circuit 2 is described as “myoelectric signal MS2 ”.
[0054] The controller 3 is a computing device including a processor 31, a memory 32, and an input / output port 33. The processor 31 is implemented by, for example, a CPU (Central Processing Unit). The memory 32 is implemented by, for example, a ROM (Read Only Memory) and a RAM (Random Access Memory). The input / output port 33 is an interface for inputting and outputting data in the controller 3. The controller 3 performs computing processing for evaluating the expression of the subject based on the myoelectric potential signals MS1 and MS2.
[0055] The communication module 4 is used to enable the user device 10 to communicate with external devices, for example, through a communication device in accordance with a near field wireless communication specification. The controller 3 controls the information exchange between the user device 10 and the external device (computer 90, etc.) by controlling the communication module 4.
[0056] The battery 5 is a secondary battery such as a lithium ion secondary battery, and supplies an operating voltage to each device in the user device 10 .
[0057] The user device 10 further includes a speaker 21 and a display 22. The controller 3 outputs control signals ( Figure 1 The “signal SS” in the signal is used to output the sound via the speaker 21.
[0058] The user device 10 also includes a content providing device 23. The content providing device 23 is a device that provides content. In one implementation example, the content providing device 23 can also provide taste to the subject 200. This device is configured, for example, to electrically sense five tastes of sweetness, saltiness, sourness, bitterness, and umami, and adjust the provided taste by changing the proportion of these tastes. More specifically, this device, as known as a kimbap synthesizer (https: / / research.miyashita.com / papers / I42 / paper.pdf), has five gels containing electrolytes for sensing each of the five tastes, and the provided taste is adjusted by adjusting the amount of electricity applied to the five gels. In one implementation example, the content providing device 23 can also provide a sense of touch to the subject 200. This device adjusts the sense of touch provided by controlling the surface state of a given object. In one implementation example, the content providing device 23 can also provide an odor to the subject 200. This device adjusts the odor provided by adjusting the content of one or more substances contained in the supplied air.
[0059] In the evaluation system 100, information related to the task performed by the subject 200 is acquired. Then, the subject 200 is provided with a portion of the acquired information corresponding to the timing at which the biological information of the subject 200 satisfies a predetermined condition.
[0060] The information related to the task may also be an image. In one example, as the information related to the task, a space in which the task is performed is photographed. In another example, as the information related to the task, an image provided to the subject 200 during the performance of the task is recorded. In this case, as the above-mentioned part, an image is provided to the subject 200. The image is provided via the display 22 (or a display device other than the user device 10).
[0061] The information related to the task may also be sound. In one example, the sound of the space in which the task is performed is recorded as the information related to the task. In another example, the sound provided to the subject 200 during the performance of the task is recorded as the information related to the task. In this case, as the above-mentioned part, the sound is provided to the subject 200. The sound is provided via the speaker 21 (or a speaker other than the user device 10).
[0062] The information related to the task may also be information for determining the smell. In one example, as information related to the task, the smell of the space in which the task is performed is recorded as, for example, the composition of the air. In another example, as information related to the task, the smell provided to the subject 200 during the execution of the task is recorded as, for example, the composition of the air. In yet another example, the images and / or sounds provided to the subject 200 during the execution of the task, and / or the substances determined based on the images and / or sounds recorded in the above-mentioned space are recorded. In this case, as the above-mentioned part, the smell reproduced based on the determined information (for example, the composition or substance of the air) is provided to the subject 200. For example, in the case where "peach" as the name of the substance is determined based on the sound recorded in the above-mentioned space, the smell of peach can be reproduced and provided. The smell is provided via the content providing device 23.
[0063] The information related to the task may also be information for determining the sense of touch. In one example, the sense of touch (the state of the surface of an object) provided to the subject 200 during the execution of the task is recorded as the information related to the task. In another example, the image and / or sound provided to the subject 200 during the execution of the task, and / or the substance determined based on the image and / or sound recorded in the above space are recorded. In this case, as the above part, the sense of touch reproduced based on the determined information is provided to the subject 200. For example, in the case where "peach" as the name of the substance is determined based on the sound recorded in the above space, the surface state of the sense of touch of the surface predetermined as peach can be reproduced and provided. The sense of touch is provided via the content providing device 23.
[0064] The information related to the task may also be information for determining the taste. In one example, as the information related to the task, the taste provided to the subject 200 during the execution of the task (information for determining the name of the food, the composition of the food, etc.) is recorded. In another example, the image and / or sound provided to the subject 200 during the execution of the task, and / or the substance determined based on the image and / or sound recorded in the above space are recorded. In this case, as the above part, the taste reproduced based on the determined information is provided to the subject 200. For example, in the case where "peach" as the name of the substance is determined based on the sound recorded in the above space, the taste predetermined as the taste of peach (a combination of five tastes: sweetness, saltiness, sourness, bitterness and umami) can be reproduced and provided. The taste is provided via the content providing device 23.
[0065] The information related to the task may be a combination of two or more of the above five types of information (image, sound, smell, touch and taste). The content providing device 23 may include a unit capable of reproducing two or more of each of the smell, touch and taste information.
[0066] <Computer 90>
[0067] The computer 90 is, for example, a PC (Personal Computer) or a server. The computer 90 communicates with the user device 10 via a communication module (not shown) and receives a signal indicating a calculation result of the controller 3. The computer 90 includes a controller 91 and a communication module 92.
[0068] The controller 91 includes a processor 95, a memory 96, and an input / output port 97, similarly to the controller 3, and performs various calculations. The communication module 92 is implemented, for example, by a communication device in accordance with a short-range wireless communication specification, similarly to the communication module 4. That is, the communication module 92 is used to enable the computer 90 to communicate with other devices.
[0069] The computer 90 is connected to the camera 210, the microphone 220, the odor sensor 230, and the button units 240 and 250. The camera 210 captures an image of the space where the task is performed and transmits the image to the computer 90. The microphone 220 acquires the sound of the space where the task is performed and transmits the sound to the computer 90. The odor sensor 230 acquires the composition of the air in the space where the task is performed and transmits the composition of the air to the computer 90. The button unit 240 detects the operation of the button 241 or the button 242 and transmits the detection result to the computer 90. The button unit 250 detects the operation of the button 251 or the button 252 and transmits the detection result to the computer 90.
[0070] [Overview of the process]
[0071] Figure 5 This is a diagram showing an overview of an example of processing performed in the evaluation system 100 .
[0072] exist Figure 5 6 types of data are shown while the subject 200 is performing a certain task. The six types of data include feature quantities of two types of biological information (biological information (1) and (2)), the states of the subject mark and the observer mark (ON / OFF), motion image analysis indicators, and related information.
[0073] Biometric information (1) represents, for example, myoelectric potential signals of muscles near the cheeks. Changes in the characteristic amount of biometric information (1) are represented by line L1. Biometric information (2) represents, for example, myoelectric potential signals of muscles near the eyebrows. Changes in the characteristic amount of biometric information (2) are represented by line L2.
[0074] The subject mark indicates, for example, the operation status of buttons 241 and 242. When button 241 is operated, the value of the subject mark becomes on, and when button 242 is operated, the value of the subject mark becomes off. The change of the subject mark is indicated by line L3.
[0075] The observer flag indicates, for example, the operation status of the buttons 251 and 252. When the button 251 is operated, the value of the observer flag becomes on, and when the button 252 is operated, the value of the observer flag becomes off. The change of the observer flag is indicated by the line L4.
[0076] The motion image analysis index represents a feature quantity obtained from the image captured by the camera 210. An example of a feature quantity is a distance that at least a part of the body of the subject 200 moves within a predetermined unit time. The motion image analysis index is affected by the movement of the body of the subject 200 in the captured image. In this sense, the motion image analysis index can be said to be an example of a feature quantity of the biological information of the subject 200. The change of the motion image analysis index is represented by the line L5.
[0077] The related information indicates information acquired as information related to the task. An example of the related information is an image captured by the camera 210 .
[0078] The computer 90 provides the subject 200 with a portion of the associated information corresponding to a given timing. Figure 5 In the example of FIG. 1 , seven timings (TM11 to TM17) are shown as timings for determining the provided portion.
[0079] More specifically, the computer 90 determines the timing at which the value of the subject flag turns on as TM11.
[0080] The computer 90 determines the timing when the value of the biological information (2) reaches a predetermined threshold value (Th22) as TM12.
[0081] The computer 90 determines the timing when the value of the biological information (1) reaches a predetermined threshold value (Th11) (falls to a predetermined threshold value) as TM13.
[0082] The computer 90 determines the timing when the value of the observer flag becomes on as TM14.
[0083] The computer 90 determines the timing when the value of the biological information (1) reaches a predetermined threshold value (Th11) as TM15.
[0084] The computer 90 determines the timing when the value of the moving image analysis index reaches a predetermined threshold value ( Th13 ) as TM16 .
[0085] The computer 90 determines the timing when the value of the biological information (2) reaches a predetermined threshold value (Th22) (falls to a predetermined threshold value) as TM17.
[0086] The computer 90 determines the period including the certain time before and after each of the seven determined timings as the period of information to be provided to the subject 200. Thus, each period in the periods PT11 to PT17 is determined for each of the timings TM11 to TM17. Then, after the task is completed, the computer 90 provides the subject 200 with a portion of each period in the periods PT11 to PT17 in the associated information. The above-mentioned "certain time" is, for example, 2 seconds. In this case, a four-second moving image is provided to the subject 200 as a portion of each period in the periods PT11 to PT17.
[0087] <Period for providing information related to the task>
[0088] In reference Figure 6 In the process described in the following, an input screen including the above-mentioned part is generated after the task is completed, and then the input screen is provided to the subject 200. The period of providing the input screen is not limited to after the task is completed. The computer 90 may also generate an input screen and provide the input screen to the subject 200 every time the above-mentioned timing is determined. That is, the computer 90 may also provide the subject 200 with the related information of the period PT11 without waiting for the determination of the next timing TM2 when the timing TM1 is determined.
[0089] <The period for which the information provided applies>
[0090] The period corresponding to the above-mentioned portion does not need to be a period including a certain period before and after the determined timing. That is, the period corresponding to the above-mentioned portion may be a certain period before and after the determined timing, or a certain period before and after the determined timing, or only the determined timing. Thus, for example, when the timing at which the biological information (1) reaches a given threshold is determined, an image of a certain period before and after the timing, an image of a certain period before and after the timing, or an image of the timing is provided to the subject 200.
[0091] <Method of determining “timing” and types of biological information>
[0092] The computer 90 may determine the timing as described above based on the fact that the detected value of the biological information or the value of the moving image analysis index has reached a given threshold value, or in addition to the fact that the detected value of the biological information or the value of the moving image analysis index has reached a given threshold value, and based on the fact that the detected value of the biological information or the value of the moving image analysis index has reached a given threshold value. In this sense, the detected value of the biological information and the value of the moving image analysis index are each an example of a characteristic value of the biological information. In addition, the fact that the value is saturated is an example of a value being maintained within a given range.
[0093] Furthermore, the above-mentioned “the threshold value has been reached” may be any of the following: the threshold value has been reached from below the threshold value and the threshold value has been reached from above the threshold value (the threshold value has been decreased).
[0094] exist Figure 5 In the example of , as specific examples of the characteristic amount of biological information, the myoelectric potential signal of the muscle near the cheek, the myoelectric potential signal of the muscle near the eyebrow, and the motion image analysis index determined based on the image obtained by shooting the subject 200 are shown. In addition, the characteristic amount of biological information can also be other types of information such as the blood pressure value, brain wave, cardiac potential, respiratory rate, and / or heart rate of the subject 200. For example, with respect to brain waves, the consistency rate between the pattern of the brain wave of the subject and the pattern of the predetermined waveform can also be set as an example of the characteristic amount. That is, if it is information reflecting the state (emotion, etc.) of the subject 200, any information can be used as the characteristic amount of biological information. Moreover, in the evaluation system 100, the computer 90 is configured to perform not only the determination of the timing based on the biological information, but also the determination of the timing based on the button operation of the subject 200 or the observer 300. Thus, the computer 90 can also provide the subject 200 with information corresponding to the timing determined by the subject 200 or the observer 300 as an auxiliary for feedback.
[0095] <Related information (information related to the task)>
[0096] The information acquired as the associated information may also be information about the atmosphere of the space where the task is performed. The information about the atmosphere of the space is, for example, information for determining the composition of the image (video) captured by the camera 210, the sound captured by the microphone 220, and / or the air captured by the odor sensor 230. In addition, the camera 210 may also capture an image of the field of view of the subject 200 as the information about the atmosphere of the space. In this case, the camera 210 is mounted on the head of the subject 200 to capture the field of view of the subject 200.
[0097] <How to obtain related information>
[0098] The associated information may be acquired continuously or at regular intervals or whenever a given event occurs. In one example, the camera 210 may continuously capture moving images as the associated information during the execution of the task. In another example, the camera 210 may capture images (photos) at regular intervals during the execution of the task as the associated information. In yet another example, the camera 210 may capture images (photos) as the associated information each time the subject 200 operates the button 241 and / or each time the observer 300 operates the button 251.
[0099] <Information provided as part of related information>
[0100] The information provided as the portion of the associated information (the portion corresponding to the period PT11 to PT17) may be a portion of the above-mentioned associated information itself, or may be information reproduced based on information determined based on a portion of the associated information. That is, the information provided to the subject 200 may also be information secondary-generated based on the associated information. For example, in the case where the associated information is an image, when it is determined that "peach" is included in the image of the determined timing, the subject 200 may be provided with the image itself containing the "peach", a sound representing "peach", air (smell) of a composition predetermined in a manner corresponding to "peach", a taste of a composition predetermined at the time corresponding to "peach", or a touch predetermined in a manner corresponding to "peach" as information corresponding to the timing.
[0101] <Task>
[0102] In the evaluation system 100, the subject 200 performs a task and inputs feedback about the task. The computer 90 obtains the feedback from the subject 200. The task performed by the subject 200 is not limited to the reference task. Figure 1 The task of making a shelf as described here can also be any type of task.
[0103] Another example of a task is a task in which the subject 200 plays a video game. In the case in which the subject 200 plays a video game as a task, the visual field image of the subject 200 as an example of associated information may be an image of the video game instead of the image captured by the camera 210. The image of the video game may also be determined based on the progress of the game. Therefore, as associated information corresponding to the timing at which the biological information satisfies a given condition, the computer 90 may also obtain the progress of the game instead of the image itself at such a timing.
[0104] The computer 90 may also generate a reference Figure 7In the case of the input screen described later, the screen is reconstructed based on the progress of the game. Then, the computer 90 may provide the screen to the subject 200 by incorporating the reconstructed screen into the input screen.
[0105] [Processing flow]
[0106] Figure 6 The flowchart of the process performed by the computer 90 to obtain feedback from the subject 200 who performs the task. The computer 90 starts the task in response to the notification that the subject 200 starts the task. Figure 6 In one implementation example, in the computer 90, the processor 95 executes a given program, thereby implementing Figure 6 The program may also be stored in the memory 96 non-temporarily.
[0107] In step S10, the computer 90 starts to obtain the associated information. In one implementation example, the computer 90 instructs the camera 210 to start recording.
[0108] In step S12, the computer 90 acquires biological information. In one implementation example, the computer 90 requests the user device 10 to send the myoelectric potential signal acquired by the sensor unit 1. The user device 10 sends the myoelectric potential signal to the computer 90 in response to the request.
[0109] In step S14, the computer 90 determines whether a specific state has occurred. Figure 5 The computer 90 determines that the specific state has occurred ("Yes" in step S14), and if not ("No" in step S14), the computer 90 returns the control to step S12.
[0110] In step S16, the computer 90 registers the current time as a reference point in the memory 96. Instead of the current time, the time elapsed from the start of the task may be registered.
[0111] In step S18, the computer 90 determines whether the task is completed. In one implementation example, when the task is completed, the subject 200 operates the button 242. When the computer 90 detects that the button 242 has been operated, it determines that the task is completed. When the computer 90 determines that the task is completed ("Yes" in step S18), the control proceeds to step S20. If not ("No" in step S18), the control returns to step S12.
[0112] In step S20, the computer 90 ends the acquisition of the associated information started in step S10. In one implementation example, the computer 90 instructs the camera 210 to stop shooting.
[0113] In step S22, the computer 90 generates an input screen. The input screen is a screen provided to the subject 200 for input feedback.
[0114] Figure 7 700 is a diagram showing an example of an input screen. A screen 700 includes a frame 710 , a key 711 , frames 721 to 725 , and a frame 730 .
[0115] Frame 710 includes a message "These are the images captured during this experience. Please fill in your thoughts about this experience while referring to these images." "The images captured during this experience" indicates the moving images displayed in each of frames 721 to 725 described later. That is, the message in frame 710 is an example of a message for prompting subject 200 to refer to the images provided in the feedback input. Computer 90 generates an input screen by embedding the above message in frame 710. In addition, the provided image is an example of a portion of the related information acquired during the execution of the task that corresponds to the "timing" to be explained.
[0116] The key 711 is operated to transmit information input into a box 730 described later to the computer 90 .
[0117] Each of the frames 721 to 725 displays a moving image. The displayed moving image is one of the moving images (an example of related information) acquired during the execution of the task and is related to the reference image. Figure 5 To explain the corresponding part of "timing". Figure 6 In the processing of , this “timing” is acquired as a “reference point”. In each of the frames 721 to 725 , the playback of the moving image starts in response to the touch operation.
[0118] The computer 90 generates content provided as a "portion" corresponding to the "timing" by cutting out the portions corresponding to the "timing" from the moving image (an example of related information) acquired during the execution of the task. Then, the computer 90 generates an input screen by embedding the generated content into each of the frames 721 to 725.
[0119] In addition, the number of frames for displaying related information such as moving images included in the input screen is not limited to Figure 7 The "5" shown. In one implementation, the number of boxes is the number of "timings" determined during the execution of the task.
[0120] Frame 730 is used to receive input of feedback from the subject 200 .
[0121] Return to Figure 6 When the computer 90 generates the input screen in step S22, it transmits the input screen to the subject 200 in step S24. In the input screen, the reference information in the associated information is incorporated as described above. Figure 5 In this sense, the computer 90 provides the above-mentioned part to the subject 200 by sending the input screen to the subject 200.
[0122] In one implementation example, the computer 90 obtains information for identifying the subject 200 and the email address of the subject 200 at the start of the task. The computer 90 sends an email including the input screen generated as described above to the email address in step S24. The subject 200 enters the input screen via the smartphone 290 ( Figure 2 ) receives the email. Thus, the subject 200 browses the input screen through the smart phone 290. In addition, the content described here is only one way to send the input screen to the subject 200. The input screen can also be sent to the subject 200 in any way.
[0123] In step S26, the computer 90 obtains feedback from the subject 200. In one implementation example, the subject 200 inputs feedback in text in the box 730 of the screen 700 displayed on the smartphone 290, and then operates the key 711. In response, the smartphone 290 transmits the text input in the box 730 to the computer 90. The computer 90 obtains feedback by receiving the text transmitted in this way.
[0124] In step S28, the computer 90 registers the acquired feedback in the memory 96. Then, the computer 90 ends Figure 6 processing.
[0125] Through the processing described above, the computer 90 provides the subject 200 with a portion of the associated information acquired during the execution of the task that corresponds to the timing determined using the biological information of the subject 200. The subject 200 inputs feedback related to the task while referring to this portion, and sends the feedback to the computer 90. Thus, the computer 90 acquires feedback from the subject 200 related to the task.
[0126] according to Figure 6The subject 200 can input feedback after being provided with a portion of the task-related information (related information) corresponding to the timing at which the biological information of the subject 200 satisfies a given condition. As a result, the subject 200 can more specifically recall the state of the subject 200 at the above timing. Therefore, the computer 90 can obtain more specific feedback from the subject 200, and the obtained feedback can reflect the subject's true feelings with high accuracy.
[0127] [Modifications]
[0128] <The "part" that provides relevant information without waiting for the task to end>
[0129] exist Figure 6 In the process of, after the task is completed, the screen 700 including frames 721 to 725 is provided to the subject 200. Each frame in the frames 721 to 725 displays the reference image (an example of related information) obtained during the execution of the task. Figure 5 The corresponding part of "timing" is explained. Figure 6 In the process, two or more parts are provided to the subject 200 at the same time after the task is completed.
[0130] On the other hand, two or more parts may be provided to the subject 200 without waiting for the task to end. For example, when the computer 90 determines the above-mentioned "timing", it extracts the part corresponding to the "timing" from the associated information, and sends the part to the subject 200 without the task ending. Thus, it is expected that the subject 200 can continue the task while being aware of the situation when the biological information of the subject 200 satisfies the given conditions even during the execution of the task, and can easily output the content to be input as feedback.
[0131] <Number of “Parts” of Related Information Included in One Input Screen>
[0132] Figure 7 The screen 700 provides the subject 200 with a plurality of parts corresponding to the plurality of timings as five frames 721 to 725. In addition, the input screen may present the plurality of parts corresponding to the plurality of timings to the subject 200 one by one, and may display a frame for input feedback for each part. That is, when five parts are provided to the subject 200 for a certain task, five screens are provided as input screens. The five input screens each include a frame for displaying the above-mentioned part and a frame for inputting feedback while referring to the part.
[0133] <Output subject's status>
[0134] In generating the input screen, the computer 90 may analyze the content of the “part” provided to the subject 200 to identify the state of the subject 200 and include the identified state in the input screen.
[0135] Figure 8 is a diagram showing another example of an input screen. Figure 7 Screen 700 also includes a frame 730 and a key 711 .
[0136] Screen 800 includes frame 810 in place of frame 710 of screen 700. The message displayed in frame 810 includes the sentence "(Please) input the degree of the state at each time point" in addition to the message displayed in frame 710. This sentence is used to prompt subject 200 to input the degree of the state of subject 200 captured at the timing of the moving image displayed in frames 840 and 850 described later.
[0137] Screen 800 includes frame 840 and frame 850. Each frame in frame 840 and frame 850 is Figure 7 Each of the frames 721 to 725 of FIG. 72 displays a moving image in the same manner. The moving image displayed is one of the moving images (an example of related information) acquired during the execution of the task and is related to the reference image. Figure 5 To explain the corresponding part of "timing".
[0138] Screen 800 includes column 841 and column 851. Column 841 and column 851 respectively display the state of subject 200 determined based on the moving images displayed in frame 840 and frame 850 respectively. In one implementation example, computer 90 extracts a specific frame (the first displayed frame, the frame displayed at an intermediate time point, etc.) from the moving image displayed in frame 840, determines the face area from the image of the frame, and determines the emotion corresponding to the face image by analyzing the image of the determined face area. Then, computer 90 embeds the determined emotion as the state of subject 200 into column 841. Computer 90 similarly determines the emotion of subject 200 based on frame 850, and embeds the emotion as the state of subject 200 into column 851.
[0139] Screen 800 includes fields 842 and 843. Field 842 is a field for inputting the degree of the state displayed in field 841. Field 843 is a pull-down menu for displaying candidates for the degree input in field 842. Figure 8 In the example of FIG. 8 , column 841 displays the state “difficult”. Column 843 displays three candidates “very difficult”, “slightly difficult”, and “not difficult” as the degree of the state “difficult”. The subject 200 selects one candidate from the candidates displayed in column 843. The selected candidate is input into column 842.
[0140] Screen 800 includes fields 852 and 853. Field 852 is a field for inputting the degree of the state displayed in field 851. Field 853 is a pull-down menu for displaying candidates for the degree input in field 852. Figure 8 In the example of FIG. 851, the state "happy" is displayed. The column 853 displays three candidates "very happy", "slightly happy", and "unhappy" as the degree of the state "happy". The subject 200 selects one candidate from the candidates displayed in the column 853. The selected candidate is input into the column 852.
[0141] In the screen 800, the send key 711 is pressed, thereby sending the text input into the frame 730 and the degree of the state input into the column 842 and the column 852 to the computer 90. Thus, in step S26, the computer 90 obtains the text input into the frame 730 and the degree of the state input into the column 842 and the column 852 as feedback.
[0142] In the above-mentioned embodiment, an example is described in which each step is executed by one computer 90. The present invention is not limited to this, and each step may be executed by different computers using a plurality of computers connected to each other so as to be able to communicate with each other.
[0143] [Way]
[0144] It will be understood by those skilled in the art that the above-mentioned multiple exemplary embodiments are specific examples of the following aspects.
[0145] (Item 1) An evaluation method involved in one embodiment may also include the following steps: obtaining information related to a task performed by a subject; obtaining biological information of the subject performing the task over time; determining the timing at which the biological information satisfies a predetermined condition; outputting a portion of the information related to the task that corresponds to the determined timing; and accepting input of feedback related to the task from the subject.
[0146] According to the evaluation method described in the first item, in the evaluation of the subject's reaction, more specific feedback is obtained from the subject.
[0147] (Item 2) In the evaluation method described in Item 1, the biological information may also include at least one of the following information: myoelectric potential signals of the subject's facial muscles; the subject's blood pressure value; the subject's brain waves; the subject's cardiac potential; the subject's breathing rate; the subject's heart rate; and indicators determined based on an image containing the subject.
[0148] According to the evaluation method described in the second aspect, the condition of the subject is accurately reflected in the biological information.
[0149] (Item 3) In the evaluation method described in Item 1 or Item 2, the predetermined condition may include at least one of the following conditions: the characteristic quantity in the biological information reaches a given threshold; and the change in the characteristic quantity in the biological information is below a given value for a period of time exceeding a specified time.
[0150] According to the evaluation method described in the third aspect, it is easy to determine whether the feature amount of the biological information satisfies the predetermined condition.
[0151] (Item 4) In the evaluation method described in any one of Items 1 to 3, the predetermined condition may include the following condition: the feature value in the biometric information is maintained within a given range and is maintained for a given time or longer.
[0152] According to the evaluation method described in the fourth aspect, it is easy to determine whether the feature amount of the biological information satisfies the predetermined condition.
[0153] (Item 5) In the evaluation method described in any one of Items 1 to 4, it may also include the following steps: while the subject is performing the task, an input of a mark is accepted from at least one of the subject and an observer observing the subject, and the output step includes providing a portion of the information related to the task that corresponds to the time point marked with the mark.
[0154] According to the evaluation method described in the fifth aspect, it is possible to provide the subject with information on the portion corresponding to the timing desired by the subject or the observer.
[0155] (Item 6) An evaluation method involved in one embodiment may also include the following steps: obtaining information related to a task performed by a subject; determining a timing for accepting a marked input from at least one of the subject and an observer observing the subject during the period when the subject performing the task is performing the task; outputting a portion of the information related to the task that corresponds to the determined timing; and accepting an input of feedback related to the task from the subject.
[0156] According to the evaluation method described in the sixth item, in the evaluation of the subject's response, more specific feedback is obtained from the subject.
[0157] (Item 7) In the evaluation method described in any one of Items 1 to 6, the information related to the task may include at least one of the following information: information on the atmosphere of the space in which the task is performed; and information on the content provided to the subject in the task.
[0158] According to the evaluation method described in the seventh item, the status of the subject is accurately reflected in the information related to the task.
[0159] (Item 8) In the evaluation method described in Item 7, the information related to the task may include information about the atmosphere of the space, and the information about the atmosphere of the space may include at least one of the following information: a camera image of the space where the task is performed; a recording of the sound of the space where the task is performed; and the smell of the space where the task is performed.
[0160] According to the evaluation method described in the eighth item, the status of the subject is more accurately reflected in the information related to the task.
[0161] (Item 9) In the evaluation method described in Item 7, the information related to the task may include information about the atmosphere of the space, the information about the atmosphere of the space may include a camera image of the space, and the camera image of the space may include at least one of the following images: an image including a subject performing the task; and an image of the line of sight of the subject performing the task.
[0162] According to the evaluation method described in the ninth item, the status of the subject is more accurately reflected in the information related to the task.
[0163] (Item 10) In the evaluation method described in any one of Items 7 to 9, the information related to the task may include information on the content, and the output portion may include at least one of an image, a sound, a smell, a touch, and a taste.
[0164] According to the evaluation method described in the tenth item, useful information is provided to the subject to input specific feedback.
[0165] (Item 11) In the evaluation method described in any one of Items 1 to 10, the step of acquiring may include acquiring information related to the task at regular intervals during execution of the task.
[0166] According to the evaluation method described in the eleventh aspect, the amount of data to be processed in acquiring information related to the task is suppressed to a minimum.
[0167] (Item 12) In the evaluation method described in Items 1 to 11, the outputted portion may correspond to the timing and a given period before and after the timing.
[0168] According to the evaluation method described in the twelfth item, it is possible to provide the subject with detailed information for reminding him / her of the situation at the timing.
[0169] (Item 13) In the evaluation method described in any one of Items 1 to 12, the output step may include providing the part after the task is completed.
[0170] According to the evaluation method described in the thirteenth item, even after the task is completed, the subject can be reminded of the situation during the execution of the task.
[0171] (Item 14) In the evaluation method described in any one of Items 1 to 13, the outputting step may include providing the portion in response to the timing being determined without waiting for the task to be completed.
[0172] According to the evaluation method described in the fourteenth item, it is possible to more reliably remind the subject of the state of the subject at the above-mentioned timing.
[0173] (Item 15) In the evaluation method described in any one of Items 1 to 14, the output step may include: determining the state of the subject by analyzing the outputted portion; and outputting the state of the subject.
[0174] According to the evaluation method described in Item 15, more specific information related to the subject is provided to the subject.
[0175] (Item 16) In the evaluation method described in Item 15, the output step may include outputting information for prompting input of the degree of the subject's state, and the receiving step may include obtaining input of the degree of the subject's state.
[0176] According to the evaluation method described in the sixteenth item, the degree of the subject's condition can be managed in the computer that implements the evaluation method.
[0177] (Item 17) In the evaluation method described in Items 1 to 16, the output step may include providing a portion corresponding to the second timing together with a portion corresponding to the first timing when the first timing and the second timing are determined as the timing.
[0178] According to the evaluation method described in Item 17, information can be provided to the subject in an inclusive manner.
[0179] (Item 18) In the evaluation method described in any one of Items 1 to 17, the output step may include providing a portion corresponding to the second timing after providing a portion corresponding to the first timing when the first timing and the second timing are determined as the timing.
[0180] According to the evaluation method described in the eighteenth item, the information related to the first timing and the second timing is independently provided to the subject.
[0181] (Item 19) In the evaluation method described in any one of Items 1 to 18, the output step may include outputting a message for prompting the subject to refer to the portion output in the input of feedback.
[0182] According to the evaluation method described in Item 19, the subject can reliably refer to the above-mentioned partial information.
[0183] (Item 20) An evaluation device according to one embodiment may include: an interface for acquiring information related to the task and biological information of a subject performing the task; a memory for storing conditions and determined information related to feature quantities in the biological information; and a processor for determining a timing at which the feature quantities in the biological information satisfy the conditions, wherein the processor performs the following processing: outputting a portion of the information related to the task that corresponds to the determined timing; and accepting input of feedback related to the task.
[0184] According to the evaluation device as described in the twentieth item, in the evaluation of the subject's reaction, more specific feedback is obtained from the subject.
[0185] (Item 21) An evaluation device according to one embodiment may also include: an interface for acquiring information related to the task and biological information of a subject performing the task; and a processor for determining a timing for accepting input of a mark from at least one of the subject and an observer observing the subject during the period when the subject performing the task performs the task, wherein the processor performs the following processing: outputting a portion of the information related to the task that corresponds to the determined timing; and accepting input of feedback related to the task.
[0186] According to the evaluation device as described in item 21, in the evaluation of the reaction of the subject, more specific feedback is obtained from the subject.
[0187] (Item 22) A program involved in one method can also be executed by a computer to cause the computer to perform the following steps: obtaining information related to a task performed by a subject; obtaining biological information of the subject; determining the timing when the biological information satisfies a predetermined condition; outputting a portion of the information related to the task that corresponds to the determined timing; and accepting input of feedback related to the task.
[0188] According to the procedure described in Item 22, more specific feedback is obtained from the subject in the evaluation of the subject's response.
[0189] (Item 23) A program involved in one method can also be executed by a computer to cause the computer to perform the following steps: obtaining information related to a task performed by a subject; determining the timing of accepting a marked input from at least one of the subject and an observer observing the subject during the performance of the task by the subject performing the task; outputting a portion of the information related to the task that corresponds to the determined timing; and accepting an input of feedback related to the task from the subject.
[0190] According to the procedure described in item 23, more specific feedback is obtained from the subject in the evaluation of the subject's response.
[0191] The embodiments disclosed herein are illustrative and not restrictive in all respects. The scope of the present disclosure is not shown by the description of the above-mentioned embodiments but by the claims, and is intended to include all changes within the meaning and scope equivalent to the claims. In addition, each technical intention in the embodiments can be implemented alone, and can also be implemented in combination with other technologies in the embodiments as much as possible as needed.
[0192] Description of Reference Numerals
[0193] 1: sensor unit; 3, 91: controller; 4, 92: communication module; 5: battery; 6: housing; 10: user device; 11: first myoelectric potential sensor; 12: second myoelectric potential sensor; 21: speaker; 22: display; 23: content provider; 31, 95: processor; 32, 96: memory; 33, 97: input and output ports; 90: computer; 100: evaluation system; 111, 121: working electrode; 112, 122: reference electrode; 151 , 152, 171, 172: pad; 200: subject; 210: camera; 220: microphone; 230: odor sensor; 240, 250: button unit; 241, 242, 251, 252: button; 290: smartphone; 300: observer; 700, 800: screen; 710, 721, 725, 730, 810, 840, 850: frame; 711: key; 841, 842, 843, 851, 852, 853: column.
Claims
1. An evaluation method comprising the following steps: Obtaining information related to the tasks performed by the subject; acquiring biological information of a subject performing the task over time; determining a timing at which the biometric information satisfies a predetermined condition; outputting a portion of the information related to the task corresponding to the determined timing; and An input of feedback related to the task is received from the subject.
2. The evaluation method according to claim 1, wherein: The biometric information includes at least one of the following information: Myoelectric potential signals of the facial muscles of the subject; The blood pressure value of the subject; The subject's brain waves; The cardiac potential of the subject; the subject's respiratory rate; the subject's heart rate; as well as An indicator is determined based on an image containing the subject.
3. The evaluation method according to claim 1, wherein: The predetermined condition includes at least one of the following conditions: The feature quantity in the biological information reaches a given threshold; and The state in which the amount of change of the characteristic quantity in the biological information is less than or equal to a given value continues for a predetermined time or longer.
4. The evaluation method according to claim 1, wherein: The predetermined condition includes a condition that the feature quantity in the biometric information is maintained within a given range and is maintained for a given time period or longer.
5. The evaluation method according to claim 1, wherein: The following steps are also included: accepting input of a mark from at least one of the subject and an observer observing the subject while the subject is performing a task, The outputting step includes providing a portion of the information related to the task corresponding to the time point marked with the mark.
6. An evaluation method comprising the following steps: Obtaining information related to the tasks performed by the subject; determining a timing at which a marker input is received from at least one of the subject and an observer observing the subject while the subject performing the task is performing the task; outputting a portion of the information related to the task that corresponds to the determined timing; as well as An input of feedback related to the task is received from the subject.
7. The evaluation method according to claim 1, wherein: The information related to the task includes at least one of the following information: information about the atmosphere of the space in which the task is to be performed; and Information about the content provided to the subject in the task.
8. The evaluation method according to claim 7, wherein: The information related to the task includes information about the atmosphere of the space, The information about the atmosphere of the space includes at least one of the following information: a camera image of a space in which the task is performed; recordings of the sounds of the space in which the tasks are performed; as well as The smell of the space in which the task is performed.
9. The evaluation method according to claim 7, wherein: The information related to the task includes information about the atmosphere of the space, The information about the atmosphere of the space includes a camera image of the space, The camera image of the space includes at least one of the following images: an image containing a subject performing the task; and An image of the gaze of a subject performing the task.
10. The evaluation method according to claim 7, wherein: The information related to the task includes information about the content, The outputted portion includes at least one of an image, a sound, a smell, a touch, and a taste.
11. The evaluation method according to claim 1, wherein: The step of acquiring includes acquiring information related to the task at regular intervals during execution of the task.
12. The evaluation method according to claim 1, wherein: The outputted portion corresponds to the timing and a given period before and after the timing.
13. The evaluation method according to claim 1, wherein: The step of outputting includes outputting the part after the task is completed.
14. The evaluation method according to claim 1, wherein: The step of outputting includes outputting the portion in response to the timing being determined without waiting for the end of the task.
15. The evaluation method according to claim 1, wherein: The outputting steps include: Determining the state of the subject by parsing the outputted portion; and The status of the subject is output.
16. The evaluation method according to claim 15, wherein: The step of outputting includes outputting information for prompting input of the degree of the state of the subject, The accepting step includes obtaining input of the degree of the subject's condition.
17. The evaluation method according to claim 1, wherein: The step of outputting includes, in a case where a first timing and a second timing are determined as the timing, providing a portion corresponding to the second timing together with a portion corresponding to the first timing.
18. The evaluation method according to claim 1, wherein: The step of outputting includes, in a case where first timing and second timing are determined as the timing, providing a portion corresponding to the second timing after outputting a portion corresponding to the first timing.
19. The evaluation method according to claim 1, wherein: The outputting step includes outputting a message for prompting the subject to refer to the portion output in the input of the feedback.
20. An evaluation device comprising: An interface for obtaining information related to the task and biological information of a subject performing the task; a memory storing conditions and determined information related to feature quantities in the biological information; and a processor for determining a timing at which a feature quantity in the biological information satisfies the condition, in, The processor performs the following processing: outputting a portion of the information related to the task corresponding to the determined timing; and Accepting input of feedback related to the task.
21. An evaluation device comprising: An interface for acquiring information related to the task and biological information of a subject performing the task; and a processor for determining a timing of receiving input of a mark from at least one of the subject and an observer observing the subject during the subject performing the task, in, The processor performs the following processing: outputting a portion of the information related to the task corresponding to the determined timing; and Accepting input of feedback related to the task.
22. A program, which, when executed by a computer, causes the computer to execute the following steps: Obtaining information related to the tasks performed by the subject; Acquiring biological information of the subject; determining a timing at which the biometric information satisfies a predetermined condition; outputting a portion of the information related to the task corresponding to the determined timing; and Accepting input of feedback related to the task.
23. A program, which, when executed by a computer, causes the computer to execute the following steps: Obtaining information related to the tasks performed by the subject; determining a timing at which a marker input is received from at least one of the subject and an observer observing the subject while the subject performing the task is performing the task; outputting a portion of the information related to the task that corresponds to the determined timing; as well as An input of feedback related to the task is received from the subject.
