Evaluation system, evaluation method, and program

Abstract

To provide an evaluation system in which a learning effect of an object person can be improved.SOLUTION: An evaluation system 10 includes an estimation unit 35 that estimates the learning motivation of an object person who is engaged in learning with a supporter, on the basis of a video including at least the object person, an identification unit 36 that identifies a statement given by the supporter within a prescribed time period including a timing at which the estimated learning motivation changed, on the basis of voice within the prescribed time period, and an evaluation unit 37 that evaluates the identified statement and outputs the evaluation result.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an evaluation system, an evaluation method, and a program. [Background technology]

[0002] Patent Document 1 discloses an education support system that can display a list of contents displayed on the screens of a plurality of communication terminals connected to a network on the screen of a specific terminal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-127033 A Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention provides an evaluation system and the like that can improve the learning effect of subjects. [Means for solving the problem]

[0005] An evaluation system according to one embodiment of the present invention includes an estimation unit that estimates the learning motivation of a subject who is studying with a supporter based on at least a video image of the subject, an identification unit that identifies the content of comments made by the supporter during a specified period of time based on audio during the specified period of time including a time when the estimated learning motivation changed, and an evaluation unit that evaluates the identified content of comments and outputs an evaluation result.

[0006] An evaluation method according to one embodiment of the present invention is an evaluation method executed by a computer, and includes an estimation step of estimating the learning motivation of a subject who is studying with a supporter based on at least a video image of the subject, an identification step of identifying the content of comments made by the supporter during a specified period of time based on audio during the specified period of time including a time when the estimated learning motivation changed, and an evaluation step of evaluating the identified content of comments and outputting an evaluation result.

[0007] A program according to one aspect of the present invention is a program for causing the computer to execute the evaluation method. Effect of the Invention

[0008] The evaluation system etc. of the present invention can improve the effectiveness of learning for subjects. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing a functional configuration of an evaluation system according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing a child studying together with a supporter using an information terminal. [Diagram 3] FIG. 3 is a diagram illustrating an example of a sequence diagram of an operation for acquiring learning history information. [Figure 4] FIG. 4 is a sequence diagram of the operation of evaluating the contents of a comment. [Diagram 5] FIG. 5 is a diagram for explaining a predetermined period including a timing when the will to learn has changed by a predetermined amount or more. [Figure 6] FIG. 6 is a diagram illustrating an example of the evaluation database. [Figure 7] FIG. 7 is a diagram illustrating an example of the advice database. [Figure 8] FIG. 8 is a diagram illustrating an example of the evaluation information. [Figure 9] FIG. 9 is a diagram showing an example of a display screen of the evaluation result. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component arrangement and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present invention. In addition, among the components in the following embodiments, components that are not described in the independent claims will be described as optional components.

[0011] In addition, each drawing is a schematic diagram and is not necessarily a precise illustration. In each drawing, the same reference numerals are used for substantially the same configurations, and duplicated explanations may be omitted or simplified.

[0012] (Embodiment) [composition] First, the configuration of the evaluation system according to the embodiment will be described below. Fig. 1 is a block diagram showing the functional configuration of the evaluation system according to the embodiment.

[0013] The evaluation system 10 according to the embodiment shown in Fig. 1 is a system capable of evaluating the content of comments made by a supporter such as a parent or a teacher when a child is studying together with the supporter using an information terminal 20. Fig. 2 is a diagram showing a state when a child is studying together with the supporter using the information terminal 20.

[0014] The children we are referring to here are school-age children (children before entering elementary school, in other words, infants) who are preparing to take the elementary school entrance exam and attend preschool classes. School-age children are said to be in a developmental stage where they are broadening their interests and developing their cognitive abilities and sociality. For this reason, parents and other supporters must take the lead in their learning and encourage their physical and mental growth.

[0015] However, it is difficult for supporters to accurately understand a child's motivation to learn and to communicate and guide the child appropriately, and the current situation is that supporters end up engaging in conversations that are inappropriate for promoting the child's growth.

[0016] To address these issues, the evaluation system 10 evaluates the content of the supporter's comments and provides feedback on the evaluation results to the supporter, thereby supporting appropriate dialogue between the supporter and the child. As shown in Fig. 1, the evaluation system 10 includes an information terminal 20 and a server device 30. Each of these devices will be described below.

[0017] First, the information terminal 20 will be described. The information terminal 20 is an information terminal used by a child or a supporter. The information terminal 20 is, for example, a portable information terminal such as a smartphone or a tablet terminal, but may also be a stationary information terminal such as a personal computer. Specifically, the information terminal 20 includes an operation receiving unit 21, a display unit 22, an information processing unit 23, a storage unit 24, a communication unit 25, a camera 26, and a microphone 27.

[0018] The operation reception unit 21 receives operations from the child or the supporter. The operation reception unit 21 is realized by, for example, a touch panel, but may also be realized by a mouse and a keyboard.

[0019] The display unit 22 displays an image. The display unit 22 displays, for example, study content. The display unit 22 is realized by, for example, a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel.

[0020] While displaying the learning content on the display unit 22, the information processing unit 23 captures an image of the child using the camera 26 and acquires the voices of the child and the supporter using the microphone 27 during learning using the learning content. The information processing unit 23 is realized, for example, by a microcomputer, but may also be realized by a processor. The functions of the information processing unit 23 are realized, for example, by the microcomputer or processor constituting the information processing unit 23 executing a computer program stored in the storage unit 24.

[0021] The storage unit 24 is a storage device that stores the computer program executed by the information processing unit 23 and various information necessary for the information processing unit 23 to perform the above-mentioned processing. The storage unit 24 is realized by, for example, a semiconductor memory.

[0022] The communication unit 25 is a communication module (communication circuit) for the information terminal 20 to communicate with the server device 30 via a wide area communication network such as the Internet. The communication performed by the communication unit 25 is, for example, wireless communication, but may also be wired communication. There is no particular limitation on the communication standard used for the communication.

[0023] The camera 26 captures an image of the child while studying. The camera 26 is realized by an image sensor and an optical system such as a lens. Note that it is not essential that the camera 26 is provided in the information terminal 20, and the camera 26 may be a standalone device that can be connected to the information terminal 20 for communication.

[0024] The microphone 27 captures the voices of the child and the supporter during learning. The microphone 27 is, for example, a condenser microphone, a dynamic microphone, or a MEMS (Micro Electro Mechanical Systems) microphone. Note that it is not essential that the microphone 27 is provided in the information terminal 20, and the microphone 27 may be a standalone device that can be communicatively connected to the information terminal 20.

[0025] Next, the server device 30 will be described. The server device 30 is a cloud server that evaluates the content of comments by the supporter based on the video of the child who is studying and the voices of the child who is studying and the supporter. The server device 30 includes a communication unit 31, an information processing unit 32, and a storage unit 33.

[0026] The communication unit 31 is a communication module (communication circuit) for the server device 30 to communicate with the information terminal 20 via a wide area communication network. The communication performed by the communication unit 31 is, for example, wired communication, but may be wireless communication. There is also no particular limitation on the communication standard used for the communication.

[0027] The information processing unit 32 performs a process of evaluating the content of the supporter's remark. The information processing unit 32 is realized, for example, by a microcomputer, but may be realized by a processor. The information processing unit 32 has an acquisition unit 34, an estimation unit 35, a specification unit 36, and an evaluation unit 37 as functional components. The functions of the acquisition unit 34, the estimation unit 35, the specification unit 36, and the evaluation unit 37 are realized, for example, by a microcomputer or a processor constituting the information processing unit 32 executing a computer program stored in the storage unit 33. The detailed functions of the acquisition unit 34, the estimation unit 35, the specification unit 36, and the evaluation unit 37 will be described later.

[0028] The storage unit 33 is a storage device that stores the computer program executed by the information processing unit 32 and various information necessary for the information processing unit 32 to perform the above-mentioned processing. The storage unit 33 is realized by, for example, an HDD (Hard Disk Drive).

[0029] [Acquisition of learning history information] The evaluation system 10 acquires video and audio data, etc., when a child is studying together with a supporter using an information terminal 20, as learning history information, and uses the acquired data to evaluate the remarks of the supporter. The operation of acquiring learning history information will be described below. Figure 3 is a diagram showing an example of a sequence diagram of the operation of acquiring learning history information.

[0030] The child or the helper performs a start operation to start the execution of a predetermined learning application program that is pre-installed in the information terminal 20. The operation reception unit 21 of the information terminal 20 receives the start operation (S11).

[0031] The start operation includes a login operation (input operation of a user ID and a password) and an input operation of attribute information of the supporter (such as the name of the father, mother, or teacher).

[0032] Once the start operation is complete, the display of the study content begins (S12). For example, a question and answer options for the question are displayed, and when an option is selected, the answer is displayed. This process is repeated.

[0033] While the learning content is being displayed, information processing unit 23 activates camera 26, captures video of the child using camera 26, and stores the video in storage unit 24 (S13). Also, while the learning content is being displayed, information processing unit 23 activates microphone 27, captures voices of the child and supporter using microphone 27, and stores the voices in storage unit 24 (S14).

[0034] In addition, while the learning content is being displayed, the information processing unit 23 acquires an operation log of what operations were performed on the operation receiving unit 21 (which position on the display unit 22 was operated) and stores it in the memory unit 24 (S15).

[0035] Thereafter, the child or the supporter performs an end operation to end the predetermined learning application program, and the operation receiving unit 21 receives the end operation (S16). When the end operation is received by the operation receiving unit 21, the information processing unit 23 ends the display of the learning content (S17), and transmits learning history information including the video, audio, and operation log acquired and stored while the learning content was being displayed to the server device 30 using the communication unit 25 (S18). The learning history information also includes the user ID and information indicating the relationship to the accompanying person input at the time of the start operation. Note that it is not essential that the learning history information is transmitted in response to the end operation, and it may be transmitted to the server device 30 periodically while the learning content is being displayed.

[0036] The communication unit 31 of the server device 30 receives the learning history information. The information processing unit 32 stores the received learning history information in the storage unit 33 (S19).

[0037] In this way, the evaluation system 10 (server device 30) can acquire learning history information when the child is studying using the information terminal 20 together with the supporter.

[0038] [Evaluation behavior] Next, an operation of evaluating the content of a comment by a supporter will be described with reference to Fig. 4. The operation of evaluating the content of a comment by a supporter is shown in Fig. 4 as a sequence diagram.

[0039] The acquisition unit 34 of the server device 30 acquires the learning history information stored in the storage unit 33 in step S19 (S20). The estimation unit 35 estimates the child's motivation to learn when he or she is engaged in learning, based on the video included in the learning history information acquired in step S20 (S21).

[0040] The estimation unit 35 estimates the willingness to learn by inputting the feature amount obtained from the video (child's appearance) into a machine learning model. The feature amount is, for example, a feature amount related to posture such as the inclination of the shoulder line while learning, but may also be a feature amount related to facial expression such as the number of blinks. When estimating the feature amount related to posture, the estimation unit 35 estimates a skeletal model of the child as necessary. The skeletal model is a model in which the positions of the joints (spheres) of a person shown in the video are connected by links (lines), and is used to analyze a person's posture.

[0041] The machine learning model for estimating the motivation to learn is constructed by associating data, which is a feature amount with the motivation to learn when the feature amount is observed, as learning data, and is stored in advance in the storage unit 33. The learning data is created under the advice of educators (education experts). For example, when a feature amount is input, the machine learning model outputs one of five scores from 1 (no motivation to learn) to 5 (motivated to learn). In other words, the estimation unit 35 can estimate the child's motivation to learn on a five-level scale from 1 to 5.

[0042] The machine learning model used in step S21 may be a model to which deep learning is applied, and may be a model capable of estimating motivation to learn using a video as an input. In other words, it is not essential for the estimation unit 35 to acquire features from the video in step S21. Note that the reason why a video showing a child is used to estimate motivation to learn is that a decrease in motivation to learn is more likely to become apparent (is more likely to be manifested in attitudes or behaviors) in children at a developmental stage than in adults.

[0043] As a result of the process of step S21, data on changes over time in motivation to learn during a period in which one learning session was performed (hereinafter also referred to as a target period) is obtained. Then, the identification unit 36 ​​acquires voice from the learning history information during a predetermined period including a time when motivation to learn changed by a predetermined amount or more (changed significantly) (S22).

[0044] FIG. 5 is a diagram for explaining the predetermined period, in which the horizontal axis indicates time and the vertical axis indicates learning motivation (five levels from 1 to 5). The predetermined period is, for example, a period from m seconds (m>0) before the timing when the learning motivation changes by a predetermined amount or more to n seconds (n>0) after the timing, or a period from m seconds before the timing when the learning motivation changes significantly to the timing. m and n are periods of several seconds to several tens of seconds, and may be appropriately determined empirically or experimentally. The predetermined period may be a period including the timing when the learning motivation changes significantly. In FIG. 5, two predetermined periods, a predetermined period T1 and a predetermined period T2, are illustrated.

[0045] Next, the identification unit 36 ​​identifies the supporter's utterances during a predetermined period based on the voice acquired in step S22 (S23). That is, the identification unit 36 ​​identifies the supporter's utterances that are considered to be related to changes in the child's motivation to learn. For example, the identification unit 36 ​​performs a speaker identification process on the voices during the predetermined period, identifies the voices identified as the voices of adults as the voices of the supporter, and performs a process of converting the voices of the supporter into text (transcription process).

[0046] Here, the storage unit 33 stores an evaluation database for evaluating the content of statements. Fig. 6 is a diagram showing an example of the evaluation database. As shown in Fig. 6, in the evaluation database, predetermined phrases such as "Why don't you understand?", "I did it before", "I tried my best", and "I can do it next time" are associated with one or more categories for classifying the predetermined phrases. Specifically, the categories are "disregard", "threat", "amazement", "vague hint", "referencing the past", "praise", and "encouragement".

[0047] In the evaluation database, each predetermined phrase is associated with an evaluation value. The evaluation values ​​are, for example, in three stages, O, △, and ×, but may be divided into four or more stages.

[0048] The evaluation database described above can be created, for example, with the advice of educators (education experts).

[0049] The evaluation unit 37 refers to such an evaluation database to determine whether or not the utterance content identified in step S23 contains a predetermined phrase. More specifically, whether or not the predetermined phrase is contained means whether or not a phrase identical to or similar to the predetermined phrase is contained, and is not in the strict sense.

[0050] If it is determined that the predetermined phrase is included, the evaluation unit 37 evaluates the comment content (S24). The evaluation unit 37 performs at least one of evaluation based on an evaluation value and evaluation of the nuance of the comment content, for example.

[0051] First, the evaluation based on the evaluation value will be described. When the evaluation unit 37 determines that the utterance content includes a predetermined phrase, it specifies the evaluation value associated with the predetermined phrase as the evaluation value for the utterance content. When the utterance content includes a plurality of predetermined phrases, the evaluation unit 37 selects the highest evaluation value or the lowest evaluation value among the plurality of evaluation values ​​corresponding to the plurality of predetermined phrases. Note that the evaluation value may be a numerical value, and when the utterance content includes a plurality of predetermined phrases, the evaluation unit 37 may add up the plurality of evaluation values ​​(numerical values) corresponding to the plurality of predetermined phrases.

[0052] Next, the evaluation of the nuance of the comment content will be described. When the evaluation unit 37 determines that the comment content contains a predetermined phrase, it counts the categories associated with the predetermined phrase to evaluate the nuance of the comment content. The nuance here has the same meaning as the category.

[0053] For example, if the utterance "Why don't you understand? I did it before, didn't I?" is identified during a predetermined period T1 when the child's motivation to learn has decreased, this utterance contains two predetermined phrases, "Why don't you understand" and "I did it before." Therefore, the evaluation unit 37 counts up "disregard," "threat," "amazement," "vague hint," "reference to the past," and "amazement" associated with these two predetermined phrases, and identifies "amazement" as occurring twice, and "disregard," "threat," "vague hint," and "reference to the past" each occurring once. Then, the evaluation unit 37 evaluates "amazement," which is the name of the category with the highest frequency, as the nuance of the utterance "Why don't you understand? I did it before, didn't I?"

[0054] Similarly, if the utterance "You did a good job! You can do it again next time!" is identified during the predetermined period T2 when the child's motivation increased, this utterance contains the two predetermined phrases "You did a good job" and "You can do it again next time." Therefore, the evaluation unit 37 counts up "praise," "encourage," and "encouragement" associated with these two predetermined phrases, and identifies "encouragement" as occurring twice and "praise" as occurring once. Then, the evaluation unit 37 evaluates "encouragement," which is the name of the category with the largest number of counts, as the nuance of the utterance "You did a good job! You can do it again next time!".

[0055] Here, the storage unit 33 stores an advice database that defines advice (comments) for evaluation results. FIG. 7 is a diagram showing an example of the advice database. As shown in FIG. 7, in the advice database, categories and advice are associated one-to-one. The advice database can be created, for example, under the advice of educators (education experts). For example, the advice database stores advice created based on educators' ideas about how parent-child learning should be and how parents and children should interact.

[0056] The evaluation unit 37 refers to the advice database to identify advice for the evaluation result of the comment content (S25). Specifically, the evaluation unit 37 identifies advice associated with the category with the largest number of counts as advice for the identified comment content. Note that in step S25, it is sufficient to identify advice associated with at least one category determined based on the counting result, and two or more types of advice associated with two or more categories may be identified.

[0057] Next, the evaluation unit 37 stores evaluation information indicating the result of the evaluation in the storage unit 33 (S26). Fig. 8 is a diagram showing an example of the evaluation information. As shown in Fig. 8, the evaluation information is information including the date and time when the comment was made, the user ID, the commenter (the attribute information of the supporter), the change in the motivation to learn, the comment content, the nuance, the advice, and the evaluation value. Note that the user ID and the attribute information of the supporter are included in the learning history information acquired in step S20.

[0058] Thereafter, the supporter performs a request operation to request the server device 30 to provide information on the evaluation result, and the operation reception unit 21 receives the request operation (S27). When the request operation is received by the operation reception unit 21, the information processing unit 23 transmits an information provision request to the server device 30 using the communication unit 25 (S28). The information provision request includes the user ID.

[0059] The communication unit 31 of the server device 30 receives the information request. The evaluation unit 37 reads out the evaluation information associated with the user ID included in the received information request from the storage unit 33, and transmits the read evaluation information to the information terminal 20 using the communication unit 31 (S29). In other words, the evaluation unit 37 outputs the evaluation result.

[0060] The communication unit 25 of the information terminal 20 receives the evaluation information. The information processing unit 23 displays a display screen of the evaluation result on the display unit 22 based on the received evaluation information (S30). That is, the information processing unit 23 visualizes the evaluation result. Fig. 9 is a diagram showing an example of the display screen of the evaluation result.

[0061] 9, the evaluation result display screen displays the utterances made when the child's motivation to learn improved, the evaluation value for the utterances, and advice for the utterances (advice praising the utterances), while the evaluation result display screen displays the utterances made when the child's motivation to learn decreased, the evaluation value for the utterances, and advice for the utterances (advice to be careful about what you say).

[0062] As described above, the evaluation system 10 can evaluate the content of the supporter's comments when the child is studying together with the supporter using the information terminal 20, and provide advice to the supporter. It is generally believed that the more appropriate the supporter's comments (encouragement) to the child while studying, the more effective the learning will be. Therefore, the evaluation system 10 can improve the effectiveness of learning by providing advice about the supporter's comments to the child.

[0063] In the above explanation of the evaluation operation, the evaluation of the supporter's utterances in one learning session has been explained. Here, if multiple learning sessions are performed and a certain amount of evaluation information is accumulated, the evaluation system 10 can provide the supporter with statistical information such as the frequency with which the supporter utters utterances with a nuance of "amazement."

[0064] [Variations of estimation of motivation to learn] In the above evaluation operation, the motivation to learn is estimated based on the video. Here, the motivation to learn may be estimated using the operation log included in the learning history information (the operation log acquired and stored in step S15) in addition to the video. For example, if operations are found in areas unrelated to learning (such as areas outside the answer column), it is considered that the child's motivation to learn is declining, so the operation log can be used to estimate the motivation to learn.

[0065] For example, if a machine learning model for estimating a willingness to learn is constructed so that a feature based on an operation log is input in addition to a feature based on a video, the estimation unit 35 can estimate the willingness to learn using the operation log in addition to the video. Note that the feature based on the operation log is, for example, an operation speed (writing speed) or an operation position (writing position).

[0066] In addition, the motivation to learn may be estimated using the contents of the child's speech in addition to the video. Since the voice acquired by the microphone 27 includes the child's voice, the identification unit 36 ​​can identify the contents of the child's speech.

[0067] For example, if a machine learning model for estimating motivation to learn is constructed to input the child's utterances in addition to the feature amount based on the video, the estimation unit 35 can estimate the motivation to learn using the child's utterances in addition to the video. The utterances here are phrases (text data) such as "I'm bored," "I don't understand," and "I solved it."

[0068] [Specific variations of advice] In the rating operations described above, the categories were aggregated using a ratings database to identify advice, however, it is not necessary that a ratings database be used to identify advice.

[0069] For example, in the above evaluation operation, it has been explained that the determination unit 36 ​​performs speaker identification processing on the voice in the above-mentioned predetermined period and converts the voice identified as the voice of an adult into text. Instead of such processing, the determination unit 36 ​​may determine voice features from the voice identified as the voice of an adult. The voice features are voice features for identifying the nuances of the utterance content, such as tone (volume), intonation, or speaking speed.

[0070] In this case, the evaluation unit 37 inputs the identified voice feature into a machine learning model to determine the category of the utterance content. This machine learning model is constructed using data in which the voice feature is associated with a category for classifying the utterance content having the voice feature (such as data in FIG. 6 in which a predetermined phrase is replaced with the voice feature) as learning data, and is stored in advance in the storage unit 33. For example, when the voice feature is input, the machine learning model outputs a category.

[0071] The evaluation unit 37 can specify advice associated with a category (category determined by voice features) output from the machine learning model by referring to the advice database. That is, the evaluation unit 37 can specify advice without using an evaluation database. Note that, in specifying advice, it is sufficient to specify advice associated with at least one category determined based on voice features, and two or more types of advice associated with two or more categories may be specified.

[0072] [Other variations] In the above evaluation operation, the processing performed by referring to a database such as the evaluation database or advice database may be performed using a machine learning model that has learned the contents of the database.

[0073] Furthermore, the evaluation system 10 can evaluate the utterances of the supporter in a situation where the subject is studying together with the supporter, and the subject is not limited to a child. The subject may be an adolescent or an adult. The supporter is typically a guardian, but may also be the subject's sibling, teacher, or superior.

[0074] In addition, it is not essential that the information terminal 20 is used for learning. The evaluation system 10 can also evaluate the content of the supporter's remarks from video and audio when the subject is learning together with the supporter without using the information terminal 20.

[0075] [Effects, etc.] Inventions derived from the disclosure of this specification are, for example, the following inventions. Hereinafter, the inventions derived from the disclosure of this specification will be described together with the effects and the like obtained by the inventions.

[0076] Invention 1 is an evaluation system 10 comprising an estimation unit 35 that estimates the learning motivation of a subject who is studying with a supporter based on at least a video image of the subject, an identification unit 36 ​​that identifies the content of comments made by the supporter during a specified period of time based on audio during the specified period of time including the time when the estimated learning motivation changed, and an evaluation unit 37 that evaluates the identified content of comments and outputs an evaluation result.

[0077] Such an evaluation system 10 can improve the effectiveness of the subject's learning by evaluating the content of comments made by the supporter that are related to changes in the subject's motivation to learn and outputting (feeding back) the evaluation results.

[0078] Invention 2 is the evaluation system 10 of Invention 1, which further includes an evaluation database in which predetermined phrases are associated with one or more categories for classifying the predetermined phrases, and a memory unit 33 in which an advice database in which categories are associated with advice is stored, and when the evaluation unit 37 determines that the comment content contains a predetermined phrase, it refers to the evaluation database to tally up one or more categories associated with the predetermined phrase, and refers to the advice database to identify advice associated with at least one category determined based on the tallying results, and outputs the identified advice as the evaluation result.

[0079] Such an evaluation system 10 can improve the effectiveness of the subject's learning by outputting advice corresponding to phrases contained in the content of the supporter's remarks.

[0080] Invention 3 is the evaluation system 10 of Invention 1, in which the identification unit 36 ​​identifies the voice features in the utterance as the utterance content, the evaluation system 10 includes a memory unit 33 in which an advice database in which categories and advice are associated is stored, and the evaluation unit 37 refers to the advice database to identify advice associated with at least one category determined based on the identified voice features, and outputs the identified advice as the evaluation result.

[0081] The evaluation system 10 described above can improve the effectiveness of the learning of the subject by outputting advice according to the voice feature obtained from the content of the supporter's speech.

[0082] Invention 4 is the evaluation system 10 of Invention 1 or 2, further comprising a memory unit 33 in which an evaluation database in which a predetermined phrase is associated with an evaluation value is stored, and when the evaluation unit 37 determines that the content of a comment contains a predetermined phrase, it identifies the evaluation value associated with the predetermined phrase by referring to the evaluation database and outputs the identified evaluation value as the evaluation result.

[0083] The evaluation system 10 as described above can improve the effectiveness of the subject's learning by outputting an evaluation value according to a phrase included in the content of the supporter's statement.

[0084] Invention 5 is an evaluation system 10 of any of Inventions 1 to 4, in which the estimation unit 35 estimates the learning motivation of a subject who is engaged in learning using an information terminal 20 together with a supporter based on video and an operation log to the information terminal 20.

[0085] Such an evaluation system 10 can estimate the subject's motivation to learn based on the subject's appearance and the subject's operations.

[0086] Invention 6 is the evaluation system 10 of any one of Inventions 1 to 5, further comprising a camera 26 for capturing video and a microphone 27 for acquiring audio.

[0087] Such an evaluation system 10 can evaluate the content of the supporter's remarks based on the video captured by the camera 26 and the audio captured by the microphone 27.

[0088] Invention 7 is the evaluation system 10 of any one of Inventions 1 to 6, in which the subject is a child and the supporter is the guardian of the child.

[0089] Such an evaluation system 10 can improve the effectiveness of children's learning by evaluating the content of comments made by parents that relate to changes in the children's motivation to learn and outputting the evaluation results.

[0090] Invention 8 is an evaluation method executed by a computer such as the evaluation system 10, and includes an estimation step S21 of estimating the learning motivation of a subject who is studying with a supporter based on at least an image showing the subject, an identification step S23 of identifying the content of the supporter's remarks during a specified period based on audio during a specified period including a time when the estimated learning motivation changed, and evaluation steps S24 and S29 of evaluating the identified content of the remarks and outputting an evaluation result.

[0091] This type of evaluation method can improve the effectiveness of the subject's learning by evaluating the supporter's comments that relate to changes in the subject's motivation to learn and outputting the evaluation results.

[0092] Invention 9 is a program for causing a computer to execute the evaluation method of Invention 8.

[0093] According to such a program, the computer can evaluate the content of comments made by the supporter that are related to changes in the target person's motivation to learn, and output the evaluation results, thereby improving the effectiveness of the target person's learning.

[0094] (Other embodiments) Although the embodiment has been described above, the present invention is not limited to the above embodiment.

[0095] For example, in the above embodiment, the evaluation system is realized by a plurality of devices, but it may be realized as a single device. For example, the evaluation system may be realized as a single device corresponding to an information terminal, or as a single device corresponding to a server device. When the evaluation system is realized by a plurality of devices, the components of the evaluation system may be distributed in any manner among the plurality of devices.

[0096] Furthermore, the method of communication between the devices in the above-described embodiment is not particularly limited. In addition, a relay device (not shown) may be involved in the communication between the devices.

[0097] In addition, in the above embodiment, the process executed by a specific processing unit may be executed by another processing unit. For example, in the above embodiment, a part or all of the process executed by the server device may be executed by an information terminal. In addition, the order of multiple processes may be changed, or multiple processes may be executed in parallel.

[0098] In the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0099] Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit, or a dedicated circuit.

[0100] Furthermore, the general or specific aspects of the present invention may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0101] For example, the present invention may be realized as an evaluation method executed by a computer such as an evaluation system, or as a program for causing a computer to execute such an evaluation method. The present invention may also be realized as an application program for causing a general-purpose computer to operate as the information terminal of the above-described embodiment. The present invention may also be realized as a computer-readable non-transitory recording medium on which such a program is recorded.

[0102] In addition, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art may think of, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of the present invention. [Explanation of symbols]

[0103] 10 Rating System 20 Information terminal 21 Operation reception section 22 Display section 23, 32 Information Processing Section 24, 33 Storage section 25, 31 Communications Department 26 Camera 27 Microphone 30 Server device 34 Acquisition Department 35 Estimation part 36 Specific part 37 Evaluation Section

Claims

1. An estimation unit that estimates a learning motivation of a subject who is studying together with a supporter based on at least a video in which the subject is shown; An identification unit that identifies the content of the statement of the supporter during a predetermined period of time based on the voice during the predetermined period of time including the timing when the estimated learning motivation changed; and an evaluation unit that evaluates the identified comment content and outputs an evaluation result. Rating system.

2. The system further includes a storage unit in which an evaluation database in which predetermined phrases are associated with one or more categories for classifying the predetermined phrases, and an advice database in which categories are associated with advice, are stored, The evaluation unit is When it is determined that the predetermined phrase is included in the comment content, the one or more categories associated with the predetermined phrase are tallied by referring to the evaluation database; and By referring to the advice database, an advice corresponding to at least one category determined based on the result of the compilation is identified; The specified advice is output as the evaluation result. The evaluation system according to claim 1 .

3. The identification unit identifies a speech feature during a speech as the speech content, the evaluation system includes a storage unit in which an advice database in which categories and advice are associated with each other is stored; the evaluation unit refers to the advice database to identify advice associated with at least one category determined based on the identified voice feature; The specified advice is output as the evaluation result. The evaluation system according to claim 1 .

4. The apparatus further includes a storage unit in which an evaluation database in which predetermined phrases and evaluation values ​​are associated with each other is stored, The evaluation unit is When it is determined that the predetermined phrase is included in the content of the comment, an evaluation value associated with the predetermined phrase is identified by referring to the evaluation database; The identified evaluation value is output as the evaluation result. The evaluation system according to claim 1 .

5. The estimation unit estimates a learning motivation of the subject who is engaged in learning using an information terminal together with the supporter, based on the video and an operation log to the information terminal. The evaluation system according to any one of claims 1 to 4.

6. moreover, A camera that captures the video; A microphone for acquiring the voice. The evaluation system according to any one of claims 1 to 4.

7. the subject is a child, The supporter is a guardian of the child. The evaluation system according to any one of claims 1 to 4.

8. 1. A computer-implemented evaluation method comprising: An estimation step of estimating a learning motivation of a subject who is engaged in learning together with a supporter based on at least a video in which the subject is shown; A step of identifying the content of the utterance of the supporter during a predetermined period of time, based on the voice during the predetermined period of time including the timing at which the estimated learning motivation changed; and an evaluation step of evaluating the identified comment content and outputting an evaluation result. Evaluation method.

9. A program for causing a computer to execute the evaluation method according to claim 8.

Images