Information feedback device, information feedback method and information feedback program

Abstract

To provide feedback information based on time-series data showing a psychological state of a learner.SOLUTION: An information feedback device includes: a storage part configured to store time-series data showing a psychological state of a learner, the time-series data in a prescribed time unit; a collection part configured to collect data for items related to a learning action of the learner, corresponding to the time-series data; a calculation part configured to calculate a time length to which the time-series data showing the psychological state of the learner belong to each level; a tabulation part configured to tabulate a time length belonging to each level, with regard to time-series data in which each piece of data of an item designated from respective items related to the learning action of the learner is equivalent; and a display part configured to display a calculation result or a tabulation result.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to an information feedback device, an information feedback method, and an information feedback program. [Background technology]

[0002] A device has been proposed that acquires biometric information of students during classes at various educational institutions such as cram schools and analyzes their psychological state. This device can appropriately determine the psychological state of students during classes. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2018-41049 Summary of the Invention [Problem to be solved by the invention]

[0004] On the other hand, it is desirable that time-series data showing the learner's psychological state be provided as useful feedback information that can lead to improvements in educational services and learning efficiency.

[0005] The present disclosure aims to provide feedback information based on time-series data indicating the psychological state of a learner. [Means for solving the problem]

[0006] According to one aspect, the information feedback device comprises: a storage unit for storing time series data indicating the psychological state of a learner in a predetermined time unit; a collection unit that collects data on each item related to the learner's learning behavior corresponding to the time-series data; a calculation unit that calculates the length of time that the time-series data indicating the mental state of the learner belongs to for each level; a counting unit that counts the time lengths belonging to each level for time-series data in which data of items designated from among the items related to the learning behavior of the learner are equal to each other; and a display unit for displaying the calculation results or the counting results. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide feedback information based on time-series data indicating the psychological state of a learner. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of an educational institution to which an information feedback device is applied. [Figure 2] FIG. 10 is a diagram showing an example of time-series data relating to the psychological state of a learner, acquired by the information feedback device. [Figure 3] FIG. 1 is a diagram illustrating an example of a system configuration of a system including an information feedback device. [Figure 4A] FIG. 10 is a diagram showing a specific example of collected data. [Figure 4B] FIG. 10 is a diagram showing a specific example of feedback information. [Figure 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information feedback device. [Figure 6] FIG. 1 is a first diagram illustrating an example of a functional configuration of an information feedback device. [Figure 7A] 1 is a first diagram showing an example of a processing result generated by calculating and aggregating the length of time belonging to each level for time-series data indicating the psychological state of one learner. FIG. [Figure 7B] FIG. 2 is a second diagram showing an example of a processing result generated by calculating and aggregating the length of time belonging to each level for the time-series data indicating the psychological state of the learner in 1. [Figure 8A] FIG. 11 is a first diagram showing an example of a display screen that displays feedback information (for learners). [Figure 8B]FIG. 2 is a second diagram showing an example of a display screen that displays feedback information (for learners). [Figure 9] FIG. 3 is a third diagram showing an example of a display screen that displays feedback information (for learners). [Figure 10A] FIG. 4 is a fourth diagram showing an example of a display screen that displays feedback information (for learners). [Figure 10B] FIG. 5 is a fifth diagram showing an example of a display screen that displays feedback information (for learners). [Figure 11A] 1 is a first flowchart showing the flow of information collection and generation processing. [Figure 11B] 10 is a second flowchart showing the flow of information collection and generation processing. [Figure 12A] 10 is a first flowchart showing the flow of information feedback processing. [Figure 12B] 10 is a flowchart showing the flow of a graph display process. [Figure 12C] 10 is a second flowchart showing the flow of the information feedback process. [Figure 13] FIG. 2 is a second diagram illustrating an example of the functional configuration of the information feedback device. [Figure 14] FIG. 10 is a diagram showing an example of processing results generated by calculating and aggregating the length of time belonging to each level for time series data indicating the psychological states of learners who attended a class taught by instructor No. 1. [Figure 15] FIG. 10 is a diagram showing an example of performance data. [Figure 16] FIG. 10 is a diagram showing an example of a display screen that displays feedback information (for instructors). [Figure 17] 10 is a flowchart showing the flow of information collection processing. [Figure 18] 10 is a third flowchart showing the flow of information feedback processing. [Figure 19A] FIG. 11 is a first diagram showing an example of another display screen. [Figure 19B] FIG. 2 is a second diagram showing an example of another display screen. [Figure 20A]FIG. 10 is a third diagram showing an example of another display screen. [Figure 20B] FIG. 4 is a fourth diagram showing an example of another display screen. [Figure 21] FIG. 5 is a fifth diagram showing an example of another display screen. [Figure 22] FIG. 6 is a sixth diagram showing an example of another display screen. [Figure 23] FIG. 7 is a seventh diagram showing an example of another display screen. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, each embodiment will be described with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0010] [First embodiment] <Application example of information feedback device> First, a description will be given of an example of an educational institution to which an information feedback device according to the first embodiment is applied. Fig. 1 is a diagram showing an example of an educational institution to which an information feedback device is applied.

[0011] As shown in Fig. 1, the information feedback device is applied to, for example, a large-scale cram school. A large-scale cram school refers to a cram school that has school buildings in multiple areas, with multiple classrooms in each school building.

[0012] The example in Figure 1 shows one school building (school building 110) in a given area. School building 110 has ten classrooms, and in classroom 120, for example, a lesson is being taught by instructor 121 to a number of learners 122_1, 122_2, ... using a given textbook.

[0013] 1, a supervisor 131 who manages the entire school building 110 is present in a teacher's room 130 in the school building 110. The supervisor 131 takes various measures to improve the educational services provided in the school building 110 and to improve the academic ability and learning efficiency of the learners studying in the school building 110. In this embodiment, the supervisor 131 and the class instructor 121 are collectively referred to as instructors.

[0014] As shown in FIG. 1, at the entrance 140 of the school building 110, for example, parents of the learners studying at the school building 110 are waiting to pick up or drop off the learners.

[0015] The information feedback device acquires time-series data relating to the psychological state of each learner during a lesson or test, for a predetermined time unit (for each lesson or test for each subject). The information feedback device also processes the acquired time-series data for each lesson or test for each subject, and generates feedback information useful for efforts to improve educational services and learners' learning efficiency based on the processing results. The information feedback device also provides the generated feedback information to learners, parents, or instructors.

[0016] In the first embodiment, the information feedback device is described as being applied to a large cram school, but the educational institution to which the information feedback device is applied is not limited to a large cram school, and may also be a small cram school.

[0017] In the first embodiment, the teaching style of the educational institution to which the information feedback device is applied is described as a group teaching style in which multiple learners receive lessons from one teacher, but the teaching style is not limited to a group teaching style and may be an individual teaching style, or may be a self-study style instead of a class style.

[0018] In addition, in the first embodiment, we will explain the case where the teaching method of the educational institution to which the information feedback device is applied is mainly a face-to-face teaching method, but the teaching method is not limited to face-to-face teaching and may be, for example, a teaching method using online video distribution, etc.

[0019] <Data acquired by the information feedback device> Next, an example of time-series data relating to the psychological state of a learner acquired by the information feedback device in an educational institution to which the information feedback device is applied will be described. Figure 2 is a diagram showing an example of time-series data relating to the psychological state of a learner acquired by the information feedback device.

[0020] The example in Fig. 2 shows how facial image data and vital data are acquired as time-series data relating to the psychological state of a learner 122_1 during class. The method of acquiring facial image data is arbitrary, and for example, the facial image data may be acquired by photographing the learner 122_1 with an imaging device attached to a learning terminal (not shown) operated by the learner 122_1 during class. Alternatively, the facial image data may be acquired by photographing the learner 122_1 with an imaging device attached to a classroom where the learner 122_1 takes class.

[0021] Furthermore, the method of acquiring the vital data is arbitrary, and for example, the vital data may be acquired by measuring with a wearable device (not shown) worn by the learner 122_1 during class. Alternatively, the vital data may be acquired without contacting the learner 122_1 by electromagnetic waves, sound waves, etc. The acquired vital data may include, for example, pulse, blood pressure, respiration, body temperature, etc.

[0022] The information feedback device generates time-series data indicating the psychological state of the learner 122_1 based on the acquired facial image data and vital data. The psychological state of the learner 122_1 includes emotions such as joy, anger, sadness, and pleasure, concentration / distraction, emotion classification based on the Russell Circle model, emotion classification based on the Plutchik theory, emotion, stress, tension, fatigue, arousal, drowsiness, relaxation, and excitement. The example of FIG. 2 shows that the generated time-series data is two-dimensional data defined based on an axis indicating concentration and distraction and an axis indicating tension and relaxation. However, the time-series data indicating the psychological state of the learner 122_1 generated by the information feedback device is not limited to the two-dimensional data and may be two-dimensional data defined based on axes different from those shown in FIG. 2. Alternatively, the time-series data indicating the psychological state of the learner 122_1 generated by the information feedback device is not limited to two-dimensional data and may be one-dimensional data or multidimensional data of three or more dimensions.

[0023] However, regardless of the dimensional data, in the following, when a learner is in a different psychological state, it is expressed as the time-series data indicating the learner's psychological state being at a different level, or the time-series data indicating the learner's psychological state being at a different level. In this case, one psychological state of the learner is expressed, for example, as the time-series data indicating the psychological state being at a high level, and the other psychological state is expressed, for example, as the time-series data indicating the psychological state being at a low level.

[0024] Furthermore, time-series data showing the same psychological state of a learner may be subdivided, and each time-series data may be expressed as time-series data of a different level. For example, even if the time-series data showing the psychological state of a learner are time-series data showing basic emotions and the learner's psychological state is the same "sad," one time-series data may be expressed as "Sad High" and the other time-series data may be expressed as "Sad Low."

[0025] The method of expressing the subdivided levels is arbitrary, and it is also possible to display only the word "Sad" and express "High" and "Low" by varying the color density of the text, whether it blinks, changing the font size, etc. In other words, the subdivided levels may be expressed by changing the display mode.

[0026] <System configuration of a system including an information feedback device> Next, a system configuration of a system including an information feedback device will be described below. Fig. 3 is a diagram showing an example of the system configuration of a system including an information feedback device.

[0027] 3, system 300 including information feedback device 310 has, in addition to information feedback device 310, school building I server device 320, school building I parent terminal 330, etc. In system 300, information feedback device 310, school building I server device 320, school building I parent terminal 330, etc. are communicably connected via network 340.

[0028] The school building I server device 320 is, for example, a server device owned by the school building 110 (school building name: school building I). The school building I server device 320 transmits collected data collected for one lesson (referred to as "collected data (lesson)") and collected data collected for one subject's test (referred to as "collected data (test)") to the information feedback device 310.

[0029] In addition, the school building I server device 320 receives feedback information (for instructors) transmitted from the information feedback device 310 in response to transmitting the collected data to the information feedback device 310. As a result, the instructor of the school building 110 having the school building I server device 320 can perform the following based on the feedback information (for instructors): -Improvement of educational services provided at School Building 110; -Improvement of learning efficiency of students studying in School Building 110 Various initiatives can be undertaken to achieve this.

[0030] The collected data (lessons) sent by the school building I server device 320 to the information feedback device 310 includes, for example, -Data on each item related to the learner's lessons, covering the time range of one lesson (predetermined time unit); Time series data related to the psychological state of learners, covering the time range of one lesson (predetermined time unit); Video data of lessons, The video data of a lesson referred to here may be video data when the teaching method is online video distribution, or video data of the instructor during the lesson when the teaching method is face-to-face.

[0031] In addition, the collected data (test) transmitted by the school building I server device 320 to the information feedback device 310 includes, for example, -Data on each item related to the learner's test, including the time range (predetermined time unit) of the test for one subject; Time series data related to the learner's psychological state, which is time series data for the test time range (predetermined time unit) for one subject; Includes:

[0032] The school building I server device 320 transmits the collected data (lessons) to the information feedback device 310 each time a corresponding lesson ends or after a predetermined time or number of days has passed. Similarly, the school building I server device 320 transmits the collected data (tests) to the information feedback device 310 each time a test for one corresponding subject ends or after a predetermined time or number of days has passed.

[0033] The information feedback device 310 receives collected data (lessons) and collected data (tests) transmitted from server devices in multiple school buildings, including the school building I server device 320.

[0034] In the first embodiment, data on each item related to the learner's lessons and data on each item related to the learner's tests are collectively referred to as "data on each item related to the learner's learning behavior."

[0035] Furthermore, the information feedback device 310 generates time series data indicating the learner's psychological state from the time series data relating to the learner's psychological state contained in the received collected data (lesson) and collected data (test). Next, the information feedback device 310 converts the generated time series data indicating the learner's psychological state into -Data on each item related to the learner's learning behavior, Video data of lessons, and store it in correspondence with

[0036] Furthermore, the information feedback device 310 generates feedback information (for the learner) or feedback information (for the instructor) based on the time-series data indicating the psychological state of the learner and the data for each item.

[0037] Furthermore, the information feedback device 310 transmits feedback information (for the instructor) to the school building I server device 320 and the like, and transmits feedback information (for the learner) to the school building I parent terminal 330 and the like.

[0038] The school building I parent terminal 330 is, for example, a terminal owned by a parent of a learner studying at the school building 110 (school building name: school building I). The school building I parent terminal 330 receives feedback information (for the learner) from the information feedback device 310. As a result, the parent who owns the school building I parent terminal 330 can, based on the feedback information (for the learner), -Improvement of learning efficiency of students studying in School Building 110 Various initiatives can be undertaken to achieve this.

[0039] <Examples of collected data and feedback information> Next, specific examples of collected data (lesson) and collected data (test) received by the information feedback device 310, and specific examples of feedback information (for learners) and feedback information (for instructors) transmitted by the information feedback device 310 will be described.

[0040] (1) Specific examples of collected data FIG. 4A is a diagram showing a specific example of collected data.

[0041] (1-1) Collected data (classes) As shown in Figure 4A, the "data related to learners' lessons" in the collected data (lessons) includes: Learner's "Student number", "Name", "Age", "Gender", "Temperament", The "class", "school building" and "classroom" in which the learner took the class; -The "subject" and "unit" of the class that the learner took, - The "day of the week" and "start and end times" of the lesson taken by the student, -The "teacher" of the class that the learner took, - The type of textbook used in the class the learner took, - The "class format" of the class the learner took, The data for each item of "data relating to the learner's lesson" is automatically received by the information feedback device 310 from, for example, the school server device 320 every time one lesson ends.

[0042] The "class format" mentioned here refers to, for example, - Individual lessons or group lessons? - Will the lessons be delivered via video or face-to-face? In the case of video lessons, are they real-time lessons or lessons that are recorded and played back? Classes or self-study? The data is set in advance before the lesson and specifies the above.

[0043] In addition, as shown in Figure 4A, the "time series data related to the learners' psychological state" of the collected data (classes) includes the following: - "Facial image data" of the learner during class, - The learner's "vital data" during the lesson, The time series data for each item of "time series data related to the psychological state of the learner" is automatically received by the information feedback device 310 from, for example, the school building server device 320 after each lesson (i.e., for each lesson).

[0044] 4A, the "video data of a lesson" in the collected data (lesson) includes video data for one lesson distributed online (or video data of the teacher during a face-to-face lesson). The video data for one lesson is automatically received by the information feedback device 310 from, for example, the school building server device 320 after each lesson.

[0045] (1-2) Collected data (test) As shown in Figure 4A, the collected data (tests) includes the following: Learner's "Student number", "Name", "Age", "Gender", "Temperament", The "class", "school building" or "classroom" where the learner took the test for the subject, - The subject of the test taken by the learner; - The "day of the week", "start and end times" on which the learner took the test for the subject, - "Test name" of the test for the subject taken by the learner, The data for each item of "data related to learner's test" is automatically received by the information feedback device 310 from, for example, the school server device 320 every time a test for one subject is completed.

[0046] In addition, as shown in Figure 4A, the "time series data related to the learner's psychological state" of the collected data (test) includes the following: - "Facial image data" of the learner during the test of the subject, - "Vital data" of the learner during the test in the subject; The data for each item of the "time-series data related to the psychological state of the learner" is automatically received by the information feedback device 310, for example, from the school building server device 320, each time a test for one subject is completed (i.e., for each test for one subject).

[0047] (2) Examples of feedback information FIG. 4B is a diagram showing a specific example of feedback information.

[0048] (2-1) Feedback information (for learners) As shown in Figure 4B, the feedback information (for learners) includes, e.g. - The results of aggregating the length of time belonging to each level of time-series data showing the learner's psychological state for each learner and subject of class. - The results of aggregating the length of time belonging to each level of time-series data showing the learner's psychological state for each learner and teacher. The calculation results of the length of time belonging to each level for time series data showing the learner's psychological state, for each learner and for each lesson, -Time series data showing the psychological state of each student in each lesson; Video data of lessons corresponding to time-series data showing the psychological state of each learner in each lesson, - The results of aggregating the length of time belonging to each level of time-series data showing the learner's psychological state for each learner and test subject. The calculation results of the length of time belonging to each level for time series data showing the learner's psychological state, calculated for each learner and test unit, Time series data showing each learner's psychological state during each test, The above feedback information (for learners) is merely an example. For example, feedback information (for learners) can be created arbitrarily depending on which item of collected data (lessons) or collected data (tests) is focused on, or on how time-series data indicating the learner's psychological state is processed.

[0049] (2-2) Feedback information (for instructors) As shown in Figure 4B, the feedback information (for instructors) includes, for example, - The results of aggregating the length of time belonging to each level of time-series data showing the learner's psychological state for each learner and subject of class. - The results of aggregating the length of time belonging to each level of time-series data showing the learner's psychological state for each learner and teacher. The calculation results of the length of time belonging to each level for time series data showing the learner's psychological state, for each learner and for each lesson, - The results of aggregating the length of time belonging to each level of time-series data showing the learner's psychological state for each learner and test subject. The calculation results of the length of time belonging to each level for time series data showing the learner's psychological state, calculated for each learner and test unit, The above feedback information (for instructors) is merely an example. For example, the feedback information (for instructors) can be created arbitrarily depending on which item of collected data (lessons) or collected data (tests) is focused on, or on how to process the time-series data that indicates the psychological state of the learner.

[0050] <Hardware configuration of the information feedback device> Next, the hardware configuration of the information feedback device 310 according to the first embodiment will be described. Fig. 5 is a diagram showing an example of the hardware configuration of the information feedback device. As shown in Fig. 5, the information feedback device 310 has a processor 501, a memory 502, an auxiliary storage device 503, an I / F (Interface) device 504, a communication device 505, and a drive device 506. The hardware components of the information feedback device 310 are connected to each other via a bus 507.

[0051] The processor 501 has various arithmetic devices such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc. The processor 501 reads various programs (for example, an information feedback program, etc.) into the memory 502 and executes them.

[0052] The memory 502 has a main storage device such as a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The processor 501 and the memory 502 form a so-called computer, and the computer realizes various functions by the processor 501 executing various programs read onto the memory 502.

[0053] The auxiliary storage device 503 stores various programs and various data used when the processor 501 executes the various programs.

[0054] The I / F device 504 accepts operations of an administrator (not shown) on the information feedback device 310 via an operation device 511. The I / F device 504 also outputs results of internal processing by the information feedback device 310 and displays them to the administrator via a display device 512.

[0055] The communication device 505 is a communication device that connects to the network 340 and communicates with the school building I server device 320, the school building I parent terminal 330, and the like.

[0056] The drive device 506 is a device for setting a recording medium 513. The recording medium 513 here includes media that record information optically, electrically, or magnetically, such as a CD-ROM, a flexible disk, a magneto-optical disk, etc. The recording medium 513 may also include semiconductor memories that record information electrically, such as ROMs, flash memories, etc.

[0057] The various programs to be installed in the auxiliary storage device 503 are installed, for example, by setting the distributed recording medium 513 in the drive device 506 and reading the various programs recorded on the recording medium 513 by the drive device 506. Alternatively, the various programs to be installed in the auxiliary storage device 503 may be installed by being downloaded from the network 340 via the communication device 505.

[0058] <Functional configuration of the information feedback device> Next, a description will be given of the functional configuration of the information feedback device 310. Note that, although the following describes a case where feedback information (for a learner) is provided to a learner or the learner's guardian, the same applies to a case where feedback information (for an instructor) is provided to an instructor.

[0059] 6 is a first diagram showing an example of the functional configuration of the information feedback device. As described above, an information feedback program is installed in the information feedback device 310, and by executing this program, the information feedback device 310 performs the following functions as shown in FIG. Data collection unit 601, data generation unit 602, ·Extraction part 603, Level classification unit 604, time length calculation unit 605, aggregation unit 606, video data extraction unit 607, Graph generation unit 608, login unit 609, display unit 610, It functions as:

[0060] The data collection unit 601 receives, for example, collected data (lessons) or collected data (tests) transmitted from the school I server device 320. The data collection unit 601 notifies the data generation unit 602 of the received collected data (lessons) or collected data (tests).

[0061] The data generation unit 602 generates time series data indicating the learner's psychological state based on time series data (facial image data, vital data) related to the learner's psychological state contained in the notified collected data (lesson) or collected data (test).

[0062] The time-series data indicating the mental state of the learner generated by the data generating unit 602 is included in the notified collected data (lesson) or collected data (test). -Data on each item related to the learner's learning behavior, Video data of lessons, are stored in the collected data storage unit 621 in association with the above.

[0063] The extraction unit 603 notifies the level classification unit 604 of the data related to the lesson for each learner and the time-series data indicating the psychological state of each learner, which are stored in the collected data storage unit 621. The extraction unit 603 also notifies the video data extraction unit 607 of the video data of the lesson, which are stored in the collected data storage unit 621.

[0064] The level classification unit 604 classifies the time-series data indicating the psychological state of each learner notified by the extraction unit 603 according to level, and notifies the time length calculation unit 605. Assume that the time-series data indicating the psychological state of the learner notified by the extraction unit 603 is time-series data associated with data related to the learner's class and time-series data associated with video data of the class. In this case, the level classification unit 604 identifies a time range within one class of the time-series data indicating the psychological state of the learner classified into a specific level, and notifies the video data extraction unit 607.

[0065] The time length calculation unit 605 calculates the length of time-series data indicating the psychological states of learners classified into each level. If the time-series data notified by the level classification unit 604 is time-series data associated with data related to the learner's classes, the time length calculation unit 605 calculates the time length belonging to each level for the time-series data on a class-by-class basis. Furthermore, if the time-series data notified by the level classification unit 604 is time-series data associated with data related to the learner's tests, the time length calculation unit 605 calculates the time length belonging to each level for the time-series data on a test-by-test basis for one subject.

[0066] The tallying unit 606 tally up the time lengths belonging to each level calculated by the time length calculation unit 605 for each lesson, for each teacher and for each subject. The tallying unit 606 also tally up the time lengths belonging to each level calculated by the time length calculation unit 605 for each test for one subject, for each subject.

[0067] The tallying unit 606 associates the notified length of time belonging to each level of the lesson unit and the aggregated length of time belonging to each level of the teacher unit and the subject unit with data related to the learner's lessons, and stores the results as processing results in the processing result storage unit 622. Alternatively, the tallying unit 606 associates the notified length of time belonging to each level of the test unit for one subject and the aggregated length of time belonging to each level of the subject unit with data related to the learner's test, and stores the results as processing results in the processing result storage unit 622.

[0068] The video data extraction unit 607 extracts video data from the video data of each lesson that corresponds to the time range notified by the level classification unit 604, and generates digest video data. The video data extraction unit 607 associates the digest video data with data related to the learner's lesson, and stores the processed result in the processing result storage unit 622.

[0069] The login unit 609 receives login information from the learner or the learner's guardian. The login unit 609 authenticates the received login information, and if the authentication is successful, notifies the display unit 610 of the login information.

[0070] When the display unit 610 is notified of the login information by the login unit 609, it displays a default display screen. The display unit 610 also accepts input of item data (any of the data for each item related to the learner's learning behavior) from the logged-in user (either the learner or the learner's guardian). Upon accepting the input of item data, the display unit 610 acquires the processing result corresponding to the accepted input item data from the processing result storage unit 622. Note that the display unit 610 may acquire the processing result corresponding to the accepted input item data via the graph generation unit 608.

[0071] Furthermore, display unit 610 generates feedback information (for the learner) based on the acquired processing results. When display unit 610 receives an instruction to display the digest video data, it transmits the digest video data to the user (learner) who issued the instruction, and charges the user (learner's parent) who issued the instruction.

[0072] The graph generating unit 608 generates a graph based on the processing results corresponding to the item data input by the display unit 610, and notifies the display unit 610 of the generated graph.

[0073] <Examples of processing results and feedback information screens> Next, a specific example of a processing result generated by calculation and aggregation by the information feedback device 310 and a specific example of a display screen that displays feedback information (for learners) generated based on the processing result will be described.

[0074] (1) Processing results for learner 1 (lesson, test) 7A is a first diagram showing an example of a processing result generated by calculating and aggregating the duration of time belonging to each level for time-series data showing the psychological state of one learner. Processing result 700 in FIG. 7A shows how the duration of time belonging to each level is calculated for each lesson and aggregated for each teacher and each subject for time-series data showing the psychological state of one learner in each lesson of the subject "Japanese."

[0075] Of these, reference numeral 701 represents time series data showing the psychological state of learner 1 in Japanese language classes, which is classified into three levels, from level A to level C, and the length of time belonging to each level is calculated for each class.

[0076] Reference numeral 702 represents time series data showing the psychological state of learner 1 in Japanese language class, which is classified into three levels, from level A to level C, and the length of time belonging to each level is tallied by teacher.

[0077] Reference numeral 703 indicates time series data showing the psychological state of learner 1 in Japanese language class, which is classified into three levels, A to C, and the length of time belonging to each level is tallied by subject.

[0078] 7A shows the processing result for the case where subject="Japanese", but it is assumed that similar processing results for other subjects are stored in the processing result storage unit 622. Also, in the example of Fig. 7A, the processing result for one learner is shown, but it is assumed that similar processing results for other learners are stored in the processing result storage unit 622.

[0079] 7B is a second diagram showing an example of a processing result generated by calculating and aggregating the duration of time belonging to each level for time-series data relating to the psychological state of one learner. Processing result 710 in FIG. 7B shows how the duration of time belonging to each level is calculated for each test and aggregated for each subject for time-series data indicating the psychological state of one learner in each test in the subject "Japanese."

[0080] Of these, reference numeral 711 represents time series data showing the psychological state of learner 1 during a Japanese language test, which is classified into three levels, from level A to level C, and the length of time belonging to each level is calculated on a test-by-test basis.

[0081] Reference numeral 712 represents time series data showing the psychological state of learner 1 during a Japanese language test, which is classified into three levels, from level A to level C, and the length of time belonging to each level is tallied by subject.

[0082] 7B shows the processing result for the case where subject="Japanese", but it is assumed that similar processing results for other subjects are stored in the processing result storage unit 622. Also, in the example of FIG. 7B, the processing result for one learner is shown, but it is assumed that similar processing results for other learners are stored in the processing result storage unit 622.

[0083] (2) A display screen (for lessons, tests) that displays feedback information (for learners) generated based on the processing results. Next, a specific example of a display screen that displays feedback information (for learners) generated based on the processing results will be described.

[0084] 8A is a first diagram showing an example of a display screen for displaying feedback information (for learners). As shown in FIG. 8A, display screen 800 includes information items such as "student number," "name," "subject," "day of the week," "start and end times," and "teacher."

[0085] The "Student Number" and "Name" fields will automatically display the student number and name entered by the student or the student's guardian when logging in.

[0086] The subject designated by the learner or the learner's guardian is displayed in "Subject." The example in Figure 8A shows that "Japanese" has been designated.

[0087] The "day of the week" and "start and end time" fields are used to input the day of the week on which the lesson took place, and the start and end times of the lesson. The "day of the week" and "start and end time" fields are used when the learner or the learner's guardian specifies a specific lesson.

[0088] The "instructor" will be the instructor designated by the learner or their guardian. If the learner or their guardian enters the "subject," "day of the week," and "start and end times," the "instructor" will be automatically entered.

[0089] As shown on the display screen 800, when only the subject is specified, the information feedback device 310 displays a graph of the results of tallying the time lengths belonging to each level for time series data showing the psychological state of one learner throughout all of his / her Japanese language classes.

[0090] On display screen 800, graph 801 shows the proportion of time duration classified into levels A (high), B (medium), and C (low) for concentration, while graph 802 shows the proportion of time duration classified into levels B (neutral), A (happy), and C (sad) for emotions.

[0091] 8B is a second diagram showing an example of a display screen for displaying feedback information (for learners). As shown in FIG. 8B, display screen 810 includes information items such as "Student ID," "Name," "Subject," "Day of the week," "Start and end times," and "Test name."

[0092] The "Student Number" and "Name" fields will automatically display the student number and name entered by the student or the student's guardian when logging in.

[0093] The subject designated by the learner or the learner's guardian is displayed in "Subject." The example in Figure 8B shows that "Japanese" has been designated.

[0094] The "Day of the week" and "Start and End times" are used to enter the day of the week on which the test was taken, the time the test started, and the time the test ended. The "Day of the week" and "Start and End times" are used when the learner or the learner's guardian specifies a specific test.

[0095] "Test Name" displays the test name specified by the learner or the learner's guardian. If the learner or the learner's guardian enters the "Subject", "Day of the week", and "Start and End times", the "Test Name" will be automatically entered.

[0096] As shown on the display screen 810, when only the subject is specified, the information feedback device 310 displays a graph of the results of tallying the time lengths belonging to each level for time series data showing the psychological state of one learner in all Japanese language tests.

[0097] On display screen 810, graph 811 shows the proportion of time durations classified into levels A (high), B (medium), and C (low) for concentration, while graph 802 shows the proportion of time durations classified into levels B (neutral), A (happy), and C (sad) for emotions.

[0098] 9 is a second diagram showing an example of a display screen displaying feedback information (for learners). Display screen 900 shows a state in which a subject and a teacher are specified. Information feedback device 310 displays a graph of the results of tallying the time lengths belonging to each level for time-series data showing the psychological state of one learner when attending each Japanese language class taught by teacher = "Teacher α."

[0099] On the display screen 900, a graph 901 shows the proportion of time lengths classified into levels A (high), B (medium), and C (low) for concentration, while a graph 902 shows the proportion of time lengths classified into levels B (neutral), A (happy), and C (sad) for emotions.

[0100] 10A is a fourth diagram showing an example of a display screen for displaying feedback information (for learners). As shown in display screen 1000, when the subject, day of the week, start time, and end time are specified, the instructor for the lesson is automatically displayed.

[0101] The information feedback device 310 allows one learner to: · Day of the week = "Tuesday, January 23rd", Start and end times = "18:00~19:00", ·Teacher = "Teacher α", The time length belonging to each level is calculated for time series data showing the psychological state of the learner when he / she took the Japanese language class, and the results are displayed in a graph.

[0102] On the display screen 1000, a graph 1001 shows the proportion of time durations classified into levels A (high), B (medium), and C (low) for concentration, while a graph 1002 shows the proportion of time durations classified into levels B (neutral), A (happy), and C (sad) for emotions.

[0103] Also, on the display screen 1000, the symbol 1010 shows time series data indicating the psychological state of the learner when he / she took a Japanese language class taught by "Teacher Alpha" on the day of the week = "Tuesday, January 23rd", with start and end times = "18:00-19:00".

[0104] Furthermore, on the display screen 1000, reference numerals 1011 to 1015 denote time ranges of time-series data indicating the psychological state of a learner that satisfy a predetermined condition and are associated with digest video data. The time ranges of reference numerals 1011 to 1015 are time ranges that fall within the top 5% of concentration level values ​​in the time-series data indicating the psychological state of a learner, when the concentration level values ​​are normalized with the maximum concentration level set to 100% and the minimum concentration level set to 0%. However, the time range of time-series data that satisfies the predetermined condition is not limited to this. For example, if the concentration level time-series data indicating the psychological state of a learner has multiple peaks, as shown by reference numeral 1010, the top three values ​​at the apex of each peak are extracted. The time range of the time-series data that satisfies the predetermined condition may be a time range of several seconds before and after the three peaks. The several seconds before and after the peak may be, for example, 5 seconds before and after the peak, totaling 10 seconds. Alternatively, a time range with a low concentration level may be extracted, or a time range in which the emotional level, rather than the concentration level, satisfies a similar condition may be determined as the time range of time-series data that satisfies the predetermined condition.Furthermore, a time range in which the concentration level or a specific level of emotionality continues for a predetermined period of time or longer may be determined as the time range of time-series data that satisfies the predetermined condition.

[0105] The example of the display screen 1000 shows that a time range indicated by reference numeral 1015 has been specified, and digest video data 1020 corresponding to that time range is being played back.

[0106] FIG. 10B is a fifth diagram showing an example of a display screen for displaying feedback information (for learners). Display screen 1030 shows a state in which a subject, a day of the week, a start time, and an end time are specified. As shown in FIG. 10B, information feedback device 310 allows one learner to · Day of the week = "Tuesday, March 5th", Start and end times = "9:00~9:45", The time length belonging to each level is calculated for time series data showing the psychological state of the learner when he / she took the Japanese language test, and the results are displayed in a graph.

[0107] On display screen 1030, graph 1031 shows the proportion of time duration classified into levels A (high), B (medium), and C (low) for concentration, while graph 1032 shows the proportion of time duration classified into levels B (neutral), A (happy), and C (sad) for emotions.

[0108] Also, on the display screen 1030, the reference numeral 1040 shows time series data indicating the psychological state of learner 1 when he took the Japanese language test on the day of the week = "Tuesday, March 5th" and the start and end times = "9:00-9:45".

[0109] <Information collection and generation process flow> Next, the flow of the information collection and generation process executed by the information feedback device 310 will be described.

[0110] (1) Collected data (classes) 11A is a first flowchart showing the flow of information collection and generation processing. In step S1101, the information feedback device 310 acquires data related to the mental state of the learner and generates time-series data indicating the mental state of the learner.

[0111] In step S1102, the information feedback device 310 collects data related to the learner's lessons.

[0112] In step S1103, the information feedback device 310 collects video data of the lesson.

[0113] In step S1104, the information feedback device 310 calculates and tallys the time lengths belonging to each level for the time-series data indicating the learner's psychological state. The information feedback device 310 also associates the results of the calculation and tallying with the data related to the learner's lesson, the time-series data indicating the learner's psychological state, and the video data of the lesson, and stores them as processing results.

[0114] In step S1105, the information feedback device 310 determines whether or not to end the information collection and generation process. If it is determined not to end in step S1105 (NO in step S1105), the process returns to step S1101. On the other hand, if it is determined to end in step S1105 (YES in step S1105), the information collection and generation process ends.

[0115] (2) Collected data (test) 11B is a second flowchart showing the flow of the information collection and generation process. In step S1111, the information feedback device 310 acquires data related to the mental state of the learner and generates time-series data indicating the mental state of the learner.

[0116] In step S1112, the information feedback device 310 collects data related to the learner's test.

[0117] In step S1113, the information feedback device 310 calculates and tally the time lengths belonging to each level for the time-series data indicating the learner's psychological state. The information feedback device 310 also stores the calculation and tallying results as processing results, in association with the test data of the learner and the time-series data indicating the learner's psychological state.

[0118] In step S1105, the information feedback device 310 determines whether or not to end the information collection and generation process. If it is determined not to end in step S1105 (NO in step S1105), the process returns to step S1111. On the other hand, if it is determined to end in step S1105 (YES in step S1105), the information collection and generation process ends.

[0119] <Information feedback processing flow (class)> (1) Information feedback process flow Next, a description will be given of the flow of information feedback processing executed by the information feedback device 310 when processing results are generated based on collected data (lessons). Fig. 12A is a first flowchart showing the flow of information feedback processing.

[0120] In step S1201, the information feedback device 310 accepts login information entered by a user (here, a learner or a parent of the learner).

[0121] In step S1202, the information feedback device 310 identifies the learner based on the login information.

[0122] In step S1203, the information feedback device 310 determines whether or not a subject has been specified by the user. If it is determined in step S1203 that a subject has not been specified (NO in step S1203), the process proceeds to step S1212.

[0123] On the other hand, if it is determined in step S1203 that a subject has been designated (YES in step S1203), the process proceeds to step S1204.

[0124] In step S1204, the information feedback device 310 determines whether or not a teacher has been designated by the user. If it is determined in step S1204 that a teacher has not been designated (NO in step S1204), the process proceeds to step S1205.

[0125] In step S1205, the information feedback device 310 reads out the subject-by-subject tabulation results for the specified learner for the designated subject from the processing results.

[0126] In step S1206, the information feedback device 310 generates a graph based on the read-out counting results, displays the generated graph, and then proceeds to step S1212.

[0127] On the other hand, if it is determined in step S1204 that a teacher has been designated (YES in step S1204), the process proceeds to step S1207.

[0128] In step S1207, the information feedback device 310 determines whether a class for a specific date and time has been specified. If it is determined in step S1207 that a class for a specific date and time has not been specified (NO in step S1207), the process proceeds to step S1208.

[0129] In step S1208, the information feedback device 310 reads out the results of the processing, ie, the tabulation results for the specified subject of the identified learner and the specified teacher.

[0130] In step S1209, the information feedback device 310 generates a graph based on the read-out counting results, displays the generated graph, and then proceeds to step S1212.

[0131] On the other hand, if it is determined in step S1207 that a class on a specific date and time has been specified (YES in step S1207), the process proceeds to step S1210.

[0132] In step S1210, the information feedback device 310 reads out, from the processing results, the calculation result of the lesson unit for the lesson of the specified teacher on the specified date and time of the identified learner.

[0133] In step S1211, the information feedback device 310 performs a graph display process to generate a graph based on the read calculation results. Details of the graph display process in step S1211 will be described later with reference to FIG.

[0134] In step S1212, the information feedback device 310 determines whether or not a logout operation has been performed by the user. If it is determined in step S1212 that a logout operation has not been performed (NO in step S1212), the process returns to step S1203.

[0135] On the other hand, if it is determined in step S1212 that a logout operation has been performed (YES in step S1212), the information feedback process for the user who input the login information in step S1201 is terminated.

[0136] (2) Details of graph display processing Next, the graph display process in step S1211 of Fig. 12A will be described in detail below. Fig. 12B is a flowchart showing the flow of the graph display process.

[0137] In step S1221, the information feedback device 310 generates a graph based on the calculation results read out in step S1211, and displays the generated graph.

[0138] In step S1222, the information feedback device 310 displays time-series data indicating the psychological states of the learners in the class taught by the designated instructor on the designated date and time.

[0139] In step S1223, information feedback device 310 determines whether a command to play digest video data has been input by the user (here, the learner). If it is determined in step S1223 that a command to play digest video data has not been input (NO in step S1223), the process returns to step S1212 in FIG. 12A.

[0140] On the other hand, if it is determined in step S1223 that the user has input an instruction to play back the digest video data (YES in step S1223), the process proceeds to step S1224.

[0141] In step S1224, the information feedback device 310 reads the digest video data for the specified time period from the processing result storage unit 622, and plays back the read digest video data.

[0142] In step S1225, the information feedback device 310 charges the user (here, the learner's guardian) according to the playback time of the played digest video data, and then the process returns to step S1212 in FIG. 12A.

[0143] <Information feedback process flow (test)> Next, a description will be given of the flow of information feedback processing executed by the information feedback device 310 when processing results are generated based on collected data (tests). Fig. 12C is a second flowchart showing the flow of information feedback processing.

[0144] In step S1231, the information feedback device 310 accepts login information entered by a user (here, a learner or a parent of the learner).

[0145] In step S1232, the information feedback device 310 identifies the learner based on the login information.

[0146] In step S1233, the information feedback device 310 determines whether or not a subject has been specified by the user. If it is determined in step S1233 that a subject has not been specified (NO in step S1233), the process proceeds to step S1239.

[0147] On the other hand, if it is determined in step S1233 that a subject has been designated (YES in step S1233), the process proceeds to step S1234.

[0148] In step S1234, the information feedback device 310 determines whether a test name has been specified by the user. If it is determined in step S1234 that a test name has not been specified (NO in step S1234), the process proceeds to step S1235.

[0149] In step S1235, the information feedback device 310 reads out the subject-by-subject tabulation results for the specified learner for the specified subject from the processing results.

[0150] In step S1236, the information feedback device 310 generates a graph based on the read-out counting results, displays the generated graph, and then proceeds to step S1239.

[0151] On the other hand, if it is determined in step S1234 that a test name has been specified (YES in step S1234), the process proceeds to step S1237.

[0152] In step S1237, the information feedback device 310 reads out, from the processing results, the calculation results of the test units for the specified subject and the specified test name, and time-series data indicating the psychological state of the identified learner.

[0153] In step S1238, the information feedback device 310 generates a graph based on the read calculation results and displays the generated graph. After displaying the read time-series data, the information feedback device 310 proceeds to step S1239.

[0154] In step S1239, the information feedback device 310 determines whether or not a logout operation has been performed by the user. If it is determined in step S1239 that a logout operation has not been performed (NO in step S1239), the process returns to step S1233.

[0155] On the other hand, if it is determined in step S1239 that a logout operation has been performed (YES in step S1239), the information feedback process for the user who input the login information in step S1231 is terminated.

[0156] <Summary> As is clear from the above description, the information feedback device 310 according to the first embodiment: The collected data storage unit 621 stores time-series data indicating the psychological state of the learner, for each lesson or test of one subject. The data collection unit 601 collects data on each item related to the learner's learning behavior, which corresponds to time-series data indicating the learner's psychological state. The time length calculation unit 605 calculates the length of time that the time series data indicating the mental state of the learner belongs to at each level. The apparatus includes a counting unit 606 that counts the time lengths belonging to each level for time series data in which data of specified items from among data of each item related to the learning behavior of the learner are equal to each other. A graph generating unit 608 is provided to generate a graph showing the calculated or aggregated proportion of the length of time belonging to each level. A display unit 610 is provided to display the generated graph.

[0157] As a result, the information feedback device 310 according to the first embodiment can provide feedback information in the form of graphs of the length of time that time-series data indicating the psychological state of a learner belongs to each level, by lesson (or test), by teacher, and by subject.

[0158] That is, the information feedback device 310 according to the first embodiment can provide feedback information based on time-series data indicating the psychological state of the learner.

[0159] In this embodiment, a specific example has been described in which the processing results stored in the processing result storage unit 622 are provided to the learner or the learner's guardian as feedback information (for the learner). However, the processing results stored in the processing result storage unit 622 may also be provided to the instructor as feedback information (for the instructor). This is because, for time-series data indicating the psychological state of a specific learner, the results of calculating the length of time belonging to each level for each learner on a lesson-by-lesson basis, and the results of aggregating the results on a lesson-by-teacher or subject-by-subject basis, can also be used when taking measures to improve educational services and learning efficiency.

[0160] [Second embodiment] In the first embodiment, a case where the generated processing results are provided as feedback information (for learners) and feedback information (for instructors) has been described. In contrast, in the second embodiment, a case where feedback information (for instructors) specialized for instructors is provided by adding performance data of learners to the generated processing results will be described. Note that the second embodiment will be described mainly focusing on the differences from the first embodiment.

[0161] <Functional configuration of the information feedback device> First, the functional configuration of the information feedback device according to the second embodiment will be described. Fig. 13 is a second diagram showing an example of the functional configuration of the information feedback device. The functional configuration differs from that shown in Fig. 6 in that Fig. 13 includes a designation unit 1301, an average level calculation unit 1302, a graph generation unit 1303, a grade calculation unit 1304, an evaluation determination unit 1305, a unit price determination unit 1306, and a display unit 1307.

[0162] When a subject and a teacher are designated by an instructor, the designation unit 1301 accepts this. The designation unit 1301 notifies the extraction unit 603 of the subject and teacher designated by the instructor. In response, the extraction unit 603 extracts, from the collected data storage unit 621, time-series data indicating the psychological states of all learners who attended classes taught by the designated subject and teacher.

[0163] The average level calculation unit 1302 calculates the average concentration level of all learners who attended the class of the specified subject and teacher, based on the time-series data indicating the psychological states of all learners who attended the class of the specified subject and teacher, from the processing result storage unit 1312. The average level calculation unit 1302 stores the calculated average concentration level in the processing result storage unit 1312 as the processing result.

[0164] The graph generating unit 1303 reads out the results of calculations performed on time-series data indicating the psychological states of all learners who attended classes by the designated subject and instructor, by calculating and aggregating the durations of time belonging to each level. The graph generating unit 1303 also generates a graph based on the read-out aggregation results.

[0165] The grade calculation unit 1304 reads out the grade data of the learners, from which time-series data indicating psychological states has been extracted by the extraction unit 603, from the grade data storage unit 1311. The grade data storage unit 1311 stores the results of all tests for all learners as grade data. The grade calculation unit 1304 calculates the average value of the read grade data and notifies the evaluation determination unit 1305.

[0166] The evaluation determination unit 1305 determines the evaluation of the designated teacher based on the average concentration level calculated by the average level calculation unit 1302 and the average value of the grade data notified by the grade calculation unit 1304. The evaluation determination unit 1305 notifies the unit price determination unit 1306 of the determined evaluation.

[0167] The unit price determination unit 1306 determines the unit price of the lesson for the designated teacher based on the evaluation notified by the evaluation determination unit 1305 and notifies the display unit 1307 of the price.

[0168] The display unit 1307 acquires the graph generated by the graph generation unit 1303, the average value of the grade data calculated by the grade calculation unit 1304, the evaluation determined by the evaluation determination unit 1305, and the lesson unit price determined by the unit price determination unit 1306. The display unit 1307 also generates feedback information (for the instructor) including the acquired graph, the average value of the grade data, the evaluation, and the lesson unit price.

[0169] <Examples of processing results, example of performance data, and example of feedback information screen> Next, the information feedback device 1310 - Specific examples of generated processing results, -Specific examples of generated performance data, A specific example of a display screen that displays feedback information (for instructors) generated based on the processing results and the performance data; This article explains:

[0170] (1) Processing result of the instructor of class 1 Fig. 14 is a diagram showing an example of a processing result generated by calculating and aggregating the length of time belonging to each level for time series data relating to the psychological states of learners who attended a class taught by one instructor. The processing result 1400 in Fig. 14 shows how the length of time belonging to each level is calculated for each learner and aggregated for each instructor for time series data indicating the psychological states of each learner who attended a class taught by one instructor ("Teacher α") in the subject="Japanese".

[0171] Of these, reference numeral 1410 represents time series data showing the psychological state of learners who attended a class taught by one instructor ("Teacher α"), which is classified into three levels, from Level A to Level C, and the length of time belonging to each level is calculated for each learner.

[0172] Reference numeral 1420 represents time series data showing the psychological state of learners who attended a class taught by one instructor ("Teacher α"), which is classified into three levels, from level A to level C, and the length of time belonging to each level is tallied by instructor.

[0173] Reference numeral 1430 indicates the average concentration level of learners in a class taught by one instructor ("Teacher α") calculated based on time series data showing the psychological state of all learners who attended the class taught by one instructor ("Teacher α").

[0174] In the example of Figure 14, the processing results for the case where the instructor is "Teacher α" are shown, but similar processing results for other instructors designated by the instructor are stored in the processing result storage unit 622.

[0175] (2) Performance data Fig. 15 is a diagram showing an example of grade data, which is an example of grade data read out by grade calculation unit 1304. As shown in Fig. 15, grade data 1500 includes grade data for all tests (N times in the example of Fig. 15) in the subject "Japanese" of all learners who took classes taught by instructor "Teacher α", and the average value of the grade data for all tests in the subject "Japanese" of all learners.

[0176] 15 shows the grade data read out by the grade calculation unit 1304 when the instructor specifies the instructor="teacher α", but the same applies when the instructor specifies another instructor for the same subject. Alternatively, the same applies when the instructor specifies another instructor for another subject.

[0177] (3) A display screen that displays feedback information generated based on the processing results and performance data. Next, a specific example of a display screen for displaying feedback information (for instructors) generated based on the processing results and grade data will be described. Fig. 16 is a diagram showing an example of a display screen for displaying feedback information (for instructors). As shown in Fig. 16, display screen 1600 includes information items such as "subject" and "teacher."

[0178] The subject designated by the instructor is displayed in "Subject." The example in Figure 16 shows that "Japanese" has been designated.

[0179] The "teacher" field is filled in with the teacher who is designated by the instructor from among the teachers for Japanese language. When a "subject" is designated, a list of teachers for the subject is displayed on the display screen 1000, and the instructor selects a teacher from the displayed list.

[0180] On the display screen 1600, a display field indicated by reference numeral 1610 displays each instructor designated by the instructor. A display field indicated by reference numeral 1620 displays a graph of the results of tallying the length of time belonging to each level for time-series data (here, concentration level) indicating the psychological state of learners who attended classes taught by each instructor. The example in Fig. 16 shows a graph displaying the proportion of the length of time classified into level A (high), level B (medium), and level C (low) for concentration level.

[0181] The display field indicated by the reference numeral 1630 displays the average concentration level during class of learners who attended classes taught by each instructor, calculated by the average level calculation unit 1302. The display field indicated by the reference numeral 1640 displays the average score data for the subject "Japanese" of all tests of learners who attended classes taught by each instructor, calculated by the score calculation unit 1304.

[0182] The display field indicated by the reference numeral 1650 displays the evaluation of each teacher, determined by the evaluation determination unit 1305 based on the average concentration level and the average value of the grade data. The display field indicated by the reference numeral 1660 displays the lesson unit price of each teacher, determined by the unit price determination unit 1306 based on the evaluation of each teacher.

[0183] <Information collection process flow> Next, a description will be given of the flow of information collection processing executed by the information feedback device 1310. Fig. 17 is a flowchart showing the flow of information collection processing. Note that the difference from the flowchart shown in Fig. 11 is step S1701.

[0184] In step S1701, the information feedback device 1310 acquires the performance data of the learner.

[0185] <Information feedback processing flow> Next, a description will be given of the flow of information feedback processing executed by information feedback device 1310. Fig. 18 is a second flowchart showing the flow of information feedback processing.

[0186] In step S1801, the information feedback device 1310 receives the subject and the teacher designated by the instructor.

[0187] In step S1802, the information feedback device 1310 extracts time-series data indicating the psychological states of learners who attended classes of the specified subject and instructor, calculates and aggregates the durations of time belonging to each level, and calculates the average concentration level. The information feedback device 1310 also associates the calculation and aggregation results and the average concentration level with data related to the learner's class and the time-series data indicating the learner's psychological state, and stores them as processing results.

[0188] In step S1803, the information feedback device 1310 reads the counting result from the processing result, generates a graph, and displays the generated graph.

[0189] In step S1804, the information feedback device 1310 reads out the average concentration level from the processing results and displays it.

[0190] In step S1805, the information feedback device 1310 calculates and displays the average value of the grade data for the specified subject among the grade data of all learners who took the class taught by the specified teacher.

[0191] In step S1806, the information feedback device 1310 determines and displays the evaluation of the set teacher based on the average concentration level read out in step S1804 and the average value of the grade data calculated in step S1805.

[0192] In step S1807, the information feedback device 1310 determines and displays the lesson unit price of the set teacher based on the evaluation determined in step S1806.

[0193] In step S1808, the information feedback device 1310 determines whether or not the instructor has designated another subject or another instructor. If it is determined in step S1808 that another subject or another instructor has been designated (YES in step S1808), the process returns to step S1801.

[0194] On the other hand, if it is determined in step S1808 that no other subjects or other instructors have been designated (NO in step S1808), the process proceeds to step S1809.

[0195] In step S1809, the information feedback device 1310 determines whether or not to end the information feedback process. If it is determined in step S1809 that the information feedback process should not be ended (NO in step S1809), the process returns to step S1808.

[0196] On the other hand, if it is determined in step S1809 that the information feedback process is to be ended (YES in step S1809), the information feedback process is ended.

[0197] <Summary> As is clear from the above description, the information feedback device 1310 according to the second embodiment: The collected data storage unit 621 stores time-series data indicating the psychological state of the learners, in units of lessons. The data collection unit 601 collects data on each item related to the learner's lessons, which corresponds to time-series data indicating the learner's psychological state. The device has a time length calculation unit 605 that calculates the time length belonging to each level for time series data indicating the psychological state of learners attending a class of a specified subject and instructor. The apparatus has a counting unit 606 that counts the length of time belonging to each level calculated for the time series data indicating the psychological state of learners attending a class of a specified subject and teacher, for each teacher. A graph generating unit 1303 is provided to generate a graph showing the proportion of the time length belonging to each of the collected levels. A display unit 1307 is provided which displays the generated graph together with the average concentration of learners who took the class taught by the designated instructor, the average score data, an evaluation determined based on the average concentration and the average score data, and the unit price of the class determined based on the evaluation.

[0198] As a result, the information feedback device 1310 according to the second embodiment can provide feedback information (for instructors) in which the time-series data indicating the psychological states of learners attending classes taught by each instructor is graphed for each instructor to show the length of time that belongs to each level.

[0199] That is, the information feedback device 1310 according to the second embodiment can provide feedback information based on time-series data indicating the psychological state of the learner.

[0200] [Third embodiment] In the first embodiment, Figs. 8A to 10B and the like are shown as examples of display screens when the generated processing results are provided as feedback information (for learners) and feedback information (for instructors). However, the display modes of the display screens are not limited to these. In the third embodiment, other screen examples will be described.

[0201] <Another example of feedback information screen> (1) Color-coded time series data showing psychological state 19A is a first diagram showing an example of another display screen. As shown in display screen 1900 in FIG. 19A, for example, the levels to which time-series data indicating the psychological states of learners during class belong can be expressed in display modes corresponding to the respective levels.

[0202] In display screen 1900 of Fig. 19A, reference numeral 1901 is an example of a graph showing time-series data of a learner's concentration level during class (one-dimensional data) (already explained in Figs. 10A and 10B). On the other hand, in display screen 1900 of Fig. 19A, reference numeral 1902 is two-dimensional data defined based on an axis indicating concentration and distraction and an axis indicating tension and relaxation (see reference numeral 1903), in which different colors are assigned to each quadrant. However, in Fig. 19A, for convenience, the different colors are represented by different types of hatching.

[0203] According to the graph indicated by reference numeral 1902 in FIG. 19A, the psychological state of the learner can be intuitively grasped even if the time-series data showing the psychological state of the learner at each time point during the lesson is two-dimensional data.

[0204] Fig. 19B is a second diagram showing an example of another display screen. As shown in display screen 1920 in Fig. 19B, for example, the levels to which time-series data indicating the psychological states of learners during class belong can be expressed in display modes corresponding to the respective levels.

[0205] In the display screen 1920 of Fig. 19B, reference numeral 1921 is an example of a graph showing to which level of basic emotions (fear, surprise, anger, disgust, sadness, joy, neutral) time-series data showing the psychological state of a learner during class belongs. Also, in the display screen 1920 of Fig. 19B, reference numeral 1922 is a graph in which a different color is assigned to each emotion included in the basic emotions, and the emotions at each time are arranged on a straight line. However, in Fig. 19B, for convenience, different colors are represented by different types of hatching.

[0206] According to FIG. 19B, even if the time-series data showing the learner's mental state at each time point during the lesson includes multiple levels, the learner's mental state can be intuitively grasped.

[0207] (2) Comparative display Fig. 20A is a third diagram showing an example of another display screen. As shown in the display screen 2000 of Fig. 20A, for example, the concentration level of a specific learner during a class of the same subject can be displayed by comparing the past and present (see reference numeral 2001). The example of reference numeral 2001 is as follows: -The average percentage of time spent in Japanese language classes classified into levels A (high), B (medium), and C (low) for a particular learner's concentration level in the previous month, and - Regarding the level of concentration of a particular learner in today's Japanese class, the percentage of time categorized into Level A (high), Level B (medium), and Level C (low), and are displayed in comparison.

[0208] Also, the example of code 2002 is -Time series data of a specific learner's concentration in the previous Japanese language class, -Time series data of a specific learner's concentration in today's Japanese language class, In the example of code 2002, the average concentration level of a specific learner in Japanese language classes in the previous month is also displayed.

[0209] According to FIG. 20A, it is possible to intuitively grasp the difference between the past and present psychological states of a particular learner.

[0210] The comparison method shown by reference numerals 2001 and 2002 in Fig. 20A is an example, and instead of the example of reference numeral 2001, for example, the past three months may be displayed in comparison with the present. Alternatively, the aggregated results for each day in the past week may be displayed in a list. Furthermore, when displaying a comparison between the past and present, it may be limited to a specific instructor or a specific subject.

[0211] FIG. 20B is a fourth diagram showing an example of another display screen. As shown in the display screen 2010 of FIG. 20B, for example, the concentration level during a lesson can be displayed in comparison between a specific learner and other learners (see reference numeral 2011). The example of reference numeral 2011 is as follows: -Regarding learners' concentration levels during lessons, the national average percentage of time spent classified into Level A (high), Level B (medium), and Level C (low) -The average percentage of time a particular learner spent concentrating during class that was classified as Level A (high), Level B (medium), or Level C (low) are displayed in comparison.

[0212] The example with reference number 2012 shows the ranking of each learner's level of concentration during class. The example with reference number 2012 also shows the national average of learners' level of concentration during class.

[0213] According to FIG. 20B, the psychological state of a particular learner can be easily understood, including the difference between the learner and other learners and the relative relationship between the learner and other learners.

[0214] The comparison methods shown in symbols 2011 and 2012 are examples, and instead of symbol 2011, for example, the aggregated results of the concentration level during class for a specific learner may be displayed in comparison with the average value of the aggregated results of the concentration levels of learners in a specific area.

[0215] (3) Short comment display Fig. 21 is a fourth diagram showing an example of another display screen. As shown on display screen 2100 in Fig. 21, for example, a short review can be displayed for time-series data (reference numeral 2101) indicating the psychological state of a specific learner in a specific lesson and for the tabulation results (reference numeral 2102). The short review shown by reference numeral 2111 is an example, and any of these may be displayed on display screen 2100. Note that the short review is not limited to that shown by reference numeral 2111 and is arbitrary. Reference numeral 2112 in Fig. 21 is an example of another short review.

[0216] (4) Monthly display Fig. 22 is a sixth diagram showing an example of another display screen. As shown in display screen 2200 in Fig. 22, for example, for a specific learner, the average concentration level during class for each day of a specific month can be displayed in a list (reference numeral 2201). Furthermore, by selecting each day, the average concentration level for each class on each day can be displayed in a list (reference numeral 2202). Note that, as shown in reference numeral 2201, by using a color scheme according to the level of concentration, the concentration level of a specific learner during class for one month can be intuitively grasped.

[0217] The day with the highest or lowest concentration within a month may be highlighted.

[0218] (5) Icon display Fig. 23 is a seventh diagram showing an example of another display screen. As shown in a display screen 2300 in Fig. 23, for example, an icon (2303) can be displayed for time-series data (2301) showing the psychological state of a specific learner in a specific class and for the tabulation results (2302).

[0219] The icon is selected according to the evaluation result of the psychological state of a particular learner in a particular lesson.

[0220] However, the method of selecting an icon is not limited to the evaluation results for each lesson, and may be selected, for example, based on the evaluation results for each day. Alternatively, the icon may be selected based on the evaluation results for each time period within a lesson. When the icon is selected based on the evaluation results for each time period within a lesson, an icon corresponding to that time period is displayed each time a time period is specified. Therefore, for example, if a time axis slide bar is provided on the display screen 2300, the expression of the icon will change each time the slide bar is moved.

[0221] In the example of Fig. 23, icons are displayed, but instead of icons, pictograms may be displayed. Alternatively, the learner's avatar may be displayed. Alternatively, a predetermined character may be displayed.

[0222] [Fourth embodiment] In the above first embodiment, a case has been described in which a user specifies data items related to a learner's class, such as "student number," "name," "subject," "day of the week," "start and end times," and "teacher." Also, in the above first embodiment, a case has been described in which a user specifies data items related to a learner's test, such as "student number," "name," "subject," "day of the week," "start and end times," and "test name." However, the data items specified by the user are not limited to these, and other data items related to the learner's learning behavior may be specified.

[0223] In the first embodiment, it has been described that the counting unit 606 counts the time lengths belonging to each level by instructor or subject, on the assumption that the user specifies data for each of the above items. However, the unit in which the counting unit 606 pre-counts is not limited to this, and the counting unit 606 may be configured to count the time lengths belonging to each level in units of time-series data in which the data for items specified from among the items related to the learner's learning behavior are equal to each other. The unit of time-series data in which the data for items specified from among the items related to the learner's learning behavior are equal to each other refers to grouping time-series data in which the data for items specified from among the items related to the learner's learning behavior are equal to each other.

[0224] In the first embodiment, the tallying unit 606 has been described as tallying the durations of time belonging to each level in advance for each instructor or for each subject, on the assumption that the user specifies the data for each of the above items. However, the timing of tallying by the tallying unit 606 is not limited to this. For example, the tallying unit 606 may be configured to tally the durations of time belonging to each level for each instructor or for each subject after the user specifies the data for each of the above items.

[0225] In the second embodiment, the processing results are generated when the instructor specifies the subject and the instructor. However, the timing for generating the processing results is not limited to this, and the processing results may be generated in advance before the subject and the instructor are specified. Alternatively, the processing results may be generated by calculating the length of time belonging to each level in advance for time-series data indicating the psychological state of the learner, and aggregating the results by instructor when the subject and the instructor are specified.

[0226] Furthermore, in each of the above embodiments, examples of feedback information provided by the information feedback device 310 are shown, but the feedback information provided by the information feedback device 310 is not limited to these. Furthermore, in each of the above embodiments, details of how to use the feedback information are not mentioned, but the feedback information may be used in any manner.

[0227] For example, by specifying a class in which an instructor wishes to check the changes in the psychological state of a specific learner, the instructor can obtain feedback information (for instructor) that graphically displays the changes in the psychological state of the specific learner in that class. This allows the instructor to present the feedback information (for instructor) to the specific learner, allowing the specific learner to objectively understand the changes in his or her own psychological state.

[0228] In addition, by presenting the feedback information (for instructors) to the parents during regular interviews with the parents, instructors can objectively explain not only the learner's learning situation but also any changes in the learner's psychological state, such as their motivation to learn.

[0229] Furthermore, for example, after a test, a learner can specify the test for each subject to obtain feedback information (for the learner) that displays a graph of the level of the learner's psychological state during the test for each subject. This allows the learner to reflect on the test. Furthermore, after a test, an instructor can specify the test for each subject for a specific learner to obtain feedback information (for the instructor) that displays time-series data indicating the learner's psychological state during the test for each subject. This allows the instructor to determine whether the difficulty level of each question in the test for each subject was appropriate for the specific learner.

[0230] Furthermore, for example, the responsible person 131 can acquire feedback information (for instructors) including the evaluation of each instructor by specifying the instructor of each subject at a predetermined time. This allows the responsible person 131 to evaluate each instructor at a predetermined time while referring to the feedback information (for instructors). The responsible person 131 can also derive an evaluation for each aggregation unit by aggregating the feedback information (for instructors) by educational institution location, area, or country. This allows the responsible person 131 to evaluate each aggregation unit using indicators other than grades and the rate of progression to higher education.

[0231] Furthermore, for example, when the learner returns home, time series data showing the learner's psychological state during each class can be displayed on the parent / guardian device of the learner's guardian, thereby encouraging communication between the learner and the parent / guardian. Also, displaying time series data showing the learner's psychological state during each class can help the learner's guardian reselect educational services that are appropriate for the learner.

[0232] Furthermore, for example, after the learner has taken the test, at the same time that the test score is presented, the learner or the learner's guardian may be shown time-series data of the concentration level as time-series data showing the learner's psychological state during the test, thereby enabling the learner or the learner's guardian to understand the relationship between the concentration level and the score.

[0233] Furthermore, for example, after each lesson, a learner's parents can specify the lesson and obtain feedback information (for the learner) that displays a graph of the learner's psychological state during each lesson. This allows the learner's parents to understand the learner's situation during each lesson, eliminating anxiety caused by a black box. As a result, educational institutions can dispel concerns about scandals and other issues.

[0234] Furthermore, for example, by an instructor or a learner's parent obtaining feedback information that graphically displays the level of time-series data indicating the learner's psychological state in each class, the instructor or the learner's parent can determine the quality of the class. Furthermore, if the instructor or the learner's parent determines that the quality of the class is low, the instructor or the learner's parent can determine whether the fault lies with the learner or the instructor. For example, if individual learners are sleeping or individual learners' concentration levels are declining, the instructor can determine that the learner is to blame. Alternatively, if many learners are sleeping or many learners' concentration levels are declining, the instructor can determine that the instructor is to blame.

[0235] Furthermore, for example, by obtaining feedback information from multiple educational institutions that graphically displays the level of time-series data indicating the psychological state of each learner in each class, a learner's parent or guardian can quantitatively evaluate multiple educational institutions. Generally, there are no indicators for quantitatively evaluating different educational institutions from the perspective of the learner's psychological state, and the feedback information allows the learner's parent or guardian to appropriately evaluate the educational institutions. It is desirable that the feedback information be configured to be obtained without going through each educational institution, provided that the learner's parent or guardian has paid the fee.

[0236] Furthermore, for example, by specifying each lesson taught by each instructor, an instructor can obtain feedback information (for instructors) that graphically displays the level of time-series data indicating the psychological state of the learners who attended each lesson. The level of time-series data indicating the psychological state of the learners who attended each lesson is the level of time-series data indicating the psychological state of the learners aggregated for each lesson. This allows the instructor to determine, for example, the method of charging each lesson taught by each instructor. For example, by tallying up the number of lessons that meet a certain standard or higher after a certain period of time, the instructor can determine the amount to charge the learners' parents / guardians based on the tallying results. This allows the learners' parents / guardians to pay the tuition fees for lessons that are effective.

[0237] [Other embodiments] In the above embodiments, the case where a user (a parent or guardian of a learner) to whom digest video data is sent has been described, but the charging method and the charging target are not limited to this. For example, the system may be configured to charge an educational institution based on the data volume of the calculation results or the tabulation results. Furthermore, the system may be configured to charge a requester based on a request for the calculation results or the tabulation results. For example, if the requester of the calculation results or the tabulation results is a company that provides educational materials, the system may be configured to charge the company based on the calculation results or the tabulation results provided to the company based on the request specified by the company.

[0238] In this case, by making the display unit 610 function as a billing amount determination unit, it is possible to present to the requester of the calculation results or tabulation results an amount that is satisfactory to the requester.

[0239] Furthermore, in each of the above embodiments, the system 300 has been described as having one information feedback device 310 or 1310, but the system 300 may have multiple information feedback devices. In this case, each information feedback device may be configured to independently execute an information feedback program, or each information feedback device may be configured to cooperate with each other to execute an information feedback program.

[0240] Although the above embodiments have described a scenario in which the information feedback device is applied to an educational institution, the application of the information feedback device is not limited to educational institutions. For example, the information feedback device may be applied to a scenario in which qualification learning, vocational training, in-house / off-site training for working adults, reskilling, or other education-related services are provided. The information feedback device of the present disclosure can provide appropriate feedback information even in such scenarios.

[0241] The present invention is not limited to the configurations described in the above embodiments, but may be combined with other elements, etc. These aspects can be changed without departing from the spirit of the present invention, and can be appropriately determined depending on the application form. [Explanation of symbols]

[0242] 300: System 310: Information feedback device 601: Data Collection Department 602: Data generation unit 603:Extraction part 604: Level Classification Section 605: Time length calculation unit 606: Aggregation section 607: Video data extraction unit 608: Graph generation unit 609: Login section 610: Display section 800, 900, 1000: Display screen 1301 :Specified part 1302: Average level calculation section 1303: Graph generation unit 1304: Grade Calculation Department 1305: Evaluation and Decision Department 1306: Unit Price Determination Department 1307: Display section 1600:Display screen

Claims

1. a storage unit for storing time series data indicating the psychological state of a learner in a predetermined time unit; a collection unit that collects data on each item related to the learner's learning behavior corresponding to the time-series data; a calculation unit that calculates the length of time that the time-series data indicating the mental state of the learner belongs to for each level; a counting unit that counts the time lengths belonging to each level for time-series data in which data of items designated from among the items related to the learning behavior of the learner are equal to each other; A display unit that displays the calculation results or tabulation results; An information feedback device having:

2. a graph generating unit that generates a graph showing the calculated proportion of the length of time that belongs to each level or the aggregated proportion of the length of time that belongs to each level; the display unit displays the generated graph as the calculation result or the counting result.

2. The information feedback device according to claim 1.

3. the calculation unit calculates a time length belonging to each level for time-series data corresponding to each lesson or each test taken by a specific learner; The aggregation unit The calculation results calculated for the time series data corresponding to each class taken by a specific learner are aggregated by instructor or subject, or The calculation results calculated for the time series data corresponding to each test taken by a specific learner are aggregated by subject.

3. The information feedback device according to claim 2.

4. The graph generation unit A graph showing the percentage of time spent at each level calculated for each lesson or test for a particular learner, or a graph showing the proportion of time lengths belonging to each level, aggregated for each instructor or each subject, for a specific learner; Generate 4. The information feedback device according to claim 3.

5. When the display unit displays a graph showing the proportion of the length of time belonging to each level calculated for a specific learner on a lesson-by-lesson or test-by-test basis, the display unit also displays the corresponding time-series data.

5. The information feedback device according to claim 4.

6. When a time range that satisfies a predetermined condition is specified in the corresponding time series data, the display unit plays back the video data corresponding to the specified time range.

6. The information feedback device according to claim 5.

7. The display unit charges according to the calculation result or the tabulation result.

2. The information feedback device according to claim 1.

8. When the display unit plays back the video data corresponding to the specified time range, the display unit charges the user according to the playback time.

7. The information feedback device according to claim 6.

9. the calculation unit calculates the length of time belonging to each level for time-series data indicating the psychological state of each learner who attended a class taught by a specific instructor; the tallying unit tallying the calculation results calculated for the time-series data indicating the psychological states of each learner who attended a class taught by a specific teacher, for each teacher; 3. The information feedback device according to claim 2.

10. the graph generating unit generates a graph showing the proportion of time lengths belonging to each level, aggregated for each teacher, for a specific teacher; 10. The information feedback device according to claim 9.

11. the display unit also displays the average concentration level of learners who attended a class taught by a specific instructor.

11. The information feedback device according to claim 10.

12. The display unit also displays the average score data of learners who attended a class taught by a specific instructor.

12. The information feedback device according to claim 11.

13. the display unit displays the average concentration level and an evaluation of the specific teacher determined based on the average value of the performance data of the learners.

13. The information feedback device according to claim 12.

14. a unit price determination unit that determines a unit price for the lesson of the specific teacher in accordance with the evaluation of the specific teacher; 14. The information feedback device of claim 13, further comprising:

15. The tallying unit tallying the calculation results calculated for the time-series data indicating the psychological states of each learner who attended a class taught by a specific teacher, on a class-by-class basis; the display unit displays the tabulation results for determining a billing method for a class taught by a specific instructor.

3. The information feedback device according to claim 2.

16. storing time-series data indicating the psychological state of a learner in a predetermined time unit in a storage unit; collecting data on each item related to the learner's learning behavior corresponding to the time-series data; calculating a time length that the time-series data indicating the mental state of the learner belongs to for each level; a step of aggregating the time lengths belonging to each level for time-series data in which data of items designated from among items related to the learning behavior of the learner are equal to each other; a step of displaying the calculation result or the tabulation result; The computer performs information feedback methods.

17. storing time-series data indicating the psychological state of a learner in a predetermined time unit in a storage unit; collecting data on each item related to the learner's learning behavior corresponding to the time-series data; calculating a time length that the time-series data indicating the mental state of the learner belongs to for each level; a step of aggregating the time lengths belonging to each level for time-series data in which data of items designated from among items related to the learning behavior of the learner are equal to each other; a step of displaying the calculation result or the tabulation result; An information feedback program for causing a computer to execute the above.

Images