Concentration level estimation system, concentration level estimation device, method, and program
The system uses a terminal and concentration level estimation device to measure physiological indices and create alternating content states, addressing the challenge of estimating concentration levels in online courses and enhancing the assessment of educational effectiveness.
Patent Information
- Application Number
- PCT/JP2023/017152
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-02
- Publication Date
- 2024-11-07
AI Technical Summary
Existing methods fail to stably estimate a student's concentration level during online courses due to varying correlations between physiological indicators and concentration levels, depending on the content, making it difficult to assess the effectiveness of education or training.
A system comprising a terminal and a concentration level estimation device that measures physiological indices and uses pre-acquired correlations between these indices and concentration levels to create content alternating between standby and target presentation states, allowing for accurate and stable concentration level estimation.
Enables the stable estimation of a student's concentration level during online courses, allowing for effective evaluation of education or training by considering psychological aspects and improving course effectiveness.
Smart Images

Figure JP2023017152_07112024_PF_FP_ABST
Abstract
Description
Concentration level estimation system, concentration level estimation device, method, and program
[0001] One aspect of the present invention relates to a concentration level estimation system used to estimate the concentration level of a participant when, for example, educating or training using content, and a concentration level estimation device, method, and program used in this system.
[0002] One form of education or training is to play content on a terminal and have participants watch the content online. The effectiveness of this type of online training varies greatly depending on how intently the participants are watching the content, but because the instructor is not giving the lecture face-to-face, it is difficult to grasp how intently the participants are watching the lecture.
[0003] Meanwhile, technology for estimating a person's level of concentration has been proposed. For example, Non-Patent Document 1 reports that physiological indices such as a person's pupil diameter correlate with the level of concentration on a task. If this method is applied to online courses, it may be possible to estimate the level of concentration of a student from the feature quantities by measuring the student's physiological indices during the course.
[0004] Nash Unsworth, Matthew K. Robison, Ashley L. Miller: “Pupillary Correlates of Fluctuations in Sustained Attention”, Journal of Cognitive Neuroscience (2018) 30 (9): 1241-1253.
[0005] However, in courses using educational and training content, depending on the content, the correlation between participants' physiological indices and their concentration level may not be reproduced, making it difficult to reliably estimate participants' concentration level.
[0006] The present invention has been made in light of the above circumstances, and aims to provide a technique that enables a stable estimation of the concentration level of participants in a content-based training course.
[0007] To solve the above problems, one aspect of the concentration estimation system according to the present invention includes a terminal used by a participant and a concentration estimation device capable of communicating with the terminal. The terminal includes a reception processing unit that receives and plays the content sent from the concentration estimation device, and a transmission processing unit that measures information representing physiological indices of the participant during playback of the content and transmits the measured information representing the physiological indices to the concentration estimation device. The concentration estimation device includes a first processing unit that acquires information representing a correlation between a person's physiological indices and a concentration level obtained in advance through a psychophysiological experiment, a second processing unit that creates the content based on scenario data related to the training and the information representing the correlation, in which sections corresponding to a waiting state and a target presentation state alternate in accordance with the scenario data, a third processing unit that transmits the content to the terminal and acquires information representing the participant's physiological indices from the terminal during playback of the content, and a fourth processing unit that estimates the participant's concentration level based on the acquired information representing the physiological indices and the information representing the correlation.
[0008] According to one aspect of the present invention, the content for the training is configured so that each scene alternates between a section corresponding to the standby state and a section corresponding to the target presentation state in accordance with the scenario data of the training, thereby making it possible to accurately and stably estimate the concentration level of the trainee based on the physiological indices of the trainee during the training. As a result, it becomes possible to judge the effectiveness of the education or training for each trainee, taking into account their psychological state.
[0009] That is, according to one aspect of the present invention, it is possible to provide a technology that enables a stable estimation of the concentration level of a participant in a lecture using content.
[0010] FIG. 1 is a diagram showing an example of the overall configuration of a system including a concentration level estimation device according to an embodiment of the present invention. FIG. 2 is a block diagram showing an example of the hardware configuration of a concentration level estimation device according to an embodiment of the present invention. FIG. 3 is a block diagram showing an example of the software configuration of a concentration level estimation device according to an embodiment of the present invention. FIG. 4 is a flowchart showing an example of the processing procedure and processing content of a concentration level estimation process executed by a control unit of the concentration level estimation device shown in FIG. 3. FIG. 5 is a diagram showing an example of a method for acquiring a correlation between a person's physiological index and concentration level using a physiological-psychological experiment. FIG. 6 is a diagram showing an example of video content created based on information indicating the correlation shown in FIG. 5. FIG. 7 is a diagram showing an example of a physiological index measurement operation performed while watching the video content shown in FIG. 6.
[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0012] [One Embodiment] (Configuration Example) (1) System FIG. 1 is a diagram showing an example of the overall configuration of a system including a concentration level estimation device according to one embodiment of the present invention.
[0013] The system according to one embodiment of the present invention comprises a concentration level estimation device SV, and enables the transmission of information data via a network NW between this concentration level estimation device SV and user terminals UT1 to UTn used by a plurality of users who are participants, and an administrator terminal MT used by the instructor.
[0014] The user terminals UT1 to UTn are, for example, personal computers, and are equipped with an input device, a display, and communication tools such as a browser or mailer in order to take online courses. The user terminals UT1 to UTn are also equipped with a camera to capture images of the user's face, including their eyes, while they are taking the course. Note that, in addition to personal computers, the user terminals UT1 to UTn may also be smartphones, tablet terminals, or other devices equipped with similar functions.
[0015] The administrator terminal MT consists of a personal computer and is used, for example, prior to a training session, to input content scenario data into the concentration estimation device SV, and to receive data representing the estimated results of the participants' concentration from the concentration estimation device SV.
[0016] The network NW includes, for example, a wide area network centered on the Internet and an access network for accessing the wide area network. Examples of the access network include a public data communication network using wired or wireless connections, a local area network (LAN) using wired or wireless connections, and a cable television (CATV) network. Furthermore, when the system is operated within a company or office, the network NW is configured as an in-house network such as a LAN or wireless LAN.
[0017] (2) Concentration Level Estimation Device SV The concentration level estimation device SV is configured by, for example, a server computer located on the web or on the cloud.
[0018] 2 and 3 are block diagrams showing an example of the hardware configuration and software configuration of the concentration level estimation device SV, respectively.
[0019] The concentration level estimation device SV includes a control unit 1 that uses a hardware processor such as a central processing unit (CPU). A storage unit having a program storage unit 2 and a data storage unit 3, and a communication interface (hereinafter, the interface will be abbreviated as I / F) unit 4 are connected to the control unit 1 via a bus 5.
[0020] Under the control of the control unit 1, the communication I / F unit 4 transmits and receives information data to and from the user terminals UT1 to UTn and the administrator terminal MT in accordance with a communication protocol defined by the network NW.
[0021] The program storage unit 2 is configured by combining, for example, a nonvolatile memory such as a solid-state drive (SSD) as a storage medium that can be written to and read from at any time, and a nonvolatile memory such as a read-only memory (ROM), and stores middleware such as an operating system (OS), as well as application programs required to execute various control processes according to an embodiment. Hereinafter, the OS and each application program will be collectively referred to as the program.
[0022] The data storage unit 3 is, for example, a combination of a non-volatile memory such as an SSD that can be written to and read from at any time and a volatile memory such as a RAM (Random Access Memory) as a storage medium, and the storage area thereof is provided with a correlation information storage unit 31, a content storage unit 32, a physiological index storage unit 33, and an estimated information storage unit 34.
[0023] The correlation information storage unit 31 is used to store correlation information that indicates the correlation between physiological indices of an average person and the level of concentration. The content storage unit 32 stores data that indicates educational or training content created by the control unit 1. The physiological index storage unit 33 is used to store information that indicates physiological indices of participants acquired during a lecture. The estimated information storage unit 34 stores information that indicates the estimated results of the participant's level of concentration estimated by the control unit 1.
[0024] The control unit 1 includes, as processing functions necessary for implementing one embodiment of the present invention, a correlation information acquisition processing unit 11, a content creation processing unit 12, a content playback processing unit 13, a physiological index acquisition processing unit 14, a concentration level estimation processing unit 15, and an estimated information transmission processing unit 16.
[0025] Each of the processing units 11 to 16 of the control unit 1 is realized by causing a hardware processor of the control unit 1 to execute an application program stored in the program storage unit 2. Note that some or all of the processing units 11 to 16 may be realized using hardware such as an LSI (Large Scale Integration) or an ASIC (Application Specific Integrated Circuit).
[0026] The correlation information acquisition processing unit 11 acquires, for example, from a website T, information representing the correlation between physiological indices and the level of concentration measured when a waiting state and a target presentation state are repeatedly presented to an average person for a certain period of time in a physiological-psychological experiment, and stores the acquired information representing the correlation between the physiological indices and the level of concentration in the correlation information storage unit 31.
[0027] The content creation processing unit 12 creates content data in which a standby state and a target presentation state appear alternately and repeatedly for a certain period of time, based on scenario data for content for training sent from the administrator terminal MT and information representing the correlation between the physiological index and the concentration level stored in the correlation information storage unit 31. Then, the created content data is stored in the content storage unit 32.
[0028] When an online course is conducted, the content playback processing section 13 reads out content data from the content storage section 32 and transmits the read out content data from the communication I / F section 4 to the user terminals UT1 to UTn of the participants.
[0029] During the online course, the physiological index acquisition processing unit 14 acquires measurement data of physiological indexes for each participant from the user terminals UT1 to UTn, and stores the acquired measurement data of physiological indexes in the physiological index memory unit 33 in association with the participant's identification information.
[0030] For example, during or after the course, the concentration estimation processing unit 15 estimates the concentration level of each participant during the course based on the measurement data of physiological indices stored in the physiological index memory unit 33 and information representing the correlation between the physiological indices and the concentration level stored in advance in the correlation information memory unit 31, and stores information representing the estimated results in the estimated information memory unit 34 in association with the participant's identification information.
[0031] The estimated information transmission processing unit 16 reads out information representing the estimated result of the concentration level from the estimated information storage unit 34, and transmits the read out information representing the estimated result of the concentration level from the communication I / F unit 4 to the manager terminal MT.
[0032] (Example of Operation) Next, an example of operation of the concentration level estimation device SV configured as above will be described.
[0033] FIG. 4 is a flowchart showing an example of the processing procedure and processing content of the concentration level estimation process executed by the control unit 1 of the concentration level estimation device SV.
[0034] (1) Obtaining information showing the correlation between physiological indices and concentration level Information showing the correlation between physiological indices and concentration level can be obtained, for example, in a psychophysiological experiment, by measuring a person's physiological indices and concentration level when a waiting state and a target presentation state are repeatedly presented to an average person for a certain period of time.
[0035] FIG. 5 is a diagram showing an example of the operation of acquiring information indicating the correlation between the physiological index and the concentration level.
[0036] The physiological index can be obtained by, for example, measuring the pupil diameter of a person's eyes during each presentation period of the standby state and the target presentation state. The concentration level can be obtained by, for example, measuring the reaction speed of pressing a button when an event requiring attention appears. The technology for measuring physiological indexes based on pupil diameter is described in detail in, for example, Non-Patent Document 1.
[0037] In step S10, the control unit 1 of the concentration level estimation device SV acquires information representing the correlation between the physiological indexes measured as described above and the concentration level, for example, from a website, under the control of the correlation information acquisition processing unit 11. Then, the acquired information representing the correlation between the physiological indexes and the concentration level is stored in the correlation information storage unit 31.
[0038] The information indicating the correlation between the physiological index and the concentration level may be obtained from the student or group of students who are the subject of the course.
[0039] (2) Creation of Content for Training Prior to the training, the control unit 1 of the concentration level estimation device SV first receives training scenario data from, for example, an administrator terminal MT used by an instructor, via the communication I / F unit 4 in step S11 under the control of the content creation processing unit 12. Then, in step S12, the content creation processing unit 12 refers to the information representing the correlation between physiological indices and the concentration level stored in the correlation information storage unit 31, and creates content in which sections corresponding to the waiting state and sections corresponding to the target presentation state appear alternately in accordance with the scenario data.
[0040] For example, suppose an instructor provides a scenario such as, "You will now be carrying heavy parts and tools and repairing equipment. Try to identify any potential dangers along the way," along with video data showing each scene.
[0041] In this case, the content creation processing unit 12 synchronizes with the timing of the standby state and target presentation state specified by the information representing the correlation between the physiological index and the concentration level, and sequentially sets, for each scene of the scenario data, a standby state in which the image is blurred due to the participant's movement of the viewpoint, for example while walking, and the target presentation state in which the viewpoint is stationary and the image can be clearly seen.
[0042] Fig. 6 shows an example of content data created as described above. As shown in Fig. 6, the video data of the content is edited in accordance with the scenario, so that the video of each scene is presented for a time period corresponding to the standby state and the target presentation state defined by the information representing the correlation, in the following order: "moving state M1 to enter the room" → "stationary state P1 to check for the outlet TG1 and the shelf TG2" → "moving state M2 moving along the shelf TG2" → "stationary state P2 to check for pedestrians by looking at the convex mirror TG3 at the corner of the shelf TG2" → "moving state M3 to turn the corner of the shelf TG2 and move to the back of the shelf" → "stationary state P3 to check for the object to be repaired RG and the stepladder TG4" → "state M4 moving toward the object to be repaired RG."
[0043] In step S12, the content creation processing unit 12 stores the content data created as described above in the content storage unit 32 in association with a training ID set for each training session, for example.
[0044] (3) Online training using content For example, when a request to start an online training course is input from the instructor's administrator terminal MT, the control unit 1 of the concentration estimation device SV detects the start request in step S13, and under the control of the content playback processing unit 13, in step S14, reads the content data from the content storage unit 32 and distributes the read content data from the communication I / F unit 4 to the user terminals UT1 to UTn of the participants who have been registered in advance.
[0045] Each student watches the video of the content data displayed on their own user terminal UT1 to UTn. During this viewing period, a facial image including the eyes of each student is captured by a camera provided in the user terminal UT1 to UTn, and the captured video data is transmitted from the user terminal UT1 to UTn to the concentration level estimation device SV.
[0046] During playback of the content data, the control unit 1 of the concentration level estimation device SV, under the control of the physiological index acquisition processing unit 14, receives video data of captured faces transmitted from the user terminals UT1 to UTn via the communication I / F unit 4 in step S15. The physiological index acquisition processing unit 14 then performs a predetermined image recognition process on the received video data to extract images of the students' pupils and detects changes in pupil diameter from the extracted images. The physiological index acquisition processing unit 14 then associates the detected information indicating the pupil diameter with the corresponding scene of the content data being played, and stores the information in the physiological index storage unit 33 in a state linked to the student's identification information (student ID).
[0047] The process of detecting the pupil diameter of the student from the captured video data may be performed in the user terminals UT1 to UTn.
[0048] Figure 7 shows an example of the physiological index PS obtained for each scene of the content shown in Figure 6, i.e., video VM2, VTG2, VM3, VTG3, VM4, and VTG4, when the video is presented to the participants.
[0049] The control unit 1 of the concentration level estimation device SV determines whether the lesson has ended in step S16 during the lesson. If the lesson is still in progress, the process returns to step S14, and the process of playing the content and acquiring physiological indices of the participants is repeated in steps S14 and S15.
[0050] (4) Estimation of Concentration Level Meanwhile, suppose that completion of the course is determined in step S16. In this case, in step S17, the control unit 1 of the concentration level estimation device SV, under the control of the concentration level estimation processing unit 15, reads information representing the pupil diameter of each participant from the physiological index storage unit 33. The concentration level estimation processing unit 15 then compares the read information representing the pupil diameter with information representing the relationship between physiological indexes and concentration levels, which is pre-stored in the correlation information storage unit 31 for each played scene, to thereby estimate the concentration level corresponding to the pupil diameter. The concentration level estimation processing unit 15 then stores information representing the concentration level estimation result in the estimation information storage unit 34, in association with the identification information of the played scene and the participant ID.
[0051] The concentration level estimation processing unit 15 executes the above concentration level estimation process for each of the students.
[0052] The concentration level estimation processing unit 15 may also be configured to execute various statistical processes at the end. Examples of statistical processes include determining the change characteristics of the concentration level over the entire period of the content based on the concentration level estimation results for each student, identifying scenes where the concentration level for each student is below a threshold, and determining the tendency of change in the concentration levels of all students for the content data.
[0053] (5) Transmission of concentration level estimation results When the concentration level estimation results are obtained, the control unit 1 of the concentration level estimation device SV, under the control of the estimated information transmission processing unit 16, finally reads information representing the estimated concentration level results of each student from the estimated information storage unit 34 in step S18, and transmits the read information representing the estimated concentration level results of each student from the communication I / F unit 4 to the instructor's administrator terminal MT.
[0054] Therefore, the instructor can evaluate whether each student was concentrating on the course based on the received information on the concentration level estimation results for each student. Then, based on this evaluation result, for example, if a student is deemed not to have been concentrating on the course, the instructor can take action such as encouraging the student to take the course again. In other words, it becomes possible to verify the effectiveness of education, training, etc. on students by going into the psychological aspects of the students.
[0055] (Operations and Effects) As described above, in one embodiment, information indicating the correlation between physiological indices and concentration levels of an average person, obtained in advance through psychophysiological experiments, is stored in the acquired correlation information storage unit 31, and content is created in which periods corresponding to the standby state and periods corresponding to the target presentation state alternate in accordance with the scenario data based on scenario data to be used in the training and the information indicating the correlation between the physiological indices and concentration levels. The created content data is then distributed to each student to have them view it, and physiological indices of the students are acquired during this viewing period, and the acquired physiological indices are compared with information indicating the correlation between the physiological indices and concentration levels obtained in advance to estimate the concentration levels, and information indicating the estimated concentration levels is notified to the instructor.
[0056] Therefore, by using content data for the training content that is configured so that each scene alternates between periods corresponding to the standby state and periods corresponding to the target presentation state in accordance with the training scenario data, it becomes possible to accurately and stably estimate the level of concentration of the trainees based on their physiological indices during the course. As a result, it becomes possible to judge the effectiveness of education or training for each trainee, taking into account their psychological state.
[0057] [Other Embodiments] (1) In one embodiment, after the end of the course, a change in the level of concentration of the participant during the course is estimated based on information indicating changes in physiological indices acquired during the course. However, this is not limited to this, and each time information indicating the participant's physiological indices is acquired during the course, the level of concentration for each scene may be estimated based on the acquired physiological indices.
[0058] (2) The concentration level estimated for each scene may be used to automatically adjust or improve the course before the course ends. For example, based on information about scenes that were not watched with concentration, the content of the course may be automatically adjusted or improved, such as by presenting scenes of a level of difficulty that the student can understand.
[0059] (3) In the above embodiment, the processing functions of the concentration level estimation device SV are provided on a server computer on the Web or the cloud. However, the processing functions of the concentration level estimation device SV may be provided on a server computer located on a local area network, such as in a workplace or community, or on a personal computer shared by multiple users. Furthermore, the functions of the concentration level estimation device SV may be distributed across multiple server computers and personal computers used by users, etc.
[0060] (4) In addition, various modifications can be made to the type and content of education or training, the content used in the training, the type of physiological indicators and the method for calculating their characteristics, the processing functions of the concentration estimation device and their processing procedures and processing contents, etc., without departing from the spirit of this invention.
[0061] Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, when implementing the present invention, specific configurations according to the embodiments may be appropriately adopted.
[0062] In short, this invention is not limited to the above-described embodiments, and in the implementation stage, the components can be modified and embodied without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments. For example, some components may be omitted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined.
[0063] SV: concentration level estimation device UT1 to UTn: user terminal MT: administrator terminal NW: network 1: control unit 2: program storage unit 3: data storage unit 4: communication I / F unit 5: bus 11: correlation information acquisition processing unit 12: content creation processing unit 13: content playback processing unit 14: physiological index acquisition processing unit 15: concentration level estimation processing unit 16: estimated information transmission processing unit 31: correlation information storage unit 32: content storage unit 33: physiological index storage unit 34: estimated information storage unit
Claims
1. A system for providing training to students using content, comprising: a terminal used by the student; and a concentration estimation device capable of communicating with the terminal, wherein the terminal comprises: a reception processing unit for receiving and playing the content sent from the concentration estimation device; and a transmission processing unit for measuring information representing a physiological index of the student during a period in which the content is being played back and transmitting the measured information representing the physiological index to the concentration estimation device, wherein the concentration estimation device comprises: a first processing unit for acquiring information representing a correlation between the physiological index of a person obtained in advance in a physiological-psychological experiment and a level of concentration, a second processing unit for creating the content as data in which sections corresponding to a standby state and sections corresponding to a target presentation state alternate in accordance with the scenario data based on scenario data related to the training and the information representing the correlation, a third processing unit for transmitting the content to the terminal and acquiring information representing the physiological index of the student from the terminal during a period in which the content is being played back, and a fourth processing unit for estimating the level of concentration of the student based on the acquired information representing the physiological index and the information representing the correlation.
2. A concentration estimation device in a system for providing training to students using content, which estimates the student's level of concentration for the training, comprising: a first process for acquiring information showing a correlation between a person's physiological index obtained in advance in a physiological-psychological experiment and the level of concentration; a second processing section for creating the content, in which sections corresponding to a waiting state and sections corresponding to a target presentation state alternate in accordance with the scenario data, based on scenario data related to the training and the information showing the correlation; a third processing section for acquiring information showing the physiological index of the student during the period in which the created content is presented to the student; and a fourth processing section for estimating the student's level of concentration based on the acquired information showing the physiological index and the information showing the correlation.
3. The concentration estimation device described in claim 2, wherein the fourth processing unit estimates the concentration level of the student for each section of the content based on the acquired information representing the physiological index and the information representing the correlation, and identifies the section in which the concentration level of the student is below a threshold value based on the estimation result.
4. The concentration estimation device described in claim 2, wherein the fourth processing unit determines the change in concentration level for each participant over the entire period of the content based on the information representing the acquired physiological index and the information representing the correlation.
5. A concentration estimation device as described in claim 2, further comprising a fifth processing unit that notifies the instructor of the training of information representing the estimated result of the concentration level of the participant obtained by the fourth processing unit.
6. A method of estimating concentration in a system for providing training to students using content, executed by an information processing device which estimates the level of concentration of the students in the training, comprising: a step of acquiring information showing the correlation between a person's physiological index obtained in advance in a psychophysiological experiment and the level of concentration; a step of creating content data in which sections corresponding to a waiting state and sections corresponding to a target presentation state alternate in accordance with the scenario data based on scenario data related to the training and the information showing the correlation; a step of acquiring information showing the physiological index of the students during the period in which the content data is presented to the students; and a step of estimating the level of concentration of the students based on the acquired information showing the physiological index and the information showing the correlation.
7. A program for causing a processor provided in a concentration estimation device to execute at least one of the processes executed by the first to fifth processing units provided in the concentration estimation device according to any one of claims 2 to 5.
Citation Information
Patent Citations
Mental disease determination apparatus
JP2018094029A
Biological measurement apparatus, biological measurement method, and determination apparatus
WO2019124023A1
