Teaching material evaluation system and teaching material evaluation method

The teaching material evaluation system addresses the inaccuracy of playback speed-based evaluation by using gaze point detection and layout information to assess learner engagement, enhancing the accuracy of material evaluation.

JP7782486B2Active Publication Date: 2025-12-09TOYOTA JIDOSHA KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023016204
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-02-06
Publication Date
2025-12-09
Estimated Expiration
2043-02-06

AI Technical Summary

Technical Problem

Evaluating the difficulty level of electronic learning materials using playback speed is inappropriate when the learner is not actively watching the material.

Method used

A teaching material evaluation system that utilizes gaze point detection and arrangement information to evaluate learning materials, considering factors such as gaze time on components, component size, and movement range of the learner's viewpoint.

Benefits of technology

Enables appropriate evaluation of learning materials by determining learner engagement and understanding through gaze point detection and layout analysis, improving the accuracy of material assessment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007782486000001
    Figure 0007782486000001
  • Figure 0007782486000002
    Figure 0007782486000002
  • Figure 0007782486000003
    Figure 0007782486000003
Patent Text Reader

Abstract

To provide a technique which can properly evaluate a teaching material displayed in a display unit.SOLUTION: A teaching material evaluation system for evaluating a teaching material displayed in a display unit includes: a storage unit for storing arrangement information as information regarding the arrangement of a plurality of components forming a teaching material on a display unit; a detection unit for detecting the point of vision of a learner on the display unit for a period of time when the teaching material is displayed in the display unit; and an evaluation unit for evaluating the teaching material by using the result of detection of the line of vision and the arrangement information.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a teaching material evaluation system and a teaching material evaluation method. [Background technology]

[0002] There is known a technique for evaluating the difficulty level of electronic learning materials using a playback speed selected by a learner when viewing the electronic learning materials (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-011290 Summary of the Invention [Problem to be solved by the invention]

[0004] If a learner is not watching the material while it is being played, evaluating the material using the playback speed may not be an appropriate evaluation. Therefore, a technology that can more appropriately evaluate material is desired. [Means for solving the problem]

[0005] The present disclosure can be realized in the following forms.

[0006] (1) According to a first aspect of the present disclosure, there is provided a teaching material evaluation system for evaluating teaching materials displayed on a display unit, the teaching material evaluation system including: a storage unit that stores arrangement information that is information regarding the arrangement of a plurality of components that make up the teaching material on the display unit; a detection unit that detects a learner's gaze point on the display unit while the teaching material is displayed on the display unit; and an evaluation unit that evaluates the teaching material using the gaze point detection result and the arrangement information. According to this type of learning material evaluation system, the learning material is evaluated using the detection result of the learner's viewpoint and the placement information, so that the learning material can be evaluated appropriately. (2) In the teaching material evaluation system of the above aspect, the evaluation unit may evaluate the teaching material according to the time the gaze point remains on each of the constituent elements. According to this type of learning material evaluation system, the learning material can be evaluated according to the time that the learner's gaze remains on each component, and therefore the learning material can be evaluated appropriately. (3) In the teaching material evaluation system of the above aspect, the evaluation unit may evaluate the teaching material using the size of each of the components on the display unit and the size of the range of movement of the viewpoint. According to this type of learning material evaluation system, the learning material can be evaluated using the size of each component element on the display unit and the size of the range of movement of the learner's viewpoint, so that the learning material can be evaluated appropriately. (4) In the teaching material evaluation system of the above aspect, the evaluation unit may evaluate the teaching material using the detection results of the viewpoints of a plurality of learners and the arrangement information. According to this type of learning material evaluation system, learning materials can be evaluated more appropriately than in a system in which learning materials are evaluated using the detection results of one learner's viewpoint. (5) According to a second aspect of the present disclosure, there is provided a teaching material evaluation method for evaluating teaching material displayed on a display unit, which includes: preparing layout information that is information regarding the layout of a plurality of components that make up the teaching material on the display unit; detecting a learner's gaze point on the display unit while the teaching material is displayed on the display unit; and evaluating the teaching material using the gaze point detection result and the layout information. According to this type of teaching material evaluation method, the teaching material is evaluated using the detection result of the learner's viewpoint and the arrangement information, so that the teaching material can be appropriately evaluated. The present disclosure can be realized in various forms other than a teaching material evaluation system and a teaching material evaluation method. For example, the present disclosure can be realized in the form of a teaching material evaluation device, a teaching material evaluation program, etc. The placement information can be created using, for example, deep learning. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is an explanatory diagram schematically showing the configuration of a teaching material evaluation system. [Figure 2] FIG. 1 is an explanatory diagram showing how a learner studies using teaching materials. [Figure 3] 10 is a flowchart showing the contents of a viewpoint detection process. [Figure 4] 10 is a flowchart showing the contents of a learning material evaluation process. [Figure 5] FIG. 10 is an explanatory diagram showing the viewpoint detection result and the arrangement information superimposed on each other. DETAILED DESCRIPTION OF THE INVENTION

[0008] A. First embodiment: 1 is an explanatory diagram showing a schematic configuration of a learning material evaluation system 10 according to the first embodiment. The learning material evaluation system 10 includes a distribution server 100, a learning computer 200, a display device 210, and an eye-tracking device 220.

[0009] The distribution server 100 distributes and evaluates the teaching material TD. The distribution server 100 is configured as a computer including a processor 101, a memory 102, an input / output interface 103, and an internal bus 104. The processor 101, the memory 102, and the input / output interface 103 are connected via the internal bus 104 to enable bidirectional communication. The memory 102 stores the teaching material TD, layout information LD, and a teaching material evaluation program PG1. The teaching material TD is electronic teaching material displayed on a display unit such as a monitor. Specifically, the teaching material TD is electronic teaching material in the form of video or slides in which pages are changed by a learner's operation. The teaching material TD is composed of multiple components. The components include, for example, text, diagrams, and images. The layout information LD is information regarding the layout of each component of the teaching material TD on the display unit. The processor 101 executes the teaching material evaluation program PG1, causing the computer to function as the distribution server 100. A display device 110 is connected to the input / output interface 103. The display device 110 is, for example, a liquid crystal display. The evaluation results of the teaching material TD are displayed on the display device 110. The processor 101 may be called an evaluation unit, and the memory 102 may be called a storage unit.

[0010] The learning computer 200 is connected to the distribution server 100 via wired or wireless communication. The learning computer 200 displays the learning material TD distributed from the distribution server 100 and detects the learner's gaze while the learning material TD is being displayed. The learning computer 200 is configured as a computer including a processor 201, a memory 202, an input / output interface 203, and an internal bus 204. The processor 201, the memory 202, and the input / output interface 203 are connected via the internal bus 204 to enable bidirectional communication. A gaze detection program PG2 is stored in the memory 202. When the processor 201 executes the gaze detection program PG2, the computer functions as the learning computer 200. A display device 210 and an eye-gaze tracking device 220 are connected to the input / output interface 203. The display device 210 is, for example, a liquid crystal display. The learning material TD is displayed on the display device 210. The display device 210 may also be referred to as a display unit.

[0011] The gaze tracking device 220 detects the gaze of the learner. In this embodiment, the gaze tracking device 220 is fixed to the display device 210. The gaze tracking device 220 tracks the movement of the learner's eyeball by irradiating the learner's face with infrared light and capturing an image of the learner's face with an infrared camera, and detects the learner's gaze based on the eyeball movement. In other embodiments, the gaze tracking device 220 may be fixed to the learner's head instead of the display device 210. The gaze tracking device 220 may be a type that tracks the movement of the learner's eyeball using electrodes placed around the learner's eyes and detects the learner's gaze based on the eyeball movement. The gaze tracking device 220 may also be referred to as a detection unit.

[0012] 2 is an explanatory diagram showing how a learner PL studies using educational material TD. In this embodiment, the educational material TD is electronic educational material in the form of moving images with audio, and the learner PL studies by viewing the educational material TD displayed on the display device 210. The content of the educational material TD displayed on the display device 210 is called the display screen SN. When the educational material TD is electronic educational material in the form of moving images, the display screen SN changes at a predetermined playback position. When the educational material TD is electronic educational material in the form of slides, the display screen SN changes by operation of the learner PL.

[0013] The display screen SN shown in FIG. 2 includes three sentences, two diagrams, and a video of the lecturer giving an explanation. In the following explanation, the area on the display screen SN where the components are displayed is referred to as the component display area. The component display area where the sentences are displayed is referred to as the sentence display area, the component display area where the diagrams are displayed is referred to as the diagram display area, and the component display area where a person such as the lecturer is displayed is referred to as the person display area. When the sentence display area, the diagram display area, and the person display area are not particularly distinguished from each other in the explanation, the sentence display area, the diagram display area, and the person display area are all referred to as the component display areas. The display screen SN shown in FIG. 2 has three sentence display areas RT1 to RT3, two diagram display areas RZ1 to RZ2, and one person display area RP1.

[0014] The layout information LD shown in FIG. 1 includes information on the position and size of each component display area as well as information on the occupancy rate of each component. The component occupancy rate is the ratio of the total area of ​​each component display area displayed on the display screen SN to the area of ​​the display screen SN. In this embodiment, the layout information LD further includes information on the type of component displayed in each component display area and information on the number of characters of the text displayed in each character display area. The layout information LD can be created using a trained model trained by deep learning so that the position, size, and type of each component display area are determined when the teaching material TD is input. The layout information LD may be created by an evaluator who evaluates the teaching material TD, rather than by a trained model.

[0015] 3 is a flowchart showing the contents of the viewpoint detection process. The viewpoint detection process is executed by the processor 201 of the learning computer 200. When the viewpoint detection process starts, in step S110, the processor 201 starts displaying the learning material TD on the display device 210. In the following description, the period during which the learning material TD is displayed is referred to as the learning material display period.

[0016] In step S120, the processor 201 uses the eye-tracking device 220 to detect the viewpoint VP of the learner PL at each time during the teaching material display period, and records the position of the viewpoint VP at each time in association with the display screen SN displayed on the display device 210 at each time in the memory 202. When the eye-tracking device 220 is of a type that outputs the position of the viewpoint VP at each time in association with the display screen SN displayed on the display device 210 at each time, the processor 201 does not need to associate the position of the viewpoint VP at each time with the display screen SN displayed on the display device 210 at each time.

[0017] In step S130, the processor 201 transmits the viewpoint detection result VD recorded in the memory 202 to the distribution server 100. After that, the processor 201 ends this process.

[0018] FIG. 4 is a flowchart showing the contents of the learning material evaluation process, and FIG. 5 is an explanatory diagram showing the viewpoint detection result VD and the arrangement information LD superimposed on each other. The learning material evaluation process is executed by the processor 101 of the distribution server 100. When the learning material evaluation process starts, in step S210, the processor 101 obtains the arrangement information LD prepared in advance from the memory 102. The arrangement information LD includes information on the position and size of each component display area on each display screen SN. In step S220, the processor 101 obtains the viewpoint detection result VD transmitted from the learning computer 200. The viewpoint detection result VD includes information on the position of the viewpoint VP at each time and information on the display screen SN displayed at each time. Note that the order of steps S210 and S220 may be reversed.

[0019] In step S230, the processor 101 performs analysis using the viewpoint detection result VD and the placement information LD. In FIG. 5, the position of the viewpoint VP at each time during the period when one display screen SN is displayed is represented by a circle, and the movement path of the viewpoint VP is represented by an arrow. The diameter of the circle represents the length of time the viewpoint VP stayed at the center of the circle. The longer the time the viewpoint VP stayed at the center of the circle, the larger the diameter of the circle. In this embodiment, the processor 101 overlays the viewpoint detection result VD and the placement information LD to calculate the gaze time for each component. The gaze time refers to the time the viewpoint VP stayed on the component display area. Furthermore, the processor 101 calculates the area of ​​the movement range of the viewpoint VP on the display screen SN from the movement path of the viewpoint VP.

[0020] In step S240, the processor 101 evaluates the teaching material TD using the analysis results and displays the evaluation results on the display device 110. In this embodiment, the processor 101 determines the quality of each display screen SN of the teaching material TD. If the number of display screens SN determined to be "poor" is one or more, the processor 101 gives a negative evaluation to the teaching material TD, and if the number of display screens SN determined to be "poor" is zero, the processor 101 gives a positive evaluation to the teaching material TD. The processor 101 determines the quality of each display screen SN using the gaze time for each component displayed on each display screen SN and the ratio of the size of the movement range of the viewpoint VP to the size of the teaching material TD on the display device 210. More specifically, the processor 101 determines that the display screen SN to be evaluated is "good" if both the following conditions A and B are satisfied. The processor 101 determines that the display screen SN to be evaluated is "poor" if at least one of the following conditions A and B is not satisfied. Condition A: The gaze time for each component is within a predetermined standard range for each component. Condition B: The ratio of the area of ​​the movement range of the viewpoint VP to the area of ​​the display screen SN to be judged is equal to or greater than a predetermined reference value according to the occupancy rate of the components of each display screen SN.

[0021] If the gaze time on a component is less than the lower limit of the reference range, it is considered that the content of the component is not interesting to the learner PL. Therefore, it is preferable to improve the content of the component so that it is interesting to the learner PL. If the gaze time on a component exceeds the upper limit of the reference range, it is considered that the content of the component is difficult for the learner PL to understand. Therefore, it is preferable to improve the content of the component so that it is easy for the learner PL to understand. If the component is a sentence, it is preferable to determine the upper and lower limits of the reference range based on the number of characters in the sentence. If the ratio of the area of ​​the movement range of the viewpoint VP to the area of ​​the display screen SN to be evaluated is less than the reference value, it is considered that the content of the display screen SN to be evaluated is not sufficiently viewed by the learner PL, that is, the content of the display screen SN to be evaluated is not sufficiently conveyed to the learner PL. Therefore, it is preferable to improve the arrangement of each component on the display screen SN to be evaluated. In another embodiment, instead of judging the quality of each display screen SN, the processor 101 may, for example, calculate a score for each display screen SN and evaluate each display screen SN by relative evaluation using the score. After step S240, processor 101 ends this process. The method realized by the viewpoint detection process and the learning material evaluation process may be referred to as a learning material evaluation method.

[0022] According to the teaching material evaluation system 10 of this embodiment described above, the processor 101 of the distribution server 100 evaluates the teaching material TD using the viewpoint detection result VD and the placement information LD, and therefore it is possible to grasp whether the learner PL has viewed each component of the teaching material TD. Therefore, the teaching material TD can be appropriately evaluated.

[0023] Furthermore, in this embodiment, the processor 101 evaluates the teaching material TD according to the amount of time the learner PL gazes at each component element. Therefore, since the processor 101 can evaluate the teaching material TD after grasping the amount of time the learner PL looked at the components of the teaching material TD, the teaching material TD can be appropriately evaluated.

[0024] In this embodiment, the processor 101 evaluates the teaching material TD using the ratio of the area of ​​the movement range of the viewpoint VP to the area of ​​the display screen SN. Therefore, the teaching material TD can be evaluated after understanding the range of the teaching material TD viewed by the learner PL, and therefore the teaching material TD can be appropriately evaluated.

[0025] B. Other Embodiments: (B1) The learning material evaluation system 10 of the first embodiment described above may include a plurality of learning computers 200, and the processor 101 of the distribution server 100 may evaluate the learning material TD using the viewpoint detection results VD acquired from the plurality of learning computers 200. In this case, it becomes easier to collect the viewpoint detection results VD of a plurality of learners PL. By evaluating the learning material TD using the viewpoint detection results VD of a plurality of learners PL, it is possible to more appropriately evaluate the learning material TD compared to a form in which the learning material TD is evaluated using the viewpoint detection result VD of a single learner PL.

[0026] (B2) In the learning material evaluation system 10 of the first embodiment described above, the processor 101 of the distribution server 100 evaluates the learning material TD using condition A and condition B. In contrast, the processor 101 may evaluate the learning material TD using condition B without using condition A, or may evaluate the learning material TD using condition A without using condition B.

[0027] (B3) In the learning material evaluation system 10 of the first embodiment described above, the distribution server 100 and the learning computer 200 are provided separately. Alternatively, the distribution server 100 and the learning computer 200 may be integrated. For example, without the distribution server 100, the learning material TD and the placement information LD may be stored in the memory 202 of the learning computer 200, and the evaluation of the learning material TD may be performed by the processor 201 of the learning computer 200. In this case, the learning computer 200 may be called a learning material evaluation device.

[0028] The present disclosure is not limited to the above-described embodiments and can be realized in various configurations without departing from the spirit thereof. For example, the technical features in the embodiments corresponding to the technical features in each aspect described in the Summary of the Invention section can be appropriately replaced or combined to solve some or all of the above-described problems or achieve some or all of the above-described effects. Furthermore, if a technical feature is not described as essential in this specification, it can be appropriately deleted. [Explanation of symbols]

[0029] 10...teaching material evaluation system, 100...distribution server, 101...processor, 102...memory, 103...input / output interface, 104...internal bus, 110...display device, 200...learning computer, 201...processor, 202...memory, 203...input / output interface, 204...internal bus, 210...display device, 220...eye-gaze tracking device

Claims

1. A teaching material evaluation system for evaluating teaching materials displayed on a display unit, a storage unit that stores layout information that is information regarding the layout of a plurality of components that make up the teaching material on the display unit; a detection unit that detects a gaze point of a learner on the display unit during a period when the teaching material is displayed on the display unit; an evaluation unit that evaluates the teaching material using the viewpoint detection result and the placement information; Equipped with The evaluation unit evaluates the teaching material using the size of each of the components on the display unit and the size of the range of movement of the viewpoint.

2. The teaching material evaluation system according to claim 1, The evaluation unit further evaluates the educational material according to the time the gaze point remains on each of the components.

3. The teaching material evaluation system according to claim 1, The evaluation unit evaluates the teaching material using the detection results of the viewpoints of multiple learners and the placement information.

4. A teaching material evaluation method executed by a computer for evaluating teaching materials displayed on a display unit, comprising: preparing arrangement information which is information regarding the arrangement of a plurality of components constituting the teaching material on the display unit; detecting a learner's gaze point on the display unit while the teaching material is displayed on the display unit; evaluating the teaching material using the viewpoint detection result and the placement information; Equipped with In the step of evaluating the teaching material, the teaching material is evaluated using the size of each of the components on the display unit and the size of the range of movement of the viewpoint.

Citation Information

Patent Citations

  • Multimedia teaching interactive method and system

    CN109272794A

  • Electronic teaching material analysis server, electronic teaching material analysis method, and program for electronic teaching material analysis server

    JP2015011290A

  • Learning support system, learning support device, and learning support method

    JP2018124483A

  • Calculation program, calculation method and calculation device

    JP2022081260A