Concentration level determination program, concentration level determination method, and concentration level determination device

Abstract

To accurately determine the concentration of a user.SOLUTION: A concentration determination device 100 specifies a first visual line position 101 on an image 110 of a user at first timing and specifies a first specific region 111 corresponding to the first timing included in the image 110. The concentration determination device 100 specifies a second visual line position 102 on the image 110 of the user at second timing when the first specific region 111 is different from the first visual line position 101. The concentration determination device 100 specifies the transition of the visual line position of the user on the basis of the first visual line position 101 and the second visual line position 102. The concentration determination device 100 specifies a second region 112 corresponding to third timing included in the image 110 and specifies the positional change between the first specific region 111 and the second specific region 112. The concentration determination device 100 determines the concentration of the user on the basis of the comparison between the positional change and the transition.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a concentration level determination program, a concentration level determination method, and a concentration level determination device. [Background technology]

[0002] Conventionally, there is a technology that allows a user to view content such as a lecture video via a network. In this case, unlike a face-to-face lecture, it is difficult for the lecturer to grasp the user's attitude toward the lecture, and therefore it may be necessary to automatically determine the degree to which the user is focused on the content (degree of concentration). In response to this, for example, it is possible to determine that the degree of concentration of the user is relatively high when the user faces a direction designated in advance by the lecturer at a specific timing.

[0003] Prior art includes, for example, a technique for detecting the state of a person detected from an image captured by at least one imaging unit and calculating the degree of concentration from the state of the person detected. For example, there is a technique for determining whether a student is concentrating on a lecture based on an image captured to capture a student attending a lecture. For example, there is a technique for acquiring object regions corresponding to a plurality of objects included in a video and determining a method for connecting the object regions based on the order of the plurality of objects and the positions of the object regions. For example, there is a technique for acquiring data related to an input based on the student's intention using a sensor located away from the student, analyzing the acquired data, and determining whether the input was made in a window in which the teaching material is displayed or in another window, thereby measuring the student's concentration level. For example, there is a technique for monitoring the student's behavior using a separate image sensor, analyzing the monitoring results, automatically evaluating the concentration level from the student's behavior, and dealing with the student's behavior based on the evaluation. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-100033 A [Patent Document 2] Patent Publication No. 2021-018316 [Patent Document 3] JP 2014-207662 A [Patent Document 4] US Patent Application Publication No. 2012 / 0237920 [Patent Document 5] US Patent Application Publication No. 2013 / 0201319 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the conventional technology, it is difficult to accurately determine the concentration level of a user. For example, even if a user does not face a pre-specified direction, the user is not necessarily not concentrating on the content, and it is difficult to accurately determine the concentration level of a user based on whether the user faces a pre-specified direction.

[0006] In one aspect, the present invention aims to accurately determine a user's concentration level. [Means for solving the problem]

[0007] According to one embodiment, a concentration degree determination program, a concentration degree determination method, and a concentration degree determination device are proposed which identify a first gaze position on an image of a user at a first timing, and if the first gaze position is different from a first specific area contained in the image corresponding to the first timing, identify a transition of the user's gaze position based on the first gaze position and a second gaze position on the image of the user at a second timing prior to the first timing, and determine a concentration degree indicating the degree to which the user's attention is focused based on a comparison of the identified transition with a position change between the first specific area and a second specific area contained in the image corresponding to a third timing after the first timing. Effect of the Invention

[0008] According to one aspect, it is possible to accurately determine the concentration level of a user. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is an explanatory diagram illustrating an example of a concentration level determination method according to an embodiment. [Diagram 2] FIG. 2 is an explanatory diagram illustrating an example of a concentration level determination system 200. As shown in FIG. [Diagram 3] FIG. 3 is a block diagram showing an example of a hardware configuration of the concentration level determination device 100. As shown in FIG. [Figure 4] FIG. 4 is a diagram illustrating an example of the contents of the gaze position management table 400. As shown in FIG. [Diagram 5] FIG. 5 is a diagram illustrating an example of the contents of the retention point management table 500. As shown in FIG. [Figure 6] FIG. 6 is an explanatory diagram of an example of the contents of the important area management table 600. As shown in FIG. [Figure 7] FIG. 7 is a block diagram showing an example of the hardware configuration of the user device 201. As shown in FIG. [Figure 8] FIG. 8 is a block diagram showing an example of a functional configuration of the concentration level determination device 100. As shown in FIG. [Figure 9] FIG. 9 is a block diagram showing an example of a functional configuration of the concentration level determination device 100. As shown in FIG. [Figure 10] FIG. 10 is an explanatory diagram showing an example of the operation of the concentration level determination device 100. As shown in FIG. [Figure 11] FIG. 11 is an explanatory diagram (part 1) showing a specific example of how to recognize an important region. [Figure 12] FIG. 12 is an explanatory diagram (part 2) showing a specific example of recognizing an important region. [Figure 13] FIG. 13 is an explanatory diagram showing a specific example of outputting the determined result. [Figure 14] FIG. 14 is a flowchart illustrating an example of an overall processing procedure. [Figure 15] FIG. 15 is a flowchart illustrating an example of an evaluation process procedure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a concentration level determination program, a concentration level determination method, and a concentration level determination device according to the present invention will be described in detail with reference to the accompanying drawings.

[0011] (One Example of a Concentration Degree Determination Method According to an Embodiment) FIG. 1 is an explanatory diagram showing one example of a concentration level determination method according to an embodiment. A concentration level determination device 100 is a computer for determining a user's concentration level on content. The content is, for example, an image related to a lecture or the like. The image is specifically a still image. The image may be specifically a moving image.

[0012] The concentration level indicates the degree to which the user is focused. The concentration level may indicate, for example, how much the user is paying attention to the content and is not distracted by other things. The concentration level may indicate, for example, how proactive the user is in viewing the content. The concentration level may indicate, for example, how much the user understands the content and is able to keep up with the lecturer's explanation.

[0013] 2. Description of the Related Art Conventionally, there have been services that allow users to view content related to lectures and attend lectures via a network. As communication technology advances, there is a tendency for opportunities to use such services to increase.

[0014] In face-to-face lectures, the lecturer can see the user directly, and it is easy to grasp the user's attitude toward the class, and it is easy to evaluate the user's concentration on the content. On the other hand, in such a lecture service, the lecturer may not be able to see the user directly, and it may be difficult to grasp the user's attitude toward the class, and it may be difficult to evaluate the user's concentration on the content.

[0015] For this reason, it is required to automatically determine the degree of concentration of a user on content. However, with conventional technology, it is difficult to accurately determine the degree of concentration of a user on content. For example, a method is conceivable in which the facial expression of a user viewing content is recognized to determine the degree of concentration of the user on the content. With this method, there is a problem that it is difficult to accurately determine the degree of concentration of a user. For example, with this method, the degree of concentration of a user is difficult to accurately determine because the facial expression of a user is relatively low dependent on the degree of concentration of the user.

[0016] Another possible method is to detect the direction in which the user is facing while viewing content, and determine that the user's level of concentration is relatively high if the user faces a direction designated in advance by the instructor at a specified timing. The direction is, for example, a direction toward a certain point on the image that is the content. The designated direction is, for example, a direction toward a point on the image that is the content where the instructor is explaining at a specified timing. The designated direction is, specifically, a direction toward a point that the instructor determines will show important content in the lecture.

[0017] This method has a problem that it is difficult to accurately determine the concentration level of the user. For example, in this method, even if the user does not face a pre-specified direction, it does not necessarily mean that the user is not concentrating on the content, so it is difficult to accurately determine the concentration level of the user. Specifically, if the direction to the part where the lecturer is explaining at a predetermined timing is pre-specified, the user may face the direction to the part where the lecturer is going to explain next at the predetermined timing and try to understand the contents of the content before the lecturer explains. In this case, although it is preferable to evaluate the user's concentration level as relatively high, this method evaluates the user's concentration level as relatively low, making it difficult to accurately determine the user's concentration level.

[0018] Therefore, in this embodiment, a concentration level determination method capable of accurately determining a user's concentration level based on a transition of the user's gaze position on an image will be described.

[0019] 1, the concentration level determination device 100 can detect the gaze position of a target user viewing an image 110. The gaze position is a point on the image 110 where the target user focuses his or her gaze. The gaze position is indicated by, for example, coordinates on the image 110. The gaze position may be indicated by, for example, a range on the image 110. It is assumed that the gaze of the target user moves along a line 120 on the image 110.

[0020] Furthermore, the concentration level determination device 100 identifies a specific area on the image 110. The specific area is, for example, an area showing relatively important content in a lecture. The specific area is, for example, an area showing a mathematical formula. Specifically, the specific area may be an area designated by a lecturer. Specifically, the specific area may be an area where the gaze positions of a certain number or more users are concentrated. The concentration level determination device 100 identifies, for example, a first specific area 111 (A) and a second specific area (B) on the image 110.

[0021] (1-1) The concentration level determination device 100 identifies a first gaze position 101 on the image 110 of the target user at a first timing. The first timing is, for example, a timing designated in advance by the instructor. The first timing may be, for example, a timing when the instructor utters a predetermined keyword. The first timing may be, for example, a timing when a certain number of users or more perform a predetermined action. Specifically, the first timing may be a timing when the gaze positions of a certain number of users or more are concentrated in an area of ​​a certain size. The first timing is, for example, a time point. The first timing may be, for example, a period of time. A dwell point on the image 110 where the gaze of the target user dwells at the first timing and which represents the gaze position of the target user may be adopted as the first gaze position 101.

[0022] (1-2) The concentration level determination device 100 identifies a first specific area 111 included in the image 110 and corresponding to a first timing. For example, the concentration level determination device 100 identifies the first specific area 111, from among the identified specific areas on the image 110, that corresponds to the content or location being explained by the instructor at the first timing. Specifically, the concentration level determination device 100 identifies the first specific area 111, from among the identified specific areas on the image 110, that is closest to the location designated by the instructor with a pointer at the first timing. The pointer is a mark displayed superimposed on the image 110.

[0023] (1-3) The concentration level determination device 100 determines whether the identified first specific area 111 and the identified first gaze position 101 match. For example, when the identified first specific area 111 contains all or a part of the identified first gaze position 101, the concentration level determination device 100 determines that they match. On the other hand, when the identified first specific area 111 does not contain all or a part of the identified first gaze position 101, the concentration level determination device 100 determines that they do not match.

[0024] (1-4) When the first specific area 111 corresponding to the first timing included in the image 110 does not match and is different from the first gaze position 101, the concentration level determination device 100 identifies the second gaze position 102 on the image 110 of the target user at the second timing. The second timing is, for example, a timing before the first timing. The second timing is, for example, a timing when the gaze of the target user stays at the same place on the image 110 for a certain period of time. The second timing is, for example, a point in time. The second timing may be, for example, a period of time. A dwell point on the image 110 where the gaze of the target user stays at the second timing and which represents the gaze position of the target user may be adopted as the second gaze position 102.

[0025] (1-5) The concentration level determination device 100 identifies a transition of the gaze position of the target user based on the identified first gaze position 101 and the identified second gaze position 102. The concentration level determination device 100 identifies, for example, a first line segment that connects the identified first gaze position 101 and the identified second gaze position 102 and indicates the transition of the gaze position of the target user.

[0026] (1-6) The concentration level determination device 100 identifies a second specific area 112 corresponding to a third timing included in the image 110. The third timing is, for example, a timing after the first timing. The third timing is, for example, a timing designated in advance by the instructor. The third timing may be, for example, a timing when the instructor utters a predetermined keyword. The third timing may be, for example, a timing when a certain number or more of users perform a certain action. Specifically, the third timing may be a timing when the gaze positions of a certain number or more of users are concentrated in an area of ​​a certain size. The third timing is, for example, a point in time. The third timing may be, for example, a period of time.

[0027] The concentration level determination device 100, for example, identifies a second specific area 112 that corresponds to the content or location being explained by the instructor at the third timing, among the specific areas on the identified image 110. Specifically, the concentration level determination device 100 identifies the second specific area 112 that is closest to the location designated by the instructor with the pointer at the third timing, among the specific areas on the identified image 110.

[0028] (1-7) The concentration level determination device 100 identifies a position change between the identified first specific area 111 and the identified second specific area 112. The concentration level determination device 100 identifies, for example, a second line segment that connects the identified first specific area 111 and the identified second specific area 112 and indicates a position change between the identified first specific area 111 and the identified second specific area 112.

[0029] (1-8) The concentration level determination device 100 determines the concentration level of the target user based on a comparison between the identified position change and the identified transition. The concentration level determination device 100 determines the concentration level of the target user based on, for example, the degree of similarity between the identified position change and the identified transition.

[0030] The degree of similarity can be evaluated, for example, by the distance between the first line segment and the second line segment. Specifically, the smaller the distance between the first line segment and the second line segment, the greater the degree of similarity between the identified position change and the identified transition is evaluated to be. Specifically, the concentration level determination device 100 determines the concentration level of the target user based on the distance between the identified first line segment and the identified second line segment.

[0031] Here, if the degree of similarity between the identified position change and the identified transition is relatively high, it is considered that the target user understands the flow of the lecture, has a desire to understand the content of the lecture, is not incapable of understanding the content of the lecture, and can keep up with the lecturer's explanation. Therefore, if the degree of similarity between the identified position change and the identified transition is relatively high, it is considered preferable to determine that the target user's concentration level is relatively high.

[0032] On the other hand, if the degree of similarity between the identified position change and the identified transition is relatively small, it is considered that the target user has difficulty in understanding the flow of the lecture, has little motivation to understand the content of the lecture, has difficulty in understanding the content of the lecture, or is unable to keep up with the lecturer's explanation. Therefore, if the degree of similarity between the identified position change and the identified transition is relatively small, it is considered preferable to determine that the target user's concentration level is relatively low.

[0033] Therefore, specifically, when the distance between the identified first line segment and the identified second line segment is equal to or greater than the threshold, the concentration level determination device 100 determines that the concentration level of the target user is relatively high. On the other hand, specifically, when the distance between the identified first line segment and the identified second line segment is less than the threshold, the concentration level determination device 100 determines that the concentration level of the target user is relatively low.

[0034] (1-9) The concentration level determination device 100 outputs the determined result. The output format may be, for example, display on a display, print out on a printer, transmit to another computer, or store in a memory area. The concentration level determination device 100 outputs the determined result so that it can be referred to by an instructor, for example. The concentration level determination device 100 may output the determined result so that it can be referred to by the target user, for example. When the concentration level determination device 100 determines that the target user's concentration level is relatively low, for example, it may output an alert so that it can be referred to by the target user. The concentration level determination device 100 may output the determined result so that it can be used for statistical processing, for example.

[0035] This allows the concentration level determination device 100 to accurately determine the concentration level of the target user. For example, even if the target user does not face the first specific area 111 at the first timing, the concentration level determination device 100 can appropriately determine whether the target user is concentrating or not. Specifically, if the target user faces the direction of the location where the lecturer is going to explain later at the first timing and understands the flow of the lecture, the concentration level determination device 100 can appropriately determine that the concentration level of the target user is relatively high.

[0036] Here, the case where the concentration level determination device 100 determines whether the concentration level of the target user is relatively high or relatively low has been described, but the present invention is not limited to this. For example, the concentration level determination device 100 may calculate the concentration level of the target user as a value. Specifically, the concentration level determination device 100 calculates a value indicating the distance between the identified first line segment and the identified second line segment, or a value obtained by weighting the distance, as the concentration level of the target user.

[0037] Here, the case where the concentration level determination device 100 determines the concentration level of the target user based on a comparison between the position change between two specific areas and the transition between two gaze positions has been described, but is not limited to this. For example, the concentration level determination device 100 may determine the concentration level of the target user based on a comparison between the position change in three or more specific areas and the transition in three or more gaze positions. Also, for example, the number of areas involved in the position change and the number of gaze positions involved in the transition may be different.

[0038] (An example of a concentration determination system 200) Next, an example of a concentration level determination system 200 to which the concentration level determination device 100 shown in FIG. 1 is applied will be described with reference to FIG.

[0039] 2 is an explanatory diagram showing an example of a concentration level determination system 200. In FIG. 2, the concentration level determination system 200 includes the concentration level determination device 100, a user-side device 201, and a provider-side device 202.

[0040] In the concentration level determination system 200, the concentration level determination device 100 and the user side device 201 are connected via a wired or wireless network 210. The network 210 is, for example, a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, etc. The concentration level determination device 100 and the provider side device 202 are connected via the wired or wireless network 210.

[0041] The concentration level determination system 200 is applied to, for example, a service in which a plurality of users receive a lecture based on an image provided by a lecturer who is the provider of the image, and is a system that enables the concentration level determination device 100 to determine the concentration level of the target user.

[0042] The concentration level determination device 100 stores various tables described later in Fig. 4 to Fig. 6. The concentration level determination device 100 receives, from each user side device 201, the gaze position of the user using the user side device 201 on the image displayed on the user side device 201. For example, the concentration level determination device 100 stores the received gaze position of the user in a gaze position management table 400 described later in Fig. 4, for each user, in association with the user. The concentration level determination device 100 receives accompanying information related to the content of the image and accompanying the image from the provider side device 202. The accompanying information is, for example, audio information. The accompanying information may be, for example, position information indicating the position on the image of a pointer displayed superimposed on the image.

[0043] The concentration level determination device 100 identifies a transition of the gaze position of the target user based on the received gaze position of the target user. For example, the concentration level determination device 100 identifies a stagnation point where the gaze of the target user lingers based on the received gaze position of the target user, and records the identified stagnation points in order to identify a transition of the gaze position of the target user. Specifically, the concentration level determination device 100 stores the identified stagnation points in a stagnation point management table 500 described later in FIG. 5.

[0044] The concentration level determination device 100 identifies a specific area on the image based on the received gaze position. The specific area is, for example, an area showing relatively important content in a lecture. The specific area is, for example, an area showing a mathematical formula. Specifically, the specific area may be an area designated by a lecturer. Specifically, the specific area may be an area where the gaze positions of a certain number or more users are concentrated. In the following description, the specific area may be referred to as an "important area." The concentration level determination device 100 may identify a specific area on the image based on accompanying information. The concentration level determination device 100 stores the identified important area in an important area management table 600 described later in FIG. 6.

[0045] The concentration level determination device 100 determines the concentration level of a target user for a predetermined timing based on various tables described later with reference to Figs. 4 to 6. The predetermined timing is, for example, a timing designated in advance by the image provider. The predetermined timing may be, for example, a timing when the gaze positions of a certain number or more users are concentrated on the same location. The predetermined timing may be at regular intervals from the start of a lecture.

[0046] The concentration level determination device 100 determines the concentration level of the target user, for example, based on a comparison between position changes in a plurality of specific regions and transitions in a plurality of gaze positions of the target user. The concentration level determination device 100 outputs the determination result. For example, the concentration level determination device 100 transmits the concentration level of the target user to a provider side device 202. For example, the concentration level determination device 100 transmits the concentration level of the target user to a user side device 201 used by the target user. The concentration level determination device 100 is, for example, a server or a PC (Personal Computer).

[0047] The user-side device 201 is a computer used by a user to view an image. The user-side device 201 displays an image related to a lecture by a provider so that the user can view it, and allows the user to receive the lecture by the provider, under the control of the provider-side device 202. The user-side device 201 detects the user's gaze position on the displayed image and transmits it to the concentration level determination device 100. The user-side device 201 is, for example, a PC, a tablet terminal, or a smartphone.

[0048] The provider-side device 202 is a computer used by a provider who provides images. The provider-side device 202 displays images related to a lecture on the user-side device 201, enables the provider to give a lecture, and allows the user to receive the lecture by the provider. The provider-side device 202 may display a pointer on the user-side device 201 superimposed on the image according to an operation input by the provider. During the lecture by the provider, the provider-side device 202 transmits, to the concentration level determination device 100, voice information indicating the contents of the provider's speech or position information indicating the position of the pointer on the image displayed on the user-side device 201. The provider-side device 202 is, for example, a PC, a tablet terminal, or a smartphone.

[0049] Here, the case where the concentration level determination device 100 and the user side device 201 are different devices has been described, but this is not limiting. For example, the concentration level determination device 100 may have the function of the user side device 201. In this case, the concentration level determination system 200 may not include the user side device 201. Here, the case where the concentration level determination device 100 and the provider side device 202 are different devices has been described, but this is not limiting. For example, the concentration level determination device 100 may have the function of the provider side device 202. In this case, the concentration level determination system 200 may not include the provider side device 202.

[0050] (Example of Hardware Configuration of Concentration Degree Determination Device 100) Next, an example of the hardware configuration of the concentration level determination device 100 will be described with reference to FIG.

[0051] Fig. 3 is a block diagram showing an example of a hardware configuration of the concentration level determination device 100. In Fig. 3, the concentration level determination device 100 has a CPU (Central Processing Unit) 301, a memory 302, a network I / F (Interface) 303, a recording medium I / F 304, and a recording medium 305. In addition, each component is connected to each other via a bus 300.

[0052] Here, CPU 301 is responsible for the overall control of concentration level determination device 100. Memory 302 has, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), and a flash ROM. Specifically, for example, the flash ROM and ROM store various programs, and the RAM is used as a work area for CPU 301. The programs stored in memory 302 are loaded into CPU 301 to cause CPU 301 to execute the coded processes.

[0053] The network I / F 303 is connected to the network 210 through a communication line, and is connected to other computers via the network 210. The network I / F 303 manages an internal interface with the network 210, and controls input and output of data from other computers. The network I / F 303 is, for example, a modem or a LAN adapter.

[0054] The recording medium I / F 304 controls reading / writing data from / to the recording medium 305 under the control of the CPU 301. The recording medium I / F 304 is, for example, a disk drive, a solid state drive (SSD), a universal serial bus (USB) port, or the like. The recording medium 305 is a non-volatile memory that stores data written under the control of the recording medium I / F 304. The recording medium 305 is, for example, a disk, a semiconductor memory, a USB memory, or the like. The recording medium 305 may be detachable from the concentration level determination device 100.

[0055] In addition to the above-mentioned components, the concentration level determination device 100 may have, for example, a keyboard, a mouse, a display, a printer, a scanner, a microphone, a speaker, etc. Furthermore, the concentration level determination device 100 may have a plurality of recording medium I / Fs 304 and recording media 305. Furthermore, the concentration level determination device 100 may not have the recording medium I / Fs 304 and recording media 305.

[0056] (Storage contents of gaze position management table 400) Next, an example of the contents stored in the gaze position management table 400 will be described with reference to Fig. 4. The gaze position management table 400 is realized by a storage area such as the memory 302 or the recording medium 305 of the concentration level determination device 100 shown in Fig. 3.

[0057] Fig. 4 is an explanatory diagram showing an example of the contents stored in gaze position management table 400. As shown in Fig. 4, gaze position management table 400 has fields for user, time, and gaze position. In gaze position management table 400, information is set in each field for each time, and gaze position management information is stored as record 400-a. a is an arbitrary integer.

[0058] In the user field, for example, identification information for identifying the user is set. In the time field, for example, a time point is set starting from the timing when an image is displayed on the user device 201 used by the user and the user becomes able to view the image. In the gaze position field, for example, coordinates on the image indicating the gaze position of the user are set.

[0059] (Storage contents of retention point management table 500) Next, an example of the contents stored in the stay point management table 500 will be described with reference to Fig. 5. The stay point management table 500 is realized, for example, by a storage area such as the memory 302 or the recording medium 305 of the concentration level determination device 100 shown in Fig. 3.

[0060] Fig. 5 is an explanatory diagram showing an example of the contents stored in the stay point management table 500. As shown in Fig. 5, the stay point management table 500 has fields for user, number, time, and stay point. The stay point management table 500 stores stay point management information as record 500-b by setting information in each field for each stay point. b is an arbitrary integer.

[0061] In the user field, for example, identification information for identifying the user is set. In the number field, for example, a number indicating the order of the dwell point detected after the image is displayed on the user side device 201 used by the user and the user becomes able to view the image is set. In the time field, for example, a time point at which the dwell point is detected is set, starting from the time when the image is displayed on the user side device 201 used by the user and the user becomes able to view the image. In the dwell point field, for example, coordinates on the image indicating the dwell point where the gaze of the user dwelled is set.

[0062] (Storage contents of important area management table 600) Next, an example of the contents stored in the important region management table 600 will be described with reference to Fig. 6. The important region management table 600 is realized, for example, by a storage area such as the memory 302 or the recording medium 305 of the concentration level determination device 100 shown in Fig. 3.

[0063] Fig. 6 is an explanatory diagram showing an example of the contents stored in the important region management table 600. As shown in Fig. 6, the important region management table 600 has fields for number, time, and important region. The important region management table 600 stores important region management information as record 600-c by setting information in each field for each important region. c is an arbitrary integer.

[0064] The number field is set with a number indicating the order in which the important area was explained in the lecture by the provider. The time field is set with the time when the important area was explained in the lecture by the provider, starting from the timing when the lecture started. The important area field is set with area information indicating the important area in a identifiable manner.

[0065] (Example of Hardware Configuration of User Device 201) Next, an example of the hardware configuration of the user device 201 included in the concentration level determination system 200 shown in FIG. 2 will be described with reference to FIG.

[0066] Fig. 7 is a block diagram showing an example of the hardware configuration of the user-side device 201. In Fig. 7, the user-side device 201 has a CPU 701, a memory 702, a network I / F 703, a recording medium I / F 704, a recording medium 705, a display 706, and a camera 707. In addition, each component is connected to each other via a bus 700.

[0067] Here, the CPU 701 is responsible for the overall control of the user side device 201. The memory 702 has, for example, a ROM, a RAM, and a flash ROM. Specifically, for example, the flash ROM and the ROM store various programs, and the RAM is used as a work area for the CPU 701. The programs stored in the memory 702 are loaded into the CPU 701, causing the CPU 701 to execute the coded processes.

[0068] The network I / F 703 is connected to the network 210 through a communication line, and is connected to other computers via the network 210. The network I / F 703 manages an internal interface with the network 210, and controls input and output of data from other computers. The network I / F 703 is, for example, a modem or a LAN adapter.

[0069] The recording medium I / F 704 controls reading / writing data from / to the recording medium 705 under the control of the CPU 701. The recording medium I / F 704 is, for example, a disk drive, an SSD, a USB port, etc. The recording medium 705 is a non-volatile memory that stores data written under the control of the recording medium I / F 704. The recording medium 705 is, for example, a disk, a semiconductor memory, a USB memory, etc. The recording medium 705 may be detachable from the user side device 201.

[0070] The display 706 displays an image. The display 706 may display a cursor, an icon, a toolbox, and data such as documents and function information. The display 706 is, for example, a CRT (Cathode Ray Tube), a liquid crystal display, or an organic EL (Electroluminescence) display. The camera 707 has an imaging element and captures an image of the user's face or eyes. The camera 707 makes it possible to identify the user's gaze position on the image based on the captured image of the user's face or eyes.

[0071] In addition to the above-mentioned components, the user side device 201 may also have, for example, a keyboard, a mouse, a printer, a scanner, a microphone, a speaker, etc. Also, the user side device 201 may have a plurality of recording medium I / Fs 704 and recording media 705. Also, the user side device 201 may not have the recording medium I / Fs 704 and recording media 705.

[0072] (Example of Hardware Configuration of Provider Side Device 202) A specific example of the hardware configuration of the provider-side device 202 included in the concentration level determination system 200 shown in FIG. 2 is similar to the example of the hardware configuration of the user-side device 201 shown in FIG. 7, and therefore a description thereof will be omitted.

[0073] (Example of Functional Configuration of Concentration Degree Determination Device 100) Next, an example of a functional configuration of the concentration level determination device 100 will be described with reference to FIG.

[0074] 8 is a block diagram showing an example of a functional configuration of the concentration level determination device 100. The concentration level determination device 100 includes a storage unit 800, an acquisition unit 801, a first identification unit 802, a first determination unit 803, a second identification unit 804, a second determination unit 805, and an output unit 806.

[0075] The storage unit 800 is realized, for example, by a storage area such as the memory 302 or the recording medium 305 shown in Fig. 3. In the following, a case where the storage unit 800 is included in the concentration level determination device 100 will be described, but this is not limiting. For example, the storage unit 800 may be included in a device different from the concentration level determination device 100, and the stored contents of the storage unit 800 may be accessible from the concentration level determination device 100.

[0076] The acquiring unit 801 to the output unit 806 function as an example of a control unit. Specifically, the acquiring unit 801 to the output unit 806 realize their functions by, for example, causing the CPU 301 to execute a program stored in a storage area such as the memory 302 or the recording medium 305 shown in Fig. 3, or by the network I / F 303. The processing results of each functional unit are stored in, for example, a storage area such as the memory 302 or the recording medium 305 shown in Fig. 3.

[0077] The storage unit 800 stores various information that is referred to or updated in the processing of each functional unit. The storage unit 800 stores, for each user, the gaze position of the user on the image at each of a plurality of timings. The timing is, for example, a point in time. The timing may have, for example, a time width. The timing may be, for example, a period of time. Specifically, the timing may be a relatively short period of time. The storage unit 800 stores, for example, the gaze position management table 400. The gaze position is acquired by, for example, the acquisition unit 801.

[0078] The storage unit 800 stores, for each user, a stay point on an image where the gaze of the user stays at each of a plurality of timings. The storage unit 800 stores, for example, a stay point management table 500. The stay point can also be used as, for example, a representative gaze position at a predetermined timing. The stay point is identified, for example, by the first identification unit 802 or the second identification unit 804.

[0079] The storage unit 800 stores an image. The storage unit 800 stores a specific area on the image that satisfies a predetermined condition. The specific area is, for example, an area that shows relatively important content in a lecture. The specific area is specifically an important area. The predetermined condition is, for example, that a predetermined character string, a predetermined formula, a predetermined figure, or a predetermined color is reflected. The predetermined condition is that the area is specified by a lecturer. The predetermined condition is, for example, that the gaze positions of a certain number or more users are concentrated. The predetermined condition is, for example, that the area is specified by a pointer. The storage unit 800 stores, for example, an important area management table 600. The specific area is specified, for example, by a first specification unit 802.

[0080] The acquisition unit 801 acquires various information used for processing by each functional unit. The acquisition unit 801 stores the acquired various information in the storage unit 800 or outputs it to each functional unit. The acquisition unit 801 may also output the various information stored in the storage unit 800 to each functional unit. The acquisition unit 801 acquires various information based on, for example, an operation input by a user. The acquisition unit 801 may receive various information from, for example, a device different from the concentration level determination device 100.

[0081] The acquisition unit 801 acquires, for example, an image. The acquisition unit 801 acquires, for example, a user's gaze position on the image. Specifically, the acquisition unit 801 acquires the user's gaze position on the image by receiving it from the user-side device 201 used by the user. More specifically, the acquisition unit 801 acquires the user's gaze position on the image at each timing when the user is viewing the image by receiving it from the user-side device 201 used by the user.

[0082] The acquisition unit 801 may receive a start trigger for starting the processing of any of the functional units. The start trigger may be, for example, a predetermined operation input by a user. The start trigger may be, for example, the reception of predetermined information from another computer. The start trigger may be, for example, the output of predetermined information by any of the functional units. The acquisition unit 801 receives, for example, the acquisition of a gaze position as a start trigger for starting the processing of the first identification unit 802, the second identification unit 804, and the second determination unit 805.

[0083] The first identification unit 802 identifies the gaze position of the user on the image at a predetermined timing. The predetermined timing is, for example, a timing when the gaze positions on the image of a predetermined number or more of users among a plurality of users are included in the same region. The predetermined timing may be, for example, a timing designated by the provider. The predetermined timing may be, for example, a timing when the user performs a predetermined action. The predetermined number is a number equal to or greater than a threshold. The threshold is, for example, set in advance.

[0084] The first identification unit 802, for example, identifies a first gaze position on the image of the target user at a first timing. The first timing is a timing when the gaze positions on the image of a predetermined number or more users among a plurality of users are included in the same area. The first timing is, for example, a point in time. The first timing may be, for example, a period of time. Specifically, the first timing may be a relatively short period of time. The first identification unit 802 may, for example, identify a first dwell point on the image where the gaze of the target user at the first timing is dwelled as the first gaze position. In this way, the first identification unit 802 can obtain information that serves as a guideline for determining the concentration level of the target user.

[0085] The first identification unit 802, for example, identifies a second gaze position on the image of the target user at the second timing. The second timing is a timing before the first timing. The second timing is, for example, a point in time. The second timing may be, for example, a period of time. Specifically, the second timing may be a relatively short period of time. The first identification unit 802 may, for example, identify a second gaze position on the image of the target user at each of a plurality of second timings. The first identification unit 802 may, for example, identify a second dwell point on the image where the gaze of the target user at the second timing is dwelled as the second gaze position. In this way, the first identification unit 802 can obtain information that serves as a guideline for determining the concentration level of the target user.

[0086] The first identification unit 802 identifies a specific area included in the image. The first identification unit 802 identifies a first specific area corresponding to a first timing included in the image based on, for example, the gaze positions on the image of each of the multiple users. The first specific area is an area in which the gaze positions on the image of a predetermined number of users or more are included at the first timing. The first specific area is, for example, an area in which the gaze positions of a number of users among the multiple users that is equal to or greater than a first threshold value are included at the first timing. The first threshold value is, for example, set in advance. The first threshold value may be a value different from the above threshold value. In this way, the first identification unit 802 can obtain information that serves as a guideline for determining the concentration level of the target user.

[0087] The first identification unit 802, for example, identifies a second specific area corresponding to a third timing included in the image based on the gaze positions on the image of each of the multiple users. The third timing is a timing after the first timing. The third timing is a timing at which the gaze positions on the image of a predetermined number or more of the multiple users are included in the same area. The third timing is, for example, a point in time. The third timing may be, for example, a period. Specifically, the third timing may be a relatively short period. The second specific area is an area in which the gaze positions on the image of a predetermined number or more of users are included in the third timing. The second specific area is, for example, an area in which the gaze positions of a number of users of the multiple users equal to or greater than a second threshold are included in the third timing. The second threshold may be, for example, the same value as the first threshold. The second threshold may be, for example, a value different from the above threshold. The first identification unit 802 may, for example, identify a second specific area corresponding to each third timing of the multiple third timings included in the image. This allows the first identifying unit 802 to obtain information that serves as a guideline for determining the concentration level of the target user.

[0088] The first identification unit 802 may identify the first specific area and the second specific area based on, for example, an analysis result of analyzing the contents of the image. Specifically, the first identification unit 802 analyzes the contents of the image at the first timing, and identifies an area on the image in which a predetermined formula, a predetermined sentence, a predetermined figure, or a predetermined color is shown at the first timing, as the first specific area. Specifically, the first identification unit 802 analyzes the contents of the image at the third timing, and identifies an area on the image in which a predetermined formula, a predetermined sentence, a predetermined figure, or a predetermined color is shown at the third timing, as the second specific area. This allows the first identification unit 802 to obtain information that serves as a guideline for determining the concentration level of the target user.

[0089] The first identification unit 802 identifies a first specific area and a second specific area, for example, based on accompanying information that accompanies an image related to the content of the image. The accompanying information is, for example, voice information indicating the content of the provider's speech, or position information indicating the position of a pointer by the provider. Specifically, the first identification unit 802 identifies a first specific area corresponding to a first timing at which a predetermined content is spoken, based on the voice information that is the accompanying information. Specifically, the first identification unit 802 identifies a second specific area corresponding to a third timing at which a predetermined content is spoken, based on the voice information that is the accompanying information. In this way, the first identification unit 802 can obtain information that serves as a guideline for determining the concentration level of the target user.

[0090] Specifically, the first identification unit 802 identifies a first specific area including the position of the pointer corresponding to the first timing based on the position information that is the accompanying information. Specifically, the first identification unit 802 identifies a second specific area including the position of the pointer corresponding to the third timing based on the position information that is the accompanying information. This allows the first identification unit 802 to obtain information that serves as a guideline for determining the concentration level of the target user.

[0091] The first identification unit 802 extracts candidates for specific areas representing predetermined content included in the image, including the gaze positions on the image of a predetermined number or more users, based on, for example, an analysis result of analyzing the gaze positions on the image of each of a plurality of users and the content of the image. Then, the first identification unit 802 identifies a first specific area and a second specific area, for example, based on the extracted candidates. Specifically, the first identification unit 802 extracts an area on the image in which a predetermined formula, a predetermined sentence, a predetermined figure, or a predetermined color is reflected and the gaze positions on the image of a predetermined number or more users are concentrated, as a candidate for the specific area. Then, the first identification unit 802 specifically identifies a first specific area corresponding to a first timing and a second specific area corresponding to a third timing from among the extracted candidates. In this way, the first identification unit 802 can obtain information that serves as a guide for determining the concentration level of the target user.

[0092] The first determination unit 803 determines whether the identified first specific area and the identified first gaze position match. If the first determination unit 803 determines that they match, it determines that the concentration level of the target user is relatively high. For example, the first determination unit 803 determines whether the identified first gaze position is included in the identified first specific area. Then, for example, if the identified first gaze position is included in the identified first specific area, the first determination unit 803 determines that the first specific area and the first gaze position match. If the first determination unit 803 determines that they match, it determines that the concentration level of the target user is relatively high.

[0093] On the other hand, for example, when the identified first specific area does not include the identified first gaze position, the first determination unit 803 determines that the first specific area and the first gaze position do not match and are different. In this way, when the concentration level of the target user is relatively high, the first determination unit 803 can appropriately determine that the concentration level of the target user is relatively high. Furthermore, if the first determination unit 803 does not determine that the concentration level of the target user is relatively high, it can cause the second determination unit 804 and the second determination unit 805 to determine the concentration level of the target user from another perspective.

[0094] The second identification unit 804 identifies a dwell point where the gaze of the target user is dwelled. If the gaze position of the target user is concentrated in an area of ​​a predetermined size on the image for a certain period of time, the second identification unit 804 performs statistical processing on the gaze position of the target user and identifies a dwell point that represents the gaze position of the target user. This allows the second identification unit 804 to identify the transition of the gaze position of the target user.

[0095] The second identification unit 804 identifies a transition of the gaze position of the target user. For example, when the identified first specific area is different from the identified first gaze position, the second identification unit 804 identifies a transition of the gaze position of the target user based on the first gaze position and the second gaze position. Specifically, the second identification unit 804 identifies a first line segment that connects the first gaze position and the second gaze position and indicates a transition of the gaze position of the target user. This allows the second identification unit 804 to obtain information that serves as a guideline for determining the concentration level of the target user.

[0096] Specifically, the second identification unit 804 may identify a first line segment that connects a first dwell point corresponding to the first gaze position and a second dwell point corresponding to the second gaze position, and indicates a transition of the gaze position of the target user. The first dwell point corresponding to the first gaze position may be, for example, a dwell point located closest to the first gaze position among the identified dwell points. The first dwell point corresponding to the first gaze position may be, for example, a dwell point located closest to the second gaze position among the identified dwell points. The second dwell point corresponding to the second gaze position may be, for example, a dwell point located closest to the second gaze position among the identified dwell points. The second dwell point corresponding to the second gaze position may be, for example, a dwell point located closest to the second gaze position among the identified dwell points. The transition may be represented by information in which the first dwell point and the second dwell point are ordered in chronological order. This allows the second identification unit 804 to obtain information that serves as a guideline for determining the concentration level of the target user.

[0097] The second identification unit 804, for example, identifies a transition of the gaze position of the target user based on the first gaze position and the second gaze position of the target user at each of the multiple second timings before the first timing. Specifically, the second identification unit 804 identifies a first trajectory that chronologically connects the first gaze position and each of the multiple second gaze positions and indicates the transition of the gaze position of the target user. The trajectory is, for example, a broken line. This allows the second identification unit 804 to obtain information that serves as a guideline for determining the concentration level of the target user.

[0098] Specifically, the second identification unit 804 may identify a first line segment that chronologically connects a first dwell point corresponding to the first gaze position and a second dwell point corresponding to each of the second gaze positions of the multiple second gaze positions, and indicates a transition of the gaze position of the target user. The transition may be represented by, for example, information that chronologically orders the first dwell point and the multiple second dwell points. This allows the second identification unit 804 to obtain information that serves as a guideline for determining the concentration level of the target user.

[0099] The second identification unit 804 identifies a position change of the specific area. The second identification unit 804, for example, identifies a position change between the identified first specific area and the identified second specific area. Specifically, the second identification unit 804 identifies a second line segment that connects a representative point of the identified first specific area and a representative point of the identified second specific area and indicates a position change between the specific areas. The representative point is, for example, a center point of the specific area. The position change may be expressed by, for example, information that orders the first specific area and the second specific area in chronological order. This allows the second identification unit 804 to obtain information that serves as a guide for determining the concentration level of the target user.

[0100] The second identification unit 804 may, for example, identify a position change between the identified first specific area and a second specific area corresponding to each of the multiple third timings included in the image. Specifically, the second identification unit 804 identifies a second trajectory that connects a representative point of the identified first specific area and a representative point of each of the multiple second specific areas, and indicates a position change between the specific areas. The position change may be expressed, for example, by information that orders the first specific area and each of the multiple second specific areas in chronological order. This allows the second identification unit 804 to obtain information that serves as a guide for determining the concentration level of the target user.

[0101] The second determination unit 805 determines the concentration level of the target user based on a comparison between the identified position change and the identified transition. The second determination unit 805 determines the concentration level of the target user based on, for example, the distance between a first line segment indicating a transition and a second line segment indicating a position change. Here, the second determination unit 805 determines that the target user is not concentrating, for example, if the distance between the first line segment and the second line segment is equal to or greater than a threshold. On the other hand, the second determination unit 805 determines that the target user is concentrating, for example, if the distance between the first line segment and the second line segment is less than the threshold. This allows the second determination unit 805 to accurately determine the concentration level of the target user.

[0102] The second determination unit 805 determines the concentration level of the target user based on, for example, the distance between the first trajectory indicating the transition and the second trajectory indicating the position change. Here, the second determination unit 805 determines that the target user is not concentrated if, for example, the distance between the first trajectory and the second trajectory is equal to or greater than a threshold. On the other hand, the second determination unit 805 determines that the target user is concentrated if, for example, the distance between the first trajectory and the second trajectory is less than the threshold. This allows the second determination unit 805 to accurately determine the concentration level of the target user.

[0103] The second determination unit 805 may determine the concentration level of the target user based on whether or not the information ordering the first stay point and one or more second stay points matches the information ordering the first specific area and one or more second specific areas. The order is indicated by, for example, assigning numbers in ascending order. Specifically, the second determination unit 805 determines that the target user is concentrated if the ratio of the stay points of each number included in the specific area of ​​the same number is equal to or greater than a threshold. Also, specifically, the second determination unit 805 determines that the target user is not concentrated if the ratio of the stay points of each number included in the specific area of ​​the same number is less than a threshold. This allows the second determination unit 805 to accurately determine the concentration level of the target user.

[0104] The output unit 806 outputs the processing result of at least one of the functional units. The output format is, for example, display on a display, printout on a printer, transmission to an external device via the network I / F 303, or storage in a storage area such as the memory 302 or the recording medium 305. In this way, the output unit 806 can notify the user of the processing result of at least one of the functional units, thereby improving the convenience of the concentration degree determination device 100.

[0105] The output unit 806 outputs, for example, the result determined by the determination unit. More specifically, the output unit 806 displays the result determined. More specifically, the output unit 806 transmits the result determined to another computer. More specifically, the output unit 806 transmits the result determined to the user-side device 201 or the provider-side device 202. In this way, the output unit 806 can make the concentration level of the target user available.

[0106] (Specific Functional Configuration Example of Concentration Degree Determination Device 100) Next, a specific example of the functional configuration of the concentration level determination device 100 will be described with reference to FIG.

[0107] 9 is a block diagram showing an example of a functional configuration of the concentration level determination device 100. The concentration level determination device 100 can communicate with a gaze detection device 901 and a display content acquisition device 902. The concentration level determination device 100 has an other person's gaze DB (DataBase) 910. The concentration level determination device 100 has a gaze recording unit 911, a saccade detection unit 912, an important area determination unit 913, an appearance order recognition unit 914, a straight line detection unit 915, a distance calculation unit 916, a concentration state evaluation unit 917, and a display control unit 918, which realize the control unit 810. The concentration level determination device 100 can communicate with a display device 920.

[0108] The gaze detection device 901 detects the gaze position of the user on the image at each of a plurality of timings during a lecture. The gaze detection device 901 transmits the detected gaze position of the user on the image at each of a plurality of timings during a lecture to the concentration level determination device 100. The gaze detection device 901 is realized, for example, by the user side device 201. The display content acquisition device 902 acquires an image and transmits it to the concentration level determination device 100. The display content acquisition device 902 is realized, for example, by the provider side device 202.

[0109] The gaze recording unit 911 receives, for each of a plurality of users, the gaze position of the user on the image at each of a plurality of timings during a lecture from the gaze detection device 901. The gaze recording unit 911 transmits the gaze position of the target user on the image at each timing to the saccade detection unit 912. The gaze recording unit 911 stores the gaze positions of users other than the target user on the image at each timing in the other's gaze DB 910. The other's gaze DB 910 is specifically realized by the gaze position management table 400.

[0110] The saccade detection unit 912 detects the saccade of the gaze of the target user based on the gaze position of the target user on the image at each timing. The saccade detection unit 912 detects a dwell point where the gaze of the target user dwells at each of two or more timings during the lecture based on the detected saccade of the gaze of the target user, and transmits the detected dwell point to the straight line detection unit 915.

[0111] The important area determination unit 913 receives an image from the display content acquisition device 902. The important area determination unit 913 analyzes the content of the image. The important area determination unit 913 reads out the gaze positions of users other than the target user on the image at each timing from the other person's gaze DB 910.

[0112] The important area determination unit 913 identifies an important area on the image at each of two or more timings during the lecture based on the result of analyzing the content of the image and the gaze positions of other users other than the target user on the image at each timing. For example, the important area determination unit 913 identifies an area on the image containing a predetermined content and on which the gaze positions of a certain number or more other users are concentrated at any timing as an important area on the image at that timing. The important area determination unit 913 transmits the important areas on the image at each of two or more timings during the lecture to the appearance order recognition unit 914 in association with the timing.

[0113] The appearance order recognition unit 914 orders the important areas on the image at each of the two or more timings according to the order in which they appear during the lecture. The appearance order recognition unit 914 transmits the ordered important areas on the image at each of the two or more timings to the line detection unit 915.

[0114] The line detection unit 915 specifies a trajectory indicating a transition of the gaze by connecting points where the gaze of the target user is fixed at each of two or more timings during the lecture time with a straight line according to the order of appearance during the lecture time. The line detection unit 915 specifies a trajectory indicating a change in position of the important area by connecting important areas on the image at each of two or more timings during the lecture time with a straight line according to the order of appearance during the lecture time. The line detection unit 915 transmits the specified trajectory indicating the transition of the gaze and the specified trajectory indicating the change in position of the important area to the distance calculation unit 916.

[0115] The distance calculation unit 916 calculates the distance between the trajectory indicating the transition of the line of sight and the trajectory indicating the position change of the important area, and transmits it to the concentration state evaluation unit 917. The concentration state evaluation unit 917 determines the concentration level of the target user based on the distance. For example, if the distance is equal to or greater than a threshold, the concentration state evaluation unit 917 determines that the target user is not concentrating. For example, if the distance is less than a threshold, the concentration state evaluation unit 917 determines that the target user is concentrating. The concentration state evaluation unit 917 transmits the result of determining the concentration level of the target user to the display control unit 918.

[0116] The display control unit 918 controls the display device 920 to display the result of the determination of the concentration level of the target user. The display device 920 displays the result of the determination of the concentration level of the target user in accordance with the control of the display control unit 918. The display device 920 is specifically realized by the provider side device 202. The display device 920 is specifically realized by the user side device 201. This allows the concentration level determination device 100 to accurately determine the concentration level of the target user.

[0117] (Example of operation of concentration level determination device 100) Next, an example of the operation of the concentration level determination device 100 will be described with reference to FIG.

[0118] Fig. 10 is an explanatory diagram showing an example of the operation of the concentration level determination device 100. In Fig. 10, the concentration level determination device 100 acquires an image 1000 used in a lecture. The concentration level determination device 100 acquires the gaze positions of each of a plurality of users on the image 1000 at each of a plurality of timings during the lecture. The plurality of users includes, for example, a user whose concentration level is to be determined.

[0119] (10-1) The concentration level determination device 100 recognizes an important area on the image 1000. Here, the important area is an area that indicates important contents in a lecture. The important area is, for example, an area related to the lecturer's explanation. For example, when the lecturer makes a relatively important statement or action during a lecture, the important area tends to attract the gazes of a relatively large number of users. For this reason, the concentration level determination device 100 identifies an area on which the gazes of a certain number or more users are concentrated at any timing based on the gaze positions on the image 1000 of each user at each timing during the lecture. Then, the concentration level determination device 100 recognizes the identified area as an important area on the image 1000 corresponding to the timing. The concentration level determination device 100 stores the important area corresponding to any of the recognized timings.

[0120] (10-2) The concentration level determination device 100 determines whether or not an important area corresponding to any timing during a lecture coincides with the gaze position of the target user corresponding to that timing. If they coincide, it is determined that the target user has not missed the lecturer's explanation at that timing and is viewing the important area corresponding to that timing, and the concentration level of the target user is considered to be relatively high. Therefore, if an important area corresponding to any timing during a lecture coincides with the gaze position of the target user corresponding to that timing, the concentration level determination device 100 determines that the target user is concentrating.

[0121] Also, if there is no match, the target user may miss the lecturer's explanation at that time and not view the important area corresponding to that time, and the concentration level of the target user may be determined to be relatively low.On the other hand, if there is no match, the target user may not view the important area corresponding to that time, but may understand the content of the lecture and view the part that the lecturer plans to explain after that time in advance, and the concentration level of the target user may be determined to be relatively high.

[0122] Therefore, it is preferable that the concentration level determination device 100 further determines whether the target user is concentrating from a different perspective than (10-2). Specifically, it is determined whether the target user is concentrating from the perspective that the target user understands the contents of the lecture and may visually check in advance the part that the lecturer is planning to explain after a certain timing. In the following description, the timing at which the gaze position of the target user does not match the important area may be referred to as the "target timing". Here, it is assumed that the concentration level determination device 100 determines that the important area corresponding to any timing during the lecture does not match the gaze position of the target user corresponding to the timing.

[0123] (10-3) The concentration level determination device 100 assigns the number 1 to the important area corresponding to the target timing. The concentration level determination device 100 assigns numbers 2 and onward to each of the important areas other than the important area corresponding to the target timing in the order in which they appeared in the instructor's explanation after the target timing. (10-4) The concentration level determination device 100 identifies a trajectory 1001 indicating the change in position of the important area by connecting the representative points of each important area in the order in which they were assigned numbers. In this way, the concentration level determination device 100 can obtain a trajectory 1001 suggesting the flow of the instructor's explanation after the target timing.

[0124] (10-5) The concentration level determination device 100 identifies a dwell point where the gaze of the target user remains at least at each of two or more timings between before the target timing and the target timing. The concentration level determination device 100 may also identify a dwell point where the gaze of the target user remains at each of two or more timings between before the target timing and after the target timing. (10-6) The concentration level determination device 100 identifies a trajectory 1003 indicating a transition 1002 of the gaze position of the target user by connecting the identified dwell points in chronological order. In this way, the concentration level determination device 100 can obtain a trajectory 1003 suggesting the flow of thought of the target user between before the target timing and the target timing, or between before the target timing and after the target timing.

[0125] (10-7) The concentration level determination device 100 calculates the distance between the trajectory 1001 and the trajectory 1003. The distance is expressed by, for example, DTW (Dynamic Time Warping). Here, if the distance between the trajectory 1001 and the trajectory 1003 is relatively short, the flow of thoughts of the target user follows the flow of the lecturer's explanation after a predetermined timing, and it is considered preferable to determine that the concentration level of the target user is relatively high. Therefore, if the calculated distance is less than a threshold, the concentration level determination device 100 determines that the target user is concentrating. On the other hand, if the calculated distance is equal to or greater than the threshold, the concentration level determination device 100 determines that the target user is not concentrating. The concentration level determination device 100 outputs the determination result.

[0126] This allows the concentration level determination device 100 to accurately determine the concentration level of the target user. Specifically, even if the target user does not view the important area corresponding to a certain timing during a lecture, the target user may understand the flow of the lecturer's explanation, and it may be preferable to determine that the target user's concentration level is relatively high. In this case, the concentration level determination device 100 can appropriately determine that the target user's concentration level is relatively high.

[0127] (Example of identifying important areas) Next, a specific example in which the concentration level determination device 100 recognizes an important area on the image 1000 will be described with reference to FIGS.

[0128] 11 and 12 are explanatory diagrams showing a specific example of recognizing an important region. In Fig. 11, the concentration level determination device 100 receives and records the gaze positions on the image of each of a plurality of users at each of a plurality of timings during a lecture from the gaze detection device 901.

[0129] The important area determination unit 913 recognizes an area on an image in which a predetermined character string, a predetermined formula, a predetermined figure, or a predetermined color is reflected. The predetermined character string, the predetermined formula, the predetermined figure, or the predetermined color is, for example, set in advance by a provider. The important area determination unit 913 detects that the gazes of a certain number or more users are concentrated on any of the recognized areas at any time during a lecture based on the gaze positions of each of a plurality of users on the image. When the important area determination unit 913 detects that the gazes of a certain number or more users are concentrated on any of the recognized areas at any time during a lecture, it identifies the area as an important area corresponding to the time.

[0130] The concentration state evaluation unit 917 determines the concentration level of the target user based on the distance between the trajectory indicating the transition of the gaze and the trajectory indicating the position change of the important area, which are based on the recorded gaze position and the identified important area. This allows the concentration level determination device 100 to accurately identify the important area, and makes it easier to accurately determine the concentration level of the target user. Next, we move on to the description of FIG. 12.

[0131] 12, it is assumed that the concentration level determination device 100 receives and records the gaze positions on an image of each of a plurality of users at each of a plurality of timings during a lecture from the gaze detection device 901. It is assumed that the concentration level determination device 100 acquires, as accompanying information related to the image, audio information that can identify the remarks made by the lecturer during the lecture, and position information that can identify the position on the image designated by the lecturer with a pointer, etc.

[0132] The important area determination unit 913 recognizes the timing when a predetermined utterance is made. The predetermined utterance is set in advance by the provider, for example. The important area determination unit 913 detects that the gazes of a certain number or more users are concentrated on any of the recognized areas at the timing when the predetermined utterance is made, based on the gaze positions of each of the multiple users on the image. When the important area determination unit 913 detects that the gazes of a certain number or more users are concentrated on any of the recognized areas at the timing when the predetermined utterance is made, it identifies the area as an important area corresponding to the timing.

[0133] The important area determination unit 913 may detect, based on the gaze positions of each of the multiple users on the image, that the gazes of a certain number of users or more are concentrated on an area in the recognized area at a position designated by a pointer at any timing during the lecture. When the important area determination unit 913 detects that the gazes of a certain number of users or more are concentrated on an area in the recognized area at a position designated by a pointer at any timing during the lecture, the important area determination unit 913 may specify the area as an important area corresponding to the timing.

[0134] The concentration state evaluation unit 917 judges the concentration level of the target user based on the distance between a trajectory indicating the transition of the gaze and a trajectory indicating the position change of the important area, which is based on the recorded gaze position and the identified important area. This allows the concentration level judgment device 100 to accurately specify the important area, making it easier to accurately judge the concentration level of the target user.

[0135] (Example of outputting the judged result) Next, a specific example in which the concentration level determination device 100 outputs a determination result will be described with reference to FIG.

[0136] Fig. 13 is an explanatory diagram showing a specific example of outputting the judgment result. In Fig. 13, it is assumed that the concentration level judgment device 100 receives and records the gaze positions on the image of each of the multiple users at each of multiple timings during the lecture from the gaze detection device 901. It is also assumed that the concentration state evaluation unit 917 judges the concentration level of the target user based on the distance between the trajectory indicating the gaze transition and the trajectory indicating the position change of the important area based on the recorded gaze positions and the important area.

[0137] The display control unit 918 transmits the determined result to the provider-side device 202 and causes it to be displayed on the provider-side device 202. In this way, the concentration degree determination device 100 enables the provider to understand the determined result, making it easier for the provider to consider the content of future lectures and take action for the target user. In addition, the concentration degree determination device 100 makes it easier for the provider to give a lecture.

[0138] Here, the case where the display control unit 918 transmits the determination result to the provider-side device 202 has been described, but the present invention is not limited to this. For example, the display control unit 918 may transmit the determination result to the user-side device 201 used by the target user and display it on the user-side device 201. In this way, the concentration degree determination device 100 can enable the target user to understand the determination result, and can facilitate the target user to improve his or her attitude toward future lectures.

[0139] Also, for example, the display control unit 918 may transmit the determination result to a statistical processing device that performs statistical processing. This allows the concentration level determination device 100 to perform statistical processing on the determination result. The provider can consider the content of future lectures based on the results of the statistical processing. Furthermore, if there is a supervisor who manages the provider, the supervisor can evaluate whether the content of the provider's lecture is desirable or not based on the results of the statistical processing.

[0140] (Overall processing procedure) Next, an example of an overall processing procedure executed by the concentration level determination device 100 will be described with reference to Fig. 14. The overall processing is realized by, for example, the CPU 301, storage areas such as the memory 302 and the recording medium 305, and the network I / F 303 shown in Fig. 3.

[0141] Fig. 14 is a flowchart showing an example of an overall processing procedure. In Fig. 14, the concentration level determination device 100 detects the gaze direction of each of a plurality of users during a lecture and records the detected gaze direction of each user (step S1401).

[0142] Next, the concentration level determination device 100 determines whether or not the gaze directions of a predetermined number or more users are concentrated in an area of ​​a predetermined size (step S1402). If the gaze directions are not concentrated in an area of ​​a predetermined size (step S1402: No), the concentration level determination device 100 returns to the process of step S1401. On the other hand, if the gaze directions are concentrated in an area of ​​a predetermined size (step S1402: Yes), the concentration level determination device 100 proceeds to the process of step S1403.

[0143] In step S1403, the concentration level determination device 100 determines whether the gaze direction of the target user is included in a specific area (step S1403). The specific area is, for example, an area where the gaze directions of a predetermined number or more users are concentrated. Here, if the gaze direction of the target user is not included in the specific area (step S1403: No), the concentration level determination device 100 proceeds to processing of step S1405. On the other hand, if the gaze direction of the target user is included in the specific area (step S1403: Yes), the concentration level determination device 100 proceeds to processing of step S1404.

[0144] In step S1404, the concentration level determination device 100 evaluates that the target user is concentrating (step S1404), and then the concentration level determination device 100 ends the entire process.

[0145] In step S1405, the concentration level determination device 100 executes an evaluation process described later in FIG. 15 to evaluate whether the target user is concentrating or not (step S1405). Then, the concentration level determination device 100 ends the entire process. As a result, the concentration level determination device 100 can once determine whether the target user is concentrating or not, and if it is not completely determined that the target user is concentrating, execute an evaluation process to determine whether the target user is concentrating or not from a different perspective. Therefore, the concentration level determination device 100 can accurately determine the concentration level of the target user.

[0146] (Evaluation process procedure) Next, an example of an evaluation process procedure executed by the concentration level determination device 100 will be described with reference to Fig. 15. The evaluation process is realized by, for example, the CPU 301, storage areas such as the memory 302 and the recording medium 305, and the network I / F 303 shown in Fig. 3.

[0147] Fig. 15 is a flowchart showing an example of an evaluation process procedure. In Fig. 15, the concentration level determination device 100 recognizes important areas on the image being displayed (step S1501). Next, the concentration level determination device 100 identifies an important area that appears in the current lecture of the lecturer from among the recognized important areas, and assigns the number 1 to the important area (step S1502).

[0148] The concentration level determination device 100 determines whether any important area has appeared in the subsequent explanation by the instructor (step S1503). If any important area has appeared (step S1503: Yes), the concentration level determination device 100 proceeds to the process of step S1505. On the other hand, if none of the important areas have appeared (step S1503: No), the concentration level determination device 100 proceeds to the process of step S1504.

[0149] In step S1504, the concentration level determination device 100 evaluates that the target user is not concentrating (step S1504), and then the concentration level determination device 100 ends the evaluation process.

[0150] In step S1505, the concentration level determination device 100 assigns numbers from 2 onwards in ascending order to the important areas that appear in the subsequent lecturer's explanations in the order in which they appear in the subsequent lecturer's explanations (step S1505). Next, the concentration level determination device 100 generates a trajectory that connects the important areas in numerical order (step S1506). Then, the concentration level determination device 100 identifies a stagnation point at each of two or more timings based on the gaze direction of the target user during the lecture, and generates a trajectory that indicates the trajectory of the gaze direction of the target user based on the stagnation points (step S1507).

[0151] Next, the concentration level determination device 100 calculates the distance between the trajectory connecting the important regions in numerical order and the trajectory indicating the trajectory of the gaze direction of the target user (step S1508). Then, the concentration level determination device 100 evaluates the concentration level of the target user based on whether the calculated distance is equal to or greater than a threshold (step S1509). Here, if the distance is equal to or greater than the threshold, the concentration level determination device 100 determines that the target user is not concentrating. On the other hand, if the distance is less than the threshold, the concentration level determination device 100 determines that the target user is concentrating. Then, the concentration level determination device 100 ends the evaluation process. This allows the concentration level determination device 100 to accurately determine the concentration level of the target user.

[0152] Here, the concentration level determination device 100 may change the order of the processes of some steps in the flowcharts of Figures 14 and 15. For example, the order of the processes of steps S1506 and S1507 may be changed. Furthermore, the concentration level determination device 100 may omit the processes of some steps in the flowcharts of Figures 14 and 15. For example, the process of step S1404 may be omitted.

[0153] As described above, the concentration level determination device 100 can identify the first gaze position on the image of the user at the first timing. The concentration level determination device 100 can determine whether or not the first specific area corresponding to the first timing included in the image and the first gaze position match. When they do not match and are different, the concentration level determination device 100 can identify a transition of the gaze position of the user based on the first gaze position and the second gaze position on the image of the user at the second timing before the first timing. The concentration level determination device 100 can determine the concentration level of the user based on a comparison between the position change between the first specific area and the second specific area corresponding to the third timing after the first timing included in the image and the identified transition. This allows the concentration level determination device 100 to accurately determine the concentration level of the user.

[0154] According to the concentration level determination device 100, it is possible to identify a first specific area and a second specific area based on the gaze positions on the image of each of a plurality of users. This allows the concentration level determination device 100 to accurately identify the first specific area and the second specific area, and makes it possible to determine the concentration level of the user with even greater accuracy.

[0155] According to the concentration level determination device 100, it is possible to identify a first specific area and a second specific area based on the analysis result of the content of the image. This allows the concentration level determination device 100 to accurately identify the first specific area and the second specific area, and makes it possible to determine the concentration level of the user with even greater accuracy.

[0156] The concentration level determination device 100 can extract candidates for a specific area that represents a specific content included in an image, including the gaze positions on the image of a predetermined number or more users among a plurality of users. The concentration level determination device 100 can specify a first specific area and a second specific area based on the extracted candidates. This allows the concentration level determination device 100 to accurately specify the first specific area and the second specific area, and can determine the concentration level of the user with even greater accuracy.

[0157] According to the concentration level determination device 100, the first specific area and the second specific area can be specified based on accompanying information that is associated with the image and is related to the content of the image. This allows the concentration level determination device 100 to accurately specify the first specific area and the second specific area, making it possible to more accurately determine the concentration level of the user.

[0158] According to the concentration level determination device 100, the first timing can be a timing when the gaze positions on the image of a predetermined number or more of the multiple users are included in the same region. According to the concentration level determination device 100, the first specific region can be a region when the gaze positions on the image of a predetermined number or more of the multiple users are included in the same region at the first timing. According to the concentration level determination device 100, the third timing can be a timing when the gaze positions on the image of a predetermined number or more of the multiple users are included in the same region. According to the concentration level determination device 100, the second specific region can be a region when the gaze positions on the image of a predetermined number or more of the users are included in the first timing. Thereby, the concentration level determination device 100 can accurately identify the first specific region and the second specific region, and can determine the concentration level of the user with even greater accuracy.

[0159] The concentration level determination device 100 can identify the transition of the user's gaze position based on the first gaze position and the user's second gaze position at each of the multiple second timings before the first timing. The concentration level determination device 100 can determine the user's concentration level based on a comparison of the position change and transition between the first specific area and the second specific area corresponding to each of the multiple third timings after the first timing included in the image. This allows the concentration level determination device 100 to more accurately determine the user's concentration level based on a comparison of the position change and transition over a relatively long period of time.

[0160] The concentration level determination device 100 can determine the concentration level of the user based on the distance between the trajectory indicating the position change and the trajectory indicating the transition. This allows the concentration level determination device 100 to obtain an appropriate guide to the concentration level of the user and to accurately determine the concentration level of the user.

[0161] The concentration level determination device 100 can display the determination result. This allows the concentration level determination device 100 to make the determination result available to people.

[0162] The concentration level determination device 100 can transmit the determination result to another computer, thereby making the determination result available to the other computer.

[0163] The concentration level determination method described in this embodiment can be realized by executing a prepared program on a computer such as a PC or a workstation. The concentration level determination program described in this embodiment is recorded on a computer-readable recording medium, and is executed by being read from the recording medium by the computer. The recording medium is a hard disk, a flexible disk, a CD (Compact Disc)-ROM, an MO (Magneto Optical disc), a DVD (Digital Versatile Disc), or the like. The concentration level determination program described in this embodiment may be distributed via a network such as the Internet.

[0164] The following supplementary notes are further disclosed regarding the above-described embodiment.

[0165] (Additional Note 1) Identifying a first gaze position of a user on an image at a first timing; when a first specific area included in the image and corresponding to the first timing differs from the first gaze position, identifying a transition of the gaze position of the user based on the first gaze position and a second gaze position of the user on the image at a second timing prior to the first timing; determining a concentration level indicating a level to which the user is focused, based on a comparison between a position change between the first specific area and a second specific area corresponding to a third timing after the first timing included in the image and the identified transition; A concentration determination program for causing a computer to execute a process.

[0166] (Additional Note 2) The first specific area and the second specific area are identified based on gaze positions on the image of each of a plurality of users. 2. The concentration determination program according to claim 1, characterized in that the program causes the computer to execute processing.

[0167] (Appendix 3) The first specific area and the second specific area are identified based on an analysis result of the content of the image. 3. The concentration determination program according to claim 1 or 2, characterized in that the program causes the computer to execute a process.

[0168] (Appendix 4) Based on an analysis result of analyzing the gaze positions on the image of each of a plurality of users and the content of the image, candidates for a specific area including gaze positions on the image of a number of users among the plurality of users equal to or greater than a threshold and representing a predetermined content included in the image are extracted, and the first specific area and the second specific area are identified based on the extracted candidates. 2. The concentration determination program according to claim 1, characterized in that the program causes the computer to execute processing.

[0169] (Appendix 5) The concentration determination program described in Appendix 3, characterized in that the process of identifying the first specific area and the second specific area includes a process of identifying the first specific area and the second specific area based on associated information accompanying the image related to the content of the image.

[0170] (Additional Note 6) The first specific area is an area including gaze positions of a number of users among a plurality of users equal to or greater than a first threshold value at the first timing, The concentration level determination program described in any one of Appendices 1 to 3, characterized in that the second specific area is an area that includes the gaze positions of a number of users among the multiple users that is equal to or greater than a second threshold value at the third timing.

[0171] (Supplementary Note 7) The second timing includes a first plurality of timings; the third timing includes a second plurality of timings; the second gaze position includes a plurality of gaze positions of the user on the screen at each of the first plurality of timings, the second specific region includes a plurality of specific regions corresponding to the second plurality of timings, the process of identifying the transition includes a process of identifying a transition of a gaze position of the user based on the first gaze position and the multiple gaze positions; The concentration level determination program described in any one of Appendices 1 to 6, characterized in that the determination process includes a process of determining the user's concentration level based on a comparison of the position change between the first specific area and the multiple specific areas and the transition.

[0172] (Appendix 8) The concentration level determination program according to any one of Appendices 1 to 7, characterized in that the determination process includes a process of determining the user's concentration level based on a distance between a trajectory indicating the position change and a trajectory indicating the transition.

[0173] (Appendix 9) Display the result of the judgment. 9. The concentration level determination program according to any one of claims 1 to 8, which causes the computer to execute a process.

[0174] (Appendix 10) Transmitting the result of the determination to another computer; 10. The concentration level determination program according to any one of claims 1 to 9, which causes the computer to execute a process.

[0175] (Appendix 11) Identifying a first gaze position of a user on an image at a first timing; when a first specific area included in the image and corresponding to the first timing differs from the first gaze position, identifying a transition of the gaze position of the user based on the first gaze position and a second gaze position of the user on the image at a second timing prior to the first timing; determining a concentration level indicating a level to which the user is focused, based on a comparison between a position change between the first specific area and a second specific area corresponding to a third timing after the first timing included in the image and the identified transition; A method for determining a concentration level, the processing of which is executed by a computer.

[0176] (Appendix 12) Identifying a first gaze position of a user on an image at a first timing; when a first specific area included in the image and corresponding to the first timing differs from the first gaze position, identifying a transition of the gaze position of the user based on the first gaze position and a second gaze position of the user on the image at a second timing prior to the first timing; determining a concentration level indicating a level to which the user is focused, based on a comparison between a position change between the first specific area and a second specific area corresponding to a third timing after the first timing included in the image and the identified transition; A concentration determination device comprising a control unit. [Explanation of symbols]

[0177] 100 Concentration level determination device 101 First Gaze Position 102 Second Gaze Position 110,100 images 111 First Specific Area 112 Second Specific Area 200 Concentration Judgment System 201 User side device 202 Provider side device 210 Network 300,700 Bus 301,701 CPU 302,702 Memory 303,703 Network I / F 304,704 Recording media I / F 305,705 Recording media 400 Gaze position management table 500 Stay point management table 600 Important Area Management Table 706 Display 707 Camera 800 Storage section 801 Acquisition Department 802 1st Specific Section 803 1st Judgment Department 804 Second Specific Section 805 2nd Judgment Department 806 Output section 810 Control section 901 Line of Sight Detection Device 902 Display content acquisition device 910 Other's gaze DB 911 Eye Tracking Department 912 Saccade detection unit 913 Important area determination section 914 Appearance order recognition unit 915 Straight line detector 916 Distance calculation section 917 Concentration State Evaluation Section 918 Display control unit 920 Display device 1001,1003 trajectory 1002 Eye gaze transition

Claims

1. Identifying a first gaze position of the user on the image at a first timing; When a first specific area corresponding to the first timing included in the image is different from the first gaze position, a transition of the gaze position of the user is identified based on the first gaze position and a second gaze position of the user on the image at a second timing prior to the first timing; determining a concentration level indicating a level to which the user is focused, based on a comparison between a position change between the first specific area and a second specific area included in the image, the second specific area corresponding to a third timing after the first timing, and the identified transition; A concentration determination program for causing a computer to execute a process.

2. identifying the first specific area and the second specific area based on gaze positions on the image of each of a plurality of users; 2. The concentration level determination program according to claim 1, wherein the program causes the computer to execute processing.

3. Identifying the first specific region and the second specific region based on an analysis result of analyzing the content of the image.

3. The concentration level determination program according to claim 1, wherein the program causes the computer to execute processing.

4. extracting candidates for a specific area including gaze positions on the image of a number of users equal to or greater than a threshold among the multiple users and representing a predetermined content included in the image, based on an analysis result of analyzing the gaze positions on the image of each of the multiple users and the content of the image, and identifying the first specific area and the second specific area based on the extracted candidates; 2. The concentration level determination program according to claim 1, wherein the program causes the computer to execute processing.

5. The concentration determination program of claim 3, characterized in that the process of identifying the first specific area and the second specific area includes a process of identifying the first specific area and the second specific area based on associated information accompanying the image related to the content of the image.

6. the first specific region is a region including gaze positions of a number of users, among a plurality of users, equal to or greater than a first threshold value, at the first timing; The concentration level judgment program described in any one of claims 1 to 3, characterized in that the second specific area is an area that includes the gaze positions of a number of users among the multiple users that is equal to or greater than a second threshold value at the third timing.

7. the second timing includes a first plurality of timings; the third timing includes a second plurality of timings; the second gaze position includes a plurality of gaze positions of the user on the image at each of the first plurality of timings, the second specific region includes a plurality of specific regions corresponding to the second plurality of timings, the process of identifying the transition includes a process of identifying a transition of a gaze position of the user based on the first gaze position and the multiple gaze positions; A concentration determination program as described in any one of claims 1 to 6, characterized in that the determination process includes a process of determining the user's concentration level based on a comparison of the position change between the first specific area and the multiple specific areas and the transition.

8. The concentration level determination program according to any one of claims 1 to 7, characterized in that the determination process includes a process of determining the user's concentration level based on the distance between a trajectory indicating the position change and a trajectory indicating the transition.

9. Identifying a first gaze position of the user on the image at a first timing; When a first specific area corresponding to the first timing included in the image is different from the first gaze position, a transition of the gaze position of the user is identified based on the first gaze position and a second gaze position of the user on the image at a second timing prior to the first timing; determining a concentration level indicating a level to which the user is focused, based on a comparison between a position change between the first specific area and a second specific area corresponding to a third timing after the first timing included in the image and the identified transition; A method for determining a concentration level, the processing of which is executed by a computer.

10. Identifying a first gaze position of the user on the image at a first timing; When a first specific area corresponding to the first timing included in the image is different from the first gaze position, a transition of the gaze position of the user is identified based on the first gaze position and a second gaze position of the user on the image at a second timing prior to the first timing; determining a concentration level indicating a level to which the user is focused, based on a comparison between a position change between the first specific area and a second specific area included in the image, the second specific area corresponding to a third timing after the first timing, and the identified transition; A concentration determination device comprising a control unit.

Images