Information processing system, information processing method, and program

Abstract

The present invention addresses the problem of making it possible to assist in enhancing attention focus of a user by detecting a decrease in the attention focus.　A determination unit 33 infers whether or not the visual line of the user is directed at a prescribed area, on the basis of determination information detected from the user's action or behavior. On the basis of the inference result, the determination unit 33 further determines whether or not the user is performing a prescribed task. When the user is not performing the prescribed task, an output unit 34 outputs prescribed information to the user. The problem mentioned above is solved thereby.

Description

Information processing system, information processing method, and program

[0001] The present invention relates to an information processing system, an information processing method, and a program.

[0002] There are known technologies for supporting users in completing tasks. For example, Patent Literature 1 discloses a technology for determining the status of a learner's learning task based on brain waves, eye gaze, etc. This technology determines whether the learner is editing or thinking depending on the learner's eye gaze position.

[0003] JP 2018-124483 A

[0004] However, the technology in Patent Document 1 only estimates the state of the learner based on the limited condition of the learner's gaze position, and therefore cannot detect a decrease in the learner's concentration and help improve the learner's concentration.

[0005] The present invention has been made in consideration of such circumstances, and aims to be able to detect a decrease in the concentration of a user performing a task and to assist in increasing the concentration of the user.

[0006] In order to achieve the above-mentioned object, one aspect of the present invention is an information processing system characterized by having: a judgment means for judging whether a user is performing a specified task based on judgment information for judging a decrease in the user's concentration, which is detected from the user's movements or actions; and an output means for outputting specified information if the user is not performing the task.

[0007] An information processing method and a program corresponding to the information processing system according to one aspect of the present invention are also provided as an information processing device, an information processing method, and a program corresponding to the information processing system according to one aspect of the present invention.

[0008] According to the present invention, it is possible to detect a decrease in the concentration of a user performing a task and to assist in increasing the concentration of the user.

[0009] 1 is a diagram showing an example of the overall configuration of an information processing system according to an embodiment of the present invention; FIG. 2 is a block diagram showing an example of the hardware configuration of a management server constituting the information processing system of FIG. 1; FIG. 3 is a functional block diagram showing an example of the functional configuration of the management server; FIG. 4 is a flowchart showing an example of the processing flow of the management server; FIG. 5 is a diagram showing a specific example of the present service; FIG. 6 is a diagram showing a specific example of the present service;

[0010] This embodiment will be described below with reference to the drawings. <Information Processing System S> Fig. 1 is a diagram showing an example of the overall configuration of an information processing system S according to one embodiment of the present invention. The information processing system S is an information processing system configured to include a management server 1, a teaching material providing server 2, a first user terminal 3, and second user terminals 4-1 to 4-n (n is an integer value of 1 or greater), all connected via a network N. The network N is, for example, the Internet, a LAN (Local Area Network), a VPN (Virtual Private Network), etc. Hereinafter, when there is no need to explain the second user terminals 4-1 to 4-n individually, they will be collectively referred to as the "second user terminals 4."

[0011] The information processing system S is a system that realizes a service (hereinafter referred to as "this service") that supports the concentration of a user performing a predetermined task. In this service, the information processing system S detects a decrease in the concentration of a user performing a predetermined task and outputs alert information indicating this.

[0012] Furthermore, this service detects that the user is performing something other than the specified task while performing the specified task. Then, information is output that prompts the user to utter a specified phrase. In this case, when the user utters the specified phrase, the user is permitted to perform something other than the task, or is prompted to perform the specified task. This allows the user to focus their attention on the task. In the following, in this embodiment, the task will be described as studying learning materials that the user has ordered for self-improvement.

[0013] [Management Server 1] The management server 1 constituting the information processing system S is an information processing device that serves as a server for managing the entire information processing system S. The management server 1 is managed, for example, by a service provider that provides the present service. The management server 1 is capable of executing a predetermined application program that enables the provision of the present service. The management server 1 transmits various types of information to the learning material providing server 2, the first user terminal 3, the second user terminal 4, and external devices, and enables various processes to be executed. The management server 1 also acquires various types of information transmitted from the learning material providing server 2, the first user terminal 3, the second user terminal 4, and external devices, and enables the execution of various processes.

[0014] For example, the management server 1 stores and manages information about the user's learning materials (hereinafter referred to as "learning material information") provided from the learning material providing server 2 or the first user terminal 3 described below. The learning material information may be the learning material itself, or the structure or content of the learning material. The management server 1 acquires information (hereinafter referred to as "determination information") for determining whether the user is concentrating, detected from the user's movements or behavior, and determines whether the user is concentrating on the learning material based on the determination information. The determination information is provided from the first user terminal 3 or the second user terminal 4.

[0015] For example, the management server 1 can determine whether the user is concentrating on the learning materials based on the user's gaze movement estimated from a captured image of the user's face (especially the eyes). In this case, the management server 1 determines whether the user is concentrating on the learning materials based on whether the user's gaze is in a predetermined area. The "predetermined area" is, for example, the display area of ​​the GUI (Graphical User Interface) of the learning materials displayed on the first user terminal 3. If the user's gaze is not in the predetermined area, the management server 1 determines that the user's concentration is decreasing.

[0016] Furthermore, the management server 1 can determine whether the user is concentrating on the learning materials based on the operation of the first user terminal 3 or the second user terminal 4 by the user. In this case, the management server 1 determines the degree of concentration of the user based on whether the processing content of the first user terminal 3 or the second user terminal 4 is related to the learning materials. For example, suppose the second user terminal 4 is a television receiver. Because the processing content of the television receiver is not related to the learning materials, when the power switch of the television receiver is turned on, the management server 1 determines that the user's concentration is decreasing.

[0017] When the management server 1 determines that the user's concentration has decreased, it outputs predetermined information. For example, the management server 1 can output information to make the user aware of the existence of learning materials as the predetermined information. Information to make the user aware of the existence of learning materials includes, for example, alert information to notify the user that they have not studied the learning materials, and information to make the user express that they will study the learning materials (hereinafter referred to as "expression instruction information"). The expression instruction information includes, for example, information to make the user utter a predetermined phrase, information to make the user input a predetermined phrase, information to make the user perform a predetermined gaze action, etc. Details of the configuration and processing of the management server 1 will be described later.

[0018] [Learning Material Providing Server 2] The learning material providing server 2, which constitutes the information processing system S, is an information processing device that provides users with learning materials for their study. The learning materials provided to users include information consisting of text data, image data, audio data, etc., and are output from a display, speaker, etc. of a first user terminal 3 on which a predetermined application program that enables output of the learning materials is installed. The learning material providing server 2 is managed, for example, by a business that provides learning materials to users. The learning material providing server 2 is capable of executing a predetermined application program that enables use of this service. The learning material providing server 2 is capable of transmitting learning materials to both the management server 1 and the first user terminal 3. The learning material providing server 2 is also capable of acquiring various information transmitted from the first user terminal 3 and executing various processes.

[0019] [First User Terminal 3] The first user terminal 3 constituting the information processing system S is an information processing device operated by a user who studies the learning materials while using the service. The first user terminal 3 is composed of, for example, a smartphone, a tablet terminal, a personal computer, a wearable terminal, etc. The first user terminal 3 is capable of executing a predetermined application program that enables use of the service. The first user terminal 3 is capable of executing various processes based on various information transmitted from the management server 1, the learning material providing server 2, the second user terminal 4, and external sources, as well as various information input by the user. The first user terminal 3 is also capable of transmitting various information to the management server 1, the learning material providing server 2, the second user terminal 4, and external sources.

[0020] For example, the first user terminal 3 obtains learning materials from the learning material providing server 2 and outputs various information contained in the learning materials. The information contained in the learning materials exists in data formats such as text data, image data, and audio data. The user studies using the learning materials output from the first user terminal 3. When studying using the learning materials output from the first user terminal 3, the user can use this service to recognize a decrease in their own concentration while studying the learning materials and take action to improve their concentration.

[0021] The first user terminal 3 is capable of acquiring determination information detected from the user's movements or actions and transmitting it to the management server 1. For example, if the first user terminal 3 has an imaging function such as a camera, it is capable of acquiring an image of the user's face as determination information and transmitting it to the management server 1. In this case, the management server 1 determines whether the user's concentration is decreasing based on where the user's line of sight is directed, which is estimated from the image of the user's face.

[0022] Furthermore, for example, if the first user terminal 3 is a wearable terminal or the like and is capable of measuring biometric data such as heart rate, body temperature, and sweat rate, it is possible to acquire the measurement results of the user's biometric data as determination information and transmit it to the management server 1. In this case, the management server 1 determines whether the user's concentration is decreasing based on the degree of stress or drowsiness felt by the user, which is estimated from the user's biometric data.

[0023] Furthermore, for example, when the first user terminal 3 can detect the active screen, it acquires, as determination information, information indicating that the active screen has switched from the learning material screen to the screen of another application program. The first user terminal 3 then enables the information indicating the screen switch to be transmitted to the management server 1. In this case, the management server 1 determines whether the user's concentration has decreased based on whether the user has performed an operation to switch from the learning material screen to another screen, which is inferred from the information indicating the screen switch.

[0024] When it is determined that the user's concentration is decreasing, the first user terminal 3 outputs, as predetermined information, information for making the user aware of the presence of learning materials. For example, the first user terminal 3 displays on the display a GUI including alert information or expression instruction information as information for making the user aware of the presence of learning materials. Specifically, for example, the first user terminal 3 may output, as the expression instruction information, information for making the user utter a predetermined phrase. In this case, the first user terminal 3 may display on the display a GUI including, for example, a message for encouraging the user to recite "I will solve problems 11 to 20 in the workbook" ten times as information for making the user utter the predetermined phrase. The configuration and processing of the first user terminal 3 will be described in detail below.

[0025] [Second User Terminal 4] The second user terminal 4 constituting the information processing system S is an information processing device operated by a user who uses the service separately from the above-mentioned first user terminal 3. The second user terminal 4 is composed of, for example, a smartphone, a tablet terminal, a personal computer, a television receiver, a game terminal, a wearable terminal, a virtual reality (VR) display device, etc. The number of second user terminals 4 for one user is not limited. For example, one user may own second user terminals 4-1 to 4-5.

[0026] The second user terminal 4 is capable of executing a predetermined application program that enables use of the service. The second user terminal 4 is capable of executing various processes based on various information transmitted from the management server 1, the first user terminal 3, and external sources, as well as various information input by the user. The second user terminal 4 is also capable of transmitting various information to the management server 1, the first user terminal 3, and external sources.

[0027] For example, similar to the first user terminal 3 described above, the second user terminal 4 can acquire determination information detected from the user's actions or behavior and transmit the information to the management server 1. For example, if the second user terminal 4 is a television receiver, the second user terminal 4 acquires information indicating that its own power switch has been turned on as determination information. The second user terminal 4 then transmits the acquired determination information to the management server 1. In this case, the management server 1 determines whether the user's concentration is decreasing based on the information indicating that the power switch of the television receiver has been turned on.

[0028] Furthermore, for example, if the second user terminal 4 is a game terminal, the second user terminal 4 acquires information indicating that its own power switch has been turned ON as information for determination. The second user terminal 4 then transmits the acquired information for determination to the management server 1. In this case, the management server 1 determines whether the user's concentration has decreased based on the information indicating that the power switch of the game terminal has been turned ON. This also applies when the second user terminal 4 is a smartphone functioning as a game terminal.

[0029] Furthermore, for example, if the second user terminal 4 is a virtual reality (VR) display device, the second user terminal 4 acquires information indicating that its own power switch has been turned on as information for determination. The second user terminal 4 then transmits the acquired information for determination to the management server 1. In this case, the management server 1 determines whether the user's concentration has decreased based on the information indicating that the power switch of the virtual reality (VR) display device has been turned on.

[0030] The above-described processes performed by the management server 1, the teaching material providing server 2, the first user terminal 3, and the second user terminal 4 constituting the information processing system S are merely examples. In other words, it is sufficient that the information processing system S as a whole has the functions to realize the above-described processes, and therefore some or all of the functions to realize the above-described processes may be shared or cooperated within the information processing system S.

[0031] For example, some or all of the functions of the management server 1 may be functions of other devices in the information processing system S. Also, some or all of the functions of other devices in the information processing system S may be functions of the management server 1. Furthermore, some or all of the functions of the management server 1 may be transferred to other servers (not shown). This promotes processing in the information processing system S as a whole and also makes it possible for processes to complement each other.

[0032] <Hardware Configuration> [Hardware Configuration of Management Server 1] Fig. 2 is a block diagram showing an example of the hardware configuration of the management server 1 that constitutes the information processing system S of Fig. 1. The management server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20. Of these, the storage unit 18 functions as a storage means.

[0033] The CPU 11 executes various processes in accordance with programs recorded in the ROM 12 or programs loaded from the storage unit 18 into the RAM 13. The RAM 13 also stores data and the like required for the CPU 11 to execute various processes. The CPU 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output interface 15 is also connected to this bus 14.

[0034] The input / output interface 15 is connected to an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20. The output unit 16 is composed of a display, a speaker, etc., and outputs various types of information as images, sounds, etc. The input unit 17 is composed of a keyboard, a mouse, a touch panel, etc., and accepts input of various types of information. The storage unit 18 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), etc., and stores various types of data. The communication unit 19 communicates with other devices via the above-mentioned network N, which is composed of the Internet, etc.

[0035] Removable media 21, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, is appropriately attached to the drive 20. Programs read from the removable media 21 by the drive 20 are installed in the storage unit 18 as needed. The removable media 21 can also store various data stored in the storage unit 18 in the same way as the storage unit 18.

[0036] [Hardware Configuration of the Learning Material Providing Server 2, First User Terminal 3, and Second User Terminal 4] The learning material providing server 2, first user terminal 3, and second user terminal 4 have the same hardware configuration as the management server 1 shown in Fig. 2 above. That is, the learning material providing server 2, first user terminal 3, and second user terminal 4 each have a CPU, ROM, RAM, bus, input / output interface, output unit, input unit, memory unit, communication unit, drive, and removable media (not shown), which correspond to the CPU 11, ROM 12, RAM 13, bus 14, input / output interface 15, output unit 16, input unit 17, memory unit 18, communication unit 19, drive 20, and removable media 21, respectively, shown in Fig. 2. Of these, the output unit functions as output means.

[0037] Furthermore, in addition to the above-described configuration, the first user terminal 3 may also have an imaging unit. The imaging unit is configured with a camera, etc. For example, the imaging unit captures an image of a subject displayed on a display of the output unit that functions as a camera viewfinder, acquires the captured image as still image data or moving image data, and stores the captured image in the storage unit.

[0038] <Functional Configuration of Management Server 1> Fig. 3 is a functional block diagram showing an example of the functional configuration of the management server 1. When the CPU 11 of the management server 1 operates, an information acquisition unit 31 and an information management unit 32 function. When the CPU 11 operates, a determination unit 33 as a determination means, an output control unit 34, and a transmission control unit 35 also function.

[0039] Various databases are provided in the storage unit 18 of the management server 1. For example, databases such as a teaching material DB 41 storing teaching material information and a determination DB 42 storing determination information are provided.

[0040] The information acquisition unit 31 acquires various types of information. For example, the information acquisition unit 31 acquires various types of information transmitted to the management server 1 from the teaching material providing server 2, the first user terminal 3, the second user terminal 4, and external devices. Among these, information transmitted from the teaching material providing server 2 to the management server 1 includes, for example, teaching material information. Furthermore, information transmitted from the first user terminal 3 to the management server 1 includes, for example, determination information.

[0041] The information management unit 32 stores and manages various types of information in the database of the storage unit 18. For example, the information management unit 32 stores and manages the teaching material information acquired by the information acquisition unit 31 in the teaching material DB 41. The information management unit 32 also stores and manages the judgment information acquired by the information acquisition unit 31 in the judgment DB 42.

[0042] The determination unit 33 makes various determinations based on various information. For example, the determination unit 33 determines whether the user is concentrating on the learning materials based on the determination information acquired by the information acquisition unit 31. Specifically, for example, the determination unit 33 detects the user's gaze movement and eye movement patterns from a captured image of the user's face (particularly the eyes) as the determination information, thereby making it possible to determine whether the user is concentrating on the learning materials. The determination unit 33 also detects a yawning movement from a captured image of the user's face (particularly the mouth), making it possible to determine whether the user is concentrating on the learning materials. The determination unit 33 also detects the user's facial expression (serious expression, sleepy expression, expressionless expression, etc.) from a captured image of the user's face, making it possible to determine whether the user is concentrating on the learning materials.

[0043] Furthermore, for example, the determination unit 33 can estimate the user's behavior from the operation details of the first user terminal 3 and the second user terminal 4 as determination information, thereby determining whether the user is concentrating on the learning materials. Examples of the operation details of the first user terminal 3 and the second user terminal 4 include key operations, mouse operations, scrolling operations, work pace, and the number of times the user re-views content. Furthermore, the determination information can include the response time to the display of information prompting the user to perform a specific operation and the user's reaction to a message to check whether the user is concentrating on the learning materials. For example, the determination information can include the user's reaction (response time and reply content) to the message "Are you progressing smoothly with the learning materials?" Furthermore, the determination information can include an operation to launch a specific application program after a period of time during which the user's concentration is expected to lapse.

[0044] Furthermore, for example, if the learning materials output from the first user terminal 3 are provided via a website, it is possible to estimate the user's behavior from the HTML tag structure and element arrangement as assessment information, and determine the degree of the user's concentration on the learning materials. In this case, by combining a technique for machine learning the history of the user's past eye gaze behavior, it is possible to identify the area of ​​the learning materials displayed as content on the webpage, and associate the direction vector of the user's gaze with the coordinates of the area of ​​the learning materials.

[0045] Furthermore, a heat map of gaze behavior may be generated by aggregating the gaze behavior histories of multiple users who use the learning materials. Furthermore, a user with an excellent history of using the learning materials may be identified from among multiple users who use the learning materials, and a gaze behavior pattern may be extracted. In this case, appropriate gaze behavior may be determined based on the generated heat map or the extracted gaze behavior pattern, and this may be used as evidence information for determining the degree of focus of the user's attention on the learning materials.

[0046] Furthermore, the content of the area where the gaze is directed may be analyzed and the relevance to the topic of the current learning material may be evaluated to determine the degree of concentration of the user's attention on the learning material. In this case, the relevance between the content of the area where the gaze is directed and the topic of the learning material may be learned by machine learning, and the degree of concentration of the user's attention on the learning material may be determined based on whether the gaze is directed to an area corresponding to the topic of the learning material. Furthermore, "what to do and how to do it" may be defined for each topic of the learning material, and the degree of concentration of the user's attention on the learning material may be determined based on whether the gaze is directed to the corresponding area.

[0047] The output control unit 34 controls the first user terminal 3 and the second user terminal 4 to output various types of information. For example, if the determination result of the determination unit 33 is that the user has not studied the learning materials, the output control unit 34 controls the output of predetermined information. In this case, the output control unit 34 controls the output of alert information and expression instruction information as the predetermined information. The alert information and expression instruction information may be vocalized by an interactive AI.

[0048] The output control unit 34 may output alert information identified from information about the device being used by the user. Furthermore, if the location where the user is studying using study materials (e.g., a study room with a desk) is identified, the output control unit 34 may output alert information based on the user's current location identified from GPS (Global Positioning System) location information. In this case, the alert information may include content instructing the user to return to the location where the user is studying using the study materials.

[0049] The output control unit 34 may cause the interactive AI to utter a specific message such as "solve numbers 11 to 20 in the problem set" as the expression instruction information, thereby prompting the user to reply, "solve numbers 11 to 20 in the problem set." In this case, if the user does not resume the study material after a predetermined time has elapsed, the interactive AI may issue a stern warning and prompt the user to repeat "solve numbers 11 to 20 in the problem set" multiple times. Furthermore, to enhance the effect, the user may be prompted to "point and call out."

[0050] In addition, the output control unit 34 may use, as expression instruction information, an abstract message such as "Say 'concentrate'" to be spoken by the interactive AI, thereby making the user say "concentrate."

[0051] Furthermore, instead of outputting information for the user to speak, the output control unit 34 may output information for the user to input text as the expression instruction information. In this case, for example, the user may be prompted to input text such as "What you need to do now is solve questions 1 to 20 in the workbook." Alternatively, for example, the output control unit 34 may output information for the user to perform a gaze action. In this case, for example, the user may be prompted to continue gazing at a certain area.

[0052] The transmission control unit 35 controls the communication unit 19 (see FIG. 2) to transmit various types of information to the learning material providing server 2, the first user terminal 3, the second user terminal 4, and the outside. For example, the transmission control unit 35 controls the transmission to the first user terminal 3 of information indicating that the concentration of the user studying the learning material is decreasing.

[0053] <Processing Flow of Management Server 1> Figure 4 is a flowchart showing an example of the processing flow of the management server 1. The management server 1 acquires, records, and manages learning material information from the learning material providing server 2 or the first user terminal 3 (step S1). When determination information is transmitted from the first user terminal 3 or the second user terminal 4 (YES in step S2), the management server 1 acquires the transmitted determination information (step S3). Specifically, the management server 1 acquires, as determination information, captured images of the user's face, operation details of the first user terminal 3 and the second user terminal 4, and the like. On the other hand, if determination information has not been transmitted (NO in step S2), the management server 1 repeats the determination process of step S2.

[0054] Based on the determination information acquired in step S3, the management server 1 determines whether the user is concentrating on the learning materials. If the user is studying the learning materials (YES in step S4), the process returns to the determination process in step S2. On the other hand, if the user is not studying the learning materials (NO in step S4), the management server 1 outputs information to make the user aware of the presence of the learning materials (step S5). Specifically, the management server 1 outputs alert information and expression instruction information as information to make the user aware of the presence of the learning materials. This ends the processing of the management server 1 (END).

[0055] 5 to 7 are diagrams showing specific examples of this service. Fig. 5(A) shows a user U studying learning materials T by operating a first user terminal 3. The first user terminal 3 has a camera C that can capture an image of the user U. The first user terminal 3 captures an image of the user U's face with the camera C and transmits the captured image to the management server 1. The management server 1 determines whether the user U is concentrating their attention on the learning materials T based on the user U's gaze movement estimated from the captured image of the user U's face.

[0056] As shown in Figure 5(A), when the user U's gaze is on the display area of ​​the GUI of the learning material T, the management server 1 determines that the user U's attention is focused on the learning material T. In other words, when the user U's attention is focused on the learning material T, the possibility that the user U has taken their eyes off the GUI of the learning material is low. In contrast, as shown in Figure 5(B), when the user U's gaze is not on the display area of ​​the GUI of the learning material T, the management server 1 determines that the user U's attention is not focused on the learning material T. In other words, when the user U's attention is not focused on the learning material T, the possibility that the user U has taken their eyes off the GUI of the learning material T is high.

[0057] In the example of Figure 5 (B), it is determined that the user U is not concentrating on the learning material T, so a warning sound P is output from the speaker of the first user terminal 3 as alert information, and further, a word W or a mark K indicating a warning is displayed on the screen of the first user terminal 3.

[0058] FIG. 6A shows a user U studying learning material T by operating a first user terminal 3. A television receiver is placed near the user U as a second user terminal 4. In this situation, assume that the user U studying learning material T turns on the power switch of the second user terminal 4. Then, as shown in FIG. 6B, the second user terminal 4 acquires information indicating that its power switch has been turned on as determination information and transmits it to the management server 1. Upon acquiring the information indicating that the power switch of the second user terminal 4 has been turned on as determination information, the management server 1 determines that the user U is not concentrating on the learning material T. In other words, the management server 1 determines that the user U studying learning material T has lost concentration and has started watching the television receiver (second user terminal 4).

[0059] In the example of FIG. 6(B), it is determined that the user U is not concentrating on the learning material T. Therefore, on the screen of the first user terminal 3, information for prompting the user U to utter a predetermined phrase is displayed as expression instruction information. Specifically, a GUI including a message M prompting the user U to recite "I will solve numbers 11 to 20 in the problem set" ten times is displayed on the screen of the first user terminal 3. Here, when the user U recites "I will solve numbers 11 to 20 in the problem set" ten times, the first user terminal 3 acquires the voice data and transmits it to the management server 1.

[0060] By acquiring and analyzing the transmitted voice data, the management server 1 recognizes that the user U has recited "I will solve questions 11 to 20 in the workbook" ten times. The management server 1 then controls the second user terminal 4 (television receiver) so that the user U can view content (television programs, etc.) output from the second user terminal 4. In this case, although not shown, the management server 1 may, for example, cause the first user terminal 3 to display a predetermined password for enabling the user U to view the content.

[0061] Furthermore, the management server 1 may be configured to output the expression instruction information again from the second user terminal 4 when a predetermined time has elapsed since the user U started viewing the content output from the second user terminal 4. In this case, for example, the user U may be prompted to repeatedly utter a predetermined phrase such as "I'll do it." This limits the time the user U spends viewing the content output from the second user terminal 4, thereby more reliably allowing the user U to complete the learning material T.

[0062] When the viewing time of the content output from the second user terminal 4 (television receiver) reaches a predetermined time, the management server 1 displays a message indicating this on the second user terminal 4 and a message recommending that the user stop viewing the content and study with the learning material T. For example, a message such as "Your TV viewing time has exceeded xx minutes. Please stop watching and continue with the learning material" may be displayed on the second user terminal 4. When the user U sees this message, he or she remembers having recited "I will solve questions 11 to 20 in the workbook" 10 times, and therefore is motivated to carry out what he or she has said. This utilizes the psychological mechanism (commitment effect) that encourages consistency in one's words and actions.

[0063] FIG. 7A shows a user U studying learning material T by operating a first user terminal 3. The first user terminal 3 is a smartphone, and various application programs are running simultaneously, switching the active screen in response to user U's operations. In this situation, assume that user U studying learning material T switches the active screen from learning material T to a predetermined SNS. Then, as shown in FIG. 7B, the first user terminal 3 acquires information indicating that the active screen has switched from learning material T to the predetermined SNS as determination information and transmits it to the management server 1. Upon acquiring the information indicating that the active screen has switched from learning material T to the predetermined SNS as determination information, the management server 1 determines that user U is not concentrating on learning material T. In other words, the management server 1 determines that user U's concentration on learning material T has decreased and that he has started browsing the predetermined SNS.

[0064] In the example of FIG. 7(B), it is determined that the user U is not concentrating on the learning material T, and therefore, the expressive instruction information is displayed on the screen of the first user terminal 3. Specifically, as the expressive instruction information, a message M1, "Is XX (a specified SNS) related to the learning material?", is displayed on the screen of the first user terminal 3. Furthermore, in the example of FIG. 7(B), information for prompting the user U to utter a predetermined phrase is displayed on the screen of the first user terminal 3 as the expressive instruction information. Specifically, a message M2 is displayed prompting the user U to utter the phrase "XX (a specified SNS) after the learning material." Here, if the user U utters "XX (a specified SNS) after the learning material," it is expected that the user U will feel guilty about using the specified SNS before finishing the learning material T. Note that, while "XX" is a specified SNS in the example of FIG. 7(B), the same applies to other application programs and websites, such as video distribution services.

[0065] In the examples shown in Figures 5 to 7, the management server 1 can output messages recommending specific techniques for enhancing the user U's concentration. In this case, specific techniques for enhancing the user U's concentration include, for example, providing a quiet place free from noise and distractions to create a good learning environment for the user U, and clearing the desk and leaving only the necessary items. Furthermore, because it is difficult to maintain concentration for long periods of time, other techniques include taking a five- to ten-minute break every hour or so, standing up and doing some light exercise, clarifying goals to increase motivation, setting rewards, and finding enjoyment. Other examples include listening to music that enhances concentration and using application programs that enhance concentration.

[0066] Furthermore, the management server 1 can prevent the user U from losing focus by keeping the GUI of the learning material T always within the field of view of the user U. In this case, the GUI of the learning material T may be always displayed, for example, at the edge of the screen of the first user terminal 3. Furthermore, the display may not disappear unless a predetermined input operation is performed on the displayed GUI of the learning material T.

[0067] <Advantageous Effects of the Present Embodiment> According to the above-described embodiment, it is possible to detect a decrease in the user's concentration and to assist in increasing the concentration of the user.

[0068] <Others> Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and modifications, improvements, etc. that achieve the object of the present invention are included in the present invention. For example, in the above embodiment, the management server 1 determines whether the user's concentration is decreasing based on the determination information transmitted from the first user terminal 3 or the second user terminal 4. However, if determination information is transmitted from each of the first user terminal 3 and the second user terminal 4, it may determine whether the user's concentration is decreasing based on the two pieces of determination information transmitted. This can increase the reliability of the determination result.

[0069] 5 to 7 are merely examples for achieving the object of the present invention, and are not particularly limited. For example, Fig. 5(B) shows a case in which alert information is output because it is determined that the user U has a low level of concentration on the learning material, but expression instruction information may be output together with or instead of the alert information.

[0070] Also, for example, Figure 6 (B) shows a case in which expression instruction information is output because it is determined that user U's level of concentration on the learning material is low, but alert information may be output together with or instead of the expression instruction information.

[0071] In addition, although the above-described embodiment is based on the premise that the user performs one task (learning material), the user may also perform multiple types of tasks simultaneously in parallel. In this case, the multiple types of tasks may be registered with a priority order.

[0072] Furthermore, while the above-described embodiment illustrates a case in which there is only one user, it is common for multiple users to use the service. Therefore, for example, different application programs may be available to each user while they are studying the learning materials. For example, a user may not be permitted to view video distribution site A while studying the learning materials, but may be permitted to view video distribution site B. On the other hand, another user may not be permitted to view video distribution site B while studying the learning materials, but may be permitted to view video distribution site A.

[0073] Furthermore, the above-described series of processes can be executed by hardware or software. In other words, the above-described functional configuration is merely an example and is not particularly limited. In other words, it is sufficient for the information processing system to be provided with a function that can execute the above-described series of processes as a whole, and the type of functional block used to realize this function is not particularly limited to the above-described example.

[0074] The location of the functional blocks is not particularly limited and may be arbitrary. For example, the functional blocks of the management server 1 may be transferred to another device, or the functional blocks of another device may be transferred to a server. Furthermore, one functional block may be configured as a single piece of hardware, a single piece of software, or a combination of both.

[0075] When a series of processes is executed by software, the programs constituting the software are installed onto a computer or the like from a network or a recording medium. The computer may be a computer incorporated into dedicated hardware. The computer may also be a computer capable of executing various functions by installing various programs, such as a server, a general-purpose smartphone, or a personal computer.

[0076] The recording medium containing such a program may be configured as a removable medium (not shown) that is distributed separately from the device main body in order to provide the program to users, etc., or may be configured as a recording medium that is pre-installed in the device main body and provided to users, etc. Since the program can be distributed via a network, the recording medium may be installed in or accessible from a computer that is connected or connectable to the network.

[0077] In this specification, the steps describing the program recorded on the recording medium include not only processes that are performed in chronological order, but also processes that are not necessarily performed in chronological order but are performed in parallel or individually. Also, in this specification, the term "system" means an overall device composed of multiple devices or multiple means, etc.

[0078] In other words, an information processing system to which the present invention is applied can take various forms having the following configurations. (1) That is, the information processing system S to which the present invention is applied is an information processing system characterized by having: estimation means (e.g., the determination unit 33 in FIG. 3 ) that makes an estimation based on determination information for determining a decline in the user's concentration detected from the user's movements or actions; determination means (e.g., the determination unit 33 in FIG. 3 ) that determines whether the user is performing a predetermined task based on the estimation result by the estimation means; and output means (e.g., the output control unit 34 in FIG. 3 ) that outputs predetermined information to the user if the user is not performing the task. This makes it possible to detect a decline in the user's concentration based on the user's line of sight and support improving the user's concentration.

[0079] (2) The output means may be configured to output the predetermined information when the user's line of sight is not in the predetermined area, thereby detecting a decrease in the user's concentration when the user's line of sight is not in the predetermined area.

[0080] (3) The output means may output, as the predetermined information, information for making the user aware of the existence of the task, thereby informing the user when the user's concentration is declining.

[0081] (4) The output means may output alert information to notify the user that the task is not being performed, as information for the user to recognize. This allows the user to be notified by the alert information when the user's concentration is declining.

[0082] (5) The device may further include a storage unit (e.g., the storage unit 18 in FIG. 2) for storing task information related to the user's task, and the output unit may output, as information for the user to recognize, expression instruction information for causing the user to express that he or she will perform the task. This can help the user to increase their concentration by causing the user to express that he or she will perform the task.

[0083] (6) The output means may output information for causing the user to vocalize a predetermined phrase as the expression instruction information. This allows the user to vocalize the task, thereby helping to increase the user's concentration.

[0084] (7) The output means may output, as the expression instruction information, information for causing the user to perform a predetermined action. This helps to increase the user's concentration by showing the user that a task is being performed through the predetermined action.

[0085] (8) The output means may output information for causing the user to perform a predetermined gaze movement as the predetermined action, thereby helping to increase the user's concentration by indicating to the user that a task is being performed by the gaze movement.

[0086] (9) Furthermore, the information processing method to which the present invention is applied can take various forms having the following configurations. That is, the information processing method to which the present invention is applied is an information processing method characterized by including a step of determining whether a user is performing a predetermined task based on determination information for determining a decline in the user's concentration, which is detected from the user's movements or actions, and a step of outputting predetermined information if the user is not performing the task. This makes it possible to detect a decline in the user's concentration and support improving the user's concentration.

[0087] (10) Furthermore, the program to which the present invention is applied can take various forms having the following configurations. That is, the program to which the present invention is applied is a program for causing a computer controlling an information processing device to execute control processing including the steps of: determining whether a user is performing a predetermined task based on determination information for determining a decline in the user's concentration, which is detected from the user's actions or behavior; and outputting predetermined information if the user is not performing the task. This makes it possible to detect a decline in the user's concentration and assist in improving the user's concentration.

[0088] 1: Management server, 2: Educational material providing server, 3: First user terminal, 4: Second user terminal, 11: CPU, 16: Output unit, 17: Input unit, 18: Storage unit, 19: Communication unit, 31: Information acquisition unit, 32: Information management unit, 33: Determination unit, 34: Output control unit, 35: Transmission control unit, 41: Educational material DB, 42: Determination DB, N: Network, S: Information processing system

Claims

1. An information processing system comprising: an estimation means for estimating whether a user's line of sight is in a predetermined area based on determination information for determining a decline in the user's concentration, which is detected from the user's movements or actions; a determination means for determining whether the user is performing a predetermined task based on the estimation result by the estimation means; and an output means for outputting predetermined information to the user if the user is not performing the task.

2. The information processing system according to claim 1, wherein the output means outputs the predetermined information when the user's line of sight is not in the predetermined area.

3. The information processing system according to claim 1, wherein said output means outputs, as said predetermined information, information for making said user aware of the existence of said task.

4. The information processing system according to claim 3, wherein the output means outputs alert information to notify the user that the task has not been performed, as information to make the user aware of the fact.

5. An information processing system as described in claim 3, further comprising a storage means for storing task information relating to the user's task, and wherein the output means outputs expression instruction information for causing the user to express that he or she will perform the task as information for the user to recognize.

6. The information processing system according to claim 5, wherein the output means outputs information for causing the user to utter a predetermined phrase as the expression instruction information.

7. The information processing system according to claim 5, wherein said output means outputs, as said expression instruction information, information for causing the user to perform a predetermined action.

8. The information processing system according to claim 7, wherein the output means outputs information for causing the user to perform a predetermined gaze movement as the predetermined action.

9. An information processing method including: a step of determining whether a user is performing a predetermined task based on an estimation result of whether the user's line of sight is in a predetermined area, which is inferred from determination information for determining a decrease in the user's concentration, which is detected from the user's movements or actions; and a step of outputting predetermined information if the user is not performing the task.

10. A program for causing a computer that controls an information processing device to execute control processing including the steps of: determining whether a user is performing a predetermined task based on an estimation result of whether the user's line of sight is in a predetermined area, which is inferred from determination information for determining a decrease in the user's concentration, detected from the user's movements or actions; and outputting predetermined information if the user is not performing the task.

Images