Education support system, ar system, education support method, and program

Abstract

To provide a technique capable of appropriately supporting learning with a simple configuration when teaching face-to-face.SOLUTION: An education support system includes: a score information database that stores a degree of understanding of a digital textbook for each student; and an AR system having an AR (Augmented Reality) glass that a teacher wears. The AR system includes: a selection receiving unit configured to receive selection of a target student who is a student to be displayed; and a display control unit that displays a browsing page that is a page being browsed in the digital textbook in different colors in accordance with the degree of understanding of the received target student. The selection receiving unit receives selection of the target student by the line of sight of the teacher.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an education support system and an education support method, and in particular to an education support technology using AR (Augmented Reality) glasses. [Background technology]

[0002] There are digital textbooks that use AR technology and can be browsed in an AR space. There are also systems in which teachers use information terminals to grasp the learning contents of students and provide learning support to individual students (for example, see Patent Document 1 and Patent Document 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-21127 A [Patent Document 2] JP 2018-59973 A Summary of the Invention [Problem to be solved by the invention]

[0004] The following analysis is provided by the present invention.

[0005] The technology disclosed in Patent Document 1 allows teachers to grasp the level of understanding of students in the classroom based on the page of the textbook that the student is opening and the marks that the student has made in the textbook. However, the technology disclosed in Patent Document 1 does not allow teachers to grasp the level of understanding of each student.

[0006] In addition, the technology disclosed in Patent Document 2 allows the teacher to process input from students on his / her terminal, thereby grasping the level of understanding of each student. However, the technology disclosed in Patent Document 2 requires complex processing because each student works on different teaching materials and grasps their respective levels of understanding, and the teacher must move his / her gaze to the terminal to grasp the information for each student and process it. Therefore, he / she is forced to take his / her eyes off the students during the lesson.

[0007] During face-to-face lessons in classrooms with multiple students, it is important to keep an eye on the students as much as possible. However, current systems cannot keep an eye on the students, grasp their level of understanding, and address the issues each student faces. This makes it difficult to provide appropriate guidance to each student.

[0008] The present invention has been made in consideration of the above circumstances, and aims to provide technology that enables appropriate learning support with a simple configuration when conducting face-to-face classes. [Means for solving the problem]

[0009] According to a first aspect of the present invention, A grade information database that stores the level of comprehension of digital textbooks for each student; An AR system having teacher AR (Augmented Reality) glasses worn by a teacher; The AR system includes: A selection receiving unit that receives a selection of a target student who is a student to be displayed; a display control unit that displays a viewing page of the digital textbook that is being viewed in a color-coded manner according to the received level of understanding of the target student; The selection receiving unit receives the selection of the target student by the teacher's line of sight in an education support system.

[0010] According to a second aspect of the present invention, The classroom is equipped with Augmented Reality (AR) glasses for teachers to wear. A selection receiving unit that receives a selection of a target student who is a student to be displayed; a display control unit that displays a currently viewed page of the digital textbook in a color-coded manner according to the previously calculated level of understanding of the target student; The selection receiving unit is provided with an AR system that receives the selection of the target student by the teacher's line of sight.

[0011] According to a third aspect of the present invention, A grade information database that stores the level of comprehension of digital textbooks for each student; An educational support method in an educational support system including an AR system having teacher AR (Augmented Reality) glasses worn by a teacher, a selection receiving step of receiving a selection of a target student, which is a display target, by the gaze of the teacher; An educational support method is provided, comprising: a display control step of displaying a viewed page, which is a page of the digital textbook being viewed, in a color-coded manner according to the level of understanding of the selected target student.

[0012] According to a fourth aspect of the present invention, The AR system computer has AR (Augmented Reality) glasses for teachers to wear. a selection receiving step of receiving a selection of a target student who is a student to be displayed by the teacher through the gaze of the teacher; A display control procedure is provided for displaying the currently viewed page of a digital textbook in a color-coded manner according to the previously calculated level of understanding of the selected target student, and a program for executing the procedure is provided.

[0013] These programs can be recorded on a computer-readable storage medium. The storage medium can be a non-transient medium such as a semiconductor memory, a hard disk, a magnetic recording medium, an optical recording medium, etc. The present invention can also be embodied as a computer program product. Effect of the Invention

[0014] According to the present invention, when a face-to-face lesson is conducted, appropriate learning support can be provided with a simple configuration. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an education support system according to a first embodiment. [Diagram 2] FIG. 1A is an example of a hardware configuration diagram of the teacher's AR glasses and the student's AR glasses of the first embodiment, FIG. 1B is an example of a hardware configuration diagram of the teacher's information terminal and the student's information terminal of the first embodiment, and FIG. 1C is an example of a hardware configuration diagram of the database server and the AR server of the first embodiment. [Diagram 3] FIG. 2 is a functional block diagram of a database server according to the first embodiment; [Figure 4] FIG. 1A is an example of an explanatory diagram for explaining a student information database according to a first embodiment, and FIGS. 1B and 1C are examples of a textbook information database according to the first embodiment. [Diagram 5] (a) is an example of an explanatory diagram for explaining the standard information database of the first embodiment, (b) is an example of the performance information database of the first embodiment, (c) is an example of data stored in the number memory unit of a modified example, (b) is an example of measurement terminal data stored in the number memory unit of another modified example of the first embodiment, and (c) is an example of the color information database of the first embodiment. [Figure 6] FIG. 2 is a functional block diagram of an AR server according to the first embodiment. [Figure 7] 13 is an example of a flowchart of a viewed student information display process according to the first embodiment. [Figure 8]13 is an example of a flowchart of a textbook information display process according to the first embodiment. [Figure 9] 13 is an example of a flowchart of a browsed page color information generation process according to the second embodiment. [Figure 10] 13 is an example of a flowchart of a textbook information display process according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] An outline of one embodiment of the present invention (hereinafter, referred to as the present embodiment) will be described below with reference to the drawings. Note that the attached reference numerals are attached to each element for convenience as an example to aid understanding, and are not intended to limit the present invention to the illustrated form. Furthermore, the connection lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional lines. The unidirectional arrows are intended to diagrammatically indicate the flow of the main signal (data), and do not exclude bidirectionality.

[0017] The program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and, if necessary, a display device. The computer device is also configured to be able to communicate with internal or external devices (including computers) via the communication interface, either wired or wirelessly. Although there are ports or interfaces at the connection points for input and output of each block in the figure, they are not shown. In the following description, "A and / or B" is used to mean A or B, or A and B.

[0018] <<First embodiment>> First, an overview of the first embodiment of the present invention will be described. Fig. 1 is a diagram for explaining an overview of an education support system 100 of this embodiment. Here, an example will be described in which the education support system 100 is used in one classroom in a school. An example will be described in which there is one teacher 920 and multiple students 930. However, in this figure, only one student 930 is shown.

[0019] As shown in the figure, the education support system 100 of this embodiment includes teacher AR glasses 210, a teacher information terminal 220, student AR glasses 310, a student information terminal 320, a database (DB) server 400, and an AR server 500. The student AR glasses 310 and student information terminals 320 are provided in the same number as the students 930.

[0020] Furthermore, these devices are connected via a network 900 provided in the school, such as a LAN (Local Area Network), and are capable of data communication with each other.

[0021] In this embodiment, when the teacher 920 wearing the teacher AR glasses 210 visually recognizes the student 930 through the teacher AR glasses 210, an image 921 of the viewed page of the digital textbook reflecting the level of understanding of the viewed student 930 is displayed on the teacher AR glasses 210. When the teacher 920 moves his / her line of sight and visually recognizes another student 930, the image 921 of the viewed page displayed on the teacher AR glasses 210 is switched to one that reflects the level of understanding of the student 930. The viewed page refers to a page of the digital textbook selected by the teacher 920 and currently displayed.

[0022] Furthermore, a viewed page image 931 of the digital textbook reflecting the student's own level of understanding is displayed on the student's AR glasses 310. Each component that realizes this will be described below.

[0023] [AR glasses for teachers, AR glasses for students] 2(a) is a hardware configuration diagram of the teacher AR glasses 210 and the student AR glasses 310. These devices are glasses-type wearable terminals and have the configuration of general AR glasses. That is, they are equipped with a CPU (Central Processing Unit) 211, a storage device 212, a display 213, a communication interface (I / F) 214, a sensor 215, a first camera 216, a second camera 217, and an operation unit 218. In addition, they may be equipped with an audio input / output unit, etc.

[0024] First, the teacher AR glasses 210 will be described.

[0025] The CPU 211 loads a program stored in advance in the storage device 212 into a work area of ​​the storage device 212 and executes the program to realize various functions and control the overall operation of the teacher AR glasses 210.

[0026] The storage device 212 stores data necessary for processing by the CPU 211. For example, the storage device 212 includes a semiconductor memory such as a random access memory (RAM), a read only memory (ROM), or a solid state drive (SSD).

[0027] The display 213 displays the display data transmitted from the AR server 500 at a predetermined time interval as an image. In this embodiment, a transmissive display that allows both the outside world and the display image to be viewed is used. That is, the teacher AR glasses 210 of this embodiment are transmissive (optical see-through) AR glasses.

[0028] In this embodiment, as described later, the display data is rendered in the AR coordinate system by the AR server 500. By displaying such processed data, the display data appears to the wearer (teacher 920) as if it were displayed in a distant space.

[0029] The communication interface (I / F) 214 is an interface for transmitting and receiving data via the network 900. In this embodiment, it is an I / F for transmitting and receiving data to and from the AR server 500. Note that, in addition, an interface for short-distance wireless communication using Wi-Fi (registered trademark) or Bluetooth (registered trademark) may be provided. For example, communication with the teacher information terminal 220 may be performed by short-distance wireless communication.

[0030] The sensor 215 detects the position, rotation, orientation, tilt, movement, etc. of the teacher AR glasses 210. For example, the sensor 215 includes a GPS (Global Positioning System) receiver, a gyro sensor, a geomagnetic sensor, an acceleration sensor, an illuminance sensor, a distance sensor, etc.

[0031] The first camera 216 captures an image of the outer periphery of the teacher AR glasses 210. The second camera 217 captures an image of the wearer. In this embodiment, the second camera 217 captures an image of the eyes of the wearer (teacher 920).

[0032] In this embodiment, the CPU 211 identifies the line of sight of the wearer (teacher 920) based on information obtained from the sensor 215, the first camera 216, and the second camera 217, and extracts a face image in the line of sight as a marker. This process is executed, for example, at a predetermined time interval.

[0033] Specifically, CPU 211 identifies the gaze direction of the wearer based on the image captured by second camera 217 and information from sensor 215. CPU 211 also extracts a face image (area) from the image captured by first camera 216. CPU 211 then extracts a face image including an intersection point between the image captured by first camera 216 and the gaze direction as a marker. If there are multiple face images including an intersection point, the marker is extracted according to a predetermined rule. For example, the face image furthest forward (toward the wearer) may be extracted as the marker. Alternatively, a face image whose intersection point is closest to the center of gravity of the face image area may be extracted as the marker.

[0034] The CPU 211 transmits the extracted marker to the AR server 500 via the communication I / F 214. Note that, for example, a header of data transmitted from the teacher AR glasses 210 includes a transmission source ID that identifies the transmission source. Similarly, for example, a transmission source ID is included in the header of data transmitted from the student AR glasses 310, the teacher information terminal 220, and the student information terminal 320. This allows the receiving device to identify the transmission source.

[0035] The facial image (area) extraction process and gaze direction specification process use existing techniques.

[0036] The operation unit 218 receives operations from the wearer. In this embodiment, for example, the operation unit 218 receives instructions to start and stop the teacher AR glasses 210.

[0037] Each unit of the student's AR glasses 310 basically realizes the same functions as the teacher's AR glasses 210. However, the student's AR glasses 310 do not need to have a function to detect markers. For example, when the student's AR glasses 310 are started, they transmit start-up information indicating that they have started to the AR server 500.

[0038] [Information terminals for teachers, information terminals for students] The teacher information terminal 220 and the student information terminal 320 are information processing devices such as smartphones, tablets, and notebook PCs (Personal Computers). They may also be viewers dedicated to digital textbooks. In this embodiment, they accept input from an operator (teacher 920 or student 930). In this embodiment, they accept, for example, instructions for operations such as starting up the digital textbook and turning pages.

[0039] 2(b) is a hardware configuration diagram of the teacher information terminal 220 and the student information terminal 320 of this embodiment. As shown in this figure, these devices include a CPU 221, a storage device 222, a display device 223, a communication I / F 224, a sensor 225, a camera 226, an audio input / output device 227, and an operation unit 228. In addition, general functions provided in a smartphone, tablet, etc. may be provided. A plurality of cameras 226 may be provided.

[0040] These components basically have the same functions as the components with the same names in the teacher AR glasses 210. The display device 223 includes a display, a touch panel, etc., and outputs images processed by the CPU 221 and also accepts input from the user. The audio input / output device 227 includes a microphone, a speaker, an audio input / output control unit, etc., and controls audio input and output.

[0041] For example, the textbook codes of selectable textbooks are stored in advance in the storage device 222. The teacher information terminal 220 accepts an instruction to select a digital textbook from the teacher 920 via a touch panel. The teacher information terminal 220 transmits the accepted textbook code of the digital textbook to the DB server 400. Note that in return, the data of the digital textbook may be received from the DB server 400 and output to a display.

[0042] The teacher information terminal 220 accepts page operation instructions for the digital textbook from the teacher 920 via the touch panel. Page operation instructions include, for example, moving to the next page, returning to the previous page, moving to a specified page, returning to the table of contents, etc. The teacher information terminal 220 transmits the accepted page operation instructions to the DB server 400. Note that, in return, data of the viewed page to be displayed in response to the instruction may be received from the DB server 400 and output to the display.

[0043] Furthermore, the functions of the student information terminal 320 are basically the same as those of the teacher information terminal 220. For example, the viewing page of the digital textbook selected by the teacher 920 may be automatically displayed on the display, and the student 930 may not select the digital textbook or operate the page. In this case, when the student information terminal 320 is started, it transmits start-up information indicating that it has started up to the DB server 400.

[0044] When the student information terminal 320 receives the color information of the viewed page together with the information of the viewed page from the DB server 400, as described below, it generates a display image and displays it on the display. Here, the student information terminal 320 processes the data of the viewed page according to the color information, as described below, generates colored data (colored data) of the viewed page of the digital textbook, and uses it to generate a display image.

[0045] [Database Server] Next, a description will be given of the database (DB) server 400. The DB server 400 manages various types of data used in the education support system 100.

[0046] 3 is a functional block diagram of the DB server 400. The DB server 400 includes a student information database (DB) 411, a grade information DB 412, a textbook information DB 413, a color information DB 414, and a reference information DB 415, as well as functions of a browsing page determination unit 421, a grade information calculation unit 422, a color information calculation unit 423, and a request response unit 424, and a browsing page storage unit 416.

[0047] First, each database will be described.

[0048] The student information DB 411 is a database that manages information for each student 930. As shown in FIG. 4(a), for example, a student name 411a, a student number 411b, a marker 411c, a terminal ID 411d, and a glasses ID 411e are associated with each student 930 and registered as one record. The student number 411b is a number that uniquely distinguishes the student 930 and is assigned in advance. The marker 411c is image information that uniquely identifies the student 930, and in this embodiment, a face image is registered. The terminal ID 411d is identification information of the student information terminal 320 assigned to the student 930 (used by the student 930), and the glasses ID 411e is identification information of the student AR glasses 310 assigned to the student 930 (used by the student 930).

[0049] The marker 411c is information used when the teacher 920 identifies the student 930 viewed through the teacher AR glasses 210. For this reason, it is sufficient that the student 930 can be uniquely identified on the image, and is not limited to a face image. For example, a two-dimensional marker may be applied to an item that can identify an individual, such as a student handbook, and this may be used as the marker. Also, an image of a name tag or the like held by the student 930 may be used.

[0050] The student information DB 411 is created and stored in advance. In addition, attendance may be managed. In the case where attendance is also managed, for example, when a marker is sent via the AR server 500 as described later, it is only necessary to compare the attendance with the information of the registered student 930.

[0051] The textbook information DB 413 stores data of digital textbooks. In this embodiment, the name, identification information, and detailed information are managed for each textbook for each predetermined unit. Hereinafter, the predetermined unit will be described as a page. FIG. 4(b) shows, as an example, a case where a textbook name 413a, a textbook code / page 413b, and detailed information 413c are associated with each other and stored as one record.

[0052] Textbook code / page 413b lists a textbook code that is assigned in advance to uniquely identify each textbook, along with the page. For example, 000-001 in the example of FIG. 4(b) means that the textbook code is 000 and the page is 001, i.e., page 1.

[0053] Detailed information about each page is registered in the detailed information 413c. An example of the detailed information 413c to be registered is shown in Fig. 4(c). As shown in this figure, the detailed information 413c includes the content and questions (items). In addition, each question is assigned a question number that uniquely identifies the question, and is specified by the question number.

[0054] Furthermore, as shown in FIG. 4(c), a unit tag is managed for each problem. Here, a unit means a division (field) of learning content. For example, it is "one-dimensional equation", "variable", "simultaneous equations", etc. For each problem, the corresponding unit (field) is specified in advance and assigned as a unit tag. In other words, the unit tag is information for specifying the corresponding field of each problem. Furthermore, the "correct answer" for each problem may be registered.

[0055] In this embodiment, as described later, the degree of understanding is calculated for each unit. In the example of Fig. 4(c), question 1 corresponds to the units "One-dimensional equation" and "Variable". Also, question 2 corresponds to the units "One-dimensional equation", "Simultaneous equation", and "Variable".

[0056] When sending textbook data to the student's AR glasses 310 and the student's information terminal 320, these "correct answers" and unit tags are not sent. On the other hand, when sending textbook data to the teacher's AR glasses 210 and the teacher's information terminal 220, these "correct answers" and unit tags may also be sent.

[0057] The criteria information DB 415 manages various judgment criteria. In the example shown in Fig. 5(a), for each unit, the criterion (threshold) of the accuracy rate for judging "understanding" and the conditions for determining color coding are managed. The criteria information DB 415 is prepared and registered in advance.

[0058] In the example of Figure 5(a), for example, if all of the units assigned to a question are rated as "Understanding," the question is assigned color 1, and if there is even one "Lack of Understanding," the question is assigned color 2.

[0059] The grade information DB 412 manages the number of correct answers and the level of understanding for each student 930 and for each unit. In the example of FIG. 5(b), a student number 412a and grade / level of understanding information are managed for each student 930. The grade / level of understanding information includes the number of correct answers 412c, the cumulative number of questions 412d, the correct answer rate 412e, and the level of understanding 412f for each unit 412b. The grade information DB 412 is prepared in advance for each student 930. Then, for example, the teacher 920 registers the number of correct answers 412c and the cumulative number of questions 412d for each unit. The correct answer rate 412e and the level of understanding 412f are calculated by the grade information calculation unit 422 described later.

[0060] The color information DB 414 manages color information according to the level of understanding for each student 930, for each page of the digital textbook, and for each question. In the example of FIG. 5(c), for each student number 414a and textbook code / page 414b, an assigned color 414d for each question 414c is registered as color information for that page. Here, a case is illustrated in which color 1 is assigned to question 1 and color 2 is assigned to question 2 for a page with textbook code / page 414b "000-001" for a student 930 with student number 414a "1234567". The color information DB 414 is created by the color information calculation unit 423.

[0061] Next, each function of the DB server 400 will be described.

[0062] The browsing page determination unit 421 determines the browsing page and temporarily stores the data. The browsing page is specified by the teacher 920. In this embodiment, for example, the textbook code / page 413b is specified from the textbook code and page operation instruction transmitted from the teacher information terminal 220, and stored.

[0063] Furthermore, when the viewing page determination unit 421 specifies the textbook code / page 413b, it refers to the textbook information DB 413 and extracts the information registered as the detailed information 413c as viewing page data. The extracted viewing page data is stored in the viewing page storage unit 416 together with the textbook code / page 413b. Here, the viewing page determination unit 421 may transmit this viewing page data, for example, to the teacher information terminal 220 and the student information terminal 320 that is running at that time. Note that when a new textbook code / page 413b is received, the information stored in the viewing page storage unit 416 is updated. Then, the information in the viewing page storage unit 416 is transmitted to the teacher information terminal 220 and the student information terminal 320 that is running at that time every time it is updated.

[0064] The result information calculation unit 422 calculates the correct answer rate 412e and the level of understanding 412f of the result information DB 412. The correct answer rate 412e is calculated by a predetermined calculation method, for example, by dividing the number of correct answers 412c by the cumulative number of questions 412d. The level of understanding 412f is calculated by referring to the reference information DB 415. That is, if the level is equal to or higher than the threshold of the judgment criterion stored in the reference information DB 415, it is determined as "understanding", and if it is less than the threshold, it is determined as "lack of understanding".

[0065] The color information calculation unit 423 determines (calculates) the color to be assigned to each item (question) on each page of the digital textbook for each student 930. The calculation results are stored in the color information DB 414. The color to be assigned to each item is calculated according to the conditions in the reference information DB 415. For example, the color to be assigned is calculated according to the number of understanding levels for each unit.

[0066] The request response unit 424 responds to requests from external devices such as the AR server 500 and the student information terminal 320.

[0067] In this embodiment, as described later, when the request response unit 424 receives a marker from the AR server 500, the request response unit 424 identifies the student information (student number) corresponding to the marker. Then, the request response unit 424 returns color information of the viewed page of the student to the AR server 500 together with the viewed page data.

[0068] Specifically, the request response unit 424 refers to the student information DB 411, and extracts the student number 411b of the record including the marker 411c that is closest (has the most similarities) to the received marker. Then, the request response unit 424 extracts data of the student number 414a that is the same as the extracted student number 411b from the color information DB 414 as color information of the viewed page, and transmits the data to the AR server 500 together with the viewed page data.

[0069] Furthermore, when the request response unit 424 receives a glasses ID from the AR server 500, it identifies the student information (student number) of the student who is using the student's AR glasses 310 having the glasses ID. Then, it returns color information of the student's viewed page to the AR server 500 together with the glasses ID and the viewed page data.

[0070] Specifically, when the request response unit 424 receives a glasses ID, it refers to the student information DB 411 and extracts the student number 411b of the record including the glasses ID 411e that matches the glasses ID. Then, it extracts color information of the student number 414a that is the same as the extracted student number 411b, which is data having a textbook code / page stored in the viewed page storage unit 416, from the color information DB 414. Then, it transmits the glasses ID, the viewed page data, and the color information to the AR server 500.

[0071] Furthermore, when the request handling unit 424 receives start-up information from the student information terminal 320, it returns color information and viewed page data of the student 930 using that student information terminal 320 to the student information terminal 320 that sent the information.

[0072] [AR Server] 6 is a functional block diagram of the AR server 500. The AR server 500 controls the teacher's AR glasses 210 and the student's AR glasses 310. That is, in this embodiment, the teacher's AR glasses 210 and / or the student's AR glasses 310 and the AR server 500 configure an AR system.

[0073] In this embodiment, as described above, when the teacher 920 starts up a digital textbook using the teacher information terminal 220, data of the digital textbook (textbook data) is obtained from the DB server 400 and displayed on the teacher's AR glasses 210 and the student's AR glasses 310. At this time, the student's AR glasses 310 display textbook data color-coded according to the wearer's (student's 930) level of understanding.

[0074] Furthermore, when the teacher 920 visually recognizes a particular student 930, the visually recognized student 930 is identified, and textbook data that is color-coded according to the level of understanding of the student 930 is displayed on the teacher's AR glasses 210.

[0075] Here, an example will be described in which one AR server 500 controls the teacher's AR glasses 210 and all the student's AR glasses 310. However, the AR server 500 may be provided separately for the teacher and for the students.

[0076] 6, the AR server 500 includes a selection receiving unit 531 that receives a selection from the teacher AR glasses 210, and a display control unit 532 that controls the display of the teacher AR glasses 210 and the student AR glasses 310. The selection receiving unit 531 includes an input unit 521, and the display control unit 532 includes a request unit 522, a data processing unit 523, a drawing processing unit 524, and an output unit 525.

[0077] The input unit 521 receives data from the outside. In this embodiment, the input unit 521 receives data from the teacher AR glasses 210. The input unit 521 also receives activation information from the student AR glasses 310, which indicates that the student AR glasses 310 have been activated.

[0078] Specifically, the input unit 521 receives information from the teacher AR glasses 210 to identify the viewing student 930, i.e., the student 930 for whom a color-coded browsing page is to be displayed on the display 213 of the teacher AR glasses 210. Here, as information to identify the viewing student 930, a face image of the student 930 is received as a marker. Then, the marker is extracted from the received data and transmitted to the request unit 522.

[0079] Furthermore, when the input unit 521 receives activation information from the student's AR glasses 310, the input unit 521 extracts the glasses ID of the sender from the header.

[0080] When the selection receiving unit 531 receives a marker from the teacher's AR glasses 210, the display control unit 532 identifies the corresponding student 930 (target student), colors the page according to the target student's level of understanding, and displays the page to be viewed on the display of the teacher's AR glasses 210.

[0081] Here, the request unit 522 transmits and receives data to and from the DB server 400 .

[0082] In this embodiment, the request unit 522 transmits a marker to request display information to be displayed on the teacher AR glasses 210. Here, the request unit 522 transmits the marker to the DB server 400, which returns the marker to the DB server 400 and obtains the browsed page data and color information as display information. The obtained display information is transmitted to the data processing unit 523.

[0083] In the present embodiment, the request unit 522 transmits a glasses ID to request display information to be displayed on the student's AR glasses 310. Here, the glasses ID is transmitted to the DB server 400, and in return, the viewed page data and color information are acquired as display information. The acquired display information is transmitted to the data processing unit 523 together with the glasses ID.

[0084] The data processing unit 523 generates display data from the display information. Here, the information (data) of the viewed page is processed according to the color information, and colored data (colored data) of the viewed page is generated. The generated colored data is transmitted to the drawing processing unit 524. Note that, if a glass ID is attached, the data is transmitted to the drawing processing unit 524 together with the glass ID.

[0085] The drawing processing unit 524 renders the colored data received from the data processing unit 523 in AR coordinates. Information after rendering (rendering information; display data) is transmitted to the output unit 525. Note that, if a glass ID is attached, it is transmitted to the output unit 525 together with the glass ID.

[0086] In this embodiment, the data processing unit 523 and the drawing processing unit 524 process the above-mentioned colored data so that it is displayed in a predetermined area of ​​the teacher AR glasses 210 or the student AR glasses 310 in a predetermined size.

[0087] The output unit 525 transmits the display data to the teacher AR glasses 210 and displays it on the display 213. When the display data is received together with the glasses ID, the output unit 525 transmits the display data to the student AR glasses 310 identified by the glasses ID and displays it on the display 213.

[0088] The teacher's AR glasses 210 or the student's AR glasses 310 display the received rendering information (display data) on their display 213. In other words, they project it on the AR coordinates.

[0089] [Hardware configuration] The hardware configuration of the DB server 400 and the AR server 500 is shown in FIG.

[0090] As shown in the figure, the DB server 400 and the AR server 500 are each realized by a general information processing device including a CPU 401, a storage device 402, a communication I / F 403, and an input / output I / F 404.

[0091] The CPU 401 loads the programs stored in the storage device 402 into a work memory and executes them to realize the various functions described above. Each database, data used by each function, data generated by processing, etc. are stored in the storage device 402. The storage device 402 includes a RAM, a ROM, a HDD, an SDD, etc.

[0092] The communication I / F 403 communicates with external devices, and the input / output I / F 404 receives data input to the device and outputs the processed data. In addition, an extension I / F, etc. may be provided.

[0093] [Display process for visually recognized students] Next, a description will be given of the flow of the viewed student information display process by the teacher AR glasses 210, the AR server 500, and the DB server 400 while a specific page is the viewed page (display target). This viewed student information display process is a process in which textbook information with color information of the viewed student 930 is displayed on the teacher AR glasses 210 every time the teacher 920 moves his / her line of sight.

[0094] 7 is a process flow of the viewed student information display process. This process is executed at a predetermined time interval. It is assumed that the browse page has been transmitted in advance from the teacher information terminal 220 to the DB server 400, for example.

[0095] The teacher AR glasses 210 identify the gaze direction of the teacher 920 at a predetermined time interval and extract the face image of the student 930 as a marker (step S1201). Then, the teacher AR glasses 210 transmit the extracted marker to the AR server 500 (step S1202).

[0096] When the AR server 500 receives the marker, the request unit 522 transmits the marker to the DB server 400 (step S1203).

[0097] In the DB server 400 that has received the marker, the request response unit 424 identifies the student information (student number) from the marker (step S1204) and extracts color information of the viewed page of the student number (step S1205). The request response unit 424 then transmits the color information of the viewed page of the student 930 having the student number to the AR server 500 together with the viewed page data (step S1206).

[0098] When the request unit 522 of the AR server 500 receives the browsing page data and the color information of the student, the data processing unit 523 of the AR server 500 processes the data (step S1207), the drawing processing unit 524 performs drawing processing (step S1208), and generates display data. Then, the output unit 525 transmits the generated display data to the teacher AR glasses 210 (step S1209).

[0099] The teacher AR glasses 210 erase the data that has been displayed up until that point, and display the transmitted display data on the display 213 (step S1210).

[0100] As described above, the teacher AR glasses 210, the AR server 500, and the DB server 400 repeat the viewed student information display process at predetermined time intervals. As a result, the teacher AR glasses 210 display information on the viewed page of the student 930 viewed by the teacher 920, which is color-coded according to the level of understanding.

[0101] In addition, the teacher AR glasses 210 may be configured to erase the displayed data if the display data is not transmitted for a predetermined period of time.

[0102] [Textbook information display processing] Next, a description will be given of the flow of textbook information display processing for displaying textbook information on the student's AR glasses 310. Fig. 8 is a process flow of the textbook information display processing. This processing is executed once when the student's AR glasses 310 are started up.

[0103] When the student's AR glasses 310 receive a start-up instruction from the student 930 (step S1301), the student's AR glasses 310 transmit start-up information to the AR server 500 (step S1302).

[0104] The request unit 522 of the AR server 500 extracts the glass ID and transmits it to the DB server 400 (step S1303).

[0105] In the DB server 400 that has received the glasses ID, the request response unit 424 identifies the student information (student number) from the glasses ID using the above-mentioned method (step S1304), extracts color information of the viewed page for that student number (step S1305), and transmits the color information of the viewed page of the student 930 having that student number to the AR server 500 together with the glasses ID and the viewed page data (step S1306).

[0106] When the request unit 522 of the AR server 500 receives the glasses ID, the viewed page data, and the color information of the student, the data processing unit 523 processes the data (step S1307), the drawing processing unit 524 performs drawing processing (step S1308), and generates display data. Then, the output unit 525 transmits the generated display data to the student AR glasses 310 identified by the glasses ID (step S1309).

[0107] The student's AR glasses 310 display the transmitted display data on the display 213 (step S1310).

[0108] Through this process, textbook data is displayed on the student's AR glasses 310 in a color-coded manner according to the student's own level of understanding.

[0109] As described above, according to this embodiment, during a lesson, textbook data that is color-coded according to the level of understanding of the students 930 viewed by the teacher 920 is displayed on the display 213 of the teacher's AR glasses 210 worn by the teacher 920. Furthermore, when teaching a lesson to a large number of students 930, when the teacher 920 moves his / her gaze to another student 930, the displayed data changes to textbook data that is color-coded according to the level of understanding of that student 930.

[0110] Therefore, according to this embodiment, the teacher 920 can teach a class while visually checking the grade information of each student 930 that has been input in advance, without taking his / her eyes off the student 930. This allows the teacher 920 to accurately grasp the information about the student 930 that he / she sees during the class, without relying on memory. Therefore, the teacher 920 can decide and give appropriate guidance to the student 930 on the spot.

[0111] In addition, the display 213 of the student's AR glasses 310 displays textbook data that is color-coded according to the student's level of understanding. By viewing this, the student 930 can grasp his or her own level of understanding. For example, when studying by himself or herself, the student can proceed with the study while clearly identifying areas that the student is weak in.

[0112] <<Second embodiment>> In the first embodiment, the degree of understanding of the student 930 is calculated based on the grade information registered in advance. In the present embodiment, the content of the answers given by the student 930 during the lesson is also reflected in the degree of understanding. That is, every time the student 930 gives an answer, the degree of understanding is updated in real time.

[0113] The education support system 100 realized in this embodiment will be described below. The configuration of the education support system 100 in this embodiment is basically the same as that in the first embodiment. That is, as shown in Fig. 1, the education support system 100 includes teacher AR glasses 210, teacher information terminal 220, student AR glasses 310, student information terminal 320, DB server 400, and AR server 500.

[0114] Each configuration will be described below, focusing on the configurations that are different from the first embodiment.

[0115] In this embodiment, it is assumed that the teacher 920 designates the pages to be viewed, and the students 930 can only view the pages designated by the teacher 920 .

[0116] The student information terminal 320 of this embodiment further accepts input of answers to questions displayed on the display. The student 930, for example, inputs the answer via a stylus pen (touch pen) on a touch panel or the like. When the student information terminal 320 accepts the input, it transmits the input together with information (question number) identifying the question to the DB server 400 as answer data.

[0117] In the grade information DB 412 of the DB server 400 of this embodiment, a storage area is prepared in advance for each student 930.

[0118] The score information calculation unit 422 of this embodiment has a function as an answer receiving unit that receives answer data from the student information terminal 320, in addition to the function of the first embodiment.

[0119] That is, each time the grade information calculation unit 422 receives an answer (answer data) to a question prepared on the viewing page from the student 930, it judges whether the answer is correct or not, and updates the data of the record of the corresponding student number 412a in the grade information DB 412. Whether the answer is correct or not is determined, for example, by referring to the "correct answer" information of the question registered in the textbook information DB 413. Also, the student information is specified by referring to the student information DB 411 from the terminal ID included in the header of the answer data.

[0120] If the answer is correct, the grade information calculation unit 422 increments the number of correct answers 412c and the cumulative number of questions 412d of the corresponding unit 412b of the record corresponding to the student number 412a of the sender of the answer by 1. On the other hand, if the answer is not correct, only the cumulative number of questions 412d is incremented by 1. The corresponding unit 412b is determined by referring to the unit tag of the question registered in the textbook information DB 413.

[0121] Then, the score information calculation unit 422 updates the correct answer rate 412e and the understanding level 412f every time the cumulative question number 412d is updated. The calculation method for these is the same as in the first embodiment.

[0122] Moreover, the color information calculation unit 423 of this embodiment updates the color information DB 414 every time the grade information calculation unit 422 updates the grade information DB 412. That is, the color information calculation unit 423 is updated every time the student 930 submits an answer. The method of determining the color to be assigned to each item is the same as in the first embodiment.

[0123] Furthermore, when the request response unit 424 of this embodiment receives answer data from the student information terminal 320, it transmits to the AR server 500 the glasses ID, color information, and viewed page data of the student 930 using the student information terminal 320.

[0124] Specifically, when the request response unit 424 receives the answer data, it extracts the terminal ID included in the header of the answer data. Then, it refers to the student information DB 411 and extracts the student number 411b and the glasses ID 411e of the record including the terminal ID 411d that matches the terminal ID. Then, it transmits the student number 411b and the answer data to the grade information calculation unit 422.

[0125] After the grade information calculation unit 422 updates the grade information DB 412 and the color information calculation unit 423 updates the color information DB 414, the request response unit 424 transmits the viewed page data and the color information of the viewed page to the student AR glasses 310 having the extracted glasses ID 411e.

[0126] Furthermore, even when the request unit 522 of the AR server 500 acquires display information without making a request, the request unit 522 transmits the display information to the data processing unit 523. The display information acquired without making a request is, as described above, the viewed page data and the color information of the viewed page that are transmitted together with the glasses ID when the student 930 transmits the answer data.

[0127] [Viewed page color information generation process] Next, the flow of the viewing page color information generation process by the DB server 400 of this embodiment will be described. Fig. 9 shows the process flow of the viewing page color information generation process. This process is performed in a state where the viewing page is determined by the viewing page determination unit 421 and the determined viewing page is displayed on the teacher information terminal 220 and the student information terminal 320. The process is also started when an answer is received from the student information terminal 320.

[0128] When an answer (answer data) to a question prepared on the browsing page is received from the student information terminal 320, the grade information calculation unit 422 identifies the student number of the sender and identifies the corresponding question (question number) (step S2101). The sender is determined by referring to the student information DB 411 based on the terminal ID included in the header of the transmitted data. The question number is also extracted from the transmitted data.

[0129] The grade information calculation unit 422 extracts the correct answer and the unit corresponding to the identified question number from the textbook information DB 413 (step S2102).

[0130] Next, the score information calculation unit 422 determines whether or not the answer is correct (step S2103).

[0131] If the answer is correct, the grade information calculation unit 422 updates the number of correct answers 412c and the cumulative number of questions 412d for all extracted units 412b of the data of the identified student number 412a in the grade information DB 412, for example, by the above method (step S2104).

[0132] On the other hand, if the answer is not correct, the grade information calculation unit 422 updates only the cumulative number of questions 412d, for example, by the above method, for all the extracted units 412b of the data of the identified student number 412a in the grade information DB 412 (step S2105).

[0133] After updating the cumulative number of questions 412d, the result information calculation unit 422 calculates and updates the correct answer rate 412e for all the extracted units 412b in the same manner as in the first embodiment (step S2106). After calculating the correct answer rate 412e, the result information calculation unit 422 calculates and updates the understanding level 412f for all the extracted units 412b (step S2107).

[0134] After updating the result information DB 412 through the above procedure, the color information calculation unit 423 determines the color of the corresponding question on the viewed page (step S2108). Here, the color to be applied is determined based on the understanding level 412f for each unit in the result information DB 412 and in accordance with the standard information DB 415.

[0135] After determining the color to be added, the color information calculation unit 423 registers the color to be added 414d in the color information DB 414 in association with the student number 414a (step S2109), and ends the process.

[0136] As described above, while a specific viewed page is being displayed, the DB server 400 repeats the above process each time it receives an answer from a student 930, and saves the latest color information of the viewed page for each student 930.

[0137] [Textbook information display processing] Next, a flow of the textbook information display process for displaying the latest textbook information on the student's AR glasses 310 in this embodiment will be described. Fig. 10 shows a process flow of the textbook information display process in this embodiment. It should be noted that each time the teacher 920 changes the page being viewed, the page is first displayed on the student's AR glasses 310 without color information.

[0138] When the student information terminal 320 receives an input from the student 930 (step S2201), it transmits the received answer together with the question number to the DB server 400 (step S2202).

[0139] The grade information calculation unit 422 of the DB server 400 refers to the student information DB 411 and identifies the student number 411b and the glasses ID 411e of the student (step S2203). Then, the grade information of the student is updated by the above method (step S2204). In addition, the color information calculation unit 423 updates the color information of the page viewed by the student by the above method (step S2205).

[0140] After that, the DB server 400 transmits the updated color information of the viewed page to the AR server 500 together with the viewed page data and the glass ID (step S2206).

[0141] When the request unit 522 of the AR server 500 receives the color information of the viewed page together with the viewed page data and the glasses ID, in the AR server 500, the data processing unit 523 processes the data (step S2207), the drawing processing unit 524 performs drawing processing (step S2208), and generates display data. Then, the output unit 525 transmits the generated display data to the student's AR glasses 310 identified by the glasses ID (step S2209).

[0142] The student's AR glasses 310 display the transmitted display data on the display 213 (step S2210).

[0143] Through this process, textbook data color-coded according to the latest level of understanding is displayed on the student's AR glasses 310.

[0144] When the color information of the viewed page is updated in step S1305, the color information of the viewed page may be transmitted to the sending student information terminal 320. As a result, the textbook data according to the understanding level of the student 930 is displayed on the student information terminal 320.

[0145] The flow of the visually recognized student information display process of this embodiment is the same as that of the first embodiment. That is, when a marker is transmitted from the teacher AR glasses 210 to the AR server 500, the latest color information of the student 930 at that time is provided.

[0146] As described above, according to this embodiment, the latest textbook data of the students 930 viewed by the teacher 920 during a lesson is displayed on the display 213 of the teacher's AR glasses 210 worn by the teacher 920. In addition, when the teacher 920 moves his / her gaze to another student 930, the displayed data changes to the latest textbook data color-coded according to the student's 930's level of understanding.

[0147] Therefore, according to this embodiment, as in the first embodiment, the teacher 920 can instantly grasp the level of understanding of the student 930 he or she is watching during a lesson. This allows the teacher 920 to grasp what the student 930 needs to learn, and provide appropriate guidance without taking his or her eyes off the student 930.

[0148] Furthermore, according to this embodiment, the students 930 can also grasp their own level of understanding, and therefore can progress with their studies efficiently.

[0149] Furthermore, according to this embodiment, even if the level of understanding of the student 930 changes during learning in class, the latest state can be grasped. For example, it is possible to explain the necessary matters while closely watching one student 930, and thereby grasp the change in the level of understanding of the student 930. This can then be reflected in the instruction. Therefore, more appropriate instruction can be provided.

[0150] <Modification> Modifications of the above embodiments will now be described.

[0151] In each of the above embodiments, the student 930 wears the AR glasses 310 for the student, but the AR glasses 310 for the student may not be required. In this case, color-coded textbook data is displayed on the student information terminal 320. The student 930 then refers to the textbook data.

[0152] In addition, in the above-mentioned embodiments, the color-coded textbook data images are displayed on the display 213 of each of the teacher's AR glasses 210 and the student's AR glasses 310, but are not limited to this. For example, the AR server 500 may have a projection function and may directly display the image as a hologram in space from the output unit 525. This eliminates the need for the student 930 to look at the student's information terminal 320.

[0153] Furthermore, only the data of the viewed page may be displayed in real space, and the color information may be displayed on the teacher's AR glasses 210 and the student's AR glasses 310.

[0154] In the above embodiments, the teacher 920 selects a digital textbook and operates a page through the teacher information terminal 220, but the present invention is not limited to this. For example, the teacher AR glasses 210 may have a function of accepting gesture input. In this case, the teacher 920 accepts a gesture to select a digital textbook and / or an instruction to operate a page. This allows the teacher 920 to face the student 930 even when operating a page.

[0155] In addition, in the above-mentioned embodiments, the degree of understanding is calculated uniformly for each student 930, but this is not limited to the above. For example, the threshold value for determining "understanding" may be changed for each desired school (or the rank of the desired school). For example, the higher the deviation value of the desired school, the higher the threshold value for determining "understanding".

[0156] In this case, a threshold value for each desired school (rank) is registered in the reference information DB 415. The desired school (rank) is further registered in the student information DB 411. The grade information calculation unit 422 extracts the desired school (rank) from the student information DB 411 and calculates the level of understanding using a threshold value corresponding to the desired school.

[0157] In addition, the standard information DB 415 is provided, a threshold is set for each unit, and the degree of understanding is calculated using the threshold, but the threshold may be a uniform value without changing for each unit. For example, if the correct answer rate is 50% or more, it is judged as "understanding".

[0158] In addition, in the above-mentioned embodiments, the colors are divided into cases where all are understood and other cases, but this is not limited to this. The colors to be applied are also not limited to two colors. For example, a color to be applied when all units associated with an item are "understood," a color to be applied when "understanding" and "lack of understanding" are mixed, and a color to be applied when all are "lack of understanding" may be prepared and applied.

[0159] Furthermore, the display mode is not limited to color coding. For example, the font of characters may be changed, the thickness of characters may be changed, shading may be applied, etc. As long as the degree of understanding of each unit can be grasped at a glance, the specific display mode is not important.

[0160] In addition, in each of the above embodiments, the student 930 visually recognized by the teacher 920 is selected in the line of sight of the teacher 920. However, the selection of the visually recognized student 930 is not limited to this. For example, the student 930 whose face area is included in a predetermined area on the display 213 of the teacher AR glasses 210 may be selected as the visually recognized student 930. In this case as well, the face area of ​​the student 930 is extracted from the image acquired by the first camera 216 and transmitted to the AR server 500 as a marker.

[0161] In addition, the teacher AR glasses 210 and the student AR glasses 310 do not need to be connected to the network 900. These devices may be connected only to the AR server 500.

[0162] In addition, all or part of the functions of the AR server 500 may be provided by the teacher AR glasses 210 and / or the student AR glasses 310, respectively.

[0163] In the above embodiment, the display of the teacher AR glasses 210 and the student AR glasses 310 is a transmissive type. However, the display is not limited to the transmissive type. For example, a non-transmissive display may be used. In this case, the image captured by the first camera 216 is used as a background image, and colored data is superimposed on a predetermined area to generate a display image (display data).

[0164] In addition, in the above-mentioned embodiments, the teacher 920 teaches the students 930, but the use environment of the present embodiment is not limited to this. In the above-mentioned embodiments, the AR glasses are used to visually confirm the information of the target person while providing instruction. Therefore, for example, in a company, the AR glasses may be used to provide instruction while confirming the skills of employees based on their past work performance, or to replace the digital textbook with a work manual and have the students master the work manual. In this case, for example, the method of calculating the degree of understanding is optimized for each use environment.

[0165] In the process flow used in the above description, multiple steps (processes) are described in order, but the order of execution of each step is not limited to the order described. For example, the order of the steps shown in the figure can be changed to a range that does not affect the content, such as executing each process in parallel.

[0166] Although each embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiments, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of the present invention. For example, the network configurations and the configurations of each element shown in the drawings are examples to help understand the present invention, and the present invention is not limited to the configurations shown in these drawings.

[0167] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) A grade information database that stores the level of comprehension of digital textbooks for each student; An AR system having teacher AR (Augmented Reality) glasses worn by a teacher; The AR system includes: A selection receiving unit that receives a selection of a target student who is a student to be displayed; An educational support system comprising: a display control unit that displays the currently viewed page of the digital textbook in a color-coded manner according to the level of understanding of the received target student. (Appendix 2) 2. The education support system according to claim 1, the selection receiving unit receives a selection of the target student based on a gaze of the teacher; The display control unit displays the viewed page in different colors on the teacher's AR glasses. (Appendix 3) The education support system according to claim 1 or 2, a textbook information database for storing textbook information including information on a unit for each page of the digital textbook; the grade information database stores the level of understanding for each of the units of the digital textbook for each of the students; The display control unit displays each unit included in the viewed page in a different color according to the level of understanding. (Appendix 4) 4. The education support system according to claim 3, a color information database that stores color information corresponding to the unit included in the viewed page for each of the students; a grade information calculation unit that calculates the level of understanding of each student by a predetermined calculation method when the grade is registered in the grade information database, and registers the level of understanding in the grade information database; a color information calculation unit that calculates the color information of the viewed page for each of the students according to a predetermined standard when the level of understanding is registered, and registers the color information in the color information database; The display control unit refers to the color information database and displays the viewing page. (Appendix 5) 5. The education support system according to claim 4, An answer receiving unit that receives answers to questions included in the digital textbook from the students, the textbook information database has information on the unit corresponding to each of the questions, the grade information calculation unit, each time an answer to the question is received, identifies the unit of the question, calculates the level of understanding of the grade information database, and updates the grade information database; The color information calculation unit calculates the color information and updates the color information database every time the understanding level is calculated. (Appendix 6) 6. An educational support system according to any one of claims 1 to 5, The AR system further includes AR glasses for students worn by each of the students, The display control unit displays the viewing page on the student's AR glasses in a color-coded manner according to the level of understanding of the student wearing the student's AR glasses, in an educational support system. (Appendix 7) The classroom is equipped with Augmented Reality (AR) glasses for teachers to wear. A selection receiving unit that receives a selection of a target student who is a student to be displayed; An AR system comprising: a display control unit that displays a viewed page of a digital textbook in a color-coded manner according to the previously calculated level of understanding of the target student. (Appendix 8) A grade information database that stores the level of comprehension of digital textbooks for each student; An educational support method in an educational support system including an AR system having teacher AR (Augmented Reality) glasses worn by a teacher, A selection receiving step of receiving a selection of a target student who is a student to be displayed; An educational support method comprising: a display control step of color-coding the currently viewed page of the digital textbook according to the selected target student's level of understanding and displaying it on the teacher's AR glasses. (Appendix 9) The AR system computer has AR (Augmented Reality) glasses for teachers to wear. A selection acceptance step for accepting a selection of a target student who is a student to be displayed; A program for executing a display control procedure that displays the currently viewed page of a digital textbook on the teacher's AR glasses in a color-coded manner according to the previously calculated level of understanding of the selected target student. In addition, the form of Appendix 7 can be expanded into the forms of Appendix 4 and Appendix 6, and the forms of Appendix 8 and 9 can be expanded from the form of Appendix 2 to the form of Appendix 6, similar to the form of Appendix 1.

[0168] The disclosures of the above patent documents and the like are incorporated herein by reference. Within the framework of the entire disclosure of the present invention (including the scope of claims), modifications and adjustments of the embodiments and examples are possible based on the basic technical ideas. Furthermore, within the framework of the disclosure of the present invention, various combinations and selections of the various disclosed elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, the present invention naturally includes various modifications and corrections that a person skilled in the art would be able to make based on the entire disclosure including the scope of claims and the technical ideas. In particular, with regard to the numerical ranges described in this specification, any numerical value or subrange included in the range should be interpreted as being specifically described even if not otherwise specified. [Explanation of symbols]

[0169] 100: Educational support system, 210: Teacher's AR glasses, 211: CPU, 212: Storage device, 213: Display, 214: Communication I / F, 215: Sensor, 216: First camera, 217: Second camera, 218: Operation unit, 220: Teacher's information terminal, 221: CPU, 222: Storage device, 223: Display device, 224: Communication I / F, 225: Sensor, 226: Camera, 227: Audio input / output device, 228: Operation unit, 310: AR glasses for students, 320: information terminal for students, 400: database server, 401: CPU, 402: storage device, 403: communication I / F, 404: input / output I / F, 411: student information DB, 411a: student name, 411b: student number, 411c: marker, 411d: terminal ID, 411e: glass ID, 412: grade information DB, 412a: student number, 412b: unit, 412c: number of correct answers, 412d: cumulative number of questions, 412e: correct answer rate, 412f: understanding degree, 413: textbook information DB, 413a: textbook name, 413b: textbook code / page, 413c: detailed information, 414: color information DB, 414a: student number, 414b: textbook code / page, 414c: question, 414d: assigned color, 415: standard information DB, 416: viewing page holding unit, 421: viewing page determination unit, 422: grade information calculation unit, 423: color information calculation unit, 424: request response unit, 500: AR server, 521: input unit, 522: request unit, 523: data processing unit, 524: drawing processing unit, 525: output unit, 531: selection reception unit, 532: display control unit, 900: network, 920: teacher, 921: image, 930: student, 931: browsing page image

Claims

1. A grade information database that stores the level of comprehension of digital textbooks for each student; An AR system having teacher AR (Augmented Reality) glasses worn by a teacher; The AR system includes: A selection receiving unit that receives a selection of a target student who is a student to be displayed; a display control unit that displays a viewing page of the digital textbook that is being viewed in a color-coded manner according to the received level of understanding of the target student; The selection receiving unit is an educational support system that receives the selection of the target student based on the teacher's line of sight.

2. 2. The education support system according to claim 1, The AR system has a projection function, The display control unit displays the viewed page in a different color as a hologram in real space, in an educational support system.

3. 2. The education support system according to claim 1, The AR system has a projection function, The display control unit displays the viewing page as a hologram in real space, and displays color-coded information according to the level of understanding on the teacher's AR glasses.

4. 2. The education support system according to claim 1, a textbook information database that stores textbook information including information on a unit for each page of the digital textbook; a color information database that stores color information corresponding to the unit included in the viewed page for each of the students; a grade information calculation unit that calculates the level of understanding of each student by a predetermined calculation method when the grade is registered in the grade information database, and registers the level of understanding in the grade information database; a color information calculation unit that calculates the color information of the viewed page for each of the students according to a predetermined standard when the level of understanding is registered, and registers the color information in the color information database; the grade information database stores the level of understanding for each of the units of the digital textbook for each of the students; The display control unit refers to the color information database, and displays the viewed page by color-coding each of the units included in the viewed page according to the level of understanding.

5. The education support system according to claim 4, An answer receiving unit that receives answers to questions included in the digital textbook from the students, the textbook information database has information on the unit corresponding to each of the questions, the grade information calculation unit, each time an answer to the question is received, identifies the unit of the question, calculates the level of understanding of the grade information database, and updates the grade information database; The color information calculation unit calculates the color information and updates the color information database every time the understanding level is calculated.

6. 6. The education support system according to claim 1, The AR system further includes student AR glasses worn by each of the students, The display control unit displays the viewing page on the student's AR glasses in a color-coded manner according to the level of understanding of the student wearing the student's AR glasses.

7. The school is equipped with Augmented Reality (AR) glasses for teachers to wear. A selection receiving unit that receives a selection of a target student who is a student to be displayed; a display control unit that displays a currently viewed page of the digital textbook in a color-coded manner according to the previously calculated level of understanding of the target student; The selection receiving unit is an AR system that receives the selection of the target student based on the teacher's line of sight.

8. A grade information database that stores the level of comprehension of digital textbooks for each student; An educational support method in an educational support system including an AR system having teacher AR (Augmented Reality) glasses worn by a teacher, comprising: a selection receiving step of receiving a selection of a target student, which is a display target, by the gaze of the teacher; An educational support method comprising: a display control step of displaying a viewed page, which is a page of the digital textbook being viewed, in a color-coded manner according to the level of understanding of the selected target student.

9. The computer of the AR system, which has teacher-use AR (Augmented Reality) glasses worn by the teacher, a selection receiving step of receiving a selection of a target student who is a student to be displayed by the teacher through the gaze of the teacher; A program for executing a display control procedure that displays the currently viewed page of a digital textbook in a color-coded manner according to the previously calculated level of understanding of the selected target student.

Images