Educational support systems, AR systems, educational support methods and programs

Abstract

To provide a technique capable of appropriately supporting learning with a simple configuration when teaching face-to-face.SOLUTION: An education support system includes: a score information database that stores a degree of understanding of a digital textbook for each student; and an AR system having an AR (Augmented Reality) glass that a teacher wears. The AR system includes: a selection receiving unit configured to receive selection of a target student who is a student to be displayed; and a display control unit that displays a browsing page that is a page being browsed in the digital textbook in different colors in accordance with the degree of understanding of the received target student. The selection receiving unit receives selection of the target student by the line of sight of the teacher.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an educational support system and an educational support method. In particular, it relates to educational support technology using AR (Augmented Reality) glasses.

Background Art

[0002] There is a digital textbook that can be browsed in an AR space using AR technology. In addition, there is a system in which a teacher uses an information terminal to grasp the learning content of students and provide learning support to individual students (see, for example, Patent Document 1 and Patent Document 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] The following analysis is provided by the present invention.

[0005] In the technology disclosed in Patent Document 1, according to the page of the textbook that the student is opening and the marks that the student has attached to the textbook, the teacher can grasp the degree of understanding of the students in the classroom. However, with the technology disclosed in Patent Document 1, it is not possible to grasp the degree of understanding of individual students.

[0006] Furthermore, the technology disclosed in Patent Document 2 allows teachers to understand the level of comprehension of individual students by processing student input on their own terminals. However, in the technology disclosed in Patent Document 2, each student works on different materials and their level of comprehension is measured individually, so complex processing is required. Teachers must shift their gaze to their terminals and process the information for each student. Consequently, they are forced to take their eyes off the students during class.

[0007] In face-to-face lessons in a classroom with multiple students, it is crucial to keep an eye on each student as much as possible. However, the current system makes it impossible to monitor each student's level of understanding and address their individual challenges without taking your eyes off them. As a result, providing appropriate instruction to each student is difficult.

[0008] This invention has been made in view of the above circumstances, and aims to provide a technology that enables appropriate learning support with a simple configuration when conducting face-to-face classes. [Means for solving the problem]

[0009] According to the first aspect of this invention, A performance information database that records each student's level of understanding of digital textbooks, The system includes an AR (Augmented Reality) system equipped with teacher-specific AR glasses worn by teachers, The aforementioned AR system, A selection reception unit that accepts the selection of the target student who is the student to be displayed, The system includes a display control unit that displays the currently viewed page of the digital textbook in different colors according to the level of understanding of the target student who has been contacted, The aforementioned selection reception unit provides an educational support system that accepts the selection of the target student from the teacher's perspective.

[0010] According to a second aspect of the present invention, Equipped with teacher-specific AR (Augmented Reality) glasses to be worn by teachers, A selection reception unit that accepts the selection of target students who are to be displayed, The system includes a display control unit that displays the currently viewed page of a digital textbook in different colors according to the pre-calculated level of understanding of the student who has received the request, The selection reception unit is provided with an augmented reality (AR) system that accepts the selection of the target student based on the teacher's gaze.

[0011] According to a third aspect of the present invention, A performance information database that records each student's level of understanding of digital textbooks, An educational support method in an educational support system comprising an AR system having teacher-use AR (Augmented Reality) glasses worn by teachers, A selection acceptance step in which the selection of the target student, who is the student to be displayed, is accepted by the teacher's gaze, An educational support method is provided, comprising a display control step of displaying the currently viewed page of the digital textbook in different colors according to the level of understanding of the selected target student.

[0012] According to the fourth aspect of the present invention, On the computer of the AR system, which has teacher-specific AR (Augmented Reality) glasses worn by the teacher, A selection acceptance procedure in which the selection of target students to be displayed is accepted by the teacher's gaze, A program is provided for executing a display control procedure that displays the currently viewed page of a digital textbook in different colors according to the pre-calculated level of understanding of the selected target student.

[0013] These programs can be recorded on a computer-readable storage medium. The storage medium can be a non-transient one such as a semiconductor memory, a hard disk, a magnetic recording medium, an optical recording medium, etc. The present invention can also be embodied as a computer program product.

Advantages of the Invention

[0014] According to the present invention, when conducting face-to-face classes, appropriate learning support can be provided with a simple configuration.

Brief Description of the Drawings

[0015] [Figure 1] It is an example of a configuration diagram of the education support system according to the first embodiment. [Figure 2] (a) is an example of the hardware configuration diagram of the teacher's AR glasses and the student's AR glasses according to the first embodiment, (b) is an example of the hardware configuration diagram of the teacher's information terminal and the student's information terminal according to the first embodiment, and (c) is an example of the hardware configuration diagram of the database server and the AR server according to the first embodiment. [Figure 3] It is an example of a functional block diagram of the database server according to the first embodiment. [Figure 4] (a) is an example of an explanatory diagram for explaining the student information database according to the first embodiment, and (b) and (c) are examples of explanatory diagrams for explaining the textbook information database according to the first embodiment. [Figure 5] (a) is an example of an explanatory diagram for explaining the reference information database according to the first embodiment, (b) is an example of an explanatory diagram for explaining the grade information database according to the first embodiment, (c) is an example of the data stored in the count storage unit of a modified example, (b) is an example of the measurement terminal data stored in the count storage unit of another modified example according to the first embodiment, and (c) is an example of an explanatory diagram for explaining the color separation information database according to the first embodiment. [Figure 6] It is an example of a functional block diagram of the AR server according to the first embodiment. [Figure 7] It is an example of a flowchart of the visual recognition student information display process according to the first embodiment. [Figure 8]This is an example of a flowchart for the textbook information display process in the first embodiment. [Figure 9] This is an example of a flowchart for the page color-coding information generation process in the second embodiment. [Figure 10] This is an example of a flowchart for the textbook information display process in the second embodiment. [Modes for carrying out the invention]

[0016] Hereinafter, an outline of one embodiment of the present invention (hereinafter referred to as "this embodiment") will be described with reference to the drawings. The reference numerals attached to the drawings are for convenience and serve as examples to aid understanding, and are not intended to limit the present invention to the illustrated embodiments. Furthermore, the connecting lines between blocks in the drawings and other references referred to in the following description include both bidirectional and unidirectional lines. Unidirectional arrows schematically represent the flow of the main signal (data) and do not exclude bidirectionality.

[0017] The program is executed via a computer device, which includes, for example, a processor, memory, input devices, a communication interface, and, if necessary, a display device. This computer device is also configured to communicate with internal and external devices (including computers) via the communication interface, whether wired or wireless. Furthermore, while each block in the diagram has input / output connection points with ports or interfaces, these are omitted from the illustration. In the following description, "A and / or B" means either A or B, or A and B.

[0018] <<First Embodiment>> First, an overview of the first embodiment of the present invention will be described. Figure 1 is a diagram illustrating the overview of the educational support system 100 of this embodiment. Here, the explanation will be given using the case in which the educational support system 100 is used in one classroom of a school as an example. The explanation will be given using the case in which there is one teacher 920 and multiple students 930 as an example. However, in this figure, only one student 930 is shown.

[0019] As shown in this figure, the educational support system 100 of this embodiment includes teacher AR glasses 210, teacher information terminal 220, student AR glasses 310, student information terminal 320, database (DB) server 400, and AR server 500. The student AR glasses 310 and student information terminal 320 are provided in quantities equal to the number of students 930.

[0020] Furthermore, these devices are connected via a network 900 established within the school, such as a LAN (Local Area Network), and are capable of communicating data with each other.

[0021] In this embodiment, when a teacher 920 wearing teacher AR glasses 210 views a student 930 through the teacher AR glasses 210, an image 921 of the viewing page of the digital textbook reflecting the student 930's level of understanding is displayed on the teacher AR glasses 210. If the teacher 920 shifts their gaze and views another student 930, the image 921 of the viewing page displayed on the teacher AR glasses 210 switches to one that reflects the understanding of that student 930. The viewing page refers to the page of the digital textbook selected by the teacher 920, which has been selected by the teacher 920 or the like and is currently displayed.

[0022] Furthermore, the AR glasses 310 for students display images 931 of the digital textbook pages that reflect their level of understanding. The following describes the various components that make this possible.

[0023] [AR glasses for teachers, AR glasses for students] Figure 2(a) shows the hardware configuration diagrams of the teacher's AR glasses 210 and the student's AR glasses 310. These devices are glasses-type wearable terminals and have the configuration of typical AR glasses. Specifically, they include a CPU (Central Processing Unit) 211, a storage device 212, a display 213, a communication interface (I / F) 214, a sensor 215, a first camera 216, a second camera 217, and an operation unit 218. In addition, they may also include an audio input / output unit, etc.

[0024] First, let me explain the AR glasses 210 for teachers.

[0025] The CPU 211 loads programs pre-stored in the memory device 212 into the work area of ​​the memory device 212 and executes them, thereby realizing various functions and controlling the overall operation of the teacher's AR glasses 210.

[0026] The storage device 212 stores the data necessary for processing by the CPU 211. For example, it may include semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), or SSD (Solid State Drive).

[0027] The display 213 displays the display data transmitted from the AR server 500 at predetermined time intervals as an image. In this embodiment, a transparent display is used that allows both the outside world and the display to be seen. That is, the teacher's AR glasses 210 in this embodiment are transparent (optical see-through) AR glasses.

[0028] In this embodiment, as will be described later, the display data is rendered in the AR coordinate system by the AR server 500. By displaying this processed data, the display data appears to the wearer (teacher 920) as if it were being displayed in distant space.

[0029] The communication interface (I / F) 214 is an interface for sending and receiving data via the network 900. In this embodiment, it is an I / F for sending and receiving data with the AR server 500. In addition, other interfaces such as Wi-Fi® or Bluetooth® may be provided. For example, communication with the teacher's information terminal 220 may be conducted via short-range wireless communication.

[0030] Sensor 215 detects the position, rotation, orientation, tilt, and movement of the teacher's AR glasses 210. For example, it may include a GPS (Global Positioning System) receiver, a gyroscope, a geomagnetic sensor, an accelerometer, an illuminance sensor, a distance sensor, etc.

[0031] The first camera 216 captures the outer periphery of the teacher's AR glasses 210. The second camera 217 captures the wearer's side. In this embodiment, the second camera 217 captures the wearer's (teacher 920) eyes.

[0032] In this embodiment, the CPU 211 identifies the gaze direction of the wearer (teacher 920) based on information obtained from the sensor 215, the first camera 216, and the second camera 217, and extracts the face image in the direction of view as a marker. This process is performed, for example, at predetermined time intervals.

[0033] Specifically, the CPU 211 determines the wearer's gaze direction based on the image captured by the second camera 217 and the information from the sensor 215. The CPU 211 also extracts a face image (region) from the image captured by the first camera 216. Then, the CPU 211 extracts a face image containing the intersection point between the image captured by the first camera 216 and the gaze direction as a marker. If there are multiple face images containing the intersection point, the marker is extracted according to a predetermined rule. For example, the face image furthest forward (towards the wearer) may be extracted as the marker. Alternatively, the face image whose intersection point is closest to the centroid of the face image region may be extracted as the marker.

[0034] The CPU 211 transmits the extracted markers to the AR server 500 via the communication interface 214. The data transmitted from the teacher's AR glasses 210 includes a source ID in its header, for example, to identify the source. Similarly, data transmitted from the student's AR glasses 310, the teacher's information terminal 220, and the student's information terminal 320 also includes a source ID in its header, for example. This allows the receiving device to identify the source.

[0035] Existing methods will be used for extracting facial images (regions) and determining gaze direction.

[0036] The control unit 218 receives commands from the wearer. In this embodiment, for example, it receives commands to start and stop the teacher's AR glasses 210.

[0037] Each part of the student AR glasses 310 essentially performs the same functions as the teacher AR glasses 210. However, the student AR glasses 310 do not necessarily need to have a marker detection function. For example, when the student AR glasses 310 are activated, they send activation information to the AR server 500, indicating that they have been activated.

[0038] [Teacher's information terminal, student's information terminal] The teacher's information terminal 220 and the student's information terminal 320 are information processing devices such as smartphones, tablets, and notebook PCs (Personal Computers). Alternatively, a viewer specifically for digital textbooks may also be used. In this embodiment, input from the operator (teacher 920 or student 930) is received. In this embodiment, for example, instructions for operations such as launching a digital textbook or turning pages are received.

[0039] Figure 2(b) is a hardware configuration diagram of the teacher's information terminal 220 and the student's information terminal 320 in this embodiment. As shown in this figure, these devices include a CPU 221, a storage device 222, a display device 223, a communication interface 224, a sensor 225, a camera 226, an audio input / output device 227, and an operation unit 228. In addition, they may also have other general functions found in smartphones, tablets, etc. Multiple cameras 226 may be provided.

[0040] Each of these components essentially has the same function as the teacher's AR glasses 210 with the same name. The display device 223 includes a display, touch panel, etc., outputs images processed by the CPU 221, and also accepts input from the user. The audio input / output device 227 includes a microphone, speaker, audio input / output control unit, etc., and controls the input and output of audio.

[0041] For example, the storage device 222 stores the textbook codes of selectable textbooks in advance. The teacher's information terminal 220 receives instructions from the teacher 920 to select a digital textbook via a touch panel. The teacher's information terminal 220 transmits the textbook code of the received digital textbook to the DB server 400. Alternatively, the DB server 400 may receive the data of the digital textbook in return and output it to the display.

[0042] The teacher's information terminal 220 receives page operation instructions for the digital textbook from the teacher 920 via a touch panel. Page operation instructions include, for example, moving to the next page, returning to the previous page, moving to a specified page, returning to the table of contents, etc. The teacher's information terminal 220 transmits the received page operation instructions to the DB server 400. Alternatively, it may receive data of the viewed page displayed according to the instructions from the DB server 400 and output it to the display.

[0043] Furthermore, the functions of the student information terminal 320 are basically the same as those of the teacher information terminal 220. For example, the system may be configured so that the viewing page of the digital textbook selected by the teacher 920 is automatically displayed on the screen, and the student 930 does not need to select the digital textbook or manipulate pages. In this case, when the student information terminal 320 is started, it sends startup information to the DB server 400 to indicate that it has started.

[0044] The student information terminal 320 receives color information for the viewed page along with the page information from the DB server 400, as described later, and generates a display image, which is then displayed on the screen. Here, the student information terminal 320 processes the data of the viewed page according to the color information, as described later, to generate colored data (color data) of the viewed page in the digital textbook, and uses this to generate a display image.

[0045] [Database Server] Next, we will describe the database (DB) server 400. The DB server 400 manages various types of data used in the educational support system 100.

[0046] Figure 3 is a functional block diagram of the DB server 400. The DB server 400 includes the following databases: student information database (DB) 411, grade information DB 412, textbook information DB 413, color coding information DB 414, and reference information DB 415; the following functions: page viewing determination unit 421, grade information calculation unit 422, color coding information calculation unit 423, and request handling unit 424; and a page viewing retention unit 416.

[0047] First, let me explain each database.

[0048] The student information DB 411 is a database that manages information for each student 930. As shown in Figure 4(a), for example, for each student 930, the student name 411a, student number 411b, marker 411c, terminal ID 411d, and glasses ID 411e are associated and registered as one record. The student number 411b is a number that uniquely distinguishes student 930 and is assigned in advance. The marker 411c is image information that uniquely identifies student 930, and in this embodiment, a facial image is registered. The terminal ID 411d is the identification information of the student information terminal 320 assigned to (used by) student 930, and the glasses ID 411e is the identification information of the student AR glasses 310 assigned to (used by) student 930.

[0049] Marker 411c is information used by teacher 920 to identify student 930 as viewed through teacher's AR glasses 210. Therefore, it is sufficient for the student 930 to be uniquely identifiable in the image, and is not limited to a facial image. For example, a two-dimensional marker may be applied to an item that can identify an individual, such as a student ID card, and this may be used as the marker. Alternatively, it may be an image of a name tag or similar item worn by student 930.

[0050] The student information database 411 is created and stored in advance. Attendance management may also be included. If attendance is also managed, for example, as described later, when a marker is sent via the AR server 500, it is only necessary to compare it with the information of student 930 who is registered as present.

[0051] The textbook information DB413 stores data for digital textbooks. In this embodiment, the name, identification information, and detailed information are managed for each textbook, for each predetermined unit. Hereafter, the predetermined unit will be described as a page. Figure 4(b) shows an example where the textbook name 413a, textbook code / page 413b, and detailed information 413c are associated and stored as a single record.

[0052] Textbook code / page 413b lists the textbook code, which is pre-assigned to uniquely identify each textbook, along with the page number. For example, in the example in Figure 4(b), 000-001 means that the textbook code is 000 and the page number is 001, i.e., page 1.

[0053] Detailed information 413c contains the detailed information for each page. An example of the detailed information 413c is shown in Figure 4(c). As shown in this figure, detailed information 413c includes its content and the problem (item). In addition, each problem is assigned a problem number that uniquely identifies it, and is identified by this problem number.

[0054] Furthermore, each problem is managed with a unit tag, as shown in Figure 4(c). Here, a unit refers to a division (field) of learning content. For example, "one-dimensional equations," "variables," "simultaneous equations," etc. For each problem, a corresponding unit (field) is identified in advance and assigned as a unit tag. In other words, the unit tag is information used to identify the corresponding field for each problem. In addition, the "correct answer" for each problem may also be registered.

[0055] In this embodiment, as will be described later, the level of understanding is calculated for each unit. In the example in Figure 4(c), Question 1 corresponds to the units "One-Dimensional Equations" and "Variables". Question 2 corresponds to the units "One-Dimensional Equations", "System of Equations", and "Variables".

[0056] When sending textbook data to student AR glasses 310 and student information terminals 320, the "correct answers" and unit tags will not be sent. On the other hand, when sending textbook data to teacher AR glasses 210 and teacher information terminals 220, the "correct answers" and unit tags may also be sent.

[0057] The Criteria Information DB415 manages various judgment criteria. In the example shown in Figure 5(a), it manages the criteria (threshold) for determining the correct answer rate to be judged as "understanding" for each unit, as well as the conditions for determining the color coding. The Criteria Information DB415 is prepared and registered in advance.

[0058] In the example in Figure 5(a), for instance, if all units assigned to a problem are "understood," the problem is assigned color 1; if even one unit is "not understood," the problem is assigned color 2.

[0059] The performance information database 412 manages the number of correct answers and comprehension level for each student (930) and each unit. In the example in Figure 5(b), each student (930) has a student number (412a) and performance / comprehension information. The performance / comprehension information includes the number of correct answers (412c), the cumulative number of questions (412d), the accuracy rate (412e), and the comprehension level (412f) for each unit (412b). The performance information database 412 is prepared in advance for each student (930). Then, for example, the teacher (920) registers the number of correct answers (412c) and the cumulative number of questions (412d) for each unit. The accuracy rate (412e) and comprehension level (412f) are calculated by the performance information calculation unit (422), which will be described later.

[0060] The color coding information DB 414 manages color coding information for each student 930, for each page of the digital textbook, for each question, and according to the student's level of understanding. In the example in Figure 5(c), for each student number 414a and textbook code / page 414b, the assigned color 414d for each question 414c is registered as the color coding information for that page. Here, we illustrate the case where, for student 930 with student number 414a "1234567", and textbook code / page 414b "000-001", question 1 is assigned color 1 and question 2 is assigned color 2. The color coding information DB 414 is created by the color coding information calculation unit 423.

[0061] Next, we will explain the various functions of DB Server 400.

[0062] The page viewing determination unit 421 determines the page to be viewed and temporarily stores its data. The page to be viewed is specified by the teacher 920. In this embodiment, for example, the textbook code / page 413b is identified and stored from the textbook code and page operation instruction transmitted from the teacher's information terminal 220.

[0063] Furthermore, when the viewing page determination unit 421 identifies the textbook code / page 413b, it refers to the textbook information DB 413 and extracts the information registered as detailed information 413c as viewing page data. The extracted viewing page data is stored in the viewing page storage unit 416 along with the textbook code / page 413b. The viewing page determination unit 421 may then transmit this viewing page data, for example, to the teacher's information terminal 220 and the student's information terminal 320 that is currently running. When a new textbook code / page 413b is received, the information held in the viewing page storage unit 416 is updated. The information in the viewing page storage unit 416 is then transmitted to the teacher's information terminal 220 and the student's information terminal 320 that is currently running each time it is updated.

[0064] The performance information calculation unit 422 calculates the accuracy rate 412e and the comprehension level 412f from the performance information DB 412. The accuracy rate 412e is calculated using a predetermined calculation method, for example, by dividing the number of correct answers 412c by the cumulative number of questions 412d. The comprehension level 412f is calculated by referring to the reference information DB 415. That is, if it is above the threshold of the judgment criteria stored in the reference information DB 415, it is considered "understood," and if it is below the threshold, it is considered "insufficient understanding."

[0065] The color information calculation unit 423 determines (calculates) the color to be assigned to each item (problem) on each page of the digital textbook for each student 930. The calculation results are stored in the color information DB 414. The assigned color to each item is calculated according to the conditions in the reference information DB 415. For example, the assigned color is calculated according to the number of students' comprehension levels for each unit.

[0066] The request handling unit 424 handles requests from external devices such as the AR server 500 and student information terminals 320.

[0067] In this embodiment, as will be described later, when the request response unit 424 receives a marker from the AR server 500, it identifies the student information (student number) corresponding to the marker. Then, it returns the color coding information of the student's viewed page, along with the viewed page data, to the AR server 500.

[0068] Specifically, the request handling unit 424 refers to the student information DB 411 and extracts the student number 411b of the record containing the marker 411c that is closest to (most similar to) the received marker. Then, from the color coding information DB 414, it extracts the data for student number 414a, which is the same as the extracted student number 411b, as color coding information for the viewed page, and sends it to the AR server 500 along with the viewed page data.

[0069] Furthermore, when the request response unit 424 receives a glasses ID from the AR server 500, it identifies the student information (student number) of the student using the student AR glasses 310 that have that glasses ID. It then returns the color coding information of the page viewed by that student, along with the glasses ID and the viewed page data, to the AR server 500.

[0070] Specifically, when the request handling unit 424 receives a Glass ID, it refers to the student information DB 411 and extracts the student number 411b of the record containing the Glass ID 411e that matches the Glass ID. Then, it extracts the color coding information of the student number 414a, which has the same student number as the extracted student number 411b, from the color coding information DB 414, which is data with a textbook code / page number held in the viewing page holding unit 416. Finally, it sends the Glass ID, the viewing page data, and its color coding information to the AR server 500.

[0071] Furthermore, when the request response unit 424 receives startup information from the student information terminal 320, it sends back the color coding information and viewed page data of the student 930 using the student information terminal 320 to the original student information terminal 320.

[0072] [AR Server] Figure 6 is a functional block diagram of the AR server 500. The AR server 500 controls the teacher's AR glasses 210 and the student's AR glasses 310. In other words, in this embodiment, the AR system is configured by the teacher's AR glasses 210 and / or the student's AR glasses 310 and the AR server 500.

[0073] In this embodiment, as described above, when the teacher 920 starts the digital textbook using the teacher's information terminal 220, the data of the digital textbook (textbook data) is obtained from the DB server 400 and displayed on the teacher's AR glasses 210 and the student's AR glasses 310, respectively. At this time, the student's AR glasses 310 display the textbook data color-coded according to the wearer's (student 930's) level of understanding.

[0074] Furthermore, when teacher 920 spots a specific student 930, the system identifies the student 930 and displays textbook data color-coded according to the student's level of understanding on the teacher's AR glasses 210.

[0075] This explanation uses an example where one AR server 500 controls both the teacher's AR glasses 210 and all student AR glasses 310. However, the AR server 500 may be provided separately for the teacher and for the students.

[0076] As shown in Figure 6, the AR server 500 includes a selection reception unit 531 that accepts selections from the teacher's AR glasses 210, and a display control unit 532 that controls the display on the teacher's AR glasses 210 and the student's AR glasses 310. The selection reception unit 531 includes an input unit 521, and the display control unit 532 includes a request unit 522, a data processing unit 523, a drawing processing unit 524, and an output unit 525.

[0077] The input unit 521 receives data from an external source. In this embodiment, it receives data from the teacher's AR glasses 210. It also receives activation information from the student's AR glasses 310, indicating that the system has been activated.

[0078] Specifically, the input unit 521 receives information from the teacher's AR glasses 210 to identify the student 930 being viewed, that is, the student 930 whose color-coded viewing page is to be displayed on the teacher's AR glasses 210's display 213. Here, the facial image of the student 930 is received as a marker as information to identify the student being viewed. The marker is then extracted from the received data and sent to the request unit 522.

[0079] Furthermore, when the input unit 521 receives activation information from the student AR glasses 310, it extracts the source glasses ID from the header. Then, it sends the extracted glasses ID to the request unit 522.

[0080] When the selection reception unit 531 receives a marker from the teacher's AR glasses 210, the display control unit 532 identifies the corresponding student 930 (target student), colors it according to the target student's level of understanding, and displays the viewed page on the teacher's AR glasses 210 display.

[0081] Here, the request unit 522 sends and receives data with the DB server 400.

[0082] In this embodiment, the request unit 522 sends a marker to request display information to be displayed on the teacher's AR glasses 210. Here, the marker is sent to the DB server 400, which then retrieves the viewed page data and color separation information as display information. The retrieved display information is then sent to the data processing unit 523.

[0083] In this embodiment, the request unit 522 requests display information by sending a glasses ID to be displayed on the student AR glasses 310. Here, the glasses ID is sent to the DB server 400, which then retrieves the viewed page data and color separation information as display information. The retrieved display information is sent to the data processing unit 523 along with the glasses ID.

[0084] The data processing unit 523 generates display data from the display information. Here, it processes the information (data) of the viewed page according to the color separation information and generates colored data of the viewed page. The generated colored data is sent to the drawing processing unit 524. If a glass ID is included, it is sent to the drawing processing unit 524 along with the glass ID.

[0085] The drawing processing unit 524 renders the colored data received from the data processing unit 523 into AR coordinates. The rendered information (rendering information; display data) is sent to the output unit 525. If a glasses ID is included, it is sent to the output unit 525 along with the glasses ID.

[0086] In this embodiment, the data processing unit 523 and the drawing processing unit 524 process the color data so that it is displayed in a predetermined area of ​​the teacher's AR glasses 210 or the student's AR glasses 310, in a predetermined size.

[0087] The output unit 525 transmits the display data to the teacher's AR glasses 210, causing it to be displayed on the display 213. If the display data is received along with the glasses ID, the output unit 525 transmits the display data to the student's AR glasses 310 identified by the glasses ID, causing it to be displayed on the display 213.

[0088] The teacher's AR glasses 210 or the student's AR glasses 310 display the received rendering information (display data) on their display 213. That is, they project it onto the AR coordinates.

[0089] [Hardware configuration] Figure 2(c) shows the hardware configuration of DB server 400 and AR server 500.

[0090] As shown in this figure, the DB server 400 and the AR server 500 are implemented as general-purpose information processing devices, each comprising a CPU 401, a storage device 402, a communication interface 403, and an input / output interface 404.

[0091] The CPU 401 implements the various functions described above by loading programs stored in the storage device 402 into work memory and executing them. Each database, the data used by each function, and the data generated by processing are stored in the storage device 402. The storage device 402 includes RAM, ROM, HDD, SSD, etc.

[0092] Communication I / F 403 communicates with external devices, and input / output I / F 404 accepts data input to the device and outputs the processed data. Other expansion I / Fs may also be provided.

[0093] [Visual Student Information Display Processing] Next, we will explain the process of displaying visible student information by the teacher's AR glasses 210, AR server 500, and DB server 400 while a designated page is being viewed (displayed). This visible student information display process is a process in which, each time the teacher 920 shifts their gaze, textbook information with color coding for the student 930 that they have seen is displayed on the teacher's AR glasses 210.

[0094] Figure 7 shows the processing flow for displaying visible student information. This process is executed at predetermined time intervals. The viewing page is assumed to have been pre-sent to the DB server 400 from, for example, the teacher's information terminal 220.

[0095] The teacher's AR glasses 210 identify the direction of the teacher's gaze at predetermined time intervals and extract the facial image of the student 930 as a marker (step S1201). Then, the teacher's AR glasses 210 transmit the extracted marker to the AR server 500 (step S1202).

[0096] Upon receiving the marker, the AR server 500 has its request unit 522 send the marker to the DB server 400 (step S1203).

[0097] Upon receiving the marker, the DB server 400 uses the above method to have the request response unit 424 identify student information (student number) from the marker (step S1204) and extract the color coding information of the viewed page for that student number (step S1205). Then, the request response unit 424 sends the color coding information of the viewed page for student 930 with that student number, along with the viewed page data, to the AR server 500 (step S1206).

[0098] When the request unit 522 of the AR server 500 receives the viewed page data and the color coding information of the student, the AR server 500's data processing unit 523 performs data processing (step S1207), the drawing processing unit 524 performs drawing processing (step S1208), and generates display data. Then, the output unit 525 transmits the generated display data to the teacher's AR glasses 210 (step S1209).

[0099] The teacher's AR glasses 210 erase the previously displayed data and display the transmitted display data on the display 213 (step S1210).

[0100] As described above, the teacher's AR glasses 210, AR server 500, and DB server 400 repeat the above-mentioned process of displaying viewed student information at predetermined time intervals. As a result, the teacher's AR glasses 210 display information about the pages viewed by the student 930, as seen by the teacher 920, color-coded according to their level of understanding.

[0101] Furthermore, the teacher's AR glasses 210 may be configured to erase the displayed data if no data is transmitted for a predetermined period of time.

[0102] [Textbook Information Display Processing] Next, we will explain the textbook information display process that displays textbook information on the student AR glasses 310. Figure 8 shows the processing flow of the textbook information display process. This process is executed once when the student AR glasses 310 are started up.

[0103] When the student AR glasses 310 receive an activation command from student 930 (step S1301), it sends activation information to the AR server 500 (step S1302).

[0104] The request unit 522 of the AR server 500 extracts the Glass ID and sends it to the DB server 400 (step S1303).

[0105] Upon receiving the Glass ID, the DB server 400 uses the above method to have the request response unit 424 identify student information (student number) from the Glass ID (step S1304), extract color coding information for the viewed page of the student with that student number (step S1305), and send the color coding information for the viewed page of student 930 with that student number, along with the Glass ID and viewed page data, to the AR server 500 (step S1306).

[0106] When the request unit 522 of the AR server 500 receives the glasses ID, the viewed page data, and the student's color information, the data processing unit 523 performs data processing (step S1307), the drawing processing unit 524 performs drawing processing (step S1308), and generates display data. Then, the output unit 525 transmits the generated display data to the student's AR glasses 310 identified by the glasses ID (step S1309).

[0107] In the student AR glasses 310, the transmitted display data is displayed on the display 213 (step S1310).

[0108] This process displays textbook data color-coded according to the student's level of understanding on the AR glasses 310.

[0109] As described above, according to this embodiment, during class, textbook data color-coded according to the level of understanding of the student 930 observed by the teacher 920 is displayed on the display 213 of the teacher's AR glasses 210 worn by the teacher 920. Furthermore, when teaching a class to multiple students 930, if the teacher 920 shifts their gaze to another student 930, the displayed data changes to textbook data color-coded according to that student's level of understanding.

[0110] Therefore, according to this embodiment, the teacher 920 can conduct lessons while visually confirming the performance information of each student 930, which has been entered in advance, without taking their eyes off the students 930. As a result, the teacher 920 can accurately grasp the information about the students 930 that they have seen during the lesson, without relying on memory. Therefore, they can make and provide appropriate guidance to the students 930 on the spot.

[0111] Furthermore, the display 213 of the student AR glasses 310 shows textbook data color-coded according to the student's level of understanding. By viewing this, students 930 can grasp their own level of understanding. For example, when studying independently, they can proceed with their studies while clearly identifying the areas in which they are struggling.

[0112] <<Second Embodiment>> In the first embodiment, student 930's level of understanding is calculated based on pre-registered performance information. In this embodiment, the content of student 930's answers during the lesson is also reflected in this level of understanding. That is, the level of understanding is updated in real time each time student 930 answers.

[0113] The educational support system 100 implemented in this embodiment will now be described. The configuration of the educational support system 100 in this embodiment is basically the same as in the first embodiment. That is, as shown in Figure 1, it comprises teacher AR glasses 210, teacher information terminal 220, student AR glasses 310, student information terminal 320, DB server 400, and AR server 500.

[0114] The following explanation will focus on the differences between each configuration and the first embodiment.

[0115] In this embodiment, the teacher 920 specifies the pages to be viewed, and the student 930 can only view the pages specified by the teacher 920.

[0116] The student information terminal 320 of this embodiment further accepts input of answers to questions displayed on the screen. The student 930 inputs the answers, for example, via a stylus pen (touch pen) on a touch panel. Upon receiving the input, the student information terminal 320 transmits the answer data, along with information identifying the question (question number), to the DB server 400.

[0117] In this embodiment, the grade information DB 412 of the DB server 400 has a storage area prepared in advance for each student 930.

[0118] In addition to the functions of the first embodiment, the grade information calculation unit 422 of this embodiment also includes the function of an answer receiving unit that receives answer data from the student information terminal 320.

[0119] In other words, each time the grade information calculation unit 422 receives an answer (answer data) to a problem provided on the viewing page from a student 930, it determines whether the answer is correct or not and updates the data in the record of the corresponding student number 412a in the grade information DB 412. Whether the answer is correct or not is determined by referring to, for example, the "correct answer" information for the problem registered in the textbook information DB 413. In addition, student information is identified by referring to the student information DB 411 from the terminal ID included in the header of the answer data.

[0120] The grade information calculation unit 422, if the answer is correct, increments the number of correct answers 412c and the cumulative number of questions 412d of the corresponding unit 412b in the record corresponding to student number 412a, the student who submitted the answer, by 1. On the other hand, if the answer is incorrect, only the cumulative number of questions 412d is incremented by 1. The corresponding unit 412b is determined by referring to the unit tag of the question registered in the textbook information DB 413.

[0121] Then, each time the cumulative number of questions 412d is updated, the performance information calculation unit 422 updates the correct answer rate 412e and the comprehension level 412f. These calculation methods are the same as in the first embodiment.

[0122] Furthermore, in this embodiment, the color-coding information calculation unit 423 updates the color-coding information DB 414 each time the grade information calculation unit 422 updates the grade information DB 412. In other words, the color-coding information calculation unit 423 is updated each time a student 930 submits an answer. The method for determining the assigned color for each item is the same as in the first embodiment.

[0123] Furthermore, when the request response unit 424 of this embodiment receives answer data from the student information terminal 320, it transmits the glasses ID, color-coded information, and viewed page data of the student 930 using the student information terminal 320 to the AR server 500.

[0124] Specifically, when the request handling unit 424 receives the answer data, it extracts the terminal ID included in the header of the answer data. Then, it refers to the student information DB 411 and extracts the student number 411b and glass ID 411e of the record that contains the terminal ID 411d that matches the terminal ID. Finally, it sends the student number 411b and the answer data to the grade information calculation unit 422.

[0125] Upon receiving confirmation that the grade information calculation unit 422 has updated the grade information DB 412 and the color-coding information calculation unit 423 has updated the color-coding information DB 414, the request response unit 424 transmits the viewed page data and the color-coding information of the viewed page to the student AR glasses 310 having the extracted glasses ID 411e.

[0126] Furthermore, even if the request unit 522 of the AR server 500 obtains display information without making a request, it also transmits that display information to the data processing unit 523. The display information obtained without making a request is, as described above, the viewed page data and color coding information of the viewed page that are transmitted along with the Glass ID when the student 930 submits the answer data.

[0127] [Processing to generate color-coded information for viewed pages] Next, the process flow for generating color-coded browsing information by the DB server 400 of this embodiment will be explained. Figure 9 shows the processing flow for generating color-coded browsing information. This process is performed when the browsing page is determined by the browsing page determination unit 421 and the determined browsing page is displayed on the teacher's information terminal 220 and the student's information terminal 320. It is also initiated when an answer is received from the student's information terminal 320.

[0128] When the student information terminal 320 receives the answers (answer data) to the problems provided on the viewing page, the grade information calculation unit 422 identifies the student number of the sender and the corresponding problem (problem number) (step S2101). The sender is determined by referring to the student information DB 411 based on the terminal ID included in the header of the transmitted data. The problem number is extracted from the transmitted data.

[0129] The grade information calculation unit 422 extracts the correct answer and unit corresponding to the identified question number from the textbook information DB 413 (step S2102).

[0130] Next, the performance information calculation unit 422 determines whether the answer is correct or not (step S2103).

[0131] Then, if the answer is correct, the performance information calculation unit 422 updates the number of correct answers 412c and the cumulative number of questions 412d in the performance information DB 412 for all extracted units 412b of the data for the identified student number 412a, for example, using the method described above (step S2104).

[0132] On the other hand, if the answer is incorrect, the grade information calculation unit 422 updates only the cumulative number of questions 412d for all extracted units 412b of the data for the identified student number 412a in the grade information DB 412 using the method described above (step S2105).

[0133] After updating the cumulative number of questions (412d), the performance information calculation unit 422 calculates and updates the correct answer rate (412e) for all extracted units (412b) in the same manner as in the first embodiment (step S2106). After calculating the correct answer rate (412e), the performance information calculation unit 422 calculates and updates the level of understanding (412f) for all extracted units (412b) (step S2107).

[0134] After updating the performance information DB412 using the above procedure, the color coding information calculation unit 423 determines the color coding of the corresponding problems on the viewed page (step S2108). Here, the assigned color is determined based on the unit-specific comprehension level 412f in the performance information DB412, according to the reference information DB415.

[0135] After determining the assigned color, the color separation information calculation unit 423 registers the assigned color 414d in the color separation information DB 414 in association with student number 414a (step S2109), and terminates the process.

[0136] As described above, the DB server 400 repeats the above process each time it receives an answer from student 930 while the designated viewing page is being displayed, and saves the latest color coding information for the viewing page for each student 930.

[0137] [Textbook Information Display Processing] Next, the flow of the textbook information display process for displaying the latest textbook information on the student AR glasses 310 in this embodiment will be explained. Figure 10 shows the processing flow of the textbook information display process in this embodiment. Note that each time the teacher 920 changes the page being viewed on the student AR glasses 310, the viewed page is first displayed without color coding information.

[0138] When the student information terminal 320 receives input from student 930 (step S2201), it sends the received answer, along with the question number, to the DB server 400 (step S2202).

[0139] The grade information calculation unit 422 of the DB server 400 refers to the student information DB 411 and identifies the student number 411b and glass ID 411e of the student in question (step S2203). Then, it updates the student's grade information using the method described above (step S2204). In addition, the color coding information calculation unit 423 updates the color coding information of the pages viewed by the student in question using the method described above (step S2205).

[0140] Subsequently, the DB server 400 sends the updated color coding information of the viewed page, along with the viewed page data and the Glasses ID, to the AR server 500 (step S2206).

[0141] When the request unit 522 of the AR server 500 receives the color information of the viewed page along with the viewed page data and the glasses ID, the AR server 500's data processing unit 523 performs data processing (step S2207), the drawing processing unit 524 performs drawing processing (step S2208), and generates display data. Then, the output unit 525 transmits the generated display data to the student AR glasses 310 identified by the glasses ID (step S2209).

[0142] In the student AR glasses 310, the transmitted display data is displayed on the display 213 (step S2210).

[0143] This process displays textbook data color-coded according to the student's latest level of understanding on the AR glasses 310.

[0144] Furthermore, if the color coding information of the viewed page is updated in step S1305, the color coding information of the viewed page may also be sent to the student information terminal 320 that sent the information. This will ensure that the textbook data corresponding to the student's level of understanding is displayed on the student information terminal 320.

[0145] The flow of the visible student information display processing in this embodiment is the same as in the first embodiment. That is, when a marker is transmitted from the teacher's AR glasses 210 to the AR server 500, the latest color-coded information of the student 930 at that time is provided.

[0146] As described above, according to this embodiment, during class, the latest textbook data, color-coded according to the level of understanding of the student 930 observed by the teacher 920, is displayed on the display 213 of the teacher's AR glasses 210 worn by the teacher 920. Furthermore, if the teacher 920 shifts their gaze to another student 930, the displayed data changes to the latest textbook data, color-coded according to the level of understanding of that student 930.

[0147] Therefore, according to this embodiment, as in the first embodiment, the teacher 920 can instantly grasp the level of understanding of the student 930 that he is watching during the lesson. As a result, the teacher 920 can identify the areas where the student 930 needs to learn and provide appropriate instruction without taking his eyes off the student 930.

[0148] Furthermore, according to this embodiment, students 930 can also grasp their own level of understanding, thus enabling them to proceed with their studies more efficiently.

[0149] Furthermore, according to this embodiment, even if a student 930's level of understanding changes during class, their latest state can be grasped. For example, by focusing on one student 930 and explaining necessary points, it is possible to grasp the change in that student's level of understanding. This can then be reflected in the instruction. Therefore, more appropriate instruction can be provided.

[0150] <Variation> The following describes variations of each of the above embodiments.

[0151] In each of the above embodiments, the student 930 is wearing student AR glasses 310, but the student AR glasses 310 are not required. In this case, the student information terminal 320 displays color-coded textbook data. The student 930 then refers to that textbook data.

[0152] Furthermore, in each of the above embodiments, the color-coded textbook data images are displayed on the displays 213 of the teacher's AR glasses 210 and the student's AR glasses 310, respectively, but are not limited to this. For example, the AR server 500 may have a projection function and display the images directly in space as holograms from its output unit 525. This eliminates the need for the student 930 to look at the student information terminal 320.

[0153] Furthermore, only the data of the viewed page may be displayed in real space, while the color separation information may be displayed on the teacher's AR glasses 210 and the student's AR glasses 310.

[0154] Furthermore, in each of the above embodiments, the teacher 920 selects and manipulates pages of the digital textbook via the teacher's information terminal 220, but is not limited to this. For example, the teacher's AR glasses 210 may be equipped with a function to accept gesture input. In this case, the teacher 920 can receive instructions for selecting and / or manipulating pages of the digital textbook through gestures. This allows the teacher 920 to remain facing the student 930 even when manipulating pages.

[0155] Furthermore, while the above embodiments calculate the level of understanding uniformly for each student, the system is not limited to this. For example, the threshold for determining "understanding" may be changed depending on the target school (or the rank of the target school). For instance, a higher threshold could be used to determine "understanding" for a target school with a higher academic ranking.

[0156] In this case, thresholds for each desired school (rank) are registered in the standard information DB415. Additionally, the desired schools (ranks) are registered in the student information DB411. The performance information calculation unit 422 extracts the desired schools (ranks) from the student information DB411 and calculates the level of understanding using the corresponding thresholds.

[0157] Furthermore, while the system includes a reference information database (DB415) and uses thresholds set for each unit to calculate the level of understanding, the thresholds do not need to be changed for each unit; they can be uniform values. For example, all units could be judged as "understood" if the correct answer rate is 50% or higher.

[0158] Furthermore, while the above embodiments use different colors to distinguish between cases where everything is understood and other cases, this is not the only way to do so. Also, the number of colors assigned is not limited to two. For example, one could prepare a color to assign when all units associated with an item are "understood," a color to assign when there is a mix of "understood" and "insufficient understanding," and a color to assign when everything is "insufficient understanding," and assign these colors.

[0159] Furthermore, the display method is not limited to color coding. For example, it could involve changing the font, changing the weight of the text, or using shading. Any specific display method is acceptable as long as it allows for a quick grasp of the level of understanding for each unit.

[0160] Furthermore, in each of the above embodiments, the student 930 that the teacher 920 has seen is selected in the direction of the teacher 920's gaze. However, the selection of the seen student 930 is not limited to this. For example, a student 930 whose face region is included in a predetermined area on the display 213 of the teacher's AR glasses 210 may be considered the seen student 930. In this case as well, the face region of the student 930 is extracted from the image acquired by the first camera 216 and transmitted to the AR server 500 as a marker.

[0161] Furthermore, the teacher's AR glasses 210 and the student's AR glasses 310 do not need to be connected to the network 900. These devices may be connected only to the AR server 500.

[0162] Furthermore, all or part of the functions of the AR server 500 may be provided by the teacher's AR glasses 210 and / or the student's AR glasses 310, respectively.

[0163] Furthermore, in the above embodiments, the cases in which the teacher's AR glasses 210 and the student's AR glasses 310 have transparent displays were described as examples. However, they are not limited to transparent displays. For example, an opaque display may be used. In this case, the image captured by the first camera 216 is used as the background image, and color data is superimposed on a predetermined area to generate a display image (display data).

[0164] Furthermore, although the above embodiments were described using the example of a teacher 920 giving a lesson to a student 930, the usage environment of these embodiments is not limited to this. Since the above embodiments involve providing instruction while visually confirming information about the target person using AR glasses, they may also be used, for example, in a company to provide instruction while confirming the skills of employees based on their past work performance, or to replace digital textbooks with work manuals and ensure mastery of the work manuals. In this case, for example, the method for calculating the level of understanding should be optimized for each usage environment.

[0165] In the processing flow described above, multiple steps (processes) are listed in order, but the execution order of each step is not restricted by that order. For example, the order of the illustrated steps can be changed to the extent that it does not affect the content, such as by executing each process in parallel.

[0166] Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of the present invention. For example, the network configurations and element configurations shown in each drawing are examples to aid in understanding the present invention, and the present invention is not limited to the configurations shown in these drawings.

[0167] Some or all of the above embodiments may also be described as follows, but are not limited to the following: (Note 1) A performance information database that records each student's level of understanding of digital textbooks, The system includes an AR (Augmented Reality) system equipped with teacher-specific AR glasses worn by teachers, The aforementioned AR system, A selection reception unit that accepts the selection of the target student who is the student to be displayed, An educational support system comprising: a display control unit that displays the currently viewed page of the digital textbook in different colors according to the level of understanding of the target student who has been contacted. (Note 2) The educational support system described in Appendix 1, The selection reception unit receives the selection of the target student based on the teacher's gaze. The display control unit is an educational support system that displays the viewed page in different colors on the teacher's AR glasses. (Note 3) An educational support system as described in Appendix 1 or Appendix 2, The system further includes a textbook information database that stores textbook information, including information about the unit for each page of the aforementioned digital textbook. The aforementioned performance information database stores the level of understanding for each student, for each unit of the digital textbook. The display control unit is an educational support system that displays each unit included in the viewing page in a different color according to the level of understanding. (Note 4) The educational support system described in Appendix 3, A color coding information database that stores color coding information corresponding to the unit contained in the viewed page for each student, When grades are registered in the aforementioned grade information database, the grade information calculation unit calculates the level of understanding for each student using a predetermined calculation method and registers it in the aforementioned grade information database. The system further comprises a color-coding information calculation unit that, once the aforementioned level of understanding is registered, calculates the color-coding information of the pages viewed by each student according to predetermined criteria and registers it in the color-coding information database, The display control unit is an educational support system that refers to the color-coded information database and displays the viewed page. (Note 5) The educational support system described in Appendix 4, The system further includes an answer reception unit that receives answers from the aforementioned students to the problems included in the digital textbook, The textbook information database has information relating to the unit corresponding to each of the problems, The performance information calculation unit, each time it receives an answer to a problem, identifies the unit of the problem, calculates the level of understanding in the performance information database, and updates the performance information database. The aforementioned color separation information calculation unit is an educational support system that calculates the color separation information and updates the color separation information database each time the level of understanding is calculated. (Note 6) An educational support system described in any of the appendices 1 to 5, The AR system further includes student-use AR glasses that each student wears, The display control unit is an educational support system that displays the viewed pages on the student's AR glasses in different colors according to the student's level of understanding while wearing the student's AR glasses. (Note 7) Equipped with teacher-specific AR (Augmented Reality) glasses to be worn by teachers, A selection reception unit that accepts the selection of target students who are to be displayed, An AR system comprising: a display control unit that displays the currently viewed page of a digital textbook in a color-coded manner according to the pre-calculated level of understanding of the target student who has received the request. (Note 8) A performance information database that records each student's level of understanding of digital textbooks, An educational support method in an educational support system comprising an AR system having teacher-use AR (Augmented Reality) glasses worn by teachers, A selection acceptance step that accepts the selection of the target student who is the student to be displayed, An educational support method comprising: a display control step of displaying the currently viewed page of the digital textbook on the teacher's AR glasses, color-coded according to the level of understanding of the selected target student. (Note 9) On the computer of the AR system, which has teacher-specific AR (Augmented Reality) glasses worn by the teacher, A selection procedure for accepting the selection of students who are to be displayed, A program for executing a display control procedure that displays the currently viewed page of a digital textbook on the teacher's AR glasses, color-coded according to the pre-calculated level of understanding of the selected target student. Furthermore, the form described in Appendix 7 can be expanded into the forms described in Appendix 4 and Appendix 6, and the forms described in Appendix 8 and 9 can be expanded from the form described in Appendix 2 to the form described in Appendix 6, similar to the form described in Appendix 1.

[0168] Furthermore, the disclosures in the above-mentioned patent documents, etc., are incorporated into this book by reference. Within the framework of the full disclosure of the present invention (including the claims), further modifications and adjustments to the embodiments or examples are possible based on the basic technical concept. Also, within the framework of the disclosure of the present invention, various combinations or selections of various disclosed elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, the present invention naturally includes the full disclosure, including the claims, and various modifications and alterations that a person skilled in the art could make in accordance with the technical concept. In particular, with respect to the numerical ranges described in this book, any numerical value or sub-range included within that range should be interpreted as being specifically described, even if not otherwise stated. [Explanation of Symbols]

[0169] 100: Educational support system, 210: Teacher's AR glasses, 211: CPU, 212: Storage device, 213: Display, 214: Communication interface, 215: Sensor, 216: First camera, 217: Second camera, 218: Control panel, 220: Teacher's information terminal, 221: CPU, 222: Storage device, 223: Display device, 224: Communication interface, 225: Sensor, 226: Camera, 227: Audio input / output device, 228: Control panel, 310: AR glasses for students, 320: Information terminals for students, 400: Database server, 401: CPU, 402: Storage device, 403: Communication interface, 404: Input / output interface, 411: Student information database, 411a: Student name, 411b: Student number, 411c: Marker, 411d: Terminal ID, 411e: Glasses ID, 412: Grade information database, 412a: Student number, 412b: Unit, 412c: Number of correct answers, 412d: Total number of questions, 412e: Correct answer rate, 412f: Comprehension Degree, 413: Textbook Information DB, 413a: Textbook Name, 413b: Textbook Code / Page, 413c: Detailed Information, 414: Color Classification Information DB, 414a: Student Number, 414b: Textbook Code / Page, 414c: Question, 414d: Assigned Color, 415: Standard Information DB, 416: Viewing Page Holding Unit, 421: Viewing Page Determination Unit, 422: Grade Information Calculation Unit, 423: Color Classification Information Calculation Unit, 424: Request Response Unit, 500: AR server, 521: Input unit, 522: Request unit, 523: Data processing unit, 524: Drawing processing unit, 525: Output unit, 531: Selection reception unit, 532: Display control unit, 900: Network, 920: Teacher, 921: Image, 930: Student, 931: Viewed Page Image

Claims

1. A performance information database that records each student's level of understanding of digital textbooks, The system includes an AR (Augmented Reality) system equipped with teacher-specific AR glasses worn by teachers, The aforementioned AR system is A selection reception unit that accepts the selection of the target student who is the student to be displayed, The system includes a display control unit that displays the currently viewed page of the digital textbook in different colors according to the level of understanding of the target student who has been contacted, The aforementioned AR glasses for teachers are equipped with a transparent display, The selection reception unit is an educational support system that accepts the selection of target students from among students in the real world who are visible through the transparent display of the teacher's AR glasses, based on the teacher's gaze.

2. A performance information database that stores the level of understanding of digital textbooks for each student, The system includes an AR (Augmented Reality) system equipped with teacher-specific AR glasses worn by teachers, The aforementioned AR system is A selection reception unit that accepts the selection of the target student who is the student to be displayed, A display control unit displays the currently viewed page of the digital textbook in different colors according to the level of understanding of the student who has been contacted; Equipped with projection capabilities, The selection reception unit receives the selection of the target student based on the teacher's gaze. The aforementioned display control unit is an educational support system that displays the viewed page as a hologram in real space, color-coded.

3. A performance information database that stores the level of understanding of digital textbooks for each student, The system includes an AR (Augmented Reality) system equipped with teacher-specific AR glasses worn by teachers, The aforementioned AR system is A selection reception unit that accepts the selection of the target student who is the student to be displayed, A display control unit displays the currently viewed page of the digital textbook in different colors according to the level of understanding of the student who has been contacted; Equipped with projection capabilities, The selection reception unit receives the selection of the target student based on the teacher's gaze. The aforementioned display control unit displays the viewing page as a hologram in real space, and displays color-coded information corresponding to the level of understanding on the teacher's AR glasses, thus providing an educational support system.

4. A performance information database that stores the level of understanding of digital textbooks for each student, An AR system that includes teacher-specific AR (Augmented Reality) glasses worn by teachers, A textbook information database that stores textbook information including information about the unit for each page of the digital textbook, A color-coding information database that stores color-coding information corresponding to the unit contained in the viewing page, which is the page of the digital textbook being viewed for each student, When grades are registered in the aforementioned grade information database, the grade information calculation unit calculates the level of understanding for each student using a predetermined calculation method and registers it in the aforementioned grade information database. The system includes a color-coding information calculation unit that, once the level of understanding is registered, calculates the color-coding information for each student's viewed pages according to predetermined criteria and registers it in the color-coding information database. The aforementioned AR system is A selection reception unit that accepts the selection of the target student who is the student to be displayed, The system includes a display control unit that displays the aforementioned viewing pages in different colors according to the level of understanding of the target student who has been registered, The selection reception unit receives the selection of the target student based on the teacher's gaze. The aforementioned performance information database stores the level of understanding for each student, for each unit of the digital textbook. The display control unit refers to the color coding information database and displays the viewed page in a color coding according to the level of understanding for each unit contained in the viewed page, as an educational support system.

5. The educational support system according to claim 4, The system further includes an answer reception unit that receives answers from the aforementioned students to the problems included in the digital textbook, The textbook information database has information relating to the unit corresponding to each of the problems, The performance information calculation unit, each time it receives an answer to a problem, identifies the unit of the problem, calculates the level of understanding in the performance information database, and updates the performance information database. The aforementioned color separation information calculation unit is an educational support system that calculates the color separation information and updates the color separation information database each time the level of understanding is calculated.

6. A performance information database that stores the level of understanding of digital textbooks for each student, The system includes an AR (Augmented Reality) system equipped with teacher-specific AR glasses worn by teachers, The aforementioned AR system is A selection reception unit that accepts the selection of the target student who is the student to be displayed, A display control unit displays the currently viewed page of the digital textbook in different colors according to the level of understanding of the student who has been contacted; The system comprises student AR glasses to be worn by each of the aforementioned students, The selection reception unit receives the selection of the target student based on the teacher's gaze. The display control unit is an educational support system that displays the viewed pages on the student's AR glasses in different colors according to the student's level of understanding while wearing the student's AR glasses.

7. Equipped with teacher-specific AR (Augmented Reality) glasses to be worn by teachers, A selection reception unit that accepts the selection of target students who are to be displayed, The system includes a display control unit that displays the currently viewed page of a digital textbook in different colors according to the pre-calculated level of understanding of the student who has received the request, The aforementioned AR glasses for teachers are equipped with a transparent display, The selection reception unit is an AR system that accepts the selection of target students from among students in the real world who are visible through the transparent display of the teacher's AR glasses, based on the teacher's gaze.

8. A performance information database that records each student's level of understanding of digital textbooks, An educational support method in an educational support system comprising: an AR system having teacher-use Augmented Reality (AR) glasses for teachers to wear, which are teacher-use AR glasses equipped with a transparent display; A selection acceptance step in which the selection of the target student to be displayed is received by the teacher through their gaze from among students in the real space that are visible through the transparent display of the teacher's AR glasses, An educational support method comprising: a display control step of displaying the viewing page, which is the page being viewed in the digital textbook, in a color-coded manner according to the level of understanding of the selected target student.

9. Teacher-use Augmented Reality (AR) glasses, which are worn by teachers, and which have a transparent display, are connected to a computer in an AR system. A selection procedure in which the selection of target students to be displayed is received by the teacher through their gaze from among students in the real world who are visible through the transparent display of the teacher's AR glasses, A program for executing a display control procedure that displays the currently viewed page of a digital textbook in different colors according to the pre-calculated level of understanding of the selected target student.

Images