Information processing device, information processing method, and program

Abstract

To provide an information processing device, an information processing method, and a program capable of easily specifying a learner needing follow-up.SOLUTION: An information processing device 1 is used for online education together with a plurality of first communication devices 2 and second communication devices 3. The information processing device 1 includes a terminal information acquisition part 10 and a determination part 20. The terminal information acquisition part 10 acquires at least one of first screen information displayed in the plurality of first communication devices 2 and first terminal operation information about operations of the plurality of first communication devices 2. The determination part 20 determines whether a determined operation is performed about each of the plurality of first communication devices 2 by using at least one of a plurality of pieces of the first screen information and a plurality of pieces of the first terminal operation information.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program. [Background Art]

[0002] Patent Document 1 (Japanese Unexamined Patent Application Publication No. 2001-337589) discloses a technology relating to a remote education system that enables an instructor located remotely from a plurality of students to interact in real time in substantially the same manner as a class conducted in a classroom.

[0003] Patent Document 2 (Japanese Unexamined Patent Application Publication No. 2013-242434) discloses a technology relating to an information processing apparatus that can more easily obtain indicators useful for learning support. [Prior Art Documents] [Patent Documents]

[0004] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2001-337589 [Patent Document 2] Japanese Unexamined Patent Application Publication No. 2013-242434 [Summary of the Invention] [Problems to be Solved by the Invention]

[0005] In recent years, the format of distributing communication devices to students and providing online education at schools and other institutions has become widespread. In such an educational format, the instructor (teacher) and the students (learners) are not necessarily located in the same place, and the instructor and the plurality of students conduct lectures and classes while sharing information through screen operations on communication devices.

[0006] However, due to the nature of remote classes and the one-to-many relationship between the instructor and students, it is difficult for the instructor to recognize when a student struggles with operations on a communication device or cannot keep up with the progress of the class, making it difficult to identify students who need follow-up support.

[0007] In the distance education system disclosed in Patent Document 1 mentioned above, the instructor's terminal is equipped with a multi-monitor screen for observing students, and the screens of multiple student terminals are displayed on this multi-monitor screen. However, it was difficult to grasp the situation of the students in detail using only the screen information of multiple students.

[0008] Furthermore, the information processing device disclosed in Patent Document 2 mentioned above acquires operation history information indicating the learner's actions on the learner terminal and estimates the learner's level of concentration based on this operation history information. However, it was difficult to identify learners who needed support (such as learners who had trouble operating the communication device or who were falling behind in their studies) based solely on information regarding the learner's level of concentration.

[0009] One example of the object of the present invention is to provide an information processing device, an information processing method, and a program that can easily identify learners who require follow-up, in view of the above-mentioned problems. [Means for solving the problem]

[0010] According to one aspect of the present invention, An information processing device used for online education, together with multiple first communication devices and second communication devices, Terminal information acquisition means for acquiring at least one of the first screen information displayed on the plurality of first communication devices and first terminal operation information relating to the operation of the plurality of first communication devices, An information processing device is provided, which includes determination means for determining whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information.

[0011] According to one aspect of the present invention, A computer that implements an information processing device used for online education, together with multiple first and second communication devices, The system acquires at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. An information processing method is provided for determining whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information.

[0012] According to one aspect of the present invention, A computer that, together with multiple first and second communication devices, realizes an information processing device used for online education. A procedure for acquiring at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. A program is provided for performing a procedure to determine whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information. [Effects of the Invention]

[0013] According to one aspect of the present invention, an information processing device, an information processing method, and a program can be obtained that can easily identify learners who require follow-up. [Brief explanation of the drawing]

[0014] [Figure 1] This is a block diagram showing an overview of the information processing device according to the first embodiment. [Figure 2] This figure shows an example of the hardware configuration of an information processing device. [Figure 3] This is a flowchart showing the processing of the determination unit according to the first embodiment. [Figure 4] This is a block diagram showing an overview of the information processing device according to the second embodiment. [Figure 5] This is an illustrative diagram to explain the concept of a shared screen area. [Figure 6]It is a diagram illustrating an example of an image on a display of a second communication device. [Figure 7] It is an image diagram for explaining a mechanism in which an operation performed on a first communication device is reflected in a shared screen area. [Figure 8] It is a block diagram illustrating an outline of an information processing apparatus according to a third embodiment. [Figure 9] This figure shows a flow diagram for calculating a divergence degree. [Figure 10] It is a diagram illustrating an example of calculating a divergence degree using first terminal operation information and second terminal operation information. [Figure 11] It is a diagram illustrating an example of calculating a divergence degree using first screen information and third screen information. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same reference numerals are assigned to similar constituent elements, and description thereof will be omitted as appropriate.

[0016] [First Embodiment] FIG. 1 is a block diagram illustrating an outline of an information processing apparatus 1 according to a first embodiment. The information processing apparatus 1 is used for online education together with a plurality of first communication devices 2 (2a to 2c) and a second communication device 3. The information processing apparatus 1 according to the first embodiment is used in online remote classes, lectures, and the like at schools, cram schools, and other educational institutions. The information processing apparatus 1 may be a so-called cloud server.

[0017] The first communication device 2 and the second communication device 3 are, for example, but not limited to, PC (personal computer) terminals, smartphones, tablets, or wearable devices (such as smart glasses and smart gloves). In the first embodiment, the first communication device 2 is, for example, a PC terminal managed (or operated) by a student attending a cram school lecture. In the first embodiment, the second communication device 3 is, for example, a PC terminal managed (or operated) by a lecturer (teacher) of a cram school lecture.

[0018] A storage unit 4 is provided outside the information processing device 1. The storage unit 4 is a so-called external storage device and may be located on the cloud. The storage unit 4 may also be located inside the information processing device 1.

[0019] The information processing device 1 is configured to communicate with a plurality of first communication devices 2 via a first network 101. In the first embodiment, the first network 101 is a public network. The information processing device 1 is configured to communicate with a second communication device 3 via a second network 102. In the first embodiment, the second network 102 is a public network. In the first embodiment, there is one second communication device 3, but there may be multiple devices.

[0020] (Terminal information acquisition unit 10) The information processing device 1 includes a terminal information acquisition unit 10 and a determination unit 20. The terminal information acquisition unit 10 acquires at least one of a plurality of first screen information and a plurality of first terminal operation information from a plurality of first communication devices 2.

[0021] The first screen information is information about the screen displayed on the first communication device 2. The first screen information includes, but is not limited to, information about the screen's color tone, shape, and characters. The first screen information includes information about the image displayed on the display of the first communication device 2. The terminal information acquisition unit 10 acquires multiple pieces of first screen information corresponding to (associated with) each of the multiple first communication devices (2a to 2c). The first screen information acquired by the terminal information acquisition unit 10 may be stored in the storage unit 4.

[0022] The first terminal operation information is information relating to the operation of the first communication device 2. The first terminal operation information includes information relating to the history of operations on the first communication device 2, such as clicking an icon on the desktop of the first communication device 2 with a mouse or dragging and dropping a file on the desktop. The first terminal operation information includes at least one of the following: operation ID, operation time, position (coordinates) of the pointing device on the desktop at the time of operation, application ID identifying the application being operated on, and the content of the operation within the application.

[0023] The terminal information acquisition unit 10 acquires multiple first terminal operation information corresponding to (associated with) each of the multiple first communication devices 2 (2a to 2c). The first terminal operation information acquired by the terminal information acquisition unit 10 may be stored in the storage unit 4.

[0024] (Judgment Department 20) The determination unit 20 uses at least one of the multiple first screen information and the multiple first terminal operation information to determine whether a predetermined operation has been performed for each of the multiple first communication devices 2 (2a to 2c). A predetermined operation is, for example, an operation that the instructor expects (anticipates) from the students during an online class using a PC terminal. More specifically, it could be, for example, which page of the online text the student opened.

[0025] For example, the terminal information acquisition unit 10 acquires first terminal operation information (e.g., the type of text opened and its page number) of the student's PC terminal (first communication device 2), and the determination unit 20 uses this first terminal operation information to determine that a specified operation has been performed on the first communication device 2. Furthermore, as another example, if there are many identical operation histories on the PC terminals (first communication device 2) of multiple students, the determination unit 20 may use these operation histories (multiple first terminal operation information) to determine that a specified operation has been performed on the first communication device 2.

[0026] (Example hardware configuration) Figure 2 shows an example of the hardware configuration of the information processing device 1. The information processing device 1 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0027] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0028] Processor 1020 is a processor implemented in components such as the CPU (Central Processing Unit) and GPU (Graphics Processing Unit).

[0029] Memory 1030 is a main memory device implemented using RAM (Random Access Memory), etc.

[0030] The storage device 1040 is an auxiliary storage device implemented as a removable media such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or memory card, or as ROM (Read Only Memory), and has a recording medium. The recording medium of the storage device 1040 stores program modules that implement each function of the information processing device 1 (for example, the terminal information acquisition unit 10 and the decision unit 20). The processor 1020 reads these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 also functions as a storage unit 4.

[0031] The input / output interface 1050 is an interface for connecting the information processing device 1 with various input / output devices.

[0032] The network interface 1060 is an interface for connecting the information processing device 1 to a network. This network may be, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method by which the network interface 1060 connects to the network may be wireless or wired. The information processing device 1 may communicate with the first communication device 2 and the second communication device 3 via the network interface 1060.

[0033] (Example of operation of the first embodiment) Figure 3 is a flowchart showing the processing of the determination unit 20 according to the first embodiment. The determination unit 20 will be explained using Figure 3. In the example of operation of the first embodiment, the terminal information acquisition unit 10 acquires both a plurality of first screen information and a plurality of first terminal operation information.

[0034] In step S100, the terminal information acquisition unit 10 acquires multiple first screen information and multiple first terminal operation information from multiple first communication devices 2. The timing of starting step S100 is arbitrary; for example, it may start when an operation is initiated on any of the multiple first communication devices 2.

[0035] In step S110, the determination unit 20 uses a plurality of first screen information and a plurality of first terminal operation information to determine whether a predetermined operation has been performed on each of the plurality of first communication devices 2. For example, the determination unit 20 uses information that the UI screen of an application specified by the instructor is displayed on the display of the PC terminal (first communication device 2) operated by the student (first screen information), and information that the icon of the application has been double-clicked with the mouse (first terminal operation information), to determine whether a predetermined operation has been performed within a predetermined time, for example, whether the application has been launched.

[0036] If the specified operation is performed (for example, the application is launched) (YES in step S110), the process terminates. If the specified operation is not performed (NO in step S110), a notification process is performed in step S120. This notification process may involve generating a notification sound, or displaying a notification screen on the display of the information processing device 1 indicating that the specified operation was not performed. Step S120 is optional; if the specified operation is not performed (NO in step S110), the process may return to step S100 and repeat. In this case, the instructor advises the student on the specified operation, and the process shown in Figure 3 terminates when the specified operation is performed.

[0037] As described above, according to the information processing device 1 of the first embodiment, it is possible to confirm whether the student is operating the PC terminal (first communication device 2) as intended by the instructor, or whether the student is operating at the same level as other students, based on information related to the screen of the PC terminal (first communication device 2) operated by the student (first screen information) and the operation history of the PC terminal operated by the student (first terminal operation information). This makes it easy to identify students who are having trouble operating the terminal or who are falling behind in their learning. Therefore, it is possible to easily identify learners (students) who need follow-up. Consequently, it becomes unnecessary for the instructor to monitor the situation of each individual student in order to find learners who need follow-up. Thus, an information processing device 1 that enables effective education can be realized.

[0038] The following describes detailed examples of the information processing device 1 using the second to fourth embodiments.

[0039] [Second Embodiment] Figure 4 is a block diagram illustrating the overview of the information processing device 1 according to the second embodiment. Unlike the information processing device 1 according to the first embodiment, the information processing device 1 according to the second embodiment further includes an output control unit 30, a shared screen area generation unit 40, and an operation information acquisition unit 50.

[0040] (Shared screen area generation unit 40) Figure 5 is an illustrative diagram illustrating the concept of a shared screen area 41. The shared screen area generation unit 40 generates the shared screen area 41. In the second embodiment, the shared screen area generation unit 40 generates the shared screen area 41 on the virtual desktop of the information processing device 1. The virtual desktop is a screen that can be displayed in common on each of the multiple first communication devices 2 and second communication devices 3. The shared screen area 41 is an area where information for output to the display of the first communication device 2 or the second communication device 3 is gathered. The shared screen area 41 has multiple first areas 42 and second areas 43.

[0041] The first area 42 is the area where the first screen information 11 acquired by the terminal information acquisition unit 10 from the first communication device 2 is displayed. The first screen information 11 acquired by the terminal information acquisition unit 10 is output to the first area 42. The first screen information 11 (11a to 11c in Figure 5) associated with each first communication device 2 (2a to 2c in Figure 5) is displayed in each of the multiple first areas 42 (42a to 42c in Figure 5). The multiple first areas 42 do not overlap each other.

[0042] The second area 43 is the area of ​​the shared screen area 41 other than the first area 42. The second area 43 is an area that is not linked to any of the multiple first communication devices 2. In the second embodiment, for example, third screen information may be output to the second area 43 (the second screen information will be described later). The third screen information is information acquired by the terminal information acquisition unit 10 from the second communication device 3, and is information relating to the screen displayed on the second communication device 3. The third screen information includes, but is not limited to, images and text information displayed on the display of the second communication device 3 (for example, image data and text data used as teaching materials).

[0043] Any area of ​​the shared screen area 41 (multiple first areas 42 and second areas 43) can be displayed on the displays of multiple first communication devices 2 or second communication devices 3. It is also possible to output the first screen information corresponding to one student's first communication device 2a, which is output to the first area 42, to the display of another student's first communication device 2b. Furthermore, it is possible to output the third screen information corresponding to the instructor's second communication device 3, which is output to the second area 43, to the displays of all students' first communication devices 2.

[0044] (Output control unit 30) The output control unit 30 shown in Figure 4 outputs multiple first screen information so that it can be viewed in a list on the screen of the second communication device 3. In the second embodiment, the output control unit 30 outputs all of the multiple first screen information to the second communication device 3 so that it can be viewed in a list on the screen of the second communication device 3. In the second embodiment, by the output control unit 30 outputting all of the multiple first areas 42 to the second communication device 3, multiple first screen information can be viewed in a list on the display of the second communication device 3.

[0045] Figure 6 shows an example of the display image of the second communication device 3. In Figure 6, the shared screen area 41 is displayed on the display of the second communication device 3. The part corresponding to multiple first areas 42 is part A in Figure 6, and the part corresponding to the second area 43 is part B in Figure 6. Multiple first screen information 11 is displayed in part A. Part B is also the third screen information. The instructor can view the screens (first screen information) displayed on each of the first communication devices 2 of multiple students at a glance on a single screen of the second communication device 3's display.

[0046] Furthermore, the output control unit 30 may output the third screen information displayed on the second communication device 3 to the screens of each of the multiple first communication devices 2. After the third screen information is output to the second area 43, the output control unit 30 can output the second area 43 containing the outputted third screen information to the displays of each of the multiple first communication devices 2. This allows the instructor's screen to be shared with the students.

[0047] As shown in Figure 6, the output control unit 30 outputs multiple first screen information and third screen information so that they can be viewed in a list on the screen of the second communication device 3. On the display of the second communication device 3, the instructor can view multiple first screen information (screens displayed on the students' PC terminals) and third screen information (screens shared with the students' PC terminals) on a single screen.

[0048] Figure 7 is an illustrative diagram illustrating how operations performed on the first communication device 2 are reflected in the shared screen area 41. The information processing device 1 according to the second embodiment further comprises an operation information acquisition unit 50. The first communication device 2 according to the second embodiment comprises a desktop 6, a pointing device driver 7, an operation receiving unit 8, and an operation transmitting unit 9. In the second embodiment, the desktop 6 is the screen that is initially displayed when the first communication device 2 (e.g., a PC terminal) is started up. The pointing device driver 7 is software necessary to enable a device such as a mouse to function.

[0049] First, we will explain the process by which a participant operates the first communication device 2, and how the screen of the first communication device 2 after the operation is reflected in the shared screen area 41.

[0050] For example, if a student double-clicks an application icon on the desktop 6 using a mouse linked to the pointing device driver 7, the pointing device driver 7 transmits the operation information to the operating system (OS) and the application, and the display on the desktop 6 is updated.

[0051] At this time, the pointing device driver 7 assigns an operation ID, the ID of the application to which the information is to be handed over, and the operation time to the operation information, and stores it in the device storage unit 5 as operation history (first terminal operation information).

[0052] The first screen information includes the display content of desktop 6. The first screen information includes the operation ID, application ID, and image data of desktop 6. The first screen information is linked to the first terminal operation information by the operation ID and stored in the device storage unit 5. The operation transmission unit 9 then transmits the operation history (first terminal operation information) and the desktop 6 image data (first screen information) to the terminal information acquisition unit 10 of the information processing device 1.

[0053] The terminal information acquisition unit 10 acquires the desktop 6 image data (first screen information) and operation history (first terminal operation information) transmitted by the operation transmission unit 9. The operation history (first terminal operation information) and desktop 6 image data (first screen information), along with an ID that identifies the first communication device 2, are stored in the storage unit 4 in chronological order. This operation history and desktop 6 image data are used by the decision unit 20.

[0054] The image data (first screen information) of the desktop 6 acquired by the terminal information acquisition unit 10 is reflected in the first area 42, which corresponds one-to-one with the first communication device 2 (see Figure 5). Note that the first area 42 is only for displaying the image of the desktop 6 and does not execute any applications. Therefore, it only needs to have memory resources to store the image data of the desktop 6, and does not need to have computer resources for executing applications.

[0055] In this way, the image of the desktop 6 after the student's operation is reflected in the shared screen area 41 (first area 42). Then, by outputting the shared screen area 41 to the second communication device 3 (or another first communication device 2), the instructor can see the screen after the image of the desktop 6 has changed due to the student's operation. In this way, the shared screen area 41 is used as the screen sharing function of the information processing device 1.

[0056] Next, we will explain the process by which the shared screen area 41 is manipulated, and how the manipulated shared screen area 41 is reflected on the desktop 6 of the first communication device 2.

[0057] The multiple first screen information displayed on the second communication device 3 are each operable. Specifically, the first area 42 output to the second communication device 3 can be operated on the second communication device 3. The operated first screen information is then reflected on the first communication device 2 corresponding to that first screen information. This will be explained in more detail.

[0058] The operation information acquisition unit 50 acquires operation information indicating that the first area 42 has been operated. This operation information includes the operation ID and operation time, as described above. The operation information acquisition unit 50 then transmits this operation information and the image data of the first area 42 that has been changed by the operation to the operation receiving unit 8 of the first communication device 2. The operation receiving unit 8 then receives the operation information and the image data from the operation information acquisition unit 50. The operation receiving unit 8 transmits the operation information and the image data of the first area 42 to the pointing device driver 7. The pointing device driver 7 delivers the operation information and the image data of the first area 42 to the desktop 6 (OS), thereby updating the display content of the desktop 6. At this time, the pointing device driver 7 stores the operation information and the image data associated with the operation information in the device storage unit 5.

[0059] In this way, by manipulating the shared screen area 41, the manipulated shared screen area 41 is reflected on the desktop 6 of the first communication device 2. Therefore, multiple first screen information displayed on the second communication device 3 can each be manipulated on the second communication device 3, and the manipulated first screen information is reflected on the first communication device 2 corresponding to that first screen information.

[0060] As described above, the information processing device 1 of the second embodiment differs from the information processing device 1 of the first embodiment in that it has the following features.

[0061] The output control unit 30 outputs multiple first screen information so that it can be viewed in a list on the screen of the second communication device 3. This allows the instructor's PC terminal (second communication device 3) to view a list of screens (e.g., desktop 6) displayed on the student's PC terminal (first communication device 2). By allowing the instructor to see the operation status and desktop screens of multiple students' PC terminals at a glance, the instructor can more easily grasp the students' learning progress. Therefore, it becomes easier to identify students who are having trouble operating their terminals or who are falling behind in their studies. Thus, it becomes easier to identify learners who need support.

[0062] The output control unit 30 outputs all of the information from the multiple first screens so that it can be viewed in a list on the screen of the second communication device 3. This allows the instructor to grasp the learning status of all students. Therefore, it becomes easier to identify students who are falling behind. Consequently, it becomes easier to identify students who need follow-up.

[0063] The output control unit 30 outputs the third screen information displayed on the second communication device 3 to the screens of each of the multiple first communication devices 2. This allows the screen displayed on the instructor's PC terminal (= second communication device 3) to be shared with each student's PC terminal (= first communication device 2). By allowing the instructor to share the screen with students in real time while operating their own PC terminal, the instructor can effectively educate students. Furthermore, it allows for effective support for students who are having trouble operating their terminals or who are falling behind in their studies.

[0064] The output control unit 30 outputs multiple first screen information and third screen information so that they can be viewed in a list on the screen of the second communication device 3. This allows the instructor to have an overview of all students while sharing the content displayed on the instructor's own terminal (=second communication device 3) screen with the students. Because the instructor can conduct lectures using the screen sharing function while keeping track of the students' learning progress, they can educate the students more effectively.

[0065] Multiple pieces of information displayed on the second communication device 3 are individually operable, and the operable first screen information is reflected on the first communication device 2 corresponding to that first screen information. This allows the instructor to directly operate the student's PC terminal (=first communication device 2), making it easier for the instructor to support students who are having trouble operating the terminal or who are falling behind in their studies. As a result, the instructor can provide more effective education to the students.

[0066] [Third Embodiment] Figure 8 is a block diagram showing an overview of the information processing device 1 according to the third embodiment. Unlike the information processing device 1 according to the second embodiment, the information processing device 1 according to the third embodiment further includes a notification unit 60. Unlike the determination unit 20 according to the second embodiment, the determination unit 20 according to the third embodiment uses difference information relating to the difference between at least one of the second screen information and the second terminal operation information stored in advance and at least one of the multiple first screen information and the multiple first terminal operation information to determine whether a predetermined operation has been performed. The notification unit 60 notifies the second communication device 3 when the difference information meets a predetermined standard.

[0067] The second screen information is pre-stored in the memory unit 4. The second screen information includes, but is not limited to, text information and image information. The second screen information is information about the screen corresponding to a certain defined operation. For example, if the defined operation is "open a specific web page," then the "screen corresponding to the defined operation" is the screen on which that web page is displayed.

[0068] The second terminal operation information is pre-stored in the memory unit 4. The second terminal operation information is information related to certain predetermined device operations. Specifically, the second terminal operation information includes operations such as clicking on a URL or accessing a server.

[0069] (Difference information) In the third embodiment, the deviation score is used as the difference information. The deviation score is a value that indicates how much the device operation (second terminal operation information) is different from the device operation (first terminal operation information) that the student actually performs on the first communication device 2. As another example, the deviation score is a value that indicates how much the screen corresponding to the predetermined operation (second screen information) is different from the screen that the student actually displays on the first communication device 2 (first screen information). For example, the deviation score is the percentage of agreement between the text information of the screen that the instructor expects (intends) and the text information of the screen that the student actually displays on the first communication device 2.

[0070] When multiple participants actually operate the first communication device 2, the history of each operation is stored in the storage unit 4 in chronological order as first terminal operation information. In addition, desktop image data associated with each operation history is stored in the storage unit 4 in chronological order as first screen information. Note that the operation history and image data may also be stored in storage separate from the storage unit 4.

[0071] In the third embodiment, the determination unit 20 compares the second screen information and a plurality of first screen information with the second terminal operation information and a plurality of first terminal operation information (calculates difference information). The determination unit 20 compares the operation history of a plurality of first communication devices 2 (a plurality of first terminal operation information) stored in the storage unit 4 with predetermined operations as second terminal operation information (operations intended by the instructor) and calculates the degree of deviation. The determination unit 20 also compares the desktop image data of a plurality of first communication devices 2 (first screen information) stored in the storage unit 4 with the screen (desktop image data) corresponding to the predetermined operations (operations intended by the instructor) as second screen information and calculates the degree of deviation. When the degree of deviation (difference information) for both meets a predetermined standard, the notification unit 60 notifies the second communication device 3 of this fact. For example, when the degree of deviation for both exceeds a predetermined standard, the notification unit 60 notifies the second communication device 3 of a warning.

[0072] Examples of notification methods for the notification unit 60 include the following: • Change the frame and background color of area 42 in the first region. • Display a pop-up message on the second communication device 3. • Notifications will be sent to chats related to the web service and to social networking tools accessible to instructors. - The order of the thumbnails for each student displayed on the second communication device 3 is rearranged according to the calculated deviation score. Students with a high calculated deviation score will be prioritized on the second communication device 3 as students that the instructor has predicted will require further instruction.

[0073] (Example of operation of the third embodiment) Figure 9 shows a flowchart for calculating the degree of deviation. The data used as the criteria (comparison) for determining the degree of deviation are the assumed operation history (second terminal operation information) and the assumed desktop image data (second screen information) provided by the instructor.

[0074] Furthermore, the operation history and desktop image data of any participant (a model participant) of the first communication device 2 may be used as the second screen information and second terminal operation information. Alternatively, clusters to which many participants belong may be identified from the operation history and desktop images of all participants using techniques such as cluster partitioning, and these clusters may be used as the second screen information and second terminal operation information.

[0075] First, in step S101, the terminal information acquisition unit 10 acquires multiple first screen information and multiple first terminal operation information from multiple first communication devices 2 and stores them in the storage unit 4 in chronological order. The terminal information acquisition unit 10 acquires operation history data and desktop image data displayed on the PC terminals from multiple PC terminals (first communication devices 2) operated by the students, based on the operations of each student, and stores them in the storage unit 4 in chronological order.

[0076] Next, in step S102, the determination unit 20 performs feature extraction on the operation history data of the first communication device 2 and the desktop image data, respectively. As a method for extracting features from the operation history data, for example, features are extracted from the operation history data by determining the order in which specific operations appear or whether the target applications are included in the same group. As a method for extracting features from the desktop image data, for example, features are extracted such as the type of application displayed, the color tone of the displayed image, and the shape. Note that these are examples of feature extraction methods, and other feature extraction methods may be used.

[0077] In step S103, the determination unit 20 extracts features of the second screen information and the second terminal operation information. The feature extraction method is the same as described above.

[0078] In step S104, the decision unit 20 calculates the degree of deviation using the feature-extracted first screen information, first terminal operation information, second screen information, and second terminal operation information. The degree of deviation is calculated using, for example, rule-based calculation, statistical analysis methods such as the least squares method, or deep learning (neural network) trained on the correct data (second screen information and second terminal operation information) as a training model. In the third embodiment, there is no particular specification for the method of calculating the degree of deviation; any method that can calculate the degree of deviation may be used.

[0079] Figure 10 shows an example of calculating the degree of deviation using first terminal operation information and second terminal operation information. In Figure 10, the operation history of the first terminal operation information and second terminal operation information of the applications (AP) "KYOZAI1" and "KYOZAI2" is shown. For example, "OPTYPE=TAP" indicates an operation of clicking (tapping) a certain coordinate (POS=(50,1000)) on the desktop with a mouse or similar device.

[0080] In Figure 10, the operations performed when first operating "KYOZAI1" and then "KYOZAI2" are stored in the memory unit 4 as the operations expected by the instructor (second terminal operation information 14). The example of operations in the second terminal operation information 14 shows the operation history when the "KYOZAI1" application is first clicked (OPTYPE=TAP), then dragged (OPTYPE=DRAG) over a predetermined distance (ST (start point)=(0,0), ED (end point)=(100,100)), and then the "KYOZAI2" application is double-clicked (OPTYPE=DTAP).

[0081] As shown in Figure 10, the operation history of two students' PC terminals (first communication device 2) is stored in the storage unit 4 as first terminal operation information 13 (13a, 13b).

[0082] Figure 10 shows the operation history of a particular student, specifically the first terminal operation information 13a. In the first terminal operation information 13a, the student clicked the "KYOZAI1" application, dragged it a predetermined distance, and then double-clicked "KYOZAI2," which perfectly matches the operation expected by the instructor (second terminal operation information 14). In such cases, the judgment unit 20 compares the first terminal operation information 13a and the second terminal operation information 14 and calculates the degree of deviation (degree of deviation = 0%). The judgment unit 20 then compares the degree of deviation with a predetermined threshold and determines whether the specified operation (the operation expected by the instructor) was performed (in this case, the judgment unit 20 determines that the operation expected by the instructor was performed).

[0083] Figure 10 shows the operation history of a different student, specifically regarding the first terminal operation information 13b, compared to the example of the first terminal operation information 13a. In the first terminal operation information 13b, the student clicks the "KYOZAI1" application, drags it a predetermined distance, and then, as a subsequent operation, drags the "KYOZAI2" application again (see the underlined section in Figure 10). In this case, the first terminal operation information 13b does not partially match the operation expected by the instructor (second terminal operation information 14). In such cases, the judgment unit 20 compares the first terminal operation information 13b and the second terminal operation information 14 and calculates the degree of discrepancy.

[0084] The method for calculating the degree of discrepancy is arbitrary, but for example, the degree of discrepancy may be calculated using the agreement rate of the number of applications being operated. For example, if only one of the applications "KYOZAI1" and "KYOZAI2" is being operated, the agreement rate will be 50%. Alternatively, the degree of discrepancy may be calculated using the agreement rate of the operation commands associated with the applications (such as TAP, DRAG, and DTAP). For example, in the first terminal operation information 13b in the example of Figure 10, two of the three defined commands ("TAP" and "DRAG" for "KYOZAI1" and "DTAP" for "KYOZAI2") match, so the agreement rate is approximately 67%. Then, similar to the case of the first terminal operation information 13a, the determination unit 20 compares a predetermined threshold with the degree of deviation and determines whether or not the specified operation (the operation expected by the instructor) has been performed (in this case, the determination unit 20 determines that the operation expected by the instructor has not been performed).

[0085] Figure 11 shows an example of calculating the degree of deviation using the first screen information 11 and the third screen information 17. The determination unit 20 may determine whether a defined operation has been performed using difference information relating to the difference between the third screen information 17 displayed on the second communication device 3 and the multiple first screen information 11.

[0086] In the example shown in Figure 11, the application screen displayed on the desktop of the instructor's second communication device 3 (third screen information 17) and the application screen displayed on the desktop of the student's first communication device 2 (first screen information 11) are shown. The judgment unit 20 extracts the characteristics of the application screens displayed on each and calculates the degree of discrepancy.

[0087] In the example shown in Figure 11, the "Teaching Material Application 15" screen is displayed on both the display of the first communication device 2 and the display of the second communication device 3. However, the "Image of a Map of Japan 16" is displayed only on the display of the second communication device 3.

[0088] The judgment unit 20 first extracts the characteristics of the above screen. For example, the judgment unit 20 extracts the type of screen that is currently open. In the example in Figure 11, the judgment unit 20 extracts the screen of "educational application 15" and the screen of "image of a map of Japan 16" as third screen information 17. Furthermore, the judgment unit 20 extracts the screen of "educational application 15" as first screen information 11.

[0089] In the above case, the "image of a map of Japan 16," which is the screen the instructor has in mind, is not extracted from the first screen information 11. The judgment unit 20 calculates the degree of deviation using the information extracted above. In this case, since the first screen information 11 only displays one of the two screens the instructor has in mind (the teaching material application 15 and the image of a map of Japan 16), the judgment unit 20 may calculate the degree of deviation as 50%.

[0090] Furthermore, if an application unrelated to the lesson (such as a game) is displayed on the display of the student's first communication device 2, and the determination unit 20 extracts the screen of that application, it may be determined that the degree of discrepancy is large.

[0091] Furthermore, after extracting the features of the screen described above, the judgment unit 20 may extract the features of the screen in more detail. Specifically, for example, from the educational application screen, it may extract feature points such as the shape and order of characters if it is a text image, the shape if it is a graphic image, or the bitmap image if it is a photograph. The distance between these feature points may then be calculated to calculate the degree of deviation. As for how to calculate the degree of deviation, for example, if the text information is a perfect match, the degree of deviation is calculated as 0%, and if the number of graphic images is half a match, the degree of deviation is calculated as 50%, and so on.

[0092] Returning to Figure 9, after calculating the degree of deviation in step S104, the process proceeds to step S111. In step S111, if the calculated degree of deviation is below the threshold (NO in step S111), the process is terminated. For example, if the threshold for the degree of deviation between the first terminal operation information and the second terminal operation information is 70%, and the threshold for the degree of deviation between the first screen information and the third screen information is 70%, the process will be terminated if either threshold is not met. In the above example (Figures 10 and 11), the degree of deviation between the first terminal operation information 13b and the second terminal operation information 14 is 67%, and the degree of deviation between the first screen information 11 and the third screen information 17 is 50%, so the process is terminated.

[0093] If the calculated deviation is above a threshold (YES in step S111), in step S121, the notification unit 60 notifies the second communication device 3. Specifically, a pop-up is displayed on the display of the second communication device 3 on the instructor's PC terminal (second communication device 3) indicating that there is a student who is behind in their studies, having trouble operating the terminal, or otherwise struggling with the learning process.

[0094] After the notification unit 60 detects a student whose deviation level exceeds a threshold and notifies the second communication device 3, the instructor needs to provide guidance on operations, etc., to that student. This instructional support mechanism will now be explained.

[0095] The determination unit 20 according to the third embodiment identifies the first first communication device 2 and the second first communication device 2 using at least one of a plurality of first screen information and a plurality of first terminal operation information.

[0096] In the third embodiment, the first communication device 2 is the first communication device 2 of a student whose deviation is below a threshold, who is not behind in their studies, and who is not having trouble operating the terminal. The second first communication device 2 is the first communication device 2 of a student whose deviation is above a threshold, who is behind in their studies or is having trouble operating the terminal.

[0097] Furthermore, the determination unit 20 may output at least one of the first screen information and the first terminal operation information of the first communication device 2 to the screen of the second first communication device 2. In other words, the determination unit 20 may output the screen and operation history of the first communication device 2 of a student who is progressing well in their learning (a model student) to the display of the first communication device 2 of a student who is lagging behind in their learning.

[0098] Furthermore, as explained in Figures 5 and 7, the first screen information 11 displayed in the first area 42 can be operated on the instructor's second communication device 3. Therefore, by directly operating the first screen information 11 displayed in the first area 42 on the second communication device 3, which corresponds to the first communication device 2 of a student who is falling behind, the instructor can effectively follow up with the student who is falling behind.

[0099] Furthermore, the third screen information displayed on the instructor's PC terminal (second communication device 3) can be shared with all students, allowing for effective instruction to be provided to students using this screen sharing function.

[0100] Alternatively, operation history corresponding to the operation expected by the instructor may be extracted from the operation history (first terminal operation information) stored in the memory unit 4, and the desktop image (first screen information) corresponding to the extracted operation history may be extracted from the memory unit 4 and converted into a video (a simple video such as a time lapse may also be used). The converted first screen information may then be output to the first area 42 corresponding to the first communication device 2 of the student who is behind in their learning. This allows the student who is behind in their learning to view exemplary operations of the student who is ahead in their learning on their first communication device 2.

[0101] In the third embodiment, the notification unit 60 notifies the second communication device 3 if the calculated deviation is equal to or greater than a threshold, and when notifying, it may also notify that the student who is falling behind in their studies needs assistance.

[0102] Examples of notifications related to the subsidy include the following variations: • Notify if the degree of deviation exceeds a predetermined threshold. • Specify the timing of notifications in advance (for example, if the deviation exceeds a predetermined threshold, send a notification a certain amount of time after the deviation is calculated). • The past deviation scores of each student are stored in memory unit 4. Students with consistently high deviation scores are notified earlier, while students with consistently low deviation scores are notified later.

[0103] As described above, the information processing device 1 according to the third embodiment differs from the information processing device 1 according to the second embodiment in that it has the following features.

[0104] The determination unit 20 according to the third embodiment determines whether a specified operation has been performed using difference information relating to the difference between at least one of the second screen information and the second terminal operation information, which is stored in advance, and at least one of the first screen information and the first terminal operation information.

[0105] This allows instructors to accurately verify whether students are operating the PC terminal (first communication device 2) as intended, based on the screen history (first screen information) and the operation history (first terminal information) of the PC terminal operated by the students. Therefore, it is possible to accurately identify students who are having difficulty operating the terminal or who are falling behind in their learning. This allows instructors to accurately identify learners who require further support.

[0106] In the third embodiment, the determination unit 20 may determine whether a predetermined operation has been performed using difference information relating to the difference between the third screen information displayed on the second communication device 3 and a plurality of first screen information. This allows the instructor to accurately confirm whether the student is operating the PC terminal (second communication device 3) as intended by the instructor, using the screen information (third screen information) of the PC terminal (second communication device 3) being operated in real time.

[0107] The notification unit 60 notifies the second communication device 3 when the difference meets a predetermined standard. This allows the instructor to immediately notice if a student is having trouble operating the terminal or is falling behind in their studies, and to provide support to that student. As a result, the effectiveness of the students' learning improves.

[0108] The determination unit 20 identifies the first first communication device 2 and the second first communication device 2 using at least one of the multiple first screen information and the multiple first terminal operation information. This makes it possible to identify students who are progressing well in their learning and students who are progressing poorly in their learning.

[0109] Furthermore, the determination unit 20 causes at least one of the first screen information and the first terminal operation information of the first communication device 2 to be output to the screen of the second first communication device 2. By displaying the terminal screen of a student with a high level of learning progress on the terminal screen of a student with a low level of learning progress, the student with a low level of learning progress can be taught the operation procedures of the student with a high level of learning progress.

[0110] [Fourth Embodiment] The information processing device 1 according to the fourth embodiment has almost the same configuration as the information processing device 1 according to the first embodiment shown in Figure 1, but the function of the terminal information acquisition unit 10 is different. The terminal information acquisition unit 10 according to the fourth embodiment adjusts at least one of the resolution of the first screen information to be acquired and the communication frequency with the first communication device 2 using the determination result of the determination unit 20.

[0111] The terminal information acquisition unit 10 can reduce the amount of communication between the information processing device 1 and the first communication device 2 by adjusting the resolution of the first screen information to be acquired and the communication frequency with the first communication device 2. As a result, even if the network bandwidth on the first communication device 2 side is narrow, the information processing device 1 and the first communication device 2 can communicate stably. Therefore, it is possible to prevent students from losing the opportunity to attend lectures.

[0112] For example, students who have completed the assigned tasks require less instruction from the instructor and do not need a high-resolution desktop image. Therefore, for students who have completed the assigned tasks, there is little problem in communicating with a lower resolution of the first screen information. By using the judgment result of the judgment unit 20 (the result that the specified operation has been performed), the amount of communication between the information processing device 1 and the first communication device 2 can be effectively reduced.

[0113] On the other hand, for example, for students who require instruction, it is necessary to increase the communication frequency between the information processing device 1 and the first communication device 2, as well as the resolution of the first screen information, in order to properly carry out the instruction. By using the judgment result of the judgment unit 20 (the result that the specified operation has not been performed), the communication frequency between the information processing device 1 and the first communication device 2, as well as the resolution of the first screen information, can be increased, enabling effective instruction.

[0114] [Other forms] Although the information processing device 1 according to this embodiment has been described as being used in online distance learning and lectures at schools, cram schools, and other educational institutions, the information processing device 1 according to this embodiment can also be used when a coach in the sports field provides online education (practical instruction) to an athlete.

[0115] Furthermore, in the field of computer and various equipment maintenance services, the information processing device 1 according to this embodiment can also be used when a customer engineer receives online training (instruction) from a head office technician via a PC terminal (first communication device 2) that they bring to the customer's site. In such a case, the judgment unit 20 determines whether the customer engineer is having trouble operating the terminal at the site, and the head office technician, who is the administrator of the second communication device 3, can use the second communication device 3 to directly instruct the customer engineer on how to operate it.

[0116] Furthermore, the information processing device 1 according to this embodiment can also be used when providing online instruction to store employees in convenience stores, apparel shops, etc., on how to operate POS terminals and other equipment, or when providing online instruction to factory workers, etc., on how to operate edge devices.

[0117] The first communication device 2 may be a wearable device such as smart glasses or smart gloves. If the first communication device 2 is smart glasses, data such as image information of objects viewed through the smart glasses can be acquired, and this data can be used to identify learners who are not performing the expected operations.

[0118] If the first communication device 2 is a smart glove, it can acquire pre-specified device operation history data and use this data to identify students who are not operating the device correctly. This enables real-time online practical instruction.

[0119] The embodiments of the present invention have been described above with reference to the drawings, but these are merely examples of the present invention, and various other configurations can also be adopted.

[0120] Furthermore, while the flowcharts used in the above description show multiple steps (processes) in sequence, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content. Also, the above embodiments can be combined to the extent that their content is not contradictory.

[0121] Some or all of the above embodiments may also be described as follows, but are not limited to the following: 1. An information processing device used for online education, together with multiple first communication devices and second communication devices, Terminal information acquisition means for acquiring at least one of the first screen information displayed on the plurality of first communication devices and first terminal operation information relating to the operation of the plurality of first communication devices, An information processing apparatus comprising: determination means for determining whether a predetermined operation has been performed for each of the plurality of first communication devices using at least one of the plurality of first screen information and the plurality of first terminal operation information. 2. In the information processing device described in 1., The determination means is an information processing device that determines whether or not the predetermined operation has been performed using difference information relating to the difference between at least one of the second screen information and the second terminal operation information stored in advance and at least one of the plurality of first screen information and the plurality of first terminal operation information. 3. In the information processing device described in 1. or 2., The determination means is an information processing device that determines whether or not the predetermined operation has been performed using difference information relating to the difference between the third screen information displayed on the second communication device and a plurality of the first screen information. 4. In the information processing device described in 2. or 3., An information processing device further comprising a notification means for notifying the second communication device when the differential information meets a predetermined standard. 5. In the information processing device described in any one of items 1 to 4, The determination means identifies the first first communication device and the second first communication device using at least one of the plurality of first screen information and the plurality of first terminal operation information. The determination means is an information processing device that causes at least one of the first screen information of the first communication device and the first terminal operation information to be output to the screen of the second first communication device. 6. In the information processing device described in any one of items 1 to 5, An information processing device further comprising output control means for outputting multiple first screen information items so that they can be viewed in a list on the screen of the second communication device. In the information processing device described in 7.6, The output control means is an information processing device that outputs all of the multiple first screen information so that they can be viewed on the screen of the second communication device. 8. In the information processing device described in 6. or 7., The output control means is an information processing device that causes the third screen information displayed on the second communication device to be output to the screens of each of the multiple first communication devices. In the information processing device described in 9.8, The output control means is an information processing device that outputs a plurality of first screen information and third screen information so that they can be viewed in a list on the screen of the second communication device. 10. In the information processing device described in any one of items 6 to 9, Each of the multiple pieces of information on the first screen displayed on the second communication device is operable, An information processing device in which the manipulated first screen information is reflected on a first communication device corresponding to the first screen information. 11. In the information processing device described in any one of items 1 to 10, The terminal information acquisition means is an information processing device that uses the determination result of the determination means to adjust at least one of the resolution of the first screen information to be acquired and the communication frequency with the first communication device. 12. A computer that, together with multiple first and second communication devices, realizes an information processing device used for online education, The system acquires at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. An information processing method that determines whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information. 13. In the information processing method described in 12., An information processing method that determines whether or not a predetermined operation has been performed, using difference information relating to the difference between at least one of pre-stored second screen information and second terminal operation information and at least one of a plurality of first screen information and a plurality of first terminal operation information. 14. In the information processing method described in 12. or 13., An information processing method that determines whether or not the predetermined operation has been performed, using difference information relating to the difference between the third screen information displayed on the second communication device and a plurality of the first screen information. 15. In the information processing method described in 13. or 14., An information processing method that notifies the second communication device when the differential information meets a predetermined standard. 16. In the information processing method described in any one of items 12 to 15, Using at least one of the multiple first screen information and the multiple first terminal operation information, the first first communication device and the second first communication device are identified. An information processing method that causes at least one of the first screen information and the first terminal operation information of the first communication device to be output to the screen of the second first communication device. 17. In the information processing method described in any one of items 12 to 16, An information processing method for outputting multiple pieces of the first screen information so that they can be viewed in a list on the screen of the second communication device. 18. In the information processing method described in 17, An information processing method that outputs all of the multiple first screen information so that they can be viewed in a list on the screen of the second communication device. 19. In the information processing method described in 17. or 18., An information processing method for outputting third screen information displayed on the second communication device to the respective screens of multiple first communication devices. 20. In the information processing method described in 19., An information processing method that outputs multiple first screen information and third screen information so that they can be viewed in a list on the screen of the second communication device. 21. In the information processing method described in any one of items 17 to 20, Each of the multiple pieces of information on the first screen displayed on the second communication device is operable, An information processing method wherein the manipulated first screen information is reflected on a first communication device corresponding to the first screen information. 22. In the information processing method described in any one of items 12 to 21, An information processing method that uses the result of determining whether or not the aforementioned predetermined operation has been performed to adjust at least one of the resolution of the first screen information to be acquired and the communication frequency with the first communication device. 23. A computer that, together with multiple first and second communication devices, realizes an information processing device used for online education. A procedure for acquiring at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. A program for causing a procedure to perform a procedure for determining whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information. 24. In the program described in 23., A program for causing a procedure to execute a procedure for determining whether a predetermined operation has been performed, using difference information relating to the difference between at least one of pre-stored second screen information and second terminal operation information and at least one of a plurality of first screen information and a plurality of first terminal operation information. 25. In the program described in 23. or 24., A program for causing a procedure to determine whether or not a predetermined operation has been performed, using difference information relating to the difference between the third screen information displayed on the second communication device and a plurality of the first screen information. 26. In the program described in 24. or 25., A program for causing a procedure to execute a procedure for notifying the second communication device when the differential information meets a predetermined standard. 27. In any one of the programs described in items 23 to 26, A procedure for identifying a first communication device and a second first communication device using at least one of a plurality of first screen information and a plurality of first terminal operation information, A program for causing a procedure to output at least one of the first screen information and the first terminal operation information of the first communication device to the screen of the second first communication device. 28. In any one of the programs described in items 23 to 27, A program for performing a procedure to output multiple pieces of the first screen information so that they can be viewed in a list on the screen of the second communication device. 29. In the program described in 28., A program for executing a procedure to output all of the multiple first screen information so that they can be viewed in a list on the screen of the second communication device. 30. In the program described in 28. or 29., A program for causing a procedure to output the third screen information displayed on the second communication device to the respective screens of multiple first communication devices. 31. In the program described in 30., A program for performing a procedure to output multiple first screen information and third screen information so that they can be viewed in a list on the screen of the second communication device. 32. In any one of the programs described in items 28 to 31, Each of the multiple pieces of information on the first screen displayed on the second communication device is operable, A program in which the manipulated first screen information is reflected on the first communication device corresponding to the first screen information. 33. In any one of the programs described in items 23 to 32, A program for causing a program to perform a procedure to adjust at least one of the resolution of the first screen information to be acquired and the communication frequency with the first communication device, using the result of determining whether or not the aforementioned predetermined operation has been performed. 34. A recording medium on which any one of the programs described in items 23 to 33 is recorded. [Explanation of symbols]

[0122] 1. Information Processing Device 2. First communication device 3. Second communication device 4 Storage section 5. Device Storage Unit 10 Terminal Information Acquisition Unit 11 1st screen information 13. First Terminal Operation Information 14. Second Terminal Operation Information 17 Third screen information 20 Judgment Department 30 Output control unit 40 Shared screen area generation section 41 Shared screen area 42 First area 43 Second area 50 Operation information acquisition section 60 Notification Department

Claims

1. An information processing device used for online education, together with multiple first communication devices and second communication devices, Terminal information acquisition means for acquiring at least one of the first screen information displayed on the plurality of first communication devices and first terminal operation information relating to the operation of the plurality of first communication devices, The system includes a determination means that determines whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information. The determination means is an information processing device that determines whether or not the predetermined operation has been performed using difference information relating to the difference between the third screen information displayed on the second communication device and a plurality of the first screen information.

2. In the information processing apparatus according to claim 1, The determination means is an information processing device that determines whether or not the predetermined operation has been performed using difference information relating to the difference between at least one of the second screen information and the second terminal operation information stored in advance and at least one of the plurality of first screen information and the plurality of first terminal operation information.

3. In the information processing apparatus according to claim 2, An information processing device further comprising a notification means for notifying the second communication device when the differential information meets a predetermined standard.

4. An information processing device used for online education, together with a plurality of first communication devices and a second communication device, Terminal information acquisition means for acquiring at least one of the first screen information displayed on the plurality of first communication devices and first terminal operation information relating to the operation of the plurality of first communication devices, The system includes a determination means that determines whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information. The determination means identifies the first first communication device and the second first communication device using at least one of the plurality of first screen information and the plurality of first terminal operation information. The determination means is an information processing device that causes at least one of the first screen information and the first terminal operation information of the first communication device to be output to the screen of the second first communication device.

5. In the information processing apparatus according to claim 1 or 2, An information processing apparatus further comprising output control means for outputting multiple first screen information so that it can be viewed in a list on the screen of the second communication device.

6. In the information processing apparatus according to claim 5, Each of the multiple pieces of information on the first screen displayed on the second communication device is operable, An information processing device in which the manipulated first screen information is reflected on a first communication device corresponding to the first screen information.

7. An information processing device used for online education, together with a plurality of first communication devices and a second communication device, Terminal information acquisition means for acquiring at least one of the first screen information displayed on the plurality of first communication devices and first terminal operation information relating to the operation of the plurality of first communication devices, The system includes a determination means that determines whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information. The terminal information acquisition means is an information processing device that uses the determination result of the determination means to adjust at least one of the resolution of the first screen information to be acquired and the communication frequency with the first communication device.

8. A computer that realizes an information processing device used for online education, together with multiple first and second communication devices, The system acquires at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. An information processing method that uses at least one of the multiple first screen information and the multiple first terminal operation information to determine whether a predetermined operation has been performed for each of the multiple first communication devices, using difference information relating to the difference between the third screen information displayed on the second communication device and the multiple first screen information.

9. A computer that, together with multiple first and second communication devices, realizes an information processing device used for online education, A procedure for acquiring at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. A program for executing a procedure that uses at least one of the multiple first screen information and the multiple first terminal operation information to determine whether a predetermined operation has been performed for each of the multiple first communication devices, using difference information relating to the difference between the third screen information displayed on the second communication device and the multiple first screen information.

10. A computer that realizes an information processing device used for online education, together with a plurality of first communication devices and a second communication device, The system acquires at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. Using at least one of the multiple first screen information and the multiple first terminal operation information, it is determined whether a predetermined operation has been performed for each of the multiple first communication devices. Using at least one of the multiple first screen information and the multiple first terminal operation information, the first first communication device and the second first communication device are identified. An information processing method for outputting at least one of the first screen information and the first terminal operation information of the first communication device to the screen of the second first communication device.

11. A computer that realizes an information processing device used for online education, together with a plurality of first communication devices and a second communication device, A procedure for acquiring at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. A procedure for determining whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information. A procedure for identifying a first communication device and a second communication device using at least one of a plurality of first screen information and a plurality of first terminal operation information, A program for causing a procedure to output at least one of the first screen information and the first terminal operation information of the first communication device to the screen of the second first communication device.

12. A computer that realizes an information processing device used for online education, together with a plurality of first communication devices and a second communication device, The system acquires at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. Using at least one of the multiple first screen information and the multiple first terminal operation information, it is determined whether a predetermined operation has been performed for each of the multiple first communication devices. An information processing method that uses the result of the aforementioned determination to adjust at least one of the resolution of the first screen information to be acquired and the communication frequency with the first communication device.

13. A computer that realizes an information processing device used for online education, together with a plurality of first communication devices and a second communication device, A procedure for acquiring at least one of the first screen information displayed on the plurality of first communication devices and the first terminal operation information relating to the operation of the plurality of first communication devices. A procedure for determining whether a predetermined operation has been performed for each of the multiple first communication devices, using at least one of the multiple first screen information and the multiple first terminal operation information. A program for causing a procedure to perform a step of adjusting at least one of the resolution of the first screen information to be acquired and the communication frequency with the first communication device, using the result of the aforementioned determination.

Images