Educational support device, communication system, program, and educational support method

Abstract

To let students realize the feel of being receiving group education.SOLUTION: An education support device configured to support online education conducted by connecting, via a network, respective terminal devices used by an instructor U0 and a plurality of students who are present in spaces separated from each other, The education support device comprises: a communication unit configured to communicate via the network; and a control unit configured to receive, through the communication unit, a plurality of individual images including an image of the instructor U0 and an image of a second student U2 different from a first student U1 among the plurality of students, and generate, using the received plurality of individual images, a composite image representing the second student U2 as being present in the same space as the instructor U0, and control a terminal device used by the first student U1 to display the generated composite image.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present disclosure relates to an education support device, a communication system, a program, and an education support method.

Background Art

[0002] Patent Document 1 discloses an education support device that assists a teacher in educating students in a remote location while using a screen displayed by a computer.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventional devices do not display a student video screen on the terminal operated by the student, but only display the teacher video screen. Therefore, it is difficult for the student to feel that they are receiving guidance from the teacher together with other students. That is, the student cannot actually feel that they are receiving group education.

[0005] An object of the present disclosure is to enable a student to actually feel that they are receiving group education.

Means for Solving the Problems

[0006] The education support device according to the present disclosure is an education support device that supports online education implemented by connecting terminal devices used by a teacher and a plurality of students in spaces separated from each other via a network, a communication unit that communicates via the network, A control unit that receives a plurality of individual images including an image of the teacher and an image of a second student different from a first student among the plurality of students via the communication unit, and uses the received plurality of individual images to generate a composite image representing a state where the second student is in the same space as the teacher, and causes the composite image to be displayed on a terminal device used by the first student is provided.

[0007] The program according to the present disclosure is a computer that supports online education implemented by connecting terminal devices used by a teacher and a plurality of students in spaces separated from each other via a network, receives a plurality of individual images including an image of the teacher and an image of a second student different from a first student among the plurality of students via the network, generates a composite image representing a state where the second student is in the same space as the teacher using the received plurality of individual images, and causes the generated composite image to be displayed on a terminal device used by the first student to execute operations including.

[0008] The education support method according to the present disclosure is an education support method for supporting online education implemented by connecting terminal devices used by a teacher and a plurality of students in spaces separated from each other via a network, receives a plurality of individual images including an image of the teacher and an image of a second student different from a first student among the plurality of students via the network, generates a composite image representing a state where the second student is in the same space as the teacher using the received plurality of individual images, and causes the generated composite image to be displayed on a terminal device used by the first student including.

Advantages of the Invention

[0009] According to the present disclosure, a student can feel as if they are receiving group education.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Best Mode for Carrying Out the Invention

[0011] Hereinafter, some embodiments of the present disclosure will be described with reference to the drawings.

[0012] In each figure, the same or corresponding parts are denoted by the same reference numerals. In the description of each embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate.

[0013] With reference to FIG. 1, the configuration of a communication system 10 according to an embodiment of the present disclosure will be described.

[0014] The communication system 10 includes a server device 20, a first terminal device 30, and a plurality of second terminal devices 40. The server device 20 can communicate with the first terminal device 30 and the plurality of second terminal devices 40 via a network 50. The first terminal device 30 may be able to communicate with the plurality of second terminal devices 40 via the network 50.

[0015] The server device 20 is installed in a facility such as a data center and is operated by a service provider. The server device 20 is a server computer belonging to a cloud computing system or other computing system.

[0016] The first terminal device 30 and the plurality of second terminal devices 40 are terminal devices used by a lecturer U0 and a plurality of students in separated spaces, respectively. The number of students is three in this embodiment, but may be any number of two or more. The number of the second terminal devices 40 is also three in this embodiment, but may be changed according to the number of students. The first terminal device 30 and the plurality of second terminal devices 40 are each, for example, a general-purpose computer such as a PC, a dedicated computer specialized for specific calculations, or a mobile device such as a mobile phone, a smartphone, or a tablet. "PC" is an abbreviation for personal computer.

[0017] Network 50 includes the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. Network 50 may include at least one wireless network, at least one optical network, or any combination thereof. The wireless network is, for example, an ad hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.

[0018] Referring to FIG. 1, the outline of this embodiment will be described.

[0019] Each second terminal device 40 is an education support device that supports online education. The online education is implemented with the first terminal device 30 and a plurality of second terminal devices 40 connected via the network 50. The second terminal device 40 used by the first student U1 among the plurality of students receives a plurality of individual images P1 including the image H0 of the instructor U0 and the image H2 of the second student U2 different from the first student U1 among the plurality of students via the network 50. The second terminal device 40 used by the first student U1 generates a composite image M1 representing that the second student U2 is in the same space as the instructor U0 using the received plurality of individual images P1. The second terminal device 40 used by the first student U1 causes the generated composite image M1 to be displayed on the second terminal device 40 used by the first student U1.

[0020] According to this embodiment, since an image representing that the second student U2 is in the same space as the instructor U0 is displayed on the second terminal device 40 used by the first student U1, the first student U1 can easily get the feeling of receiving the guidance of the instructor U0 together with the second student U2. That is, the first student U1 can actually feel that he / she is receiving group education.

[0021] In this embodiment, the plurality of individual images P1 further includes an image H3 of a third student U3 who is different from the first student U1 and also different from the second student U2 among the plurality of students. The second terminal device 40 used by the first student U1 generates, as a composite image M1, an image representing a state where the second student U2 and the third student U3 are in the same space as the instructor U0.

[0022] According to this embodiment, since an image representing a state where the second student U2 and the third student U3 are in the same space as the instructor U0 is displayed on the second terminal device 40 used by the first student U1, the first student U1 can easily get the feeling of receiving guidance from the instructor U0 together with the second student U2 and the third student U3. That is, the first student U1 can strongly feel that he / she is receiving group education.

[0023] Similar to the second terminal device 40 used by the first student U1, the second terminal device 40 used by the second student U2 also receives, via the network 50, a plurality of individual images P2 including an image H0 of the instructor U0, an image H1 of the first student U1, and an image H3 of the third student U3. The second terminal device 40 used by the second student U2 generates, using the received plurality of individual images P2, a composite image M2 representing a state where the first student U1 and the third student U3 are in the same space as the instructor U0. The second terminal device 40 used by the second student U2 causes the generated composite image M2 to be displayed on the second terminal device 40 used by the second student U2.

[0024] According to this embodiment, since an image representing a state where the first student U1 and the third student U3 are in the same space as the instructor U0 is displayed on the second terminal device 40 used by the second student U2, the second student U2 can easily get the feeling of receiving guidance from the instructor U0 together with the first student U1 and the third student U3. That is, the second student U2 can also strongly feel that he / she is receiving group education.

[0025] Similar to the second terminal device 40 used by the first student U1 and the second student U2, the second terminal device 40 used by the third student U3 also receives a plurality of individual images P3 including the image H0 of the instructor U0, the image H1 of the first student U1, and the image H2 of the second student U2 via the network 50. The second terminal device 40 used by the third student U3 generates a composite image M3 representing the state where the first student U1 and the second student U2 are in the same space as the instructor U0 using the received plurality of individual images P3. The second terminal device 40 used by the third student U3 causes the composite image M3 generated to be displayed on the second terminal device 40 used by the third student U3.

[0026] According to the present embodiment, since an image representing the state where the first student U1 and the second student U2 are in the same space as the instructor U0 is displayed on the second terminal device 40 used by the third student U3, it is easy for the third student U3 to feel as if they are receiving guidance from the instructor U0 together with the first student U1 and the second student U2. That is, the third student U3 can strongly feel that they are also receiving group education.

[0027] Referring to FIG. 2, the configuration of the first terminal device 30 according to the present embodiment will be described.

[0028] The first terminal device 30 includes a control unit 31, a storage unit 32, a communication unit 33, an input unit 34, and an output unit 35.

[0029] The control unit 31 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for specific processing. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphics processing unit. The programmable circuit is, for example, an FPGA. "FPGA" is an abbreviation for field-programmable gate array. The dedicated circuit is, for example, an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. While controlling each part of the first terminal device 30, the control unit 31 executes processes related to the operation of the first terminal device 30.

[0030] The storage unit 32 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a RAM, ROM, or flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. The RAM is, for example, an SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. The ROM is, for example, an EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. The flash memory is, for example, an SSD. "SSD" is an abbreviation for solid-state drive. The magnetic memory is, for example, an HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 32 functions as, for example, a main memory device, an auxiliary storage device, or a cache memory. In the storage unit 32, data used for the operation of the first terminal device 30 and data obtained by the operation of the first terminal device 30 are stored.

[0031] The communication unit 33 includes at least one communication interface. The communication interface is, for example, an interface compatible with a wired LAN communication standard such as Ethernet (registered trademark), a wireless LAN communication standard such as IEEE 802.11, or an interface compatible with a mobile communication standard such as LTE, 4G standard, or 5G standard. "IEEE" is an abbreviation for Institute of Electrical and Electronics Engineers. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation. "5G" is an abbreviation for 5th generation. The communication unit 33 communicates with the server device 20. The communication unit 33 may communicate with a plurality of second terminal devices 40. The communication unit 33 receives data used for the operation of the first terminal device 30 and transmits data obtained by the operation of the first terminal device 30.

[0032] The input unit 34 includes at least one input interface. The input interface is, for example, a physical key, a capacitive key, a pointing device, a touch screen provided integrally with a display, a camera, LiDAR, or a microphone. "LiDAR" is an abbreviation for light detection and ranging. The camera is, for example, an RGB camera or a combination of an RGB camera and a depth camera. The input unit 34 accepts an operation of inputting data used for the operation of the first terminal device 30. Instead of being provided in the first terminal device 30, the input unit 34 may be connected to the first terminal device 30 as an external input device. As the connection interface, an interface compatible with a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0033] The output unit 35 includes at least one output interface. The output interface is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electro luminescent. The output unit 35 outputs data obtained by the operation of the first terminal device 30. Instead of being provided in the first terminal device 30, the output unit 35 may be connected to the first terminal device 30 as an external output device. As the connection interface, an interface compliant with a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0034] The functions of the first terminal device 30 are realized by executing the program according to the present embodiment on a processor as the control unit 31. That is, the functions of the first terminal device 30 are realized by software. The program causes a computer to execute the operations of the first terminal device 30, thereby making the computer function as the first terminal device 30. That is, the computer functions as the first terminal device 30 by executing the operations of the first terminal device 30 according to the program.

[0035] The program can be stored in a non-transitory computer-readable medium. The non-transitory computer-readable medium is, for example, a flash memory, a magnetic recording device, an optical disk, a magneto-optical recording medium, or a ROM. The distribution of the program is performed, for example, by selling, transferring, or lending a portable medium such as an SD card storing the program, a DVD, or a CD-ROM. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program may be stored in the server storage and transferred from the server to other computers to distribute the program. The program may be provided as a program product.

[0036] The computer stores, once, a program stored in a portable medium or a program transferred from a server in the main memory device, for example. Then, the computer reads the program stored in the main memory device by the processor and executes processing according to the read program by the processor. The computer may directly read the program from the portable medium and execute processing according to the program. The computer may sequentially execute processing according to the received program each time a program is transferred from the server to the computer. The processing may be executed by a so-called ASP type service that realizes functions only by execution instructions and result acquisition without transferring the program from the server to the computer. "ASP" is an abbreviation for application service provider. The program includes information for use in processing by an electronic computer and things equivalent to the program. For example, data that is not a direct instruction to the computer but has a property of defining the processing of the computer corresponds to "things equivalent to the program".

[0037] Some or all of the functions of the first terminal device 30 may be realized by a programmable circuit or a dedicated circuit as the control unit 31. That is, some or all of the functions of the first terminal device 30 may be realized by hardware.

[0038] With reference to FIG. 3, the configuration of each second terminal device 40 according to the present embodiment will be described.

[0039] The second terminal device 40 includes a control unit 41, a storage unit 42, a communication unit 43, an input unit 44, and an output unit 45.

[0040] The control unit 41 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for specific processing. The programmable circuit is, for example, an FPGA. The dedicated circuit is, for example, an ASIC. While controlling each part of the second terminal device 40, the control unit 41 executes processing related to the operation of the second terminal device 40.

[0041] The storage unit 42 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a RAM, ROM, or flash memory. The RAM is, for example, an SRAM or DRAM. The ROM is, for example, an EEPROM. The flash memory is, for example, an SSD. The magnetic memory is, for example, an HDD. The storage unit 42 functions as, for example, a main memory device, an auxiliary storage device, or a cache memory. Data used for the operation of the second terminal device 40 and data obtained by the operation of the second terminal device 40 are stored in the storage unit 42.

[0042] The communication unit 43 includes at least one communication interface. The communication interface is, for example, an interface corresponding to a wired LAN communication standard such as Ethernet (registered trademark), a wireless LAN communication standard such as IEEE802.11, or an interface corresponding to a mobile communication standard such as LTE, 4G standard, or 5G standard. The communication unit 43 communicates with the server device 20. The communication unit 43 may communicate with the first terminal device 30. The communication unit 43 receives data used for the operation of the second terminal device 40 and transmits data obtained by the operation of the second terminal device 40.

[0043] The input unit 44 includes at least one input interface. The input interface is, for example, a physical key, a capacitive key, a pointing device, a touch screen provided integrally with a display, a camera, LiDAR, or a microphone. The camera is, for example, an RGB camera or a combination of an RGB camera and a depth camera. The input unit 44 receives an operation of inputting data used for the operation of the second terminal device 40. Instead of being provided in the second terminal device 40, the input unit 44 may be connected to the second terminal device 40 as an external input device. As the connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0044] The output unit 45 includes at least one output interface. The output interface is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. The output unit 45 outputs data obtained by the operation of the second terminal device 40. Instead of being provided in the second terminal device 40, the output unit 45 may be connected to the second terminal device 40 as an external output device. As the connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0045] The functions of the second terminal device 40 are realized by a processor as the control unit 41 executing another program according to this embodiment. That is, the functions of the second terminal device 40 are realized by software. The program causes a computer to execute the operations of the second terminal device 40, thereby causing the computer to function as the second terminal device 40. That is, the computer functions as the second terminal device 40 by executing the operations of the second terminal device 40 according to the program.

[0046] Some or all of the functions of the second terminal device 40 may be realized by a programmable circuit or a dedicated circuit as the control unit 41. That is, some or all of the functions of the second terminal device 40 may be realized by hardware.

[0047] Referring to FIG. 4, the functions of the second terminal device 40 used by the first student U1 will be described. Since the functions of the second terminal device 40 used by the second student U2 and the third student U3 are the same as those of the second terminal device 40 used by the first student U1, the description thereof will be omitted.

[0048] The control unit 41 of the second terminal device 40 receives the image H0 of the instructor U0, the image H2 of the second student U2, and the image H3 of the third student U3 via the communication unit 43. The control unit 41 displays the received image H0 on the display as the output unit 45 so that the instructor U0 is displayed at the center of the screen. The control unit 41 stores the received images H2 and H3 in the storage unit 42. When the control unit 41 determines that there is free space at both ends of the screen, the control unit 41 synthesizes the images H2 and H3 stored in the storage unit 42 with the displayed image H0 so that the second student U2 is displayed at one end of the screen and the third student U3 is displayed at the other end of the screen, and displays an image as shown in FIG. 5 on the display. In this image, since the instructor U0 is facing forward, it feels as if the instructor U0 is looking at the students, and since the second student U2 and the third student U3 are facing backward, it feels as if the second student U2 and the third student U3 are looking at the instructor U0.

[0049] Applying this embodiment, it is conceivable to simultaneously provide a lesson that requires the instructor U0 to show a demonstration, such as a dance class or a karate class, to a plurality of students. When each student imitates the instructor U0, a display that attracts attention to the instructor U0, such as displaying the instructor U0 at the center of the screen, is essential. By applying the function shown in FIG. 4, not only is the instructor U0 displayed in the center on the screen of each student's terminal, but also, for example, only the upper body is displayed on both the left and right sides so that other students do not get in the way, making it easy for each student to feel as if they are taking a group lesson. Other students may be displayed in the front, the back, or both instead of being displayed on the left and right.

[0050] The display method may be changed according to an education mode such as individual education or group education. In the case of an individual education mode in which the instructor U0 conducts individual guidance for a specific student, only the instructor U0 may be displayed, or only the instructor U0 and the specific student may be displayed, and other students may be made non-displayed. In the case of a group education mode in which the instructor U0 conducts guidance for a plurality of students, similar to the example of FIG. 5, the instructor U0 may be displayed in the center and other students may be displayed around, so as to make the students aware of group education.

[0051] Referring to FIG. 6, the function of the second terminal device 40 used by the first student U1 when the display method is changed according to the education mode and the first student U1 receives individual guidance in the individual education mode will be described.

[0052] The control unit 41 of the second terminal device 40 receives, via the communication unit 43, control data C0 that designates an education mode, in addition to the image H0 of the instructor U0, the image H2 of the second student U2, and the image H3 of the third student U3. The control unit 41 displays the received image H0 on the display as the output unit 45 so that the instructor U0 is displayed at the center of the screen. When the education mode designated by the received control data C0 is the group education mode, the control unit 41 stores the received images H2 and H3 in the storage unit 42. Then, when the control unit 41 determines that there is free space at both ends of the screen, the control unit 41 synthesizes the images H2 and H3 stored in the storage unit 42 with the image H0 being displayed so that the second student U2 is displayed at one end of the screen and the third student U3 is displayed at the other end of the screen, and displays an image as shown in FIG. 5 on the display. On the other hand, when the education mode designated by the received control data C0 is the individual education mode, the control unit 41 discards the received images H2 and H3. As a result, the control unit 41 displays an image as shown in FIG. 7 on the display.

[0053] Referring to FIG. 8, the display method is changed according to the teaching mode, and the functions of the second terminal device 40 used by the second student U2 when the first student U1 receives individual instruction in the individual teaching mode will be described. The functions of the second terminal device 40 used by the third student U3 are the same as those of the second terminal device 40 used by the second student U2, so the description thereof will be omitted.

[0054] In addition to the image H0 of the instructor U0, the image H1 of the first student U1, and the image H3 of the third student U3, the control unit 41 of the second terminal device 40 receives control data C0 via the communication unit 43. The control unit 41 stores the received images H1 and H3 in the storage unit 42. The control unit 41 displays the images H1 and H3 stored in the storage unit 42 on the display as the output unit 45 such that the first student U1 is displayed at one end of the screen and the third student U3 is displayed at the other end of the screen. When the teaching mode specified by the received control data C0 is the group teaching mode and the control unit 41 determines that there is an empty space in the center of the screen, the control unit 41 synthesizes the received image H0 with the images H1 and H3 being displayed so that the instructor U0 is displayed in the center of the screen, and displays an image similar to FIG. 5 on the display except that the second student U2 is replaced by the first student U1. On the other hand, when the teaching mode specified by the received control data C0 is the individual teaching mode, the control unit 41 discards the received image H0. As a result, the control unit 41 displays an image as shown in FIG. 9 on the display. The control unit 41 may make the first student U1 invisible so that it can be seen that the first student U1 is receiving individual instruction.

[0055] If the functions shown in FIG. 6 are applied, when the mode in which the instructor U0 guides a specific student one-on-one is selected, the other students become invisible, so it is easy to get the feeling that the specific student is receiving individual lessons alone during the group lesson. If the functions shown in FIG. 8 are applied, when the mode in which the instructor U0 guides other students one-on-one is selected, the instructor U0 becomes invisible, so it is easy for the students to get the feeling that other students are receiving individual lessons during the group lesson. During individual lessons, it is desirable that the voice of the instructor U0 can only be heard by the student receiving the instruction.

[0056] As a mode in which instructor U0 coaches other students one-on-one, a private mode in which instructor U0 does not show themselves to students other than the student being coached one-on-one and a public mode in which instructor U0 shows themselves to students other than the student being coached one-on-one may be selectable. In such a modification, when the private mode is selected, instructor U0 becomes invisible, but when the public mode is selected, instructor U0 continues to be displayed. Therefore, the content of the individual lesson can be shared when it is useful as a reference for students other than the student receiving the coaching. In the private mode, it is desirable that the voice of instructor U0 is audible only to the student receiving the coaching. In the public mode, the voice of instructor U0 may also be audible to students who are not receiving the coaching.

[0057] With reference to FIGS. 10 and 11, the operation of the communication system 10 according to the present embodiment will be described. This operation corresponds to the educational support method according to the present embodiment.

[0058] FIG. 10 shows the operation of the first terminal device 30 used by instructor U0.

[0059] The processes from step S101 to step S103 are repeatedly executed while the online education is being carried out.

[0060] In step S101, the control unit 31 captures an image H0 of instructor U0 using the camera as the input unit 34. The control unit 31 may also acquire the voice of instructor U0 via the microphone as the input unit 34.

[0061] In step S102, the control unit 31 transmits the image H0 captured in step S101 to the server device 20 via the communication unit 33, and receives a plurality of individual images P0 including the image H1 of the first student U1, the image H2 of the second student U2, and the image H3 of the third student U3 from the server device 20 via the communication unit 33. When the control unit 31 acquires the voice of the instructor U0 in step S101, the acquired voice is also transmitted to the server device 20 via the communication unit 33. The control unit 31 may further receive the voice of the first student U1, the second student U2, or the third student U3 from the server device 20 via the communication unit 33.

[0062] The server device 20 receives the image H0 of the instructor U0 from the first terminal device 30 via the network 50. The server device 20 transmits the received image H0 as it is or after processing it into a hologram to the second terminal device 40 via the network 50. When the server device 20 receives the voice of the instructor U0 from the first terminal device 30, the received voice is also transmitted to the second terminal device 40 via the network 50.

[0063] In step S103, the control unit 31 displays the plurality of individual images P0 received in step S102 on the display as the output unit 45. When the control unit 41 receives the voice of the first student U1, the second student U2, or the third student U3 in step S102, the received voice is output from the speaker as the output unit 45.

[0064] FIG. 11 shows the operation of the second terminal device 40 used by the first student U1. This operation corresponds to the function shown in FIG. 4. The operations of the second terminal devices 40 used by the second student U2 and the third student U3 are the same as those of the second terminal device 40 used by the first student U1, and thus the description is omitted.

[0065] The processes from step S201 to step S204 are repeatedly executed while the online education is being carried out.

[0066] In step S201, the control unit 41 captures an image H1 of the first student U1 using a camera as the input unit 44. The control unit 41 may also acquire the voice of the first student U1 via a microphone as the input unit 44.

[0067] In step S202, the control unit 41 transmits the image H1 captured in step S201 to the server device 20 via the communication unit 43, and receives a plurality of individual images P1 including the image H0 of the instructor U0 and the image H2 of the second student U2 from the server device 20 via the communication unit 43. In the present embodiment, the plurality of individual images P1 further includes an image H3 of the third student U3. When the control unit 41 acquires the voice of the first student U1 in step S201, the acquired voice is also transmitted to the server device 20 via the communication unit 43. The control unit 41 may further receive the voice of the instructor U0, the second student U2, or the third student U3 from the server device 20 via the communication unit 43.

[0068] The server device 20 receives the image H1 of the first student U1 from the second terminal device 40 via the network 50. The server device 20 transmits the received image H1 as it is or after processing it into a hologram to the first terminal device 30 via the network 50. When the server device 20 receives the voice of the first student U1 from the second terminal device 40, the received voice is also transmitted to the first terminal device 30 via the network 50.

[0069] In step S203, the control unit 41 generates a composite image M1 representing the state that the second student U2 is in the same space as the instructor U0 using the plurality of individual images P1 received in step S202. For example, the control unit 41 generates an image as shown in FIG. 5 as the composite image M1, in which the instructor U0 is displayed in the center of the screen and the second student U2 is displayed at one end of the screen. In the present embodiment, the control unit 41 generates an image as the composite image M1 representing the state that the second student U2 and the third student U3 are in the same space as the instructor U0. For example, the control unit 41 generates an image as shown in FIG. 5 as the composite image M1, in which the third student U3 is displayed at the other end of the screen.

[0070] In step S204, the control unit 41 displays the composite image M1 generated in step S203 on the display as the output unit 45. When the control unit 41 receives the voice of the instructor U0, the second student U2, or the third student U3 in step S202, the received voice is output from the speaker as the output unit 45.

[0071] According to the present embodiment, through the operation as described above, it is easy for the student to get the feeling of receiving guidance together with other students. That is, the student can actually feel that he / she is receiving group education.

[0072] With reference to FIGS. 12 and 13, a modified example of the operation of the communication system 10 according to the present embodiment will be described.

[0073] FIG. 12 shows the operation of the first terminal device 30 used by the instructor U0 when the display method is changed according to the education mode.

[0074] The processes from step S111 to step S115 are repeatedly executed while the online education is being carried out. Since the processes of step S111, step S112, and step S115 are the same as the processes of step S101 to step S103 in FIG. 10 respectively, the description thereof will be omitted.

[0075] In step S113, when the control unit 31 receives an operation for switching the education mode from the input unit 34 by the instructor U0, it determines whether the switched education mode is a group education mode in which a plurality of students receive the guidance of the instructor U0 simultaneously or an individual education mode in which only a specific student among the plurality of students receives the guidance of the instructor U0 individually. Then, the process of step S114 is executed. When the operation for switching the education mode is not performed in step S113, or when the process of step S114 is completed, the process of step S115 is executed.

[0076] In step S114, the control unit 31 transmits the control data C0 specifying the switched education mode, which was determined in step S113, to the server device 20 via the communication unit 33. In the present embodiment, when the control data C0 specifies the individual education mode, it includes data for identifying a specific student, that is, a student who receives guidance from the instructor U0.

[0077] The server device 20 receives the control data C0 from the first terminal device 30 via the network 50. The server device 20 transmits the received control data C0 as it is or after appropriate processing to the second terminal device 40 via the network 50.

[0078] FIG. 13 shows the operation of the second terminal device 40 used by the first student U1 when the display method is changed according to the education mode. This operation corresponds to the functions shown in FIGS. 6 and 8. Since the operations of the second terminal devices 40 used by the second student U2 and the third student U3 are the same as those of the second terminal device 40 used by the first student U1, the description thereof is omitted.

[0079] The processes from step S211 to step S218 are repeatedly executed while the online education is being carried out. Since the processes of step S211, step S212, and step S214 are the same as the processes of step S201 to step S203 in FIG. 11, respectively, the description thereof is omitted.

[0080] In step S213, the control unit 41 receives the control data C0 from the server device 20 via the communication unit 43. When the education mode specified by the received control data C0 is the collective education mode, that is, when the collective education mode is selected, the process of step S214 is executed. When the education mode specified by the received control data C0 is the individual education mode, that is, when the individual education mode is selected, the process of step S215 is executed.

[0081] In step S215, the control unit 41 determines whether the student identified by the control data C0 received in step S213 is the first student U1. If it is determined that the student identified by the control data C0 is the first student U1, the process of step S216 is executed. If it is determined that the student identified by the control data C0 is not the first student U1, the process of step S217 is executed.

[0082] In step S216, the control unit 41 generates a guidance image L1 that displays only the instructor U0 or displays only the instructor U0 and the first student U1 as an image different from the composite image M1 generated in step S214. For example, the control unit 41 generates, as the guidance image L1, an image as shown in FIG. 7, in which the instructor U0 is displayed at the center of the screen and no students are displayed. Thereafter, the process of step S218 is executed.

[0083] In step S217, the control unit 41 generates a standby image W1 that represents a state where the first student U1 is in a space different from the instructor U0 as an image different from the composite image M1 generated in step S214. For example, the control unit 41 generates, as the standby image W1, an image in which the second student U2 is displayed at one end of the screen, the third student U3 is displayed at the other end of the screen, and the instructor U0 is not displayed, which is the same as FIG. 9 except that the first student U1 is replaced by the second student U2. The control unit 41 may make the student identified by the control data C0 invisible among the second student U2 and the third student U3 so that it is clear who is receiving individual guidance. Thereafter, the process of step S218 is executed.

[0084] In step S218, when the control unit 41 generates the composite image M1 in step S214, the generated composite image M1 is displayed on the display as the output unit 45. When the control unit 41 generates the guidance image L1 in step S216, the generated guidance image L1 is displayed on the display. When the control unit 41 generates the standby image W1 in step S217, the generated standby image W1 is displayed on the display. When the control unit 41 receives the voice of the instructor U0, the second student U2, or the third student U3 in step S202, the received voice is output from the speaker as the output unit 45.

[0085] According to the present embodiment, by the operation as described above, in the case of the group education mode, it is easy for the student to feel that he / she is receiving guidance together with other students. That is, the student can actually feel that he / she is receiving group education. On the other hand, in the case of the individual education mode, it is easy for the student to feel that he / she is receiving individual guidance. That is, the student can actually feel that he / she is receiving individual education.

[0086] As another embodiment of the present disclosure, instead of configuring each second terminal device 40 as an education support device, the server device 20 may be configured as an education support device.

[0087] Since the configuration of the communication system 10 according to the present embodiment is the same as that shown in FIG. 1, the description thereof is omitted.

[0088] Referring to FIG. 14, the configuration of the server device 20 according to the present embodiment will be described.

[0089] The server device 20 includes a control unit 21, a storage unit 22, and a communication unit 23.

[0090] The control unit 21 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for specific processing. The programmable circuit is, for example, an FPGA. The dedicated circuit is, for example, an ASIC. While controlling each part of the server device 20, the control unit 21 executes processing related to the operation of the server device 20.

[0091] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a RAM, ROM, or flash memory. The RAM is, for example, an SRAM or DRAM. The ROM is, for example, an EEPROM. The flash memory is, for example, an SSD. The magnetic memory is, for example, an HDD. The storage unit 22 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. Stored in the storage unit 22 are data used for the operation of the server device 20 and data obtained by the operation of the server device 20.

[0092] The communication unit 23 includes at least one communication interface. The communication interface is, for example, an interface corresponding to a wired LAN communication standard such as Ethernet (registered trademark), or an interface corresponding to a wireless LAN communication standard such as IEEE802.11. The communication unit 23 communicates with the first terminal device 30 and a plurality of second terminal devices 40. The communication unit 23 receives data used for the operation of the server device 20 and transmits data obtained by the operation of the server device 20.

[0093] The functions of the server device 20 are realized by executing a further different program according to this embodiment by a processor as the control unit 21. That is, the functions of the server device 20 are realized by software. The program causes a computer to execute the operations of the server device 20, thereby making the computer function as the server device 20. That is, the computer functions as the server device 20 by executing the operations of the server device 20 according to the program.

[0094] Some or all of the functions of the server device 20 may be realized by a programmable circuit or a dedicated circuit as the control unit 21. That is, some or all of the functions of the server device 20 may be realized by hardware.

[0095] Referring to FIG. 15, the operation of the communication system 10 according to this embodiment will be described. This operation corresponds to the education support method according to this embodiment.

[0096] FIG. 15 shows the operation of the server device 20.

[0097] The processes from step S301 to step S303 are repeatedly executed while the online education is being carried out.

[0098] In step S301, the control unit 21 receives a plurality of individual images P1 including the image H0 of the instructor U0 and the image H2 of the second student U2 via the communication unit 23. Specifically, the control unit 21 receives the image H0 of the instructor U0 from the first terminal device 30 used by the instructor U0 via the communication unit 23. The control unit 21 receives the image H2 of the second student U2 from the second terminal device 40 used by the second student U2 via the communication unit 23. In this embodiment, the plurality of individual images P1 further includes the image H3 of the third student U3, and the control unit 21 receives the image H3 of the third student U3 from the second terminal device 40 used by the third student U3 via the communication unit 23. The control unit 21 may further receive the voice of the instructor U0 from the first terminal device 30 via the communication unit 23. The control unit 21 may further receive the voice of the second student U2 from the second terminal device 40 used by the second student U2 via the communication unit 23. The control unit 21 may further receive the voice of the third student U3 from the second terminal device 40 used by the third student U3 via the communication unit 23.

[0099] In step S302, the control unit 21 generates a composite image M1 representing the state that the second student U2 is in the same space as the instructor U0 using the plurality of individual images P1 received in step S301. For example, as the composite image M1, the control unit 21 generates an image as shown in FIG. 5, in which the instructor U0 is displayed in the center of the screen and the second student U2 is displayed at one end of the screen. In this embodiment, the control unit 21 generates an image as the composite image M1 representing the state that the second student U2 and the third student U3 are in the same space as the instructor U0. For example, as the composite image M1, the control unit 21 generates an image as shown in FIG. 5, in which the third student U3 is displayed at the other end of the screen.

[0100] In step S303, the control unit 21 transmits the synthesized image M1 generated in step S302 to the second terminal device 40 used by the first student U1 via the communication unit 23. If the control unit 21 has received the voice of the instructor U0 from the first terminal device 30 in step S301, the voice of the second student U2 from the second terminal device 40 used by the second student U2, or the voice of the third student U3 from the second terminal device 40 used by the third student U3, the received voice is also transmitted to the second terminal device 40 used by the first student U1 via the communication unit 23.

[0101] The second terminal device 40 used by the first student U1 receives the synthesized image M1 from the server device 20 via the network 50. The second terminal device 40 used by the first student U1 displays the received synthesized image M1 on the display. If the second terminal device 40 used by the first student U1 has received the voice of the instructor U0, the second student U2, or the third student U3 from the server device 20, the received voice is output from the speaker.

[0102] According to the present embodiment, by the operation as described above, it is easy for the student to feel that he / she is receiving guidance together with other students. That is, the student can actually feel that he / she is receiving group education.

[0103] The description of the operation of the server device 20 related to the screen display on the second terminal device 40 other than the first terminal device 30 and the second terminal device 40 used by the first student U1 is omitted.

[0104] With reference to FIG. 16, a modification of the operation of the communication system 10 according to the present embodiment will be described.

[0105] FIG. 16 shows the operation of the server device 20 when the display method is changed according to the education mode.

[0106] The processes from step S311 to step S315 are repeatedly executed while the online education is being carried out. Since the processes of step S311 and step S313 are the same as the processes of step S301 and step S302 in FIG. 15 respectively, the description thereof will be omitted.

[0107] In step S312, the control unit 21 receives control data C0 specifying an education mode from the first terminal device 30 via the communication unit 23. When the education mode specified by the received control data C0 is the collective education mode, that is, when the collective education mode is selected, the process of step S313 is executed. When the education mode specified by the received control data C0 is the individual education mode, that is, when the individual education mode is selected, the process of step S314 is executed.

[0108] In step S314, when the first student U1 receives individual guidance, the control unit 21 generates a guidance image L1 that displays only the instructor U0 or only the instructor U0 and the first student U1 as an image different from the composite image M1 generated in step S313. For example, the control unit 21 generates an image as the guidance image L1 that displays the instructor U0 in the center of the screen and does not display any students as shown in FIG. 7. When a student other than the first student U1 receives individual guidance, the control unit 21 generates a standby image W1 that shows the first student U1 in a space different from that of the instructor U0. For example, the control unit 21 generates an image as the standby image W1 that is the same as FIG. 9 except that the first student U1 is replaced by the second student U2, displays the second student U2 at one end of the screen, displays the third student U3 at the other end of the screen, and does not display the instructor U0. The control unit 21 may hide the student receiving individual guidance, for example, the student identified by the control data C0, among the second student U2 and the third student U3 so that it is clear who is receiving individual guidance. Thereafter, the process of step S315 is executed.

[0109] In step S315, when the control unit 21 generates the composite image M1 in step S313, the generated composite image M1 is transmitted to the second terminal device 40 used by the first student U1 via the communication unit 23. When the control unit 21 generates the guidance image L1 in step S314, the generated guidance image L1 is transmitted to the second terminal device 40 used by the first student U1 via the communication unit 23. When the control unit 21 generates the standby image W1 in step S314, the generated standby image W1 is transmitted to the second terminal device 40 used by the first student U1 via the communication unit 23.

[0110] The second terminal device 40 used by the first student U1 receives the composite image M1, the guidance image L1, or the standby image W1 from the server device 20 via the network 50. The second terminal device 40 used by the first student U1 displays the received composite image M1, guidance image L1, or standby image W1 on the display.

[0111] According to this embodiment, by the above-described operation, in the case of the group education mode, it is easy for students to feel that they are receiving guidance together with other students. That is, students can actually feel that they are receiving group education. On the other hand, in the case of the individual education mode, it is easy for students to feel that they are receiving individual guidance. That is, students can actually feel that they are receiving individual education.

[0112] Regarding the operation of the server device 20 related to the screen display on the second terminal device 40 other than the first terminal device 30 and the second terminal device 40 used by the first student U1, the description is omitted. However, when the first student U1 receives individual guidance in the individual education mode, in step S314, at least the standby image W2 for the second student U2 is generated together with the guidance image L1. Then, in step S315, the standby image W2 is transmitted to the second terminal device 40 used by the second student U2. On the other hand, when the second student U2 receives individual guidance in the individual education mode, in step S314, the guidance image L2 for the second student U2 is generated together with the standby image W1. Then, in step S315, the guidance image L2 is transmitted to the second terminal device 40 used by the second student U2.

[0113] Some embodiments of the present disclosure will be exemplified below. However, note that the embodiments of the present disclosure are not limited to these. [Appendix 1] An educational support device for supporting online education implemented by connecting terminal devices used by a teacher and a plurality of students in separated spaces via a network, a communication unit that communicates via the network, a control unit that receives a plurality of individual images including an image of the teacher and an image of a second student different from a first student among the plurality of students via the communication unit, generates a composite image representing a state where the second student is in the same space as the teacher using the received plurality of individual images, and causes the generated composite image to be displayed on a terminal device used by the first student An educational support device comprising. [Appendix 2] The educational support device according to Appendix 1, wherein the control unit generates an image in which the teacher is displayed at the center of the screen and the second student is displayed at one end of the screen as the composite image. [Appendix 3] The plurality of individual images further include an image of a third student different from the first student and different from the second student among the plurality of students, The educational support device according to Appendix 2, wherein the control unit generates an image in which the third student is displayed at the other end of the screen as the composite image. [Appendix 4] The control unit causes the composite image to be displayed on the terminal device used by the first student when a collective education mode in which the plurality of students receive guidance from the teacher simultaneously is selected, and causes an image different from the composite image to be displayed on the terminal device used by the first student when an individual education mode in which only a specific student among the plurality of students receives guidance from the teacher individually is selected. The educational support device according to any one of Appendices 1 to 3. [Appendix 5] When the individual education mode is selected and the specific student is the first student, the control unit generates a guidance image that displays only the teacher or the teacher and the first student as an image different from the composite image, and causes the terminal device used by the first student to display the generated guidance image. The educational support device according to Supplementary Note 4. [Supplementary Note 6] When the individual education mode is selected and the specific student is not the first student, the control unit generates a standby image that represents the state where the first student is in a space different from the teacher as an image different from the composite image, and causes the terminal device used by the first student to display the generated standby image. The educational support device according to Supplementary Note 4 or Supplementary Note 5. [Supplementary Note 7] An educational support device according to any one of Supplementary Notes 1 to 6, Terminal devices used by the teacher and the plurality of students respectively, A communication system comprising. [Supplementary Note 8] On a computer that supports online education implemented by connecting terminal devices used by a teacher and a plurality of students in spaces separated from each other via a network, Receiving a plurality of individual images including an image of the teacher and an image of a second student different from the first student among the plurality of students via the network; Generating a composite image representing the state where the second student is in the same space as the teacher using the received plurality of individual images; Causing the terminal device used by the first student to display the generated composite image; A program for executing operations including. [Supplementary Note 9] An educational support method for supporting online education implemented by connecting terminal devices used by a teacher and a plurality of students in spaces separated from each other via a network, Receiving a plurality of individual images including an image of the teacher and an image of a second student different from the first student among the plurality of students via the network; Generating a composite image representing that the second student is in the same space as the instructor using a plurality of received individual images; Causing the first student to display the generated composite image on a terminal device used by the first student; An educational support method including the above.

[0114] The present disclosure is not limited to the above-described embodiments. For example, two or more blocks described in the block diagram may be integrated, or one block may be divided. Instead of executing two or more steps described in the flowchart in time series according to the description, they may be executed in parallel or in a different order according to the processing capabilities of the devices that execute each step, or as necessary. Other changes are possible without departing from the spirit of the present disclosure.

Description of Signs

[0115] 10 Communication system 20 Server device 30 First terminal device 31 Control unit 32 Storage unit 33 Communication unit 34 Input unit 35 Output unit 40 Second terminal device 41 Control unit 42 Storage unit 43 Communication unit 44 Input unit 45 Output unit 50 Network

Claims

1. An educational support device for supporting online education implemented by connecting terminal devices used by a teacher and a plurality of students in separated spaces via a network, a communication unit that communicates via the network, receives a plurality of individual images including an image of the teacher and an image of a second student different from a first student among the plurality of students via the communication unit, when a collective education mode in which the plurality of students receive the teacher's guidance simultaneously is selected, using the received plurality of individual images, as a composite image representing a state where the second student is in the same space as the teacher, display the teacher and the second student, or generate an image for displaying the teacher, the first student, and the second student, and display the generated composite image on the terminal device used by the first student, when an individual education mode in which only a specific student among the plurality of students receives the teacher's guidance individually is selected and the specific student is the first student, generate a guidance image for displaying only the teacher or only the teacher and the first student, and display the generated guidance image on the terminal device used by the first student, as the individual education mode, when a private mode in which the teacher does not show himself / herself to anyone other than the specific student is selected and the specific student is not the first student, as a standby image representing a state where the first student is in a space different from the teacher, make the teacher non-displayed in the composite image, or generate an image with the teacher and the specific student non-displayed, and display the generated standby image on the terminal device used by the first student, as the individual education mode, when a public mode in which the teacher shows himself / herself to others in addition to the specific student is selected and the specific student is not the first student, display the composite image as it is or an image with only the specific student non-displayed in the composite image on the terminal device used by the first student a control unit An educational support device comprising the above.

2. The educational support device according to Claim 1, wherein the control unit generates, as the composite image, an image in which the teacher is displayed at the center of the screen and only the upper body of the second student is displayed at one end of the screen.

3. The plurality of individual images further include an image of a third student who is different from the first student and also different from the second student among the plurality of students, The educational support device according to claim 2, wherein the control unit generates, as the composite image, an image that displays only the upper body of the third student at the other end of the screen.

4. The control unit further receives the voice of the instructor via the communication unit, and when the collective education mode is selected, the individual education mode is selected, the specific student is the first student, or when the public mode is selected as the individual education mode and the specific student is not the first student, outputs the received voice of the instructor to the terminal device used by the first student, The educational support device according to claim 1, wherein when the private mode is selected as the individual education mode and the specific student is not the first student, the received voice of the instructor is not output to the terminal device used by the first student.

5. An educational support device according to any one of claims 1 to 4, and terminal devices used by the instructor and the plurality of students respectively A communication system comprising.

6. On a computer that supports online education implemented by connecting terminal devices used by an instructor and a plurality of students in spaces separated from each other via a network, receiving a plurality of individual images including an image of the instructor and an image of a second student different from the first student among the plurality of students via the network; When the collective education mode in which the plurality of students receive the instructor's guidance simultaneously is selected, using the plurality of received individual images, as a composite image representing the state where the second student is in the same space as the instructor, display the instructor and the second student, or generate an image displaying the instructor, the first student, and the second student, and display the generated composite image on the terminal device used by the first student; When the individual education mode in which only a specific student among the plurality of students receives the instructor's guidance individually is selected and the specific student is the first student, generate a guidance image that displays only the instructor or only the instructor and the first student, and display the generated guidance image on the terminal device used by the first student; As the individual education mode, a private mode in which the teacher does not show himself / herself to anyone other than the specific student is selected. When the specific student is not the first student, as a waiting image representing that the first student is in a space different from the teacher, in the composite image, the teacher is made invisible, or an image in which both the teacher and the specific student are made invisible is generated, and the generated waiting image is displayed on the terminal device used by the first student. As the individual education mode, a public mode in which the teacher shows himself / herself to others in addition to the specific student is selected. When the specific student is not the first student, the composite image as it is, or an image in which only the specific student in the composite image is made invisible is displayed on the terminal device used by the first student. A program for executing an operation including the above.

7. An education support method for supporting online education implemented by connecting terminal devices used by a teacher and a plurality of students in separate spaces via a network, Receiving a plurality of individual images including an image of the teacher and an image of a second student different from the first student among the plurality of students via the network. When a collective education mode in which the plurality of students receive guidance from the teacher all at once is selected, using the received plurality of individual images to generate a composite image representing that the second student is in the same space as the teacher, and displaying the generated composite image on the terminal device used by the first student. When an individual education mode in which only a specific student among the plurality of students receives guidance from the teacher individually is selected and the specific student is the first student, generating a guidance image that displays only the teacher or only the teacher and the first student, and displaying the generated guidance image on the terminal device used by the first student. As the individual education mode, a private mode in which the teacher does not show himself / herself to anyone other than the specific student is selected. When the specific student is not the first student, as a waiting image representing that the first student is in a space different from the teacher, in the composite image, the teacher is made invisible, or an image in which both the teacher and the specific student are made invisible is generated, and the generated waiting image is displayed on the terminal device used by the first student. As the individual education mode, a public mode in which the instructor shows himself / herself to students other than the specific student is selected. When the specific student is not the first student, the composite image as it is or an image in which only the specific student in the composite image is made invisible is displayed on the terminal device used by the first student. An education support method including this.

Images