Education auxiliary system

The educational assistance system uses AR and CG technologies to enhance student comprehension by allowing interactive three-dimensional visualizations of complex subjects, addressing the limitations of existing systems in explaining difficult terms and improving engagement in remote learning.

JP2024178542AActive Publication Date: 2024-12-25RISOH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023096747
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-13
Publication Date
2024-12-25
Estimated Expiration
2043-06-13

Smart Images

  • Figure 2024178542000001_ABST
    Figure 2024178542000001_ABST
Patent Text Reader

Abstract

To provide an education auxiliary system capable of improving the lecture understanding of a lecture participant.SOLUTION: An education auxiliary system has a lecturer terminal which has a first display part and a participant terminal which has a second display part and is communicably connected to the lecturer terminal. When a predetermined part of an image displayed at the first display part is tapped while the same image is displayed at the first display part and the second display part, the name and explanatory sentence at the predetermined part are popped up at corresponding parts of the image at the second display part, and the images displayed at the first display part and the second display part are three-dimensional images utilizing AR (Augmented Reality) technology, computer graphics technology or animation technology.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an educational support system, and more particularly to an educational support system used when studying for a qualification exam or the like through online classes. [Background technology]

[0002] There is known a remote teaching system for taking online classes at home, etc. For example, Patent Document 1 discloses a distance learning support method that allows knowledge to be easily transferred without geographical and time constraints. In the distance learning support method of Patent Document 1, an operation center connects a lecture location registered by a member and a lecture location registered by a content provider via a network, and holds an online lecture.

[0003] Patent Document 2 also discloses a remote teaching system that allows a teacher (lecturer) to check the status of students (participants) regarding learning materials. In the remote teaching system of Patent Document 2, the orientation of an image sent from a student's PC (Personal Computer) to a teacher's PC is corrected to an orientation that is easy for the teacher to view, and then the image is displayed on the teacher's PC screen. Since the teacher views the image with the orientation corrected, it becomes easier for the teacher to check the status of the students. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2002-229438 A [Patent Document 2] JP 2023-30428 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, Patent Document 1 does not disclose how to explain difficult terms, etc., in the lecture materials. In addition, in Patent Document 2, an imaging unit provided in a student's PC captures the student's learning, transmits the captured image to a teacher's PC, and the teacher's PC receives the image, corrects the orientation of the image, displays the corrected image on the teacher's PC screen, and the teacher must look at the PC screen to determine the student's progress, etc. Therefore, the technology in Patent Document 2 has a complex and cumbersome device configuration and processing.

[0006] In view of the above-mentioned problems, an object of the present invention is to provide an educational support system that can more easily improve a student's understanding of a lecture. [Means for solving the problem]

[0007] In order to solve the above problems, one embodiment of the educational support system of the present invention is an educational support system having a lecturer terminal having a first display unit, and a lecturer terminal having a second display unit and communicatively connected to the lecturer terminal, wherein when the same image is displayed on the first display unit and the second display unit, and a specific portion of the image displayed on the first display unit is tapped, the name and description of the specific portion are displayed in a pop-up in the corresponding portion of the image on the second display unit, and the images displayed on the first display unit and the second display unit are three-dimensional images utilizing AR (Augmented Reality) technology, computer graphics technology, or animation technology. Effect of the Invention

[0008] According to the present invention, it is possible to improve the students' understanding of a lecture. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing a configuration of an education support system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram of a lecturer terminal according to the first embodiment. [Diagram 3]FIG. 2 is a block diagram of a student terminal according to the first embodiment. [Figure 4] FIG. 1 is a diagram illustrating a conventional textbook illustration. [Diagram 5] FIG. 2 is a diagram illustrating an image used in the first embodiment. [Figure 6] 4A to 4C are diagrams illustrating screens of a display unit of a lecturer terminal and a student terminal in the first embodiment. [Figure 7] FIG. 13 is a diagram illustrating another illustration in a conventional textbook. [Figure 8] FIG. 11 is a diagram illustrating another example of the image used in the first embodiment. [Figure 9] FIG. 11 is a diagram illustrating a display unit of a student terminal according to the second embodiment. [Figure 10] 13A and 13B are diagrams illustrating display units of a lecturer terminal and a student terminal in the second embodiment. [Figure 11] 13A and 13B are diagrams illustrating display units of a lecturer terminal and a student terminal in the second embodiment. [Figure 12] 13A and 13B are diagrams illustrating display units of a lecturer terminal and a student terminal in the second embodiment. [Figure 13] 13A and 13B are diagrams illustrating display units of a lecturer terminal and a student terminal in the second embodiment. [Figure 14] 13A and 13B are diagrams illustrating display units of a lecturer terminal and a student terminal in the second embodiment. [Figure 15] 13A and 13B are diagrams illustrating display units of a lecturer terminal and a student terminal in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the present invention, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the present invention. The configurations of the embodiments may be appropriately modified or changed depending on the specifications of the device to which the present invention is applied and various conditions (conditions of use, environment of use, etc.). The technical scope of the present invention is determined by the claims, and is not limited by the individual embodiments below. Also, parts of each embodiment may be appropriately combined to form a configuration.

[0011] First embodiment 1 shows an example of the configuration of an education support system 10 according to a first embodiment of the present invention. The education support system 10 is composed of one instructor terminal 20, n student terminals 30 (first student terminal 30a, second student terminal 30b, ..., nth student terminal 30n), a communication network 40, and a server 45. The instructor terminal 20 is connected to the first student terminal 30a to the nth student terminal 30n and the server 45 via the communication network 40 so as to be able to communicate with them.

[0012] The communication network 40 may be a wireless network (eg, the Internet, Bluetooth (registered trademark)) or a wired network (eg, a Local Area Network (LAN)). The server 45 is connected to a communication network 40 and can communicate with the lecturer terminal 20 and the student terminals 30a to 30n via the communication network 40. The server 45 can store, for example, lecture information transmitted (distributed) from the lecturer terminal 20 to the student terminals 30a to 30n. The student terminals 30a to 30n can access the server 45, read out the lecture information stored in the server 45, and play and output the information. The lecture information includes images and audio. The education support system 10 including the server 45 can function as a so-called cloud system. In this specification, the term "image" includes both moving images and still images.

[0013] In this embodiment, the instructor terminal 20 and the student terminals 30a to 30n are each a personal computer. The student terminals 30a to 30n have the same structure. In the following description, the student terminals 30a to 30n may be simply referred to as student terminals 30. A personal computer may be abbreviated as a PC.

[0014] 2 shows the configuration of the instructor terminal 20. The instructor terminal 20 has a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, an imaging unit 25, a sound collection unit 26, an audio output unit 27, a communication unit 28, and a bus 29 connecting these units. The control unit 21 performs overall control of the instructor terminal 20. The control unit 21 is configured with one or more processors (e.g., CPU: Central Processing Unit). The control unit 21 controls each component of the instructor terminal 20 according to a signal input to the control unit 21 and a program stored in the storage unit 22.

[0015] The storage unit 22 is composed of a volatile memory, a non-volatile memory, a storage medium, etc. The volatile memory is, for example, a RAM (Random Access Memory) and is used to temporarily hold various data and as a working area for the control unit 21. The non-volatile memory is, for example, a ROM (Read Only Memory) and stores programs executed by the control unit 21. The storage medium stores various data, programs, etc. The storage medium may be a medium that is detachable from the lecturer terminal 20, or may be built into the lecturer terminal 20. It is assumed that images (videos) used by the lecturer in a lecture are stored as lecture materials in, for example, a RAM or a storage medium.

[0016] The operation unit 23 is used to receive instructions from the lecturer to the lecturer terminal 20. The operation unit 23 includes, for example, a mouse, a keyboard, and the like. The operation unit 23 also includes a power ON / OFF button for the lecturer terminal 20 and a communication function ON / OFF button. For example, when the lecturer delivers a lecture to the student terminal 30, the lecturer operates the operation unit 23 to turn on the communication function and start delivering the lecture content (lecture materials). Note that, when the display unit 24 functions as a touch panel, the display unit 24 functions as a part of the operation unit 23. The operation unit 23 may be called an input unit because it can receive instructions (input) from the lecturer.

[0017] The display unit 24 is configured, for example, with a liquid crystal display. The display unit 24 displays lecture materials (teaching materials) of the lecturer. The display unit 24 can also function as a touch panel. The display unit 24 does not have to be built into the lecturer terminal 20 (it may be externally attached to the lecturer terminal 20). The display unit 24 may have a window for displaying images other than the teaching material. For example, the display unit 24 may have a window (not shown) for displaying images transmitted from the student terminal 30. The display unit 24 may also have a window for displaying an image captured of the lecturer giving an oral explanation. If the display unit 24 has a screen splitting function, the contents of the teaching material may be displayed on one of the split screens, and the image transmitted from the student terminal 30 or the image of the lecturer may be displayed on another screen. The size of one split screen does not have to be the same as that of another split screen. The display unit 24 can display all images transmitted from the student terminals 30a to 30n, or can selectively display some of them.

[0018] The imaging unit 25 is a camera unit. The imaging unit 25 captures an image of a lecturer or the like, and generates video data (image data) under the control of the control unit 21. The imaging unit 25 captures, for example, an image of a lecturer giving a lecture near the lecturer terminal 20. The image acquired by the capture can be transmitted from the imaging unit 25 to the student terminal 30 via the communication unit 28. The sound collection unit 26 is a microphone that collects the voice of the lecturer. The collected voice of the lecturer is transmitted to the student terminal 30 via the communication unit 28. The audio output unit 27 is a speaker, and reproduces the audio transmitted from the student terminal 30 to the instructor terminal 20 . The communication section 28 is a communication unit for realizing communication with the student terminal 30 and the server 45 by wireless communication or wired communication.

[0019] 3 shows the configuration of the student terminals 30 (first student terminal 30a to n-th student terminal 30n). The student terminal 30 has a control unit 31, a storage unit 32, an operation unit 33, a display unit 34, an imaging unit 35, a sound collection unit 36, an audio output unit 37, a communication unit 38, and a bus 39 connecting these. The control unit 31 performs overall control of the student terminal 30. The control unit 31 is composed of one or more processors (e.g., CPUs). The control unit 31 controls each component of the student terminal 30 according to signals input to the control unit 31 and programs stored in the storage unit 32.

[0020] The storage unit 32 is composed of a volatile memory, a non-volatile memory, a storage medium, etc. The volatile memory is, for example, a RAM, and is used to temporarily hold various data and as a working area for the control unit 31. The non-volatile memory is, for example, a ROM, and stores programs executed by the control unit 31. The storage medium stores various data, programs, etc. The storage medium may be a medium that is detachable from the student terminal 30, or may be built into the student terminal 30.

[0021] The operation unit 33 is used to receive instructions for the student terminal 30 from the user (student) of the student terminal 30. The operation unit 33 includes, for example, a mouse, a keyboard, and the like. The operation unit 33 also includes a power ON / OFF button for the student terminal 30 and a communication function ON / OFF button. The operation unit 33 may also include a button for displaying, as a second image, an image identical to a specific image (teaching material) displayed on the instructor terminal 20 on the display unit 34 of the student terminal 30. If the display unit 34 functions as a touch panel, the display unit 34 functions as a part of the operation unit 33. The operation unit 33 may be referred to as an input unit since it can receive instructions (input) from the user (student) of the student terminal 30. If the display unit 34 functions as a touch panel (input unit), input from the user of the student terminal 30 is performed by the user touching a predetermined portion of the screen of the display unit 34.

[0022] The display unit 34 displays the lecture materials distributed from the lecturer terminal 20. The display unit 34 is, for example, configured with a liquid crystal display. The display unit 34 can also function as a touch panel. The display unit 34 does not have to be built into the student terminal 30. The display unit 34 may have a window that displays an image other than the teaching material. For example, the display unit 34 may have a window (not shown) that displays an image of the lecturer received from the lecturer terminal 20. The display unit 34 may have a screen splitting function. When the display unit 34 has the screen splitting function, the contents of the teaching material (the contents received from the lecturer terminal 20) may be displayed on one of the split screens, the image of the lecturer may be displayed on another screen, and the specific image (second image) described above may be displayed on yet another screen. The size of one split screen does not have to be the same as that of another split screen.

[0023] The imaging section 35 is a camera unit. The imaging section 35, for example, captures an image of the students and generates video data (image data) under the control of the control section 31. The sound collection unit 36 ​​is a microphone, and collects the voice of the user (student) of the student terminal 30. The collected voice of the student is transmitted to the instructor terminal 30 via the communication unit 38, and is output from the audio output unit 27 of the instructor terminal 20. The audio output unit 37 is a speaker, and reproduces the audio transmitted from the audio pickup unit 26 of the instructor terminal 20 to the student terminal 30 via the communication unit 28 . The communication unit 38 is a communication unit for realizing communication with the instructor terminal 20 and the server 45 through wireless communication or wired communication.

[0024] Next, a case where a lecturer gives a lecture to a student using the education support system 10 will be described. The education support system 10 of this embodiment can be used when a lecturer gives various lectures to a student. In the following description, a case where a lecturer gives a lecture to a student who wishes to obtain a registered salesperson qualification will be described. The student terminal 30 is connected to the lecturer terminal 20 via a communication network 40, and the student terminal 30 and the lecturer terminal 20 are in a state in which they can communicate with each other. The lecturer gives a lecture using lecture materials displayed on the display unit 24 of the lecturer terminal 20. The lecture materials displayed on the display unit 24 of the lecturer terminal 20 are distributed to the student terminal 30 and displayed on the display unit 34 of the student terminal 30.

[0025] To obtain the license of a registered salesperson, it is necessary to understand the structure and function of the human body and to study the action of drugs. Therefore, the lecture materials used by the instructor include, for example, the following five chapters: Chapter 1: Common characteristics and basic knowledge of pharmaceuticals Chapter 2: Human Body Functions and Medicines Chapter 3: Major drugs and their effects Chapter 4: Pharmaceutical Affairs Laws and Regulations Chapter 5: Appropriate Use and Safety Measures for Drugs

[0026] Among the above five chapters, the contents of chapters 2 and 3 are considered to be particularly difficult to understand. One of the reasons is that when a lecturer lectures on the workings of the human body, medicines and their actions, there are no teaching materials that allow the students to imagine specific parts of the human body or the actions of medicines. Therefore, in this embodiment, the lecture is given using teaching materials that utilize AR (Augmented Reality) technology, animation technology, CG (Computer Graphics) technology, and 3D (three dimensional) technology, thereby improving the students' understanding. The teaching materials (software including images and audio) used in the lecture are stored in the memory unit 22 of the lecturer terminal 20. The software may be called an application or app.

[0027] The applications used in the lectures will include at least the following: (1) Images and explanatory text to help participants understand the movement of the digestive system as the medicinal ingredients are absorbed into the body after taking the medicine, as well as a program for displaying the images and explanatory text on the instructor terminal 20 and the participant terminal 30. (2) Images and explanatory text to help participants understand the function of the digestive system and the internal pathways through which medicine passes, as well as a program for displaying the images and explanatory text on the instructor terminal 20 and the participant terminal 30. (3) Images and explanatory text to help participants understand how the medicine dissolves and how, after dissolving, the medicine moves to and enters (penetrates) various parts of the body, as well as a program for displaying the images and explanatory text on the instructor terminal 20 and the participant terminal 30. (4) Images and explanatory text to help participants understand the movement (action) of the medicine once it has entered each part of the body, as well as a program for displaying the images and explanatory text on the instructor terminal 20 and the participant terminal 30.

[0028] In this embodiment, the function and structure of the digestive system (for example, the stomach), which is difficult to understand from illustrations in conventional textbooks, is shown to students in three-dimensional images using AR, animation, CG, and 3D to show them specifically where the digestive system is located in the body, what shape it is, what parts it is made up of, etc. Students can visualize the structure of the human body more specifically, which increases their motivation to learn and their level of understanding. 4, in a conventional textbook, for example, an illustration 100 of the entire stomach is shown, and the names of each part of the stomach (e.g., fundus, upper body, middle body, lower body, pyloric antrum, antrum, angle, pylorus, bulb) are written on the illustration 100, and an explanation 105 of each part is written at a position away from the illustration 100. The illustration 100 is a two-dimensional picture.

[0029] In contrast, in this embodiment, as shown in FIG. 5, the instructor terminal 20 displays an AR image 60 of the stomach 50 (the actual stomach image 50 and pop-up images 61, 63) on the display unit 24. For example, when the instructor taps (clicks) a portion 51 of the stomach 50 on the display unit (screen) 24, the name of the portion 51, "Name: Fundus" and the description of the fundus, "Description: The fundus is...", are popped up on the display unit 24 as a pop-up image 61. When the instructor taps another portion 53 of the stomach 50, the name of the portion 53, "Name: Antrum" and the description of the antrum, "Description: The antrum is...", are popped up on the display unit 24 as a pop-up image 63. The instructor taps on the stomach image 50 by clicking the cursor on the portions 51, 53 using the operation unit 23 (e.g., a mouse, etc.) of the instructor terminal 20. Alternatively, the instructor may tap on the portions 51 and 53 of the stomach image 50 by directly touching the display unit 24. The stomach image 50 is a three-dimensional actual image of the stomach.

[0030] In Fig. 5, pop-up images (name and explanation) 61, 63 are displayed adjacent to the corresponding parts 51, 53 of the stomach 50. The name and explanation are also written side by side. This improves the student's understanding compared to a textbook like that of Fig. 4 (where the name and explanation are written away from the illustration). In addition, the name and explanation (pop-up image) are displayed as a pop-up before they are present, so the name and explanation can leave a strong impression on the student.

[0031] In this embodiment, the AR image 60 (stomach image 50) is a 3D image that can be rotated 360 degrees, and when explaining the back side of the stomach, the instructor operates the operation unit 23 (e.g., a mouse, etc.) of the instructor terminal 20 to rotate the stomach image 50 so that the back side of the image 50 can be seen. 5, the stomach image 50 is an actual image, but a 3D CG image or a 3D animation image may be used instead of an actual image. When a CG image or animation image is used, the shading and color of the image 50 can be processed in various ways to improve the understanding of the trainee.

[0032] The image 50 may be a video. In the case of a video, it is possible to display how the stomach 50 moves during digestive processes. Also, in the case of a video, it is possible to display how the color of the affected area in the stomach 50 changes from a normal color to an aggravated color. Such an image (video) 50 is an easy teaching material for the instructor to teach about the changes in the stomach when it is normal, when it aggravates, and when it recovers, and how medicine works, and is also an easy-to-understand teaching material for the students.

[0033] As shown in Figures 6(A) and 6(B), in the education support system 10 of this embodiment, an image 50A (real image, CG image, or animation image) that is the same as the image 50 displayed on the display unit 24 of the instructor terminal 20 is displayed on the display unit 34 of the student terminal 30. Furthermore, when the instructor taps on portions 51 and 53, pop-up images 61A and 63A that are the same as the pop-up images 61 and 63 are also displayed on the display unit 34 of the student terminal 30. Therefore, by looking at the display unit 34 of the student terminal 30, the student can study anywhere, whether it is during a distance learning class, at home, or on the go. It is not limited to the pop-up images 61 and 63. When a part of the stomach other than the fundus 51 or the antrum 53 (for example, the upper body, the pylorus, the bulb, etc.) is clicked, a pop-up image of that part is displayed.

[0034] The images (lecture materials) delivered from the lecturer terminal 20 are stored in the server 45. Therefore, the lecture materials can be used as an action teaching material tool. In other words, the students can access the server 45 and view or download the images (lecture materials) stored in the server 45, thereby performing review learning using the images stored in the server 45 as action teaching materials.

[0035] In addition, each of the instructor terminal 20 and the first student terminal 30 is not limited to a PC, and may be, for example, a smartphone, a tablet terminal, or the like. In addition, the education support system 10 of the present embodiment can be used for distance learning, and can also be used for other purposes. In cases other than distance learning, for example, the instructor terminal 20 and the student terminal 30 may be in the same classroom (in the same building). 1 shows student terminals 30a, 30b, ..., 30n, the number (n) of student terminals 30 may be 1 or more. In addition, although the education support system 10 includes one instructor terminal 20, it may include multiple instructor terminals 20.

[0036] In the above embodiment, the stomach is described as an example of the digestive system, but the digestive system is not limited to the stomach. FIGS. 7 and 8 show a case where the digestive system is the oral cavity. FIG. 7 shows an illustration 110 of a conventional textbook. In FIG. 7, as in FIG. 4, the names of each part of the oral cavity (lips, uvula, labial commissure, etc.) are written in the illustration 110, and an explanation 115 of each part is written at a position away from the illustration 110. In contrast, when the present embodiment is applied, as shown in FIG. 8, a 3D image 70 of the oral cavity is displayed on the display unit 24 of the lecturer terminal 20 and the display unit 34 of the student terminal 30, and the lecturer gives a lecture. The image 70 is an animated image (a cartoon-like picture), and has a softer appearance than the illustration in FIG. 7, making it an image that is easy to get used to. The image 70 gives a softer impression than a photograph of an actual human nose, mouth, teeth, tongue, etc., making it an image that is easy to get used to. The mouth included in the image 70 may be a moving image that opens and closes. Such image (video) 70 can clearly show what can be seen at the back when the mouth is opened to a certain extent, making it an easy teaching material for the instructor and an easy-to-understand teaching material for the students. Clicking on the uvula in image 70 displays a pop-up image 71. The pop-up image 71 contains the "name and description" of the uvula. Note that image 70 may be a real image or a CG image. The use of the educational support system 10 of this embodiment is not limited to lectures on matters that should be learned by registered salespeople. This embodiment can be applied to lectures using lecture materials containing any content. For example, this embodiment can be applied to lectures for students who are aiming to obtain qualifications such as pharmacy clerks or registered dietitians. In addition, this embodiment can also be used for the education of architects and automobile mechanics by changing the content of the educational material images.

[0037] Second embodiment Next, a second embodiment of the present invention will be described with reference to Figures 1 to 3, 5, 6, and 9 to 15. The education support system 10 shown in Figure 1, the lecturer terminal 20 shown in Figure 2, and the student terminal 30 shown in Figure 3 are also used in the second embodiment. Below, differences from the first embodiment will be mainly described. The same components as in the first embodiment are given the same reference numbers and will not be described. In the second embodiment, a lecture on the stomach will be described.

[0038] First, the features of the second embodiment will be described with reference to FIG. 9. FIG. 9 shows the display unit 34 of the student 30. A teaching material image (real image, CG image, or animation image) 50A and another image (real image, CG image, or animation image) 50B are displayed on the display unit 34. In this embodiment, in addition to the teaching material image 50A, an image (second image) 50B identical to the teaching material image 50A can be displayed on the display unit 34. When the image 50B is displayed on the display unit 34, the student operates the operation unit 33 of his / her PC (the student terminal 30) (for example, clicks a specific button with a mouse). That is, the image 50B is displayed on the display unit 34 based on the student's intention. In response to a predetermined input (clicking a specific button), the student terminal 30 displays the image 50B, which is the same as the image 50A already displayed on the display unit 34, as a second image on the display unit 34 together with the already displayed image 50A.

[0039] Image 50B is an image that is operated by the students while the lecture is in progress. Image 50B is an image that is operated independently of image 50A. Image 50A is an image that is linked to image 50 on lecturer terminal 20 (image 50A is an image transmitted from lecturer terminal 20). When the lecturer clicks on image 50 on lecturer terminal 20, image 50A on display unit 34 is also clicked. Even if a student clicks on image 50A, nothing happens on display unit 34. Image 50B is an image that is not linked to images 50 and 50A. When a student clicks on image 50B, a specified phenomenon (described later) occurs on display unit 34.

[0040] A remote lecture in this embodiment will be described below. It is assumed that the lecturer terminal 20 and the student terminal 30 are connected so as to be able to communicate with each other. First, the instructor operates the operation unit 23 of the instructor terminal 20 , whereby the instructor terminal 20 displays the teaching material image 50 on the display unit 24 and transmits image data of the teaching material image 50 to the student terminal 30 . The student terminal 30 receives the image data of the teaching material image 50 and displays the teaching material image 50A on the display unit 34. The student terminal 30 automatically receives the data of the teaching material image 50 and displays the teaching material image 50A on the display unit 35. In other words, even if the student does not operate the student terminal 30, the student terminal 30 receives the data of the teaching material image 50 and displays the teaching material image 50A on the display unit 35 of the student terminal 30. This state is shown in Figures 10(A) and 10(B).

[0041] After that, the lecturer starts explaining about the stomach 50. In the following description, a case will be described in which the lecturer lectures to the students about the fundus 51 of the teaching material image 50 displayed on the lecturer terminal 20. There are several ways to give a lecture. Two examples will be described below.

[0042] <Example 1> The instructor uses a mouse to click on the fundus 51 of the teaching material image 50 displayed on the display unit 24 of the instructor terminal 20. In response to the click, the name and explanation of the fundus 51 are displayed as a pop-up image 61 on the display unit 24 of the instructor terminal 20. At the same time, a pop-up display 61A is also displayed on the display unit 34 of the student terminal 30 for the teaching material image 50A. This state is shown in Figures 11(A) and 11(B). This state is the same as in the first embodiment (Figure 6). After that, the instructor calls out to the students through the sound pickup section (microphone) 26 of the instructor terminal 20, "All students, please display the image of the stomach on your PC." This call is output as voice from the audio output section 37 of the student terminal 30. In response to this voice, the student operates the operation section 33 of the student terminal 30 to display image 50B on the display section 34 of the student terminal 30. This state is shown in Figures 12(A) and 12(B). At this time, the display section 34 goes into dual-screen display mode. Image 50B is displayed by active action (instruction) of the user (student) of the student terminal 30.

[0043] Next, the instructor calls out to the students through the sound pickup unit 26 of the instructor terminal 20, saying, "Students, please click on the fundus of the image of the stomach displayed on your PC." The call is output as a voice from the audio output unit 37 of the student terminal 30. In response to the voice, the student operates the operation unit 33 of the student terminal 30 to click on the upper part (fundus) 51B of the image 50B on the display unit 34 of the student terminal 30. When the student correctly clicks on the fundus 51B of the image 50B, the name and explanation of the fundus are displayed in a pop-up image 61B near the image 50B, as shown in FIG. 13(B). That is, the display unit 34 of the student terminal 30 displays the teaching material image 50A and a pop-up display 61A displayed near it, and the second teaching material image 50B and a pop-up display 61B displayed near it. FIG. 13(A) shows the display unit 24 of the instructor terminal 20.

[0044] If the student clicks on a part of the image 50B other than the fundus 51B, the pop-up display 61B is not displayed on the display unit 34. In this case, as shown in FIG. 13(C), text (alert text) 75 such as "Wrong" or "You clicked the wrong part" is displayed on the display unit 34. Alternatively, the audio output unit 37 may output a voice such as "You clicked the wrong part", or both text display and audio output may be performed. When the student clicks on the teaching material image 50A, no phenomenon (reaction) occurs on the display unit 34. The text 75 may be any text as long as it informs the student that he or she clicked on the wrong part. The text 75 is an example of an alert for the student. Although the instructor's appeal to the students is output from the audio output unit 37 of the student terminal 30, it may be displayed in text (text output) on the display unit 34 of the student terminal 30 in addition to being output from the audio output unit 37 (or instead of audio output).

[0045] As described above, in Example 1 of this embodiment, the students do not simply watch the lecture by the lecturer, but also click on their own PC screen in the same way as the lecturer. Therefore, the students can actively participate in the lecture. In addition, the students actually point to and click on the fundus 51B with their own hands, which improves their understanding compared to simply watching the lecture by the lecturer. Although the image 50B is displayed on the display unit 34 of the student terminal 30 by the student's operation, the image 50B may be transmitted from the instructor terminal 20 to the student terminal 30. The student may simply click on the fundus 51 of the image 50B displayed on the display unit 34 of the student terminal 30.

[0046] <Example 2> With the teaching material image 50 displayed on the display unit 24 of the lecturer terminal 20 and the teaching material image 50A displayed on the display unit 34 of the student terminal 30, the lecturer does not click the fundus 51 of the teaching material image 50 with the mouse, but calls out to the students via the sound collection unit 26 of the lecturer terminal 20, "Students, please display the image of your stomach on your PC." In response to this call (voice), the students operate the operation unit 33 of the student terminal 30 to display the image 50B on the display unit 34 of the student terminal 30. The display unit 34 goes into a dual screen display mode. This state is shown in Figures 14(A) and 14(B).

[0047] Next, the instructor calls out to the students through the sound pickup unit 26 of the instructor terminal 20, saying, "Students, please click on the fundus of the stomach image displayed on your PC." In response to the call (voice), the students operate the operation unit 33 of the student terminal 30 to try to click on the upper part (fundus) 51B of the image 50B on the display unit 34. When the student correctly clicks on the fundus 51B of the image 50B, the name and explanation of the fundus are displayed in a pop-up image 61B near the image 50B, as shown in FIG. 15(B). That is, the teaching material image 50A, the second teaching material image 50B, and the pop-up image 61B are displayed on the display unit 34 of the student terminal 30. FIG. 15(A) shows the display unit 24 of the instructor terminal 20.

[0048] If the student clicks on a part of image 50B other than fundus 51A, pop-up display 61B is not displayed on display unit 34. In this case, an alert message such as "You clicked the wrong part" is displayed on display unit 34. The alert may be a voice message from audio output unit 37, or may be a message that is both displayed as text and output as audio.

[0049] As described above, in Example 2 of this embodiment, in response to the instructor's question, "All students, please click on the fundus of the stomach image displayed on your PC," the students attempt to click on the fundus 51B using only their own knowledge. In Example 2, the instructor has the students click on the fundus 51 without showing the position of the fundus 51 to the students, making the lecture more difficult than Example 1. In Examples 1 and 2, when the student clicks on the teaching material image 50A, no phenomenon (reaction) occurs on the display unit 34. However, an alert (characters 75) as shown in Fig. 13(C) may be output. Also, instead of (or in addition to) the characters 75 or sound, the student may be alerted by light emission, blinking, etc.

[0050] The instructor can check how the student clicks on the image 50B on the student terminal 30, for example, in the following manner. (1) When a student displays image 50B on display unit 34 of student terminal 30, the same image as image 50B is also displayed on instructor terminal 20. Then, when a student clicks on image 50B on display unit 34, the click is displayed in the same way on the image on display unit 24 of instructor terminal 20. In this way, the instructor can check how the student clicked on display unit 34 of student terminal 30 (whether the student clicked the correct part). (2) A camera is separately installed to capture an image of the student terminal 30, and the camera captures the clicking action of the student and transmits the captured image to the instructor terminal 20. The instructor terminal 20 displays the image on the display unit 24, allowing the instructor to check the clicking action of the student (whether the correct part was clicked).

[0051] Although the above description has been given of a lecture on the fundus 51 of the stomach, the lecture can also be given on the upper part of the stomach body, the pylorus, etc. in the same manner. In addition, if the student clicks on the wrong part in Examples 1 and 2, information indicating the mistake may be transmitted to the server 45 or the lecturer terminal 20, or may be stored in the storage unit 32 of the student terminal 30. For example, suppose that the student fails to click on the position of the pylorus correctly when learning about the stomach. This information is stored in a predetermined storage unit (the server 45, the storage unit 22 of the lecturer terminal 20, the storage unit 32 of the student terminal 30). Therefore, the student can access the server 45 or the like before the registered salesperson test and find out that the part he or she made a mistake in was the pylorus. When a part other than the predetermined part of the image 50B is tapped, the server 45 or the like functions as a storage unit that stores information about the tap.

[0052] The lectures distributed from the instructor terminal 20 to the student terminal 30 are not limited to the above. For example, the present invention can be used to teach customer service skills to students. For example, this can be used to teach customer service skills to people working in pharmacies, drug stores, etc. (pharmacists, registered salespeople, etc.). Since medicines are related to people's lives, a role-play video of a series of steps from medical interview to prescription for a customer who is feeling unwell can be distributed to the student terminal 20. Customer service includes multiple scenes, starting from "greeting the customer", "understanding the patient's condition", "explaining the medicine", "deciding on the medicine", and "payment". In each of the multiple scenes, options are displayed on the display unit 34 of the student's terminal 30, and the student can proceed to the next scene by selecting the correct answer. Through this learning, the student can be presented (learned) with a series of steps from interviewing a customer who is not feeling well to prescribing medicine and payment, as if in a role-play. As a result, the student (pharmacist or registered salesperson) can develop the skills to easily explain the function of medicines (including side effects, etc.) and their main ingredients. Through this learning, the student (pharmacist or registered salesperson) can acquire the skills to sell safe and secure medicines. For pharmacies and drug stores, this will contribute to the proper use and safety of medicines.

[0053] The first and second embodiments described above may be used in appropriate combination as long as they are not inconsistent. The above-described embodiments are merely illustrative of the practical implementation of the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features. [Explanation of symbols]

[0054] 10 Educational Support System 20 Teacher's terminal 30 Student terminals 31 Control Unit 32 Storage section 33 Operation section (input section) 34 Display section 36 Communications Department 40 Communication Network 45 Server 50 Stomach image (educational image) 50B Stomach image (second image) 60 AR images / CG images / animations 61 Pop-up Images

Claims

1. A lecturer terminal having a first display unit; A training support system including: a student terminal having a second display unit and communicably connected to the instructor terminal, When a predetermined portion of the image displayed on the first display unit is tapped in a state in which the same image is displayed on the first display unit and the second display unit, a name and an explanation of the predetermined portion are displayed in a pop-up on a corresponding portion of the image on the second display unit; An educational support system, characterized in that the images displayed on the first display unit and the second display unit are three-dimensional images using AR (Augmented Reality) technology, computer graphics technology, or animation technology.

2. The educational support system described in claim 1, characterized in that, in response to a specified input, the student terminal displays an image that is the same as the image already displayed on the second display unit as a second image on the second display unit together with the image already displayed.

3. 3. The educational support system according to claim 2, wherein the image already displayed on the second display unit and the second image are images that are operated independently of each other.

4. The educational support system according to claim 3 , wherein when a predetermined portion of the second image is tapped, a name and an explanation of the predetermined portion are displayed in a pop-up on the second image.

5. The education support system according to claim 4 , wherein the student terminal outputs a predetermined alert when a portion other than a predetermined portion of the second image is tapped.

6. The education support system according to claim 5 , further comprising a storage unit that stores information about a tap when a part of the second image other than the predetermined part is tapped.

7. 7. The education support system according to claim 1, wherein the images are educational materials for educating a pharmacist, a registered salesperson, a dispensing pharmacy clerk, a registered dietitian, an automobile mechanic, or an architect.

8. A student terminal communicatively connected to a lecturer terminal, A communication unit that receives a first image from the instructor terminal; a display unit that displays the received first image; a control unit that, in response to a predetermined input, displays, on the display unit, an image that is the same as the first image already being displayed on the display unit as a second image together with the first image; A participant terminal comprising:

9. 9. The student terminal according to claim 8, wherein the first image already displayed on the display unit and the second image are images that can be operated independently of each other.

10. 10. The student terminal according to claim 9, wherein when a predetermined portion of the second image is tapped, a name and an explanation of the predetermined portion are displayed in a pop-up on the second image.

11. The student terminal according to claim 10, further comprising an output unit that outputs a predetermined alert when a portion other than the predetermined portion of the second image is tapped.

12. The student terminal according to claim 11 , wherein the control unit, when a part of the second image other than the predetermined part is tapped, stores information of the tap in a predetermined storage unit.

13. 9. The student terminal according to claim 8, wherein the first image is a teaching material for educating a pharmacist, a registered salesperson, a dispensing pharmacy clerk, a registered dietitian, an automobile mechanic, or an architect.

14. A program for causing a computer to function as each part of the student terminal according to any one of claims 8 to 13.

Citation Information

Patent Citations

  • Medical education network system using mobile terminal

    JP2008217293A

  • Educational methods and systems including at least one user interface

    JP2011504612A

  • Learning support device

    JP2017097030A

  • Education assisting system, method and program

    JP2022022664A

  • Learning system and learning method

    JP2022182673A