An online teaching and research system and device based on collaborative whiteboard

Abstract

The present invention discloses an online teaching and research system and device based on a collaborative whiteboard, wherein the online teaching and research system includes a lecturer client, a plurality of student clients, a plurality of reviewer clients, an audio and video server, a class whiteboard server, and a reviewer whiteboard server, and further includes a lecturer client. The lecturer client is connected to the audio and video server and the class whiteboard server respectively, each student client is connected to the audio and video server and the class whiteboard server respectively, and each reviewer client is connected to the audio and video server and the reviewer whiteboard server respectively; the lecturer client is logged in and used by the lecturer, the student client is logged in and used by the student, and the reviewer client is logged in and used by the reviewer. The present invention utilizes audio and video synchronization technology and whiteboard collaborative technology to connect the relatively separated scenes of teaching, reviewing, listening to classes, and reviewing in traditional offline teaching and research activities.

Description

Technical Field

[0001] The present invention belongs to the field of Internet technology, and in particular relates to an online teaching and research system and device based on a collaborative whiteboard. Background Art

[0002] With the development of information-based teaching and research, online teaching and research has become increasingly common as a key method for participating in teaching, research, and preparation within a campus, as well as across campuses and regions. Teaching and research departments organizing online teaching and research activities not only address the limitations of physical space and the inefficiency of long-distance offline participation, but also enable real-time aggregation of comments and records during the teaching and research process, generating statistics on teaching and research participation.

[0003] In conventional online teaching and research activities, only the teachers who attend the lectures participate online, while the teachers who evaluate the lessons only participate offline or, when participating online, need to wait until the end of the lecture to initiate audio and video discussions in order not to interfere with the lecture of the main teacher. The overall teaching and research process cannot be fully realized online, which greatly reduces the teaching and research effect.

[0004] To this end, it is necessary to develop an online teaching and research system so that online evaluators can watch the teaching process of the main teacher in real time, and can initiate audio and video discussions and text / voice annotations among the evaluators at any time; at the same time, the main teacher can interact with the online students in the class without being disturbed by the audio and video discussions of the online evaluators during the teaching process, just like in the offline class; at the same time, the listening teachers can watch the teaching process of the main teacher in real time. Summary of the Invention

[0005] To solve the above technical problems, the present invention provides an online teaching and research system and device based on a collaborative whiteboard. The technical solutions adopted are as follows:

[0006] An online teaching and research system based on a collaborative whiteboard includes a lecturer client, several student clients, several evaluation teacher clients, an audio and video server, a class whiteboard server, and a class evaluation whiteboard server; the lecturer client is connected to the audio and video server and the class whiteboard server respectively, each student client is connected to the audio and video server and the class whiteboard server respectively, and each evaluation teacher client is connected to the audio and video server and the class evaluation whiteboard server respectively;

[0007] The teaching teacher client is logged in and used by the teaching teacher to convert the real-time audio and video of the teaching teacher and the screen display of the teaching computer into the teaching teacher audio and video data stream, and push it to the audio and video server, and is also used to parse and play the audio and video data streams of each student attending the class obtained from the audio and video server; it is also used to display and edit blackboard files, and send blackboard editing instructions to the class whiteboard server, and is also used to obtain blackboard editing instructions from the class student client from the class whiteboard server to synchronously update the blackboard file;

[0008] The student client is used by the students to log in and parse and play the audio and video data stream of the lecturer obtained from the audio and video server, and is also used to convert the audio and video of the students obtained in real time into the student audio and video data stream and push it to the audio and video server; it is also used to display and edit the blackboard file, and send the blackboard editing instructions to the class whiteboard server, and is also used to obtain the blackboard editing instructions from the lecturer client from the class whiteboard server to synchronously update the blackboard file;

[0009] The lesson evaluation teacher client is logged in and used by the lesson evaluation teacher to parse and play the lesson evaluation teacher audio and video data streams obtained from the audio and video server from other lesson evaluation teacher clients, and is also used to convert the audio and video of the lesson evaluation teacher obtained in real time into the lesson evaluation teacher audio and video data streams, and push them to the audio and video server; it is also used to display and edit the lesson evaluation blackboard file, and send the lesson evaluation blackboard editing instructions to the lesson evaluation whiteboard server, and is also used to obtain the lesson evaluation blackboard editing instructions from other lesson evaluation teacher clients from the lesson evaluation whiteboard server to synchronously update the lesson evaluation blackboard file.

[0010] Furthermore, it also includes several teacher clients connected to the audio and video server, and the teacher clients are used to parse and play the audio and video data streams of the main teacher and the audio and video data streams of each student obtained from the audio and video server.

[0011] Furthermore, the teacher client includes a data pulling module and an audio and video playback module that are interconnected. The data pulling module is used to pull the audio and video data stream of the main teacher and the audio and video data stream of each student from the audio and video server, and parse them into the voice, video and real-time screen display of the teaching computer of the main teacher and the voice and video of each student, and then play them through the audio and video playback module.

[0012] Furthermore, the teaching teacher client includes an audio and video acquisition module, a data push / pull module, an audio and video playback module and a blackboard module; the audio and video acquisition module is connected to the data push / pull module, and is used to obtain the voice and video of the teaching teacher and the screen display of the teaching computer in real time, and convert it into the teaching teacher's audio and video data stream through the data push / pull module and push it to the audio and video server; the data push / pull module is also connected to the audio and video playback module, and is used to pull the audio and video data stream of the students from the audio and video server and parse it into the voice and video of the students, and then play it in windows through the audio and video playback module; the blackboard module is used to display and edit blackboard files, and send blackboard editing instructions to the class whiteboard server, and is also used to obtain blackboard editing instructions from the class whiteboard server from the student client to synchronously update the blackboard file.

[0013] Furthermore, the student client includes an audio and video acquisition module, a data push / pull module, an audio and video playback module, and a blackboard module; the audio and video acquisition module is connected to the data push / pull module, and is used to obtain the sound and video of the students in real time, and convert it into the audio and video data stream of the students through the data push / pull module and push it to the audio and video server; the data push / pull module is also connected to the audio and video playback module, and is used to pull the audio and video data stream of the lecturer from the audio and video server and parse it into the sound and video of the lecturer and the real-time screen display of the teaching computer, and then play it through the audio and video playback module; the blackboard module is used to display and edit blackboard files, and send blackboard editing instructions to the class whiteboard server, and is also used to obtain blackboard editing instructions from the class whiteboard server from the lecturer client and other student clients to synchronously update the blackboard files.

[0014] Furthermore, the teaching teacher client is also provided with a permission control module, and a permission response module is correspondingly provided in the student client; the permission control module is used to set the speaking permission and blackboard editing permission of each student client, and send the permission setting instruction to the corresponding student client; the permission response module is respectively connected to the audio and video acquisition module and the blackboard module in the student client, and is used to receive the permission setting instruction and control the audio and video acquisition module and the blackboard module according to the instruction: when the permission setting instruction is a mute instruction, the permission response module will turn off the sound acquisition function in the audio and video acquisition module; if it is a lift mute instruction, the sound acquisition function in the audio and video acquisition module will be turned on; when the permission setting instruction is a prohibition blackboard instruction, the permission response module will turn off the blackboard editing function in the blackboard module; if it is a lift prohibition blackboard instruction, the blackboard editing function in the blackboard module will be turned on.

[0015] Furthermore, the lesson evaluation teacher client includes an audio and video acquisition module, a data push / pull module, a second data pull module, a first audio and video playback module, and a second audio and video playback module; the audio and video acquisition module is connected to the data push / pull module for acquiring the audio and video of the lesson evaluation teacher in real time, and converting it into the lesson evaluation teacher audio and video data stream through the data push / pull module and pushing it to the audio and video server; the data push / pull module is connected to the first audio and video playback module for pulling the lesson evaluation teacher audio and video data streams from other lesson evaluation teacher clients from the audio and video server and parsing them into the audio and video of the corresponding lesson evaluation teacher, and then playing them in windows through the first audio and video playback module; the second data pull module is used to pull the audio and video data stream of the main teacher and the audio and video data streams of each student from the audio and video server, and parse them into the voice, video and real-time screen display of the teaching computer and the voice and video of each student, and then play them through the second audio and video playback module;

[0016] The lesson evaluation teacher client also includes a lesson evaluation blackboard module, which is used to display and edit lesson evaluation blackboard files, and send lesson evaluation blackboard editing instructions to the lesson evaluation whiteboard server, and is also used to obtain lesson evaluation blackboard editing instructions from other lesson evaluation teacher clients from the lesson evaluation whiteboard server to synchronously update the lesson evaluation blackboard files.

[0017] Furthermore, the course evaluation teacher client is also provided with a course end module for issuing a course end instruction, and correspondingly a course end prompt module is provided in the main teacher client for receiving course end instructions from each course evaluation teacher client, and notifying the main teacher to actively end the course when the number of course end instructions received is greater than a certain proportion.

[0018] Furthermore, it also includes a resource management server; the resource management server is connected to the lecturer's client, and the lecturer's client is provided with a data upload module for uploading courseware and learning materials to the resource management server; the resource management server is connected to the class whiteboard server, and the class whiteboard server is provided with a class blackboard generation module for generating a class blackboard file at the end of the online class according to the blackboard editing instructions received by the class whiteboard server and sending it to the resource management server;

[0019] The resource management server is connected to the lesson evaluation whiteboard server, and the lesson evaluation whiteboard server is provided with a lesson evaluation blackboard book generation module for generating a lesson evaluation blackboard book file at the end of the lesson evaluation according to the lesson evaluation blackboard book editing instruction received by the lesson evaluation whiteboard server and sending the file to the resource management server;

[0020] The resource management server is connected to the audio and video server, and the audio and video server is provided with a classroom video generation module, which is used to generate a classroom video file at the end of the online class and send it to the resource management server based on the audio and video data stream of the lecturer and the audio and video data stream of the students receiving the audio and video server; the audio and video server is also provided with a lesson evaluation video generation module, which is used to generate a lesson evaluation video file at the end of the lesson evaluation and send it to the resource management server based on the audio and video data stream of the lesson evaluation teacher received by the audio and video server.

[0021] Furthermore, a resource download module is provided in the student client for attending the class, which is used to obtain courseware and learning materials, class blackboard files and classroom video files from the resource service manager; a resource download module is also provided in the teacher client for evaluating the class, which is used to obtain courseware and learning materials, class evaluation blackboard files and class evaluation video files from the resource service manager.

[0022] A teaching and research device based on the above-mentioned online teaching and research system is used for a class whiteboard server, including a receiving module, a storage module, a sending module and a class blackboard generation module; the receiving module is used to receive blackboard editing instructions from the main teacher client and each student client and save them in the storage module; the sending module is used to send the blackboard editing instructions in the storage module to other clients at the same time; the class blackboard generation module is used to generate a class blackboard file at the end of the online class according to the blackboard editing instructions in the storage module.

[0023] A teaching and research device based on the above-mentioned online teaching and research system is used for a lesson evaluation whiteboard server, comprising a receiving module, a storage module, a sending module and a lesson evaluation blackboard generation module; the receiving module is used to receive lesson evaluation blackboard editing instructions from each lesson evaluation teacher client and save them in the storage module; the sending module is used to send the lesson evaluation blackboard editing instructions in the storage module to other lesson evaluation teacher clients at the same time; the lesson evaluation blackboard generation module is used to generate a lesson evaluation blackboard file at the end of the lesson evaluation according to the lesson evaluation blackboard editing instructions in the storage module.

[0024] A teaching and research device based on the above-mentioned online teaching and research system, used in an audio server, comprising a first receiving module, a first storage module, and a first sending module connected to each other, a second receiving module, a second storage module, and a second sending module connected to each other, and a third receiving module, a third storage module, and a third sending module connected to each other;

[0025] The first receiving module is used to receive the audio and video data stream of the main teacher and save it to the first storage module, and the first sending module is used to forward the received audio and video data stream of the main teacher to each student client and each teacher client in real time;

[0026] The second receiving module is used to receive the audio and video data streams of the students attending the class from each student client and save them to the second storage module, and the second sending module is used to forward the audio and video data streams of the students attending the class to the main teacher client and other students attending the class clients and various evaluation teacher clients in real time;

[0027] The third receiving module is used to receive the audio and video data stream of the lesson reviewer from each lesson reviewer client and save it to the third storage module, and the third sending module is used to forward the audio and video data stream of the lesson reviewer to other lesson reviewer clients in real time.

[0028] Furthermore, the above-mentioned teaching and research device for the audio server also includes a classroom video generation module and a lesson evaluation video generation module; the classroom video generation module is connected to the first storage module and the second storage module, and is used to generate a classroom video file at the end of the online class and send it to the resource management server based on the audio and video data stream of the lecturer stored in the first storage module and the audio and video data stream of the students attending the class stored in the second storage module; the lesson evaluation video generation module is connected to the third storage module, and is used to generate a lesson evaluation video file at the end of the lesson evaluation and send it to the resource management server based on the audio and video data stream of the lesson evaluation teacher stored in the third storage module.

[0029] Compared with existing online teaching and research methods, this invention has the following advantages:

[0030] (1) Strictly distinguish between teaching space and evaluation space, so that they do not interfere with each other, thus improving the effectiveness of teaching, research and evaluation;

[0031] (2) By utilizing audio and video synchronization technology and whiteboard collaboration technology, the relatively fragmented scenes of teaching, evaluating, listening to lessons, and reviewing lessons in traditional offline teaching and research activities have been connected;

[0032] (3) The teacher who reviews the lesson can initiate audio and video discussions at any time and can use the blackboard to assist in the audio and video discussions. The content of the blackboard includes but is not limited to text and pictures;

[0033] (4) The client for the lecturer, the client for the student attending the class, the client for the teacher evaluating the class, and the client for the teacher attending the class are all web clients. They do not need to be downloaded or installed, and are practical and convenient. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0035] Figure 1 This is a schematic diagram of a system framework provided by an embodiment of the present invention;

[0036] Figure 2This is a schematic diagram of the module composition of the lecturer client provided by one embodiment of the present invention;

[0037] Figure 3 This is a schematic diagram of the module composition of a client for students attending a lecture provided by one embodiment of the present invention;

[0038] Figure 4 This is a schematic diagram of the module composition of a classroom whiteboard server provided by one embodiment of the present invention;

[0039] Figure 5 This is a schematic diagram of the module composition of the lesson evaluation teacher client provided by one embodiment of the present invention;

[0040] Figure 6 This is a schematic diagram of the module composition of a lesson evaluation whiteboard server provided by one embodiment of the present invention;

[0041] Figure 7 The figure is a schematic diagram of the module composition of the audio and video server provided in one embodiment of the present invention. DETAILED DESCRIPTION

[0042] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0043] like Figure 1 As shown, the online teaching and research system based on the collaborative whiteboard provided by the present invention mainly includes a lecturer client, multiple student clients, multiple evaluation teacher clients, an audio and video server, a class whiteboard server, a class evaluation whiteboard server, and a resource management server. The lecturer client is connected to the audio and video server and the class whiteboard server respectively, each student client is connected to the audio and video server and the class whiteboard server respectively, and each evaluation teacher client is connected to the audio and video server and the class evaluation whiteboard server respectively. Among them:

[0044] The lecturer's client is logged in by the lecturer, such as Figure 2As shown, it mainly includes an audio and video acquisition module, a data push / pull module, an audio and video playback module and a blackboard writing module. Among them, the audio and video acquisition module is connected to the data push / pull module, which is used to obtain the voice and video of the main teacher in real time (especially the video or head portrait containing the main teacher's face, which can intuitively reflect the main teacher's expression and emotions during the teaching process) and the screen display of the teaching computer, and convert it into the audio and video data stream of the main teacher through the data push / pull module and push it to the audio and video server. The data push / pull module is also connected to the audio and video playback module, which is used to pull the audio and video data stream of the students from the audio and video server and parse it into the voice and video of the students (such as the video or head portrait containing the students' faces), and then play it in windows through the audio and video playback module. Each playback window corresponds to a student in the class, so that the listening status of each student can be known. In addition to audio and video teaching interaction, the main teacher can also use the blackboard writing module to write on the blackboard in class or ask students to demonstrate classroom problem solving, etc. Specifically, the blackboard module is used to display and edit blackboard files, and send blackboard editing instructions to the class whiteboard server. It is also used to obtain blackboard editing instructions from the class student client from the class whiteboard server to synchronously update the blackboard files.

[0045] The student client is used by the students who attend the class. Figure 3 As shown, it mainly includes an audio and video acquisition module, a data push / pull module, an audio and video playback module, and a blackboard module. Similar to the main teacher client, the audio and video acquisition module of the student client is connected to the data push / pull module, which is used to obtain the sound and video of the student in real time, and convert it into the audio and video data stream of the student through the data push / pull module and push it to the audio and video server. The data push / pull module is also connected to the audio and video playback module, which is used to pull the audio and video data stream of the main teacher from the audio and video server and parse it into the sound and video of the main teacher and the real-time screen display of the teaching computer, and then play it through the audio and video playback module to obtain the teaching content. The blackboard module is used to display and edit blackboard files, and send blackboard editing instructions to the class whiteboard server. It is also used to obtain blackboard editing instructions from the main teacher client and other student clients from the class whiteboard server to synchronously update the blackboard files.

[0046] like Figure 4As shown, the class whiteboard server includes a receiving module, a storage module and a sending module. Among them, the receiving module is used to receive the blackboard editing instructions from the main teacher client and each student client and store them in the storage module. The blackboard editing instructions include operation instructions such as creating / deleting blackboard files, adding / deleting / modifying content in blackboard files, etc. Its data structure adopts the form of [commondld, reqTime, params]. Commondld is the instruction enumeration value, which is a number. Each number represents a signaling, such as 1 represents creating a file and 2 represents deleting a file. ReqTime is the request time and params is the request parameter. Its specific structure is related to commonld and may be an array or an object, or may be a number or a string. The sending module is used to send the blackboard editing instructions in the storage module to other clients at the same time, such as sending the blackboard editing instructions from the main teacher client to each student client, or sending the blackboard editing instructions from a student client to other student clients and the main teacher client. The blackboard writing module of the teacher's client, the blackboard writing module of the student's client and the whiteboard server together constitute an application or device similar to online shared documents. Through it, the teacher can write on the blackboard in class or ask the students to demonstrate problem solving, just like offline.

[0047] In some embodiments, in order to facilitate the control of the online class by the lecturer, a permission control module is also provided in the lecturer client, and a permission response module is correspondingly provided in the student client. Figure 2 and Figure 3 As shown. The authority control module is used by the main teacher to set the speaking authority and blackboard editing authority of each student client, and send the authority setting instruction to the corresponding student client. The authority response module in the student client is connected to the audio and video acquisition module and the blackboard module respectively, and is used to receive the authority setting instruction and control the audio and video acquisition module and the blackboard module according to the instruction: when the authority setting instruction is a mute instruction, the authority response module will turn off the sound acquisition function in the audio and video acquisition module; if it is a lift mute instruction, the sound acquisition function in the audio and video acquisition module will be turned on; when the authority setting instruction is a ban blackboard instruction, the authority response module will turn off the blackboard editing function in the blackboard module; if it is a lift ban blackboard instruction, the blackboard editing function in the blackboard module will be turned on. In this way, the main teacher can choose which student to speak or demonstrate the problem-solving on the blackboard, which is convenient for the main teacher to maintain classroom discipline and control the course rhythm.

[0048] The teacher client is logged in by the teacher, such as Figure 5As shown, it mainly includes an audio and video acquisition module, a data push / pull module, a second data pull module, a first audio and video playback module and a second audio and video playback module. Among them, the audio and video acquisition module is connected to the data push / pull module for obtaining the voice and video of the class review teacher in real time, and converting it into the audio and video data stream of the class review teacher through the data push / pull module and pushing it to the audio and video server. The data push / pull module is connected to the first audio and video playback module for pulling the audio and video data stream of the class review teacher from other class review teacher clients from the audio and video server and parsing it into the voice and video of the corresponding class review teacher respectively, and then playing it in windows through the first audio and video playback module, with each playback window corresponding to a class review teacher. The second data pulling module is used to pull the audio and video data stream of the main teacher and the audio and video data stream of each student from the audio and video server, and parse them into the voice and video of the main teacher and the real-time screen display of the teaching computer and the voice and video of each student, and then play them through the second audio and video playback module, so that the evaluation teacher can know the teaching content of the main teacher, the classroom performance of the students, and the interaction between the main teacher and the students.

[0049] The lesson evaluation teacher client also includes a lesson evaluation blackboard module, which is used to display and edit lesson evaluation blackboard files, and send lesson evaluation blackboard editing instructions to the lesson evaluation whiteboard server. It is also used to obtain lesson evaluation blackboard editing instructions from other lesson evaluation teacher clients from the lesson evaluation whiteboard server to synchronously update the lesson evaluation blackboard files.

[0050] like Figure 6 As shown, the lesson review whiteboard server includes a receiving module, a storage module, and a sending module. The receiving module is used to receive and store the lesson review whiteboard editing instructions from each lesson review teacher client in the storage module. The lesson review whiteboard editing instructions include operations such as creating / deleting lesson review whiteboard files and adding / deleting / modifying content in lesson review whiteboard files. The sending module is used to simultaneously send the lesson review whiteboard editing instructions in the storage module to other lesson review teacher clients, allowing them to synchronize their lesson review whiteboards. The lesson review whiteboard is used to assist the lesson review teacher's audio and video discussions, and the content of the whiteboard includes but is not limited to text and images.

[0051] During offline teaching and research activities, the class reviewer will decide whether to end the class early based on the main teacher's classroom teaching performance. Therefore, in some embodiments of the present invention, the class reviewer client is also equipped with a course end module for issuing a course end instruction. Correspondingly, the main teacher client is equipped with a course end notification module for receiving course end instructions from each class reviewer client. When the number of course end instructions received exceeds a certain proportion (for example, accounting for half of the number of class reviewers), the main teacher is notified to proactively end the course.

[0052] In some embodiments, in order to facilitate the fact that the lecturer and other personnel who do not need to perform interactive operations can also watch the lecture process of the main teacher in real time, the online teaching and research system of the present invention also includes a lecturer client, which is mainly composed of an interconnected data pulling module and an audio and video playback module. The data pulling module is used to pull the main teacher's audio and video data stream and the audio and video data stream of each lecturer from the audio and video server, and respectively parse them into the main teacher's voice, video and the real-time screen display of the teaching computer and the voice and video of each lecturer, and then play them through the audio and video playback module. The lecturer client is generally a web client, which does not require registration and login, and can only be used to watch the lecturer's teaching process. It does not support any interaction with the main teacher, the lecturer or the teacher who evaluates the class, and it is not possible to intervene in the online class.

[0053] To facilitate the retention and reuse of online classroom data, in some embodiments of the present invention, a data upload module is also provided in the lecturer client, a class blackboard writing generation module is provided in the class whiteboard server, a class evaluation blackboard writing generation module is provided in the class evaluation whiteboard server, a class video generation module and a class evaluation video generation module are provided in the audio and video server, and a resource management server is also configured which is respectively connected to the lecturer client, the class whiteboard server, the class evaluation whiteboard server and the audio and video server. Among them, the data upload module is used for the lecturer to upload courseware and learning materials to the resource management server; the class blackboard generation module is used to generate a class blackboard file at the end of the online class based on the blackboard editing instructions received by the class whiteboard server and send it to the resource management server; the class review blackboard generation module is used to generate a class review blackboard file at the end of the class review based on the class review blackboard editing instructions received by the class review whiteboard server and send it to the resource management server; the class video generation module is used to generate a class video file at the end of the online class based on the audio and video data stream of the lecturer and the audio and video data stream of the students receiving the class on the audio and video server and send it to the resource management server; the class review video generation module is used to generate a class review video file at the end of the class review based on the audio and video data stream of the teacher receiving the class review on the audio and video server and send it to the resource management server. Correspondingly, a resource download module is set in the student client to obtain courseware and learning materials, class blackboard files and class video files from the resource service manager; a resource download module is also set in the class review teacher client to obtain courseware and learning materials, class review blackboard files and class review video files from the resource service manager.

[0054] like Figure 4As shown, based on the above-mentioned online teaching and research system, the present invention also provides an online teaching and research device for a class whiteboard server, comprising a receiving module, a storage module, a sending module and a class blackboard generation module. Among them, the receiving module is used to receive blackboard editing instructions from the main teacher client and each student client and save them in the storage module, and the sending module is used to send the blackboard editing instructions in the storage module to other clients at the same time. The class blackboard generation module is used to generate a class blackboard file at the end of the online class based on the blackboard editing instructions received by the class whiteboard server and saved in the storage module.

[0055] like Figure 6 As shown, based on the above-mentioned online teaching and research system, the present invention also provides an online teaching and research device for a lesson evaluation whiteboard server, comprising a receiving module, a storage module, a sending module, and a lesson evaluation blackboard generation module. The receiving module is used to receive the lesson evaluation blackboard editing instructions from each lesson evaluation teacher client and store them in the storage module. The sending module is used to simultaneously send the lesson evaluation blackboard editing instructions in the storage module to other lesson evaluation teacher clients, so that other lesson evaluation teacher clients can synchronize the lesson evaluation blackboard. The lesson evaluation blackboard generation module is used to generate a lesson evaluation blackboard file at the end of the lesson evaluation based on the lesson evaluation blackboard editing instructions received by the lesson evaluation whiteboard server.

[0056] like Figure 7 As shown, based on the above-mentioned online teaching and research system, the present invention also provides an online teaching and research device for an audio and video server, which mainly includes a first receiving module, a first storage module and a first sending module connected to each other, a second receiving module, a second storage module and a second sending module connected to each other, and a third receiving module, a third storage module and a third sending module connected to each other. Among them, the first receiving module is used to receive the audio and video data stream of the main teacher and save it to the first storage module, and the first sending module is used to forward the received audio and video data stream of the main teacher in real time to each student client and each teacher client; the second receiving module is used to receive the audio and video data stream of the student from each student client and save it to the second storage module, and the second sending module is used to forward the audio and video data stream of the student in real time to the main teacher client and other students clients and each teacher client; the third receiving module is used to receive the audio and video data stream of the teacher from each teacher client and save it to the third storage module, and the third sending module is used to forward the audio and video data stream of the teacher in real time to other teachers clients.

[0057] In some embodiments, the online teaching and research device for the audio and video server further includes a classroom video generation module and a lesson evaluation video generation module. The classroom video generation module is connected to the first storage module and the second storage module, and is used to generate a classroom video file at the end of the online class and send it to the resource management server based on the audio and video data stream of the lecturer stored in the first storage module and the audio and video data stream of the students attending the class stored in the second storage module. The lesson evaluation video generation module is connected to the third storage module, and is used to generate a lesson evaluation video file at the end of the lesson evaluation and send it to the resource management server based on the audio and video data stream of the lesson evaluation teacher stored in the third storage module.

[0058] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Under the idea of ​​the present invention, the technical features in the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations of different aspects of the present invention as described above. For the sake of simplicity, they are not provided in detail. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in this field should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of this application.

Claims

1. An online teaching and research system based on a collaborative whiteboard, characterized by: It includes a lecturer client, several student clients, several reviewer clients, an audio and video server, a class whiteboard server, and a reviewer whiteboard server; the lecturer client is connected to the audio and video server and the class whiteboard server respectively, each student client is connected to the audio and video server and the class whiteboard server respectively, and each reviewer client is connected to the audio and video server and the class whiteboard server respectively; The teaching teacher client is logged in and used by the teaching teacher to convert the real-time audio and video of the teaching teacher and the screen display of the teaching computer into the teaching teacher audio and video data stream, and push it to the audio and video server, and is also used to parse and play the audio and video data streams of each student attending the class obtained from the audio and video server; it is also used to display and edit blackboard files, and send blackboard editing instructions to the class whiteboard server, and is also used to obtain blackboard editing instructions from the class student client from the class whiteboard server to synchronously update the blackboard file; The student client is used by the students to log in and parse and play the audio and video data stream of the lecturer obtained from the audio and video server, and is also used to convert the audio and video of the students obtained in real time into the student audio and video data stream and push it to the audio and video server; it is also used to display and edit the blackboard file, and send the blackboard editing instructions to the class whiteboard server, and is also used to obtain the blackboard editing instructions from the lecturer client from the class whiteboard server to synchronously update the blackboard file; The class reviewer client is logged in and used by the class reviewer to parse and play the class reviewer audio and video data streams obtained from the audio and video server from other class reviewer clients, and is also used to convert the audio and video of the class reviewer obtained in real time into the class reviewer audio and video data streams and push them to the audio and video server; it is also used to display and edit the class review blackboard file, and send the class review blackboard editing instructions to the class review whiteboard server, and is also used to obtain the class review blackboard editing instructions from other class reviewer clients from the class review whiteboard server to synchronously update the class review blackboard file; The lesson evaluation teacher client includes an audio and video acquisition module, a data push / pull module, a second data pull module, a first audio and video playback module and a second audio and video playback module; the audio and video acquisition module is connected to the data push / pull module for acquiring the audio and video of the lesson evaluation teacher in real time, and converting it into the lesson evaluation teacher audio and video data stream through the data push / pull module and pushing it to the audio and video server; the data push / pull module is connected to the first audio and video playback module for pulling the lesson evaluation teacher audio and video data streams from other lesson evaluation teacher clients from the audio and video server and parsing them into the voice and video of the corresponding lesson evaluation teacher, and then playing them in windows through the first audio and video playback module; the second data pull module is used to pull the audio and video data stream of the main teacher and the audio and video data streams of each student from the audio and video server, and parse them into the voice, video and real-time screen display of the teaching computer and the voice and video of each student, and then play them through the second audio and video playback module; It also includes several teacher clients connected to the audio and video server, and the teacher clients are used to parse and play the audio and video data streams of the main teacher and the audio and video data streams of each student obtained from the audio and video server.

2. The online teaching and research system based on a collaborative whiteboard according to claim 1, characterized in that: The teacher client includes a data pulling module and an audio and video playback module that are interconnected. The data pulling module is used to pull the audio and video data stream of the main teacher and the audio and video data stream of each student from the audio and video server, and parse them into the voice, video and real-time screen display of the main teacher and the teaching computer and the voice and video of each student, and then play them through the audio and video playback module.

3. The online teaching and research system based on collaborative whiteboard according to claim 1, characterized in that: The teaching teacher client includes an audio and video acquisition module, a data push / pull module, an audio and video playback module and a blackboard module; the audio and video acquisition module is connected to the data push / pull module for acquiring the voice and video of the teaching teacher and the screen display of the teaching computer in real time, and converting them into the audio and video data stream of the teaching teacher through the data push / pull module and pushing them to the audio and video server; the data push / pull module is also connected to the audio and video playback module for pulling the audio and video data stream of the students attending the class from the audio and video server and parsing it into the voice and video of the students attending the class, and then playing them in separate windows through the audio and video playback module; the blackboard module is used to display and edit blackboard files, and send blackboard editing instructions to the class whiteboard server, and also to obtain blackboard editing instructions from the class whiteboard server from the student client to synchronously update the blackboard file; The main teacher client is also provided with a permission control module for setting the speaking permission and blackboard editing permission of each student client, and sending the permission setting instruction to the corresponding student client.

4. The online teaching and research system based on a collaborative whiteboard according to claim 3, characterized in that: The student client includes an audio and video acquisition module, a data push / pull module, an audio and video playback module, and a blackboard module; the audio and video acquisition module is connected to the data push / pull module for acquiring the audio and video of the students in real time, and converting it into the audio and video data stream of the students through the data push / pull module and pushing it to the audio and video server; the data push / pull module is also connected to the audio and video playback module for pulling the audio and video data stream of the main teacher from the audio and video server and parsing it into the voice and video of the main teacher and the real-time screen display of the teaching computer, and then playing it through the audio and video playback module; the blackboard module is used to display and edit blackboard files, and send blackboard editing instructions to the class whiteboard server, and is also used to obtain blackboard editing instructions from the class whiteboard server from the main teacher client and other student clients to synchronously update the blackboard files; The student client is also provided with a permission response module corresponding to the permission control module in the main teacher client. The permission response module is respectively connected to the audio and video acquisition module and the blackboard writing module in the student client, and is used to receive permission setting instructions and control the audio and video acquisition module and the blackboard writing module according to the instructions: when the permission setting instruction is a mute instruction, the permission response module will turn off the sound acquisition function in the audio and video acquisition module; if it is a lift mute instruction, the sound acquisition function in the audio and video acquisition module will be turned on; when the permission setting instruction is a blackboard writing prohibition instruction, the permission response module will turn off the blackboard writing editing function in the blackboard writing module; if it is a lift blackboard writing prohibition instruction, the blackboard writing editing function in the blackboard writing module will be turned on.

5. The online teaching and research system based on collaborative whiteboard according to claim 1, characterized in that: The lesson evaluation teacher client also includes a lesson evaluation blackboard module, which is used to display and edit lesson evaluation blackboard files, and send lesson evaluation blackboard editing instructions to the lesson evaluation whiteboard server, and is also used to obtain lesson evaluation blackboard editing instructions from other lesson evaluation teacher clients from the lesson evaluation whiteboard server to synchronously update the lesson evaluation blackboard files.

6. The online teaching and research system based on collaborative whiteboard according to claim 5, characterized in that: The course evaluation teacher client is also provided with a course end module for issuing a course end instruction. Correspondingly, a course end prompt module is provided in the main teacher client for receiving course end instructions from each course evaluation teacher client, and notifying the main teacher to actively end the course when the number of course end instructions received is greater than a certain proportion.

7. The online teaching and research system based on collaborative whiteboard according to claim 1, characterized in that: The system further comprises a resource management server; the resource management server is connected to the lecturer client, and the lecturer client is provided with a data upload module for uploading courseware and learning materials to the resource management server; the resource management server is connected to the class whiteboard server, and the class whiteboard server is provided with a class blackboard generation module for generating a class blackboard file at the end of the online class according to the blackboard editing instructions received by the class whiteboard server and sending it to the resource management server; The resource management server is connected to the lesson evaluation whiteboard server, and the lesson evaluation whiteboard server is provided with a lesson evaluation blackboard book generation module for generating a lesson evaluation blackboard book file at the end of the lesson evaluation according to the lesson evaluation blackboard book editing instruction received by the lesson evaluation whiteboard server and sending the file to the resource management server; The resource management server is connected to the audio and video server, and the audio and video server is provided with a classroom video generation module, which is used to generate a classroom video file at the end of the online class and send it to the resource management server based on the audio and video data stream of the lecturer and the audio and video data stream of the students receiving the audio and video server; the audio and video server is also provided with a lesson evaluation video generation module, which is used to generate a lesson evaluation video file at the end of the lesson evaluation and send it to the resource management server based on the audio and video data stream of the lesson evaluation teacher received by the audio and video server.

8. The online teaching and research system based on collaborative whiteboard according to claim 7, characterized in that: The student client is provided with a resource download module for obtaining courseware and learning materials, class blackboard files and classroom video files from the resource service manager; the teacher client is also provided with a resource download module for obtaining courseware and learning materials, class evaluation blackboard files and class evaluation video files from the resource service manager.

9. A teaching and research device based on the online teaching and research system according to claim 1, used in a classroom whiteboard server, characterized in that: It includes a receiving module, a storage module, a sending module and a class blackboard writing generation module; the receiving module is used to receive blackboard writing editing instructions from the main teacher client and each student client and save them in the storage module; the sending module is used to send the blackboard writing editing instructions in the storage module to other clients at the same time; the class blackboard writing generation module is used to generate a class blackboard writing file at the end of the online class according to the blackboard writing editing instructions in the storage module.

10. A teaching and research device based on the online teaching and research system according to claim 1, used for a lesson evaluation whiteboard server, characterized in that: It includes a receiving module, a storage module, a sending module and a lesson evaluation blackboard generation module; the receiving module is used to receive the lesson evaluation blackboard editing instructions from each lesson evaluation teacher client and save them in the storage module; the sending module is used to send the lesson evaluation blackboard editing instructions in the storage module to other lesson evaluation teacher clients at the same time; the lesson evaluation blackboard generation module is used to generate a lesson evaluation blackboard file at the end of the lesson evaluation according to the lesson evaluation blackboard editing instructions in the storage module.

11. A teaching and research device based on the online teaching and research system according to claim 1, used in an audio server, characterized in that: comprising a first receiving module, a first storage module and a first sending module connected to each other, a second receiving module, a second storage module and a second sending module connected to each other, and a third receiving module, a third storage module and a third sending module connected to each other; The first receiving module is used to receive the audio and video data stream of the main teacher and save it to the first storage module, and the first sending module is used to forward the received audio and video data stream of the main teacher to each student client and each teacher client in real time; The second receiving module is used to receive the audio and video data streams of the students attending the class from each student client and save them to the second storage module, and the second sending module is used to forward the audio and video data streams of the students attending the class to the main teacher client and other students attending the class clients and various evaluation teacher clients in real time; The third receiving module is used to receive the audio and video data stream of the lesson reviewer from each lesson reviewer client and save it to the third storage module, and the third sending module is used to forward the audio and video data stream of the lesson reviewer to other lesson reviewer clients in real time.

12. The teaching and research device according to claim 11, wherein: It also includes a classroom video generation module and a lesson evaluation video generation module; the classroom video generation module is connected to the first storage module and the second storage module, and is used to generate a classroom video file at the end of the online class and send it to the resource management server based on the audio and video data stream of the lecturer saved in the first storage module and the audio and video data stream of the students saved in the second storage module; the lesson evaluation video generation module is connected to the third storage module, and is used to generate a lesson evaluation video file at the end of the lesson evaluation and send it to the resource management server based on the audio and video data stream of the lesson evaluation teacher saved in the third storage module.

Images