Immersive virtual classroom system and method
By introducing an immersive virtual classroom system in remote classrooms, using multi-dimensional teaching environment and real-time audio and video communication, the problem of lack of interaction and participation in the existing technology is solved, and efficient teacher-student interaction and personalized learning experience is achieved. , improves teaching quality and learning effectiveness.
Patent Information
- Application Number
- CN202411057686.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2024-11-22
AI Technical Summary
The existing remote interactive classroom solutions lack instant interaction and sense of participation in the teaching process, which affects the teaching quality and learning experience.
An immersive virtual classroom system was designed, including WebRTC module, media gateway module, audio and video encoding module, immersive interaction module, personalized learning path planning module, teaching resource library module, cloud storage and synchronization module, and data analysis and evaluation The module enhances teacher-student interaction through a multi-dimensional teaching environment and real-time audio and video communication, and provides a personalized learning experience.
It significantly improves the teaching experience of teachers and students, enhances interaction and participation, improves teaching effectiveness and learning efficiency, reduces the threshold for participation, and ensures the consistency and authenticity of teaching through multi-screen display and synchronous audio technology. .
Smart Images

Figure CN119011892A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of audio and video network communications, and in particular relates to an immersive virtual classroom system and method. Background Art
[0002] With the rapid progress of modern audio and video communication technology, remote interactive education has become an indispensable part of the education field. Its characteristics of transcending geographical boundaries and flexibly arranging learning time have greatly promoted the balanced distribution of educational resources and the improvement of learning efficiency. However, the current remote interactive classroom solutions on the market often focus on one-way transmission of content, that is, teachers mainly teach through computer screens, while students passively accept. This model weakens the instant interactivity and sense of participation in the teaching process to a certain extent, affecting the teaching quality and learning experience.
[0003] In order to solve this problem, the patent of this invention proposes an innovative system and method, which aims to significantly improve the teacher's experience in remote online classes. By building a multi-dimensional and immersive teaching environment, it enhances the interaction between teachers and students, improves teaching effectiveness, and solves problems such as high user participation threshold, poor interactivity, and insufficient system scalability. Summary of the invention
[0004] The purpose of the present invention is to provide an immersive virtual classroom system and method to solve the problems raised in the above background technology.
[0005] In order to achieve the above object, the present invention provides the following technical solutions: an immersive virtual classroom system, the immersive virtual classroom system includes a core module and an extension module;
[0006] The core modules include: WebRTC module, media gateway module, audio and video encoding module, distributed audio and video decoding module, management and control module, immersive interaction module, personalized learning path planning module, teaching resource library module, cloud storage and synchronization module and data analysis and evaluation module.
[0007] Preferably, the WebRTC module includes a WebRTC server; receives all audio and video stream data, and sends the speaker's content to each participant. Participants do not need to install a client and can participate in the online course through a browser.
[0008] Preferably, the media gateway module is connected to the public network and the LAN of the main lecture area to perform protocol conversion and media forwarding; the media gateway module converts the input audio and video stream data into the WebRTC protocol and sends it to all participants;
[0009] On the one hand, it receives the video stream data sent by the WebRTC module, performs protocol conversion and then multicasts it in the local area network; on the other hand, it receives the audio and video data of the main lecture area sent by the distributed audio and video decoding module, performs protocol conversion and then sends it to the WebRTC module.
[0010] Preferably, the audio and video encoding module encodes the collected audio and video data and forwards it to the media gateway module;
[0011] Use a private protocol to transmit the encoded audio and video data to the media gateway module;
[0012] The distributed audio and video decoding module decodes the audio and video data multicast by the media gateway module and outputs it to the corresponding display device and audio equipment;
[0013] The management control module performs corresponding management and parameter configuration on the services involved.
[0014] Preferably, the immersive interaction module includes:
[0015] Compatibility of interactive devices: Supports a variety of VR / AR devices and interaction methods, such as gesture recognition and voice control, to improve the user's interactive experience and immersion;
[0016] Virtual environment customization: Provide customized services for virtual classroom environments, including scene design, item placement, and interactive elements to meet the needs of different teaching scenarios;
[0017] The personalized learning path planning module includes:
[0018] Learning outcome prediction: Use machine learning algorithms to predict students’ learning outcomes and potential difficulties, intervene in advance, and provide targeted tutoring resources;
[0019] Adaptive feedback mechanism: dynamically adjust the learning path and difficulty based on students' learning progress and feedback, and provide personalized learning suggestions and feedback.
[0020] Preferably, the teaching resource library module includes:
[0021] Smart tags and retrieval: Add smart tags to teaching resources to support quick retrieval and recommendation based on content; provide semantic search function to improve the accuracy and efficiency of resource search;
[0022] Copyright management and compliance: Establish a strict copyright management mechanism to ensure the legality and compliance of teaching resources; support copyright information registration, review and protection functions;
[0023] The cloud storage and synchronization module includes:
[0024] High availability and data backup: Distributed storage architecture and redundant backup mechanism are used to ensure high availability and security of user data;
[0025] Real-time synchronization technology: Real-time synchronization technology is used to achieve instant synchronization of user data between different devices to ensure the continuity of learning experience;
[0026] The data analysis and evaluation module includes:
[0027] Multi-dimensional analysis: Analyze users' learning behaviors and effects from the dimensions of learning time, participation, and performance, and provide a comprehensive learning evaluation report;
[0028] Visual reports: Provide intuitive and easy-to-understand visual reports to help teachers and administrators quickly understand students' learning situation and system operation status.
[0029] Preferably, the extension module includes: a multi-language support module, a collaborative learning module, a virtual experiment module, an adaptive learning module and a third-party application integration module.
[0030] Preferably, the method of the virtual classroom system specifically includes the following steps:
[0031] Step 1: Build the WebRTC platform;
[0032] Build a real-time audio and video communication platform based on the WebRTC MCU architecture and deploy the WebRTC service on a server with a public network address;
[0033] Step 2: Media gateway deployment;
[0034] The media gateway service is deployed on the intranet server, which can seamlessly connect to the WebRTC server. The audio and video data of the participants collected by the WebRTC module are forwarded to the media gateway in real time. The media gateway is responsible for converting this data into an internal Ethernet multicast stream and distributing it to each required decoding terminal through the switch.
[0035] Step 3: Speaker audio and video encoding;
[0036] Install a dedicated embedded audio and video encoder in the main lecture classroom. The encoder is equipped with a network interface and an audio and video input interface to receive audio and video signals collected by the lecturer's camera and microphone. After the encoder efficiently compresses and encodes the audio and video data, it sends the encoded data to the media gateway. After receiving the data, the media gateway encapsulates it in the WebRTC format and distributes it to all participants as the main lecture source.
[0037] Step 4: Distributed decoding service;
[0038] A distributed decoding service is composed of multiple dedicated embedded audio and video decoders, each of which is equipped with a network interface and an audio and video output interface; the management control module sends instructions to the decoder, instructing it to select a specific multicast source for decoding, and output the decoded audio and video signals to the corresponding display and audio equipment;
[0039] Step 5: System management and control;
[0040] Open or close the WebRTC service, group courses, and control the opening and closing of audio and video streams; notify the distributed decoder to select the multicast source and adjust the screen layout to meet the needs of different teaching scenarios; set or modify the audio and video encoding format to ensure the efficiency and compatibility of audio and video data during transmission;
[0041] Step 6: Build an immersive environment;
[0042] Introducing VR / AR technology to build a three-dimensional virtual classroom environment, providing participants with an immersive learning experience; supporting natural interaction methods such as gesture recognition and voice interaction to enhance classroom interactivity and fun;
[0043] Step 7: Personalized learning plan;
[0044] Based on the user's learning history, grades and preferences, intelligent algorithms are used to plan personalized learning paths; suitable learning resources and courses are recommended to help users achieve their learning goals efficiently;
[0045] Step 8: Construction of teaching resource library;
[0046] Build a rich and diverse multimedia teaching resource library, support online editing, uploading and sharing of teaching resources; provide teachers with rich teaching materials and provide students with convenient access to learning materials;
[0047] Step 9: Cloud storage and synchronization;
[0048] Use cloud computing technology to achieve cloud storage and cross-device synchronization of user data; ensure that users can continue their previous learning progress when switching seamlessly between different devices, improving learning efficiency and convenience;
[0049] Step 10: Data analysis and evaluation;
[0050] Conduct big data analysis on users' learning behaviors, grades and feedback, and provide detailed learning evaluation and feedback reports; help teachers understand students' learning situations and adjust teaching strategies; help students understand their own learning outcomes and develop more reasonable learning plans.
[0051] Preferably, the method steps of the virtual classroom system also include:
[0052] Step 1: Multi-language support and international communication: The multi-language support module provides real-time translation and subtitle functions, supports multiple language interfaces and interaction methods, and promotes barrier-free communication and learning among international students;
[0053] Step 2: Collaborative learning and team building: The collaborative learning module encourages cooperation and communication among students, provides online collaborative tools and discussion area functions, and helps students solve problems together, share experiences, and improve team collaboration capabilities.
[0054] Step 3: Virtual experiment and hands-on practice: The virtual experiment module provides students with a virtual experimental environment and experimental equipment, allowing students to perform experimental operations, observe phenomena, and verify theories in a virtual environment, thereby enhancing their practical ability and innovative thinking.
[0055] Step 4, Adaptive learning system: The adaptive learning module automatically adjusts the teaching content and difficulty according to the students' learning feedback and performance, providing students with a personalized learning experience;
[0056] Step 5. Third-party application integration: The third-party application integration module allows teachers or students to seamlessly integrate external tools, applications or resources into the virtual classroom.
[0057] The beneficial effects of the present invention are as follows:
[0058] 1. The present invention uses multi-screen display technology, so that the main classroom can simultaneously receive and independently display the audio and video signals of multiple students. This not only allows the main teacher to intuitively see the real-time reaction and expression of each student, but also allows the teacher to feel a richer classroom interactive atmosphere, greatly enhancing the immersiveness and sense of presence of teaching.
[0059] Synchronous audio technology ensures perfect synchronization of audio and video signals, avoiding the problem of audio and video asynchrony in traditional online classrooms, further enhancing the continuity and authenticity of teaching, making teachers feel as if they are in a real classroom environment.
[0060] 2. The present invention introduces the WebRTC module, so that students do not need to download or install any additional client software, and can easily join the class through a browser, which greatly reduces the participation threshold and improves the students' participation enthusiasm and convenience.
[0061] This plug-and-play participation method also reduces the trouble caused by software compatibility issues, ensuring that all students can smoothly access the classroom and enjoy a high-quality online learning experience.
[0062] 3. The present invention provides great flexibility for the system by using the strong scalability of the media gateway, and can easily support the docking and compatibility of multi-layer protocols and various third-party platforms. This means that the system can be customized and expanded according to actual needs to meet the teaching needs in different scenarios.
[0063] At the same time, this scalability also leaves room for future upgrades and updates of the system, ensuring that the system can keep pace with technological development and continue to provide teachers and students with a more advanced and efficient teaching experience.
[0064] 4. The present invention enables the main teacher to have a more comprehensive understanding of the students' learning status and reactions through the independent output and high-quality display of multiple audio and video signals, thereby adjusting the teaching strategies and methods in a timely manner and improving the pertinence and effectiveness of teaching.
[0065] The immersive teaching experience can also stimulate students' interest and enthusiasm in learning, promote effective communication and interaction between teachers and students, and further improve teaching quality and learning outcomes.
[0066] 5. Through multi-screen display and synchronous audio technology, the system of the present invention realizes the optimal configuration and efficient utilization of teaching resources. High-quality online teaching experience can be achieved without adding additional hardware equipment or investing a lot of manpower and material resources. This not only reduces teaching costs, but also improves the utilization rate and coverage of teaching resources, allowing more teachers and students to enjoy high-quality online education resources. BRIEF DESCRIPTION OF THE DRAWINGS
[0067] Figure 1 A simplified flowchart of the method of the virtual classroom system of the present invention;
[0068] Figure 2 This is a simplified flow chart of some core modules of the present invention;
[0069] Figure 3 This is a flow chart of the management control module of the present invention;
[0070] Figure 4 A schematic diagram of an embodiment of the present invention. DETAILED DESCRIPTION
[0071] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0072] like Figures 1 to 4As shown, an embodiment of the present invention provides an immersive virtual classroom system, which includes a core module and an extension module;
[0073] The core modules include: WebRTC module, media gateway module, audio and video encoding module, distributed audio and video decoding module, management and control module, immersive interaction module, personalized learning path planning module, teaching resource library module, cloud storage and synchronization module and data analysis and evaluation module.
[0074] Among them, the WebRTC module includes a WebRTC server; it receives all audio and video stream data and sends the speaker's content to each participant. Participants do not need to install the client and can participate in the online course through the browser.
[0075] Deployment location: Deployed on the public network platform to ensure that users around the world can directly join the course through the browser.
[0076] ·Functional features: Supports direct participation through a Web browser, without the need to install additional client software, which reduces the threshold for user participation. Realizes real-time audio and video communication between the lecturer and participants, ensuring instant delivery and interaction of course content.
[0077] Technical details: WebRTC (Web RealTime Communication) technology is used to ensure low-latency and high-quality transmission of audio and video streams. It supports large-scale concurrent access by users to ensure smooth course delivery.
[0078] The media gateway module is connected to the public network and the LAN of the main lecture area to perform protocol conversion and media forwarding. The media gateway module converts the input audio and video stream data into the WebRTC protocol and sends it to all participants.
[0079] On the one hand, it receives the video stream data sent by the WebRTC module, performs protocol conversion and then multicasts it in the local area network; on the other hand, it receives the audio and video data of the main lecture area sent by the distributed audio and video decoding module, performs protocol conversion and then sends it to the WebRTC module.
[0080] Connection function: As a bridge between the public network and the LAN in the main lecture area, it is responsible for the protocol conversion and media forwarding of audio and video streams.
[0081] ·Functional features: On the one hand, it receives the participant video stream data sent by the WebRTC module, performs protocol conversion and then multicasts it in the LAN of the main lecture area for the speaker and the audience to watch; on the other hand, it receives the audio and video data of the main lecture area sent by the audio and video encoding module, performs protocol conversion and then sends it to the WebRTC service module to realize the whole network broadcast of the main lecture content.
[0082] Technical details: Supports conversion of multiple audio and video protocols, such as H.264 / H.265 video encoding protocol, AAC / Opus audio encoding protocol, etc. Adopts efficient forwarding mechanism to ensure fast and accurate transmission of audio and video streams.
[0083] Among them, the audio and video encoding module encodes the collected audio and video data and forwards it to the media gateway module;
[0084] Use a private protocol to transmit the encoded audio and video data to the media gateway module;
[0085] The distributed audio and video decoding module decodes the audio and video data multicast by the media gateway module and outputs it to the corresponding display device and audio equipment;
[0086] The management and control module manages and configures parameters for the services involved: such as grouping, upgrading, multicast source selection, screen layout, etc. Technical features: integrates user authentication, authority management, course scheduling, resource allocation and fault monitoring functions to ensure stable operation and efficient management of the system.
[0087] Audio and video encoding module:
[0088] Function description: Encode the original audio and video signals collected by the camera and microphone in the main lecture area for transmission over the network.
[0089] Technical features: It uses advanced audio and video coding technologies, such as H.266 / VVC video coding, Opus audio coding, etc., to reduce bandwidth usage while ensuring audio and video quality. It supports private protocol transmission to ensure the security and integrity of audio and video data.
[0090] Output mode: The encoded audio and video data is transmitted to the media gateway module through a private protocol, and the media gateway module performs subsequent processing.
[0091] Distributed audio and video decoding module:
[0092] Functional description: Decode the audio and video data multicasted by the media gateway module and output them to the corresponding display devices and audio equipment.
[0093] Technical features: Supports distributed computing resources, realizes parallel decoding and rendering of audio and video streams, reduces decoding delay, and improves user experience. Supports access to multiple display devices and audio equipment to meet the needs of different teaching scenarios.
[0094] Among them, the immersive interaction modules include:
[0095] Compatibility of interactive devices: Supports a variety of VR / AR devices and interaction methods, such as gesture recognition and voice control, to improve the user's interactive experience and immersion;
[0096] Virtual environment customization: Provide customized services for virtual classroom environments, including scene design, item placement, and interactive elements to meet the needs of different teaching scenarios;
[0097] The personalized learning path planning module includes:
[0098] Learning outcome prediction: Use machine learning algorithms to predict students’ learning outcomes and potential difficulties, intervene in advance and provide targeted tutoring resources;
[0099] Adaptive feedback mechanism: dynamically adjust the learning path and difficulty based on students' learning progress and feedback, and provide personalized learning suggestions and feedback.
[0100] Among them, the teaching resource library module includes:
[0101] Smart tags and retrieval: Add smart tags to teaching resources to support quick retrieval and recommendation based on content; provide semantic search function to improve the accuracy and efficiency of resource search;
[0102] Copyright management and compliance: Establish a strict copyright management mechanism to ensure the legality and compliance of teaching resources; support copyright information registration, review and protection functions;
[0103] The cloud storage and synchronization module includes:
[0104] High availability and data backup: Adopt distributed storage architecture and redundant backup mechanism to ensure high availability and security of user data; support cross-regional data backup and recovery strategies.
[0105] Real-time synchronization technology: Use real-time synchronization technology (such as WebSocket, MQTT, etc.) to achieve instant synchronization of user data between different devices to ensure the continuity of the learning experience;
[0106] The data analysis and evaluation modules include:
[0107] Multi-dimensional analysis: Analyze users' learning behaviors and effects from the dimensions of learning time, participation, and performance, and provide a comprehensive learning evaluation report;
[0108] Visual reports: Provide intuitive and easy-to-understand visual reports to help teachers and administrators quickly understand students' learning situation and system operation status. Support custom report templates and export functions.
[0109] Among them, the extension modules include: multi-language support module, collaborative learning module, virtual experiment module, adaptive learning module and third-party application integration module.
[0110] Multi-language support module
[0111] Language translation community: Establish a user-contributed translation community to encourage teachers and students to participate in the translation and proofreading of teaching content and accelerate the internationalization process.
[0112] Language preference learning: Analyze the user's language preference through the user's learning history and interaction data, and automatically recommend teaching content in the corresponding language.
[0113] Localization optimization: Based on the cultural habits and education systems of different regions, the teaching content is localized to make it more in line with the needs of local students.
[0114] Collaborative Learning Module
[0115] Real-time collaborative editing: Supports real-time collaborative editing by multiple people on the same document or project, improving team collaboration efficiency.
[0116] Display of collaborative achievements: Provide an online display platform for collaborative achievements, encourage students to share their learning achievements, and promote mutual learning and communication.
[0117] Collaborative evaluation system: Establish an evaluation system based on team collaboration, comprehensively consider individual contributions and team results, and provide fair evaluation and feedback.
[0118] Virtual Experiment Module
[0119] Experimental data recording and analysis: Automatically record students' operation process and result data in virtual experiments, provide data analysis tools, and help students deeply understand the experimental principles.
[0120] Experimental scenario expansion: According to the development of disciplines and teaching needs, the scenarios and types of virtual experiments are continuously expanded to meet more experimental teaching needs.
[0121] Experimental safety training: simulate experimental safety accidents in a virtual environment, conduct safety education and emergency drills, and improve students' awareness of experimental safety.
[0122] Adaptive learning modules
[0123] Personalized assessment test: Generate personalized assessment test questions based on students' learning progress and ability level to accurately evaluate students' learning effects.
[0124] Dynamic learning path adjustment: Dynamically adjust the learning path and difficulty based on assessment test results and students' learning feedback to ensure the pertinence and effectiveness of learning content.
[0125] Learning achievement system: Establish a learning achievement system to record students’ learning outcomes and progress, and motivate students to continue learning and challenge themselves.
[0126] Third-party application integration module
[0127] Developer community: Establish a third-party developer community, provide technical support and documentation resources, and encourage developers to develop more high-quality educational applications.
[0128] Application Market: Establish an education application market to display and recommend high-quality third-party education applications to facilitate teachers and students to choose and use them.
[0129] Data security and privacy protection: When integrating third-party applications, strictly abide by data security and privacy protection regulations to ensure the security and privacy of user data.
[0130] The method of the virtual classroom system specifically includes the following steps:
[0131] Step 1: Build the WebRTC platform;
[0132] Build an audio and video real-time communication platform based on the WebRTC MCU (Multiple Control Unit) architecture, and deploy the WebRTC service on a server with a public network address; this platform supports online multi-point interactive courses, and participants can join the class only through the browser client to achieve instant audio and video communication.
[0133] Step 2: Media gateway deployment;
[0134] The media gateway service is deployed on the intranet server, which can seamlessly connect to the WebRTC server. The audio and video data of the participants collected by the WebRTC module are forwarded to the media gateway in real time. The media gateway is responsible for converting this data into an internal Ethernet multicast stream and distributing it to each required decoding terminal through the switch.
[0135] Step 3: Speaker audio and video encoding;
[0136] Install a dedicated embedded audio and video encoder in the main lecture classroom. The encoder is equipped with a network interface and an audio and video input interface to receive audio and video signals collected by the lecturer's camera and microphone. After the encoder efficiently compresses and encodes the audio and video data, it sends the encoded data to the media gateway. After receiving the data, the media gateway encapsulates it in the WebRTC format and distributes it to all participants as the main lecture source.
[0137] Step 4: Distributed decoding service;
[0138] A distributed decoding service is composed of multiple dedicated embedded audio and video decoders, each of which is equipped with a network interface and an audio and video output interface. The management control module sends instructions to the decoder, instructing it to select a specific multicast source for decoding, and output the decoded audio and video signals to the corresponding display and audio equipment. It supports multi-decoder to multi-display mode to ensure that each audio and video stream can be displayed independently and clearly.
[0139] Step 5: System management and control;
[0140] Open or close the WebRTC service, group courses, and control the opening and closing of audio and video streams; notify the distributed decoder to select the multicast source and adjust the screen layout to meet the needs of different teaching scenarios; set or modify the audio and video encoding format to ensure the efficiency and compatibility of audio and video data during transmission;
[0141] Step 6: Build an immersive environment;
[0142] Introducing VR / AR technology to build a three-dimensional virtual classroom environment, providing participants with an immersive learning experience; supporting natural interaction methods such as gesture recognition and voice interaction to enhance classroom interactivity and fun;
[0143] Step 7: Personalized learning plan;
[0144] Based on the user's learning history, grades and preferences, intelligent algorithms are used to plan personalized learning paths; suitable learning resources and courses are recommended to help users achieve their learning goals efficiently;
[0145] Step 8: Construction of teaching resource library;
[0146] Build a rich and diverse multimedia teaching resource library, support online editing, uploading and sharing of teaching resources; provide teachers with rich teaching materials and provide students with convenient access to learning materials;
[0147] Step 9: Cloud storage and synchronization;
[0148] Use cloud computing technology to achieve cloud storage and cross-device synchronization of user data; ensure that users can continue their previous learning progress when switching seamlessly between different devices, improving learning efficiency and convenience;
[0149] Step 10: Data analysis and evaluation;
[0150] Conduct big data analysis on users' learning behaviors, grades and feedback, and provide detailed learning evaluation and feedback reports; help teachers understand students' learning situations and adjust teaching strategies; help students understand their own learning outcomes and develop more reasonable learning plans.
[0151] The method steps of the virtual classroom system also include:
[0152] Step 1: Multi-language support and international communication: The multi-language support module provides real-time translation and subtitle functions, supports multiple language interfaces and interaction methods, and promotes barrier-free communication and learning among international students;
[0153] Step 2: Collaborative learning and team building: The collaborative learning module encourages cooperation and communication among students, provides online collaborative tools and discussion area functions, and helps students solve problems together, share experiences, and improve team collaboration capabilities.
[0154] Step 3: Virtual experiment and hands-on practice: The virtual experiment module provides students with a virtual experimental environment and experimental equipment, allowing students to perform experimental operations, observe phenomena, and verify theories in a virtual environment, thereby enhancing their practical ability and innovative thinking.
[0155] Step 4: Adaptive learning system: The adaptive learning module automatically adjusts the teaching content and difficulty according to the students’ learning feedback and performance, providing students with a personalized learning experience. This module can intelligently identify students’ learning bottlenecks and difficulties, and provide them with targeted coaching and support.
[0156] Step 5: Third-party application integration: The third-party application integration module allows teachers or students to seamlessly integrate external tools, applications or resources into the virtual classroom. These external applications can enrich teaching content, improve teaching effectiveness, and meet the diverse needs of students.
[0157] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.
[0158] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. An immersive virtual classroom system, characterized by: The immersive virtual classroom system includes a core module and an extension module; The core modules include: WebRTC module, media gateway module, audio and video encoding module, distributed audio and video decoding module, management and control module, immersive interaction module, personalized learning path planning module, teaching resource library module, cloud storage and synchronization module and data analysis and evaluation module.
2. An immersive virtual classroom system according to claim 1, characterized in that: The WebRTC module includes a WebRTC server; it receives all audio and video stream data and sends the speaker's content to each participant. Participants can participate in online courses through a browser without installing a client.
3. The immersive virtual classroom system according to claim 1, characterized in that: The media gateway module is connected to the public network and the LAN of the main lecture area to perform protocol conversion and media forwarding; The media gateway module converts the input audio and video stream data into the WebRTC protocol and sends it to all participants; On the one hand, it receives the video stream data sent by the WebRTC module, performs protocol conversion and then multicasts it in the local area network; on the other hand, it receives the audio and video data of the main lecture area sent by the distributed audio and video decoding module, performs protocol conversion and then sends it to the WebRTC module.
4. The immersive virtual classroom system according to claim 1, characterized in that: The audio and video encoding module encodes the collected audio and video data and forwards it to the media gateway module; Use a private protocol to transmit the encoded audio and video data to the media gateway module; The distributed audio and video decoding module decodes the audio and video data multicast by the media gateway module and outputs it to the corresponding display device and audio equipment; The management control module performs corresponding management and parameter configuration on the services involved.
5. The immersive virtual classroom system and method according to claim 1, characterized in that: The immersive interaction module includes: Compatibility of interactive devices: Supports a variety of VR / AR devices and interaction methods, such as gesture recognition and voice control, to improve the user's interactive experience and immersion; Virtual environment customization: Provide customized services for virtual classroom environments, including scene design, item placement, and interactive elements to meet the needs of different teaching scenarios; The personalized learning path planning module includes: Learning outcome prediction: Use machine learning algorithms to predict students’ learning outcomes and potential difficulties, intervene in advance and provide targeted tutoring resources; Adaptive feedback mechanism: dynamically adjust the learning path and difficulty based on students' learning progress and feedback, and provide personalized learning suggestions and feedback.
6. The immersive virtual classroom system and method according to claim 1, characterized in that: The teaching resource library module includes: Smart tags and retrieval: Add smart tags to teaching resources to support quick retrieval and recommendation based on content; provide semantic search function to improve the accuracy and efficiency of resource search; Copyright management and compliance: Establish a strict copyright management mechanism to ensure the legality and compliance of teaching resources; Support copyright information registration, review and rights protection functions; The cloud storage and synchronization module includes: High availability and data backup: Distributed storage architecture and redundant backup mechanism are used to ensure high availability and security of user data; Real-time synchronization technology: Real-time synchronization technology is used to achieve instant synchronization of user data between different devices to ensure the continuity of learning experience; The data analysis and evaluation module includes: Multi-dimensional analysis: Analyze users' learning behaviors and effects from the dimensions of learning time, participation, and performance, and provide a comprehensive learning evaluation report; Visual reports: Provide intuitive and easy-to-understand visual reports to help teachers and administrators quickly understand students' learning situation and system operation status.
7. The immersive virtual classroom system and method according to claim 1, characterized in that: The extension modules include: a multi-language support module, a collaborative learning module, a virtual experiment module, an adaptive learning module and a third-party application integration module.
8. The method of an immersive virtual classroom system according to claim 1, characterized in that: The method of the virtual classroom system specifically comprises the following steps: Step 1: Build the WebRTC platform; Build a real-time audio and video communication platform based on the WebRTC MCU architecture and deploy the WebRTC service on a server with a public network address; Step 2: Media gateway deployment; The media gateway service is deployed on the intranet server, which can seamlessly connect to the WebRTC server. The audio and video data of the participants collected by the WebRTC module are forwarded to the media gateway in real time. The media gateway is responsible for converting this data into an internal Ethernet multicast stream and distributing it to each required decoding terminal through the switch. Step 3: Speaker audio and video encoding; Install a dedicated embedded audio and video encoder in the main lecture classroom. The encoder is equipped with a network interface and an audio and video input interface to receive audio and video signals collected by the lecturer's camera and microphone. After the encoder efficiently compresses and encodes the audio and video data, it sends the encoded data to the media gateway. After receiving the data, the media gateway encapsulates it in the WebRTC format and distributes it to all participants as the main lecture source. Step 4: Distributed decoding service; A distributed decoding service is composed of multiple dedicated embedded audio and video decoders, each of which is equipped with a network interface and an audio and video output interface; the management control module sends instructions to the decoder, instructing it to select a specific multicast source for decoding, and output the decoded audio and video signals to the corresponding display and audio equipment; Step 5: System management and control; Open or close the WebRTC service, group courses, and control the opening and closing of audio and video streams; notify the distributed decoder to select the multicast source and adjust the screen layout to meet the needs of different teaching scenarios; set or modify the audio and video encoding format to ensure the efficiency and compatibility of audio and video data during transmission; Step 6: Build an immersive environment; Introducing VR / AR technology to build a three-dimensional virtual classroom environment, providing participants with an immersive learning experience; supporting natural interaction methods such as gesture recognition and voice interaction to enhance classroom interactivity and fun; Step 7: Personalized learning plan; Based on the user's learning history, grades and preferences, intelligent algorithms are used to plan personalized learning paths; suitable learning resources and courses are recommended to help users achieve their learning goals efficiently; Step 8: Construction of teaching resource library; Build a rich and diverse multimedia teaching resource library, support online editing, uploading and sharing of teaching resources; provide teachers with rich teaching materials and provide students with convenient access to learning materials; Step 9: Cloud storage and synchronization; Use cloud computing technology to achieve cloud storage and cross-device synchronization of user data; ensure that users can continue their previous learning progress when switching seamlessly between different devices, improving learning efficiency and convenience; Step 10: Data analysis and evaluation; Conduct big data analysis on users' learning behaviors, grades and feedback, and provide detailed learning evaluation and feedback reports; help teachers understand students' learning situations and adjust teaching strategies; help students understand their own learning outcomes and develop more reasonable learning plans.
9. The method of an immersive virtual classroom system according to claim 1, characterized in that: The method steps of the virtual classroom system also include: Step 1: Multi-language support and international communication: The multi-language support module provides real-time translation and subtitle functions, supports multiple language interfaces and interaction methods, and promotes barrier-free communication and learning among international students; Step 2: Collaborative learning and team building: The collaborative learning module encourages cooperation and communication among students, provides online collaborative tools and discussion area functions, and helps students solve problems together, share experiences, and improve team collaboration capabilities. Step 3: Virtual experiment and hands-on practice: The virtual experiment module provides students with a virtual experimental environment and experimental equipment, allowing students to perform experimental operations, observe phenomena, and verify theories in a virtual environment, thereby enhancing their practical ability and innovative thinking. Step 4, Adaptive learning system: The adaptive learning module automatically adjusts the teaching content and difficulty according to the students' learning feedback and performance, providing students with a personalized learning experience; Step 5. Third-party application integration: The third-party application integration module allows teachers or students to seamlessly integrate external tools, applications or resources into the virtual classroom.
Citation Information
Cited By
Virtual environment-based advanced training course resource adaptation method
CN119417670A
