Accompanying type interactive education system based on instant structure real-time audio and video communication

Abstract

The invention belongs to the technical field of online education, and particularly relates to an accompanying type interactive education system based on instant construction real-time audio and video communication, which is used for improving the flexibility and convenience of online education and solving the problems of network fluctuation, high delay, poor user experience and the like in traditional live teaching. By optimizing a real-time communication protocol, a dynamic code rate adaptive algorithm, a redundant data packet retransmission mechanism, CDN node coverage, a low-delay technology and a first-screen second-opening technology, the flexibility and convenience of online education are comprehensively improved, smooth and low-delay audio and video communication can be ensured to be realized in various network environments, the teacher-student interaction efficiency is improved, and the user experience is improved. The learning effect is enhanced.

Description

Technical Field

[0001] The present invention belongs to the technical field of online education, and in particular relates to a companion-type interactive education system based on real-time audio and video communication. Background Art

[0002] With the rapid development of Internet technology, online learning has become an important part of education. Although traditional live teaching can achieve remote teaching, there are many problems in practical applications, such as audio and video freezes caused by network fluctuations, high latency, and poor user experience. These problems seriously affect the interaction efficiency and learning effect between teachers and students. Therefore, how to achieve smooth and low-latency audio and video communication in various network environments has become an important research direction of online education technology.

[0003] Although the existing companion learning technology has solved some problems to a certain extent, it still has the following shortcomings: Network fluctuation problem: In a weak network environment, the quality of audio and video is easily affected, resulting in problems such as live broadcast freezes and interruptions. High latency: The delay in audio and video transmission directly affects the communication efficiency and teaching effect between teachers and students, especially in real-time interactive teaching services. High latency will lead to poor interaction between teachers and students. Poor user experience: When users open live courses, they expect the page to load extremely quickly, but existing technologies are difficult to meet this demand, resulting in low user participation and satisfaction. Summary of the invention

[0004] The purpose of the present invention is to provide a companion interactive education system based on instant real-time audio and video communication to solve the problems raised in the above background technology.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is:

[0006] A companion interactive education system based on iQiyi real-time audio and video communication, including the following contents: optimizing real-time communication protocols to improve the efficiency and stability of data transmission; dynamically adjusting the video bit rate according to the network bandwidth through a dynamic bit rate adaptive algorithm to ensure video quality and transmission stability; adopting a redundant data packet retransmission mechanism to add redundant data packets during data transmission and automatically retransmit lost data packets when data packet loss is detected; ensuring deep coverage of the content distribution network across the country and reducing access delays through extensive CDN node coverage; applying low-latency technology, optimizing transmission links and adopting efficient encoding and decoding technology to reduce end-to-end delays; implementing first-screen opening technology to ensure that users can quickly see content when opening the live broadcast page through preloading key frames and CDN edge caching mechanism.

[0007] The optimized real-time communication protocol includes: improving the underlying design of the transmission protocol, reducing unnecessary handshake and confirmation steps, and enhancing data transmission efficiency; dynamically adjusting transmission parameters according to network bandwidth and quality to ensure stable data transmission in different network environments.

[0008] The dynamic bitrate adaptation algorithm includes: real-time monitoring of network bandwidth and packet loss rate, and dynamically adjusting the video bitrate; adopting a smooth switching technique during bitrate adjustment to avoid stuttering caused by sudden bitrate changes; reasonably managing the buffer to ensure that there is no buffer overflow or idle situation during bitrate adjustment.

[0009] The redundant packet retransmission mechanism includes: generating redundant packets at the sending end to ensure data integrity; automatically requesting retransmission of lost packets when the receiving end detects packet loss; selecting an appropriate retransmission strategy according to network conditions and packet loss situations to improve retransmission efficiency.

[0010] The extensive CDN node coverage includes: deploying a large number of CDN nodes nationwide to ensure in-depth coverage of the content delivery network; using intelligent DNS scheduling technology to select the nearest CDN node according to the user's location to reduce access latency; adopting the principle of nearest access and preferentially selecting the CDN node closest to the user to improve access speed.

[0011] The low-latency technology includes: optimizing the transmission link, reducing the network transmission hierarchy, and lowering the end-to-end latency; adopting efficient encoding and decoding technologies to improve the compression and decompression efficiency of audio and video data, further reducing latency; through cloud-based bitstream synthesis technology, achieving lower-latency video switching and splicing to ensure the best real-time performance during live interactions.

[0012] The first-screen instant opening technology includes: through preloading technology, preloading key frames in advance to ensure that users can quickly see the content when opening the live page; adopting a key-frame priority push strategy to ensure that the first key frame can quickly reach the client and improve page loading speed; using the CDN edge caching mechanism to cache the first key frame of the live stream to the nearest CDN node to further improve the loading speed.

[0013] It also includes the intelligent processing of multimedia content, specifically including: real-time optimization of audio and video content through intelligent algorithms to improve audio and video quality; using deep learning technology to perform real-time identification and filtering of live content to ensure the legality and security of the content; through AR (augmented reality) and VR (virtual reality) technologies, enhancing the live interaction effect and improving user participation.

[0014] It also includes data security and privacy protection measures, specifically including: encrypting the transmitted data to prevent it from being stolen during transmission; adopting multi-factor authentication technology to ensure the authenticity and legality of user identities; complying with relevant laws and regulations to protect users' personal privacy and not collecting or using users' sensitive information.

[0015] It also includes the construction of an interactive teaching platform, a course management and evaluation system, specifically including: providing a virtual classroom environment to support multi-person online learning and interaction simultaneously; realizing real-time interaction between teachers and students through functions such as chat rooms, Q&A, and gifts; providing a teaching resource management function to support the uploading, downloading, and sharing of courseware; supporting the creation, editing, publishing, and management of courses, and providing rich course management functions; supporting students' registration, login, permission management, and learning progress tracking; providing course evaluation and student evaluation functions to support mutual evaluation between teachers and students and improve teaching effectiveness.

[0016] In summary, due to the adoption of the above technical solutions, the beneficial effects of the present invention are as follows:

[0017] By optimizing the real-time communication protocol, dynamic bitrate adaptation algorithm, redundant data packet retransmission mechanism, extensive CDN node coverage, low-latency technology, and first-screen instant opening technology, the present invention comprehensively improves the flexibility and convenience of online education, can ensure smooth and low-latency audio and video communication in various network environments, improve the interaction efficiency between teachers and students, and enhance the learning effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a system architecture diagram of an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0019] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. Generally, the components of the embodiments of the present invention described and illustrated in the drawings here can be arranged and designed in various different configurations.

[0020] Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of the claimed present invention, but merely represents selected embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts fall within the scope of protection of the present invention.

[0021] 1. System Architecture

[0022] As Figure 1As shown in the figure, a companion interactive education system based on ZEGO's real-time audio and video communication mainly includes the following parts:

[0023] Server: Responsible for processing live requests, managing live rooms, scheduling CDN nodes, etc.

[0024] Teacher's terminal: Simulate the behavior of real teachers and provide real-time interactive teaching.

[0025] ZEGO network transmission: Provide real-time audio and video transmission services.

[0026] Client: Users watch live courses and participate in interactions through the client.

[0027] Classroom question bank: Store teaching questions and answers.

[0028] Video library: Store teaching video clips.

[0029] 2. Optimization of real-time communication protocol

[0030] The present invention optimizes the real-time communication protocol by integrating ZEGO to improve the efficiency and stability of data transmission. Traditional real-time communication protocols are prone to problems such as packet loss and high latency in the face of complex network environments. The optimization of the real-time communication protocol mainly includes the following measures:

[0031] Protocol improvement: Improve the underlying design of the transmission protocol, reduce unnecessary handshake and confirmation steps, and improve the efficiency of data transmission.

[0032] Dynamic adjustment of transmission parameters: Dynamically adjust transmission parameters according to network bandwidth and quality to ensure stable data transmission in different network environments.

[0033] Packet segmentation: Split large chunks of data into small packets to reduce the transmission time of individual packets and improve transmission efficiency.

[0034] 3. Dynamic bitrate adaptation algorithm

[0035] In order to ensure high-quality audio and video experience in different network environments, the present invention introduces a dynamic bitrate adaptation algorithm by integrating ZEGO. This algorithm can dynamically adjust the video bitrate according to network bandwidth and quality to ensure video quality and transmission stability. It mainly includes the following:

[0036] Real-time monitoring of network conditions: Dynamically adjust the video bitrate by real-time monitoring of network bandwidth and packet loss rate.

[0037] Smoothing switching: During the bitrate adjustment process, adopt smoothing switching technology to avoid stuttering caused by sudden changes in bitrate.

[0038] Buffer Management: Reasonably manage the buffer to ensure that there is no buffer overflow or idle situation during the bitrate adjustment process.

[0039] 4. Redundant Packet Retransmission Mechanism

[0040] To improve the reliability of data transmission, the present invention introduces a redundant packet retransmission mechanism through Zego. During the data transmission process, redundant packets are added, and when a packet loss is detected, the lost packet is automatically retransmitted. The following measures are included:

[0041] Redundant Packet Generation: Generate redundant packets at the sender to ensure data integrity.

[0042] Automatic Retransmission: When a packet loss is detected at the receiver, automatically request retransmission to ensure the reliability of data transmission.

[0043] Retransmission Strategy: Select an appropriate retransmission strategy according to the network condition and packet loss situation to improve the retransmission efficiency.

[0044] 5. Extensive CDN Node Coverage

[0045] To ensure the access speed of users nationwide and even globally, the present invention uses Zego's extensive CDN node coverage. The following measures are taken to ensure the deep coverage of the content delivery network:

[0046] CDN Node Layout Nationwide: Deploy a large number of CDN nodes around the world to ensure the deep coverage of the content delivery network.

[0047] Intelligent DNS Scheduling: Through intelligent DNS scheduling technology, select the nearest CDN node according to the user's location to reduce the access latency.

[0048] Proximity Access Principle: When users access live content, give priority to selecting the nearest CDN node to improve the access speed.

[0049] 6. Low Latency Technology

[0050] To improve the communication efficiency and teaching effect of real-time interactive teaching services, the present invention introduces low latency technology through Zego. The following specific measures are included:

[0051] Optimize the Transmission Link: By optimizing the transmission link, reduce the network transmission levels and lower the end-to-end latency.

[0052] Efficient Coding and Decoding Technology: Adopt efficient coding and decoding technology to improve the compression and decompression efficiency of audio and video data, and further reduce the latency.

[0053] Cloud Bitstream Synthesis Technology: Through the cloud bitstream synthesis technology, lower-latency video switching and splicing are achieved, ensuring that the real-time performance during live interactions reaches the best level.

[0054] 7. First-screen Instant Loading Technology

[0055] To improve the user experience when opening a live course, the present invention introduces the first-screen instant loading technology through integration with ZEGO. Specifically, it includes the following:

[0056] Preloading Technology: Key frames are preloaded in advance to ensure that users can quickly view the content when opening the live page.

[0057] Key Frame Priority Pushing Strategy: Through the key frame priority pushing strategy, it is ensured that the first key frame can quickly reach the client, improving the page loading speed.

[0058] CDN Edge Caching Mechanism: Utilizing the CDN edge caching mechanism, the first key frame of the live stream is cached to the nearest CDN node to further improve the loading speed.

[0059] 8. Intelligent Processing of Multimedia Content

[0060] To further enhance the user experience, the present invention introduces the intelligent processing technology of multimedia content through integration with ZEGO. Specifically, it includes the following steps:

[0061] Audio and Video Quality Optimization: The audio and video content is optimized in real time through intelligent algorithms to improve the audio and video quality.

[0062] Content Recognition and Filtering: Deep learning technology is used to identify and filter the live content in real time to ensure the legality and security of the content.

[0063] Enhanced Interaction Effects: Through AR (Augmented Reality) and VR (Virtual Reality) technologies, the live interaction effects are enhanced to improve user participation.

[0064] 9. Data Security and Privacy Protection

[0065] To ensure the security and privacy of user data, the present invention adopts a variety of data security and privacy protection measures through integration with ZEGO. Specifically, the following measures are included:

[0066] Data Encryption: The data transmitted is encrypted to prevent the data from being stolen during transmission.

[0067] Identity Authentication: Multifactor identity authentication technology is adopted to ensure the authenticity and legality of user identities.

[0068] Privacy Protection: Comply with relevant laws and regulations to protect the personal privacy of users, and do not collect and use users' sensitive information.

[0069] 10. Construction of an Interactive Teaching Platform

[0070] To support real-time interactive teaching, the present invention constructs an interactive teaching platform. Specifically, it includes:

[0071] Live Classroom: Provides a virtual classroom environment, supporting multi-person online learning and interaction simultaneously.

[0072] Real-time Interaction: Through functions such as chat rooms and Q&A, real-time interaction between teachers and students is achieved.

[0073] Teaching Resource Management: Provides teaching resource management functions, supporting the uploading, downloading, and sharing of courseware.

[0074] 11. Course Management and Evaluation System

[0075] To improve the efficiency and effectiveness of teaching management, the present invention introduces a course management and evaluation system. Specific measures include:

[0076] Course Management: Supports the creation, editing, publishing, and management of courses, providing rich course management functions.

[0077] Student Management: Supports student registration, login, permission management, and learning progress tracking.

[0078] Evaluation System: Provides course evaluation and student evaluation functions, supporting mutual evaluation between teachers and students to improve teaching effects.

[0079] 12. Technological Innovation and Application Prospect

[0080] The technological innovation points of the present invention are mainly reflected in the following aspects:

[0081] Strong Network Adaptability: By optimizing the real-time communication protocol and dynamic bitrate adaptive algorithm, the present invention can achieve smooth and low-latency audio and video communication in various network environments.

[0082] High Interaction: Through low-latency technology and real-time interaction functions, the present invention can significantly improve the interaction efficiency between teachers and students and enhance learning effects.

[0083] Good User Experience: Through the first-screen instant opening technology and intelligent processing of multimedia content, the present invention can provide a high-quality user experience, improving user participation and satisfaction.

[0084] 13. Implementation Case

[0085] The present invention has been practically applied in the Dayuzhongxue APP and the Dayuzhongxue Live Streaming Mini Program platform, achieving good results.

Claims

1. A companion interactive education system based on ZEGO real-time audio and video communication, characterized in that, It includes the following: Optimize the real-time communication protocol to improve the efficiency and stability of data transmission; Through the dynamic bitrate adaptation algorithm, dynamically adjust the video bitrate according to the network bandwidth to ensure video quality and transmission stability; Adopt a redundant packet retransmission mechanism, add redundant packets during data transmission, and automatically retransmit the lost packets when packet loss is detected; Through extensive CDN node coverage, ensure deep coverage of the content delivery network nationwide and reduce access latency; Apply low-latency technology, optimize the transmission link and adopt efficient encoding and decoding technologies to reduce end-to-end latency; Implement the first-screen instant opening technology. Through preloading key frames and the CDN edge caching mechanism, ensure that users can quickly see the content when opening the live page.

2. The companion interactive education system based on ZEGO real-time audio and video communication according to claim 1, characterized in that, The optimized real-time communication protocol includes: Improve the underlying design of the transmission protocol, reduce unnecessary handshake and confirmation steps, and improve data transmission efficiency; Dynamically adjust transmission parameters according to network bandwidth and quality to ensure stable data transmission in different network environments.

3. The companion interactive education system based on Zego real-time audio and video communication according to claim 1, characterized in that, The dynamic bitrate adaptation algorithm includes: Real-time monitor network bandwidth and packet loss rate, and dynamically adjust the video bitrate; Adopt smooth switching technology during bitrate adjustment to avoid stuttering caused by sudden bitrate changes; Reasonably manage the buffer to ensure that there is no buffer overflow or idle situation during bitrate adjustment.

4. The companion interactive education system based on Zego real-time audio and video communication according to claim 1, wherein The redundant packet retransmission mechanism includes: Generate redundant packets at the sender to ensure data integrity; When packet loss is detected at the receiver, automatically request retransmission of the lost packets; According to network conditions and packet loss situations, select appropriate retransmission strategies to improve retransmission efficiency.

5. The companion interactive education system based on ZEGO real-time audio and video communication according to claim 1, wherein, The extensive CDN node coverage includes: Deploy a large number of CDN nodes nationwide to ensure deep coverage of the content delivery network; Through intelligent DNS scheduling technology, select the nearest CDN node according to the user's location to reduce access latency; Adopt the principle of nearest access, and preferentially select the CDN node closest to the user to improve access speed.

6. The companion interactive education system based on Zego real-time audio and video communication according to claim 1, wherein, The low-latency technology includes: Optimize the transmission link, reduce the network transmission level, and reduce end-to-end latency; Adopt efficient encoding and decoding technologies to improve the compression and decompression efficiency of audio and video data, and further reduce latency; Through cloud stream synthesis technology, achieve lower-latency video switching and splicing, and ensure that the real-time performance during the live interaction process reaches the best level.

7. An interactive education system based on Zego real-time audio and video communication according to claim 1, characterized in that The first-screen instant opening technology includes: Through preloading technology, preload key frames in advance to ensure that users can quickly see the content when opening the live page; Adopt the key frame priority push strategy to ensure that the first key frame can reach the client quickly and improve the page loading speed; Utilize the CDN edge caching mechanism to cache the first key frame of the live stream to the nearest CDN node to further improve the loading speed.

8. The companion interactive education system based on ZEGO real-time audio and video communication according to claim 1, characterized in that, It also includes intelligent processing of multimedia content, specifically including: Real-time optimize audio and video content through intelligent algorithms to improve audio and video quality; Utilize deep learning technology to perform real-time recognition and filtering of live content to ensure the legality and security of the content. Enhance the live interactive effect and improve user engagement through AR (Augmented Reality) and VR (Virtual Reality) technologies.

9. The companion interactive education system based on Zego real-time audio and video communication according to claim 1, wherein, It also includes data security and privacy protection measures, specifically including: Encrypt the transmitted data to prevent it from being stolen during transmission; Adopt multi-factor authentication technology to ensure the authenticity and legality of user identities; Comply with relevant laws and regulations to protect users' personal privacy and do not collect or use users' sensitive information.

10. The companion interactive education system based on Zego real-time audio and video communication according to claim 1, characterized in that, It also includes the construction of an interactive teaching platform, a course management and evaluation system, specifically including: Provide a virtual classroom environment to support multi-person online learning and interaction simultaneously; Achieve real-time interaction between teachers and students through functions such as chat rooms, Q&A, and gifts; Provide a teaching resource management function to support the upload, download, and sharing of courseware; Support the creation, editing, publishing, and management of courses, providing rich course management functions; Support student registration, login, permission management, and learning progress tracking; Provide course evaluation and student evaluation functions to support mutual evaluation between teachers and students and improve teaching effectiveness.

Images