Patents
Literature
173 results about "Instructional video" patented technology
Efficacy Topic
Property
Owner
Technical Advancement
Application Domain
Technology Topic
Technology Field Word
Patent Country/Region
Patent Type
Patent Status
Application Year
Inventor
Automatic lecturer video generation method based on AI speech synthesis and animation driving
ActiveCN120897102AProgram initiation/switchingDigital data information retrievalData streamAlgorithm
The invention discloses a lecturer video automatic generation method based on AI speech synthesis and animation driving. The method comprises the following steps: performing structured analysis on a PPT or a text script through an improved interior point method and an incremental shortest path algorithm; performing semantic grouping by applying a full-dynamic parallel single-link clustering algorithm and generating an enhanced script with an expressive mark; a CosyVoice technology is combined with a low-rank approximation method to generate a high-quality voice data stream; establishing a mapping relation between contents and action expressions through semantic analysis, and generating a complete action expression instruction set; and driving the digital human model by using the msueTalk technology, and generating a final lecturer teaching video through a parallel rendering algorithm. According to the invention, the method achieves the efficient and automatic generation of the education video, remarkably improves the content production efficiency, reduces the production cost, and guarantees the specialty and expressive force of the teaching video.
Owner:SHENZHEN XUEYOU TECHNOLOGY CO LTD
Interactive three-dimensional teaching resource generation system and method based on 3D Gaussian splashing
ActiveCN121170164AInput/output for user-computer interactionGraph readingSequence reconstructionComputer graphics (images)
The invention discloses an interactive three-dimensional teaching resource generation system and method based on 3D Gaussian splashing, and belongs to the technical field of three-dimensional reconstruction, and the system comprises a multi-view image obtaining module which is used for extracting a multi-view image sequence related to a teaching theme from a teaching video resource, and determining the category of each structural region in each view image; the enhanced three-dimensional reconstruction module is used for reconstructing the multi-view image sequence into a three-dimensional teaching model; determining the anchor point attribute of each anchor point in the three-dimensional teaching model; the intelligent interaction module is used for acquiring a user instruction; determining a target anchor point according to the user instruction, and obtaining an anchor point attribute corresponding to the target anchor point; and the three-dimensional visualization module is used for performing rendering display on the three-dimensional teaching model and displaying the anchor point attribute corresponding to the target anchor point. The three-dimensional teaching model which has interaction capability and is subjected to structured knowledge labeling can be generated. The technical problem that a current three-dimensional model lacks intelligent interaction capability is solved.
Owner:HUAZHONG NORMAL UNIV
Hemodialysis teaching system based on AI intelligent pushing
The invention relates to the technical field of hemodialysis teaching systems, and discloses a hemodialysis teaching system based on AI intelligent pushing. The system comprises an operation feature extraction module, an instrument positioning analysis module, an operation step analysis module and a teaching strategy generation module. Operating a feature extraction module to obtain a hemodialysis teaching video stream, and extracting multi-modal features containing an instrument movement track sequence and physiological parameter simulation data; an instrument positioning analysis module calls a pre-training network for positioning and generates a coordinate data set containing instrument types and three-dimensional position coding mapping; the operation step analysis module analyzes the time sequence characteristics by means of an action segmentation model, and generates a result containing step integrity and an error operation mark; and the teaching strategy generation module inputs a result into the intelligent push model, plans a personalized teaching path, outputs a knowledge point sequence containing a student ability model and dynamic teaching elements of operation difficulty parameters, and assists the hemodialysis teaching to be precise and personalized.
Owner:晋江市医院(上海市第六人民医院福建医院)
Education virtual human generation method and device based on teaching plan driving, equipment and medium
The invention discloses an educational virtual human generation method and device based on teaching plan driving, equipment and a medium, and relates to the technical field of virtual human. The method comprises: acquiring a voice file; a first image frame is obtained. And repeating the subsequent steps until the voice ends, and obtaining an image frame sequence. And carrying out synchronous synthesis to obtain a teaching video of the virtual human. And extracting portrait features of the target frame and audio features of the next frame, and aligning the portrait features and the audio features to obtain multi-modal alignment features. Identity feature parameters, expression coefficient parameters and attitude parameters are extracted from portrait features, then the parameters are converted into face three-dimensional point cloud information through a FLAME model, position coding is carried out, and query embedded features are obtained. And performing fusion by taking the query embedding feature and the multi-modal alignment feature as main inputs and taking the audio feature as a condition to obtain a visual alignment feature. And fusing and modulating the visual alignment features, the identity feature parameters, the expression coefficient parameters and the attitude parameters into Gaussian representation, projecting the Gaussian representation to a two-dimensional image plane, and then fusing the Gaussian representation to obtain a next image frame.
Owner:XIAMEN UNIV OF TECH
Classroom teaching evaluation generation method and system based on multi-modal large model
The invention provides a classroom teaching evaluation generation method and system based on a multi-modal large model, and belongs to the technical field of artificial intelligence and education, and the method comprises the steps: S1, defining an analysis task; s2, setting unified prompt words for guiding model generation: role setting, core tasks and structure requirements; s3, performing fine adjustment on the detector by using the corresponding task domain target detection data set; and S4, integrating a detector, a region slice detection strategy, an optical character recognition technology, a voice recognition technology and a framework of a plurality of large models, taking a teaching video and a corresponding audio as input of the classroom teaching evaluation model, and outputting a structured teaching evaluation analysis report. According to the method provided by the invention, a better effect is obtained on various evaluation standards, the quality of an evaluation report is higher, and the method can be expanded to any classroom scene only by replacing or finely adjusting a detector capable of adapting to a new scene, so that efficient and low-cost framework migration is realized, and meanwhile, high performance is ensured.
Owner:BEIHANG UNIV
Teaching quality management and control method and device, computer equipment and storage medium
The invention discloses a teaching quality management and control method and device, computer equipment and a storage medium. The method comprises the following steps: analyzing teaching behaviors of teachers and classroom performance behaviors of students in a real teaching video to obtain a first teaching quality evaluation result; generating a second teaching quality evaluation result according to the evaluation of the students on the teaching quality; generating a third teaching quality evaluation result according to the evaluation of the teacher on the teaching quality; generating a fourth teaching quality evaluation result according to the student score; and optimizing the weight of each teaching quality evaluation result by adopting an improved particle swarm optimization algorithm, calculating a comprehensive score through the optimized weight, and generating a final teaching quality evaluation report according to each teaching quality evaluation result and the comprehensive score. Therefore, a technical problem that it is difficult to understand the teaching condition of the teacher in a manner of evaluating the teaching quality only through one manner in the related art is solved.
Owner:GUANGXI COLLEGE OF WATER RESOURCES & ELECTRIC POWER
Student classroom behavior analysis method and device, electronic equipment and storage medium
PendingCN121033926ACharacter and pattern recognitionBiological modelsComputer graphics (images)Engineering
The invention provides a student classroom behavior analysis method and device, electronic equipment and a storage medium, and relates to the technical field of artificial intelligence education application. The method comprises the following steps: coding selected video clips of samples of a sample classroom teaching video to obtain a sample image block vector sequence; generating a sample state accumulation vector according to the continuous concentration fragment number and the continuous non-concentration fragment number; performing visual coding on the sample image block vector sequence and the sample state accumulation vector through an initial visual conversion encoder, performing convolution classification on the obtained sample spatial-temporal feature tensor to obtain a sample fragment concentration prediction category, and training the initial visual conversion encoder to obtain a target visual conversion encoder; and performing visual coding on the target classroom teaching video clip through a target visual conversion encoder, and performing convolution classification on the obtained target spatial-temporal feature tensor to obtain a target clip concentration prediction category. The analysis accuracy and efficiency can be improved.
Owner:SOUTHERN UNIVERSITY OF SCIENCE AND TECHNOLOGY
Video playing device
Owner:东营职业学院
Education course intelligent recording and broadcasting management method
The invention belongs to the technical field of education data management, and particularly discloses an intelligent recording and broadcasting management method for education courses, which comprises the following steps of: acquiring multi-modal data in real time through a multi-sensor group, and comprehensively capturing teaching actions of teachers, limb actions of students, speech audios and running states of teaching equipment; further comparing the feature combination with a pre-stored template feature combination to identify different teaching stages; recording modes are automatically switched according to the identified teaching stage, a main and auxiliary picture polling switching rule is established, and videos recorded at different camera positions are integrated into a composite video with synchronous main and auxiliary pictures; key teaching links of teaching videos are automatically identified, index tags are established, the videos are classified and stored in combination with a preset classification rule, and accordingly video contents meeting user requirements are pushed to different users. Structured management and rapid retrieval of recorded and broadcast video content are realized, and personalized service and utilization efficiency of teaching resources are enhanced.
Owner:FENGYE (SHENZHEN) TECH CO LTD
Online teaching video production method and device based on virtual scene, and medium
The invention discloses an online teaching video production method and device based on a virtual scene, and a medium, belongs to the technical field of teaching video production, and is used for solving the technical problem of high curriculum abandoning rate caused by low construction efficiency, low content updating rate and low knowledge transmission accuracy of an existing online curriculum. The method comprises the steps of customizing a digital teacher image of a target teacher based on modeling software; wherein the digital teacher image comprises a 3D digital teacher image and a 2D digital teacher image; constructing a virtual teaching scene, and training a virtual scene model to identify a user instruction so as to adjust features in the virtual teaching scene; based on the made teaching courseware, generating a corresponding digital human control script and a voice explanation script; placing the digital teacher image and the virtual teaching scene into a virtual environment, and fusing the digital teacher image and the virtual teaching scene with the digital human control script and the voice explanation script to form a virtual teaching model; and performing video rendering on the virtual teaching model to obtain a teaching video.
Owner:INSPUR ZHUOSHU BIG DATA IND DEV CO LTD
Multimodal automatic teaching video generation method and system based on intermediate file
PendingCN121099150ATelevision system detailsColor television detailsDocument transformationEngineering
The invention discloses a multi-modal automatic teaching video generation method and system based on an intermediate file. The analysis module is used for extracting texts and pictures from documents input by a user and constructing a searchable knowledge base. The content generation module retrieves related teaching content texts according to knowledge points specified by a user through calling of a two-stage large language model, and generates an explanation first draft in a free format; and retrieving related pictures, performing format conversion, and combining with the explaining first draft to generate a structured JSON file. The format conversion module is used for converting the JSON file into an intermediate file which can be read by human and can be analyzed by a machine through a predefined template engine; the collaborative review module presents the intermediate file to a user and receives a modification instruction; and the synchronous updating module performs reverse analysis and grammar verification, and updates the original structured data according to the changed content. The material generation module generates corresponding audio and image materials; and the video synthesis module synthesizes the materials into a video file and outputs the video file.
Owner:HANGZHOU DIANZI UNIVERSTIY INFORMATION ENG SCHOOL
Foreign language teaching video generation method and apparatus
The present invention provides a foreign language teaching video generation method and apparatus. The foreign language teaching video generation method comprises: acquiring video subtitle text corresponding to a video to be processed; on the basis of the video subtitle text and a preset explanation generation rule, using a large language model to generate foreign language teaching explanation text of the video subtitle text; generating a corresponding explanation audio on the basis of the foreign language teaching explanation text; determining a time information relationship between the foreign language teaching explanation text and the explanation audio; on the basis of the time information relationship between the foreign language teaching explanation text and the explanation audio, generating a display style corresponding to the explanation audio; and on the basis of the explanation audio, the display style corresponding to the explanation audio, and the time information relationship between the explanation text and the explanation audio, generating an explanation video corresponding to the video to be processed. In the present invention, a target teaching video corresponding to a video to be processed can be automatically generated, and the generated teaching video is highly targeted, so that the personalized requirements of users can be met.
Owner:JIANG QIUSHI
Video frame accurate positioning method based on hierarchical knowledge base
PendingCN120671855ASemantic analysisCharacter and pattern recognitionSemantic alignmentLinguistic model
The invention discloses a video frame precise positioning method based on a hierarchical knowledge base, and the method comprises the steps: carrying out the preprocessing of each teaching video of a MOOC class in an online education platform, and extracting a representative key frame and a precise timestamp of the representative key frame in an original video; on this basis, knowledge points are extracted by means of a visual language large model, and a hierarchical knowledge base structure is constructed; then, carrying out deep semantic analysis on a natural language question input by a user by utilizing a large language model; based on an analysis result, through semantic similarity calculation and a structured reasoning mechanism, positioning a target knowledge point most related to the user intention layer by layer in a knowledge base; furthermore, a teaching video timestamp corresponding to the knowledge point is determined, and interpretable path information is generated based on a reasoning path in the positioning process. The method not only can realize accurate positioning of a key frame level, but also has traceable and explainable semantic alignment capability, and can remarkably improve intelligent understanding and positioning precision of teaching video content.
Owner:PAZHOU LAB (HUANGPU) +1
Intelligent management method for AI big data
PendingCN121616888ACharacter and pattern recognitionBiological modelsEngineeringIntelligent management
The invention discloses an intelligent management method for AI big data, and relates to the technical field of AI video management, and the method comprises the steps: collecting teaching video data, and marking teaching behavior guiding key points; training a knowledge point association model based on the annotated data, extracting video frame feature recognition key points, and generating a key point motion trail; constructing a knowledge point graph, and performing correlation calculation on the key points and the knowledge points to obtain correlation degree factors; calculating a dynamic parameter based on the key point trajectory data, and integrating a correlation factor to optimize a parameter value; defining abnormal video segments, marking video segments deviating from a threshold value through an anomaly detection algorithm, and automatically isolating and deleting the video segments; collecting user behavior data to construct a user portrait, and constructing a user learning path according to the knowledge point graph and the user portrait; calculating a basic matching score of the video segment and the learning path, and obtaining a final matching score through dynamic parameter weighting; and according to the final matching score, dividing the video segment into three storage levels and storing the three storage levels into corresponding storage layers.
Owner:BEIJING XIAONIAN TECHNOLOGY CO LTD
Heterogeneous graph-based multi-modal teaching video abstract generation method
The invention discloses a heterogeneous graph-based multi-modal teaching video abstract generation method. The method comprises the steps of obtaining a plurality of video samples to form a training set; establishing a multi-modal abstract generation model, training by using a training set, and executing the following operations by the model: respectively inputting a video frame sequence and a sentence sequence into a visual feature extraction model and a language model to obtain a visual feature vector set and a text feature vector set to form multi-modal feature representation; initializing an adjacent matrix; performing Hadamard product on the intra-modal constraint matrix, the inter-modal constraint matrix and the adjacent matrix to obtain an optimized heterogeneous graph; executing a double-stage fusion strategy; and screening a key video frame node set and a key sentence node set by using multi-modal unified representation output by the trained multi-modal abstract generation model, and correspondingly reserving a connection relationship in the optimized heterogeneous graph as a sub-adjacency matrix to obtain a multi-modal abstract graph. According to the method, teaching video abstracts with consistent semantics and rich contents can be generated, and the generalization ability is high.
Owner:ZHEJIANG UNIV OF TECH
Learning machine voice instruction interaction method and system
The invention provides a learning machine voice instruction interaction method and system, is applied to the technical field of learning machines, and realizes fine management of help seeking of a user by starting an independent'temporary session state record 'for each knowledge point. By generating'multi-level guide prompts' and'multi-level question exploration ', the system can gradually guide the user to think instead of directly giving answers, so that not only is the independent thinking ability of the user cultivated, but also the system can more accurately judge the real mastering degree of the user on the knowledge point. When the user answers correctly, the system confirms the mastering of the user; and when the answer is incorrect, the system adjusts an auxiliary strategy, such as recommending a teaching video, so that more targeted help is provided. Therefore, according to the method provided by the invention, false triggering of dependence intervention caused by multi-user sharing can be avoided, the accuracy and individuation of an auxiliary strategy of the learning machine are ensured, and the user experience and learning efficiency are remarkably improved.
Owner:HENGSHU HOLDINGS (GUANGDONG) GROUP CO LTD
Cognitive diagnosis method and model based on emotional state
The invention relates to the technical field of intelligent education, in particular to a cognitive diagnosis method and model based on an emotional state, and the model comprises a multi-modal information feature extraction module, a feature alignment layer, a modal selection layer, a self-adaptive super-modal learning layer and a cross-modal fusion conversion layer which are cascaded. The method comprises the following steps: extracting emotion-related multi-modal features from a teaching video, and obtaining knowledge point information corresponding to the emotion-related multi-modal features; the extracted multi-modal features are projected to a unified low-dimensional space, so that data are in the same dimension, and preparation is made for subsequent fusion; adaptively selecting a main mode and an auxiliary mode; emotional semantic expression is formed through information interaction between the main mode and the auxiliary mode; and fusing the main mode and the super-mode state to generate a unified super-mode state representing the emotion cognitive state of the student. The problem that cognitive diagnosis in the prior art is not comprehensive enough is solved, and the method has the advantages of being high in accuracy and applicability.
Owner:GUANGDONG UNIV OF TECH
Classroom teaching comprehensive quality evaluation method and system based on teacher and student behavior multi-mode intelligent analysis
PendingCN120875681AData processing applicationsCharacter and pattern recognitionEvaluation resultData set
The invention discloses a classroom teaching comprehensive quality evaluation method and system based on teacher and student behavior multi-mode intelligent analysis, and the method comprises the steps: firstly obtaining a multi-view classroom teaching video, and constructing a multi-view teacher behavior data set, a teacher behavior audio data set and a student behavior data set; secondly, constructing a multi-view behavior recognition network based on a Mama structure, and respectively obtaining a teacher behavior visual recognition model, a teacher behavior audio recognition model, a teacher behavior multi-modal fusion model and a student learning state detection model through the three data sets; and then acquiring a multi-view classroom teaching video in real time, and based on the model, obtaining a comprehensive teacher behavior identification result and the concentration degree of the students. And finally, according to the teacher behavior comprehensive identification result and the concentration degree of the students, performing quantitative evaluation on the classroom teaching video, and outputting a classroom comprehensive quality evaluation result. According to the method, the problem of one-sided single-modal analysis is solved, and the balance between the multi-view behavior recognition precision and the running speed is realized.
Owner:HANGZHOU DIANZI UNIV
Intelligent teaching video generation system fused with multi-modal large model and method thereof
The invention relates to the technical field of video generation, in particular to an intelligent teaching video generation system and method fused with a multi-modal large model, and the method comprises the steps: obtaining a course name inputted by a user, calling a target DeepSeek model according to the course name to generate teaching content, and calling a CosyVoice model to convert the teaching content into voice content consistent with the tone of the audio uploaded by the user, generating animation content by adopting an Echomimic model according to the voice content and a character image photo submitted by the user, fusing the voice content and the animation content to obtain a teaching video, and pushing the teaching video to a user terminal. Through efficient teaching content generation, speech synthesis and animation generation technologies, the production cost of teaching videos is remarkably reduced, the production efficiency of teaching resources is improved, and the requirements of personalized teaching are met.
Owner:HENAN UNIVERSITY
Progressive multi-mode semantic alignment teaching video content extraction method
ActiveCN121214299AData processing applicationsCharacter and pattern recognitionSemantic alignmentFeature extraction
The invention discloses a progressive multi-modal semantic alignment teaching video content extraction method, and belongs to the technical field of video abstract generation, and the method comprises the steps: sampling an education video, and obtaining a video frame sequence and a corresponding sentence sequence; inputting the video frame sequence into a visual feature extraction model to obtain video frame feature representation, and inputting the sentence sequence into a text feature extraction model to obtain sentence feature representation; establishing a progressive multi-mode semantic alignment model; and inputting the video frame sequence, the sentence sequence, the video frame feature representation and the sentence feature representation obtained from the teaching video to be extracted into the progressive multi-mode semantic alignment model to obtain a fine-grained video frame abstract set and a fine-grained text abstract set, namely abstract contents extracted from the teaching video. According to the method, semantic association among multiple modes can be effectively utilized, and more accurate and smooth teaching video abstract content can be generated.
Owner:ZHEJIANG UNIV OF TECH
Learning resource recommendation system based on deep learning
PendingCN121479057ADigital data information retrievalData processing applicationsData capacityEngineering
The invention discloses a learning resource recommendation system based on deep learning, and relates to the technical field of resource recommendation, an online learning service module is arranged to provide online learning resource watching service for students, and a monitoring and recording module is arranged to record pull-back operation executed by learning resources. A pull-back analysis module is arranged to analyze pull-back monitoring data for all learning resources; in the analysis process, aiming at any learning resource, all knowledge points with recommendation qualification in the learning resource are judged by analyzing a plurality of knowledge points involved when the student executes the pull-back operation on the learning resource and the data capacity of the teaching video of the knowledge points; the online learning service module recommends the corresponding knowledge points to the students for all the knowledge points with the recommendation qualification in the learning resource playing process, so that the problem of time waste caused by repeatedly pulling back the same section of low-efficiency explanation by the students can be effectively reduced, and the students are helped to improve the learning efficiency.
Owner:NANCHANG NORMAL UNIV
system
We provide the system. [Solution] A means of presenting instructional videos selected by the user, Means for recording user imitation behavior, A means for comparing recorded imitative behavior with instructional videos to generate evaluations and areas for improvement, A means of presenting evaluations and areas for improvement to users, When imitative behavior meets the evaluation criteria, a means of providing a setting for interactive training is provided. A system that includes this.
Owner:SOFTBANK GROUP CORP
Mechanism for ensuring draggable entry choices fall within established error categories
PendingUS20250292697A1Electrical appliancesInput/output processes for data processingAlgorithmTheoretical computer science
A system makes the abstract, step-by-step logic of math problems visible via the use of digitized mathematical reasoning blocks, which can be used to construct an interactive teaching program that allows a student to select problem sets from an index of problems, allows the student to view a brief instructional video pertaining to that skill if desired, allows the student to choose the mode of problem presentation (i.e., various learning or test modes), allows the student to work randomly generated problems from within the chosen mode and set by dragging and dropping inputs to mathematical reasoning blocks that represent the various necessary / possible sub-steps in route to the solution of that problem.
Owner:WEEMS RODNEY ADRAIN
Method, device, equipment and medium for generating educational virtual human based on lesson plan drive
A method, device, equipment, and medium for generating an educational virtual human driven by a teaching plan relate to the field of virtual human technology. The method comprises: obtaining a voice file. Obtaining a first image frame. Repeating the subsequent steps until the voice ends to obtain a sequence of image frames. Synchronously synthesizing the generated image frame to obtain a teaching video of the virtual human. Extracting the portrait features of the target frame and the audio features of the next frame and aligning them to obtain multimodal alignment features. Extracting identity feature parameters, expression coefficient parameters, and posture parameters from the portrait features, then converting them into three-dimensional facial point cloud information using the FLAME model and performing position encoding to obtain query embedding features. Taking the query embedding features and multimodal alignment features as the main input, the audio features are used as a condition for fusion to obtain visual alignment features. The visual alignment features, identity feature parameters, expression coefficient parameters, and posture parameters are fused and modulated into a Gaussian representation, projected onto a two-dimensional image plane, and then fused to obtain the image frame of the next frame.
Owner:XIAMEN UNIV OF TECH
Interactive control method and teaching machine based on eye movement trajectory analysis
ActiveCN119200849BInput/output for user-computer interactionData processing applicationsInteraction controlFeature extraction
The present invention discloses an interactive control method based on eye movement trajectory analysis and its teaching machine, comprising: obtaining the target user's eye movement trajectory for each video in the teaching video during the teaching video playback process based on a visual camera; obtaining a first target video with an attention duration greater than or equal to a preset duration, and displaying the first target video on the display interface of the teaching machine to obtain a second target video and a text prompt word; performing feature extraction on the second target video to obtain the visual features of the second target video; performing feature extraction on the text prompt word to obtain the text features of the text prompt word; inputting the visual features and text features into a pre-trained large language model to obtain a description text of the target to be analyzed output by the large language model. The present invention completes the analysis and description of specific targets in the video, focuses on the content that the target user is interested in, and improves the target user's learning enthusiasm and learning efficiency.
Owner:SHENZHEN YUANJUN INTEGRATED TECH DEV CO LTD
Intelligent video learning engine and multi-level knowledge point real-time positioning method thereof
ActiveCN121170679ACharacter and pattern recognitionBiological modelsComputer graphics (images)Engineering
The invention relates to the technical field of video mode recognition, in particular to an intelligent video learning engine and a multi-level knowledge point real-time positioning method thereof. The method comprises the following steps: firstly, acquiring a change coefficient of each pixel point in each frame of image according to picture content change between adjacent frames of a learning video; the real-time change distance between the pixel points is further obtained according to the time sequence fluctuation difference of the change coefficients, and iteration windowing is carried out; segmenting the learning video according to the distribution of the change coefficients of the pixel points in the real-time image in combination with the synchronization factor; further removing video segmentation points according to the continuity of the text content; and finally, constructing an interactive knowledge point tree according to a video segmentation result in combination with the text content. According to the method, the teaching video paragraphs are intelligently divided by fusing picture change analysis and text semantic continuity verification, and finally the interactive knowledge point tree is constructed, so that accurate positioning and efficient navigation of learning contents are realized.
Owner:CHINA OPEN UNIV PRESS CO LTD
Accessing and viewing organized resources in digital learning material through data filtering
PCT designated stageWO2026013678A1Digital data information retrievalData processing applicationsPersonalizationKnowledge management
5 Embodiments disclose a system and method for simplifying access and viewing of a variety of digital learning meta resources. Utilizing advanced filtration based on categorized resource data, the system efficiently organizes content for effortless retrieval. It provides users with a personalized approach to accessing educational 10 digital resource content, thereby improving accessibility and organization within digital meta learning materials. The available resources encompass images, sets of related pictures, various types of videos such as teaching and concept videos, keywords, tables, and more. With its innovative filtering features, the system aims to revolutionize the learning experience, making education more accessible, engaging, 15 and impactful for students worldwide.
Owner:KAKUMANU SARATH +2
Teaching audio and video transmission method and device, equipment and storage medium
The invention relates to a teaching audio and video transmission method and device, equipment and a storage medium, and the method comprises the steps: obtaining teaching audio data and teaching video data in response to teaching video recording, and carrying out the coding to obtain a teaching audio data stream and a teaching video data stream; interweaving the teaching audio data stream and the teaching video data stream according to a timeline, and determining teaching audio and video fragment data; and transmitting the teaching audio and video fragment data to a cloud server in real time, and storing the teaching audio and video fragment data in real time by the cloud server to obtain a teaching video supporting playback. According to the method, recording while uploading and storage and play can be supported, the waiting period of recording, transcoding, uploading and publishing can be shortened, and the teaching efficiency and the interaction timeliness are improved. Meanwhile, a fragmented data transmission mechanism enhances the adaptability to network fluctuation, solves the problem of sound and picture synchronization, improves the stability and reliability of transmission, and improves the user experience during playing.
Owner:BEIJING CHUANGYING ORIENTAL TECHNOLOGY CO LTD
A teaching video super-resolution reconstruction method and system based on cross-modal feature fusion
The application discloses a teaching video super-resolution reconstruction method and system based on cross-modal feature fusion, and belongs to the field of computer vision. In view of the problems of low resolution, detail loss, inter-frame jitter and large amount of calculation of the existing teaching video, the application obtains a low-resolution video frame and G-buffer information thereof; in the encoding stage, the cross-channel feature interaction rearrangement and point-by-point product are used to obtain the encoding feature; in the decoding stage, the encoding feature and the G-buffer information are taken as the SS2D module of the Mamba network to perform global space-time feature extraction, and the point-by-point product fusion of the decoding output of the previous frame and the current frame SS2D output is performed; finally, the sub-pixel convolution upsampling is performed to generate a high-resolution frame. The application fuses multi-modal physical information, significantly improves the reconstruction clarity and timing stability of key elements such as board writing and teaching aids, has small parameter quantity and low delay, supports real-time processing, reduces privacy risk based on low-resolution reconstruction, and is suitable for teaching video enhancement and analysis scenes.
Owner:ANHUI POLYTECHNIC UNIV MECHANICAL & ELECTRICAL COLLEGE
A progressive multi-modal semantic alignment teaching video content extraction method
ActiveCN121214299BData processing applicationsCharacter and pattern recognitionSemantic alignmentFeature extraction
The application discloses a kind of progressive multimodal semantic alignment's teaching video content extraction method, belong to video abstract generation technical field, including: sampling education video, obtain video frame sequence and corresponding sentence sequence;Video frame sequence is input into visual feature extraction model to obtain video frame feature representation, sentence sequence is input into text feature extraction model to obtain sentence feature representation;Establish progressive multimodal semantic alignment model;The video frame sequence, sentence sequence, video frame feature representation and sentence feature representation obtained by the teaching video to be extracted are input into progressive multimodal semantic alignment model, obtain fine-grained video frame abstract set and fine-grained text abstract set, that is, the abstract content extracted from teaching video.The method can effectively utilize the semantic association between multi-modal, generate more accurate, smooth teaching video abstract content.
Owner:ZHEJIANG UNIV OF TECH