Patents
Literature
243 results about "Instructional video" patented technology
Efficacy Topic
Property
Owner
Technical Advancement
Application Domain
Technology Topic
Technology Field Word
Patent Country/Region
Patent Type
Patent Status
Application Year
Inventor
Automatic lecturer video generation method based on AI speech synthesis and animation driving
ActiveCN120897102AProgram initiation/switchingDigital data information retrievalData streamAlgorithm
The invention discloses a lecturer video automatic generation method based on AI speech synthesis and animation driving. The method comprises the following steps: performing structured analysis on a PPT or a text script through an improved interior point method and an incremental shortest path algorithm; performing semantic grouping by applying a full-dynamic parallel single-link clustering algorithm and generating an enhanced script with an expressive mark; a CosyVoice technology is combined with a low-rank approximation method to generate a high-quality voice data stream; establishing a mapping relation between contents and action expressions through semantic analysis, and generating a complete action expression instruction set; and driving the digital human model by using the msueTalk technology, and generating a final lecturer teaching video through a parallel rendering algorithm. According to the invention, the method achieves the efficient and automatic generation of the education video, remarkably improves the content production efficiency, reduces the production cost, and guarantees the specialty and expressive force of the teaching video.
Owner:SHENZHEN XUEYOU TECHNOLOGY CO LTD
Makeup auxiliary method and device based on intelligent cosmetic mirror and electronic equipment
PendingCN120340487AInput/output for user-computer interactionSpeech recognitionEngineeringHuman–computer interaction
The invention provides a makeup auxiliary method and device based on an intelligent cosmetic mirror and electronic equipment, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a user voice instruction and user appearance data; based on the user instruction analysis, obtaining makeup demand keywords; and based on the makeup demand keyword and the user appearance data, obtaining a makeup teaching video, and displaying the makeup teaching video through an intelligent cosmetic mirror. According to the invention, through non-contact interaction, teaching content self-adaptive pushing and real-time action guiding, the makeup experience of the user is comprehensively improved.
Owner:SHENZHEN XINXINLEI BRUSH PROD CO LTD
Teaching quality evaluation method based on teaching robot
The invention discloses a teaching quality evaluation method based on a teaching robot, and relates to the field of artificial intelligence education application, and the method comprises the steps: collecting classroom teaching video data and audio data through a sensor of the teaching robot; performing face recognition according to the classroom teaching video data to obtain student expression data, and performing acoustic feature extraction on the audio data to obtain teacher voice data; sending the student expression data into a pre-trained emotion recognition model to obtain a classroom student attention score, and sending the teacher voice data into a voice evaluation model to obtain a teacher speed score; and establishing a weighted calculation formula based on the classroom student attention score and the teacher speech speed score, and calculating to obtain a classroom teaching quality score. According to the invention, the classroom video and audio data are collected and processed in real time, the student attention score and the teacher speed score are calculated, and weighted fusion is carried out, so that the objective quantitative evaluation of the classroom teaching quality is realized.
Owner:SHANDONG HONGRU SMART EDUCATION TECHNOLOGY CO LTD
Interactive three-dimensional teaching resource generation system and method based on 3D Gaussian splashing
ActiveCN121170164AInput/output for user-computer interactionGraph readingSequence reconstructionComputer graphics (images)
The invention discloses an interactive three-dimensional teaching resource generation system and method based on 3D Gaussian splashing, and belongs to the technical field of three-dimensional reconstruction, and the system comprises a multi-view image obtaining module which is used for extracting a multi-view image sequence related to a teaching theme from a teaching video resource, and determining the category of each structural region in each view image; the enhanced three-dimensional reconstruction module is used for reconstructing the multi-view image sequence into a three-dimensional teaching model; determining the anchor point attribute of each anchor point in the three-dimensional teaching model; the intelligent interaction module is used for acquiring a user instruction; determining a target anchor point according to the user instruction, and obtaining an anchor point attribute corresponding to the target anchor point; and the three-dimensional visualization module is used for performing rendering display on the three-dimensional teaching model and displaying the anchor point attribute corresponding to the target anchor point. The three-dimensional teaching model which has interaction capability and is subjected to structured knowledge labeling can be generated. The technical problem that a current three-dimensional model lacks intelligent interaction capability is solved.
Owner:HUAZHONG NORMAL UNIV
Hemodialysis teaching system based on AI intelligent pushing
The invention relates to the technical field of hemodialysis teaching systems, and discloses a hemodialysis teaching system based on AI intelligent pushing. The system comprises an operation feature extraction module, an instrument positioning analysis module, an operation step analysis module and a teaching strategy generation module. Operating a feature extraction module to obtain a hemodialysis teaching video stream, and extracting multi-modal features containing an instrument movement track sequence and physiological parameter simulation data; an instrument positioning analysis module calls a pre-training network for positioning and generates a coordinate data set containing instrument types and three-dimensional position coding mapping; the operation step analysis module analyzes the time sequence characteristics by means of an action segmentation model, and generates a result containing step integrity and an error operation mark; and the teaching strategy generation module inputs a result into the intelligent push model, plans a personalized teaching path, outputs a knowledge point sequence containing a student ability model and dynamic teaching elements of operation difficulty parameters, and assists the hemodialysis teaching to be precise and personalized.
Owner:晋江市医院(上海市第六人民医院福建医院)
Education virtual human generation method and device based on teaching plan driving, equipment and medium
The invention discloses an educational virtual human generation method and device based on teaching plan driving, equipment and a medium, and relates to the technical field of virtual human. The method comprises: acquiring a voice file; a first image frame is obtained. And repeating the subsequent steps until the voice ends, and obtaining an image frame sequence. And carrying out synchronous synthesis to obtain a teaching video of the virtual human. And extracting portrait features of the target frame and audio features of the next frame, and aligning the portrait features and the audio features to obtain multi-modal alignment features. Identity feature parameters, expression coefficient parameters and attitude parameters are extracted from portrait features, then the parameters are converted into face three-dimensional point cloud information through a FLAME model, position coding is carried out, and query embedded features are obtained. And performing fusion by taking the query embedding feature and the multi-modal alignment feature as main inputs and taking the audio feature as a condition to obtain a visual alignment feature. And fusing and modulating the visual alignment features, the identity feature parameters, the expression coefficient parameters and the attitude parameters into Gaussian representation, projecting the Gaussian representation to a two-dimensional image plane, and then fusing the Gaussian representation to obtain a next image frame.
Owner:XIAMEN UNIV OF TECH
Dynamic compression method, system and equipment for teaching video and storage medium
The invention relates to the technical field of data processing, and particularly provides a dynamic compression method, system and device for a teaching video and a storage medium, and the method comprises the steps: converting the video into an image frame sequence; detecting abrupt change image frames in the image frame sequence, and marking the abrupt change image frames as node image frames; segmenting the video into a plurality of video clips according to the node image frames, and adding classification tags to the plurality of video clips by using an image recognition technology; and generating a compression parameter for the corresponding video clip according to the classification label, and compressing the video clip according to the compression parameter. According to the invention, the dynamic compression of the teaching video is realized, and the proportion of redundant video clips is reduced, so that the network and storage resources consumed by the redundant video are reduced, and the user experience is improved.
Owner:SHANDONG INSPUR ULTRA HD INTELLIGENT TECH CO LTD
Interactive teaching method and system based on teaching video
The embodiment of the invention relates to the technical field of information, in particular to an interactive teaching method and system based on teaching videos. The method comprises the following steps: carrying out content segmentation on a historical teaching video, identifying explanation fragments of knowledge points in the historical teaching video, carrying out semantic annotation and label annotation, and constructing a structured knowledge point explanation video library; constructing a teaching agent, wherein the teaching agent integrates a natural language processing module, a learning state recognition module and a video fusion module; identifying a current learning demand and a target knowledge point of the student, and automatically retrieving a matched explanation fragment according to the target knowledge point; the teaching agent analyzes the content of the retrieved explanation segment, extracts the explanation content and the teaching logic, and fuses the explanation content and the teaching logic into a knowledge base of the agent; and the teaching agent provides explanation, question answering, practice recommendation and feedback evaluation for students in a dialogue or interaction mode based on the fused knowledge base, so that interactive teaching is realized.
Owner:HANGZHOU EXPOLANG XINZHI EDUCATION TECHNOLOGY CO LTD
Classroom teaching evaluation generation method and system based on multi-modal large model
The invention provides a classroom teaching evaluation generation method and system based on a multi-modal large model, and belongs to the technical field of artificial intelligence and education, and the method comprises the steps: S1, defining an analysis task; s2, setting unified prompt words for guiding model generation: role setting, core tasks and structure requirements; s3, performing fine adjustment on the detector by using the corresponding task domain target detection data set; and S4, integrating a detector, a region slice detection strategy, an optical character recognition technology, a voice recognition technology and a framework of a plurality of large models, taking a teaching video and a corresponding audio as input of the classroom teaching evaluation model, and outputting a structured teaching evaluation analysis report. According to the method provided by the invention, a better effect is obtained on various evaluation standards, the quality of an evaluation report is higher, and the method can be expanded to any classroom scene only by replacing or finely adjusting a detector capable of adapting to a new scene, so that efficient and low-cost framework migration is realized, and meanwhile, high performance is ensured.
Owner:BEIHANG UNIV
Teaching quality management and control method and device, computer equipment and storage medium
The invention discloses a teaching quality management and control method and device, computer equipment and a storage medium. The method comprises the following steps: analyzing teaching behaviors of teachers and classroom performance behaviors of students in a real teaching video to obtain a first teaching quality evaluation result; generating a second teaching quality evaluation result according to the evaluation of the students on the teaching quality; generating a third teaching quality evaluation result according to the evaluation of the teacher on the teaching quality; generating a fourth teaching quality evaluation result according to the student score; and optimizing the weight of each teaching quality evaluation result by adopting an improved particle swarm optimization algorithm, calculating a comprehensive score through the optimized weight, and generating a final teaching quality evaluation report according to each teaching quality evaluation result and the comprehensive score. Therefore, a technical problem that it is difficult to understand the teaching condition of the teacher in a manner of evaluating the teaching quality only through one manner in the related art is solved.
Owner:GUANGXI COLLEGE OF WATER RESOURCES & ELECTRIC POWER
Student classroom behavior analysis method and device, electronic equipment and storage medium
PendingCN121033926ACharacter and pattern recognitionBiological modelsComputer graphics (images)Engineering
The invention provides a student classroom behavior analysis method and device, electronic equipment and a storage medium, and relates to the technical field of artificial intelligence education application. The method comprises the following steps: coding selected video clips of samples of a sample classroom teaching video to obtain a sample image block vector sequence; generating a sample state accumulation vector according to the continuous concentration fragment number and the continuous non-concentration fragment number; performing visual coding on the sample image block vector sequence and the sample state accumulation vector through an initial visual conversion encoder, performing convolution classification on the obtained sample spatial-temporal feature tensor to obtain a sample fragment concentration prediction category, and training the initial visual conversion encoder to obtain a target visual conversion encoder; and performing visual coding on the target classroom teaching video clip through a target visual conversion encoder, and performing convolution classification on the obtained target spatial-temporal feature tensor to obtain a target clip concentration prediction category. The analysis accuracy and efficiency can be improved.
Owner:SOUTHERN UNIVERSITY OF SCIENCE AND TECHNOLOGY
Video playing device
Owner:东营职业学院
Education course intelligent recording and broadcasting management method
The invention belongs to the technical field of education data management, and particularly discloses an intelligent recording and broadcasting management method for education courses, which comprises the following steps of: acquiring multi-modal data in real time through a multi-sensor group, and comprehensively capturing teaching actions of teachers, limb actions of students, speech audios and running states of teaching equipment; further comparing the feature combination with a pre-stored template feature combination to identify different teaching stages; recording modes are automatically switched according to the identified teaching stage, a main and auxiliary picture polling switching rule is established, and videos recorded at different camera positions are integrated into a composite video with synchronous main and auxiliary pictures; key teaching links of teaching videos are automatically identified, index tags are established, the videos are classified and stored in combination with a preset classification rule, and accordingly video contents meeting user requirements are pushed to different users. Structured management and rapid retrieval of recorded and broadcast video content are realized, and personalized service and utilization efficiency of teaching resources are enhanced.
Owner:FENGYE (SHENZHEN) TECH CO LTD
Teaching evaluation method and device based on artificial intelligence
The invention provides a teaching evaluation method and device based on artificial intelligence, and the method comprises the steps: constructing a subject standard knowledge graph based on a large language model and collected teaching materials, and constructing pre-learning knowledge graphs of different students based on the subject standard knowledge graph; virtual student agents corresponding to different students are constructed based on a multi-modal large model and pre-learning knowledge maps, character types and classroom attention mechanisms of the different students; pre-learning knowledge maps of different students are updated based on an input teacher teaching video through virtual student intelligent agents corresponding to the different students so as to simulate learning behaviors of the different students and obtain post-learning knowledge maps of the different students; and evaluating the teaching quality of the teacher corresponding to the teacher teaching video based on the subject standard knowledge graph, the pre-learning knowledge graph, the post-learning knowledge graph and the learning behavior simulation result of the different students. According to the invention, the efficiency and accuracy of teacher teaching quality evaluation can be improved.
Owner:BEIJING NORMAL UNIV AT ZHUHAI
Online teaching video production method and device based on virtual scene, and medium
The invention discloses an online teaching video production method and device based on a virtual scene, and a medium, belongs to the technical field of teaching video production, and is used for solving the technical problem of high curriculum abandoning rate caused by low construction efficiency, low content updating rate and low knowledge transmission accuracy of an existing online curriculum. The method comprises the steps of customizing a digital teacher image of a target teacher based on modeling software; wherein the digital teacher image comprises a 3D digital teacher image and a 2D digital teacher image; constructing a virtual teaching scene, and training a virtual scene model to identify a user instruction so as to adjust features in the virtual teaching scene; based on the made teaching courseware, generating a corresponding digital human control script and a voice explanation script; placing the digital teacher image and the virtual teaching scene into a virtual environment, and fusing the digital teacher image and the virtual teaching scene with the digital human control script and the voice explanation script to form a virtual teaching model; and performing video rendering on the virtual teaching model to obtain a teaching video.
Owner:INSPUR ZHUOSHU BIG DATA IND DEV CO LTD
Multimodal automatic teaching video generation method and system based on intermediate file
PendingCN121099150ATelevision system detailsColor television detailsDocument transformationEngineering
The invention discloses a multi-modal automatic teaching video generation method and system based on an intermediate file. The analysis module is used for extracting texts and pictures from documents input by a user and constructing a searchable knowledge base. The content generation module retrieves related teaching content texts according to knowledge points specified by a user through calling of a two-stage large language model, and generates an explanation first draft in a free format; and retrieving related pictures, performing format conversion, and combining with the explaining first draft to generate a structured JSON file. The format conversion module is used for converting the JSON file into an intermediate file which can be read by human and can be analyzed by a machine through a predefined template engine; the collaborative review module presents the intermediate file to a user and receives a modification instruction; and the synchronous updating module performs reverse analysis and grammar verification, and updates the original structured data according to the changed content. The material generation module generates corresponding audio and image materials; and the video synthesis module synthesizes the materials into a video file and outputs the video file.
Owner:HANGZHOU DIANZI UNIVERSTIY INFORMATION ENG SCHOOL
Foreign language teaching video generation method and apparatus
The present invention provides a foreign language teaching video generation method and apparatus. The foreign language teaching video generation method comprises: acquiring video subtitle text corresponding to a video to be processed; on the basis of the video subtitle text and a preset explanation generation rule, using a large language model to generate foreign language teaching explanation text of the video subtitle text; generating a corresponding explanation audio on the basis of the foreign language teaching explanation text; determining a time information relationship between the foreign language teaching explanation text and the explanation audio; on the basis of the time information relationship between the foreign language teaching explanation text and the explanation audio, generating a display style corresponding to the explanation audio; and on the basis of the explanation audio, the display style corresponding to the explanation audio, and the time information relationship between the explanation text and the explanation audio, generating an explanation video corresponding to the video to be processed. In the present invention, a target teaching video corresponding to a video to be processed can be automatically generated, and the generated teaching video is highly targeted, so that the personalized requirements of users can be met.
Owner:JIANG QIUSHI
Video frame accurate positioning method based on hierarchical knowledge base
PendingCN120671855ASemantic analysisCharacter and pattern recognitionSemantic alignmentLinguistic model
The invention discloses a video frame precise positioning method based on a hierarchical knowledge base, and the method comprises the steps: carrying out the preprocessing of each teaching video of a MOOC class in an online education platform, and extracting a representative key frame and a precise timestamp of the representative key frame in an original video; on this basis, knowledge points are extracted by means of a visual language large model, and a hierarchical knowledge base structure is constructed; then, carrying out deep semantic analysis on a natural language question input by a user by utilizing a large language model; based on an analysis result, through semantic similarity calculation and a structured reasoning mechanism, positioning a target knowledge point most related to the user intention layer by layer in a knowledge base; furthermore, a teaching video timestamp corresponding to the knowledge point is determined, and interpretable path information is generated based on a reasoning path in the positioning process. The method not only can realize accurate positioning of a key frame level, but also has traceable and explainable semantic alignment capability, and can remarkably improve intelligent understanding and positioning precision of teaching video content.
Owner:PAZHOU LAB (HUANGPU) +1
Intelligent management method for AI big data
PendingCN121616888ACharacter and pattern recognitionBiological modelsEngineeringIntelligent management
The invention discloses an intelligent management method for AI big data, and relates to the technical field of AI video management, and the method comprises the steps: collecting teaching video data, and marking teaching behavior guiding key points; training a knowledge point association model based on the annotated data, extracting video frame feature recognition key points, and generating a key point motion trail; constructing a knowledge point graph, and performing correlation calculation on the key points and the knowledge points to obtain correlation degree factors; calculating a dynamic parameter based on the key point trajectory data, and integrating a correlation factor to optimize a parameter value; defining abnormal video segments, marking video segments deviating from a threshold value through an anomaly detection algorithm, and automatically isolating and deleting the video segments; collecting user behavior data to construct a user portrait, and constructing a user learning path according to the knowledge point graph and the user portrait; calculating a basic matching score of the video segment and the learning path, and obtaining a final matching score through dynamic parameter weighting; and according to the final matching score, dividing the video segment into three storage levels and storing the three storage levels into corresponding storage layers.
Owner:BEIJING XIAONIAN TECHNOLOGY CO LTD
Teaching platform video management method and system
The invention relates to the technical field of teaching platforms, in particular to a teaching platform video management method and system, and the method comprises the following steps: extracting a subtitle text or audio transcription in a video based on a video data index, carrying out the semantic content processing, evaluating the similarity with the existing teaching video content, and analyzing the timeliness of the teaching video; and obtaining a video demand index. According to the method, deep semantic analysis and real-time updating monitoring are carried out on the teaching video content, the timeliness and correlation of the education content are greatly improved, the similarity and timeliness of the teaching video and the existing content are accurately evaluated, it is ensured that video data closely correspond to education requirements, the latest dynamic state of the education field is reflected in time, and the education efficiency is improved. The function of monitoring the video uploading and transcoding progress in real time not only improves the management efficiency, but also enhances the transparency of the process, and the quality and adaptability of teaching materials are effectively ensured through automatic video quality detection and feedback-based content optimization.
Owner:广州中教智学技术有限公司
Systems and methods for video models with procedure understanding
ActiveUS12367662B2Natural language translationSemantic analysisKnowledge graphArtificial intelligence
Embodiments described herein provide systems and methods for training video models to perform a task from an input instructional video. A procedure knowledge graph (PKG) may be generated with nodes representing procedure steps, and edges representing relationships between the steps. The PKG may be generated based on text and / or video training data which includes procedures (e.g., instructional videos). Using the PKG, a video model may be trained using the PKG to provide supervisory training signals for a number of tasks. Once the model is trained, it may be fine-tuned for a specific task which benefits from the model being trained in a way that makes the model embed procedural information when encoding videos.
Owner:SALESFORCE INC
Heterogeneous graph-based multi-modal teaching video abstract generation method
The invention discloses a heterogeneous graph-based multi-modal teaching video abstract generation method. The method comprises the steps of obtaining a plurality of video samples to form a training set; establishing a multi-modal abstract generation model, training by using a training set, and executing the following operations by the model: respectively inputting a video frame sequence and a sentence sequence into a visual feature extraction model and a language model to obtain a visual feature vector set and a text feature vector set to form multi-modal feature representation; initializing an adjacent matrix; performing Hadamard product on the intra-modal constraint matrix, the inter-modal constraint matrix and the adjacent matrix to obtain an optimized heterogeneous graph; executing a double-stage fusion strategy; and screening a key video frame node set and a key sentence node set by using multi-modal unified representation output by the trained multi-modal abstract generation model, and correspondingly reserving a connection relationship in the optimized heterogeneous graph as a sub-adjacency matrix to obtain a multi-modal abstract graph. According to the method, teaching video abstracts with consistent semantics and rich contents can be generated, and the generalization ability is high.
Owner:ZHEJIANG UNIV OF TECH
Learning machine voice instruction interaction method and system
The invention provides a learning machine voice instruction interaction method and system, is applied to the technical field of learning machines, and realizes fine management of help seeking of a user by starting an independent'temporary session state record 'for each knowledge point. By generating'multi-level guide prompts' and'multi-level question exploration ', the system can gradually guide the user to think instead of directly giving answers, so that not only is the independent thinking ability of the user cultivated, but also the system can more accurately judge the real mastering degree of the user on the knowledge point. When the user answers correctly, the system confirms the mastering of the user; and when the answer is incorrect, the system adjusts an auxiliary strategy, such as recommending a teaching video, so that more targeted help is provided. Therefore, according to the method provided by the invention, false triggering of dependence intervention caused by multi-user sharing can be avoided, the accuracy and individuation of an auxiliary strategy of the learning machine are ensured, and the user experience and learning efficiency are remarkably improved.
Owner:HENGSHU HOLDINGS (GUANGDONG) GROUP CO LTD
Teaching video knowledge graph generation method and device, and related product
PendingCN120338069AData processing applicationsKnowledge representationSemantic alignmentMultimodal data
The embodiment of the invention relates to a method and a device for generating a teaching video knowledge graph, and a related product. The method comprises the following steps: acquiring teaching video data; searching for curriculum standard data corresponding to the teaching video data, and constructing an internal subject knowledge database according to the curriculum standard data; extracting first multi-modal data in the teaching video data, preprocessing the first multi-modal data, and performing modal semantic alignment enhancement on the preprocessed data through a retrieval enhancement generation (RAG) framework to generate second multi-modal data; wherein a retrieval module of a retrieval enhancement generation (RAG) framework retrieves in an internal subject knowledge database; extracting and generating video knowledge point entity data according to the second multi-modal data; extracting a relationship between knowledge points according to the video knowledge point entity data, and generating video entity relationship set data; and constructing a teaching video knowledge graph according to the video knowledge point entity data and the video entity relationship set data.
Owner:SOUTH CHINA NORMAL UNIV
Classroom teaching ability assessment method, device, equipment, storage medium and product
The invention discloses a classroom teaching ability assessment method, device and equipment, a storage medium and a product, and relates to the technical field of artificial intelligence, and the method comprises the steps: carrying out the analysis of a classroom teaching video of a to-be-assessed teacher according to a multi-modal large language model, and obtaining a multi-modal analysis result; constructing a classroom teaching knowledge graph according to a multi-modal analysis result; and comparing the classroom teaching knowledge graph with a preset expert knowledge graph, and evaluating the classroom teaching ability of the to-be-evaluated teacher according to a comparison result to obtain an evaluation result. A section of classroom video is taken as a research object, classroom speech and behavior data are analyzed through a multi-modal large model, a multi-modal analysis result is extracted, a classroom teaching knowledge graph is constructed according to the multi-modal analysis result, the classroom teaching knowledge graph is compared with a knowledge graph of an expert classroom, a teacher ability assessment model is established, and a teacher ability assessment result is obtained. Therefore, teaching videos can be analyzed more deeply, teaching quality can be evaluated more accurately, and improved teaching ability suggestions can be provided.
Owner:EDUCATIONAL WORKING COMMITTEE OF THE COMMUNIST PARTY OF CHINA ILI KAZAKH AUTONOMOUS PREFECTURE COMMITTEE ILI KAZAKH AUTONOMOUS PREFECTURE EDUCATION BUREAU
Cognitive diagnosis method and model based on emotional state
The invention relates to the technical field of intelligent education, in particular to a cognitive diagnosis method and model based on an emotional state, and the model comprises a multi-modal information feature extraction module, a feature alignment layer, a modal selection layer, a self-adaptive super-modal learning layer and a cross-modal fusion conversion layer which are cascaded. The method comprises the following steps: extracting emotion-related multi-modal features from a teaching video, and obtaining knowledge point information corresponding to the emotion-related multi-modal features; the extracted multi-modal features are projected to a unified low-dimensional space, so that data are in the same dimension, and preparation is made for subsequent fusion; adaptively selecting a main mode and an auxiliary mode; emotional semantic expression is formed through information interaction between the main mode and the auxiliary mode; and fusing the main mode and the super-mode state to generate a unified super-mode state representing the emotion cognitive state of the student. The problem that cognitive diagnosis in the prior art is not comprehensive enough is solved, and the method has the advantages of being high in accuracy and applicability.
Owner:GUANGDONG UNIV OF TECH
Classroom teaching comprehensive quality evaluation method and system based on teacher and student behavior multi-mode intelligent analysis
PendingCN120875681AData processing applicationsCharacter and pattern recognitionEvaluation resultData set
The invention discloses a classroom teaching comprehensive quality evaluation method and system based on teacher and student behavior multi-mode intelligent analysis, and the method comprises the steps: firstly obtaining a multi-view classroom teaching video, and constructing a multi-view teacher behavior data set, a teacher behavior audio data set and a student behavior data set; secondly, constructing a multi-view behavior recognition network based on a Mama structure, and respectively obtaining a teacher behavior visual recognition model, a teacher behavior audio recognition model, a teacher behavior multi-modal fusion model and a student learning state detection model through the three data sets; and then acquiring a multi-view classroom teaching video in real time, and based on the model, obtaining a comprehensive teacher behavior identification result and the concentration degree of the students. And finally, according to the teacher behavior comprehensive identification result and the concentration degree of the students, performing quantitative evaluation on the classroom teaching video, and outputting a classroom comprehensive quality evaluation result. According to the method, the problem of one-sided single-modal analysis is solved, and the balance between the multi-view behavior recognition precision and the running speed is realized.
Owner:HANGZHOU DIANZI UNIV
Adult online education learning quality evaluation method
The invention discloses an adult online education learning quality evaluation method, and relates to the technical field of online education, and the method comprises the following steps: obtaining teaching video text content; dividing the text content into a plurality of teaching units carrying time range marks, function type marks and knowledge point marks according to teaching functions; acquiring a concentration index of the student when playing each teaching unit; obtaining the playing integrity of each teaching unit of the student; calculating a basic score for each teaching unit according to the playing integrity and concentration indexes; the method has the beneficial effects that the attention state of the student in the learning process can be effectively identified, and misjudgment caused by only depending on the watching duration or the test result is avoided; the test question can be dynamically generated according to the knowledge points of the teaching unit and the basic score of the student, the basic score is corrected through the answer result, and compared with a traditional single scoring mechanism, the real learning quality of the student can be more comprehensively measured.
Owner:ZHENGZHOU VOCATIONAL UNIV OF INFORMATION & TECH
Intelligent teaching video generation system fused with multi-modal large model and method thereof
The invention relates to the technical field of video generation, in particular to an intelligent teaching video generation system and method fused with a multi-modal large model, and the method comprises the steps: obtaining a course name inputted by a user, calling a target DeepSeek model according to the course name to generate teaching content, and calling a CosyVoice model to convert the teaching content into voice content consistent with the tone of the audio uploaded by the user, generating animation content by adopting an Echomimic model according to the voice content and a character image photo submitted by the user, fusing the voice content and the animation content to obtain a teaching video, and pushing the teaching video to a user terminal. Through efficient teaching content generation, speech synthesis and animation generation technologies, the production cost of teaching videos is remarkably reduced, the production efficiency of teaching resources is improved, and the requirements of personalized teaching are met.
Owner:HENAN UNIVERSITY
Knowledge-enhanced procedure planning of instructional videos using knowledge graph and large language models
Systems and methods include predicting a first action step and a last action step based on an initial visual observation and a goal visual state and retrieving multiple procedural plans from a procedural knowledge graph (PKG), trained using a set of training instructional videos, which start with the first action step and end with the last action step. A procedure plan is generated using the retrieved multiple procedural plans. An instructional video is generated based on the procedure plan.
Owner:NEC LABORATORIES AMERICA INC