Digital teaching system based on multi-mode intelligent technology

Abstract

The invention relates to a digital teaching system based on a multi-mode intelligent technology. A teaching end displays digital content through screen equipment; the control end provides a digital classroom control capability for teachers or assistant teachers through mobile equipment; the student end realizes real-time interaction between students and the digital classroom through a mobile device configured with a voice device; the server is configured with an intelligent knowledge base, analyzes classroom data based on an intelligent algorithm and a big data analysis technology, generates a learning path and recommendation resources according to student conditions, processes questions with the help of natural languages, and drives the whole teaching to operate intelligently. According to the invention, classroom interaction intellectualization can be realized, teaching quality can be improved, multidisciplinary knowledge coverage and dynamic adaptation can be realized based on an intelligent knowledge base, modular course design and dynamic interaction are optimized, dialogue type and touch type interaction modes are fused, popularization application of code-free teaching design is supported, and teaching experience is improved. And classroom effect optimization driven by real-time data, enhanced teaching feedback and long-term improvement are facilitated.

Description

Technical Field

[0001] The present invention relates to the field of intelligent teaching technology, and in particular to a digital teaching system based on multi-modal intelligent technology. Background Art

[0002] As the education model continues to evolve, the traditional teaching method centered on real teachers faces many challenges in some niche knowledge fields. Especially in elective courses, the learning cost of teachers is often high, and the classroom effect may not be ideal. Although teachers work hard to promote student participation and interaction in class, this interactive model is still limited by traditional offline classes and it is difficult to achieve a real breakthrough. These problems are particularly evident in elective courses, which account for an increasing proportion of current schools, affecting students' learning experience and learning effects.

[0003] In addition, although the rise of online digital classrooms has provided new possibilities for education, neither the one-to-one nor the one-to-many teaching mode can effectively solve the problem of teachers' lack of control over students' actual behavior. In such a teaching environment, the interaction between students is also very limited, and it is difficult to form a good learning atmosphere. Therefore, the effect of online classrooms in achieving most offline classroom teaching goals is still unsatisfactory.

[0004] In this context, the application of emerging language big model technologies has gradually attracted attention. These technologies have shown good adaptability in some one-to-one learning scenarios centered on language, such as Chinese reading comprehension, English writing and conversation, etc. These technologies rely on students' active behavior and can provide personalized learning experience. However, for students of low school age, since their learning method is mainly passive learning, this learning method based on active behavior is not suitable. At the same time, not all learning content is suitable for interactive methods centered on dialogue, which limits the widespread application of language big model technology.

[0005] Therefore, designing a digital teaching system based on multimodal intelligent technology remains an urgent problem to be solved. Summary of the invention

[0006] In order to solve the technical problems existing in the above-mentioned prior art, the purpose of the present invention is to provide a digital teaching system based on multimodal intelligent technology, which can realize intelligent classroom interaction, improve teaching quality, rely on intelligent knowledge base to achieve multidisciplinary knowledge coverage and dynamic adaptation, and optimize modular course design and dynamic interaction.

[0007] To achieve the above-mentioned invention object, the present invention provides a digital teaching system based on multimodal intelligent technology, including a teaching end, a control end, a student end and a service end;

[0008] The teaching end displays digital content through a screen device;

[0009] The control terminal provides the teacher or teaching assistant with the ability to control the digital classroom through a mobile device;

[0010] The student terminal realizes real-time interaction between the student and the digital classroom through a mobile device equipped with a voice device;

[0011] The server is equipped with an intelligent knowledge base, which analyzes classroom data based on intelligent algorithms and big data analysis technology, generates learning paths and recommended resources according to students' situations, answers questions with the help of natural language processing, and drives the entire teaching intelligent operation.

[0012] According to a technical solution of the present invention, the teaching end publishes the digital content of the course through an interactive application program, and reserves an interactive interface to realize real-time interaction during the teaching process;

[0013] The interactive interface includes a questioning interface based on natural language, a group competition interface, a quick answer interface and a real-time input signal interface based on a touch screen.

[0014] According to a technical solution of the present invention, the control terminal at least includes a content switching module, a progress adjustment module and a monitoring module, and is configured with an operation interface, and the teacher or teaching assistant uses the content switching module to switch the teaching content through the operation interface, and uses the progress adjustment module to adjust the playback progress;

[0015] The monitoring module can monitor the students' learning status in real time, record the students' participation, and feed back the monitoring content to the server.

[0016] According to a technical solution of the present invention, the server side analyzes classroom data in real time based on intelligent algorithms and big data analysis after receiving monitoring content feedback from the control side. The classroom data at least includes students' learning behavior, classroom participation and answering performance. Based on data mining technology, it provides teachers with accurate teaching suggestions and generates personalized learning paths and resource recommendations based on students' learning progress and characteristics.

[0017] According to a technical solution of the present invention, the question interface is used to identify sudden questions from teachers or students, and analyze the question content through a large language model to quickly provide accurate answers;

[0018] The question interface is used to display answers and multimedia resources related to the question content.

[0019] According to a technical solution of the present invention, the group competition interface allows students to participate in classroom competition in groups or individually;

[0020] The system assigns a unique number or name to each group before the digital classroom begins, and records the performance of each group or individual in the classroom in real time, displaying the ranking and score.

[0021] According to a technical solution of the present invention, the quick-answer interface is used to monitor students' quick-answer behaviors in real time, and distribute limited interactive participation opportunities to students with the fastest response speed through the control of the server.

[0022] According to a technical solution of the present invention, the server includes:

[0023] Semantic understanding module, which is used to realize multi-level semantic analysis of speech text, including grammatical analysis, context understanding and implicit information extraction;

[0024] The intention recognition and question classification module is used to quickly identify students' question intentions based on voice text and automatically classify the question content;

[0025] Dynamic knowledge retrieval and optimization module, used to match student questions with relevant items in the aerospace knowledge base in real time based on a large language model;

[0026] An interactive feedback generation module that generates understandable speech and text for a large language model and matches it with visual content;

[0027] Multimodal integration module, which is used to organize information in various forms and generate content packages suitable for display;

[0028] The emotion recognition module is used to capture the emotional state of students through speech sentiment analysis.

[0029] Compared with the prior art, the present invention has the following beneficial effects:

[0030] The digital teaching system based on multimodal intelligent technology of the present invention can realize intelligent classroom interaction and improve teaching quality. It relies on the intelligent knowledge base to achieve multidisciplinary knowledge coverage and dynamic adaptation, optimizes modular course design and dynamic interaction, integrates conversational and touch-based interaction methods, supports the popularization of code-free teaching design, and is conducive to real-time data-driven classroom effect optimization, enhanced teaching feedback and long-term improvement.

[0031] This invention digitizes traditional classroom interaction links such as answering questions, dialogue, and grouping, optimizes classroom management through intelligent algorithms, and supports real-time data analysis and feedback. Teachers can quickly grasp students' learning situation and adjust teaching strategies through intelligent recommendation functions, thereby achieving precise teaching in fully digital teaching and further stimulating students' interest in learning and enthusiasm for participation.

[0032] The present invention, relying on the intelligent knowledge base, can dynamically generate personalized teaching content to meet the needs of different subjects, whether it is aerospace science popularization, historical research, or multilingual teaching. At the same time, the system supports in-depth supplementation of major course content, using AI technology to provide customized learning path planning, and realize true cross-disciplinary intelligent teaching support.

[0033] The present invention realizes highly modularized course design through intelligent interactive interface. Teachers can add or remove content modules at any time according to teaching needs without redeveloping the system. The intelligent recommendation engine can dynamically adjust the course rhythm according to students' feedback data, ensuring that students maintain high attention and learning motivation, and enhancing teaching effect.

[0034] The present invention abstracts complex interactive forms into two basic modes: conversational interaction and touch-based interaction. Based on natural language processing (NLP) and multimodal perception technology, it supports seamless switching of multiple input methods such as voice, text, and gestures. Through intelligent scene generation and semantic analysis, the system can realize rapid customization of complex interactive scenes, enhance students' interactive experience, and provide content creators with greater creative freedom.

[0035] With this invention, teachers can design rich interactive content without programming skills. The system's built-in intelligent content generation tools can automatically complete complex teaching design tasks, greatly reducing the production threshold. Combined with the low-code / no-code environment, teachers and course developers can focus on course creativity and knowledge content polishing, significantly improving the efficiency and quality of digital course development.

[0036] In this invention, the system can collect students' behavior data in real time, such as concentration, interaction frequency, etc., through built-in sensors and data acquisition modules, and analyze them in combination with artificial intelligence algorithms to generate personalized teaching optimization suggestions. Teachers can adjust classroom strategies in real time based on these data to ensure that every student can get the best learning experience.

[0037] The system of the present invention generates detailed student learning reports through intelligent learning achievement tracking and feedback mechanisms, including knowledge point mastery, participation, and development potential prediction. Teachers can use these data to formulate long-term teaching plans, and students and parents can also intuitively understand the learning progress, thus forming a comprehensive learning closed loop and helping students' all-round growth. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0039] Figure 1 A schematic diagram schematically shows the composition of a digital teaching system based on multimodal intelligent technology provided by an embodiment of the present invention;

[0040] Figure 2 The interactive schematic diagram of the digital teaching system based on multimodal intelligent technology provided by the embodiment of the present invention is schematically shown;

[0041] Figure 3 A schematic diagram schematically shows a use process diagram of a digital teaching system based on multimodal intelligent technology provided by an embodiment of the present invention;

[0042] Figure 4 The interactive process diagram of the digital teaching system based on multimodal intelligent technology provided by an embodiment of the present invention is schematically shown. DETAILED DESCRIPTION

[0043] The description of the embodiments of this specification should be combined with the corresponding drawings, which should be considered as part of the complete specification. In the drawings, the shape or thickness of the embodiments may be enlarged and indicated for simplification or convenience. Furthermore, the parts of each structure in the drawings will be described separately. It is worth noting that the elements not shown in the drawings or not described in words are in a form known to ordinary technicians in the relevant technical field.

[0044] The description of the embodiments herein and any reference to directions and orientations are only for the convenience of description and are not to be construed as any limitation on the scope of protection of the present invention. The following description of the preferred embodiments may involve combinations of features, which may exist independently or in combination, and the present invention is not particularly limited to the preferred embodiments. The scope of the present invention is defined by the claims.

[0045] like Figures 1 to 4 As shown, the present invention is based on multi-terminal linkage based on C / S architecture, and constructs a digital teaching system based on multimodal intelligent technology, which is composed of a teaching terminal, a control terminal, a student terminal and a service terminal.

[0046] The teaching end is based on screen devices, which are used to present digital content, including digital images and sound. The screen devices take advantage of their large size and high resolution to present the main content of the class, including courseware and video materials.

[0047] The control terminal provides teachers or teaching assistants with basic control capabilities for digital classrooms based on mobile devices. Through a simple and intuitive operation interface, teachers or teaching assistants can switch teaching content, adjust playback progress, and other operations. In addition, the control terminal also has the function of real-time monitoring of students' learning status, and can understand and intervene in students' classroom participation so that teachers can adjust teaching strategies at any time. The control terminal can also interact with students, such as raising questions and organizing discussions, to enhance the interactivity and fun of the classroom.

[0048] The student side provides students with digital interaction capabilities based on mobile devices with voice devices (such as microphones). Students can interact with the digital classroom in real time through mobile devices, ask questions, express opinions, participate in classroom questions and other interactive sessions. At the same time, the student side also has functions such as answering questions and submitting homework, which facilitates students to feedback their learning results in a timely manner. It is understandable that the mobile device on the student side can also be equipped with other devices such as cameras.

[0049] The server is equipped with an intelligent knowledge base, which is based on intelligent algorithms and big data analysis to provide intelligent support for auxiliary teaching. The server can analyze classroom data in real time, including students' learning behavior, classroom participation and answering performance, and provide teachers with accurate teaching suggestions. At the same time, the server can also generate personalized learning paths and resource recommendations based on students' learning progress and characteristics to improve learning efficiency. In addition, the server also supports natural language processing technology, which can answer some common questions of students, reduce the burden on teachers, and improve classroom efficiency.

[0050] The digital content of the course is published through interactive applications, and real-time interaction during the teaching process is achieved through the interactive interfaces reserved in the applications. The interactive interfaces include: natural language-based question interface, group competition interface, quick-answer interface and real-time input signal interface based on touch screen.

[0051] The natural language-based questioning interface is used to respond to sudden questions from teachers or students outside the teaching plan. This interactive interface provides a convenient way for teachers and students to ask questions outside the teaching plan. Enter the questioning session through the designated button on the teaching end. The teacher or student inputs voice through the mobile device. The application recognizes the natural language and analyzes the question content with the help of a large language model. It quickly provides accurate answers to the questioner and displays the answers and multimedia resources such as pictures and videos corresponding to the answers on the teaching end.

[0052] The group competition interface is used to respond to students participating in competitions in the teaching process as a group or individual. Before the course starts, each group is assigned a unique number or name based on the student device, so as to distinguish them in the subsequent competition. At the same time, the group information will be sent to each student's student terminal to let the students know which group they are in. The application will record the performance of each group or individual in real time according to the answers and interactions of each group in the class, and display the ranking and score.

[0053] The quick-answer interface is used to respond to students' quick-answer behaviors, and distribute limited interactive participation opportunities to the students (ends) with the fastest response speed through the control of the server.

[0054] When questions are raised during the course and a quick-answer session is initiated, the server enters the quick-answer status monitoring mode. After the student receives the quick-answer signal, an obvious quick-answer button prompt will appear on the interface. After the student sees the prompt, he or she quickly clicks the quick-answer button on the student. After the server receives the quick-answer request from each student, it will accurately record the time when each request arrives. The server sorts all the quick-answer requests in chronological order and quickly selects the student with the fastest response speed, that is, the student corresponding to the first quick-answer request that arrives. After determining the student who successfully answers, the server will immediately send a quick-answer result notification to all students. The information of the student who successfully answers will be displayed on the interface of other students.

[0055] The real-time input signal interface based on the touch screen is used for students to interact with digital content in real time through the student terminal, such as remote control signals.

[0056] When the course starts, a dedicated interactive area will be displayed on the student interface to receive real-time input signals from students based on the touch screen. The generated instructions will be transmitted to the server of the teaching system in real time through the network. After receiving the instructions, the server will perform corresponding operations on the digital content according to the type of instructions. Throughout the course, students can continue to input in real time through the touch screen and interact with the digital content.

[0057] The planned teaching content of the course is programmatically controlled through the server;

[0058] Teachers in the classroom no longer need to actively promote the main links of the lecture. When necessary, they can ask questions, pause or continue the operation through the control terminal.

[0059] The control logic of the course teaching has no requirements for digital content and can carry 2D or 3D application content, video content, etc.

[0060] Interactive behaviors that can earn rewards will be calculated in real time by the server and presented to the teaching end, so that students can get real-time feedback on their participation in the learning process, and the enthusiasm of students to participate will be stimulated through a scoreboard.

[0061] Through the voice equipment on the student side, the original words from the students are captured, which maximizes the form of interaction and is achieved in a more real-life interaction way. The youngest eligible students can be at least first graders in elementary school.

[0062] The server converts the captured voice information into natural language text and analyzes the natural language through a large language model to drive the course response decision chain based on the aerospace intelligent knowledge base.

[0063] The server includes:

[0064] Semantic understanding module, which is used to realize multi-level semantic analysis of speech text, including grammatical analysis, context understanding and implicit information extraction;

[0065] The intention recognition and question classification module is used to quickly identify students' question intentions based on voice text and automatically classify the question content;

[0066] Dynamic knowledge retrieval and optimization module, used to match student questions with relevant items in the aerospace knowledge base in real time based on a large language model;

[0067] An interactive feedback generation module that generates easy-to-understand speech and text for a large language model and matches it with visual content (such as pictures, videos, or animations);

[0068] The multimodal integration module is used to organize information in various forms such as text, voice, image, and video to generate a content package suitable for display;

[0069] The emotion recognition module is used to capture the emotional state of students through voice emotion analysis, and / or use camera equipment to assist in emotional judgment, such as confusion, excitement or frustration, adjust the answer method according to the emotional state, provide more encouragement or detailed explanation, and enhance the learning experience.

[0070] The server uses the course knowledge base or online search technology to supplement the course response decision-making process with data in real time. Combined with multimodal technology, it returns the final feedback to the teaching end in the form of text, voice, image or video for presentation, supporting the presentation of different types and quantities of content combinations.

[0071] like Figure 2As shown in the figure, the user logs in and connects to the server at the teaching end, and establishes communication with the server at the same time. After the teaching end initiates the class instruction, the control end accesses the server, and the student end connects to the server by scanning the code. After the teacher and students are ready, the teacher initiates the class start instruction to the server through the control end, and the server returns the start instruction to the teaching end. The group competition interface and the quick answer interface are used to complete the grouping, question and answer, and quick answer links. The specific information flow is as follows Figure 2 shown.

[0072] The serial numbers of the above-mentioned steps involved in the method of the present invention do not mean the order of execution of the method. The execution order of each step should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the implementation mode of the present invention.

[0073] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A digital teaching system based on multimodal intelligent technology, characterized in that: Including teaching end, control end, student end and service end; The teaching end displays digital content through a screen device; The control terminal provides the teacher or teaching assistant with the ability to control the digital classroom through a mobile device; The student terminal realizes real-time interaction between the student and the digital classroom through a mobile device equipped with a voice device; The server is equipped with an intelligent knowledge base, which analyzes classroom data based on intelligent algorithms and big data analysis technology, generates learning paths and recommended resources according to students' situations, answers questions with the help of natural language processing, and drives the entire teaching intelligent operation.

2. The system according to claim 1, characterized in that The teaching end publishes the digital content of the course through an interactive application program, and reserves an interactive interface to realize real-time interaction during the teaching process; The interactive interface includes a questioning interface based on natural language, a group competition interface, a quick answer interface and a real-time input signal interface based on a touch screen.

3. The system according to claim 2, characterized in that The control terminal at least includes a content switching module, a progress adjustment module and a monitoring module, and is configured with an operation interface, through which the teacher or teaching assistant uses the content switching module to switch the teaching content and uses the progress adjustment module to adjust the playback progress; The monitoring module can monitor the students' learning status in real time, record the students' participation, and feed back the monitoring content to the server.

4. The system according to claim 1, characterized in that Based on intelligent algorithms and big data analysis, the server side analyzes classroom data in real time after receiving monitoring content fed back by the control side. The classroom data at least includes students' learning behavior, class participation and answering performance. Based on data mining technology, it provides teachers with accurate teaching suggestions and generates personalized learning paths and resource recommendations based on students' learning progress and characteristics.

5. The system according to claim 2, characterized in that The question interface is used to identify sudden questions from teachers or students, and analyze the question content through a large language model to quickly provide accurate answers; The question interface is used to display answers and multimedia resources related to the question content.

6. The system according to claim 2, characterized in that The group competition interface allows students to participate in classroom competition in groups or individually; The system assigns a unique number or name to each group before the digital classroom begins, and records the performance of each group or individual in the classroom in real time, displaying the ranking and score.

7. The system according to claim 2, characterized in that The quick-answer interface is used to monitor students' quick-answer behaviors in real time, and distribute limited interactive participation opportunities to the students with the fastest response speed through the control of the server.

8. The system according to claim 1, characterized in that The server includes: Semantic understanding module, which is used to realize multi-level semantic analysis of speech text, including grammatical analysis, context understanding and implicit information extraction; The intention recognition and question classification module is used to quickly identify students' question intentions based on voice text and automatically classify the question content; Dynamic knowledge retrieval and optimization module, used to match student questions with relevant items in the aerospace knowledge base in real time based on a large language model; An interactive feedback generation module that generates understandable speech and text for a large language model and matches it with visual content; Multimodal integration module, which is used to organize information in various forms and generate content packages suitable for display; The emotion recognition module is used to capture the emotional state of students through speech sentiment analysis.

Images