Document-based interactive 3D digital courseware making method and system

Abstract

The invention relates to a document-based interactive 3D digital courseware making method and system. The method comprises the following steps: S1, constructing an association information base about knowledge points based on a 3D model; s2, acquiring a course manuscript uploaded by a user, and extracting an outline paragraph to obtain knowledge points and interaction points; s3, completing outline identification, knowledge point identification and interaction type classification based on the association information base; and S4, generating interactive 3D digital courseware. According to the invention, teachers can still complete basic contents through mainstream and traditional office software, and through documents containing texts, images and tables, digital courseware is automatically generated, so that the interactivity and flexibility of teaching contents are improved, and the requirements of modern education are met.

Description

Technical Field

[0001] The present invention relates to the technical field of digital teaching, and in particular to a method and system for producing interactive 3D digital courseware based on documents. Background Art

[0002] In the modern education environment, teachers are facing more and more challenges, especially in the preparation and presentation of teaching content. The traditional teaching method mainly relies on teachers to create courseware through office software (such as Microsoft Word, PowerPoint, etc.). Although this method enables teachers to directly control the final content, it also has the following significant limitations:

[0003] Although traditional office software is powerful, its main functions are concentrated on text and graphics processing, and lack flexible interactive functions. Teachers can often only display knowledge points through static slides, which makes it difficult to achieve dynamic interaction and immersive learning experience.

[0004] The forms of interaction that students can participate in in class mainly rely on teachers' oral questions and offline discussions. This method is difficult to stimulate students' interest and initiative in learning, especially when explaining complex knowledge points.

[0005] The production of high-quality teaching courseware requires teachers to have certain professional skills, such as graphic design, animation production, etc. However, most teachers focus on the delivery of teaching content and lack relevant technical background, which makes them feel powerless when using traditional office software to produce courseware.

[0006] Due to the lack of appropriate training and support, teachers often cannot realize the full potential of traditional tools, which affects the quality of courseware and teaching effectiveness.

[0007] With the development of educational technology, more and more schools and institutions are trying to use software development tools and platforms to create interactive courseware. However, the standardized production process of this method is often complicated and highly customized, which leads to a significant increase in development costs.

[0008] Although software development can greatly enhance interactive effects, such as expanding classroom experience through 3D digital content, teachers’ lack of content production capabilities prevents them from effectively participating in the courseware development process, resulting in a gap in information transmission.

[0009] The current courseware production process often involves multiple links, including content design, model making, program development, etc. The production chain is too long, resulting in a decrease in teachers' ability to control the final content.

[0010] There is often a time delay between content creation and final presentation, and teachers are unable to adjust and optimize courseware in a timely manner, which affects the flexibility and effectiveness of teaching.

[0011] In summary, although the traditional teaching courseware production method meets the needs of teachers to a certain extent, it has obvious shortcomings in terms of interactive effects, professional skills, cost control and production efficiency. These problems not only limit teachers' teaching innovation, but also affect students' learning experience and effects. Therefore, there is an urgent need for a new type of courseware generation system that integrates advanced technical means to improve the interactivity and flexibility of teaching content to meet the needs of modern education. Summary of the invention

[0012] In order to solve the technical problems existing in the above-mentioned prior art, the purpose of the present invention is to provide a method and system for producing document-based interactive 3D digital courseware, which can enhance the interactivity and flexibility of teaching content to meet the needs of modern education.

[0013] To achieve the above-mentioned object of the invention, the present invention provides a method for producing interactive 3D digital courseware based on a document, comprising the following steps:

[0014] Step S1, constructing a related information database about knowledge points based on the 3D model;

[0015] Step S2: Obtain the course manuscript uploaded by the user, extract the outline paragraphs, and obtain the knowledge points and interaction points;

[0016] Step S3: Based on the associated information database, outline recognition, knowledge point recognition and interaction type classification are completed;

[0017] Step S4: Generate interactive 3D digital courseware.

[0018] According to a technical solution of the present invention, in step S1, an associated information library is established based on external knowledge point information on the 3D model, and any of the knowledge point information at least includes a knowledge label, a summary and three-dimensional position information based on a model coordinate system.

[0019] According to a technical solution of the present invention, in step S2, after obtaining the course manuscript uploaded by the user, the corresponding file format reading plug-in is used to extract the text and format information in the course manuscript into structured text. The specific steps include:

[0020] Use the corresponding file format reading plug-in to extract text and format information;

[0021] Automatically divide the manuscript into multiple outline paragraphs;

[0022] Extract knowledge points from each outline paragraph;

[0023] Generate interaction points based on knowledge points.

[0024] According to a technical solution of the present invention, in step S3, a large language model LLM is used to perform text parsing, and knowledge points and structured information are automatically extracted by setting knowledge domains and courseware production processes, specifically including:

[0025] Based on the multiple outline paragraphs obtained in step S2, a clear course structure is constructed;

[0026] Based on the knowledge points and / or course structure obtained in step S2, associating with the associated information base of the knowledge points;

[0027] Determine the interaction point type based on the characteristics of the knowledge point.

[0028] According to a technical solution of the present invention, in step S4, structured information of interactive 3D digital courseware is generated based on the course structure, knowledge points and information base associated with the knowledge points, interaction points and interaction point types.

[0029] According to one aspect of the present invention, a document-based interactive 3D digital courseware production system is proposed, comprising:

[0030] A construction module, used to construct an associated information base about knowledge points based on the 3D model;

[0031] Intelligent extraction module, used to obtain the original course manuscript uploaded by the user, extract the outline paragraphs, and obtain the knowledge points and interaction points;

[0032] The parsing module is used to complete outline recognition, knowledge point recognition and interaction type classification based on the associated information database;

[0033] The digital courseware generation module is used to generate interactive 3D digital courseware.

[0034] According to a technical solution of the present invention, the intelligent extraction module includes:

[0035] The reading submodule is used to extract text and format information using the corresponding file format reading plug-in;

[0036] The segmentation submodule is used to automatically segment the manuscript into multiple outline paragraphs;

[0037] The extraction submodule is used to extract knowledge points from each outline paragraph;

[0038] The generation submodule is used to generate interaction points based on knowledge points.

[0039] According to a technical solution of the present invention, the parsing module includes:

[0040] The construction submodule is used to build a clear course structure based on multiple outline paragraphs obtained by the intelligent extraction module;

[0041] An association submodule, used to associate the knowledge points and / or course structure obtained by the intelligent extraction module with the association information base of the knowledge points;

[0042] The determination submodule is used to determine the type of interaction point according to the characteristics of the knowledge point.

[0043] According to one aspect of the present invention, there is provided an electronic device, comprising: one or more processors, one or more memories, and one or more computer programs; wherein the processor is connected to the memory, and the one or more computer programs are stored in the memory, and when the electronic device is running, the processor executes the one or more computer programs stored in the memory, so that the electronic device executes a document-based interactive 3D digital courseware production method as described in any one of the above technical solutions.

[0044] According to one aspect of the present invention, a computer-readable storage medium is provided for storing computer instructions. When the computer instructions are executed by a processor, a method for producing a document-based interactive 3D digital courseware as described in any one of the above technical solutions is implemented.

[0045] Compared with the prior art, the present invention has the following beneficial effects:

[0046] The present invention proposes a method and system for producing interactive 3D digital courseware based on documents, which enables teachers to complete basic content through mainstream and traditional office software, and automatically generate digital courseware through documents containing texts, images, and tables, thereby improving the interactivity and flexibility of teaching content to meet the needs of modern education.

[0047] Through open interfaces, the assets contained in traditional courseware software development can be reused, and the application development of digital content assets can be decoupled from the actual application in the courseware through one-time annotation work, so that the production process of digital courseware with complex interactive methods can get rid of the production method of traditional customized software development;

[0048] Through intelligent technology based on natural language, we can open up the automated production process from office documents to digital courseware content, allowing teachers to directly influence digital course content through traditional methods and see actual results more quickly, thereby reducing the cost of adjustment and optimization. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0050] Figure 1 A flowchart schematically showing a method for producing interactive 3D digital courseware based on a document in an implementation case of the present invention;

[0051] Figure 2 A schematic diagram schematically shows the composition of a system for making interactive 3D digital courseware based on documents in an implementation case of the present invention;

[0052] Figure 3 The flowchart of making interactive 3D digital courseware by using the document-based interactive 3D digital courseware making system according to the present invention is schematically shown. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0054] like Figure 1 As shown, a method for making interactive 3D digital courseware based on a document of the present invention comprises the following steps:

[0055] Step S1, constructing a related information database about knowledge points based on the 3D model;

[0056] Based on the external knowledge point information on the 3D model, an associated information library is established, and any of the knowledge point information at least includes a knowledge label, a summary and three-dimensional position information based on the model coordinate system.

[0057] Each associated information library is equivalent to a 3D digital asset. Taking the digital assets of China's Tiangong Space Station as an example, it contains detailed information about the Wentian Experimental Module, as shown below:

[0058] {

[0059] "Name":"Wentian Experimental Chamber",

[0060] "Model ID":"xxxxxxx",

[0061] "Abstract":"The Wentian Experimental Module is part of China's Tiangong Space Station and is mainly used for scientific experiments.",

[0062] "Knowledge tags": ["Tiangong", "Space Station", "Weightlessness Experiment"],

[0063] "Coordinates": [22.1, 10.4, 15.3]

[0064] }

[0065] Among them, "Name" is the name of the knowledge point. The name in the above example is "Wentian Laboratory Cabin"; "Model ID" is the unique identifier associated with the 3D model asset; "Knowledge Tag" represents the keywords related to the knowledge point, which is convenient for classification and retrieval; "Coordinates" represent the data coordinates modeled in the 3D model.

[0066] Step S2: Obtain the course manuscript uploaded by the user, extract the outline paragraphs, and obtain the knowledge points and interaction points;

[0067] After obtaining the course manuscript uploaded by the user, use the corresponding file format reading plug-in to extract the text and format information in the course manuscript into structured text. The specific steps include:

[0068] Use the corresponding file format reading plug-in to extract text and format information;

[0069] Automatically divide the manuscript into multiple outline paragraphs;

[0070] Extract knowledge points from each outline paragraph;

[0071] Generate interaction points based on knowledge points.

[0072] Still taking the Chinese Tiangong Space Station as an example, assuming that the course manuscript uploaded by the user is a paper about the Tiangong Space Station, the system will automatically identify and generate the following outline:

[0073] 1. Introduction

[0074] -Background of Tiangong Space Station

[0075] - Development History

[0076] 2. Main components

[0077] -Wentian Experimental Chamber

[0078] -Other experimental chambers

[0079] 3. Scientific Experiments

[0080] -Weightlessness experiment

[0081] -Biological Experiments

[0082] The system will extract the corresponding knowledge points for each outline paragraph and classify the interaction types.

[0083] Users upload the course manuscript, and the system automatically reads the text content. Through natural language processing technology, the system analyzes the text and generates an outline structure. Based on the preset knowledge base, the system automatically extracts knowledge points in the text and uses machine learning algorithms to classify the interaction types of knowledge points.

[0084] It supports reading multiple file formats, ensuring that users can easily upload various teaching materials and complete extraction of text and format information. It improves the accuracy of information extraction through intelligent paragraph segmentation and knowledge point extraction.

[0085] Step S3: Based on the associated information database, outline recognition, knowledge point recognition and interaction type classification are completed;

[0086] Use the Large Language Model (LLM) to parse text and automatically extract knowledge points and structured information by setting knowledge domains and courseware production processes, including:

[0087] Based on the multiple outline paragraphs obtained in step S2, a clear course structure is constructed;

[0088] Based on the knowledge points and / or course structure obtained in step S2, associating with the associated information base of the knowledge points;

[0089] According to the characteristics of knowledge points, the types of interaction points are determined, and each knowledge point is intelligently classified into a limited set of interaction types to ensure the diversity of subsequent interaction design.

[0090] By setting relevant prompt information on knowledge areas, courseware production processes and key points, we implement basic intelligent visible text prompt word engineering, which greatly improves the efficiency and accuracy of courseware production.

[0091] Step S4, generating interactive 3D digital courseware;

[0092] Based on the course structure, knowledge points and the information base associated with the knowledge points, interaction points and interaction point types, the structured information of interactive 3D digital courseware is generated.

[0093] By integrating the structured information obtained in each step to form complete courseware data, the corresponding associated information library is loaded according to the model ID to ensure the association between the model and the knowledge point information, and the corresponding interaction logic is generated according to the interaction type. For example: a detailed information box pops up after clicking on a knowledge point, and the generated 3D interactive courseware is published to the teaching platform for teachers and students to use.

[0094] It can quickly generate courseware structured information at a speed of minutes under normal performance; the generated courseware structured information contains all the information required for 3D interactive digital courseware, ensuring the integrity and functionality of the courseware; by abstracting the interaction types into dialogue and touch, combined with the intelligent understanding and generation capabilities of the large language model, it supports various interaction forms such as knowledge point question and answer, 3D model sandbox display, first / third perspective roaming, etc.

[0095] like Figure 2 and Figure 3 As shown, according to one aspect of the present invention, a system for making interactive 3D digital courseware based on documents is proposed, comprising:

[0096] A construction module, used to construct an associated information base about knowledge points based on the 3D model;

[0097] Intelligent extraction module, used to obtain the original course manuscript uploaded by the user, extract the outline paragraphs, and obtain the knowledge points and interaction points;

[0098] The parsing module is used to complete outline recognition, knowledge point recognition and interaction type classification based on the associated information database;

[0099] The digital courseware generation module is used to generate interactive 3D digital courseware.

[0100] According to a technical solution of the present invention, the intelligent extraction module includes:

[0101] The reading submodule is used to extract text and format information using the corresponding file format reading plug-in;

[0102] The segmentation submodule is used to automatically segment the manuscript into multiple outline paragraphs;

[0103] The extraction submodule is used to extract knowledge points from each outline paragraph;

[0104] The generation submodule is used to generate interaction points based on knowledge points.

[0105] According to a technical solution of the present invention, the parsing module includes:

[0106] The construction submodule is used to build a clear course structure based on multiple outline paragraphs obtained by the intelligent extraction module;

[0107] An association submodule, used to associate the knowledge points and / or course structure obtained by the intelligent extraction module with the association information base of the knowledge points;

[0108] The determination submodule is used to determine the type of interaction point according to the characteristics of the knowledge point.

[0109] According to one aspect of the present invention, there is provided an electronic device, comprising: one or more processors, one or more memories, and one or more computer programs; wherein the processor is connected to the memory, and the one or more computer programs are stored in the memory, and when the electronic device is running, the processor executes the one or more computer programs stored in the memory, so that the electronic device executes a document-based interactive 3D digital courseware production method as described in any one of the above technical solutions.

[0110] According to one aspect of the present invention, a computer-readable storage medium is provided for storing computer instructions. When the computer instructions are executed by a processor, a method for producing a document-based interactive 3D digital courseware as described in any one of the above technical solutions is implemented.

[0111] The present invention realizes the intelligent generation of educational courseware by integrating multiple modules, significantly improves the efficiency of courseware production, and meets the needs of personalized teaching. At the same time, the introduction of 3D digital assets (associated information library) enhances the interactivity and fun of the course, making it easier for students to understand complex knowledge points and improving the learning experience;

[0112] The automated courseware generation process greatly shortens teachers’ preparation time, allowing them to devote more energy to teaching and save time costs.

[0113] The system can quickly adjust and generate corresponding courseware content according to the needs of different students to achieve personalized teaching.

[0114] In addition, it should be noted that the present invention can be provided as a method, an apparatus or a computer program product. Therefore, the embodiments of the present invention can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the embodiments of the present invention can take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program code.

[0115] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0116] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device, so that a series of operation steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0117] It should also be noted that, in the present invention, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0118] Finally, it should be noted that the above is a preferred embodiment of the present invention. It should be pointed out that although the preferred embodiment of the present invention has been described, for those skilled in the art, once the basic creative concept of the present invention is known, several improvements and modifications can be made without departing from the principles of the present invention, and these improvements and modifications should also be regarded as the protection scope of the present invention. Therefore, the attached claims are intended to be interpreted as including the preferred embodiment and all changes and modifications that fall within the scope of the embodiments of the present invention.

Claims

1. A method for producing interactive 3D digital courseware based on documents, characterized in that: The following steps are involved: Step S1, constructing a related information database about knowledge points based on the 3D model; Step S2: Obtain the course manuscript uploaded by the user, extract the outline paragraphs, and obtain the knowledge points and interaction points; Step S3: Based on the associated information database, outline recognition, knowledge point recognition and interaction type classification are completed; Step S4: Generate interactive 3D digital courseware.

2. The method for producing document-based interactive 3D digital courseware according to claim 1, characterized in that: In the step S1, based on the knowledge point information attached to the 3D model, an associated information library is established, and any of the knowledge point information at least includes a knowledge label, a summary and three-dimensional position information based on the model coordinate system.

3. The method for producing document-based interactive 3D digital courseware according to claim 2, characterized in that: In step S2, after obtaining the course manuscript uploaded by the user, the corresponding file format reading plug-in is used to extract the text and format information in the course manuscript into structured text. The specific steps include: Use the corresponding file format reading plug-in to extract text and format information; Automatically divide the manuscript into multiple outline paragraphs; Extract knowledge points from each outline paragraph; Generate interaction points based on knowledge points.

4. The method for producing document-based interactive 3D digital courseware according to claim 3, characterized in that: In step S3, the large language model LLM is used to perform text analysis, and knowledge points and structured information are automatically extracted by setting the knowledge domain and courseware production process, which specifically includes: Based on the multiple outline paragraphs obtained in step S2, a clear course structure is constructed; Based on the knowledge points and / or course structure obtained in step S2, associating with the associated information base of the knowledge points; Determine the interaction point type based on the characteristics of the knowledge point.

5. The method for producing document-based interactive 3D digital courseware according to claim 3, characterized in that: In the step S4, structured information of interactive 3D digital courseware is generated based on the course structure, knowledge points and the information base associated with the knowledge points, interaction points and interaction point types.

6. A document-based interactive 3D digital courseware production system, characterized in that: include: A construction module, used to construct an associated information base about knowledge points based on the 3D model; Intelligent extraction module, used to obtain the original course manuscript uploaded by the user, extract the outline paragraphs, and obtain the knowledge points and interaction points; The parsing module is used to complete outline recognition, knowledge point recognition and interaction type classification based on the associated information database; The digital courseware generation module is used to generate interactive 3D digital courseware.

7. The system for making interactive 3D digital courseware based on documents according to claim 6, characterized in that: The intelligent extraction module comprises: The reading submodule is used to extract text and format information using the corresponding file format reading plug-in; The segmentation submodule is used to automatically segment the manuscript into multiple outline paragraphs; The extraction submodule is used to extract knowledge points from each outline paragraph; The generation submodule is used to generate interaction points based on knowledge points.

8. The system for making interactive 3D digital courseware based on documents according to claim 6, characterized in that: The parsing module comprises: The construction submodule is used to build a clear course structure based on multiple outline paragraphs obtained by the intelligent extraction module; An association submodule, used to associate the knowledge points and / or course structure obtained by the intelligent extraction module with the association information base of the knowledge points; The determination submodule is used to determine the type of interaction point according to the characteristics of the knowledge point.

9. An electronic device, characterized in that: include: One or more processors, one or more memories, and one or more computer programs; wherein the processor is connected to the memory, and the one or more computer programs are stored in the memory. When the electronic device is running, the processor executes the one or more computer programs stored in the memory, so that the electronic device executes the document-based interactive 3D digital courseware production method as described in any one of claims 1 to 5.

10. A computer-readable storage medium, characterized in that: Used to store computer instructions, which, when executed by a processor, implement the method for producing document-based interactive 3D digital courseware as described in any one of claims 1 to 5.

Images