Weather and energy education-oriented holographic interactive teaching system and method

Abstract

The invention discloses a holographic interactive teaching system and method for meteorological and energy education, and relates to the technical field of teaching systems. The system comprises a multi-mode input module, a virtual character interaction module, a data input module, a data processing module and a visualization and output module. The multi-mode input module is used for acquiring information such as gestures, voice and touch input; the virtual character interaction module is used for generating a virtual character and acquiring input information, and is used for interactive dialogue and action; the data input module is used for providing meteorological data; the data processing module is used for resolving a multi-scale model and prediction power; and the visualization and output module is used for visually outputting resolving and predicting results. According to the invention, an advanced holographic display technology, multi-mode man-machine interaction, a complex scientific calculation model and intelligent teaching guidance are combined, and an immersive, interactive and intelligent meteorological and energy education solution is provided, so that the teaching quality and learning effect are effectively improved.

Description

Technical Field

[0001] The present invention relates to the technical field of teaching systems, and in particular to an interactive teaching system and method for meteorology and energy science education that combines holographic display with human-computer interaction technology. Background Art

[0002] With the increasing global attention to renewable energy, especially wind power, and the frequent occurrence of extreme weather events, the demand for high-quality meteorology and energy education has grown significantly.

[0003] Traditional teaching methods, such as textbooks, two-dimensional images, videos, and lectures, lack intuitiveness when presenting complex three-dimensional meteorological phenomena (such as atmospheric circulation and typhoon structure) and abstract physical equations (such as the Navier-Stokes equations), making it difficult to stimulate students' interest and deepen their understanding. Students often need strong spatial imagination to grasp the relevant knowledge.

[0004] Holographic projection technology, capable of presenting realistic three-dimensional images, offers new possibilities for addressing these issues. However, current attempts to apply holographic technology to science education are still immature, with most remaining at the static display or limited interactive level, failing to fully exploit its potential.

[0005] Existing teaching equipment often lacks deep integration with complex scientific models (such as meteorological models and energy forecasting models), and also lacks intelligent interactive mechanisms that can guide the learning process and provide real-time feedback. Summary of the Invention

[0006] In response to the above-mentioned shortcomings, the purpose of the present invention is to provide a holographic interactive teaching system and method for meteorological and energy education. The system can provide students with an intuitive, immersive and interactive learning experience through holographic three-dimensional visualization, natural human-computer interaction, real-time model solving and data integration, and effectively enhance their understanding of complex meteorological phenomena and energy system principles.

[0007] To achieve the above object, the present invention adopts the following technical solutions: In a first aspect, the present invention provides a holographic interactive teaching system for meteorology and energy education, comprising a multimodal input module, a virtual character interaction module, a data input module, a data processing module, and a visualization and output module, wherein: The multimodal input module is used to obtain interactive information of user gestures, voice and touch screen input; The virtual character interaction module is used to generate and drive the virtual character based on pre-trained character model data, perform interactive dialogue and actions in response to the interactive information obtained by the multimodal input module, and transmit the user's intention or instructions regarding mode selection or system operation to the data processing module; The data input module is used to provide meteorological data from a real-time meteorological data interface or locally stored historical meteorological data according to instructions from the data processing module; The data processing module is used to receive and analyze user intentions or instructions transmitted from the virtual character interaction module, manage and switch between teaching mode and training mode accordingly, and call the multi-scale meteorological model for solution and the power prediction model for energy power prediction in the currently active mode; The visualization and output module is used to perform three-dimensional or two-dimensional visualization of the multi-scale meteorological model solution results, energy power prediction results, and the images and actions of the virtual characters in the virtual character interaction module output by the data processing module.

[0008] Furthermore, the multimodal input module includes a voice information acquisition module, a gesture information recognition module and a touch information input module; the voice information acquisition module collects user voice through a circular microphone array; the gesture information recognition module captures the user's three-dimensional gesture movements through a camera; and the touch information input module is used to receive the user's input operations on the touch screen.

[0009] Furthermore, the virtual character interaction module includes a virtual character engine module and an intelligent interaction module; the virtual character engine module generates a rendered image sequence or video stream of the virtual character's image, action and expression based on pre-trained character model data; the intelligent interaction module is used to receive and parse the interaction information from the multimodal input module, perform natural language understanding and dialogue management, generate corresponding voice and action feedback to drive the virtual character to explain or respond, and pass the user's operation intentions or instructions regarding mode selection and parameter adjustment to the corresponding functional modules in the data processing module.

[0010] Furthermore, the data input module includes a data source management module and a network communication module; the data source management module manages access to the real-time meteorological data interface and the local historical meteorological database according to the instructions of the data processing module, selects and provides a suitable meteorological data source; the network communication module is used to handle network connection and data transmission with external data sources, and ensure the security of data transmission and the stability of the connection.

[0011] Furthermore, the data processing module includes a mode management module, a multi-scale model solving module, a power prediction module and a visualization data generation module; the mode management module is used to receive and analyze user intentions or instructions transmitted from the virtual character interaction module, and is responsible for switching between the teaching mode and the training mode, state control, and managing the loading of teaching or training scenes and resources related to the current mode; the multi-scale model solving module has an embedded multi-scale meteorological model, and simulates and solves the atmospheric state and phenomena according to the currently activated mode, user-configured parameters and meteorological data provided by the data input module; the power prediction module has an embedded power prediction model, and adopts a machine learning prediction algorithm to predict energy-related power output based on the output of the multi-scale meteorological model solving module or the meteorological data directly provided by the data input module; the visualization data generation module is used to receive the solution results of the multi-scale meteorological model solving module, the prediction results of the power prediction module and the virtual character rendered image sequence or video stream output by the virtual character engine module, and synthesizes and uniformly processes this information (including meteorological data, prediction results and virtual character images) to generate structured graphic data for three-dimensional or two-dimensional visualization rendering.

[0012] Furthermore, the visualization and output module includes a holographic projection module and an output module; the holographic projection module is used to receive structured graphic data containing scenes, models and virtual character images generated by the visualization data generation module in the data processing module, and renders the data through the imaging unit to generate a three-dimensional or two-dimensional holographic image; the output module includes a screen and a speaker, the screen is used to display the three-dimensional or two-dimensional image generated by the holographic projection module, and the speaker is used to output the voice of the virtual character and system sound effects.

[0013] In a second aspect, the present invention provides a holographic interactive teaching method for meteorology and energy education. Running the holographic interactive teaching system for meteorology and energy education comprises the following steps: Step S1: The system is started and initialized. The data processing module displays the virtual character preset by the virtual character interaction module on the screen through the visualization and output module, and issues a welcome message and a mode selection prompt through the speaker. Step S2: The user inputs interaction information through the multimodal input module; the avatar interaction module receives and interprets the information, interacts with the user through dialogue, and transmits the user's explicit mode selection request or operation instruction to the mode management module in the data processing module; Step S3: If the request received by the mode management module is to enter the teaching mode, the mode management module switches to the teaching mode, loads the preset teaching scene resources or equation demonstration logic, and instructs the data input module to provide corresponding historical or real-time meteorological data; the multi-scale meteorological model solving module in the data processing module solves the model according to the teaching content and the provided meteorological data; the visualization data generation module in the data processing module integrates the solution results, scene and virtual character information to generate graphic data; the holographic projection module in the visualization and output module renders and outputs three-dimensional images, and the virtual character interaction module drives the virtual character to give a synchronous voice explanation according to the teaching script; the user can interact through the multimodal input module during this process, and the interaction request is processed by the virtual character interaction module and transmitted to the relevant modules in the data processing module; Step S4: If the request received by the mode management module is to enter the training mode, the mode management module switches to the training mode and loads the corresponding scene and user interface according to the user's further operation, and at the same time instructs the data input module to provide real-time or user-selected historical meteorological data; if the user's operation is to simulate meteorological phenomena, the multi-scale meteorological model solving module in the data processing module solves according to the parameters configured by the user and the provided meteorological data; if the user's operation is to perform power prediction, the power prediction module in the data processing module predicts according to the provided meteorological data; the visualization data generation module in the data processing module integrates the solution or prediction results, scene and virtual character information to generate graphic data; the holographic projection module in the visualization and output module renders and outputs three-dimensional or two-dimensional images, and the virtual character interaction module drives the virtual character to guide or explain; Step S5: After the visualization and output module presents the results to the user, the user can adjust parameters, select different data sources, or perform other interactive operations through the multimodal input module to repeat the simulation or prediction process and conduct exploratory learning. The virtual character interaction module can continuously provide analysis prompts or answer user questions about the simulation results. Step S6: After the user completes the learning or training task, he / she chooses to exit the system; the system can perform necessary learning record saving or setting clearing, and then shut down.

[0014] Compared with the prior art, the present invention has the following beneficial effects: 1. Immersive learning experience: Through high-quality holographic 3D visualization, abstract meteorological phenomena and complex physical processes are presented to students in an intuitive and three-dimensional manner, greatly enhancing the immersiveness and intuitiveness of learning.

[0015] 2. Enhanced interactivity: Supports multiple natural interaction methods such as gestures, voice, and touch, combined with intelligent guidance from virtual characters, to increase user engagement and learning initiative.

[0016] 3. Combination of theory and practice: The educational model focuses on explaining principles, while the practical training model provides an environment for hands-on operation and exploration, and can run professional-level models for simulation, effectively combining theoretical learning with practical application.

[0017] 4. Intelligent teaching assistance: Virtual characters can not only explain, but also engage in interactive conversations, provide intelligent guidance and feedback based on learning progress and interactions, and enhance the personalization and intelligence of teaching. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments.

[0019] Figure 1 It is a block diagram of the overall system principle provided by an embodiment of the present invention; Figure 2 is an internal diagram of a multimodal input module provided by an embodiment of the present invention; Figure 3 is an internal diagram of a virtual character interaction module provided by an embodiment of the present invention; Figure 4 is an internal diagram of a data input module provided by an embodiment of the present invention; Figure 5 is an internal diagram of a data processing module provided by an embodiment of the present invention; Figure 6 This is an internal diagram of the visualization and output module provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0020] The following is a diagram of an embodiment of the present invention. Figures 1 to 6 ), the technical solutions in the embodiments of the present invention are clearly and completely described. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments.

[0021] Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative work shall fall within the scope of protection of the present invention.

[0022] Example 1: Please refer to Figure 1 In the embodiment of the first aspect of the present invention, a holographic interactive teaching system for meteorological and energy education includes a multimodal input module, a virtual character interaction module, a data input module, a data processing module, and a visualization and output module, wherein: The multimodal input module is used to obtain interactive information of user gestures, voice and touch screen input; The avatar interaction module is used to generate and drive avatars based on pre-trained character model data, conduct interactive dialogues and actions in response to interaction information obtained by the multimodal input module, and transmit user intentions or instructions regarding mode selection or system operation to the data processing module; The data input module is used to provide meteorological data from a real-time meteorological data interface or locally stored historical meteorological data according to the instructions of the data processing module; The data processing module is used to receive and analyze user intentions or instructions transmitted by the virtual character interaction module, manage and switch between teaching mode and training mode accordingly, and call the multi-scale meteorological model for solution and the power prediction model for energy power prediction in the currently active mode; The visualization and output module is used to present the multi-scale meteorological model solution results, energy power prediction results, and the image and actions of the virtual characters in the virtual character interaction module in three-dimensional or two-dimensional visualization.

[0023] See also Figure 2 The multimodal input module includes a voice information acquisition module, a gesture information recognition module and a touch information input module; the voice information acquisition module collects user voice through a circular microphone array; the gesture information recognition module captures the user's three-dimensional gesture movements through a camera; and the touch information input module is used to receive user input operations on the touch screen.

[0024] It should be noted that: Voice information acquisition: Accurately collect the user's voice commands or inquiries through a circular microphone array.

[0025] Gesture information recognition: The camera is combined with image recognition algorithms to capture the user's gestures in three-dimensional space, such as clicking, waving, grabbing, rotating, etc., for intuitive control of holographic images.

[0026] Touch information input: Users input instructions, parameter settings, or select operations by tapping, sliding, or dragging on the touch screen.

[0027] See also Figure 3 The virtual character interaction module includes a virtual character engine module and an intelligent interaction module; the virtual character engine module generates a rendered image sequence or video stream of the virtual character's image, action and expression based on pre-trained character model data; the intelligent interaction module is used to receive and parse the interaction information from the multimodal input module, perform natural language understanding and dialogue management, generate corresponding voice and action feedback to drive the virtual character to explain or respond, and pass the user's operation intention or instructions regarding mode selection and parameter adjustment to the corresponding functional module in the data processing module.

[0028] It should be noted that: Virtual characters can be created using professional 3D modeling software and include a rich library of actions and expressions. The virtual character engine module is based on pre-trained character model data and uses real-time rendering engines such as Unreal Engine. According to the instructions of the intelligent interaction module, it generates rendered image sequences or video streams containing virtual character images, actions, expressions and lip synchronization. This image sequence or video stream will be provided as an input to the visualization data generation module, enabling it to provide vivid explanations and interactions.

[0029] Intelligent Interaction: This module uses natural language processing (NLP) technology to understand user voice questions or commands, maintaining the coherence of multiple rounds of conversation through a dialogue management system. To enhance responsiveness to professional questions, this module can connect to a domain knowledge base to assist in generating responses. This module can generate corresponding voice responses and action commands based on pre-set teaching scripts, real-time user interactions, or auxiliary information from the knowledge base. Furthermore, this module accurately transmits the user's explicit operational intentions or instructions regarding mode selection, parameter adjustment, and other issues to the corresponding functional modules in the data processing module (such as the mode management module) for subsequent processing. For complex questions that cannot be answered immediately, the system can guide users to other learning resources.

[0030] See also Figure 4 The data input module includes a data source management module and a network communication module; the data source management module manages access to the real-time meteorological data interface and the local historical meteorological database according to the instructions of the data processing module, selects and provides a suitable meteorological data source; the network communication module is used to handle the network connection and data transmission with the external data source, and ensure the security of data transmission and the stability of the connection.

[0031] It should be noted that: In order to improve the efficiency of real-time data access and cope with potential network fluctuations, the data input module can implement a data caching mechanism. For frequently requested real-time meteorological data, the system can cache it locally. When the external real-time data interface is temporarily unavailable or the response delay exceeds the preset threshold, the system can give priority to the most recent valid data in the cache, or fall back to the specified historical data set according to the configuration to ensure the continuity of the teaching or training process. If valid real-time data cannot be obtained and the cached data is also unavailable or inapplicable, the system can prompt the user (for example, through a virtual character) of the data source problem and provide options to use an alternative historical data set or wait for data recovery.

[0032] See also Figure 5The data processing module includes a mode management module, a multi-scale model solving module, a power prediction module and a visualization data generation module; the mode management module is used to receive and analyze the user intention or instruction transmitted from the virtual character interaction module, and is responsible for switching between the teaching mode and the training mode, state control, and managing the loading of teaching or training scenes and resources related to the current mode; the multi-scale model solving module is embedded with a multi-scale meteorological model, and simulates and solves the atmospheric state and phenomena according to the currently activated mode, the user-configured parameters and the meteorological data provided by the data input module; the power prediction module is embedded with a power prediction model, and adopts a machine learning prediction algorithm to predict the energy-related power output based on the output of the multi-scale meteorological model solving module or the meteorological data directly provided by the data input module; the visualization data generation module is used to receive the solution results of the multi-scale meteorological model solving module, the prediction results of the power prediction module and the virtual character rendering image sequence or video stream output by the virtual character engine module, and synthesizes and uniformly processes this information (including meteorological data, prediction results and virtual character images) to generate structured graphic data for three-dimensional or two-dimensional visualization rendering.

[0033] It should be noted that: The multi-scale meteorological model solving module embeds professional numerical weather forecast models or computational fluid dynamics models (such as WRF, OpenFOAM, etc.). With the support of the core computing unit (especially the GPU), it can perform numerical simulation and solution of meteorological phenomena such as atmospheric flow and energy conversion at different spatial and temporal scales according to the currently activated mode (preset scenario simulation in educational mode or user-defined simulation in practical training mode), user-configured parameters and meteorological data provided by the data input module.

[0034] The power prediction module uses a prediction algorithm based on machine learning (such as recurrent neural network RNN, long short-term memory network LSTM, Transformer). This module predicts the energy (such as wind power) power output of a specific area or a specific wind turbine generator set based on the meteorological element field (such as wind speed, wind direction, air pressure, temperature at a specific height, etc.) output by the multi-scale meteorological model solution module, or the meteorological data directly provided by the data input module.

[0035] See also Figure 6 The visualization and output module includes a holographic projection module and an output module; the holographic projection module is used to receive the structured graphic data containing scenes, models and virtual characters generated by the visualization data generation module in the data processing module, and render the data through the imaging unit to generate a three-dimensional or two-dimensional holographic image; the output module includes a screen and a speaker, the screen is used to display the three-dimensional or two-dimensional image generated by the holographic projection module, and the speaker is used to output the voice of the virtual character and system sound effects.

[0036] When the system is started and initialized, the data processing module will display the virtual character preset by the virtual character interaction module on the screen through the visualization and output module, and send out a welcome message and mode selection prompts through the speaker; The user inputs interaction information through the multimodal input module (for example, speaking "enter teaching mode" or clicking "training mode" on the touch screen); the virtual character interaction module receives and interprets the information, interacts with the user in a dialogue (for example, "You have selected teaching mode"), and transmits the user's explicit mode selection request or operation instruction to the mode management module in the data processing module; If the request received by the mode management module is to enter the teaching mode, the mode management module switches to the teaching mode. The mode management module can load the preset teaching scene resources or equation demonstration logic according to the preset teaching process or the user's further selection (for example, voice or touch selection of "learning typhoon structure"), and instruct the data input module to provide corresponding historical or real-time meteorological data; the multi-scale meteorological model solving module in the data processing module solves the model according to the teaching content and the provided meteorological data; the visualization data generation module in the data processing module integrates the solution results, scene and virtual character information to generate graphic data; the holographic projection module in the visualization and output module renders and outputs three-dimensional images, and at the same time, the virtual character interaction module drives the virtual character to give a synchronous voice explanation according to the teaching script; the user can interact through the multimodal input module during this process (for example, gestures to rotate the three-dimensional image), and the interaction request is processed by the virtual character interaction module and passed to the relevant modules in the data processing module; If the request received by the mode management module is to enter the training mode, the mode management module switches to the training mode, and loads the corresponding scene and user interface according to the user's further operation, and at the same time instructs the data input module to provide real-time or user-selected historical meteorological data; if the user's operation is to simulate meteorological phenomena, the multi-scale meteorological model solving module in the data processing module solves according to the parameters configured by the user and the provided meteorological data; if the user's operation is to perform power prediction, the power prediction module in the data processing module predicts according to the provided meteorological data; the visualization data generation module in the processing module integrates the solution or prediction results, scene and virtual character information to generate graphic data; the holographic projection module in the visualization and output module renders and outputs three-dimensional or two-dimensional images, and the virtual character interaction module drives the virtual character to guide or explain; After the visualization and output module presents the results to the user, the user can adjust parameters, select different data sources, or perform other interactive operations through the multimodal input module to repeat the simulation or prediction process and conduct exploratory learning. The virtual character interaction module can continuously provide analysis prompts or answer users' questions about the simulation results. After the user completes the learning or training task, he / she chooses to exit the system; the system can perform necessary learning record saving or setting clearing, and then shut down.

[0037] The present invention can combine advanced holographic display technology, multimodal human-computer interaction, complex scientific computing models and intelligent teaching guidance to overcome the limitations of traditional teaching methods and provide an immersive, interactive and intelligent meteorological and energy education solution, thereby effectively improving teaching quality and learning outcomes.

[0038] It should be noted that those skilled in the art should understand that the embodiments described above are only preferred examples given to illustrate the principles of the present invention and are not intended to limit the scope of protection of the present invention. Within the spirit and scope of the present invention, any modification, equivalent replacement or improvement based on the same concept, such as the use of different models of specific hardware devices, different software libraries or algorithm implementation details, adjustment of specific steps of the interaction process, or selection of certain non-core functions or performance indicators based on cost and application scenarios, should be deemed to be included in the scope of protection of the present invention.

Claims

1. A holographic interactive teaching system for meteorology and energy education, characterized by: It includes multimodal input module, virtual character interaction module, data input module, data processing module and visualization and output module; The multimodal input module is used to obtain interactive information of user gestures, voice and touch screen input; The virtual character interaction module is used to generate and drive the virtual character based on pre-trained character model data, perform interactive dialogue and actions in response to the interactive information obtained by the multimodal input module, and transmit the user's intention or instructions regarding mode selection or system operation to the data processing module; The data input module is used to provide meteorological data from a real-time meteorological data interface or locally stored historical meteorological data according to instructions from the data processing module; The data processing module is used to receive and analyze user intentions or instructions transmitted from the virtual character interaction module, manage and switch between teaching mode and training mode accordingly, and call the multi-scale meteorological model for solution and the power prediction model for energy power prediction in the currently active mode; The visualization and output module is used to perform three-dimensional or two-dimensional visualization of the multi-scale meteorological model solution results, energy power prediction results, and the images and actions of the virtual characters in the virtual character interaction module output by the data processing module.

2. The holographic interactive teaching system for meteorology and energy education according to claim 1 is characterized by: The multimodal input module includes a voice information acquisition module, a gesture information recognition module and a touch information input module; the voice information acquisition module collects user voice through a circular microphone array; the gesture information recognition module captures the user's three-dimensional gesture movements through a camera; and the touch information input module is used to receive user input operations on the touch screen.

3. The holographic interactive teaching system for meteorology and energy education according to claim 1 is characterized by: The virtual character interaction module includes a virtual character engine module and an intelligent interaction module; the virtual character engine module generates a rendered image sequence or video stream of the virtual character's image, action and expression based on pre-trained character model data; the intelligent interaction module is used to receive and parse the interaction information from the multimodal input module, perform natural language understanding and dialogue management, generate corresponding voice and action feedback to drive the virtual character to explain or respond, and pass the user's operation intention or instructions regarding mode selection and parameter adjustment to the corresponding functional module in the data processing module.

4. The holographic interactive teaching system for meteorology and energy education according to claim 1 is characterized by: The data input module includes a data source management module and a network communication module; The data source management module manages access to the real-time meteorological data interface and the local historical meteorological database according to the instructions of the data processing module, selects and provides appropriate meteorological data sources; the network communication module is used to handle network connections and data transmission with external data sources, and ensure the security of data transmission and the stability of connections.

5. The holographic interactive teaching system for meteorology and energy education according to claim 1 is characterized by: The data processing module includes a mode management module, a multi-scale model solving module, a power prediction module and a visualization data generation module; the mode management module is used to receive and analyze user intentions or instructions transmitted from the virtual character interaction module, and is responsible for switching between the teaching mode and the training mode, state control, and managing the loading of teaching or training scenes and resources related to the current mode; the multi-scale model solving module has an embedded multi-scale meteorological model, and simulates and solves the atmospheric state and phenomena according to the currently activated mode, user-configured parameters and meteorological data provided by the data input module; the power prediction module has an embedded power prediction model, and adopts a machine learning prediction algorithm to predict energy-related power output based on the output of the multi-scale meteorological model solving module or the meteorological data directly provided by the data input module; the visualization data generation module is used to receive the solution results of the multi-scale meteorological model solving module, the prediction results of the power prediction module and the virtual character rendering image sequence or video stream output by the virtual character engine module, and performs scene synthesis and unified processing on this information to generate structured graphic data for three-dimensional or two-dimensional visualization rendering.

6. The holographic interactive teaching system for meteorology and energy education according to claim 5 is characterized by: The visualization and output module includes a holographic projection module and an output module; the holographic projection module is used to receive structured graphic data containing scenes, models and virtual character images generated by the visualization data generation module in the data processing module, and render the data through the imaging unit to generate a three-dimensional or two-dimensional holographic image; the output module includes a screen and a speaker, the screen is used to display the three-dimensional or two-dimensional image generated by the holographic projection module, and the speaker is used to output the voice of the virtual character and system sound effects.

7. A holographic interactive teaching method for meteorology and energy education, characterized by: Running the holographic interactive teaching system for meteorology and energy education as described in claim 6 comprises the following steps: Step S1: The system is started and initialized. The data processing module displays the virtual character preset by the virtual character interaction module on the screen through the visualization and output module, and issues a welcome message and a mode selection prompt through the speaker. Step S2: The user inputs interaction information through the multimodal input module; the avatar interaction module receives and interprets the information, interacts with the user through dialogue, and transmits the user's explicit mode selection request or operation instruction to the mode management module in the data processing module; Step S3: If the request received by the mode management module is to enter the teaching mode, the mode management module switches to the teaching mode, loads the preset teaching scene resources or equation demonstration logic, and instructs the data input module to provide corresponding historical or real-time meteorological data; the multi-scale meteorological model solving module in the data processing module solves the model according to the teaching content and the provided meteorological data; the visualization data generation module in the data processing module integrates the solution results, scene and virtual character information to generate graphic data; the holographic projection module in the visualization and output module renders and outputs three-dimensional images, and the virtual character interaction module drives the virtual character to give a synchronous voice explanation according to the teaching script; the user can interact through the multimodal input module during this process, and the interaction request is processed by the virtual character interaction module and transmitted to the relevant modules in the data processing module; Step S4: If the request received by the mode management module is to enter the training mode, the mode management module switches to the training mode and loads the corresponding scene and user interface according to the user's further operation, and at the same time instructs the data input module to provide real-time or user-selected historical meteorological data; if the user's operation is to simulate meteorological phenomena, the multi-scale meteorological model solving module in the data processing module solves according to the parameters configured by the user and the provided meteorological data; if the user's operation is to perform power prediction, the power prediction module in the data processing module predicts according to the provided meteorological data; the visualization data generation module in the data processing module integrates the solution or prediction results, scene and virtual character information to generate graphic data; the holographic projection module in the visualization and output module renders and outputs three-dimensional or two-dimensional images, and the virtual character interaction module drives the virtual character to guide or explain; Step S5: After the visualization and output module presents the results to the user, the user can adjust parameters, select different data sources, or perform other interactive operations through the multimodal input module to repeat the simulation or prediction process and conduct exploratory learning. The virtual character interaction module can continuously provide analysis prompts or answer user questions about the simulation results. Step S6: After the user completes the learning or training task, he / she chooses to exit the system; the system can perform necessary learning record saving or setting clearing, and then shut down.

Images