Children music immersive learning system using virtual reality technology

By designing a children's music learning system with virtual reality environment and multiple interactive modules, the problem of poor learning experience in the existing system is solved, and music education with high immersion and interactiveness is achieved, and children's learning effect and performance skills are improved. .

CN119400045AInactive Publication Date: 2025-02-07王彤
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411847030.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-13
Publication Date
2025-02-07
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing virtual reality system lacks rich learning content and interactive experiences in the field of children's music education, resulting in poor learning experience and difficulty in maintaining children's concentration.

Method used

A children's music immersive learning system using virtual reality technology is designed, including virtual reality environment building module, immersive audio experience module, intelligent interactive teaching module, interactive classroom and distance teaching module and evaluation module, through multiple interactive methods and Personalized teaching, providing immersive and interactive music learning experience.

Benefits of technology

It significantly enhances children's learning immersion and fun, enhances the authenticity and interactivity of music learning, and improves the learning effect and performance skills through personalized teaching and real-time feedback.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119400045A_ABST
    Figure CN119400045A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of virtual reality teaching, and discloses a children's music immersive learning system using a virtual reality technology, which creates an immersive music world for children by constructing a three-dimensional virtual reality environment and dynamically simulating musical instruments and music elements, and significantly enhances the immersion and interestingness of learning. The immersive audio experience module brings a surrounding sound effect, so that the reality and interactivity of music learning are improved; the intelligent interactive teaching module uses multiple interactive modes to enable children to interact with music in a virtual space, and the learning effect and playing skills are fed back and improved in real time; the interactive classroom and remote teaching module breaks space-time limitation, realizes real-time interaction between teachers and students, and provides personalized comprehensive guidance; the evaluation module and the artificial intelligence personalized teaching module provide targeted guidance and content customization according to the child performance and the learning progress, and further improve the learning efficiency and pertinence.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of virtual reality teaching, and in particular to a children's music immersive learning system utilizing virtual reality technology. Background Art

[0002] Traditional children's music education often relies on paper music scores, physical instruments and face-to-face guidance from teachers. However, this method has many limitations, such as space limitations, time limitations, instrument resource limitations, and lack of interactivity and fun. With the continuous development of virtual reality technology, people have begun to explore the application of VR or AR technology in the field of education to provide a richer and more diverse learning experience.

[0003] Although virtual reality technology has broad application prospects in the field of children's music education, the virtual reality systems currently on the market for this field are still insufficient. They can often only provide basic music learning and performance functions, lack richer and more diverse learning content and interactive experience, resulting in a poor experience, especially for children, who find it difficult to concentrate. For this reason, a children's music immersive learning system using virtual reality technology is proposed. Summary of the invention

[0004] In view of the deficiencies of the prior art, the present invention provides a children's music immersive learning system using virtual reality technology to solve the background technical problems.

[0005] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a children's music immersive learning system using virtual reality technology, comprising a virtual reality environment construction module, an immersive audio experience module, an interactive learning module, an interactive classroom and remote teaching module, and an evaluation module;

[0006] Virtual reality environment building module: Based on VR or AR platform, it is used to provide users with a three-dimensional, stereoscopic learning environment that can dynamically simulate various musical instruments, music scores and music elements, so that users can be in a musical world. This module uses visual processing technology to convert digital signals into realistic visual images and present them through virtual devices.

[0007] Immersive audio experience module: used to provide users with a surround audio experience, allowing users to hear sounds from different directions and distances, thereby enhancing the immersion of music learning; this module uses audio processing technology to convert digital audio signals into realistic sound effects and play them through virtual devices or surround sound systems;

[0008] Intelligent interactive teaching module: uses intelligent algorithms to enable users to interact with music and equipment in a virtual reality space and provide music teaching to users, providing real-time feedback based on the user's playing movements and strength, including touch interaction, visual interaction, voice interaction and gesture interaction;

[0009] Interactive classroom and remote teaching module: used to realize remote interactive teaching between teachers and users, enabling teachers to teach, demonstrate and guide in virtual classrooms, while children can interact and communicate with teachers in real time through virtual device helmets or displays;

[0010] Evaluation module: The system records and analyzes children's performance and generates detailed evaluation reports, including analysis of playing skills, rhythm control and pitch, to provide targeted guidance for children's music learning;

[0011] Personalized teaching module based on artificial intelligence: Based on the evaluation results of the evaluation module, combined with the user's learning progress, preferences and repeated errors, the teaching content is personalized through artificial intelligence to make the teaching content fit the user's learning stage.

[0012] Preferably, the intelligent interactive teaching module also includes reality interaction, simulating real musical instruments in virtual reality in real time, and users follow the simulated instruments and practice with real instruments; at the same time, use vision and sound to identify the correctness of the performance, and correct it if it is incorrect.

[0013] Preferably, the intelligent interactive teaching module also includes a tactile feedback function and an emotion recognition and feedback function;

[0014] Tactile feedback function: used for real feedback of users during the learning process. This module adopts tactile simulation technology to provide real tactile feedback to users through virtual devices and handles.

[0015] Emotional recognition and feedback function: By analyzing children’s expressions, tone and other emotional information during the performance, their emotional state can be identified, and corresponding emotional feedback and encouragement can be given to enhance children’s learning enthusiasm and self-confidence.

[0016] Preferably, the virtual reality environment construction module further includes:

[0017] Musical instrument model library: stores a large number of high-precision, realistic 3D models of musical instruments, including various string instruments, wind instruments, and percussion instruments, for children to choose and interact with;

[0018] Dynamic music score generator: dynamically generates music scores based on children's performance needs and learning progress, including notes, rhythms, and chords, and presents them in real time in a virtual environment;

[0019] Music scene simulator: can simulate various music scenes, allowing children to learn and play in different environments;

[0020] Visual effects and animations: Provide users with rich visual effects and animation effects to increase the fun and interactivity of learning.

[0021] Preferably, the immersive audio experience module further comprises:

[0022] Musical Instrument Library: Stores real timbre samples of various musical instruments, including the delicate timbre of string instruments, the melodious timbre of wind instruments, and the crisp timbre of percussion instruments, for users to choose and experience;

[0023] Surround audio processor: Through audio processing technology, it can achieve the surround effect of sound, allowing users to hear sounds from different directions and enhance the immersive feeling of music;

[0024] Dynamic sound effect generator: Dynamically generates sound effects based on the user's playing movements and strength, providing users with realistic playing feedback.

[0025] Preferably, the evaluation and feedback module further comprises:

[0026] Performance Data Evaluator: Real-time analysis and evaluation of children’s performance data, including performance skills, rhythm control, and pitch;

[0027] Learning Outcome Report Generator: Generates detailed learning outcome reports based on assessment results, including data on assessment scores, learning time, and number of interactions.

[0028] Preferably, the personalized teaching module based on artificial intelligence further includes:

[0029] Learning Progress Tracker: Track children’s learning progress and completion in real time, and provide children with personalized learning suggestions and resource recommendations based on learning outcome reports.

[0030] Point of interest identifier: Through data analysis and machine learning technology, it identifies children's interests and learning preferences, and provides children with learning resources and activities that match their interests;

[0031] Ability Level Evaluator: Evaluate children's ability level based on their performance and learning outcomes, and provide them with learning tasks and challenges that are appropriate to their ability level.

[0032] Preferably, the interactive classroom and distance learning module further includes:

[0033] Real-time interactive toolset: Provides real-time interactive tools such as paintbrushes, whiteboards, and annotations, allowing teachers and children to annotate, discuss, and share in a virtual environment;

[0034] Remote collaboration function: supports multiple children to learn and collaborate together in a virtual environment, enhancing teamwork and social skills.

[0035] Preferably, the immersive audio experience module also includes a sound localization training function, which can simulate the positions of different musical instruments in three-dimensional space, and guide children to identify musical instruments through sound localization, thereby exercising their spatial hearing and music perception abilities.

[0036] Compared with the prior art, the present invention has the following beneficial effects:

[0037] The present invention builds an immersive music world for children by constructing a three-dimensional virtual reality environment and dynamically simulating musical instruments and music elements, thereby significantly enhancing the immersion and fun of learning; the immersive audio experience module brings surround sound effects, improving the realism and interactivity of music learning; the intelligent interactive teaching module uses a variety of interactive methods to allow children to interact with music in a virtual space, and real-time feedback improves learning effects and playing skills; the interactive classroom and distance teaching modules break the limitations of time and space, realize real-time interaction between teachers and students, and provide personalized and comprehensive guidance; the evaluation module and the artificial intelligence personalized teaching module provide targeted guidance and content customization according to children's performance and learning progress, further improving learning efficiency and targeting.

[0038] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 This is a block diagram of the children's music immersive learning system using virtual reality technology in the present invention. DETAILED DESCRIPTION

[0040] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this technical field without creative work are within the scope of protection of the present invention.

[0041] See also Figure 1 ,This embodiment provides a children's music immersive learning system using virtual reality technology, which aims to provide children with a comprehensive and immersive music learning experience through a virtual reality environment construction module, an immersive audio experience module, an interactive learning module, an interactive classroom and remote teaching module, and an evaluation module;

[0042] 1. Virtual reality environment building module:

[0043] The virtual reality environment construction module is based on the VR or AR platform and is used to provide users with a three-dimensional, stereoscopic learning environment; this module uses visual processing technology to convert digital signals into realistic visual images and present them through virtual devices.

[0044] (1) Visual processing

[0045] Visual processing includes visual encoding, visual decoding, visual mixing, visual playback and other steps to process the video;

[0046] Visual encoding: converting visual signals into digital signals; the mathematical model formula is:

[0047]

[0048] Among them, y(n) is the encoded digital signal, x(n) is the original visual signal, and b k is the coding coefficient, and K is the number of coding coefficients.

[0049] Visual decoding: convert digital signals into visual signals; the mathematical model formula is:

[0050]

[0051] Among them, x(n) is the decoded visual signal, y(n) is the encoded digital signal, Yes Decoding

[0052] coefficients, K is the number of decoded coefficients.

[0053] Visual mixing: Mixing multiple visual signals into a new visual signal; the mathematical model formula is:

[0054]

[0055] Among them, x max (n) is the mixed visual signal, x k (n) is the original visual signal, a k is the mixing coefficient, and K is the number of mixing coefficients.

[0056] Visual playback: convert visual signals into visual signals and play them; the mathematical model formula is:

[0057] p(t)=x(t)·h(t)

[0058] Among them, p(t) is the visual signal after playback, x(t) is the original visual signal, and h(t) is the response function of the playback system.

[0059] (2) Musical instrument model library: stores a large number of high-precision, realistic three-dimensional models of musical instruments, including various string instruments, wind instruments, and percussion instruments, for children to choose and interact with.

[0060] (3) Dynamic music score generator: Dynamically generates music scores based on children’s performance needs and learning progress, including notes, rhythm, and chord elements, and presents them in real time in a virtual environment.

[0061] (4) Music scene simulator: It can simulate various music scenes, such as concerts, recording studios, music classrooms, etc., so that children can learn and play in different environments.

[0062] (5) Visual effects and animations: Provide users with rich visual effects and animation effects to increase the fun and interactivity of learning, enhance children's learning pleasure, and increase the immersive effect.

[0063] 2. Immersive audio experience module:

[0064] The immersive audio experience module is used to provide users with a surround audio experience, allowing users to hear sounds from different directions and distances, simulating the positions of different musical instruments in three-dimensional space, and guiding children to identify musical instruments through sound positioning, thereby exercising their spatial hearing and music perception abilities; this module uses audio processing technology to convert digital audio signals into realistic sound effects, and play them through virtual devices or surround sound systems.

[0065] (1) Audio processing:

[0066] Audio processing is a key technology for VR music. Audio processing includes audio encoding, audio decoding, audio mixing, audio playback and other steps. Audio processing allows music to be played in VR space and also allows music to interact with VR devices:

[0067] Audio coding: converting audio signals into digital signals; the mathematical model formula is:

[0068]

[0069] Among them, y(n) is the encoded digital signal, x(n) is the original audio signal, and b k is the coding coefficient, and K is the number of coding coefficients.

[0070] Audio decoding: convert digital signals into audio signals; the mathematical model formula is:

[0071]

[0072] Among them, x(n) is the decoded audio signal, y(n) is the encoded digital signal, is the decoding coefficient, K is the number of decoding coefficients;

[0073] Audio mixing: Mixing multiple audio signals into a new audio signal; the mathematical model formula is:

[0074] Among them, x max (n) is the mixed audio signal, x k (n) is the original audio signal, a k is the mixing coefficient, and K is the number of mixing coefficients.

[0075] Audio playback: convert audio signals into audio signals and play them. The mathematical model formula is:

[0076] p(t)=x(t)·h(t)

[0077] Among them, p(t) is the audio signal after playback, x(t) is the original audio signal, and h(t) is the response function of the playback system.

[0078] (2) Musical Instrument Library: This library stores real timbre samples of various musical instruments, including the delicate timbre of string instruments, the melodious timbre of wind instruments, and the crisp timbre of percussion instruments, for users to choose and experience.

[0079] (3) Surround audio processor: Use audio processing technology to achieve surround sound effects.

[0080] Users can hear sounds from different directions, enhancing the immersiveness of music.

[0081] (4) Dynamic sound effect generator: Dynamically generates sound effects such as string vibration and drum beats based on the user’s playing movements and strength, providing users with realistic performance feedback.

[0082] 3. Intelligent interactive teaching module:

[0083] The intelligent interactive teaching module uses intelligent algorithms such as clustering algorithms to enable users to interact with music and devices in a virtual reality space, and to provide music teaching to users, thus achieving an intelligent interactive teaching experience. The specific applications of its intelligent algorithms are:

[0084] Using the clustering algorithm, suppose we have a set of children's performance data, each data point contains multiple features, such as performance speed, performance accuracy, performance duration, etc.; we hope to divide these data points into K clusters to identify groups of children with similar performance characteristics.

[0085] Initialize the cluster centers:

[0086] For each data point xi (where i represents the index of a data point, and i=1, 2, ..., N, N is the total number of data points);

[0087] Assign data points to clusters:

[0088] Calculate its correlation with each cluster center C j (where j represents the index of the cluster center, and j = 1, 2, ..., K, K is the number of clusters) distance; here the Euclidean distance is used as the metric:

[0089] Among them, x ik Represents data point x i The k-th feature of (the k-th component of the eigenvector);

[0090] C jk Represents the cluster center C j The k-th feature of (the k-th component of the cluster center vector);

[0091] n represents the number of features (i.e. the dimension of the feature vector).

[0092] Then, the data point x i Assign to the cluster center C with the smallest distance j This can be done by comparing d(x i ,C j ) value to achieve this, and x i Into d(x i ,C j )The cluster corresponding to the smallest j;

[0093] Update cluster centers:

[0094] In each iteration, the center of each cluster is recalculated to be the average of all data points assigned to that cluster; for cluster j, the new cluster center is It can be expressed as:

[0095]

[0096] in:

[0097] N j represents the number of data points in cluster j;

[0098] Indicates the sum of the feature vectors of all data points in cluster j;

[0099] This new cluster center It will become the cluster center of the next iteration until the cluster center no longer changes or the maximum number of iterations is reached.

[0100] (1) Its interaction methods include touch interaction, visual interaction, voice interaction and gesture interaction;

[0101] 1) Touch interaction allows users to interact with the system by touching the screen or virtual interface. In the intelligent music teaching system, children can select instruments, adjust timbre, control rhythm, etc. by touching the screen to achieve intuitive interaction with the system. This interactive method is simple and easy to understand, in line with children's cognitive habits, and helps to improve their learning interest and participation.

[0102] 2) Visual interaction uses visual elements (such as images, animations, videos, etc.) to convey information and guide users to perform operations. In the intelligent music teaching system, visual interaction can be used to display music scores, teaching videos, instrument models, etc. to help children better understand music knowledge and playing skills. At the same time, the system can also indicate the child’s playing status through visual feedback, such as showing the accuracy and rhythm of the performance.

[0103] 3) Voice interaction allows users to interact with the system through voice commands. In the intelligent music teaching system, children can use voice commands to select songs, adjust the volume, request help, etc., to achieve convenient interaction with the system. This interaction method lowers the operation threshold and allows children to focus more on music learning itself.

[0104] 4) Gesture interaction interacts by identifying the user's gestures. In the intelligent music teaching system, gesture interaction can be used to simulate the movements of playing musical instruments, such as playing the piano, playing wind instruments, etc. By identifying children's gestures, the system can judge their playing skills and rhythm, etc., and thus provide targeted guidance and feedback.

[0105] (2) Realistic interaction: Realistic interaction is an important function in the intelligent music teaching system. It allows users to combine real musical instruments with the virtual reality environment for a more realistic performance experience. The system uses visual and sound recognition technology to determine in real time whether the user's performance is correct and make corrections when necessary. This interactive method not only improves the realism of the performance, but also helps to cultivate children's performance skills and sense of rhythm.

[0106] (3) The tactile feedback function uses tactile simulation technology to deliver real tactile feedback to users through virtual devices or handles. In the intelligent music teaching system, tactile feedback can be used to simulate the touch and vibration effects of musical instruments, such as the touch of piano keys when playing piano, the air flow resistance when playing wind instruments, etc. This feedback method can make children feel the feeling of playing musical instruments more realistically and improve their playing skills and experience.

[0107] (4) Emotional recognition and feedback function: The system can identify children’s emotional state by analyzing their facial expressions, tone of voice and other emotional information during the performance, and provide corresponding emotional feedback and encouragement. This feedback method can not only enhance children’s self-confidence and learning motivation, but also help them better understand the emotional expression in music and improve their musical literacy and aesthetic ability.

[0108] 4. Interactive classroom and distance learning module:

[0109] Used to achieve remote interactive teaching between teachers and users, enabling teachers to teach, demonstrate and guide in virtual classrooms, while children can interact and communicate with teachers in real time through virtual device helmets or displays, including:

[0110] (1) Real-time interactive toolset: The real-time interactive toolset not only provides basic real-time interactive tools such as brushes, whiteboards, and annotations, but also supports interactive needs in a variety of teaching scenarios. For example, the brush tool can be used to draw music scores and mark key points in a virtual environment; the whiteboard tool can be used to display teaching content and explain knowledge; the annotation tool can be used to mark and provide real-time feedback on problems encountered during children's performance. These tools not only improve the interactivity of teaching, but also make teaching more intuitive and vivid.

[0111] (2) Remote collaboration function: The remote collaboration function allows multiple children to learn and collaborate together in a virtual environment, enhancing teamwork and social skills. Through the virtual environment, children can communicate, discuss and collaborate with other classmates in real time to jointly solve problems in music learning. This collaborative learning method can not only improve children’s learning efficiency, but also cultivate their team spirit and communication skills.

[0112] 5. Evaluation module:

[0113] The system records and analyzes children's performance and generates detailed evaluation reports, including analysis of playing skills, rhythm control and pitch, to provide targeted guidance for children's music learning. Specifically:

[0114] (1) Performance Data Evaluator: By analyzing and evaluating children’s performance data in real time, we can fully understand the children’s performance skills, rhythm control, pitch, etc. The evaluator uses advanced algorithms and technologies to accurately identify problems in children’s performance and provide targeted improvement suggestions. At the same time, the evaluator can also record children’s learning progress and performance, providing data support for personalized teaching.

[0115] (2) Learning Outcome Report Generator: Automatically generates detailed learning outcome reports based on the data from the assessment module. These reports include data on assessment scores, learning time, number of interactions, etc., which can comprehensively reflect children’s learning situation and progress. By viewing these reports, parents and teachers can better understand children’s learning status and provide them with more targeted guidance and help.

[0116] 6. Personalized teaching module: Based on the evaluation results of the evaluation module, combined with the user's learning progress, preferences and repeated errors, the teaching content is customized through artificial intelligence to make the teaching content fit the user's learning stage, including:

[0117] (1) Learning Progress Tracker: This tool tracks children’s learning progress and completion in real time, and provides children with personalized learning suggestions and resource recommendations based on learning outcome reports. The tool uses advanced machine learning algorithms to accurately identify children’s learning needs and interests, and provide them with learning resources that match their learning levels and interests. The tool can also dynamically adjust learning plans and difficulty levels based on children’s learning progress and performance, ensuring maximum learning outcomes.

[0118] (2) Interest point identifier: Through data analysis and machine learning technology, we can deeply explore children's learning preferences and interests. This identifier can analyze children's behavior data, interaction data, and feedback data during the learning process, and extract the learning content and activities that children are interested in. By identifying children's interests, we can provide them with learning resources and activities that are more in line with their interests and needs, thereby stimulating their learning motivation and enthusiasm.

[0119] (3) Ability Level Evaluator: Accurately evaluate children’s ability levels based on their playing performance and learning outcomes. This evaluator uses advanced algorithms and technologies to comprehensively consider children’s performance in playing skills, rhythm control, pitch, etc., and provide them with learning tasks and challenges that are suitable for their ability levels. By evaluating children’s ability levels, more reasonable learning plans and goals can be formulated for them, helping them to gradually improve their musical level.

[0120] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the embodiments here. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the claims of the present invention.

Claims

1. A children's music immersive learning system using virtual reality technology, characterized in that: It includes virtual reality environment construction module, immersive audio experience module, interactive learning module, interactive classroom and distance learning module and evaluation module; Virtual reality environment building module: Based on VR or AR platform, it is used to provide users with a three-dimensional, stereoscopic learning environment that can dynamically simulate various musical instruments, music scores and music elements, so that users can be in a musical world. This module uses visual processing technology to convert digital signals into realistic visual images and present them through virtual devices. Immersive audio experience module: used to provide users with a surround audio experience, allowing users to hear sounds from different directions and distances, thereby enhancing the immersive feeling of music learning; This module uses audio processing technology to convert digital audio signals into realistic sound effects and play them through virtual devices or surround sound systems; Intelligent interactive teaching module: uses intelligent algorithms to enable users to interact with music and equipment in a virtual reality space and provide music teaching to users, providing real-time feedback based on the user's playing movements and strength, including touch interaction, visual interaction, voice interaction and gesture interaction; Interactive classroom and remote teaching module: used to realize remote interactive teaching between teachers and users, enabling teachers to teach, demonstrate and guide in virtual classrooms, while children can interact and communicate with teachers in real time through virtual device helmets or displays; Evaluation module: The system records and analyzes children's performance and generates detailed evaluation reports, including analysis of playing skills, rhythm control and pitch, to provide targeted guidance for children's music learning; Personalized teaching module based on artificial intelligence: Based on the evaluation results of the evaluation module, combined with the user's learning progress, preferences and repeated errors, the teaching content is personalized through artificial intelligence to make the teaching content fit the user's learning stage.

2. The children's music immersive learning system using virtual reality technology according to claim 1, characterized in that: The intelligent interactive teaching module also includes reality interaction, which simulates real musical instruments in virtual reality in real time. Users follow the simulated instruments and practice with real instruments. At the same time, vision and sound are used to identify the correctness of the performance, and if it is incorrect, it is corrected.

3. The children's music immersive learning system using virtual reality technology according to claim 2, characterized in that: The intelligent interactive teaching module also includes tactile feedback function and emotion recognition and feedback function; Tactile feedback function: used for real feedback of users during the learning process. This module adopts tactile simulation technology to provide real tactile feedback to users through virtual devices and handles. Emotional recognition and feedback function: By analyzing children’s expressions, tone and other emotional information during the performance, their emotional state can be identified, and corresponding emotional feedback and encouragement can be given to enhance children’s learning enthusiasm and self-confidence.

4. The children's music immersive learning system using virtual reality technology according to claim 1, characterized in that: The virtual reality environment building module further includes: Musical instrument model library: stores a large number of high-precision, realistic 3D models of musical instruments, including various string instruments, wind instruments, and percussion instruments, for children to choose and interact with; Dynamic music score generator: dynamically generates music scores based on children's performance needs and learning progress, including notes, rhythms, and chords, and presents them in real time in a virtual environment; Music scene simulator: can simulate various music scenes, allowing children to learn and play in different environments; Visual effects and animations: Provide users with rich visual effects and animation effects to increase the fun and interactivity of learning.

5. The children's music immersive learning system using virtual reality technology according to claim 1, characterized in that: The immersive audio experience module further includes: Musical Instrument Library: Stores real timbre samples of various musical instruments, including the delicate timbre of string instruments, the melodious timbre of wind instruments, and the crisp timbre of percussion instruments, for users to choose and experience; Surround audio processor: Through audio processing technology, it can achieve the surround effect of sound, allowing users to hear sounds from different directions and enhance the immersive feeling of music; Dynamic sound effect generator: Dynamically generates sound effects based on the user's playing movements and strength, providing users with realistic playing feedback.

6. The children's music immersive learning system using virtual reality technology according to claim 1, characterized in that: The evaluation and feedback module further comprises: Performance Data Evaluator: Real-time analysis and evaluation of children’s performance data, including performance skills, rhythm control, and pitch; Learning Outcome Report Generator: Generates detailed learning outcome reports based on assessment results, including data on assessment scores, learning time, and number of interactions.

7. The children's music immersive learning system using virtual reality technology according to claim 6, characterized in that: The personalized teaching module based on artificial intelligence further includes: Learning Progress Tracker: Track children’s learning progress and completion in real time, and provide children with personalized learning suggestions and resource recommendations based on learning outcome reports. Point of interest identifier: Through data analysis and machine learning technology, it identifies children's interests and learning preferences, and provides children with learning resources and activities that match their interests; Ability Level Evaluator: Evaluate children's ability level based on their performance and learning outcomes, and provide them with learning tasks and challenges that are appropriate to their ability level.

8. The children's music immersive learning system using virtual reality technology according to claim 1, characterized in that: The interactive classroom and distance learning module further includes: Real-time interactive toolset: Provides real-time interactive tools such as paintbrushes, whiteboards, and annotations, allowing teachers and children to annotate, discuss, and share in a virtual environment; Remote collaboration function: supports multiple children to learn and collaborate together in a virtual environment, enhancing teamwork and social skills.

9. The children's music immersive learning system using virtual reality technology according to claim 1, characterized in that: The immersive audio experience module also includes a sound positioning training function, which can simulate the positions of different musical instruments in three-dimensional space, and guide children to identify musical instruments through sound positioning, thereby exercising their spatial hearing and music perception abilities.

Citation Information

Cited By

  • Method for remote processing of audiovisual information to provide interactive interaction of the user with a software and hardware complex

    RU2863772C1