Music practical training system and device based on virtual reality technology

Abstract

According to the music practical training system and device based on the virtual reality technology, a virtual reality function is introduced, and practical training data such as playing actions, playing sound effects and tones in the music practical training process are collected; in combination with a virtual reality practical training module of a music practical training system, separation of data acquisition and data configuration of a virtual reality display interface is realized based on display requirements and data structure configuration related to virtual reality specific functions, and an autonomous practical training effect feedback mechanism is provided for a system administrator. And a system manager determines how to feed back and display related practical training data and practical training effects in the music practical training process, and guides music practical training according to virtual reality display data.

Description

Technical Field

[0001] The invention belongs to the field of new generation information technology, and in particular relates to a music training system and device based on virtual reality technology. Background Art

[0002] Music training courses are an important part of music education and are indispensable in the process of music practice. Various music education theories emphasize the necessity of music training courses. For example, Orff's music education principles mention that people participate as performers rather than listeners. Orff's music education principles emphasize the use of listening training to improve sensitivity to music; the use of rhythm training to improve the playing and application of percussion instruments; the use of rhythm training to strengthen the training and application of voice, form, etc.; the use of language learning as music language teaching training and application, while focusing on the training and development of creative ability.

[0003] Educational institutions and units such as Hunan University of Technology have also established music school training centers to pay full attention to and invest in music training. The music and dance training centers of the school's music school were established in September 2011. Currently, there are comprehensive training rooms, music production and recording training rooms, MIDI music production training rooms, music professional photography, editing and recording training rooms, dance training training rooms, etc. Students combine the systematic theories learned in class with artistic practice, and solve practical problems through information data collection, analysis and research, planning and design.

[0004] Introducing information technology and means in the process of music training to improve the effectiveness of music training, allowing trainees and instructors to grasp the training results and understand the training feedback in real time, has also become one of the hot topics in music training research.

[0005] Virtual Reality (VR) is a new generation of information technology that uses computer technology as its core and combines relevant scientific and technological knowledge to generate a digital environment that is highly similar to a real environment within a certain range in terms of sight, hearing, touch, etc. Users can interact and influence each other with objects in the digital environment with the help of necessary equipment, and have the feeling and experience of being in the corresponding real environment.

[0006] Virtual reality technology is classified into various categories, including Milgram's Reality-Virtuality Continuum, which takes the real environment and the virtual environment as the two ends of the continuum, and the one in the middle is called Mixed Reality. The one close to the real environment is Augmented Reality, and the one close to the virtual environment is Augmented Virtuality.

[0007] There is still a lack of current research on how to introduce the diversity enhancement of information display by virtual reality technology into music training education. The only existing technologies mechanically superimpose simple VR data displays during the training process. Not only do they not fully consider the customized configuration of the display function, but they also fail to fully realize the feedback guidance and teaching assistance of the display data on the training effect.

[0008] The present invention proposes a music training system and device based on virtual reality technology, introduces a virtual reality function, collects training data such as playing movements, playing sound effects and tones in the music training process, and combines the virtual reality training module of the music training system with the data structure configuration based on display requirements and specific virtual reality functions to achieve separation of virtual reality display interface data collection and data configuration, and provides an autonomous training effect feedback mechanism for system administrators. The system administrators determine how to provide feedback and display of relevant training data and training effects in the music training process, and provide guidance for music training based on the virtual reality display data. Summary of the invention

[0009] The present invention aims to provide a music training system and device based on virtual reality technology which are superior to the prior art.

[0010] In order to achieve the above object, the technical solution of the present invention is as follows:

[0011] A music training system based on virtual reality technology, the system comprising:

[0012] The music rhythm training module is used to capture and detect the instrument playing movements and actual sound effects during the music training process and generate performance data;

[0013] The music training fusion module is used to fill and fuse data based on the data collected by the music rhythm training module and the virtual reality data display data structure configured by the virtual reality training module;

[0014] The virtual reality training module is used to configure the virtual reality data display data structure, and based on the data structure fusion results of the music training fusion module, perform virtual reality enhancement in the music training process through the virtual reality equipment worn by the trainees.

[0015] Preferably, the music rhythm training module specifically captures and detects the instrument playing movements and actual sound effects during the music training process, generates first performance image data and second sound effect data, and uploads them to the music training fusion module;

[0016] The music rhythm training module at least includes:

[0017] The performance data generation submodule generates first performance image data based on capturing and detecting the movements in the music training process; generates second sound effect data based on capturing and detecting the sound effects in the music training process,

[0018] The performance data uploading submodule is used to combine the first performance image data and the second sound effect data into a music training data block, and send the music training data block to the music training fusion module.

[0019] Preferably, the virtual reality training module configures a virtual reality data display data structure, and sends the configured virtual reality data display data structure to the music training fusion module, and based on the data structure fusion result of the music training fusion module, performs virtual reality enhancement in the music training process;

[0020] The virtual reality training module at least includes a virtual reality adaptation submodule and a virtual reality presentation submodule;

[0021] The virtual reality adapter submodule configures the corresponding functions into the music training virtual reality display function set based on the requirements of the virtual reality enhancement system during the music training process, and reserves corresponding data segmentation space in the virtual reality data display data structure for each function that needs to be displayed, and forms a target virtual reality data display data structure based on the reserved data segmentation space, and sends it to the music training fusion module;

[0022] The virtual reality presentation submodule receives the target virtual reality data display data structure filled by the music training fusion module, and based on a preset virtual reality presentation interface, displays various virtual reality functions of training effect evaluation, guidance and display in real time in the field of vision of the training object through the virtual reality device;

[0023] Preferably, the music training fusion module specifically fills and fuses the data segments of the virtual reality data display data structure based on the data collected by the music rhythm training module to form a fused target virtual reality data display data structure; each data segment space of the fused target virtual reality data display data structure is filled with the corresponding collected data in the first performance image data and the second sound effect data;

[0024] The music training fusion module at least includes:

[0025] A data structure fusion submodule, wherein the data structure fusion submodule performs specific data filling and fusion on the data segments of the virtual reality data display data structure based on the first performance image data and the second sound effect data collected by the music rhythm training module to form a fused target virtual reality data display data structure;

[0026] A data bidirectional transmission submodule, which is used to send the fused target virtual reality data display data structure to the virtual reality training module, and perform virtual reality display through the virtual reality device, and

[0027] The fused target virtual reality data display data structure is sent to the music rhythm training module, and the performance data upload submodule of the music rhythm training module performs data verification to verify whether the data in the generated target virtual reality data display data structure has transmission errors. If an error occurs, the target virtual reality data display data structure sent to the virtual reality training module is retrieved to perform data correction and redundant retransmission.

[0028] Preferably, the virtual reality training module is used to configure a virtual reality data display data structure, and send the configured virtual reality data display data structure to the music training fusion module, specifically:

[0029] The virtual reality training module configures a music training virtual reality display function set according to the system requirements in the music training process, configures corresponding data segments in the virtual reality data display data structure based on the functions in the display function set, and forms a target virtual reality data display data structure from the corresponding data segments, and sends the configured target virtual reality data display data structure to the music training fusion module for data structure fusion.

[0030] Preferably, the data structure fusion result based on the music training fusion module executes virtual reality enhancement in the music training process, specifically: the music training fusion module extracts corresponding parts of the first performance image data and the second sound effect data based on the data segmentation contained in the target virtual reality data display data structure, and fuses the corresponding data into the target virtual reality data display data structure to form a virtual reality music training data class instance of the target virtual reality data display data structure, and sends the virtual reality music training data class instance to the virtual reality training module via the data bidirectional transmission sub-module.

[0031] At the same time, the present invention also proposes a music training device based on virtual reality technology, the device comprising a memory and a processor, the memory comprising computer program instructions and when executed by the processor, realizing the corresponding functions of the music training system of virtual reality technology as described above.

[0032] At the same time, the present invention also proposes a computer-readable storage medium, characterized in that it includes instructions, which, when running on a computer, enable the corresponding functions of the music training system using virtual reality technology as described above to be executed.

[0033] At the same time, the present invention also proposes a chip, characterized in that it includes a processor and an interface; the processor is used to read instructions to execute the corresponding functions of the music training system of the virtual reality technology mentioned above.

[0034] At the same time, the present invention also proposes a computer program product, which is stored in a computer-readable storage medium, and is characterized in that when the computer program product is executed by a processor, it is used to execute the corresponding functions of the music training system based on virtual reality technology as described above.

[0035] The present invention proposes a music training system and device based on virtual reality technology, introduces a virtual reality function, collects training data such as playing movements, playing sound effects and tones in the music training process, and combines the virtual reality training module of the music training system with the data structure configuration based on display requirements and specific virtual reality functions to achieve separation of virtual reality display interface data collection and data configuration, and provides an autonomous training effect feedback mechanism for system administrators. The system administrators determine how to provide feedback and display of relevant training data and training effects in the music training process, and provide guidance for music training based on the virtual reality display data. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 It is a basic system structure diagram of a music training system based on virtual reality technology shown in the present invention;

[0037] Figure 2 It is a schematic diagram of one embodiment of a music rhythm training module of a music training system based on virtual reality technology shown in the present invention;

[0038] Figure 3 It is a schematic diagram of one embodiment of a music training fusion module of a music training system based on virtual reality technology shown in the present invention;

[0039] Figure 4 It is one of the embodiments of the virtual reality training module of the music training system based on virtual reality technology claimed by the present invention;

[0040] Figure 5 It is a schematic diagram of a preferred embodiment of a music training device based on virtual reality technology shown in the present invention. DETAILED DESCRIPTION

[0041] The following describes in detail several embodiments and beneficial effects of the music training system and method based on virtual reality technology claimed in the present invention, so as to facilitate a more detailed review and analysis of the present invention.

[0042] In order to better understand the technical solution of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0043] It should be clear that the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0044] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0045] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0046] It should be understood that although the terms first, second, etc. may be used to describe the method and corresponding device in the embodiments of the present invention, these keywords should not be limited to these terms. These terms are only used to distinguish keywords from each other. For example, without departing from the scope of the embodiments of the present invention, a template, etc. may also be referred to as a target plate.

[0047] It should be understood that although the terms first, second, etc. may be used to describe the method and the corresponding device in the embodiments of the present invention, these keywords should not be limited to these terms. These terms are only used to distinguish the keywords from each other. For example, without departing from the scope of the embodiments of the present invention, the first performance image data, the second sound effect data, etc. may also be called the second performance image data, the first sound effect data.

[0048] The word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0049] As the instruction manual Figure 1 As shown, it is one of the embodiments of the music training system based on virtual reality technology and its specific modules included in the music training system based on virtual reality technology claimed by the present invention. The music training system based on virtual reality technology claimed by the present invention includes:

[0050] The music rhythm training module is used to capture and detect the instrument playing movements and actual sound effects during the music training process and generate performance data;

[0051] The music training fusion module is used to fill and fuse data based on the data collected by the music rhythm training module and the virtual reality data display data structure configured by the virtual reality training module;

[0052] The virtual reality training module is used to configure the virtual reality data display data structure, and based on the data structure fusion results of the music training fusion module, perform virtual reality enhancement in the music training process through the virtual reality equipment worn by the trainees.

[0053] As the instruction manual Figure 2 As shown, Figure 2 It is a schematic diagram of one embodiment of a music rhythm training module of a music training system based on virtual reality technology shown in the present invention.

[0054] As a superimposable preferred embodiment, the music rhythm training module specifically captures and detects the instrument playing movements and actual sound effects during the music training process, generates first performance image data and second sound effect data, and uploads them to the music training fusion module;

[0055] The music rhythm training module at least includes:

[0056] The performance data generation submodule generates first performance image data based on capturing and detecting the movements in the music training process; generates second sound effect data based on capturing and detecting the sound effects in the music training process,

[0057] The performance data uploading submodule is used to combine the first performance image data and the second sound effect data into a music training data block, and send the music training data block to the music training fusion module.

[0058] As the instruction manual Figure 3-4 As shown, Figure 3-4 It is a schematic diagram of one embodiment of a music training fusion module of a music training system based on virtual reality technology and a virtual reality training module according to the present invention.

[0059] As a superimposable preferred embodiment, the virtual reality training module configures a virtual reality data display data structure, and sends the configured virtual reality data display data structure to the music training fusion module, and based on the data structure fusion result of the music training fusion module, performs virtual reality enhancement in the music training process;

[0060] The virtual reality training module at least includes a virtual reality adaptation submodule and a virtual reality presentation submodule;

[0061] The virtual reality adapter submodule configures the corresponding functions into the music training virtual reality display function set based on the requirements of the virtual reality enhancement system during the music training process, and reserves corresponding data segmentation space in the virtual reality data display data structure for each function that needs to be displayed, and forms a target virtual reality data display data structure based on the reserved data segmentation space, and sends it to the music training fusion module;

[0062] As a superimposable preferred embodiment, the virtual reality training module configures a music training virtual reality display function set according to the system requirements in the music training process, configures the corresponding data segments in the virtual reality data display data structure based on the functions in the display function set, and forms a target virtual reality data display data structure by the corresponding data segments, and sends the configured target virtual reality data display data structure to the music training fusion module for data structure fusion. The specific example is: the virtual reality training module is based on the virtual reality enhancement system requirements in the music training process, for example, it is necessary to use a head-mounted or split-screen virtual reality device to display the difference in the amplitude of the actual performance action and the standard performance action in real time in the field of vision of the training object, the actual performance action posture correction degree, the actual performance syllable evaluation value, the actual performance tone difference ratio, etc., then the corresponding function is configured into the music training virtual reality display function set, and for each function that needs to be displayed, a corresponding data segmentation space is reserved in the virtual reality data display data structure, and the specific data of the data segmentation space is to be filled. And based on the reserved data segmentation space, the target virtual reality data display data structure is formed, thereby forming a target virtual reality data display data structure with a determined data structure and including multiple specific demand data functions, and sending it to the music training fusion module to obtain specific data of each type and fill it into the segments of the music training fusion module.

[0063] The virtual reality presentation submodule receives the target virtual reality data display data structure filled by the music training fusion module, and based on a preset virtual reality presentation interface, displays various virtual reality functions of training effect evaluation, guidance and display in real time in the field of vision of the training object through the virtual reality device;

[0064] As a superimposable preferred embodiment, the music training fusion module specifically fills and fuses the data segments of the virtual reality data display data structure based on the data collected by the music rhythm training module to form a fused target virtual reality data display data structure; each data segment space of the fused target virtual reality data display data structure is filled with the corresponding collected data in the first performance image data and the second sound effect data;

[0065] As a superimposable preferred embodiment, the music training fusion module extracts corresponding parts of the first performance image data and the second sound effect data based on the data segmentation contained in the target virtual reality data display data structure, and fuses the corresponding data into the target virtual reality data display data structure to form a virtual reality music training data class instance of the target virtual reality data display data structure, and sends the virtual reality music training data class instance to the virtual reality training module via the data bidirectional transmission submodule, specifically: the first performance image data and the second sound effect data include the training performance action and posture diagram collected on site The music training fusion module collects the corresponding data in the first performance image data and the second sound effect data according to the data segmentation contained in the target virtual reality data display data structure, and compares it with the system preset standard action and standard music database, corrects the data through the neural network, and finally outputs various training effect data such as the difference value of the movement amplitude between the actual performance action and the standard performance action, the correction degree of the actual performance action posture, the evaluation value of the actual performance syllable, and the difference ratio of the actual performance tone in real time, to form a filled target virtual reality data display data structure, which is sent to the virtual reality training module. The virtual reality presentation submodule in the virtual reality training module displays the specific training effect data in the filled target virtual reality data display data structure, based on the preset virtual reality presentation interface, through a head-mounted or split-screen virtual reality device, in the field of vision of the training object, the difference value of the movement amplitude between the actual performance action and the standard performance action, the correction degree of the actual performance action posture, the evaluation value of the actual performance syllable, the difference ratio of the actual performance tone, and other virtual reality music training effect evaluation, guidance and display functions are displayed in real time in real time in the field of vision of the training object.

[0066] As a superimposable preferred embodiment, each data segment space of the fused target virtual reality data display data structure is filled with the corresponding collected data in the first performance image data and the second sound effect data, specifically: the first performance image data contains various data such as three-dimensional spatial posture data and three-dimensional spatial action data in various performance processes during the collection process, and the second sound effect data contains sound effect data and tone data at various rhythm time points during the collection process. According to the functional requirements corresponding to the data segments of the virtual reality data display data structure, such as the difference value of the action amplitude between the actual performance action and the standard performance action, the correction degree of the actual performance action posture, the evaluation value of the actual performance syllable, the difference ratio of the actual performance tone, etc., the corresponding collected data is filled into the virtual reality data display data structure, that is, the fused target virtual reality data display data structure is obtained, and at this time, each data segment space thereof is filled with the corresponding collected data in the first performance image data and the second sound effect data.

[0067] The music training fusion module at least includes:

[0068] A data structure fusion submodule, wherein the data structure fusion submodule performs specific data filling and fusion on the data segments of the virtual reality data display data structure based on the first performance image data and the second sound effect data collected by the music rhythm training module to form a fused target virtual reality data display data structure;

[0069] A data bidirectional transmission submodule, which is used to send the fused target virtual reality data display data structure to the virtual reality training module, and perform virtual reality display through the virtual reality device, and

[0070] The fused target virtual reality data display data structure is sent to the music rhythm training module, and the performance data upload submodule of the music rhythm training module performs data verification to verify whether the data in the generated target virtual reality data display data structure has transmission errors. If an error occurs, the target virtual reality data display data structure sent to the virtual reality training module is retrieved to perform data correction and redundant retransmission.

[0071] As a superimposable preferred embodiment, the virtual reality training module is used to configure a virtual reality data display data structure, and send the configured virtual reality data display data structure to the music training fusion module, specifically:

[0072] The virtual reality training module configures a music training virtual reality display function set according to the system requirements in the music training process, configures corresponding data segments in the virtual reality data display data structure based on the functions in the display function set, and forms a target virtual reality data display data structure from the corresponding data segments, and sends the configured target virtual reality data display data structure to the music training fusion module for data structure fusion.

[0073] As a superimposable preferred embodiment, the data structure fusion result based on the music training fusion module executes virtual reality enhancement in the music training process, specifically: the music training fusion module extracts corresponding parts of the first performance image data and the second sound effect data based on the data segmentation contained in the target virtual reality data display data structure, and fuses the corresponding data into the target virtual reality data display data structure to form a virtual reality music training data class instance of the target virtual reality data display data structure, and sends the virtual reality music training data class instance to the virtual reality training module via the data bidirectional transmission submodule.

[0074] As the instruction manual Figure 5 As shown, Figure 5 It is a schematic diagram of a preferred embodiment of a music training device based on virtual reality technology shown in the present invention.

[0075] The present invention also proposes a music training device based on virtual reality technology, the device comprising a memory and a processor, the memory comprising computer program instructions and when executed by the processor, realizing the corresponding functions of the music training system of virtual reality technology as described above.

[0076] At the same time, the present invention also proposes a computer-readable storage medium, characterized in that it includes instructions, which, when running on a computer, enable the corresponding functions of the music training system using virtual reality technology as described above to be executed.

[0077] At the same time, the present invention also proposes a chip, characterized in that it includes a processor and an interface; the processor is used to read instructions to execute the corresponding functions of the music training system of the virtual reality technology mentioned above.

[0078] At the same time, the present invention also proposes a computer program product, which is stored in a computer-readable storage medium, and is characterized in that when the computer program product is executed by a processor, it is used to execute the corresponding functions of the music training system based on virtual reality technology as described above.

[0079] The present invention proposes a music training system and device based on virtual reality technology, introduces a virtual reality function, collects training data such as playing movements, playing sound effects and tones in the music training process, and combines the virtual reality training module of the music training system with the data structure configuration based on display requirements and specific virtual reality functions to achieve separation of virtual reality display interface data collection and data configuration, and provides an autonomous training effect feedback mechanism for system administrators. The system administrators determine how to provide feedback and display of relevant training data and training effects in the music training process, and provide guidance for music training based on the virtual reality display data.

[0080] In all the above embodiments, in order to realize some special data transmission and read / write function requirements, the above method operation process and its corresponding device can add devices, modules, components, hardware, pin connections or memory, processor differences to expand functions.

[0081] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the methods, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0082] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the method steps is only a logical or functional division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0083] The units described as the various steps of the method and the separated components of the device may or may not be logically or physically separated, and may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0084] In addition, the method steps and their implementations and functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0085] The above method and device can be implemented as an integrated unit in the form of a software functional unit, which can be stored in a computer-readable storage medium. The above software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (Processor) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (RandomAccess Memory, RAM), NVRAM, disk or optical disk and other media that can store program codes.

[0086] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

[0087] It should be noted that the above embodiments are only used to more clearly explain and illustrate the technical solutions of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A music training system based on virtual reality technology, the system comprising: The music rhythm training module is used to capture and detect the instrument playing movements and actual sound effects during the music training process and generate performance data; The music training fusion module is used to fill and fuse data based on the data collected by the music rhythm training module and the virtual reality data display data structure configured by the virtual reality training module; The virtual reality training module is used to configure the virtual reality data display data structure, and based on the data structure fusion results of the music training fusion module, perform virtual reality enhancement in the music training process through the virtual reality equipment worn by the trainees.

2. The music training system based on virtual reality technology as claimed in claim 1, characterized in that: The music rhythm training module specifically captures and detects the instrument playing movements and actual sound effects during the music training process, generates first performance image data and second sound effect data, and uploads them to the music training fusion module; The music rhythm training module at least includes: A performance data generation submodule, wherein the performance data generation submodule generates first performance image data based on capturing and detecting movements during music training; Based on capturing and detecting the sound effects during the music training process, the second sound effect data is generated. The performance data uploading submodule is used to combine the first performance image data and the second sound effect data into a music training data block, and send the music training data block to the music training fusion module.

3. The music training system based on virtual reality technology as claimed in claim 2, characterized in that: The virtual reality training module configures a virtual reality data display data structure, and sends the configured virtual reality data display data structure to the music training fusion module, and based on the data structure fusion result of the music training fusion module, performs virtual reality enhancement in the music training process; The virtual reality training module at least includes a virtual reality adaptation submodule and a virtual reality presentation submodule; The virtual reality adapter submodule configures the corresponding functions into the music training virtual reality display function set based on the requirements of the virtual reality enhancement system during the music training process, and reserves corresponding data segmentation space in the virtual reality data display data structure for each function that needs to be displayed, and forms a target virtual reality data display data structure based on the reserved data segmentation space, and sends it to the music training fusion module; The virtual reality presentation submodule receives the target virtual reality data display data structure filled by the music training fusion module, and based on a preset virtual reality presentation interface, displays various virtual reality functions of training effect evaluation, guidance and display in real time in the field of vision of the training object through the virtual reality device.

4. The music training system based on virtual reality technology as claimed in claim 3, characterized in that: The music training fusion module specifically fills and fuses the data segments of the virtual reality data display data structure based on the data collected by the music rhythm training module to form a fused target virtual reality data display data structure; each data segment space of the fused target virtual reality data display data structure is filled with the corresponding collected data in the first performance image data and the second sound effect data; The music training fusion module at least includes: A data structure fusion submodule, wherein the data structure fusion submodule performs specific data filling and fusion on the data segments of the virtual reality data display data structure based on the first performance image data and the second sound effect data collected by the music rhythm training module to form a fused target virtual reality data display data structure; A data bidirectional transmission submodule, which is used to send the fused target virtual reality data display data structure to the virtual reality training module, and perform virtual reality display through the virtual reality device, and The fused target virtual reality data display data structure is sent to the music rhythm training module, and data verification is performed in the performance data upload submodule of the music rhythm training module to verify whether there is any transmission error in the data in the generated target virtual reality data display data structure. In case of an error, the target virtual reality data display data structure sent to the virtual reality training module is retrieved to perform data correction and redundant retransmission.

5. The music training system based on virtual reality technology as claimed in claim 4, characterized in that: The virtual reality training module is used to configure a virtual reality data display data structure, and send the configured virtual reality data display data structure to the music training fusion module, specifically: The virtual reality training module configures a music training virtual reality display function set according to the system requirements in the music training process, configures corresponding data segments in the virtual reality data display data structure based on the functions in the display function set, and forms a target virtual reality data display data structure from the corresponding data segments, and sends the configured target virtual reality data display data structure to the music training fusion module for data structure fusion.

6. The music training system based on virtual reality technology as claimed in claim 5, characterized in that: The data structure fusion result based on the music training fusion module is used to perform virtual reality enhancement in the music training process. Specifically, the music training fusion module extracts corresponding parts of the first performance image data and the second sound effect data based on the data segmentation contained in the target virtual reality data display data structure, and fuses the corresponding data into the target virtual reality data display data structure to form a virtual reality music training data class instance of the target virtual reality data display data structure, and sends the virtual reality music training data class instance to the virtual reality training module via the data bidirectional transmission submodule.

7. A music training device based on virtual reality technology, the device comprising a memory and a processor, the memory comprising computer program instructions and when executed by the processor, realizing the corresponding functions of the music training system using virtual reality technology as claimed in any one of claims 1 to 6.

8. A computer-readable storage medium, characterized in that: It includes instructions, which, when run on a computer, enable the corresponding functions of the music training system using virtual reality technology as described in any one of claims 1 to 6 to be executed.

9. A chip, characterized in that: Includes processor and interface; The processor is used to read instructions to execute the corresponding functions of the music training system using virtual reality technology as described in any one of claims 1-6.

10. A computer program product, the computer program product being stored in a computer-readable storage medium, characterized in that: When executed by a processor, the computer program product is used to perform the corresponding functions of the music training system based on virtual reality technology as described in claims 1-6.

Images