Immersive virtual action learning method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides an immersive virtual action learning method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the collection and recording of a standard action through action capture, carrying out the binding fusion of action capture data and a three-dimensional model, and carrying out the learning of a virtual action based on the bound and fused three-dimensional model. An interactive system is manufactured through a UE engine; projecting a virtual environment in the LED screen through the interactive system; and executing a control operation on the three-dimensional model according to an operation of a user on the interactive system. According to the embodiment of the invention, the use feeling of the user can be improved, the user can learn actions in an immersive manner, and the learning efficiency of the user is higher through interaction with the user.

Description

Technical Field

[0001] This document relates to the field of computer technology, and in particular to an immersive virtual action learning method, device, electronic device and storage medium. Background Art

[0002] In the prior art, when users learn dance, martial arts, yoga and other movements, they usually learn based on videos, or learn in front of a virtual coach in a mirror. However, this learning method makes it difficult for users to immerse themselves in the learning situation, and the interactivity is relatively poor. Summary of the invention

[0003] The purpose of the present invention is to provide an immersive virtual action learning method, device, electronic device and storage medium, aiming to solve the above-mentioned problems in the prior art.

[0004] The present invention provides an immersive virtual action learning method, comprising:

[0005] The standard actions are collected and recorded through motion capture, and the motion capture data is bound and fused with the 3D model. Based on the bound and fused 3D model, an interactive system is made through the UE engine;

[0006] Projecting a virtual environment on the LED screen through the interactive system;

[0007] According to the user's operation on the interactive system, a control operation is performed on the three-dimensional model.

[0008] The present invention provides an immersive virtual action learning device, comprising:

[0009] The capture module is used to collect and record standard actions through motion capture, bind and fuse the motion capture data with the three-dimensional model, and make an interactive system through the UE engine based on the bound and fused three-dimensional model;

[0010] an LED screen for projecting a virtual environment through the interactive system;

[0011] The control module is used to perform control operations on the three-dimensional model according to the user's operation on the interactive system.

[0012] An embodiment of the present invention further provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps of the above-mentioned immersive virtual action learning method when executed by the processor.

[0013] An embodiment of the present invention further provides a computer-readable storage medium, on which a program for implementing information transmission is stored. When the program is executed by a processor, the steps of the above-mentioned immersive virtual action learning method are implemented.

[0014] By adopting the embodiments of the present invention, the user's usage experience can be improved, the user can learn actions in an immersive manner, and the user's learning efficiency can be made higher through interaction with the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate one or more embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0016] Figure 1 is a flow chart of an immersive virtual action learning method according to an embodiment of the present invention;

[0017] Figure 2 is a schematic diagram of an immersive virtual action learning device according to an embodiment of the present invention;

[0018] Figure 3 is a schematic diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0019] In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the following will be combined with the drawings in one or more embodiments of this specification to clearly and completely describe the technical solutions in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on one or more embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this document.

[0020] Method Embodiment

[0021] According to an embodiment of the present invention, an immersive virtual action learning method is provided. Figure 1 is a flow chart of an immersive virtual action learning method according to an embodiment of the present invention. Figure 1 As shown, the immersive virtual action learning method according to an embodiment of the present invention specifically includes:

[0022] Step S101, collecting and recording standard actions through motion capture, binding and fusing the motion capture data with the three-dimensional model, and making an interactive system through the UE engine based on the bound and fused three-dimensional model; specifically including:

[0023] The standard actions are captured and recorded through inertial motion capture MVN, digital modeling is performed through Maya, and weights are brushed using metahuman and ADV. The motion capture data and the three-dimensional model are character-bound in MotionBuilder and imported into the UE engine. Logical interactions are created through the UE engine UMG system, and an interactive system is made through the UE blueprint system.

[0024] Step S102, projecting a virtual environment on an LED screen through the interactive system, specifically includes:

[0025] The interactive system projects a virtual environment and a virtual coach on a semi-enclosed or fully-enclosed LED flexible screen, allowing users to learn in an immersive way in a curved screen environment.

[0026] Step S103, performing control operations on the three-dimensional model according to the user's operation on the interactive system. Specifically comprising:

[0027] According to the user's operation on the interactive system, the three-dimensional model is controlled to rotate, slow down, pause, zoom in to view details, and view digital boxing scores.

[0028] In summary, with the help of the technical solution of the embodiment of the present invention, the user's usage experience can be improved, the user can learn the movements in an immersive manner, and the user's learning efficiency can be higher through interaction with the user.

[0029] Device Example 1

[0030] According to an embodiment of the present invention, an immersive virtual action learning device is provided. Figure 2 is a schematic diagram of an immersive virtual action learning device according to an embodiment of the present invention. Figure 2 As shown, the immersive virtual action learning device according to an embodiment of the present invention specifically includes:

[0031] The capture module 20 is used to collect and record standard actions through motion capture, bind and fuse the motion capture data with the three-dimensional model, and make an interactive system through the UE engine based on the bound and fused three-dimensional model; specifically used for:

[0032] The standard actions are captured and recorded through inertial motion capture MVN, digital modeling is performed through Maya, and weights are brushed using metahuman and ADV. The motion capture data and the three-dimensional model are character-bound in MotionBuilder and imported into the UE engine. Logical interactions are created through the UE engine UMG system, and an interactive system is made through the UE blueprint system.

[0033] The LED screen 22 is used to project a virtual environment through the interactive system; the LED screen is specifically a semi-enclosed or fully-enclosed LED flexible screen, which is specifically used for:

[0034] A virtual environment and a virtual coach are projected through the interactive system.

[0035] The control module 24 is used to perform control operations on the three-dimensional model according to the user's operation on the interactive system. Specifically, it is used to:

[0036] According to the user's operation on the interactive system, the three-dimensional model is controlled to rotate, slow down, pause, zoom in to view details, and view digital boxing scores.

[0037] The embodiment of the present invention is a device embodiment corresponding to the above method embodiment. The specific operations of each module can be understood by referring to the description of the method embodiment, which will not be repeated here.

[0038] Device Example 2

[0039] An embodiment of the present invention provides an electronic device, such as Figure 3 As shown, it includes: a memory 30, a processor 32, and a computer program stored in the memory 30 and executable on the processor 32. When the computer program is executed by the processor 32, the steps described in the method embodiment are implemented.

[0040] Device Example 3

[0041] An embodiment of the present invention provides a computer-readable storage medium, on which a program for implementing information transmission is stored. When the program is executed by the processor 32, the steps described in the method embodiment are implemented.

[0042] The computer-readable storage medium in this embodiment includes, but is not limited to, ROM, RAM, magnetic disk or optical disk, etc.

[0043] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An immersive virtual action learning method, characterized in that: include: The standard actions are collected and recorded through motion capture, and the motion capture data is bound and fused with the 3D model. Based on the bound and fused 3D model, an interactive system is made through the UE engine; Projecting a virtual environment on the LED screen through the interactive system; According to the user's operation on the interactive system, a control operation is performed on the three-dimensional model.

2. The method according to claim 1, characterized in that The standard actions are collected and recorded through motion capture, and the motion capture data is bound and fused with the 3D model. Based on the bound and fused 3D model, an interactive system is made through the UE engine, which includes: The standard actions are captured and recorded through inertial motion capture MVN, digital modeling is performed through Maya, and weights are brushed using metahuman and ADV. The motion capture data and the three-dimensional model are character-bound in MotionBuilder and imported into the UE engine. Logical interactions are created through the UE engine UMG system, and an interactive system is made through the UE blueprint system.

3. The method according to claim 1, characterized in that According to the user's operation on the interactive system, performing the control operation on the three-dimensional model specifically includes: According to the user's operation on the interactive system, the three-dimensional model is controlled to rotate, slow down, pause, zoom in to view details, and view digital boxing scores.

4. The method according to claim 1, characterized in that: Projecting a virtual environment on an LED screen through the interactive system specifically includes: The interactive system projects a virtual environment and a virtual coach on a semi-enclosed or fully-enclosed LED flexible screen.

5. An immersive virtual action learning device, characterized in that: include: The capture module is used to collect and record standard actions through motion capture, bind and fuse the motion capture data with the three-dimensional model, and make an interactive system through the UE engine based on the bound and fused three-dimensional model; an LED screen for projecting a virtual environment through the interactive system; The control module is used to perform control operations on the three-dimensional model according to the user's operation on the interactive system.

6. The device according to claim 5, characterized in that The capture module is specifically used for: The standard actions are captured and recorded through inertial motion capture MVN, digital modeling is performed through Maya, and weights are brushed using metahuman and ADV. The motion capture data and the three-dimensional model are character-bound in MotionBuilder and imported into the UE engine. Logical interactions are created through the UE engine UMG system, and an interactive system is made through the UE blueprint system.

7. The device according to claim 5, characterized in that The control module is specifically used for: According to the user's operation on the interactive system, the three-dimensional model is controlled to rotate, slow down, pause, zoom in to view details, and view digital boxing scores.

8. The device according to claim 5, characterized in that The LED screen is specifically a semi-enclosed or fully-enclosed LED flexible screen, which is specifically used for: A virtual environment and a virtual coach are projected through the interactive system.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the steps of the immersive virtual action learning method according to any one of claims 1 to 4 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an implementation program for information transmission, and when the program is executed by a processor, the steps of immersive virtual action learning according to any one of claims 1 to 4 are implemented.

Images