3D-VR teaching interaction data real-time sharing system and method

Abstract

The invention discloses a 3D-VR teaching interaction data real-time sharing system, and the system comprises a data collection module which is used for collecting the interaction data of students and teachers in a 3D-VR teaching scene; the data preprocessing module is used for receiving the interaction data acquired by the data acquisition module and preprocessing the acquired interaction data; the data transmission module is used for transmitting the data processed by the data preprocessing module from the local 3D-VR to a server in real time; the server is used for receiving data transmitted by the data transmission module of each 3D-VR device and storing, managing and distributing the data; the data receiving module is used for receiving data distributed by the server; the 3D-VR teaching interaction data real-time sharing system overcomes the defects that in the prior art, the processing capacity for complex 3D-VR teaching scene data is limited, real-time transmission and sharing of large-scale data cannot be achieved, and the real-time sharing of the 3D-VR teaching interaction data cannot be achieved. And richness and diversity of teaching contents are limited.

Description

Technical Field

[0001] The present invention relates to the field of educational technology, and in particular to a 3D-VR teaching interactive data real-time sharing system and method. Background Art

[0002] With the development of virtual reality (VR) technology, 3D-VR teaching has gradually become a hot trend in the field of education. In a 3D-VR teaching environment, students can participate in course learning in an immersive way, greatly enhancing the immersiveness and fun of learning.

[0003] However, existing 3D-VR teaching systems have the following problems in interactive data sharing:

[0004] Existing systems have limited data processing capabilities for complex 3D-VR teaching scenarios and are unable to achieve real-time transmission and sharing of large-scale data, which limits the richness and diversity of teaching content.

[0005] Therefore, providing a 3D-VR teaching interactive data real-time sharing system and method that can realize real-time and efficient sharing of interactive data in the 3D-VR teaching process during use and improve the interactivity and quality of teaching is an urgent problem to be solved by the present invention. Summary of the Invention

[0006] In response to the above technical problems, the purpose of the present invention is to overcome the problem that the existing technology has limited data processing capabilities for complex 3D-VR teaching scenes, cannot achieve real-time transmission and sharing of large-scale data, and restricts the richness and diversity of teaching content. It thus provides a 3D-VR teaching interactive data real-time sharing system and method that can achieve real-time and efficient sharing of interactive data in the 3D-VR teaching process during use, thereby improving the interactivity and quality of teaching.

[0007] In order to achieve the above-mentioned object, the present invention provides a 3D-VR teaching interactive data real-time sharing system, the system comprising:

[0008] The data acquisition module is installed on each 3D-VR device to collect the interaction data between students and teachers in the 3D-VR teaching scene;

[0009] A data preprocessing module, configured to receive the interaction data collected by the data collection module and preprocess the collected interaction data;

[0010] A data transmission module, used to transmit the data processed by the data pre-processing module from the local 3D-VR to the server in real time;

[0011] The server is used to receive data transmitted from the data transmission modules of various 3D-VR devices and store, manage and distribute the data;

[0012] A data receiving module, installed on each 3D-VR device, to receive the data distributed by the server;

[0013] A data presentation module, connected to the data receiving module, to present the restored interactive data in the 3D-VR teaching scenario.

[0014] Preferably, the system further includes: a data feedback module; wherein,

[0015] The data feedback module is used to analyze the data stored in the server and generate an analysis report to provide suggestions and feedback for teachers and students.

[0016] Preferably, the data acquisition module includes: an inertial measurement unit, a depth camera, a pressure sensor, and an acceleration sensor.

[0017] Preferably, the data transmission module selects a 5G network or an optical fiber network for data transmission.

[0018] A method for real-time sharing of 3D-VR teaching interactive data includes the following steps:

[0019] S1. Data acquisition: The data acquisition module on each 3D-VR device acquires the interactive data of students and teachers in the 3D-VR teaching scenario in real time;

[0020] S2. Data preprocessing: The data processing module preprocesses and compresses the interactive data acquired by the data acquisition module;

[0021] S3. Data transmission: The data transmission module transmits the compressed data to the server through a high-speed network, and encrypts the data at the same time;

[0022] S4. Server processing: The server receives the data from each 3D-VR device, stores, manages, analyzes, and distributes it;

[0023] S5. Data reception and presentation: The data receiving module receives the data distributed by the server, decompresses and converts the format, and the data presentation module presents the restored interactive data in the 3D-VR teaching scenario.

[0024] Preferably, if a data transmission error occurs during the data transmission stage, the data transmission module automatically triggers a data retransmission and error correction mechanism.

[0025] Preferably, the data preprocessing module preprocesses the interactive data acquired by the acquisition module, including: data cleaning, format conversion, and feature extraction, and compresses the processed data using a data compression algorithm.

[0026] Preferably, the data preprocessing module uses a filtering algorithm to clean the interaction data collected by the data collection module, removing noise and interference.

[0027] According to the above technical solution, the beneficial effects of the 3D-VR teaching interaction data real-time sharing system and method provided by the present invention when in use are as follows:

[0028] (1) The system has good scalability and can easily add more 3D-VR devices and teaching scenarios to adapt to teaching needs of different scales and types.

[0029] (2) The present invention adopts a high-speed and stable network transmission protocol and an efficient data processing algorithm, which can realize the real-time sharing of 3D-VR teaching interaction data, greatly reducing data transmission latency and improving the interaction fluency during the teaching process.

[0030] (3) The present invention realizes the real-time interaction data sharing between students and students, and between students and teachers, increasing the interactivity of 3D-VR teaching and promoting students' collaborative learning and participation.

[0031] (4) The present invention reduces the amount of data transmission through data compression and encryption technologies, ensures data security, and improves the overall operation efficiency of the system.

[0032] Other features and advantages of the present invention will be described in detail in the subsequent specific implementation part; and parts not involved in the present invention are the same as or can adopt the prior art to realize. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The drawings are used to provide a further understanding of the present invention, and constitute a part of the specification, and are used to explain the present invention together with the following specific implementation manners, but do not constitute a limitation to the present invention. In the drawings:

[0034] Figure 1 is a block diagram of the working principle of the 3D-VR teaching interaction data real-time sharing system provided in a preferred embodiment of the present invention;

[0035] Figure 2 is a flowchart of the 3D-VR teaching interaction data real-time sharing method provided in a preferred embodiment of the present invention.

[0036] DESCRIPTION OF THE REFERENCE NUMERALS

[0037] 1. Data collection module; 2. Data preprocessing module; 3. Data transmission module; 4. Server; 5. Data receiving module; 6. Data presentation module; 7. Data feedback module. DETAILED DESCRIPTION OF THE INVENTION

[0038] The following will describe in detail the specific embodiments of the present invention with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only for the purpose of illustrating and explaining the present invention, and are not intended to limit the present invention.

[0039] As Figure 1-2 shown, a 3D-VR teaching interaction data real-time sharing system and method provided by the present invention, the system includes:

[0040] A data acquisition module 1, installed on each 3D-VR device, for acquiring interaction data of students and teachers in the 3D-VR teaching scene;

[0041] A data preprocessing module 2, for receiving the interaction data acquired by the data acquisition module 1 and preprocessing the acquired interaction data;

[0042] A data transmission module 3, for real-time transmitting the data processed by the data preprocessing module 2 from the local 3D-VR to the server 4;

[0043] A server 4, for receiving the data transmitted by the data transmission modules 3 of each 3D-VR device and storing, managing and distributing them;

[0044] A data receiving module 5, installed on each 3D-VR device, for receiving the data distributed by the server 5;

[0045] A data presentation module 6, connected to the data receiving module 5, for presenting the restored interaction data in the 3D-VR teaching scene.

[0046] In the above solution, the interaction data acquired by the data acquisition module 1 includes but is not limited to the user's location information, action posture information, viewing angle information, operation information on virtual objects, etc.

[0047] The data preprocessing module 2 is connected to the data acquisition module 1 to receive the interaction data acquired by the data acquisition module 1 and preprocess the acquired interaction data to reduce data noise and improve data quality. The data transmission module 3 uses a high-speed and stable network transmission protocol to be responsible for transmitting the processed data from the local 3D-VR device to the server 5 to ensure real-time transmission of the data.

[0048] The server 4 receives the data transmitted by the data transmission module 3 of each 3D-VR device, and stores and manages it. It analyzes and processes the received data in real time, and distributes the data to the corresponding target devices according to preset rules and algorithms. For example, in group collaborative learning, the operation data of a certain student is distributed to other students in the same group. The server 4 adopts high-performance server hardware, equipped with a large-capacity storage device and a multi-core processor to meet the storage and processing requirements of large-scale data.

[0049] The data receiving module 5 is installed on each 3D-VR device, and is used to receive the data distributed by the server 4, and decompresses and converts the format of the received data to restore it to the original interactive data. The same decryption algorithm as the data transmission module 3 is used to decrypt the encrypted data (the data is encrypted using the AES encryption algorithm to ensure the security of the data), and then decompression operations are performed.

[0050] The data presentation module 6 is connected to the data receiving module 5, and presents the restored interactive data in the 3D-VR teaching scenario. For example, the position and action posture information of other students are displayed in real time in the local 3D-VR scenario to achieve real-time sharing of interactive data.

[0051] In summary, the system provided by the present invention has the following advantages:

[0052] (1) The system has good scalability and can easily add more 3D-VR devices and teaching scenarios to adapt to different scales and types of teaching needs.

[0053] (2) The present invention adopts a high-speed and stable network transmission protocol and an efficient data processing algorithm, which can realize the real-time sharing of 3D-VR teaching interaction data, greatly reduce the data transmission delay, and improve the interaction fluency in the teaching process.

[0054] (3) The present invention realizes the real-time interaction data sharing between students and students, and between students and teachers, increases the interactivity of 3D-VR teaching, and promotes the collaborative learning and participation of students.

[0055] (4) The present invention reduces the data transmission volume through data compression and encryption technologies, ensures the security of the data, and improves the overall operation efficiency of the system.

[0056] In a preferred embodiment of the present invention, the system further includes: a data feedback module 7; wherein,

[0057] The data feedback module 7 is used to analyze the data stored in the server 4 and generate an analysis report to provide suggestions and feedback for teachers and students.

[0058] In the above solution, machine learning algorithms (such as decision trees and neural networks) are used to analyze the interaction data to mine the user's behavior patterns and learning habits. A visualization interface is developed to display the analysis results to teachers and students in the form of intuitive charts and reports. Teachers and students can view the analysis reports through the visualization interface and obtain targeted suggestions and feedback.

[0059] In a preferred embodiment of the present invention, the data acquisition module 1 includes: an inertial measurement unit, a depth camera, a pressure sensor, and an acceleration sensor.

[0060] In the above solution, an inertial measurement unit (IMU) is installed on each 3D-VR helmet to collect the user's head pose information in real time, including pitch angle, yaw angle, and roll angle. A pressure sensor and an acceleration sensor are installed on the 3D-VR handle to collect the user's hand movements and operation information, such as button operations and gripping forces. The depth camera is used to collect the user's position information and surrounding environment information in the virtual scene.

[0061] In a preferred embodiment of the present invention, the data transmission module 3 selects a 5G network or a fiber optic network for data transmission.

[0062] In the above solution, a 5G network module is selected as the main data transmission method to ensure high-speed and stable data transmission. Before data transmission, the AES encryption algorithm is used to encrypt the data to ensure data security.

[0063] A method for real-time sharing of 3D-VR teaching interaction data includes the following steps:

[0064] S1. Data acquisition: The data acquisition module 1 on each 3D-VR device collects the interaction data of students and teachers in the 3D-VR teaching scene in real time;

[0065] S2. Data preprocessing: The data processing module 2 preprocesses and compresses the interaction data collected by the data acquisition module 1;

[0066] S3. Data transmission: The data transmission module 3 transmits the compressed data to the server 4 through a high-speed network, and encrypts the data at the same time;

[0067] S4. Server processing: The server receives the data from each 3D-VR device and performs storage, management, analysis, and distribution;

[0068] S5, Data Reception and Presentation: The data reception module 5 receives the data distributed by the receiving server 4, decompresses and converts the format, and the data presentation module 6 presents the restored interactive data in the 3D-VR teaching scenario.

[0069] In the above solution,

[0070] S1, Data Acquisition:

[0071] At the start of 3D-VR teaching, the data acquisition module 1 of each 3D-VR device starts to collect interactive data in real time. The data acquisition frequency is set according to actual needs to ensure the accuracy and integrity of the data to ensure its real-time nature.

[0072] S2, Data Processing:

[0073] The data preprocessing module 2 preprocesses the collected data every specified millisecond, including data cleaning, format conversion, and feature extraction.

[0074] After the processing is completed, the data is immediately compressed using a data compression algorithm.

[0075] S3, Data Transmission:

[0076] The data transmission module 3 transmits the compressed and encrypted data to the server 4 in real time through the 5G network. During the transmission process, the network status is continuously monitored to ensure the stable transmission of the data.

[0077] S4, Server Processing:

[0078] The server 4 receives the data from each 3D-VR device in real time and stores it in the database.

[0079] The server 4 analyzes and distributes the data according to the preset teaching rules and grouping information. For example, in a group discussion scenario, the interactive data of the members within the group is distributed to other members within the group.

[0080] S5, Data Reception and Presentation:

[0081] After the data reception module 5 receives the data distributed by the server 4, it immediately performs decryption and decompression operations.

[0082] The data presentation module 6 presents the restored interactive data in the 3D-VR teaching scenario in real time, enabling users to intuitively see the status and operations of other participants.

[0083] In a preferred embodiment of the present invention, if a data transmission error occurs during the data transmission stage by the data transmission module 3, the system automatically triggers a data retransmission and error correction mechanism.

[0084] In the above solution, during the transmission process, a data retransmission and error correction mechanism is adopted to ensure that the data arrives at the destination accurately and without error.

[0085] In a preferred embodiment of the present invention, the data preprocessing module 2 preprocesses the interaction data collected by the acquisition module 1, including: data cleaning, format conversion, and feature extraction, and compresses the processed data using a data compression algorithm.

[0086] In the above solution, data in different formats is uniformly converted into a standard data format for subsequent processing and transmission. Key features of the data are extracted, such as the start and end times of actions, the change trend of positions, etc., to reduce the amount of data. A lossless compression algorithm is used to compress the processed data, such as the LZ77 algorithm.

[0087] Therefore, the data preprocessing module 2 performs data cleaning, format conversion, and feature extraction on the interaction data collected by the data acquisition module 1 to reduce data noise and improve data quality; while using a data compression algorithm to compress the processed data to reduce the data transmission volume and improve the transmission efficiency.

[0088] In a preferred embodiment of the present invention, the data preprocessing module 2 uses a filtering algorithm to clean the interaction data collected by the data acquisition module 1 to remove noise and interference.

[0089] In summary, the 3D-VR teaching interaction data real-time sharing system and method provided by the present invention overcome the problems in the prior art that the data processing ability for complex 3D-VR teaching scenarios is limited, the real-time transmission and sharing of large-scale data cannot be achieved, and the richness and diversity of teaching content are restricted.

[0090] The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the present invention is not limited to the specific details in the above embodiments. Within the scope of the technical concept of the present invention, various simple modifications can be made to the technical solutions of the present invention, and these simple modifications all fall within the protection scope of the present invention.

[0091] In addition, it should be noted that, among the various specific technical features described in the above specific embodiments, they can be combined in any suitable manner without conflict. To avoid unnecessary repetition, the present invention will not separately describe various possible combination methods.

[0092] In addition, any combination can be made between various different embodiments of the present invention, as long as it does not violate the idea of the present invention, it should also be regarded as the content disclosed by the present invention.

Claims

1. A 3D-VR teaching interaction data real-time sharing system, characterized in that, The system includes: A data acquisition module (1), installed on each 3D-VR device, for acquiring the interaction data of students and teachers in the 3D-VR teaching scenario; A data preprocessing module (2), for receiving the interaction data acquired by the data acquisition module (1) and preprocessing the acquired interaction data; A data transmission module (3), for real-time transmitting the data processed by the data preprocessing module (2) from the local 3D-VR to the server (4); A server (4), for receiving the data transmitted by the data transmission modules (3) of each 3D-VR device and storing, managing, and distributing it; A data receiving module (5), installed on each 3D-VR device, for receiving the data distributed by the server (5); A data presentation module (6), connected to the data receiving module (5), for presenting the restored interaction data in the 3D-VR teaching scenario.

2. The 3D-VR teaching interaction data real-time sharing system according to claim 1, wherein The system further includes: a data feedback module (7); wherein, The data feedback module (7) is used to analyze the data stored in the server (4), generate an analysis report, and provide suggestions and feedback for teachers and students.

3. The 3D-VR teaching interaction data real-time sharing system according to claim 1, characterized in that The data acquisition module (1) includes: an inertial measurement unit, a depth camera, a pressure sensor, and an acceleration sensor.

4. The 3D-VR teaching interaction data real-time sharing system according to claim 1, wherein The data transmission module (3) selects a 5G network or a fiber optic network for data transmission.

5. The real-time sharing method of 3D-VR teaching interaction data according to any one of claims 1-4, characterized in that, It includes the following steps: S1. Data acquisition: The data acquisition module (1) on each 3D-VR device acquires the interaction data of students and teachers in the 3D-VR teaching scenario in real time; S2. Data preprocessing: The interaction data acquired by the data acquisition module (1) is preprocessed and compressed by the data processing module (2); S3. Data transmission: The compressed data is transmitted by the data transmission module (3) to the server (4) through a high-speed network, and the data is encrypted at the same time; S4. Server processing: The server receives the data from each 3D-VR device, stores, manages, analyzes, and distributes it; S5. Data reception and presentation: The data receiving module (5) receives the data distributed by the server (4), decompresses and converts the format, and the data presentation module (6) presents the restored interaction data in the 3D-VR teaching scenario.

6. The real-time sharing method of 3D-VR teaching interaction data according to claim 5, wherein, If a data transmission error occurs during the data transmission stage of the data transmission module (3), the system automatically triggers a data retransmission and error correction mechanism.

7. The real-time sharing method of 3D-VR teaching interaction data according to claim 5, characterized in that The preprocessing of the interaction data acquired by the data acquisition module (1) by the data preprocessing module (2) includes: data cleaning, format conversion, and feature extraction, and the processed data is compressed using a data compression algorithm.

8. The real-time sharing method of 3D-VR teaching interaction data according to claim 5, wherein The data preprocessing module (2) uses a filtering algorithm to clean the interaction data acquired by the data acquisition module (1) to remove noise and interference.

Images