English learning system based on virtual reality and self cognition and use method thereof

Through the English learning system combining virtual reality technology and embodied cognitive theory, the problems of low efficiency and lack of real context in traditional English learning methods are solved, efficient and interesting English learning effects are achieved, and learners' oral and listening skills are improved. ability.

CN119045666APending Publication Date: 2024-11-29SOUTHEAST UNIV
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411228473.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

Traditional English learning methods are inefficient and lack real context, resulting in weak oral and listening abilities and insufficient learning motivation.

Method used

Combining virtual reality technology and embodied cognitive theory, an English learning system is designed, including system control module, scene configuration module, operation control module, data acquisition module, data processing module and data visualization module, and through immersive learning in a virtual environment English learning is provided, providing a variety of interaction methods, such as PC keyboard and mouse interaction, VR handle interaction and VR motion capture glove interaction, enhancing the fun and interactiveness of learning.

Benefits of technology

It improves the efficiency and effectiveness of English learning, enhances learners' interest and motivation, and improves language application ability and memory effect through real context simulation and multi-sensory stimulation in the virtual environment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119045666A_ABST
    Figure CN119045666A_ABST
Patent Text Reader

Abstract

The invention discloses an English learning system based on virtual reality and self cognition and a use method thereof, and the system at least comprises a system control module, a scene configuration module, an operation control module, a data collection module, a data processing module and a data visualization module. The English learning device is applied to the training and practice aspects of the education field, and particularly aims at the problems that domestic students are difficult to convert book knowledge into practical application, the oral language and listening ability is weak and the like, English is fused into life and entertainment in an immersive learning mode, and English is learned in life and entertainment. The system can be applied on a large scale, and the English learning effect can be improved in a more efficient, more interesting and unconscious mode.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of virtual reality and human-computer interaction, and is particularly suitable for helping users learn English and improving learning efficiency. It mainly relates to an English learning system based on virtual reality and embodied cognition and a method of using the system. Background Art

[0002] As a global language, mastering English can not only open a window to global knowledge and information, promote cross-cultural communication and understanding, but also improve personal competitiveness on the international stage and provide more opportunities for academic research, career development and travel. At the same time, as an important language in fields such as science and technology, business and diplomacy, learning English can help individuals better participate and develop in these fields and contribute to the diversity and innovation of society. However, in China, there are some common problems with English as a foreign language. Traditional learning methods such as memorizing words and doing exercises are often inefficient and easily lead to learners' fatigue and boredom. The lack of real context makes it difficult for learners to apply book knowledge to real life, and their oral and listening skills are weak. The traditional classroom teaching method is single, student participation is low, and there is a lack of interactivity and fun, which leads to insufficient learning motivation.

[0003] Virtual reality (VR) is a computer simulation system and human-computer interaction technology for creating and experiencing a virtual world. It can realistically simulate things and scenes in the real world, giving people a feeling of being "in the scene". It can also interact with the virtual environment naturally, and has the characteristics of high immersion, high fidelity, strong interactivity and fun. It uses data from real life, electronic signals generated by computers, and combines them with various output devices to transform them into phenomena that people can feel. These phenomena can be real objects in reality or substances that are invisible to our naked eyes, which are simulated and expressed through three-dimensional models, so it is called virtual reality. Head-mounted virtual reality devices are usually used to isolate the user's real visual and auditory senses to produce virtual vision and hearing. Users can also use special gloves or handles to interact with the virtual world, so as to produce a feeling of being completely in a virtual environment. Immersive virtual reality technology can provide a full range of sensory stimulation, allowing learners to be completely immersed in the virtual environment, enhancing their concentration and sense of involvement when learning English. Through the construction of virtual scenes, learners can communicate and interact in a simulated language environment, improve their practical application ability, enhance the interactivity and fun of the learning process, and stimulate learners' interest and motivation.

[0004] Embodied cognition theory is a theory in the field of psychology and cognitive science. In simple terms, it holds that our body and environment interact with each other to shape our way of thinking and understanding. First, the way and steps of cognitive process are actually determined by the physical properties of the body. Human perceptual ability, such as the breadth of perception, threshold, and perceptible limit, are all determined by the physical properties of the body. Second, the content of cognition is also provided by the body. Most of human abstract thinking uses this metaphorical reasoning, that is, using familiar things to understand unfamiliar things. Third, cognition is embodied, and the body is embedded in the environment. Cognition, body, and environment form a dynamic unity. Cognitive process or cognitive state should be extended to the environment of the cognizer. Language is an abstract symbol system related to our physical actions and perceptual experiences. Learning a foreign language should include learning methods related to physical actions and sensory experiences, such as role-playing, body movements, visual and auditory experiences, etc. Understanding and expressing language through perception and action is very important for learning the context, culture and real communication of English, rather than just memorizing vocabulary and grammar rules. At the same time, the theory of embodied cognition encourages the cultivation of this muscle memory through imitation and active participation to improve the accuracy and fluency of language pronunciation. Summary of the invention

[0005] The present invention is aimed at the problems existing in the prior art, and provides an English learning system based on virtual reality and embodied cognition and its use method, which at least includes a system control module, a scene configuration module, an operation control module, a data acquisition module, a data processing module and a data visualization module, and organically combines virtual reality technology with embodied cognition theory, and applies it to the training and practice in the field of education, especially for the problems that domestic students have difficulty in converting book knowledge into practical applications, and have weak oral and listening abilities, and use immersive learning to integrate English into life and entertainment, and learn English in life and entertainment. The system of the present invention can be applied on a large scale, which is conducive to improving the effect of English learning in a more efficient, interesting and subtle way.

[0006] In order to achieve the above-mentioned purpose, the technical solution adopted by the present invention is: an English learning system based on virtual reality and embodied cognition, comprising at least a system control module, a scene configuration module, an operation control module, a data acquisition module, a data processing module and a data visualization module,

[0007] The system control module: extracts basic environment configuration parameter information according to the interaction mode selected by the user and the number of users, receives the evaluation results of the data processing module, makes scene content adjustment decisions according to the historical evaluation result records, and provides scene configuration information to the scene configuration module; provides updated task flow data to the operation control module and issues operation task flow instructions; the scene configuration information at least includes the number of users, scene content and behavior task content adjustment;

[0008] The scene configuration module receives the instruction information of the system control module, adjusts the scene settings, builds and outputs the virtual scene environment, and realizes the virtual scene switching;

[0009] The operation control module receives the task flow data of the system control module, publishes tasks in real time during system operation according to the new task flow data, and determines the task completion status;

[0010] The data collection module automatically collects the interaction information and task flow information during the interaction between the user and the system, and transmits the information data to the data processing module for data analysis; the interaction information at least includes the number of interactions between the user and the system, the interaction mode, and the user's movement trajectory; the task flow information at least includes the system mode, user ID, level number, interaction time, and behavior information;

[0011] The data processing module receives all the data collected by the data collection module, calculates and analyzes the reaction time of the user to complete the interactive behavior, determines the user's mastery of the English learning content, and transmits the evaluation results to the data visualization module and the system control module;

[0012] The data visualization module receives all the data processed by the data processing module and displays them in a visual manner to provide a reference for analyzing the user's learning situation and progress.

[0013] As an improvement of the present invention, the interaction mode selected by the user includes at least PC keyboard and mouse interaction, VR handle interaction and VR motion capture glove interaction.

[0014] As another improvement of the present invention, when the user selects PC keyboard and mouse interaction, the data acquisition module includes: a keyboard input recording unit, a mouse operation recording unit and a data synchronization module; wherein the keyboard input recording unit is used to record all key data input by the user through the keyboard; the mouse operation recording unit is used to record the user's mouse operation data; the data synchronization module is used to synchronously transmit the interaction data of the keyboard and mouse to the data processing module in real time for analysis and storage;

[0015] When the user selects VR handle interaction, the data acquisition module includes: a handle action recording unit, a handle interaction recording unit and a data synchronization module; wherein the handle action recording unit is used to record all action data performed by the user through the VR handle; the handle interaction recording unit is used to record the interaction information between the user and the virtual object; the data synchronization module is used to synchronously transmit the interaction data of the handle to the data processing module in real time for analysis and storage;

[0016] When the user chooses to interact with VR motion capture gloves, the data acquisition module includes: a glove action recording unit, a glove interaction recording unit and a data synchronization module; wherein the glove action recording unit is used to record all action data performed by the user through the motion capture gloves; the glove interaction recording unit is used to record the interaction information between the user and the virtual object; the data synchronization module is used to synchronize and transmit the interaction data of the gloves to the data processing module in real time for analysis and storage.

[0017] As another improvement of the present invention, according to different interaction methods, the virtual scene constructed by the system includes a PC version scene and a VR version scene. The PC version scene constructs a 3D modeling scene based on a third perspective, and the interaction method is PC keyboard and mouse interaction; the VR version scene constructs a 3D modeling VR scene based on a first perspective, and the interaction methods include VR handle interaction and VR motion capture glove interaction.

[0018] As another improvement of the present invention, the data acquisition module includes but is not limited to a virtual reality head-mounted display, a handle matching the head-mounted display, a motion capture glove, and a keyboard and mouse.

[0019] As another improvement of the present invention, the data visualization module includes a front end, a back end, a data security and access control section, and a real-time data synchronization and update section.

[0020] The front end: provides a user-friendly interface and interactive functions, allows operators to filter, sort and search data, and supports dynamic updates and real-time feedback;

[0021] The backend receives and processes data from the data processing module and stores the processed data in a database;

[0022] The data security and access control section: implements user authentication and authorization mechanisms, and adds encryption technology during data transmission and storage;

[0023] The real-time data synchronization and update section realizes real-time data synchronization between the front-end and the back-end.

[0024] In order to achieve the above-mentioned purpose, the present invention also adopts a technical solution: a method for using an English learning system based on virtual reality and embodied cognition, comprising the following steps:

[0025] S1, scene selection: when the user enters the system, he / she selects the English learning scene according to the device and the number of users, and determines the single-user mode or multi-user mode;

[0026] S2, interactive learning: In single-player mode, users learn and interact with interactive objects in the scene by reading English instructions or listening to English instructions according to task requirements, until all task behaviors meet the requirements or the countdown ends; in multi-player mode, multiple users work together to complete task requirements through English dialogue until all tasks meet the requirements or the countdown ends; during the interactive learning process, the system automatically records the interaction process data of each user according to the user ID and transmits the data to the system data processing module;

[0027] S3, learning test: After completing all tasks in the current scene, the user enters the learning test phase, and the test result data is also transmitted to the system data processing module to form a visual result;

[0028] S4, data analysis: the system receives and calculates the data of step S2 and step S3, and makes a judgment and analysis on the English mastery level according to the calculation results, forms an evaluation result and stores it in the historical data record, and issues the content adjustment instruction for the next scene based on the forgetting curve theory, and continues to repeat steps S1-S3;

[0029] S5, manual intervention: The instructor analyzes the user's mastery of the English learning content based on the data and visualization results of step S3, and manually intervenes in the user's English learning plan by modifying the English learning content in the learning database to provide better learning suggestions.

[0030] As a further improvement of the present invention, in the scene selection of step S1, if it is not the first time to use the system, the system modifies the content of the scene and arranges new tasks based on the historical retained learning evaluation results or the evaluation of the previous scene and the latest English learning database.

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] (1) The present invention combines for the first time multiple sets of interactive modes for interacting with virtual objects and an English learning method based on embodied cognition theory. The system of the present invention allows users to be in a virtual living environment and interact with the environment through a variety of different interactive modes, providing users with English learning content that matches the behavioral environment and completing corresponding English learning effect detection tests. The test results will continue to be used by the system as a feedback factor to maintain the user's English learning effect. Since users tend to perceive certain actual behaviors, they will also remember the English content corresponding to the relevant behaviors, and the learning effect can also be gradually improved.

[0033] (2) Compared with traditional English learning methods, the system of the present invention can create a virtual environment with a higher degree of immersion, provide a simulation of a real language context, enable users to communicate and interact in a simulated language environment, and enhance their language application ability. Traditional learning methods rely on classroom teaching, memorizing words, doing exercises, etc., which lack the simulation of a real language context, making it difficult to apply book knowledge to actual communication, and the learning process is often boring and tedious, which can easily lead to learners' fatigue and boredom. The system of the present invention enhances the fun and interactivity of learning through physical participation and multi-sensory stimulation, and stimulates the interest and motivation of users.

[0034] (3) The system of the present invention also introduces personalized learning paths and real-time data visualization functions, which can be adjusted according to the specific needs and levels of users, provide scientific and comprehensive learning assessments and personalized learning suggestions, and significantly improve the efficiency and effectiveness of learning. Compared with traditional methods, this system not only has obvious advantages in improving learning effects, but also provides users with a more interesting and interactive learning experience, promoting the deep internalization and long-term memory of knowledge. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 A structural diagram of the system of the present invention;

[0036] Figure 2 The present invention is a flowchart of the steps of the method for using the system. DETAILED DESCRIPTION

[0037] The present invention will be further explained below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the following specific embodiments are only used to illustrate the present invention and are not used to limit the scope of the present invention.

[0038] Example 1

[0039] English learning system based on immersive virtual reality and embodied cognition theory, such as Figure 1 As shown, it at least includes a system control module, a scene configuration module, an operation control module, a data acquisition module, a data processing module and a data visualization module.

[0040] The system control module extracts basic environment configuration parameter information according to the system usage equipment and number of users selected by the user, receives the evaluation results of the data processing module or makes scene content adjustment decisions based on historical evaluation result records, provides scene configuration information to the scene configuration module, including the number of users, scene content, behavioral task content adjustment, etc., provides updated task flow data to the operation control module and issues operation task flow instructions.

[0041] There are three ways for users to interact with items:

[0042] (1) PC keyboard and mouse interaction, (2) VR handle interaction, and (3) VR motion capture glove interaction.

[0043] The number of users includes two modes:

[0044] (1) Single-user mode: In this mode, the system focuses more on the learning of English reading and listening, and there will be more indicator words and indicator voices to guide users to interact and learn.

[0045] (2) Multi-user mode: In this mode, the system focuses more on the learning of spoken English and provides greater freedom and a wider range of usage space, making it convenient for multiple users to practice speaking during interaction and communication.

[0046] The scene configuration module receives instruction information from the system control module, adjusts scene settings, builds and outputs a virtual scene environment, and implements virtual scene switching.

[0047] Based on different devices, the virtual scenes built by the system are of two types:

[0048] (1) PC version scene: a 3D modeling scene built based on the third-person perspective, with the main interaction method being PC keyboard and mouse interaction;

[0049] (2) VR version scene: A 3D modeling VR scene built based on the first-person perspective. The main interaction methods include VR handle interaction and VR motion capture glove interaction.

[0050] In the scene configuration module, the constructed virtual scene environment will present different scene effects according to different types and modes. In addition, based on the system feedback mechanism, the virtual scene content will select instructions to build corresponding interactive objects according to the content transmitted by the task control module, and appropriately modify the behavioral task content under the original virtual scene template, so as to improve the user's mastery of relevant English learning content through repeated learning and other methods.

[0051] The operation control module receives the task flow data of the system control module, publishes tasks in real time during system operation according to the new task flow data, determines the task completion status, and ensures the normal operation of the scenario;

[0052] The data acquisition module: in the constructed virtual scene environment, the user interacts normally with the objects in the scene, and the module automatically collects and records the interaction information during the interaction process, such as the number of interactions between the user and the object, the interaction method, the user's movement trajectory, etc., as well as task flow information, such as system mode, user ID, level number, interaction time, behavior-related information (behavior content, completion time, etc.), etc., and transmits the recorded data to the data processing module for data analysis.

[0053] The data acquisition module selects the interaction mode and data acquisition mode to be used in the current scenario according to the instruction information issued by the task control module.

[0054] If the PC keyboard and mouse interaction is selected, the data acquisition module includes: a keyboard input recording unit, which is used to record all keystroke data entered by the user through the keyboard. A mouse operation recording unit, which is used to record the user's mouse operation, and the main content is the selection result of the system operation mode. A data synchronization module, which is used to synchronously transmit the interaction data of the keyboard and mouse to the data processing module in real time for analysis and storage;

[0055] If VR handle interaction is selected, the data collection module includes: a handle action recording unit, which is used to record all action data performed by the user through the VR handle, including the button operation of the handle, vibration feedback, etc. A handle interaction recording unit, which is used to record the interaction information between the user and the virtual object, such as grabbing, moving, rotating, holding time, etc. A data synchronization module, which is used to synchronize the interaction data of the handle to the data processing module in real time for analysis and storage;

[0056] If the selected VR motion capture glove interaction, the data acquisition module includes: a glove action recording unit, which is used to record all action data performed by the user through the motion capture gloves, including the curvature of the fingers, the position and posture of the palm, etc. A glove interaction recording unit, which is used to record the interaction information between the user and the virtual object, such as grabbing, moving, rotating, throwing and other operations. A data synchronization module, which is used to synchronize the interaction data of the gloves to the data processing module in real time for analysis and storage.

[0057] In the data acquisition module, the devices that complete the data acquisition task are a virtual reality head-mounted display, a handle that matches the head-mounted display, motion capture gloves, and a keyboard and mouse.

[0058] The data processing module receives all data collected by the data collection module, including interaction information and task flow information, calculates and analyzes the reaction time of the user to complete various interactive object-related behaviors, thereby judging the user's mastery of the relevant English learning content, and transmits the evaluation results to the data visualization module and the system control module;

[0059] The data visualization module receives all data processed by the data processing module, including the number of learning times of relevant English learning content, reaction time data characteristics (average value, maximum value, fitted regression curve, etc.), etc., and presents the received data to the instructor through various display forms such as charts, texts, and data, thereby assisting the instructor to deeply analyze the user's learning situation and progress, and then obtain a learning path that is more suitable for the user.

[0060] The data visualization module presents the analysis results from the data analysis module through a website developed with front-end and back-end separation. This module contains four sub-sections:

[0061] (1) Front-end: Design a user-friendly interface to display charts, text, and data in various forms, including but not limited to line charts, bar charts, pie charts, and data tables. Provide interactive functions to allow instructors to filter, sort, and search data, and support dynamic updates and real-time feedback.

[0062] (2) Backend: Receives and processes data from the data processing module and stores the processed data in the database. Through interface calls, ensure that the front end can obtain and update data in real time.

[0063] (3) Data security and access control: Implement user authentication and authorization mechanisms to ensure that only authorized instructors can access and operate data. Use encryption technology during data transmission and storage to ensure data security and privacy.

[0064] (4) Real-time data synchronization and update: Realize real-time data synchronization between the front-end and back-end to ensure that instructors can see the latest data and analysis results immediately.

[0065] Example 2

[0066] The English learning system is based on immersive virtual reality technology and embodied cognition theory. In this embodiment, users learn English content related to supermarket items and behaviors in a supermarket environment. It includes a system control module, a scene configuration module, an operation control module, a data acquisition module, a data processing module, and a data visualization module. When the user selects the single-player mode and the interactive mode selects VR motion capture gloves to interact, the scenes include the lobby, character selection, multiple specific task scenes, learning tests, etc. Figure 2 As shown, the specific steps for using the system VR single-player mode version are as follows:

[0067] Step S1: The user uses VR motion capture gloves to interact and enter the single-player mode. In the lobby scene, the user can select a learning topic and enter the scene by clicking with the index finger. At this time, the system control module will combine the historical evaluation results, appropriately adjust the supermarket task content, and build a supermarket task scene for the user.

[0068] Step S2: According to the instructions of the operation control module, the system's usage instructions will be displayed through language broadcast, animation display, text display, etc. when just entering the scene. When the user completes the specified behavior in the order of prompts, the usage instructions will disappear, and the user will begin to interact autonomously in the supermarket scene. The user needs to read and learn about various behaviors that may occur in the supermarket within the specified time, and complete the tasks published in real time during the scene operation. The interaction process will be automatically recorded for subsequent data processing and analysis. After the timing ends, the operation control module will issue an instruction to switch the system scene to the learning test scene.

[0069] Step S3: In the learning test scenario, the user will complete the learning test in the virtual supermarket scenario. The specific content of the learning test is that the operation control module conveys the supermarket-related test behavior tasks to the user through English voice broadcast, animation display, text display, etc. After the user confirms that the understanding is correct, he enters the virtual supermarket scene and completes the corresponding test task. The data acquisition module will capture the user's interactive behavior and record the behavior data, including task completion time, movement trajectory, interactive behavior type, interactive items, number of interactions, etc. After the user completes the test, the data acquisition module will pass all data to the data processing module. At the same time, the system will also count the number and quality of completed tasks in this scenario and give a final score. When the score is higher than the set threshold, you can enter the next level, that is, repeat step S2.

[0070] In this embodiment, there are a total of 78 specific interactive behaviors, and they are designed according to the design directions such as interaction type, English learning content, and real scene mapping. The specific contents of some interactive behaviors are shown in the following table:

[0071]

[0072]

[0073] Step S4: The system captures the recorded behavioral interaction data, analyzes each user's mastery of supermarket-related vocabulary and sentences by calculating behavioral word frequency, movement trajectory, reaction speed, etc., and transmits the evaluation results to the historical evaluation result records of each server, and forms a visual result to be transmitted to the instructor.

[0074] Step S5: The instructor receives the visualization results provided by the main server and conducts a theoretical analysis of each user's mastery of the English learning content in the supermarket scenario, appropriately modifies the learning content of each user's learning database, manually intervenes in each user's English learning plan, and provides better personalized learning suggestions.

[0075] Example 3

[0076] The English learning system based on immersive virtual reality technology and embodied cognitive theory, in this embodiment, the user learns English content related to kitchen items and behaviors in the kitchen environment, including system control module, scene configuration module, operation control module, data acquisition module, data processing module and data visualization module. When the user selects multiplayer mode and selects PC keyboard and mouse interaction as the interactive mode, the scene includes lobby, character selection, multiple specific task scenes, etc. The specific steps for using the PC multiplayer mode version of the system are as follows:

[0077] Step S1: The user uses the keyboard and mouse to interact to enter the multiplayer mode. In the lobby scene, you can create a room and wait for other users to join. You can also join an existing room by clicking the room link in the list, entering the room number, or entering the room name. After joining the room, the system enters the role selection scene, and the user can choose the corresponding role according to his or her preferences. When all users in the room have finished selecting, the system combines the historical evaluation results, appropriately adjusts the kitchen task content, and builds a kitchen task scene for each user.

[0078] Step S2: After all players in the room confirm that they have read and completed the task requirements of this scene, the kitchen scene is officially launched. Multiple users need to communicate in English within the specified time to complete the tasks released in real time during the scene operation. The communication audio will be automatically recorded for subsequent data processing and analysis. After the countdown ends, the system counts the number and quality of completed tasks in this scene and gives a final score. When the score is higher than the set threshold, you can enter the next level, that is, repeat this step.

[0079] In this embodiment, specific interactive behaviors are designed according to design directions such as interaction type, English learning content, and real scene mapping. The specific contents of some interactive behaviors are shown in the following table:

[0080]

[0081]

[0082] Step S3: The system captures the recorded audio data keywords, analyzes each user's mastery of kitchen-related vocabulary and sentences by calculating the frequency of occurrence, comparing the pronunciation accuracy, etc., and transmits the evaluation results to the historical evaluation result records of each server, and forms a visual result to be transmitted to the instructor.

[0083] Step S4: The instructor receives the visualization results provided by the main server and conducts a theoretical analysis of each user's mastery of the English learning content in the kitchen scenario, appropriately modifies the learning content of each user's learning database, manually intervenes in each user's English learning plan, and provides better personalized learning suggestions.

[0084] In summary, the English learning system based on immersive virtual reality and embodied cognition theory of the present invention at least includes a system control module, a scene configuration module, an operation control module, a data acquisition module, a data processing module and a data visualization module, which organically combines virtual reality technology with embodied cognition theory to improve the efficiency of English learning and open up broader prospects for academic research and career development.

[0085] It should be noted that the above content only illustrates the technical idea of ​​the present invention and cannot be used to limit the protection scope of the present invention. For ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications all fall within the protection scope of the claims of the present invention.

Claims

1. An English learning system based on virtual reality and embodied cognition, characterized by: At least includes system control module, scene configuration module, operation control module, data acquisition module, data processing module and data visualization module. The system control module extracts basic environment configuration parameter information according to the interaction mode selected by the user and the number of users, receives the evaluation results of the data processing module, makes scene content adjustment decisions according to the historical evaluation result records, and provides scene configuration information to the scene configuration module; Providing updated task flow data to the operation control module and issuing an operation task flow instruction; the scene configuration information at least includes the number of users, scene content and behavior task content adjustment; The scene configuration module receives instruction information from the system control module, adjusts scene settings, builds and outputs a virtual scene environment, and implements virtual scene switching; The operation control module receives the task flow data of the system control module, publishes tasks in real time during system operation according to the new task flow data, and determines the task completion status; The data collection module automatically collects the interaction information and task flow information during the interaction between the user and the system, and transmits the information data to the data processing module for data analysis; the interaction information at least includes the number of interactions between the user and the system, the interaction mode, and the user's movement trajectory; the task flow information at least includes the system mode, user ID, level number, interaction time, and behavior information; The data processing module receives all the data collected by the data collection module, calculates and analyzes the reaction time of the user to complete the interactive behavior, determines the user's mastery of the English learning content, and transmits the evaluation results to the data visualization module and the system control module; The data visualization module receives all the data processed by the data processing module and displays them in a visual manner to provide a reference for analyzing the user's learning situation and progress.

2. The English learning system based on virtual reality and embodied cognition as claimed in claim 1, characterized in that: The interaction method selected by the user includes at least PC keyboard and mouse interaction, VR handle interaction and VR motion capture glove interaction.

3. The English learning system based on virtual reality and embodied cognition as claimed in claim 2, characterized in that: When the user selects PC keyboard and mouse interaction, the data acquisition module includes: a keyboard input recording unit, a mouse operation recording unit and a data synchronization module; wherein the keyboard input recording unit is used to record all key data input by the user through the keyboard; the mouse operation recording unit is used to record the user's mouse operation data; the data synchronization module is used to synchronously transmit the interaction data of the keyboard and mouse to the data processing module in real time for analysis and storage; When the user selects VR handle interaction, the data acquisition module includes: a handle action recording unit, a handle interaction recording unit and a data synchronization module; wherein the handle action recording unit is used to record all action data performed by the user through the VR handle; the handle interaction recording unit is used to record the interaction information between the user and the virtual object; the data synchronization module is used to synchronously transmit the interaction data of the handle to the data processing module in real time for analysis and storage; When the user chooses to interact with VR motion capture gloves, the data acquisition module includes: a glove action recording unit, a glove interaction recording unit and a data synchronization module; wherein the glove action recording unit is used to record all action data performed by the user through the motion capture gloves; the glove interaction recording unit is used to record the interaction information between the user and the virtual object; the data synchronization module is used to synchronize and transmit the interaction data of the gloves to the data processing module in real time for analysis and storage.

4. The English learning system based on virtual reality and embodied cognition as claimed in claim 3, characterized in that: According to different interaction methods, the virtual scenes built by the system include PC version scenes and VR version scenes. The PC version scene constructs a 3D modeling scene based on the third perspective, and the interaction method is PC keyboard and mouse interaction; the VR version scene constructs a 3D modeling VR scene based on the first perspective, and the interaction methods include VR handle interaction and VR motion capture glove interaction.

5. The English learning system based on virtual reality and embodied cognition as claimed in claim 2, characterized in that: The data acquisition module includes but is not limited to a virtual reality head-mounted display, a handle matching the head-mounted display, a motion capture glove, and a keyboard and mouse.

6. The English learning system based on virtual reality and embodied cognition as claimed in claim 4 or 5, characterized in that: The data visualization module includes the front-end, back-end, data security and access control section, and real-time data synchronization and update section. The front end: provides a user-friendly interface and interactive functions, allows operators to filter, sort and search data, and supports dynamic updates and real-time feedback; The backend receives and processes data from the data processing module and stores the processed data in a database; The data security and access control section: implements user authentication and authorization mechanisms, and adds encryption technology during data transmission and storage; The real-time data synchronization and update section realizes real-time data synchronization between the front-end and the back-end.

7. The method for using the English learning system based on virtual reality and embodied cognition as claimed in claim 1, characterized in that: The steps include: S1, scene selection: when the user enters the system, he / she selects the English learning scene according to the device and the number of users, and determines the single-user mode or multi-user mode; S2, interactive learning: In single-player mode, users learn and interact with interactive objects in the scene by reading or listening to English instructions according to task requirements, until all task behaviors meet the requirements or the countdown ends; in multiplayer mode, multiple users work together to complete the task requirements through English dialogue until all tasks meet the requirements or the countdown ends; During the interactive learning process, the system automatically records the interactive process data of each user according to the user ID and transmits the data to the system data processing module; S3, learning test: After completing all tasks in the current scene, the user enters the learning test phase, and the test result data is also transmitted to the system data processing module to form a visual result; S4, data analysis: the system receives and calculates the data of step S2 and step S3, and makes a judgment and analysis on the English mastery level according to the calculation results, forms an evaluation result and stores it in the historical data record, and issues the content adjustment instruction for the next scene based on the forgetting curve theory, and continues to repeat steps S1-S3; S5, manual intervention: The instructor analyzes the user's mastery of the English learning content based on the data and visualization results of step S3, and manually intervenes in the user's English learning plan by modifying the English learning content in the learning database to provide better learning suggestions.

8. The method for using the English learning system based on virtual reality and embodied cognition as claimed in claim 7, characterized in that: In the scene selection of step S1, if it is not the first time to use the system, the system modifies the content of the scene and arranges new tasks based on the historical retained learning evaluation results or the evaluation of the previous scene and the latest English learning database.

Citation Information

Cited By

  • Immersive virtual reality interaction method and device, electronic equipment and medium

    CN120215700A