Methods and Systems for Training English Conversation Skills Based on Virtual Reality Scenarios

Abstract

This invention provides a method and system for training English conversation skills based on virtual reality scenarios. Unlike existing technologies that only provide English reading aloud training, this method analyzes the student's English speaking speed and vocabulary level to select English conversation practice texts that match the student's speaking speed and vocabulary comprehension ability. Furthermore, it allows for virtual scene English conversation simulation practice with virtual objects within a virtual reality environment. During practice, the method provides real-time feedback on the student's dynamic changes in speaking speed and any abnormalities, thus offering a training scenario for adjusting English conversation speaking speed and automatically reminding students to adjust their speaking speed at any time during training. This significantly improves the experience and reliability of English conversation skills training.

Description

Technical Field

[0001] This invention relates to the technical field of intelligent teaching, and in particular to a method and system for training English conversation skills based on virtual reality scenarios. Background Technology

[0002] In learning English, a student's English conversational ability directly determines their practical English skills. Current technology typically trains students' English conversational skills through reading and reciting English articles. However, this method can only train the accuracy of English word pronunciation to a certain extent; it cannot interactively train students' English conversational skills, nor can it create virtual scenario-based English conversation simulations that match the student's own speaking speed. This severely reduces the interactivity of English conversational skills training and fails to effectively and clearly remind students of their own speaking speed, thus hindering students from specifically improving and adjusting their English conversational pace. Summary of the Invention

[0003] To address the shortcomings of existing technologies, this invention provides a method and system for training English dialogue skills based on virtual reality scenarios. The method involves collecting audio information from students' actual English recitation; extracting the corresponding English recitation audio components from the audio information; analyzing the English recitation audio components to determine the student's actual English speaking speed and vocabulary level; selecting matching English dialogue practice texts from a pre-set virtual scenario English dialogue simulation practice material library based on the student's vocabulary level; determining the speaking speed and length of the English dialogue practice text for a virtual object to read based on the actual English speaking speed, thereby achieving virtual scenario English dialogue simulation practice between the student and the virtual object; and providing feedback to the student during the virtual scenario English dialogue simulation practice to match their speaking speed. The system provides dynamic prompts and sends corresponding warning voice messages to students when their speaking speed is abnormal. This virtual reality-based English conversation skills training method and system differs from existing technologies that only provide English reading practice. It analyzes students' English speaking speed and vocabulary, selecting English conversation practice texts that match their speaking speed and vocabulary comprehension abilities. Furthermore, it simulates virtual English conversations with students in a virtual reality environment, providing real-time prompts on dynamic changes and abnormalities in students' speaking speed. This offers students a training scenario for adjusting their English speaking speed and automatically reminds them to adjust their speaking speed at any time during training, significantly improving the experience and reliability of English conversation skills training.

[0004] This invention provides a method for training English conversation skills based on virtual reality scenarios, characterized by comprising the following steps:

[0005] Step S1: Collect the audio information of the student's actual English recitation; extract the corresponding English recitation audio components from the audio information; analyze the English recitation audio components to determine the student's actual English speaking speed and the student's own English vocabulary information.

[0006] Step S2: Based on the student's own English vocabulary information, select a matching English dialogue practice text from the preset virtual scene English dialogue simulation practice material library; and based on the actual English dialogue speaking speed, determine the speaking speed and length of the English dialogue practice text for the virtual object to read, thereby realizing virtual scene English dialogue simulation practice between the student and the virtual object.

[0007] Step S3: During the virtual English dialogue simulation practice, provide students with dynamic prompts that match their speaking speed; and send corresponding warning voice messages to students when their speaking speed is abnormal.

[0008] Furthermore, in step S1, the following steps are taken: collecting the student's actual English recitation audio information; extracting the corresponding English recitation audio components from the audio information; and analyzing the English recitation audio components to determine the student's actual English speaking speed and their own English vocabulary information.

[0009] Step S101: Collect the voice information of the student's actual English recitation, and perform Kalman filtering on the voice information to remove background noise from the voice information;

[0010] Step S102: Based on the student's own voiceprint characteristics, extract the voice components that are consistent with the student's voiceprint from the voice information, and use them as the corresponding English recitation components for the student; and perform semantic recognition on the English recitation voice components to determine the total number of English words contained in the English recitation voice components, and use them as the student's own English vocabulary information.

[0011] Step S103: Using the following formula (1), analyze the phonetic components of the English recitation to determine the actual English speaking speed of the student.

[0012]

[0013] In the above formula (1), V a t represents the actual English speaking speed of the a-th student. a,i Let t represent the initial moment when the a-th student speaks the i-th word in the a-th student's English recitation. a,i+1This represents the initial moment when the a-th student says the (i+1)th word in the English recitation of the a-th student, where the i-th word and the (i+1)-th word are two adjacent words. a This represents the number of words contained in the English recitation of the a-th student;

[0014] Furthermore, in step S2 above, based on the student's own English vocabulary information, a matching English dialogue practice text is selected from a preset virtual scenario English dialogue simulation practice material library; and based on the actual English dialogue speaking speed, the speaking speed and length of the English dialogue practice text for the virtual object to read are determined, thereby realizing the virtual scenario English dialogue simulation practice between the student and the virtual object, specifically including:

[0015] Step S201: Based on the student's own English vocabulary information, select an English dialogue practice text from the preset virtual scenario English dialogue simulation practice material library that contains the most English words mastered by the student.

[0016] Step S202: Using the formula (2) below and in conjunction with the actual English dialogue speaking speed, determine the speaking speed at which the virtual object reads the English dialogue practice text.

[0017]

[0018] In the above formula (2), This represents the speaking speed of the virtual object during a simulated English dialogue practice with the a-th student, where m represents the number of students. This indicates taking V1, V2...V a The minimum value in, This indicates taking V1, V2...V a The maximum value in, V max Indicates the maximum speaking speed of the virtual object;

[0019] Step S203: Using the following formula (3), determine the length L of the English dialogue practice text for the virtual object to read. a ,

[0020]

[0021] In the above formula (3), T represents the total duration for the virtual object to read the English dialogue practice text;

[0022] And extract a portion of the selected English dialogue practice text that is the same length as the stated length L. a Consistent text fragments;

[0023] The virtual object is then instructed to read the selected text segment at a predetermined speaking speed, thereby enabling students to practice simulated English dialogues in a virtual setting with the virtual object.

[0024] Furthermore, in step S3 above, during the virtual English dialogue simulation practice, dynamic prompts are provided to students that match their speaking speed; and when a student's speaking speed is abnormal, a corresponding warning voice message is sent to the student, specifically including:

[0025] Step S301: During the virtual scene English dialogue simulation practice, the pressure of the water column forming device is controlled according to the student's speaking speed to generate a water column with dynamically changing height, which serves as the dynamic prompt; the pressure of the water column is determined using the following formula (4).

[0026]

[0027] In the above formula (4), P a The pressure at which the water column is formed by the water column forming device is controlled according to the speaking speed of the a-th student, where ρ represents the density of water, and h represents the pressure. max The maximum height of the water column formed by the water column forming device is represented by g, where g represents the acceleration due to gravity; and when the pressure P a The larger the pressure P, the higher the water column, meaning the faster the a-th student speaks; conversely, the lower the pressure P, the faster the water column. a The smaller the value, the smaller the height of the water column, meaning the slower the speaking speed of the a-th student.

[0028] Step S302: Compare the student's speaking speed with a preset speaking speed threshold. If the student's speaking speed exceeds the preset speaking speed threshold, send a warning voice message to the student about speaking too fast.

[0029] This invention also provides an English conversation skills training system based on virtual reality scenarios, characterized in that it includes a speech acquisition and analysis module, a virtual scenario English conversation simulation practice construction module, a dynamic speech rate prompt module, and a speech rate abnormality warning module; wherein,

[0030] The speech acquisition and analysis module is used to acquire speech information of students actually reciting English; extract the corresponding English recitation speech components from the speech information; and analyze the English recitation speech components to determine the actual English dialogue speed of the students and their own English vocabulary information.

[0031] The virtual scene English dialogue simulation practice construction module is used to select matching English dialogue practice texts from a preset virtual scene English dialogue simulation practice material library based on the student's own English vocabulary information; and to determine the speaking speed and length of the English dialogue practice texts for the virtual object to read based on the actual English dialogue speaking speed, thereby realizing virtual scene English dialogue simulation practice between the student and the virtual object.

[0032] The dynamic speech rate prompt module is used to provide students with dynamic prompts that match their speech rate during virtual English dialogue simulation practice.

[0033] The abnormal speech rate voice warning module is used to send a corresponding warning voice message to the student when the student's speech rate is abnormal.

[0034] Furthermore, the speech acquisition and analysis module is used to acquire speech information of students actually reciting English; extract the corresponding English recitation speech components from the speech information; and analyze the English recitation speech components to determine the actual English speaking speed and the student's own English vocabulary information, specifically including:

[0035] The audio information of students reciting English is collected, and the audio information is processed by Kalman filtering to remove background noise from the audio information.

[0036] Based on the student's own voiceprint characteristics, the speech components that are consistent with the student's voiceprint are extracted from the speech information, and these are used as the corresponding English recitation components for the student; and semantic recognition is performed on the English recitation speech components to determine the total number of English words contained in the English recitation speech components, which are used as the student's own English vocabulary information.

[0037] Using the formula (1) below, the phonetic components of the English recitation are analyzed to determine the actual English speaking speed of the student.

[0038]

[0039] In the above formula (1), V a t represents the actual English speaking speed of the a-th student. a,i Let t represent the initial moment when the a-th student speaks the i-th word in the a-th student's English recitation. a,i+1 This represents the initial moment when the a-th student says the (i+1)th word in the English recitation of the a-th student, where the i-th word and the (i+1)-th word are two adjacent words. a This represents the number of words contained in the English recitation of the a-th student;

[0040] Furthermore, the virtual scenario English dialogue simulation practice construction module is used to select matching English dialogue practice texts from a preset virtual scenario English dialogue simulation practice material library based on the student's own English vocabulary information; and to determine the speaking speed and length of the English dialogue practice text for the virtual object to read based on the actual English dialogue speaking speed, thereby realizing the virtual scenario English dialogue simulation practice between the student and the virtual object, specifically including:

[0041] Based on the students' own English vocabulary information, select an English dialogue practice text containing the most English words mastered by the students from the preset virtual scenario English dialogue simulation practice material library;

[0042] Using formula (2) below, and in conjunction with the actual English dialogue speaking speed, determine the speaking speed at which the virtual object reads the English dialogue practice text.

[0043]

[0044] In the above formula (2), This represents the speaking speed of the virtual object during a simulated English dialogue practice with the a-th student, where m represents the number of students. This indicates taking V1, V2...V a The minimum value in, This indicates taking V1, V2...V a The maximum value in, V max This represents the maximum speaking speed of the virtual object and can be a preset value.

[0045] Using the formula (3) below, determine the length L of the English dialogue practice text that the virtual object reads. a ,

[0046]

[0047] In the above formula (3), T represents the total duration for the virtual object to read the English dialogue practice text;

[0048] And extract a portion of the selected English dialogue practice text that is the same length as the stated length L. a Consistent text fragments;

[0049] The virtual object is then instructed to read the selected text segment at a predetermined speaking speed, thereby enabling students to practice simulated English dialogues in a virtual setting with the virtual object.

[0050] Furthermore, the dynamic speech rate prompting module is used to provide students with dynamic prompts that match their speech rate during virtual English dialogue simulation practice. Specifically, this includes:

[0051] During the virtual English dialogue simulation practice, the pressure of the water column forming device is controlled according to the student's speaking speed to generate a water column with dynamically changing height, which serves as the dynamic prompt; the pressure of the water column is determined using the following formula (4).

[0052]

[0053] In the above formula (4), P a The pressure at which the water column is formed by the water column forming device is controlled according to the speaking speed of the a-th student, where ρ represents the density of water, and h represents the pressure. max The maximum height of the water column formed by the water column forming device is represented by g, where g represents the acceleration due to gravity; and when the pressure P a The larger the pressure P, the higher the water column, meaning the faster the a-th student speaks; conversely, the lower the pressure P, the faster the water column. a The smaller the value, the smaller the height of the water column, meaning the slower the speaking speed of the a-th student.

[0054] as well as,

[0055] The abnormal speech rate warning module is used to send corresponding warning voice messages to students when their speech rate is abnormal. Specifically, it includes:

[0056] The student's speaking speed is compared with a preset speaking speed threshold. If the student's speaking speed exceeds the preset speaking speed threshold, a warning voice message about speaking too fast is sent to the student.

[0057] Compared to existing technologies, this method and system for training English dialogue skills based on virtual reality scenarios collects students' actual English recitation audio information; extracts the corresponding English recitation audio components from the audio information; analyzes the English recitation audio components to determine the actual English dialogue speed and the student's own English vocabulary information; selects matching English dialogue practice texts from a pre-set virtual scenario English dialogue simulation practice material library based on the student's own English vocabulary information; and determines the speaking speed and length of the English dialogue practice text for the virtual object to read based on the actual English dialogue speed, thereby realizing virtual scenario English dialogue simulation practice between the student and the virtual object; during the virtual scenario English dialogue simulation practice, provides students with dynamic prompts consistent with their speaking speed. Furthermore, when a student's speaking speed is abnormal, a corresponding warning voice message is sent to the student. It is evident that this virtual reality-based English dialogue skills training method and system differs from existing technologies that only provide English repetition training. It can analyze the student's English speaking speed and vocabulary level to select English dialogue practice texts that match the student's speaking speed and vocabulary comprehension ability. In a virtual reality scenario, the system simulates English dialogue practice with the student through virtual objects. Simultaneously, it can provide real-time prompts regarding the student's dynamic changes in speaking speed and any abnormalities during practice. This provides students with a training scenario for adjusting their English speaking speed and automatically reminds them to adjust their speaking speed at any time during training, greatly improving the experience and reliability of English dialogue skills training.

[0058] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.

[0059] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0060] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0061] Figure 1 This is a flowchart illustrating the English conversation skills training method based on a virtual reality scenario provided by the present invention.

[0062] Figure 2This is a schematic diagram of the structure of the English conversation skills training system based on virtual reality scenarios provided by the present invention. Detailed Implementation

[0063] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0064] See Figure 1 This is a flowchart illustrating the English conversation skills training method based on a virtual reality scenario provided in an embodiment of the present invention. The English conversation skills training method based on a virtual reality scenario includes the following steps:

[0065] Step S1: Collect the audio information of the student's actual English recitation; extract the corresponding English recitation audio components from the audio information; analyze the English recitation audio components to determine the student's actual English speaking speed and the student's own English vocabulary information.

[0066] Step S2: Based on the student's own English vocabulary information, select a matching English dialogue practice text from the preset virtual scene English dialogue simulation practice material library; and based on the actual English dialogue speaking speed, determine the speaking speed and length of the English dialogue practice text for the virtual object to read, thereby realizing the virtual scene English dialogue simulation practice between the student and the virtual object.

[0067] Step S3: During the virtual English dialogue simulation practice, provide students with dynamic prompts that match their speaking speed; and send corresponding warning voice messages to students when their speaking speed is abnormal.

[0068] The beneficial effects of the above technical solution are as follows: This English dialogue skills training method based on virtual reality scenarios differs from existing technologies that only provide English reading aloud training. It can analyze the student's English dialogue speaking speed and vocabulary size, thereby selecting English dialogue practice texts that match the student's speaking speed and vocabulary comprehension ability. Furthermore, it allows for virtual scene English dialogue simulation practice with the student through virtual objects in a virtual reality scenario. At the same time, it can also provide real-time prompts on the student's own dynamic changes in speaking speed and abnormal speaking speed during the practice process. This provides students with a training scenario for adjusting their English dialogue speaking speed and can automatically remind students to adjust their speaking speed at any time during the training process, greatly improving the experience and reliability of English dialogue skills training for students.

[0069] Preferably, in step S1, the following steps are taken: collecting the student's actual English recitation audio information; extracting the corresponding English recitation audio components from the audio information; and analyzing the English recitation audio components to determine the student's actual English speaking speed and their own English vocabulary information.

[0070] Step S101: Collect the voice information of the student's actual English recitation, and perform Kalman filtering on the voice information to remove background noise from the voice information;

[0071] Step S102: Based on the student's own voiceprint characteristics, extract the voice components that are consistent with the student's voiceprint from the voice information, and use them as the corresponding English recitation components for the student; and perform semantic recognition on the English recitation voice components to determine the total number of English words contained in the English recitation voice components, and use them as the student's own English vocabulary information.

[0072] Step S103: Using the formula (1) below, analyze the phonetic components of the English recitation to determine the actual English speaking speed of the student.

[0073]

[0074] In the above formula (1), V a t represents the actual English speaking speed of the a-th student. a,i Let t represent the initial moment when the a-th student speaks the i-th word in the a-th student's English recitation. a,i+1 This represents the initial moment when the a-th student says the (i+1)th word in the English recitation of the a-th student, where the i-th word and the (i+1)-th word are two adjacent words. a This indicates the number of words contained in the English recitation of student a.

[0075] The beneficial effects of the above technical solution are as follows: Students will have their own habitual speaking speed in actual English recitation. This speaking speed refers to the student's speaking speed when reciting, not when talking to others. This may result in the speaking speed being too slow or too fast and unsuitable for English conversation. In this case, it is necessary to train students to purposefully adjust their speaking speed in conversational situations.

[0076] By collecting students' actual English recitation audio information and analyzing it through voiceprint feature extraction and semantic recognition, the student's unique audio components and the total number of English words mastered are extracted, thus quickly and accurately determining the student's English vocabulary. The above formula (1) is then used to analyze the student's audio components, allowing for a step-by-step analysis of the time taken for each word spoken, thereby calculating the student's actual English speaking speed. Since formula (1) analyzes the situation of students reading a large number of English words, compared to analyzing the speaking speed obtained from reading a few scattered English words, the speaking speed determined by formula (1) more accurately reflects the student's actual speaking speed and effectively reduces the error in determining the speaking speed.

[0077] Preferably, in step S2 above, based on the student's own English vocabulary information, a matching English dialogue practice text is selected from a preset virtual scenario English dialogue simulation practice material library; and based on the actual English dialogue speaking speed, the speaking speed and length of the English dialogue practice text for the virtual object to read are determined, thereby realizing the virtual scenario English dialogue simulation practice between the student and the virtual object, specifically including:

[0078] Step S201: Based on the student's own English vocabulary information, select an English dialogue practice text from the preset virtual scenario English dialogue simulation practice material library that contains the most English words mastered by the student.

[0079] Step S202: Using the formula (2) below and in conjunction with the actual English dialogue speaking speed, determine the speaking speed at which the virtual object reads the English dialogue practice text.

[0080]

[0081] In the above formula (2), This represents the speaking speed of the virtual object during a simulated English dialogue practice with the a-th student, where m represents the number of students. This indicates taking V1, V2...V a The minimum value in, This indicates taking V1, V2...V a The maximum value in, V max Indicates the maximum speaking speed of the virtual object;

[0082] Step S203: Using the following formula (3), determine the length L of the English dialogue practice text for the virtual object to read. a ,

[0083]

[0084] In the above formula (3), T represents the total duration for the virtual object to read the English dialogue practice text;

[0085] And extract a portion of length L from the selected English dialogue practice text. a Consistent text fragments;

[0086] The virtual object is then instructed to read the selected text segment at a predetermined speed, thereby enabling students to practice simulated English dialogues in a virtual setting with the virtual object.

[0087] The beneficial effects of the above technical solution are as follows: Since English dialogue training involves at least an English dialogue between the student and a virtual object, the virtual object can be, but is not limited to, a virtual character constructed in a virtual reality device (such as an AR device), and the virtual character can interact with the student in corresponding English dialogue. In order to maximize the improvement of the student's English vocabulary conversational skills during the English dialogue connection process, based on the student's own English vocabulary information, an English dialogue practice text containing the most English words mastered by the student is selected from the preset virtual scene English dialogue simulation practice material library. This can increase the frequency of the student's use of different English words during the dialogue practice. In addition, using the above formula (2), the dialogue speed of the virtual object can be set to match the student's speaking speed. This can ensure that the student will not be unable to accurately understand the meaning of the virtual object's English dialogue during the English dialogue training process because the virtual object's speaking speed is too slow or too fast. And using the above formula (3), the length of the practice text corresponding to the virtual object in the English dialogue training process can greatly improve the experience of the practice while ensuring that the student has sufficient English dialogue practice, thereby avoiding over-practice.

[0088] Preferably, in step S3 above, during the virtual English dialogue simulation practice, providing students with dynamic prompts that match their speaking speed; and sending corresponding warning voice messages when a student's speaking speed is abnormal, specifically includes:

[0089] Step S301: During the virtual scene English dialogue simulation practice, the pressure of the water column forming device is controlled according to the student's speaking speed to generate a water column with dynamically changing height, which serves as a dynamic prompt; the pressure of the water column is determined using the following formula (4).

[0090]

[0091] In the above formula (4), P a The pressure at which the water column is formed by the water column forming device is controlled according to the speaking speed of the a-th student, where ρ represents the density of water, and h represents the pressure. maxThe maximum height of the water column formed by the water column forming device is represented by g, where g represents the acceleration due to gravity; and when the pressure P a The larger the pressure P, the higher the water column, meaning the faster the a-th student speaks; conversely, the lower the pressure P, the faster the water column. a The smaller the value, the smaller the height of the water column, meaning the slower the speaking speed of the a-th student.

[0092] Step S302: Compare the student's speaking speed with a preset speaking speed threshold. If the student's speaking speed exceeds the preset speaking speed threshold, send a warning voice message to the student about speaking too fast.

[0093] The beneficial effects of the above technical solution are as follows: A water column is formed in real time using a water column forming device (such as a water jet gun), and the height of this water column is positively correlated with the student's speaking speed. This allows students to intuitively determine their real-time speaking speed simply by observing the height of the water column. Compared to displaying a speaking speed value, this method allows students to understand and respond to their real-time speaking speed more quickly, facilitating adaptive adjustments. Furthermore, when a student's speaking speed exceeds a preset threshold, a warning voice message about excessive speaking speed is sent to the student. This provides timely and significant reminders of when the student's speaking speed is too fast, enabling timely adjustments.

[0094] See Figure 2 This is a flowchart illustrating an English conversation skills training system based on a virtual reality scenario provided in an embodiment of the present invention. The system includes a voice acquisition and analysis module, a virtual scenario English conversation simulation practice construction module, a dynamic speech rate prompt module, and a speech rate abnormality warning module; wherein,

[0095] The speech acquisition and analysis module is used to collect speech information of students actually reciting English; extract the corresponding English recitation speech components from the speech information; and analyze the English recitation speech components to determine the actual English conversation speed of the students and their own English vocabulary information.

[0096] The virtual scene English dialogue simulation practice module is used to select matching English dialogue practice texts from a preset virtual scene English dialogue simulation practice material library based on the student's own English vocabulary information; and determine the speaking speed and length of the English dialogue practice text for the virtual object to read based on the actual English dialogue speaking speed, thereby realizing virtual scene English dialogue simulation practice between the student and the virtual object.

[0097] This dynamic speech rate prompt module is used to provide students with dynamic prompts that match their speech rate during virtual English dialogue simulation practice.

[0098] This abnormal speech rate voice warning module is used to send corresponding warning voice messages to students when their speech rate is abnormal.

[0099] The beneficial effects of the above technical solution are as follows: This English dialogue skills training system based on virtual reality scenarios differs from existing technologies that only provide English reading practice. It can analyze the student's English dialogue speed and vocabulary, thereby selecting English dialogue practice texts that match the student's speaking speed and vocabulary comprehension ability. Furthermore, it allows the student to engage in virtual dialogue simulation practice in a virtual reality scenario through virtual objects. It can also provide real-time prompts on the student's dynamic changes in speaking speed and any abnormalities during the practice process. This provides students with training scenarios for adjusting their English dialogue speaking speed and can automatically remind them to adjust their speaking speed at any time during training, greatly improving the experience and reliability of English dialogue skills training.

[0100] Preferably, the speech acquisition and analysis module is used to acquire speech information of students actually reciting English; extract the corresponding English recitation speech components from the speech information; and analyze the English recitation speech components to determine the actual English speaking speed and the student's own English vocabulary information, specifically including:

[0101] The audio information of students reciting English is collected and then processed by Kalman filtering to remove background noise from the audio information.

[0102] Based on the student's own voiceprint characteristics, the speech components that are consistent with the student's voiceprint are extracted from the speech information, and these are used as the corresponding English recitation components for the student; then, semantic recognition is performed on the English recitation speech components to determine the total number of English words contained in the English recitation speech components, which are used as the student's own English vocabulary information.

[0103] Using the formula (1) below, the phonetic components of the English recitation are analyzed to determine the actual English speaking speed of the student.

[0104]

[0105] In the above formula (1), V a t represents the actual English speaking speed of the a-th student. a,i Let t represent the initial moment when the a-th student speaks the i-th word in the a-th student's English recitation. a,i+ 1 represents the initial moment when the a-th student says the (i+1)th word in the a-th student's English recitation, where the i-th word and the (i+1)-th word are two adjacent words, and n a This indicates the number of words contained in the English recitation of student a.

[0106] The beneficial effects of the above technical solution are as follows: Students will have their own habitual speaking speed in actual English recitation. This speaking speed refers to the student's speaking speed when reciting, not when talking to others. This may result in the speaking speed being too slow or too fast and unsuitable for English conversation. In this case, it is necessary to train students to purposefully adjust their speaking speed in conversational situations.

[0107] By collecting students' actual English recitation audio information and analyzing it through voiceprint feature extraction and semantic recognition, the student's unique audio components and the total number of English words mastered are extracted, thus quickly and accurately determining the student's English vocabulary. The above formula (1) is then used to analyze the student's audio components, allowing for a step-by-step analysis of the time taken for each word spoken, thereby calculating the student's actual English speaking speed. Since formula (1) analyzes the situation of students reading a large number of English words, compared to analyzing the speaking speed obtained from reading a few scattered English words, the speaking speed determined by formula (1) more accurately reflects the student's actual speaking speed and effectively reduces the error in determining the speaking speed.

[0108] Preferably, the virtual scene English dialogue simulation practice construction module is used to select matching English dialogue practice texts from a preset virtual scene English dialogue simulation practice material library based on the student's own English vocabulary information; and to determine the speaking speed and length of the English dialogue practice text for the virtual object to read based on the actual English dialogue speaking speed, thereby realizing the virtual scene English dialogue simulation practice between the student and the virtual object, specifically including:

[0109] Based on the students' own English vocabulary information, select an English dialogue practice text containing the most English words mastered by the students from the preset virtual scenario English dialogue simulation practice material library;

[0110] Using formula (2) below, and in conjunction with the actual English conversation speed, determine the speaking speed at which the virtual object reads the English dialogue practice text.

[0111]

[0112] In the above formula (2), This represents the speaking speed of the virtual object during a simulated English dialogue practice with the a-th student, where m represents the number of students. This indicates taking V1, V2...V a The minimum value in, This indicates taking V1, V2...V a The maximum value in, Vmax Indicates the maximum speaking speed of the virtual object;

[0113] Using the formula (3) below, determine the length L of the English dialogue practice text for the virtual object to read. a ,

[0114]

[0115] In the above formula (3), T represents the total duration for the virtual object to read the English dialogue practice text;

[0116] And extract a portion of length L from the selected English dialogue practice text. a Consistent text fragments;

[0117] The virtual object is then instructed to read the selected text segment at a predetermined speed, thereby enabling students to practice simulated English dialogues in a virtual setting with the virtual object.

[0118] The beneficial effects of the above technical solution are as follows: Since English dialogue training involves at least an English dialogue between the student and a virtual object, the virtual object can be, but is not limited to, a virtual character constructed in a virtual reality device (such as an AR device), and the virtual character can interact with the student in corresponding English dialogue. In order to maximize the improvement of the student's English vocabulary conversational skills during the English dialogue connection process, based on the student's own English vocabulary information, an English dialogue practice text containing the most English words mastered by the student is selected from the preset virtual scene English dialogue simulation practice material library. This can increase the frequency of the student's use of different English words during the dialogue practice. In addition, using the above formula (2), the dialogue speed of the virtual object can be set to match the student's speaking speed. This can ensure that the student will not be unable to accurately understand the meaning of the virtual object's English dialogue during the English dialogue training process because the virtual object's speaking speed is too slow or too fast. And using the above formula (3), the length of the practice text corresponding to the virtual object in the English dialogue training process can greatly improve the experience of the practice while ensuring that the student has sufficient English dialogue practice, thereby avoiding over-practice.

[0119] Preferably, the dynamic speech rate prompting module is used to provide students with dynamic prompts that match their speech rate during virtual English dialogue simulation practice. Specifically, this includes:

[0120] In the virtual English dialogue simulation practice, the pressure of the water column forming device is controlled according to the student's speaking speed to generate a water column with dynamically changing height, which serves as a dynamic prompt; the pressure of the water column is determined using the following formula (4).

[0121]

[0122] In the above formula (4), P a The pressure at which the water column is formed by the water column forming device is controlled according to the speaking speed of the a-th student, where ρ represents the density of water, and h represents the pressure. max The maximum height of the water column formed by the water column forming device is represented by g, where g represents the acceleration due to gravity; and when the pressure P a The larger the pressure P, the higher the water column, meaning the faster the a-th student speaks; conversely, the lower the pressure P, the faster the water column. a The smaller the value, the smaller the height of the water column, meaning the slower the speaking speed of the a-th student.

[0123] as well as,

[0124] This abnormal speech rate voice warning module is used to send corresponding warning voice messages to students when their speech rate is abnormal. Specifically, these messages include:

[0125] The system compares the student's speaking speed with a preset speaking speed threshold. If the student's speaking speed exceeds the preset threshold, a warning voice message about speaking too fast is sent to the student.

[0126] The beneficial effects of the above technical solution are as follows: A water column is formed in real time using a water column forming device (such as a water jet gun), and the height of this water column is positively correlated with the student's speaking speed. This allows students to intuitively determine their real-time speaking speed simply by observing the height of the water column. Compared to displaying a speaking speed value, this method allows students to understand and respond to their real-time speaking speed more quickly, facilitating adaptive adjustments. Furthermore, when a student's speaking speed exceeds a preset threshold, a warning voice message about excessive speaking speed is sent to the student. This provides timely and significant reminders of when the student's speaking speed is too fast, enabling timely adjustments.

[0127] As can be seen from the above embodiments, this method and system for training English conversation skills based on virtual reality scenarios differs from existing technologies that only provide English reading aloud training. It can analyze the student's English conversation speed and vocabulary level to select English conversation practice texts that match the student's speaking speed and vocabulary comprehension ability. Furthermore, it allows for virtual scene English conversation simulation practice with the student through virtual objects in a virtual reality scenario. It can also provide real-time prompts on the student's dynamic changes in speaking speed and any abnormalities during the practice process. This provides students with a training scenario for adjusting their English conversation speed and can automatically remind them to adjust their speaking speed at any time during the training process, greatly improving the experience and reliability of English conversation skills training.

[0128] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A method for training English conversation skills based on virtual reality scenarios, characterized in that, It includes the following steps: Step S1: Collect the audio information of the student's actual English recitation; extract the corresponding English recitation audio components from the audio information; analyze the English recitation audio components to determine the student's actual English speaking speed and the student's own English vocabulary information. Step S2: Based on the student's own English vocabulary information, select a matching English dialogue practice text from the preset virtual scene English dialogue simulation practice material library; and based on the actual English dialogue speaking speed, determine the speaking speed and length of the English dialogue practice text for the virtual object to read, thereby realizing virtual scene English dialogue simulation practice between the student and the virtual object. Step S3: During the virtual English dialogue simulation practice, provide students with dynamic prompts that match their speaking speed. And when a student's speaking speed is abnormal, a corresponding warning voice message will be sent to the student; Specifically, in step S1, the following steps are taken: collecting the student's actual English recitation audio information; extracting the corresponding English recitation audio components from the audio information; and analyzing the English recitation audio components to determine the student's actual English speaking speed and their English vocabulary. Step S101: Collect the voice information of the student's actual English recitation, and perform Kalman filtering on the voice information to remove background noise from the voice information; Step S102: Based on the student's own voiceprint characteristics, extract the voice components that are consistent with the student's voiceprint from the voice information, and use them as the corresponding English recitation components for the student; and perform semantic recognition on the English recitation voice components to determine the total number of English words contained in the English recitation voice components, and use them as the student's own English vocabulary information. Step S103: Using the formula (1) below, analyze the phonetic components of the English recitation to determine the actual English speaking speed of the student. （1） In the above formula (1), This indicates the actual speaking speed of the a-th student in English. This indicates the initial moment when the a-th student speaks the i-th word in the a-th student's English recitation. This represents the initial moment when the a-th student says the (i+1)th word in the English recitation of the a-th student, where the i-th word and the (i+1)-th word are two adjacent words. This represents the number of words contained in the English recitation of the a-th student; In step S2 above, based on the student's English vocabulary, a matching English dialogue practice text is selected from a preset virtual scenario English dialogue simulation practice material library; and based on the actual English dialogue speaking speed, the speaking speed and length of the English dialogue practice text for the virtual object to read are determined, thereby realizing the virtual scenario English dialogue simulation practice between the student and the virtual object. Specifically, this includes: Step S201: Based on the student's own English vocabulary information, select an English dialogue practice text from the preset virtual scenario English dialogue simulation practice material library that contains the most English words mastered by the student. Step S202: Using the formula (2) below and in conjunction with the actual English dialogue speaking speed, determine the speaking speed at which the virtual object reads the English dialogue practice text. （2） In the above formula (2), This represents the speaking speed of the virtual object during a simulated English dialogue practice with the a-th student, where m represents the number of students. This indicates taking V1, V2...V a The minimum value in, This indicates taking V1, V2...V a The maximum value in, Indicates the maximum speaking speed of the virtual object; Step S203: Using the following formula (3), determine the length of the English dialogue practice text for the virtual object to read. , （3） In the above formula (3), T represents the total duration for the virtual object to read the English dialogue practice text; And extract a portion of the selected English dialogue practice text that is the length of the passage. Consistent text fragments; The virtual object is then instructed to read the selected text segment at a predetermined speaking speed, thereby enabling students to practice simulated English dialogues in a virtual setting with the virtual object.

2. The English conversation skills training method based on virtual reality scenarios as described in claim 1, characterized in that: In step S3 above, during the virtual English dialogue simulation practice, dynamic prompts are given to students that match their speaking speed. And when a student's speaking speed is abnormal, a corresponding warning voice message will be sent to the student, specifically including: Step S301: During the virtual scene English dialogue simulation practice, the pressure of the water column forming device is controlled according to the student's speaking speed to generate a water column with dynamically changing height, which serves as the dynamic prompt; the pressure of the water column is determined using the following formula (4). （4） In the above formula (4), This indicates that the pressure of the water column formed by the water column forming device is controlled according to the speaking speed of the a-th student. This indicates the density of water. The maximum height of the water column formed by the water column forming device is represented by g, where g represents the acceleration due to gravity; and when the pressure is... The greater the pressure, the higher the water column, meaning the faster the a-th student speaks; conversely, the lower the pressure... The smaller the value, the smaller the height of the water column, meaning the slower the speaking speed of the a-th student. Step S302: Compare the student's speaking speed with a preset speaking speed threshold. If the student's speaking speed exceeds the preset speaking speed threshold, send a warning voice message to the student about speaking too fast.

3. An English conversation skills training system based on virtual reality scenarios, characterized in that: It includes a voice acquisition and analysis module, a virtual scene English dialogue simulation practice construction module, a dynamic speech rate prompt module, and an abnormal speech rate voice warning module; among them, The speech acquisition and analysis module is used to acquire speech information of students actually reciting English; extract the corresponding English recitation speech components from the speech information; and analyze the English recitation speech components to determine the actual English dialogue speed of the students and their own English vocabulary information. The virtual scene English dialogue simulation practice construction module is used to select matching English dialogue practice texts from a preset virtual scene English dialogue simulation practice material library based on the student's own English vocabulary information; and to determine the speaking speed and length of the English dialogue practice texts for the virtual object to read based on the actual English dialogue speaking speed, thereby realizing virtual scene English dialogue simulation practice between the student and the virtual object. The dynamic speech rate prompt module is used to provide students with dynamic prompts that match their speech rate during virtual English dialogue simulation practice. The abnormal speech rate voice warning module is used to send a corresponding warning voice message to the student when the student's speech rate is abnormal. The speech acquisition and analysis module is used to acquire speech information of students actually reciting English; extract the corresponding English recitation speech components from the speech information; and analyze the English recitation speech components to determine the actual English speaking speed and the student's English vocabulary information, specifically including: The audio information of students reciting English is collected, and the audio information is processed by Kalman filtering to remove background noise from the audio information. Based on the student's own voiceprint characteristics, the speech components that are consistent with the student's voiceprint are extracted from the speech information, and these are used as the corresponding English recitation components for the student; and semantic recognition is performed on the English recitation speech components to determine the total number of English words contained in the English recitation speech components, which are used as the student's own English vocabulary information. Using the formula (1) below, the phonetic components of the English recitation are analyzed to determine the actual English speaking speed of the student. （1） In the above formula (1), This indicates the actual speaking speed of the a-th student in English. This indicates the initial moment when the a-th student speaks the i-th word in the a-th student's English recitation. This represents the initial moment when the a-th student says the (i+1)th word in the English recitation of the a-th student, where the i-th word and the (i+1)-th word are two adjacent words. This represents the number of words contained in the English recitation of the a-th student; The virtual scenario English dialogue simulation practice construction module is used to select matching English dialogue practice texts from a preset virtual scenario English dialogue simulation practice material library based on the student's own English vocabulary information; and to determine the speaking speed and length of the English dialogue practice text for the virtual object to read based on the actual English dialogue speaking speed, thereby realizing virtual scenario English dialogue simulation practice between the student and the virtual object, specifically including: Based on the students' own English vocabulary information, select an English dialogue practice text containing the most English words mastered by the students from the preset virtual scenario English dialogue simulation practice material library; Using the formula (2) below, and in conjunction with the actual English dialogue speaking speed, determine the speaking speed at which the virtual object reads the English dialogue practice text. （2） In the above formula (2), This represents the speaking speed of the virtual object during a simulated English dialogue practice with the a-th student, where m represents the number of students. This indicates taking V1, V2...V a The minimum value in, This indicates taking V1, V2...V a The maximum value in, Indicates the maximum speaking speed of the virtual object; Using the formula (3) below, determine the length of the English dialogue practice text for the virtual object to read. , （3） In the above formula (3), T represents the total duration for the virtual object to read the English dialogue practice text; And extract a portion of the selected English dialogue practice text that is the length of the passage. Consistent text fragments; The virtual object is then instructed to read the selected text segment at a predetermined speaking speed, thereby enabling students to practice simulated English dialogues in a virtual setting with the virtual object.

4. The English conversation skills training system based on virtual reality scenarios as described in claim 3, characterized in that: The dynamic speech rate prompt module is used to provide students with dynamic prompts that match their speech rate during virtual English dialogue simulation practice. Specifically, it includes: In the virtual English dialogue simulation practice, the pressure of the water column forming device is controlled according to the student's speaking speed to generate a water column with dynamically changing height, which serves as the dynamic prompt; the pressure of the water column is determined using the following formula (4). （4） In the above formula (4), This indicates that the pressure of the water column formed by the water column forming device is controlled according to the speaking speed of the a-th student. This indicates the density of water. The maximum height of the water column formed by the water column forming device is represented by g, where g represents the acceleration due to gravity; and when the pressure is... The greater the pressure, the higher the water column, meaning the faster the a-th student speaks; conversely, the lower the pressure... The smaller the value, the smaller the height of the water column, meaning the slower the speaking speed of the a-th student. as well as, The abnormal speech rate warning module is used to send corresponding warning voice messages to students when their speech rate is abnormal. Specifically, it includes: The student's speaking speed is compared with a preset speaking speed threshold. If the student's speaking speed exceeds the preset speaking speed threshold, a warning voice message about speaking too fast is sent to the student.

Images