Automatic control type practice system for English learning

Abstract

The invention discloses a self-control exercise system for English learning, which comprises a hardware system for processing information, the hardware system further comprises a central processing unit and a playing unit, an eyeball tracking unit is used for capturing eye action information of a user, and a projection unit is used for projecting learning content to a specified area. The projection area is divided into designated areas within a certain range according to user selection, and the playing unit and the projection unit are jointly used for reminding the user to learn autonomously. According to the automatic control type practice system for English learning, through active supervision and intelligent reminding modes, the automatic control performance of a user in the English learning and practice process or the practice process of other languages can be remarkably improved, meanwhile, the projection technology and the image acquisition technology are innovatively combined, and the practicability is high. According to the invention, the learning state of the user can be determined more pertinently and accurately, so that the self-control exercise of the user can be accurately assisted, and the learning efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of language learning systems, and in particular to an English practice system based on language recognition and artificial intelligence, and more specifically to a self-controlled practice system for English learning. Background Art

[0002] There is a big gap between English and Chinese or other languages ​​in terms of language differences, morphological changes and sentence structures. Therefore, users often need to pay a greater time cost when learning. In the prior art, there are technologies that use both hardware and software to assist in English learning, such as the English oral practice system with publication number CN111862698A. The English oral practice system includes a student terminal and a server; the student terminal includes a first processor, a display module, a voice training module and a storage module, and the display module, the voice training module and the storage module are all connected to the first processor; the server includes a second processor, a question bank module and a student learning record module; the first processor is wirelessly connected to the second processor through a data sharing module. When in use, students can conduct English oral voice training according to their own English learning situation, select different oral training contents from the question bank module in the server, and conduct training. At the same time, the server will record the students' learning status for teachers to view. Through such a setting, students can conduct English oral training independently, which improves students' enthusiasm for learning and helps improve their English learning level and ability;

[0003] Another example is an English teaching language learning system with publication number CN108682210A, which includes a teacher teaching terminal and a student learning terminal. Both the teacher teaching terminal and the student learning terminal have a wireless communication module for establishing communication, and the teacher and the student interact with each other through the wireless communication module; the teacher teaching terminal includes a teaching lesson plan module, a voice and video module, a data question bank module, and an assessment module; the student learning terminal includes a voice and video module, an exercise module, a voice listening and reading module, an interesting learning module, a student interactive practice module, a scene communication practice module, and a real dialogue practice module; the invention can conduct real-time teaching communication through the voice and video module, and can conduct remote learning communication at any time and place, and can greatly improve students' oral ability and learning efficiency by providing an interesting learning module, a student interactive practice module, a scene communication practice module, and a real dialogue practice module in the student learning terminal;

[0004] Although the above-mentioned existing technologies can enhance learning intensity and interest of English learning or oral ability practice through voice communication or supplementing information database, they lack attention to users themselves and cannot remind users to practice independently when users are distracted or out of the learning environment. Therefore, the actual use effect is not good. Summary of the invention

[0005] The purpose of the present invention is to provide a self-controlled practice system for English learning, so as to solve the problem that although the existing technology mentioned in the above background technology can enhance the learning intensity and interest of English learning or oral ability practice through voice communication or supplementary information library, it lacks attention to the user himself and cannot remind the user to practice independently when the user is distracted or out of the learning environment, so the actual use effect is not good.

[0006] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a self-controlled practice system for English learning, comprising a hardware system for processing information, wherein the hardware system also includes a central processing unit and a playback unit, the playback unit is used to play learning content, the hardware system in the practice system also includes an eye tracking unit and a projection unit, the eye tracking unit is used to capture the user's eye movement information, and the projection unit is used to project the learning content to a designated area, and the projection area is divided into designated areas within a certain range according to the user's selection, wherein the playback unit and the projection unit are used together to remind the user to study independently.

[0007] As a further feature, the hardware system further includes an image acquisition unit, a sound acquisition unit, a data transmission unit and a body capture unit, wherein the image acquisition unit is used to obtain graphic information of the user and the learning scene by taking photos or videos;

[0008] As a further feature, the sound collection unit is used to collect user voice and ambient sound, wherein the collected ambient sound is used to automatically adjust the output volume of the playback unit.

[0009] As a further feature, the data transmission unit is used for wireless transmission of user learning data, and the posture capture unit is used for capturing the user's body and facial expression data for analyzing the user's posture habits during learning.

[0010] As a further feature, the self-controlled practice system further comprises a software system supported by the hardware system and the algorithm, wherein the software system comprises a supervision module, a projection module, a training module and a correction module, and also comprises a synchronization module;

[0011] As a further step, the synchronization module is implemented by the data transmission unit and the central processing unit. The main function of the central processing unit is to schedule the storage information, transmit the data containing the learning progress, exercise or test results to the cloud and synchronize it to the user terminal, where the user terminal is an app or applet or web terminal;

[0012] As a further feature, the monitoring module is combined with the eye tracking unit to record when the user's eyes are directed towards the working area of ​​the non-projection module. If the time or cumulative number of times exceeds a threshold, a reminder is issued, and the current user status is determined in combination with the imaging unit and the body capture unit.

[0013] As a further feature, the projection module is implemented by a projection unit and an image acquisition unit, which also includes a projection learning module and a practice module, both of which respectively implement learning and practice functions through projection functions.

[0014] As a further step, the projection learning module uses software-level editing to form a projection area in a specified area. The implementation principle is that the image acquisition unit captures the video or freeze-frame of the practice space area, and then projects the specified lined or framed area through software-level editing, and then projects the content to be learned for users to practice reading and writing;

[0015] As a further feature, the editing at the software level is completed via a user terminal, which includes but is not limited to an app or mini-program or web terminal.

[0016] As a further step, the exercise module projects the exercise or test content to a designated area by utilizing the projection area, and the user directly performs the test / exercise in the projection area;

[0017] As a further step, the training module cooperates with the playback unit and the sound collection unit to perform intelligent question-and-answer exercises by collecting user voice information or writing operations in the projection area and through real-time interaction.

[0018] As a further example, the practice module includes a two-way dialogue interaction module and a voice and text interaction module, wherein the two-way dialogue interaction module is configured by the central processing unit according to the user's learning progress or the training stage actively selected by the user, the central processing unit calls the storage information or cloud information, sends the voice command to the playback unit, and the playback unit plays the machine-side dialogue content to the user, and after the user voice responds, the user voice information is converted into character data through the sound collection unit, and then processed by the central processing unit to make the playback unit respond to the specified voice or text content;

[0019] Furthermore, the voice and text interaction module is controlled by the central processing unit, which calls the stored information or cloud information and sends the voice command to the playback unit according to the user's learning progress or the training stage actively selected by the user. The playback unit or the projection unit plays the machine-side dialogue content to the user. The user then interacts in the form of written text in the projection area, and the central processing unit collects the text information through the imaging unit for further interaction.

[0020] As a further feature, the correction module includes a correction video module and a correction audio module, both of which perform intelligent correction on the practice or learning information from two levels: text information and voice information.

[0021] As a further step, the correction and image acquisition module is responsible for real-time or timed acquisition of the written content in the projection area by the image acquisition unit, and compares it with the content in the database. When the content in the area is fully or partially completed, the content at the writing place is highlighted, or the playback unit broadcasts sound or other marking methods for correction;

[0022] As a further step, the correction and sound collection module allows the user to practice or test by reciting aloud, and the sound collection unit collects the sound within a specified time period;

[0023] As a further step, after collecting the sound data, the central processing unit synchronously transliterates it into character units and projects it in the projection area, or converts the sound data into character data and compares it with the database, makes corrections, and projects the correction results in the projection area, or plays the correction results via the playback unit.

[0024] Compared with the prior art, the beneficial effects of the present invention are as follows: the self-controlled practice system for English learning can significantly improve the self-control of users in the process of learning and practicing English or other languages ​​through active supervision and intelligent reminders, and at the same time, the innovative combination of projection and image capture technology can make a more targeted and accurate judgment on the learning status of the user, thereby accurately assisting the user's self-controlled practice and improving learning efficiency;

[0025] 1. The design and use of eye tracking and posture capture units can more accurately capture the user's posture and eye movement information, and use the above information to collect and learn the user's morphological habits during the learning process, so as to better adapt to the user's learning habits and combine cloud data to give self-control practice suggestions in a targeted manner;

[0026] Furthermore, the use of the above technology can also warn and remind users of behaviors that may cause distraction or departure from the learning environment during the learning process, and help users to better self-control learning / practice by collecting and judging behavioral information in designated areas;

[0027] 2. The integrated setting of the projection module and the training module can, on the one hand, use the image acquisition unit to collect the user's learning environment, and accurately judge the user's learning environment through the projection module, so as to realize the user's visual learning and practice through the projection module, thereby increasing the learning and practice effect and improving the learning efficiency of different languages;

[0028] Furthermore, the use of the projection module can also be combined with the use of the image collection unit and the sound collection unit to recognize and analyze the user's written information and voice information, so as to use the above analysis data for interactive learning exercises such as recognition and dialogue, thereby making the user's learning efficiency higher and the auxiliary self-control effect better. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 It is a schematic diagram of the hardware system of the present invention;

[0030] Figure 2 It is a schematic diagram of the software system composition of the present invention;

[0031] Figure 3 It is a schematic diagram of the structure and functional distribution of the projection module of the present invention;

[0032] Figure 4 It is a schematic diagram of the composition and functional distribution of the correction module of the present invention. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0034] See also Figure 1-Figure 4 , the present invention provides the following technical solutions:

[0035] Hardware system: includes a hardware system for processing information, wherein the hardware system also includes a central processing unit and a playback unit, the playback unit is used to play learning content, the hardware system in the practice system also includes an eye tracking unit and a projection unit, the eye tracking unit is used to capture the user's eye movement information, and the projection unit is used to project the learning content to a designated area, and the projection area is divided into designated areas within a certain range according to user selection, wherein the playback unit and the projection unit are used together to remind the user to study independently, the hardware system also includes an imaging unit, a sound collection unit, a data transmission unit and a body capture unit, wherein the imaging unit is used to obtain graphic information of the user and the learning scene by taking photos or videos, and the sound collection unit is used to collect user voice and ambient sound, wherein the collected ambient sound is used to automatically adjust the output volume of the playback unit.

[0036] The data transmission unit is used for wireless transmission of user learning data, and the posture capture unit is used for capturing the user's body and facial expression data for analyzing the user's posture habits during learning.

[0037] Software system: The self-controlled practice system also includes a software system supported by a hardware system and an algorithm, wherein the software system includes a supervision module, a projection module, a training module and a correction module, and also includes a synchronization module; the synchronization module is implemented by the data transmission unit and the central processing unit, and the main function is that the central processing unit is responsible for scheduling storage information, transmitting data containing information such as learning progress, practice or test results to the cloud and synchronizing it to the user terminal, wherein the user terminal is an app or a mini-program or a web terminal; wherein the supervision module is combined with the eye tracking unit to record when the user's eyes are facing the working area of ​​the non-projection module. If the time or the cumulative number of times exceeds the threshold, a reminder is given, and the current user status is determined in combination with the imaging unit and the body capture unit.

[0038] The projection module is implemented by a projection unit and an imaging unit, and also includes a projection learning module and a practice module, both of which realize learning and practice functions respectively through projection functions. The projection learning module uses software-level editing to form a projection area in a designated area. The implementation principle is that the imaging unit captures the video or freeze-frame of the practice space area, and then projects the designated lined or framed area through software-level editing, and then projects the content to be learned for users to practice reading and writing. The software-level editing is completed through a user terminal, and the user terminal includes but is not limited to an app or mini-program or web terminal.

[0039] The practice module projects the practice or test content to the designated area by utilizing the projection area, and the user directly performs the test / practice in the projection area. The training module cooperates with the playback unit and the sound collection unit, and is intended to perform intelligent question-and-answer exercises by collecting the user's voice information or writing operations in the projection area and interacting in real time. The practice module includes a two-way dialogue interaction module and a voice-text interaction module, wherein the two-way dialogue interaction module is composed of a central processing unit that calls storage information or cloud information and sends a voice command to the playback unit according to the user's learning progress or the training stage actively selected by the user, and the playback unit plays the machine-side dialogue content to the user, and after the user responds to the voice, the user's voice information is converted into character data via the sound collection unit, and then processed by the central processing unit to enable the playback unit to respond to the designated voice or text content;

[0040] The voice and text interaction module is composed of the central processing unit, which calls the stored information or cloud information and sends the voice command to the playback unit according to the user's learning progress or the training stage actively selected by the user. The playback unit or the projection unit plays the machine-side dialogue content to the user. The user then interacts in writing in the projection area, and the central processing unit collects the text information through the imaging unit for further interaction.

[0041] The correction module includes a correction image module and a correction sound module, both of which perform intelligent correction on the practice or learning information from the two levels of text information and voice information respectively. The correction image module is responsible for real-time or periodic collection of written content in the projection area by the image collection unit, and compares it with the content in the database. After the content in the area is fully or partially completed, the content is highlighted at the writing place, or the sound is broadcast by the playback unit or other marking methods for correction. The correction sound module allows the user to practice or test by vocal recitation. The sound collection unit collects the sound within a specified time period. After the sound data is collected, the central processing unit synchronously transliterates it into character units and projects it in the projection area, or converts the sound data into character data and compares it with the database for correction, and projects the correction results in the projection area or plays the correction results through the playback unit.

[0042] At the same time, this embodiment discloses the following use and operation steps (S) of the self-controlled exercise system. It should be noted that this step is not the optimal step under algorithm optimization:

[0043] S1: Using software-level editing, a projection area is formed in a designated area. The image acquisition unit captures the video or freeze-frame of the practice space area, and then projects the designated lined or framed area through software-level editing, and then projects the content to be learned for users to practice reading and writing;

[0044] S2: The central processing unit schedules the storage information, transmits the data including the learning progress, practice or test results to the cloud and synchronizes it to the user terminal, and generates the projection content at the same time;

[0045] S3: The monitoring module combines with the eye tracking unit to record when the user's eyes are facing the working area of ​​the non-projection module. If the time or cumulative number exceeds the threshold, a reminder is given, and the current user status is determined in combination with the imaging unit and the body capture unit;

[0046] S4: The central processing unit calls the storage information or cloud information according to the user's learning progress or the training stage actively selected by the user, and sends the voice command to the playback unit, and the playback unit plays the machine-side dialogue content to the user, and after the user voice responds, the sound collection unit converts the user voice information into character data, and then processes it again through the central processing unit to make the playback unit respond with the specified voice or text content;

[0047] S5: The image-collecting module for correction is responsible for real-time or timed collection of the written content in the projection area by the image-collecting unit, and comparison with the content in the database. When the content in the area is fully or partially completed, the content at the writing place is highlighted, or the sound or other marking methods are broadcast through the playback unit. The sound-collecting module for correction allows the user to practice or test by reciting aloud. The sound-collecting unit collects the sound within a specified time period. After the sound data is collected, the central processing unit synchronously transliterates it into character units and projects it in the projection area, or converts the sound data into character data and compares it with the database for correction, and projects the correction result in the projection area, or plays the correction result through the playback unit.

[0048] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A self-controlled practice system for learning English, comprising a hardware system for processing information, wherein the hardware system also includes a central processing unit and a playback unit, the playback unit is used to play learning content, characterized in that: The hardware system in the practice system also includes an eye tracking unit and a projection unit. The eye tracking unit is used to capture the user's eye movement information, and the projection unit is used to project the learning content to a designated area. The projection area is divided into designated areas within a certain range according to the user's selection. The playback unit and the projection unit are used together to remind the user to study independently.

2. The self-controlled practice system for learning English according to claim 1, characterized in that: The hardware system also includes an imaging unit, a sound collection unit, a data transmission unit and a body capture unit, wherein the imaging unit is used to obtain graphic information of the user and the learning scene by taking photos or videos, and the sound collection unit is used to collect user voice and ambient sound, wherein the collected ambient sound is used to automatically adjust the output volume of the playback unit.

3. The self-controlled practice system for learning English according to claim 2, characterized in that: The data transmission unit is used for wireless transmission of user learning data, and the posture capture unit is used for capturing the user's body and facial expression data for analyzing the user's posture habits during learning.

4. The self-controlled practice system for learning English according to claim 3, characterized in that: The self-controlled practice system also includes a software system supported by the hardware system and the algorithm, wherein the software system includes a supervision module, a projection module, a training module and a correction module, and also includes a synchronization module; The synchronization module is implemented by the data transmission unit and the central processing unit. The main function of the central processing unit is to schedule the storage information, transmit the data containing information such as learning progress, exercises or test results to the cloud and synchronize it to the user terminal, where the user terminal is an app or mini program or web terminal; The supervision module is combined with the eye tracking unit to record when the user's eyes are facing the working area of ​​the non-projection module. If the time or cumulative number exceeds the threshold, a reminder will be issued, and the current user status will be determined in combination with the imaging unit and the body capture unit.

5. The self-controlled practice system for learning English according to claim 4, characterized in that: The projection module is implemented by a projection unit and an image acquisition unit, and also includes a projection learning module and a practice module, both of which respectively implement learning and practice functions through projection functions.

6. The self-controlled practice system for learning English according to claim 5, characterized in that: The projection learning module utilizes software-level editing to form a projection area in a designated area. The implementation principle is that the imaging unit captures the video or freeze-frame of the practice space area, and then projects the designated lined or framed area through software-level editing, and then projects the content to be learned for users to practice reading and writing. The software-level editing is completed through the user terminal, which includes but is not limited to an app or mini-program or web terminal.

7. The self-controlled practice system for learning English according to claim 6, characterized in that: The practice module projects the practice or test content to a designated area by utilizing the projection area, and the user can take the test / practice directly in the projection area. The training module collaborates with the playback unit and the sound collection unit to perform intelligent question-and-answer exercises by collecting user voice information or writing operations in the projection area and through real-time interaction.

8. The self-controlled practice system for learning English according to claim 7, characterized in that: The practice module includes a two-way dialogue interaction module and a voice and text interaction module, wherein the two-way dialogue interaction module is configured by the central processing unit to call storage information or cloud information according to the user's learning progress or the training stage actively selected by the user, and send the voice command to the playback unit, and the playback unit plays the machine-side dialogue content to the user, and after the user responds, the user's voice information is converted into character data through the sound collection unit, and then processed by the central processing unit to make the playback unit respond with the specified voice or text content; The voice and text interaction module is composed of the central processing unit, which calls the stored information or cloud information and sends the voice command to the playback unit according to the user's learning progress or the training stage actively selected by the user. The playback unit or the projection unit plays the machine-side dialogue content to the user. The user then interacts in writing in the projection area, and the central processing unit collects the text information through the imaging unit for further interaction.

9. The self-controlled practice system for learning English according to claim 7, characterized in that: The correction module includes a correction image collection module and a correction audio collection module, which respectively perform intelligent correction on the practice or learning information from two levels: text information and voice information.

10. The self-controlled practice system for learning English according to claim 9, characterized in that: The correction and image acquisition module is responsible for real-time or timed acquisition of the written content in the projection area by the image acquisition unit, and compares it with the content in the database. When the content in the area is fully or partially completed, the content at the writing place is highlighted or the playback unit broadcasts sound or other marking methods for correction; The correction and sound collection module allows the user to practice or test by reciting aloud. The sound collection unit collects the sound within a specified time period. After the sound data is collected, the central processing unit synchronously transliterates it into character units and projects it on the projection area, or converts the sound data into character data and compares it with the database, performs correction, and projects the correction results in the projection area, or plays the correction results through the playback unit.

Images