Computerized method and apparatus for determining the accuracy of written Chinese characters

Abstract

Computerized methods and apparatuses are disclosed for determining the accuracy of a written Chinese character entered by a user, whether the Chinese character is formed by correct strokes and conforms to applicable rules, and providing visual and audio feedback to the user. The computing device includes a Chinese character comparison engine, a rules engine, a stroke engine, an art rendering engine, a music engine, and a voice engine, and can access a Chinese character library, a rules library, a stroke library, an art library, and an audio library. The computing device shows the user an appropriate way to write a Chinese character, then allows the user to write the Chinese character, evaluates the quality of the Chinese character, and provides audio and / or visual feedback to the user in response to the quality of the user's work to provide positive feedback. The visual feedback may include step-by-step guidance on how to paint using traditional Chinese contour or non-contour painting techniques.

Description

Technical Field

[0001] The method of writing Chinese characters using a computer can be used to determine the accuracy of Chinese characters when a user writes them, and whether the Chinese characters are formed by correct strokes and comply with correct writing rules. At the same time, during the process of writing Chinese characters, the product will display the rendered image of the written Chinese characters and be equipped with an audio prompt to indicate whether the writing is correct. Background Art

[0002] Historically, the development of Chinese character writing has always been an important factor in helping to unify Chinese civilization. First of all, by passing knowledge from one generation to the next, it helps to unite generations across time. After the standardization of Chinese character writing in ancient China, it helped to unite regions geographically by making it easier to transmit information from one province to another. In this way, Chinese character writing has always been an important factor in China's development into a powerful and unified country.

[0003] This technology provides new opportunities to help students learn to write Chinese characters correctly. Methods that help learn to write Chinese characters correctly can help students do handwriting exercises and help them improve good handwriting skills more quickly. However, it is not a substitute for classroom teaching, but an auxiliary tool that schools and parents can use to increase children's interest in writing Chinese characters and enjoy the writing process. Our other users will be those who learn Chinese as a foreign language. In recent years, China has made great technological progress, and its sustained and rapid economic growth has made it a world power. The importance of China as one of the leading countries in the world has made many foreigners, while admiring China's success, also realize the value of opportunities for cooperation with China in business, science, technology and other fields. To achieve these goals, many people have developed a great interest in learning Chinese. In fact, there has been an overwhelming increase in the number of people willing to learn Chinese. However, students find it difficult to learn Chinese well. Chinese teachers teaching Chinese to non-native speakers find that it is quite difficult for many students to learn to write Chinese characters. For example, native English speakers only need to learn 26 English letters in the early years of primary school. However, to achieve a primary school Putonghua reading level in Chinese, students must learn thousands of Chinese characters. Learning to write Chinese characters is a practice task that requires a lot of patience and attention to detail. When students start writing Chinese characters, they find it difficult to form correct strokes. They are not clear about what details they should pay attention to and how to correctly combine these strokes to ensure that the finally written Chinese characters are correct.

[0004] For students, using the traditional method of repeatedly copying Chinese characters one by one to memorize the characters is a very difficult and time-consuming process. When teaching students to write Chinese characters, first of all, they should be taught the correct strokes and stroke orders, as shown in the regulations titled "Specifications for the Stroke Orders of General Standard Chinese Characters" promulgated by the Ministry of Education of the People's Republic of China in Appendix A.

[0005] For Chinese people, there are many excellent methods for teaching students to write Chinese characters. These methods have increased literacy rates, making it a foundation for educational success. The Chinese Ministry of Education has continuously introduced measures to further improve the quality of writing Chinese characters. Writing Chinese characters with a computer reduces the amount of time children spend writing Chinese characters by hand, and over time, this may lead to the loss of the skill of writing Chinese characters. To prevent this problem from occurring, the Ministry of Education has introduced in its regulations the "Opinions of the Ministry of Education on Strengthening Writing Instruction in Primary and Secondary Schools" (Appendix B).

[0006] Figure 1 Depicted is a prior art practice sheet 100, and the practice sheet can also be a paper exercise book. The practice sheet 100 typically includes dozens of cross grids 101. The cross grid 101 is a dotted square frame, and these dotted lines divide the cross grid into several parts to help students determine the position of Chinese characters within the square. Students practice writing Chinese characters 102 in the cross grid 101. It is not uncommon that before students can accurately write Chinese characters according to the rules, they write each Chinese character hundreds of times, and then the teacher comments on whether the writing of each Chinese character is accurate. Over time, students learn how to correctly write each stroke and learn the writing rules shown in Appendix A. Students also learn the meaning of Chinese characters and how to write each Chinese character.

[0007] The prior art also includes computerized educational software that provides an environment for users to practice writing Chinese characters electronically. However, the ability of this software to provide meaningful feedback to users is limited. The prior art software also tends to be very mechanical and boring. For students, having to complete a boring task reduces the effectiveness of the memory process. When they are forced to memorize boring information, the memories they form tend to be short-term, while for language learners, what is needed is to form long-term memories, accompanied by the ability to be easily recalled.

[0008] In another aspect of the prior art, many people also strive to learn Chinese traditional painting techniques. There are mainly two painting styles in Chinese traditional art. The first style is the "meticulous" style, where an image is first drawn on paper or canvas with ink, and after the ink dries, other traditional Chinese painting pigments are applied to the drawing. The second style is the "freehand" style, where the artist mixes ink and other traditional Chinese painting color pigments and directly applies them to paper or canvas. The prior art includes videos showing students how to paint in both styles, but the prior art does not include computer software to help students learn these painting styles.

[0009] What we need is an improved software environment that shows users the proper way to write Chinese characters, teaches them the rules for forming specific strokes and Chinese character structures, then allows users to write Chinese characters, evaluates the quality of the written Chinese characters, provides audio and / or visual feedback on the quality of the Chinese characters written by the users, and provides positive or constructive feedback. Such software offers a more engaging experience than existing technologies.

[0010] What is further needed is an improved software environment that can adjust the difficulty of the course based on the relative ease with which students whose native language is and is not Chinese progress in a course of learning to write Chinese characters.

[0011] What is further needed is a software environment that shows users how to paint in the meticulous and freehand styles of traditional Chinese painting.

[0012] What is further needed is a multi-disciplinary software environment that teaches users how to write Chinese characters while also learning how to paint in the meticulous and freehand styles.

[0013] What is further needed is a technical solution that can be applied to child or adult learners. By playing educational games, students enjoy the beauty of painting and writing Chinese characters while learning the rules of writing Chinese characters. Such games will improve students' hand-eye coordination and teach students to write Chinese characters with a sense of strength and balanced beauty. Summary of the Invention

[0014] Computerized methods and apparatuses are disclosed for determining the accuracy of a user-entered written Chinese character, whether the Chinese character is formed by correct strokes and complies with applicable rules, and providing visual and audio feedback to the user. The computing device includes a Chinese character comparison engine, a rule engine, a stroke engine, an artistic rendering engine, a music engine, and a voice engine, and can access a Chinese character library, a rule library, a stroke library, an art library, and an audio library. The computing device shows users the proper way to write Chinese characters, then allows users to write Chinese characters, evaluates the quality of the written Chinese characters, and provides audio and / or visual feedback to the user in response to the quality of the user's work to provide positive or constructive feedback. The visual feedback can include step-by-step guidance on how to paint using traditional Chinese meticulous or freehand painting techniques. Brief Description of the Drawings

[0015] This patent or application document contains at least one color drawing. Copies of this patent or patent application disclosure, including the (one or more) color drawings, will be provided by the office upon request and payment of the necessary fees.

[0016] Figure 1 Depicts a prior art practice sheet for practicing writing Chinese characters.

[0017] Figure 2Depicts the hardware components of a prior art client device.

[0018] Figure 3 Depicts the software components of the client device.

[0019] Figure 4 Depicts the hardware components of a prior art server.

[0020] Figure 5 Depicts the software components of the server.

[0021] Figure 6 Depicts multiple client devices communicating with the server.

[0022] Figure 7 Depicts a Chinese character library, an art library, and a music library.

[0023] Figure 8 Depicts a Chinese character comparison engine executed by a client application and / or a server application.

[0024] Figure 9 Depicts a reference Chinese character.

[0025] Figure 10A Depicts a cross-grid generated in a user interface, which allows a user to write input strokes.

[0026] Figure 10B Depicts Figure 10A the input strokes of Figure 10B compared with the reference Chinese character of

[0027] Figure 11 to generate an accuracy score for the input strokes.

[0028] Figure 12 Depicts a first set of Chinese characters learned by a user through a software environment.

[0029] Figure 13 Depicts a course screen.

[0030] Figure 14A 、 14B 、14C, 14D, 14E, 14F, 14G, 14H, 14I, 14J, 14K, 14L, 14M, 14N, 14O, 14P, and 14Q depict an exemplary sequence of writing Chinese characters with the help of a shaded reference Chinese character and with visual feedback, the visual feedback including a course of meticulous brushwork in traditional Chinese painting.

[0031] Figure 15A 、 15B, 15C, 15D, 15E, 15F, 15G, 15H, and 15I depict an exemplary sequence of writing Chinese characters without the aid of shaded reference Chinese characters and with visual feedback, the visual feedback including a course on meticulous brushwork of traditional Chinese painting.

[0032] Figure 16 Depicts a course screen.

[0033] Figure 17A , 17B , 17C, 17D, 17E, 17F, 17G, 17H, 17I, 17J, 17K, 17L, 17M, 17N, 17O, 17P, and 17Q depict an exemplary sequence of writing Chinese characters with visual feedback, the visual feedback including a course on freehand brushwork of traditional Chinese painting.

[0034] Figure 18A , 18B , 18C, 18D, 18E, and 18F depict a configuration method. Detailed Description

[0035] The embodiments described herein provide an educational experience that is completely lacking in the prior art. In the examples provided herein, the software environment teaches the user Chinese (Mandarin). However, it should be understood that the software environment can be used for other languages with a high density of Chinese characters, such as Cantonese, Japanese, or other languages.

[0036] The software environment is designed to achieve the following goals:

[0037] 1. To help the user identify the strokes and their composition, which is an improvement in the user's analytical and visual skills.

[0038] 2. To help the user identify the rules of stroke order, which is an improvement in the user's analytical and visual skills.

[0039] 3. To help the user identify and remember the origin of the stroke names used in Mandarin, which is an improvement in the user's auditory skills.

[0040] 4. To help the user visually analyze Chinese characters that are new to the user and conceptually elaborate on the rules of applying stroke order when writing Chinese characters, which is an improvement in the user's visual and analytical skills.

[0041] 5. To help the user practice writing simplified Chinese characters with the correct strokes in the correct stroke order, which is an improvement in the user's motor skills;

[0042] 6. To teach the user the standard Mandarin pronunciation of those Chinese characters, which is an improvement in the user's auditory skills;

[0043] 7. To provide translations of those Chinese characters for users whose native language is not Chinese;

[0044] 8. Establish a visual connection between writing simplified Chinese characters and traditional Chinese art including meticulous brush painting and freehand brush painting;

[0045] 9. Improve the user's hand-eye coordination; and

[0046] 10. Encourage the user to write Chinese characters and learn painting in meticulous brush painting and freehand brush painting using paper, brushes, ink, and pigments in real life outside of the software environment.

[0047] To achieve these goals, the game utilizes an educational method called "holistic language acquisition" which optimizes all aspects of human memory, such as visual, auditory, analytical, associative, and motor aspects combined with the use of cultural context, in order to improve the memory of Mandarin Chinese characters and their meanings. The holistic language acquisition method of memory is useful in educational game design because it creates the following conceptual framework: in this conceptual framework, all aspects of memory become multiple classification categories. These categories help establish parameters for quantitatively feeding different types of cognitive inputs presented to the user. The combination of inputs presented in specific doses helps achieve the desired learning effect. As the user progresses in the learning process, the game needs to be adjusted to maintain the user's attention. Thus, educational game design can be considered a dynamic optimization problem. The error rate of the user's response and the speed at which the user responds to questions can be used as indicators of the user's learning progress rate and help regulate the dynamic adjustment process.

[0048] For example, in the software environment, all aspects of the user's memory are utilized and exercised in the following ways:

[0049] · Visual: Present images of Chinese characters to the user and expect the user to copy them using the correct strokes in the correct order. If they make mistakes in stroke type or stroke order, their mistakes are highlighted. Incorrect strokes disappear, and the method shows the correct strokes or stroke order. For the following reason, the user's mistakes are highlighted in a color other than red (such as green): teachers often use red to correct students' test papers at school, so students may associate that color with a sense of guilt for making mistakes. The software environment is designed to avoid making the user feel this way, thus maintaining goal-oriented focus and a positive attitude. Negative self-assessment can be distracting and interfere with the memory process. Initially, for all Chinese characters in the set except the last one, the user receives an indication of whether the Chinese character strokes are correct and whether they are executed in the correct order by observing the color changes during the drawing in meticulous brush painting shown on the same screen as the writing practice. For the last Chinese character at the end of each set, the user receives step-by-step guidance for drawing a flower or other object in freehand brush painting.

[0050] · Auditory: In a preferred setting, the user only hears the target words and the writing rules in Chinese. The translation of these words and other information is only provided in written form. This focuses the user's auditory attention on the target information and prevents auditory language distraction. Exceptions are children who have not yet become proficient readers.

[0051] · Analysis: Group and present these Chinese characters to the customer according to the radicals contained in the Chinese characters. Gongbi and freehand paintings are presented as combinations of brush strokes, combining these strokes one by one to produce a painting.

[0052] · Association: Teach the user to associate the sound of the word with each Chinese character, and the sound of the rule with the action or sequence of actions that meet the rule requirements.

[0053] · Movement: The user needs to "write" specific strokes on the screen. The actions of writing strokes and specific stroke sequences are imprinted in the user's memory, similar to how dance steps are imprinted in a dancer's memory.

[0054] · Cultural background: In Chinese culture, traditional paintings are usually associated with poems written in calligraphy style. In fact, without such poems, traditional paintings would be considered incomplete. Usually, the method for writing simplified Chinese characters uses cartoon illustrations. Our innovation is to use simplified Chinese characters and write the simplified Chinese characters side by side with traditional-style paintings. The writing and painting are carried out side by side, thus creating a visual and temporal association between the two art forms. Traditional art images highlight the aesthetic qualities of the simplified Chinese characters, making them more attractive and memorable to users. The animated short film will be accompanied by excerpts from melodies from traditional Chinese songs. This will enhance the user's cultural immersion effect.

[0055] Computing device

[0056] The embodiments described herein are implemented on a computing device. In one embodiment, the client device interacts with a server via a network. In another embodiment, the client device is a stand-alone computing device and does not interact with a server.

[0057] Figure 2 The hardware components of the client device 200 are depicted. The client device 200 is a computing device such as a tablet computer, smart phone, notebook computer, desktop computer, gaming unit, wearable computing device such as a watch or glasses, or any other computing device. These hardware components are known in the prior art. The client device 200 is a computing device that includes a processing unit 210, a memory 220, a non-volatile storage device 230, a positioning unit 240, a network interface 250, an image capture unit 260, a graphics processing unit 270, and a display 280.

[0058] The processing unit 210 optionally includes a microprocessor having one or more processing cores. The memory 220 optionally includes DRAM or SRAM volatile memory. The non-volatile storage device 230 optionally includes a hard disk drive or a flash memory array. The positioning unit 240 optionally includes a GPS unit or a GNSS unit that communicates with GPS or GNSS satellites to determine the latitude and longitude coordinates of the client device 200, which are typically output as latitude data and longitude data. The network interface 250 optionally includes a wired interface (such as an Ethernet interface) or a wireless interface (such as 3G, 4G, 5G, GSM, 802.11, protocols known through the trademark BLUETOOTH, etc.). The image capture unit 260 optionally includes one or more standard cameras (such as those currently found in most smartphones and laptop computers). The graphics processing unit 270 optionally includes a controller or a processor for generating graphics for display. The display 280 displays the graphics generated by the graphics processing unit 270 and, in a preferred embodiment, includes a touch screen.

[0059] Figure 3 The software components of the client device 200 are depicted. The client device 200 includes an operating system 310 (such as an operating system known through the trademarks WINDOWS, LINUX, ANDROID, IOS or other operating systems), a web browser 320 (such as a web browser known through the trademarks CHROME, FIREFOX, SAFARI, EDGE or other web browsers), and a client application 330. The client application 330 includes lines of software code executed by the processing unit 210 and / or the graphics processing unit 270 to perform the functions described below. For example, the client device 200 can be a tablet computer sold by Apple under the trademark "IPAD", and the client application 330 can be a downloadable app installed on the tablet computer. The client device 200 can also be a laptop computer, a desktop computer, a gaming system, or other computing devices, and the client application 330 can be a software application running on the client device 200. The client application 330 forms an important component of the inventive aspects of the embodiments described herein, and the client application 330 is unknown in the prior art.

[0060] In an alternative embodiment, all of the functions described herein for the client application 330 are alternatively performed by the web browser 320, which may be desirable if a software environment is provided through a website.

[0061] Figure 4Depicts the hardware components of server 400. These hardware components are known in the prior art. Server 400 is a computing device that includes a processing unit 410, a memory 420, a non-volatile storage device 430, a positioning unit 440, a network interface 450, an image capture unit 460, a graphics processing unit 470, and a display 480.

[0062] The processing unit 410 optionally includes a microprocessor having one or more processing cores. The memory 420 optionally includes DRAM or SRAM volatile memory. The non-volatile storage device 430 optionally includes a hard disk drive or a flash memory array. The positioning unit 440 optionally includes a GPS unit or a GNSS unit that communicates with GPS or GNSS satellites to determine the latitude and longitude coordinates of server 400, which are typically output as latitude data and longitude data. The network interface 450 optionally includes a wired interface (such as an Ethernet interface) or a wireless interface (such as 3G, 4G, 5G, GSM, 802.11, a protocol known through the trademark "BLUETOOTH", etc.). The image capture unit 460 optionally includes one or more standard cameras (such as those currently found in most smartphones and laptop computers). The graphics processing unit 470 optionally includes a controller or a processor for generating graphics for display. The display 480 displays the graphics generated by the graphics processing unit 470 and optionally includes a monitor, a touch screen, or other types of displays.

[0063] Figure 5 Depicts the software components of server 400. Server 400 includes an operating system 510 (such as a server operating system known through the trademarks "WINDOWS SERVER", "MAC OS X Server", "LINUX", or others), a web server 520 (such as a web server known through the trademark "APACHE"), and a server application 530. The server application 530 includes lines of software code executed by the processing unit 410 and / or the graphics processing unit 470, and the server application 530 is specifically designed to interact with the client application 330. The server application 530 is unknown in the prior art.

[0064] In an alternative embodiment, all of the functions described herein for the server application 530 are alternatively performed by the web server 520 that communicates with the web browser 320, which may be desirable if a software environment is provided through a website.

[0065] Reference Figure 6, shows three instances of the client device 200, namely client devices 200a, 200b, and 200c. These are exemplary devices, and it should be understood that any number of different instances of the client device 200 can be used. Each of the client devices 200a, 200b, and 200c communicates with the server 400 via the network interface 250 using the network 610. In this example, each client device 200 operates its own instance of the web browser 320 and the client application 330.

[0066] Figure 7 Depicts a Chinese character library 710, a rule library 720, a stroke library 730, an art library 740, and an audio library 750, each of which includes a collection of data stored in a database within a non-volatile storage device. The client 200 and the server 400 can access the Chinese character library 710, the rule library 720, the stroke library 730, the art library 740, and the audio library 750.

[0067] Figure 8 Depicts various engines operated by the client application 330 and / or the server application 530, including a Chinese character comparison engine 810, a rule engine 820, a stroke engine 830, an art rendering engine 840, a music engine 850, and a voice generation engine 860. Each of the engines includes lines of software code executed by the processing unit 210 and / or 410 and / or the graphics processing unit 270 and / or 470.

[0068] Software environment

[0069] Additional details will now be provided regarding the Chinese character comparison engine 810, the rule engine 820, the stroke engine 830, the art rendering engine 840, the music engine 850, the voice generation engine 860, the Chinese character library 710, the rule library 720, the stroke library 730, the art library 740, and the audio library 750, and the functions they jointly implement in the client device 200 and the server 400.

[0070] Figure 9 Depicts a reference Chinese character 900 superimposed on a grid 901. These are graphical depictions on the display 280 of the client device 200, as well as associated pixel data and data structures in the memory 220 or the graphics processing unit 270. The Chinese character library 710 stores data for the reference Chinese character 900 and many other Chinese characters. The rule library 720 stores data for the rules to be followed when writing all Chinese characters, including but not limited to the following stroke order rules promulgated by the State Language Commission of China:

[0071] 1. From top to bottom

[0072] 2. From left to right

[0073] 3. First horizontal then vertical

[0074] 4. First left then right

[0075] 5. From outside to inside - refers to the case where the closing stroke surrounds the internal structure from the upper left corner, upper right corner, or from above

[0076] 6. From inside to outside - refers to the case where the closing stroke surrounds the internal structure from below or from the lower left corner

[0077] 7. First write the inside then close

[0078] 8. First write the middle then the two sides

[0079] 9. Write the intersecting strokes later

[0080] 10. First write the left vertical stroke then close

[0081] 11. Write the dot at the top or upper left first

[0082] 12. Write the dot at the upper right or inside later.

[0083] The stroke library 730 stores data in the ideal form of each possible stroke type that can be used in any possible Chinese character.

[0084] The reference Chinese character 900 includes strokes 902, 910 and other strokes. For stroke 902, the data of sample points 903, 904, 905, 906, 907 and 908 are captured and stored. The sample point 903 is the starting point of stroke 902. The stroke starts from the top of the "hook" tip, travels through the sample point 903, and ends at the sample point 908. Similar sample points are captured for all other strokes in the reference Chinese character 900. The following shows in Table 1 the data types of each Chinese character and stroke (such as the reference Chinese character 900 and stroke 902) stored in the Chinese character library 610.

[0085] Table 1: Data set of reference Chinese characters

[0086]

[0087]

[0088] In Table 1, the cross-grid coordinates x, y indicate the relative position of a specific point within the cross-grid 901. For example, the lower left corner of the cross-grid 901 may have coordinates 0, 0, and each increment will represent a movement of one pixel upward or to the right. The slope s in Table 1 represents the slope of the stroke 902 at that specific point, which provides information about the curvature of the stroke 902. The stroke type in Table 1 indicates the stroke type of the stroke 902 (according to the stroke library 730). The creation order in Table 1 indicates the order in which each stroke should be created (according to the rule library 720) and the order in which the points within each stroke (such as stroke 902) are correctly formed. That is, the point 903 as the starting point is formed first, and the point 908 as the ending point is formed last.

[0089] Figure 10A and 10B Additional details about the Chinese character comparison engine 810, the rule engine 820, and the stroke engine 830 are provided.

[0090] Figure 10A The input stroke 1001 entered by the user is depicted, for example, by writing on the display 280 when the display 280 is a touch screen, or by using a mouse. Here, the cross-grid 901 is also drawn on the display 280, and the user writes the input stroke 1001 within the cross-grid 901. The input stroke 1001 is the first stroke in the input Chinese character 1000. Figure 10B The reference Chinese character 900 that the user is attempting to imitate is depicted along with the input stroke 1001.

[0091] Reference Figure 11 and then Figure 10A the feedback method 1100 is performed on the input stroke 1001 to provide feedback to the user regarding the input stroke 1001.

[0092] In step 1120, the Chinese character comparison engine 810 uses a formula based on the criteria contained in Table 1 to calculate the accuracy score 1101 of the input stroke 1001. An example of a simple formula is:

[0093] Accuracy score 1101 = w1 * (distance between starting points) +

[0094] w2 * (distance between ending points) + w3 * (average distance between points) + w4 * (average difference in slopes of points)

[0095] where w1, w2, w3, and w4 are weights selected to emphasize the relative importance of each criterion.

[0096] In step 1130, the stroke engine 830 then determines whether the input stroke 1001 is the correct stroke. If so, the system proceeds to step 1140. If not, the system proceeds to step 1170. For example, a "slanting" stroke such as stroke 902 should start from the top and fall to the left when written. The stroke engine 1130 analyzes the input stroke 1001 to determine whether it is a "slanting stroke" by analyzing this criterion and other criteria for a "slanting" stroke.

[0097] In step 1140, the rule engine 820 then determines whether the input stroke 1001 follows all applicable rules. If so, the system proceeds to step 1150. If not, the system proceeds to step 1170. For example, one rule is that a stroke falling to the left should be written before a stroke falling to the right (see Appendix A). Here, the "slanting" stroke is a stroke falling to the left, so the rule engine 820 will determine whether the user has incorrectly written any strokes falling to the right before writing the "slanting" stroke. In Figure 10A the example of, no such error has occurred.

[0098] In step 1150, the Chinese character comparison engine 810 then determines whether the accuracy score 1101 exceeds a predetermined threshold 1102. If so, the system proceeds to step 1160. If not, the system proceeds to step 1170. In Figure 10A and 10B the example of, it can be seen that the curvature of the input stroke 1001 is different from the curvature of the input stroke 1020. Whether this is an acceptable level of deviation will be determined by the setting of the predetermined threshold 1102. That is, the predetermined threshold 1102 can be set at a loose level, a strict level, or any level in between. This aspect of threshold setting is further discussed below with reference to FIG. 18.

[0099] In step 1160, positive feedback is provided to the user because it has been determined that the input stroke 1001 is the correct stroke, follows the applicable rules, and is accurate. The positive feedback can include one or more of the following options:

[0100] · The music engine 850 provides music feedback 1101 to the user. For example, the music engine 850 can play a part of a Chinese folk song and provide additional segments whenever the accuracy score of a new stroke exceeds the threshold. The music content is stored in the audio library 750. Once the entire Chinese character has been written in a satisfactory manner, the music engine 850 can play the whole song. In an alternative approach, the music engine 850 can play the whole song each time, but in the case of each correct stroke, add it in a different audio track (e.g., each audio track has a different instrument), rather than playing a part of a song each time.

[0101] · The sound engine 860 provides voice feedback 1102 to the user. For example, the sound engine 860 can provide positive encouragement by using pre-recorded voice clips stored in the audio library 750 or by synthesizing speech using the speech generation module. The type of voice that is easiest for the user to understand is the type that is closest in pitch to that of a person. For the first set, the game will use the voice of a 10-year-old child for the following reasons: Young children like to imitate the examples set by older children. Since many users will be young children, using the voice of an older child will attract them to the game. The pronunciation of the target word translation is a high to medium-high pitched voice. Here, the goal is to ensure easy understanding. Since we know that most users with this characteristic are young children, we will use a higher pitched voice to meet their needs. The same voice will be retained for this set of words, including the pronunciation of the target word and the statement of the rules. Since most people find it unpleasant to hear the same voice repeatedly, after a few sets, a new person will be brought in to pronounce the game. At first, voice actors with medium-pitched voices, children aged 10 - 12, mezzo-sopranos, and tenors will be selected, gradually evolving to a change in pitch: 6-year-old children, sopranos, and basses. This is important ear training; there are 4 tones in Chinese that have phonemic significance. Listeners need to learn to distinguish these 4 tones and gradually learn to recognize them, even when listening to the voices of speakers with very different pitches from their own. An additional complication of the additional challenge: the voices of the elderly, whose voices may be a bit unsteady, and the voices of teenagers.

[0102] · The art rendering engine 840 uses the artworks stored in the art library 740 to provide artwork feedback 1103 to the user. For example, for each stroke with an accuracy higher than the threshold, the art rendering engine 840 can depict additional strokes in classical Chinese paintings. The following is referred to Figures 17A to 17Q to show an example of this.

[0103] In step 1170, constructive feedback is provided to the user because it has been determined that the input stroke 1001 is an incorrect stroke (step 1130), does not follow all applicable rules (step 1140), and / or is inaccurate (step 1150). Then, constructive feedback will be provided to the user, which can include one or more of the following options:

[0104] · The music engine 850 provides music feedback 1111 to the user. The music engine 850 can stop playing Chinese folk songs, or it can remove tracks (instruments) from the song that is being played.

[0105] · The sound engine 860 provides sound feedback 1112 to the user. For example, the sound engine 860 can provide constructive comments to the user by utilizing pre-recorded sound clips stored in the audio library 750 or by synthesizing speech using the speech generation module.

[0106] · The art rendering engine 840 provides art feedback 1113 to the user. For example, the art rendering engine 840 can delete brush strokes in the previously added art, or can remove colors from the art, as feedback indicating that the stroke 1001 was not written with sufficient accuracy.

[0107] · The Chinese character comparison engine 810, the rule engine 820, and / or the stroke engine 830 provide Chinese character feedback 1114 to the user. For example, the Chinese character comparison engine 810 or the stroke engine 830 can overlay correct and accurate strokes on the stroke 1001, such that the user can see why the stroke 1001 is incorrect or not entirely accurate. The rule engine 820 can indicate the way in which the rules are violated, for example, by showing the strokes that the user should have written before writing the input stroke 1001.

[0108] Dynamic difficulty

[0109] The client application 330 and / or the server application 530 can change the difficulty of the exercise for the user. For example, making the exercise easier for non-native speakers than for native speakers, or easier for younger users than for older users.

[0110] During the initial configuration process, the user will be asked to:

[0111] · Specify his or her native language, which will activate the dictionary for translating Chinese words into the user's native language;

[0112] · Select an age range, such as (1) 7 years old or younger, (2) 8 - 10 years old, (3) 11 - 14 years old, and (4) 15 years old and older. Grouping users by age will help establish the fault tolerance for each group. While younger children are very good at learning to speak, their fine motor skills are just developing and they require a greater margin of error when they learn to write Chinese characters.

[0113] These factors can be considered when selecting the Chinese characters (such as the reference Chinese character 900) to be used during the exercise and when setting the threshold 1102 for each exercise.

[0114] To maintain the user's interest in the game, it is important to make progress in terms of the difficulty level. The difficulty level will be gradually increased in the following ways:

[0115] 1. Complexity of Chinese characters - As the user progresses in the game, he or she will be presented with Chinese characters composed of a greater number of strokes and more complex types of strokes, and will ultimately progress to words composed of two or more Chinese characters.

[0116] 2. Accuracy – Threshold 1102 can increase over time, so the user's accuracy will need to improve as he or she progresses in the game. The quality of the strokes is essential for writing Chinese well, so the game encourages the user to pay close attention to their writing and improve hand-eye coordination.

[0117] 3. Elasticity of understanding (a training process).

[0118] 4. Complexity of artistic images. The presented artistic images will also pose more challenges in terms of the number of strokes, spatial composition, and painting techniques. As the user progresses in the game, both the meticulous and freehand painting styles will be presented with step-by-step guidance.

[0119] Artwork feedback examples 1103 and 1113

[0120] The following per-scenario description shows the characteristics of the artwork feedback 1103, which can include guidance in the meticulous and freehand techniques of traditional Chinese painting.

[0121] Reference Figure 12 , the game starts with five Chinese characters from the first set 1200 as shown in Figure 12 . The game begins with five Chinese characters from the first set 1200 as shown in Figure 12 , the pronunciation of each Chinese character in pinyin (a Latin-based phonetic notation), and in the foreign language versions, the definition of each Chinese character in the foreign language. Each of the five Chinese characters starts with the same radical "person" - which means a standing person, and this radical includes the left side of the five shown Chinese characters.

[0122] When learning the first four Chinese characters in the first set 1200, the user will also see a depiction of a lotus flower in meticulous painting. The practice starts with a black-and-white image of a single flower. As the user writes the correct strokes, the image gradually and visibly gains color. If the user makes a mistake, the image loses some color and regains that color when the mistake is corrected. When the user correctly completes the Chinese character, the image is presented in full color. In this way, the gain and temporary loss of color are part of the positive and negative feedback to the user as they progress through this stage of the game. Thus, the user can focus on learning the rules of writing with minimal distraction.

[0123] When learning the last Chinese character in the first set 1200, the user will learn how to paint a lotus flower in freehand painting.

[0124] The painting order of any meticulous or freehand image that the user has seen can be replayed at any time, thus helping the user recall the method of painting the image in real life. This method regularly provides visual guidance to the user in the form of short animations on various themes. For example: Instead of using a specific type of stroke in painting (there are several variations), what is the best hand position and grip on the paintbrush for writing; how to avoid making common mistakes when writing with a paintbrush; how to mix various colors together to achieve the desired effect.

[0125] Figure 13 Depicts the lesson screen 1300 used as a template during practice. The cross-grid 901 is the area where the user will write Chinese characters. The art panel 902 is the area where meticulous or freehand paintings will be depicted. The art control 1303 allows the user to browse the creation of the art on a stroke-by-stroke basis. If the user selects the audio request 1301, the sound engine will use the audio library 750 to pronounce the Chinese character 900. That is, the user will be able to hear the Chinese character pronounced in Mandarin. If the user selects the translation request or additional information 1302, the information or foreign language translation of the reference Chinese character 900 will be displayed using the Chinese character library 710.

[0126] Now the two sequences will be described using the easiest Chinese characters - shén in the first set of Chinese characters 1200 in Figure 14 and Figure 16 the most difficult Chinese character - nǐ in the first set of Chinese characters 1200 in

[0127] In Figure 14A , the reference Chinese character 1400 (here the shén character) that the user will be required to write within the cross-grid 901 is shown to the user. The user hears the word pronounced in Mandarin using the voice engine 830.

[0128] In Figure 14B , the reference Chinese character 1400 fades, but does not completely disappear. This feature is called the "shadow" feature and is optional. The art panel 902 shows the outline of a flower in traditional meticulous painting.

[0129] In Figure 14C , the user writes the first stroke in the display 280 within the cross-grid 901. The execution feedback method 1100 is performed, and in step 1130, the stroke engine 830 determines that the user has written an incorrect stroke, as indicated by the arrow. Specifically, the user has written a "raising" stroke (writing upward and to the right) instead of a "left-falling" stroke (writing downward and to the left). The stroke engine 830 also instructs the voice engine 860 to announce the name of the correct stroke, "left-falling", in Mandarin using the audio library 750. If the user is a foreign language speaker, he or she can have the option to press "?" (translation request 1302) to display Figures 14C to 14GAt any time after the stroke is seen in a written description in a foreign language. After the user writes the next stroke, in Figure 14H the English description of the previous stroke is no longer available to the user, so that as the user progresses through the game, he will not be confused by reading information that is no longer relevant.

[0130] In Figure 14D the incorrect first stroke is erased from the display 280.

[0131] In Figure 14E the correct way to write the first stroke is shown to the user on the display 280 using a computer-generated stroke 1401 (with or without an arrow), preferably in a different color (e.g., green instead of black). The user hears the name of the stroke to be written in Mandarin using the voice engine 830.

[0132] In Figure 14F the computer-written stroke 1401 is erased.

[0133] In Figure 14G the user writes the first stroke again in the display 280 within the cross-grid 901. In this instance, the user writes the first stroke in the correct direction as indicated by the arrow. The feedback method 1100 is executed, and the stroke engine 830 determines that the user has formed the correct stroke (step 1130), the rule engine 820 determines that the stroke complies with the rules (step 1140), and the Chinese character comparison engine determines that the accuracy score 1101 exceeds the threshold 1102 (step 1150). As a result, the art rendering engine 840 fills in part of the outline of the artwork to achieve the first level of color saturation in the artwork panel 902 (using data from the art library 740) (step 1160).

[0134] In Figure 14H the user writes the second stroke - represented by a dashed line - in the display 280 within the cross-grid 901. Here, the user writes the correct stroke ("vertical"), but very inaccurately. The feedback method 1100 is executed, and in step 1150, the Chinese character comparison engine 810 determines that the accuracy score 1101 of the second stroke does not exceed the threshold 1102.

[0135] In Figure 14I the correctly written reference stroke is shown in color (such as green) (step 1170).

[0136] In Figure 14J the user's stroke and the reference stroke are erased.

[0137] In Figure 14KIn this case, the user attempts to write the stroke again, and this time writes it accurately. The feedback method 1100 is executed, and the stroke engine 830 determines that the user has formed a correct stroke (step 1130), the rule engine 820 determines that the stroke complies with the rules (step 1140), and the Chinese character comparison engine determines that the accuracy score 1101 exceeds the threshold 1102 (step 1150). The stroke is written out and is not merely shown as a dotted line as in the case of incorrect strokes in Figure 14H The stroke is not merely shown as a dotted line as in the case of incorrect strokes in

[0138] The artistic rendering engine 840 increases the color saturation level of the artwork to level 2 in the artwork panel 902 (using data from the art library 740) (step 1160).

[0139] In Figure 14L the user writes the third stroke in the display 280 within the cross grid 901. The feedback method 1100 is executed, and in step 1140, the rule engine 820 determines that the third stroke does not comply with all the rules in the rule library 720 because the user has written the strokes in the wrong order. The rule engine 820 identifies the rules in the rule library 720 that have been violated. In this example, they are: first the horizontal stroke "heng", and then the vertical stroke "shu". The rule engine 820 then instructs the voice engine 860 to announce the name of the rule in Mandarin using the audio library 750 (step 1170). The artistic rendering engine 840 reduces the color saturation back to level 1 (step 1170). Again, the user has the option to view the foreign language translation of the rule by pressing "?" (translation request 1302) until the user makes the Figure 14N next stroke in

[0140] In Figure 14M the incorrect third stroke is erased from the display 280.

[0141] In Figure 14N the correct way to write the third stroke is shown to the user on the display 280 by a computer-generated stroke 1402 (with or without an arrow), preferably using a different color (e.g., green instead of black). The user hears the stroke order rule to be followed in this case in Mandarin using the voice engine 830 (step 1170).

[0142] In Figure 14O the computer-generated stroke 1402 is erased.

[0143] In Figure 14PIn this case, the user writes the third stroke again on the display 280 within the nine-square grid 901. In this example, the user writes the correct third stroke. The feedback method 1100 is executed, and the stroke engine 830 determines that the user has formed a correct stroke (step 1130), the rule engine 820 determines that the stroke conforms to the rules (step 1140), and the Chinese character comparison engine determines that the accuracy score 1101 exceeds the threshold 1102 (step 1150). As a result, the art rendering engine 840 increases the color saturation in the painting to level 3 (step 1160).

[0144] In Figure 14Q this case, the user writes the fourth stroke on the display 280 within the nine-square grid 901. The feedback method 1100 is executed, and the stroke engine 830 determines that the user has formed a correct stroke (step 1130), the rule engine 820 determines that the stroke conforms to the rules (step 1140), and the Chinese character comparison engine determines that the accuracy score 1101 exceeds the threshold 1102 (step 1150). As a result, the art rendering engine 840 adds additional colors within the outline of the artwork in the artwork panel 902 (using the data in the art library 740) (step 1160). This is the last stroke of the Chinese character, and thus, the meticulous painting is also completed. As a result, the art rendering engine 840 increases the color saturation in the painting to level 4 (step 1160).

[0145] As indicated above, FIG. 14 provides the user with a "shadow" feature where the shadow of the reference Chinese character is always present. After repeatedly writing any given Chinese character several times in a set such as the set depicted in FIG. 14, the user is then given the opportunity to test his or her memory recall and writing skill accuracy using the "no shadow" feature depicted in FIG. 15. In this case, the user is performing a more complex task, so the practical goal overrides aesthetic considerations, and the user's markings are more prominent.

[0146] In Figure 15A this case, the reference Chinese character 1400 appears, as in Figure 14A this case.

[0147] In Figure 15B this case, the reference Chinese character disappears, leaving only the nine-square grid 901 without the shadow of the reference Chinese character.

[0148] In Figure 15C this case, the user writes the first stroke. The stroke is visible as a thin black line, just as if written with a black pen. The feedback method 1100 is executed, and the stroke engine 830 determines that the user has formed a correct stroke (step 1130), the rule engine 820 determines that the stroke conforms to the rules (step 1140), and the Chinese character comparison engine determines that the accuracy score 1101 exceeds the threshold 1102 (step 1150). As a result, inFigure 15D In this case, the user's stroke is replaced by an appropriate bold calligraphy stroke. This makes the user satisfied because he knows he is doing it right, even if his initial stroke is not perfect.

[0149] In Figure 15E the user writes the second stroke. The feedback method 1100 is executed, and the stroke engine 830 determines that the user has formed a correct stroke (step 1130), and the rule engine 820 determines that the stroke complies with the rules (step 1140). However, the Chinese character comparison engine determines that the accuracy score 1101 does not exceed the threshold 1102 (step 1150) because the user's stroke is written at an incorrect angle with incorrect start and end positions.

[0150] In Figure 15F the correctly written stroke is shown in green.

[0151] In Figure 15G the correct stroke and the user's stroke are deleted.

[0152] In Figure 15H the user tries the second stroke again. The feedback method 1100 is executed, and the stroke engine 830 determines that the user has formed a correct stroke (step 1130), the rule engine 820 determines that the stroke complies with the rules (step 1140), and the Chinese character comparison engine determines that the accuracy score 1101 exceeds the threshold 1102 (step 1150). As a result, in Figure 15I the user's stroke is replaced by an appropriate bold calligraphy stroke.

[0153] Then, the user can proceed with the remaining strokes of the Chinese character. After each stroke, the feedback method 1100 is executed, and the Chinese character comparison engine 810, the rule engine 820, and the stroke engine 830 perform the same analysis described above with reference to FIG. 14. For the sake of efficiency, the remaining part of the Chinese character practice with the non-shaded options in FIG. 15 is not shown.

[0154] Now referring to Figure 16 and 17 depict an example of a lesson on the most difficult Chinese character - nǐ in the first Chinese character set 1200.

[0155] Figure 16 depicts the lesson screen 1600 used as a template during the practice. The lesson screen 1600 is the same as the lesson screen 1300 in Figure 13 except that a completed freehand painting is depicted in the art panel 902.

[0156] In Figure 17A the reference Chinese character 1700 that the user will be required to write within the cross-grid 901 is shown to the user. As in FIG. 14, Figure 16Follow the "shadow" option, where a faded version of the reference Chinese character 1700 is shown throughout the exercise.

[0157] In Figure 17B the reference Chinese character 1700 disappears or fades.

[0158] In Figure 17C the user writes a first stroke in the display 280 within the cross-grid 901. The feedback method 1100 is executed, and it is determined that the accuracy score 1101 exceeds the threshold 1102. As a result, the art rendering engine 840 draws the first stroke in the art panel 902 (using data from the art library 740). Notably, the art shown in the art panel 902 of Figure 17C uses the freehand painting technique of traditional Chinese painting.

[0159] In Figure 17D the user writes a second stroke in the display 280 within the cross-grid 901. The feedback method 1100 is executed, and it is determined that the accuracy score 1101 exceeds the threshold 1102. As a result, the art rendering engine 840 draws the second stroke in the art panel 902 (using data from the art library 740).

[0160] In Figure 17E the user writes a third stroke in the display 280 within the cross-grid 901. The feedback method 1100 is executed, and it is determined that the accuracy score 1101 exceeds the threshold 1102. As a result, the art rendering engine 840 draws the third stroke in the art panel 902 (using data from the art library 740).

[0161] In Figure 17F the user writes a fourth stroke in the display 280 within the cross-grid 901. The feedback method 1100 is executed, and it is determined that the accuracy score 1101 does not exceed the threshold 1102. Here, this is because the user did not write a hook at the end of the fourth stroke. As a result, the art rendering engine 840 does not draw a new stroke in the art panel 902. Alternatively, the art rendering engine 840 can remove the third stroke from the art panel 902.

[0162] In Figure 17G the incorrect fourth stroke is erased from the display 280.

[0163] In Figure 17H the correct way to write the fourth stroke is shown to the user on the display 280 by a computer-generated stroke 1701 (with or without an arrow), preferably using a different color (e.g., green instead of black). The vocalization engine 860 pronounces the name of the correct stroke in Mandarin.

[0164] InFigure 17I In it, the computer-generated stroke 1701 is erased.

[0165] In Figure 17J In it, the user writes the fourth stroke again in the display 280 within the nine-square grid 901. The feedback method 1100 is executed, and it is determined that this time the accuracy score 1101 exceeds the threshold 1102. As a result, the art rendering engine 840 draws an additional stroke in the art panel 902 (using the data in the art library 740).

[0166] In Figure 17K In it, the user writes the fifth stroke in the display 280 within the nine-square grid 901. The feedback method 1100 is executed, and it is determined that the accuracy score 1101 exceeds the threshold 1102. As a result, the art rendering engine 840 draws an additional stroke in the art panel 902 (using the data in the art library 740).

[0167] In Figure 17L In it, the user writes the sixth stroke in the display 280 within the nine-square grid 901. The feedback method 1100 is executed, and it is determined that the accuracy score 1101 does not exceed the threshold 1102. Here, this is because the user placed the sixth stroke in the wrong position. The user violated the rule "left first, then right". As a result, the art rendering engine 840 does not draw a new stroke in the art panel 902. Alternatively, the art rendering engine 840 can remove one or more strokes from the art panel 902.

[0168] In Figure 17M In it, the incorrect sixth stroke is erased from the display 280.

[0169] In Figure 17N In it, the correct way of writing the fourth stroke is shown to the user on the display 280 by a computer-generated stroke 1702 (with or without an arrow), preferably using a different color (e.g., green instead of black).

[0170] In Figure 17O In it, the computer-generated stroke 1701 is erased.

[0171] In Figure 17P In it, the user writes the sixth stroke again in the display 280 within the nine-square grid 901. The feedback method 1100 is executed, and it is determined that this time the accuracy score 1101 exceeds the threshold 1102. As a result, the art rendering engine 840 draws an additional stroke in the art panel 902 (using the data in the art library 740).

[0172] In Figure 17QIn this case, the user writes the seventh stroke in the display 280 within the grid 901. The feedback method 1100 is executed, and it is determined that the accuracy score 1101 exceeds the threshold 1102. As a result, the art rendering engine 840 draws an additional stroke in the art panel 902 (using data from the art library 740).

[0173] At this point, the user has successfully written the entire reference Chinese character 1700 accurately enough.

[0174] The system can now provide the user with practice of the same Chinese character using the shadowless option previously described with respect to FIG. 15.

[0175] Reference Figure 13-1 The course descriptions discussed in Reference 7 are merely examples of the general process of a course illustrated with only two Chinese characters and two artworks that can be used in an educational software environment. Those of ordinary skill in the art will understand that these examples can be extended to an infinite number of additional Chinese characters.

[0176] Figures 18A to 18F FIG. 15 depicts a calibration process 1800. The calibration process 1800 is used to set or refine the threshold 1102 so that the user or teacher can modify the system to be as lenient or as strict as desired. The calibration process 1800 itself is also a process instructive to the user, in which he or she can practice the finer aspects of stroke generation and can receive useful feedback on each stroke.

[0177] Figure 18A FIG. 19 depicts a portion of the reference Chinese character 1700, specifically, the first two strokes of the reference Chinese character 1700.

[0178] Figure 18B FIG. 23 depicts a checkpoint 1801 and a peripheral checkpoint 1802 of the reference Chinese character 1700. The Chinese character comparison engine 810 can use the checkpoint 1801 and the peripheral checkpoint 1802 to determine the accuracy score 1101.

[0179] Figure 18C FIG. 27 depicts a first example of the user writing the first two strokes of the reference Chinese character 1700. In this instance, the user's strokes are relatively accurate as determined by the deviation of the user's strokes from the checkpoint 1801 and the peripheral checkpoint 1802. The user input box 1803 is displayed on the screen to solicit calibration feedback from the user or teacher. The Chinese character comparison engine 810 determines the accuracy score 1101 and depicts the accuracy score 1101 as a number with a simple label "Score" (here "95"). The user or teacher is asked whether the accuracy score 1101 is acceptable. In this example, the threshold 1102 is initially set to 100. If the user or teacher selects "Yes", the threshold 1102 is set to the current value of the accuracy score 1101 (here 95).

[0180] Figure 18D depicts a second example of the user writing the first two strokes of the reference Chinese character 1700. In this instance, the user's strokes are not as Figure 18C accurate as in, as determined by the deviation of the user's strokes from the checkpoint 1801 and the surrounding checkpoints 1802. Again, the Chinese character comparison engine 810 determines the accuracy score 1101 and depicts the accuracy score 1101 as a number with the simple label "Score" (here "90"). The user or teacher is asked whether the accuracy score 1101 is acceptable. If the user or teacher selects "Yes", the threshold 1102 is set to the current value of the accuracy score 1101 (here "90"). If the user or teacher selects "No", the threshold 1102 remains unchanged.

[0181] Figure 18E depicts a third example of the user writing the first two strokes of the reference Chinese character 1700. In this instance, the user's strokes are not as Figure 18C accurate as in or 18D, as determined by the deviation of the user's strokes from the checkpoint 1801 and the surrounding checkpoints 1802. Again, the Chinese character comparison engine 810 determines the accuracy score 1101 and depicts the accuracy score 1101 as a number with the simple label "Score" (here "80"). The user or teacher is asked whether the accuracy score 1101 is acceptable. If the user or teacher selects "Yes", the threshold 1102 is set to the current value of the accuracy score 1101 (here "80"). If the user or teacher selects "No", the threshold 1102 remains unchanged.

[0182] Figure 18F depicts a fourth example of the user writing the first two strokes of the reference Chinese character 1700. In this instance, the user's strokes are not as Figure 18C , 18D accurate as in, as determined by the deviation of the user's strokes from the checkpoint 1801 and the surrounding checkpoints 1802. Again, the Chinese character comparison engine 810 determines the accuracy score 1101 and depicts the accuracy score 1101 as a number with the simple label "Score" (here "70"). The user or teacher is asked whether the accuracy score 1101 is acceptable. If the user or teacher selects "Yes", the threshold 1102 is set to the current value of the accuracy score 1101 (here "70"). If the user or teacher selects "No", the threshold 1102 remains unchanged.

[0183] Using the calibration process 1800, the user can increase the strictness of the stroke evaluation process as he or she becomes more proficient. On the other hand, if the user is a young child or a beginner, the calibration process 1800 also allows the threshold 1102 to be set at a lenient level.

[0184] The systems and methods described herein provide a computerized environment for users to learn how to accurately write characters from languages such as Chinese while receiving musical feedback, sound feedback, art feedback, and Chinese character feedback, and also to learn how to create Chinese classical paintings of meticulous and freehand brushwork at the same time.

[0185] The reference to the present invention in this text is not intended to limit the scope of any claim or claim term, but instead only refers to one or more features that may be covered by one or more of the claims. The above materials, processes, and numerical examples are merely exemplary and should not be considered as limiting the claims. It should be noted that, as used herein, both the terms "on" and "upon" inclusively include "directly on" (with no intervening material, element, or space therebetween) and "indirectly on" (with intervening material, element, or space therebetween). Similarly, the term "adjacent" includes "directly adjacent" (with no intervening material, element, or space therebetween) and "indirectly adjacent" (with intervening material, element, or space therebetween). For example, forming an element "on a substrate" may include forming the element directly on the substrate with no intervening material / element therebetween, and forming the element indirectly on the substrate with one or more intervening materials / elements therebetween.

Claims

1. A method for providing visual feedback to a user in response to written Chinese characters input by the user, comprising: generating a cross-grid and an art panel on a display of a computing device; generating a reference Chinese character in a first color on the display; fading the reference Chinese character to a second color on the display; generating strokes input by the user in the cross-grid on the display; determining an accuracy score of the strokes based on data of the reference Chinese character and data of all Chinese characters, wherein the data of the reference Chinese character includes stroke placement and stroke direction, and the data of all Chinese characters includes multiple stroke order rules applicable to all Chinese characters; comparing the accuracy score with a predetermined threshold; and when the accuracy score exceeds the predetermined threshold, generating a part of an art including a first set of strokes in the art panel on the display as visual feedback to the user, wherein the art is different from the reference Chinese character, and the first set of strokes is different from the strokes input by the user.

2. The method according to claim 1, further comprising: generating a second stroke input by the user in the cross-grid on the display; determining an accuracy score of the second stroke based on data of the reference Chinese character; comparing the accuracy score with a predetermined threshold; and when the accuracy score is less than the predetermined threshold, removing one or more strokes from a part of the art in the art panel on the display as visual feedback to the user.

3. The method according to claim 2, further comprising: generating a correct version of the second stroke on the display as visual feedback to the user.

4. The method according to claim 2, further comprising: generating an audio pronunciation of the reference Chinese character in response to user input.

5. The method according to claim 2, further comprising: generating a text spelling of the reference Chinese character in a language different from the reference Chinese character in response to user input.

6. The method according to claim 1, further comprising: selecting a reference Chinese character based on information input by the user before the step of generating the reference Chinese character on the display.

7. The method according to claim 1, wherein the art includes contour lines.

8. The method according to claim 1, wherein the art does not include contour lines.

9. A computer system for providing visual feedback to a user in response to written Chinese characters input by the user, comprising: a display; a user input device; a processor; a computer medium storing instructions that, when executed by the processor, cause the following steps to be performed: generating a cross-grid and an art panel on a display of a computing device; generating a reference Chinese character in a first color on the display; fading the reference Chinese character to a second color on the display; generating strokes input by the user in the cross-grid on the display; determining an accuracy score of the strokes based on data of the reference Chinese character and data of all Chinese characters, wherein the data of the reference Chinese character includes stroke placement and stroke direction, and the data of all Chinese characters includes multiple stroke order rules applicable to all Chinese characters; comparing the accuracy score with a predetermined threshold; and When the accuracy score exceeds a predetermined threshold, a portion of the artwork including the first set of strokes is generated in the artwork panel on the display as visual feedback to the user, where the artwork is different from the reference Chinese character, and the first set of strokes is different from the strokes entered by the user.

10. The computer system according to claim 9, wherein the computer medium further stores instructions that, when executed by the processor, cause the following steps to be performed: Generate a second stroke entered by the user in the cross grid on the display; Determine an accuracy score for the second stroke based on the data of the reference Chinese character; Compare the accuracy score with a predetermined threshold; and When the accuracy score is less than the predetermined threshold, remove one or more strokes from a portion of the artwork in the artwork panel on the display as visual feedback to the user.

11. The computer system according to claim 10, wherein the computer medium further stores instructions that, when executed by the processor, cause the following steps to be performed: Generate a correct version of the second stroke on the display as visual feedback to the user.

12. The computer system according to claim 10, wherein the computer medium further stores instructions that, when executed by the processor, cause the following steps to be performed: Generate an audio pronunciation of the reference Chinese character in response to a user input.

13. The computer system according to claim 10, wherein the computer medium further stores instructions that, when executed by the processor, cause the following steps to be performed: Generate a text spelling of the reference Chinese character in a language different from the reference Chinese character in response to a user input.

14. The computer system according to claim 9, wherein the computer medium further stores instructions that, when executed by the processor, cause the following steps to be performed: Before generating the reference Chinese character on the display, select the reference Chinese character based on the information entered by the user.

15. The computer system according to claim 9, wherein the artwork includes contour lines.

16. The computer system according to claim 9, wherein the artwork does not include contour lines.

Images