Chinese character stroke sequence learning system combining character and image processing
By combining Chinese character stroke sequence learning system with text and image processing, multimedia learning experience and real-time feedback are provided, the problems of incomplete understanding of Chinese characters and lack of interactivity in traditional learning methods are solved, and the order and cultural background of Chinese characters are improved by students' writing order and cultural background of Chinese characters are improved. The understanding of language ability and cultural literacy has promoted the improvement of language ability and cultural literacy.
Patent Information
- Application Number
- CN202411712654.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-27
- Publication Date
- 2024-12-31
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The traditional Chinese character learning method focuses on the order of writing strokes, ignores the pronunciation and meaning of Chinese characters, leading to students' understanding of Chinese characters one-sidedly, affecting the comprehensive development of language ability, and lack of interactivity, leading to students' bored mentality.
Design a Chinese character stroke sequence learning system combining text and image processing, including a touch display screen and a handwriting board, and provides an image recognition and processing module, an animation display module, a database, a user interface, a knowledge explanation module and an interactive evaluation and evaluation module. Multimedia learning experience, capture and feedback user writing actions in real time, and display the correct stroke order and cultural background.
This system not only helps students fully understand the writing order and cultural background of Chinese characters, but also improves their interest and participation in learning. Through real-time feedback and evaluation reports, it promotes the improvement of language ability and cultural literacy, and avoids one-sided understanding of Chinese characters.
Smart Images

Figure CN119229695A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of Chinese character stroke order learning, and particularly to a Chinese character stroke order learning system combining text and image processing. Background Art
[0002] Chinese characters are the writing system of the Chinese language. It is a logographic script, that is, each Chinese character usually represents a meaning or a word. Chinese characters are composed of one or more strokes, and different strokes have different writing methods. Mastering the stroke order of Chinese characters helps to improve writing fluency and aesthetics. The writing stroke order of Chinese characters follows certain rules. Generally, write the horizontal stroke first and then the vertical stroke, such as the character "十" (ten), write the horizontal stroke first and then the vertical stroke; write the left-falling stroke first and then the right-falling stroke, such as the character "人" (person), write the left-falling stroke first and then the right-falling stroke; from top to bottom, such as the character "三" (three), write the top horizontal stroke first, then the middle horizontal stroke, and finally the bottom horizontal stroke; from left to right, such as the character "汉" (Han), write the three dots on the left first and then the right part; write the outer part first, then the inner part and then seal it, such as the character "国" (country), write the outer frame first, then the "玉" inside, and finally seal it; write the middle part first and then the two sides, such as the character "小" (small), write the vertical hook in the middle first and then the dots on both sides.
[0003] At present, when primary and middle school students learn Chinese characters, they often only focus on the writing stroke order and ignore the pronunciation and meaning of Chinese characters. Such a learning method is likely to lead to one-sided understanding of Chinese characters by students and affect the all-round development of language ability. Chinese characters are not only writing symbols, but also carry rich culture and history. Learning writing alone may cause students to be unable to understand the context and meaning of Chinese characters in actual use. Moreover, in traditional writing learning, writing practice is mostly carried out through exercise books, copybooks, etc., and there is often a lack of interactivity, which makes students prone to boredom. In view of this, it is necessary to explore and research a Chinese character stroke order learning system combining text and image processing. Summary of the Invention
[0004] The present invention provides a Chinese character stroke order learning system combining text and image processing to solve the technical problems existing in the background art.
[0005] To solve the above problems, the technical solution of the present invention is as follows: A Chinese character stroke sequence learning system combining text and image processing comprises hardware and software, wherein the hardware comprises a touch screen and a handwriting board; the software comprises an image recognition and processing module, an animation display module, a database, a user interface, a knowledge explanation module, and an interactive evaluation module; the touch screen is used as the main interface for user interaction with the system, and displays the stroke sequence animation, image and other contents of Chinese characters; the handwriting board is used for the user's Chinese character writing practice and captures the user's writing action in real time; the image recognition and processing module is used to recognize the Chinese characters written by the user on the writing board, judge the correctness of the stroke sequence, and provide feedback; the animation display module is used to display the correct writing sequence of Chinese characters in steps, and vividly demonstrate the writing method of each stroke through animation; the database is used to store knowledge materials such as the stroke sequence, cultural background, pronunciation and meaning, and exercises of Chinese characters; the user interface is used to provide an interactive interface between the learner and the system; the knowledge explanation module is used to explain the meaning, usage and cultural background of Chinese characters through multi-media forms such as text, pictures, audio and video; the interactive evaluation module is used to generate test questions and evaluate the learning progress of the learner.
[0006] Preferably, the touch display screen is provided with a display engine, a user interaction interface, an animation player and an image display; the display engine is used to display Chinese character stroke sequence animation, images, text and other contents; the user interaction interface supports touch operation and provides interactive buttons and menus; the animation player is used to play the animation of the Chinese character stroke sequence; the image display is used to display Chinese character images, cultural background images, etc.; the handwriting board is provided with a pressure sensor, a coordinate positioning module, a data transmission interface and a user feedback display module; the sensor is used to sense the user's writing strength; the coordinate positioning module is used to capture the writing stroke position and trajectory; the data transmission interface is used to transmit the captured data to the image recognition and processing module; the user feedback display module is used to display the user's writing results and feedback information.
[0007] Preferably, the image recognition and processing module is provided with an image recognition engine, a feature extraction submodule and a comparison and analysis submodule; the image recognition engine is used to obtain and recognize the Chinese character image written by the user from the handwriting board; the feature extraction submodule is used to extract the shape, direction and other features of the strokes; the comparison and analysis submodule is used to compare the extracted features with the standard stroke order information in the database.
[0008] Preferably, the multi-level features are automatically extracted from the image by the CNN algorithm in the feature extraction submodule, and the specific steps are as follows: S1: Preprocess the image captured by the handwriting tablet, including binarization, denoising, etc.; S2: Use CNN to extract the shape and direction features of the strokes. CNN automatically extracts multi-level features from the image through multi-layer convolution and pooling operations; S3: Convert the extracted features into feature vector form to facilitate subsequent comparative analysis; S4: Compare the extracted feature vector with the standard stroke sequence information in the database, determine the correctness of the stroke sequence, and generate feedback information.
[0009] Preferably, the animation display module is provided with an animation generator, an animation player and a stroke annotation module; the animation generator is used to generate an animation of the stroke order of Chinese characters; the animation player is used to play the animation to display the writing order and method of each stroke; the stroke annotation is used to display the name and order of each stroke in the animation.
[0010] Preferably, the database includes a Chinese character stroke order database, a Chinese character culture and history database, and an exercise question bank database; the Chinese character stroke order database is used to store standard stroke order information of Chinese characters, including the writing order, number of strokes and writing method of each Chinese character; the Chinese character culture and history database is used to provide the cultural background, historical origin, evolution process and usage of each Chinese character in the language; the exercise question bank database is used to store various exercises and evaluation tests related to Chinese character learning.
[0011] Preferably, the user interface is provided with a menu bar, a user information storage module and a navigation tool; the menu bar is used to provide a function menu to the user; the user information storage module is used to save user account, password and other information; the navigation tool is used to help the user switch between different function modules.
[0012] Preferably, the knowledge explanation module is provided with multimedia content management, content display engine and interactive learning tools; the multimedia content management is used to manage multimedia content such as text, pictures, audio and video; the content display engine is used to display multimedia content and supports the playback of text, pictures, audio and video; the interactive learning tool is used to provide interactive learning tools, such as exercises, test questions, etc.
[0013] Preferably, the interactive assessment module is provided with a question generator, an answer evaluation submodule and a result analysis submodule; the question generator is used to generate various types of test questions; the answer evaluation submodule is used to compare user answers with standard answers; the result analysis submodule is used to generate an assessment report based on the results.
[0014] The present invention also provides a Chinese character stroke sequence learning method combining text and image processing, comprising the following steps: S1: The user selects a Chinese character on the touch screen; S2: The system extracts the stroke sequence, cultural background, pronunciation and meaning of the Chinese character from the database, plays the stroke writing animation on the touch screen through the animation display module, and provides the relevant pronunciation and interpretation through the knowledge explanation module; S3: The system generates an animation of the stroke sequence of Chinese characters through the animation generator in the animation display module. The animation player plays the animation to display the writing sequence and method of each stroke. The stroke annotation module displays the name and sequence of each stroke in the animation, and displays it to the user through the touch screen for viewing and learning. S4: The user practices writing Chinese characters in sequence on the handwriting board. The pressure sensor in the handwriting board senses the writing force. The coordinate positioning module captures the stroke position and trajectory. The data transmission interface transmits the captured data to the image recognition and processing module. S5: The image recognition and processing module recognizes the Chinese character image written by the user, extracts the stroke features through the CNN algorithm, and compares it with the standard stroke sequence information in the database to determine the correctness of the stroke sequence. If it is correct, it will record the result and provide positive feedback; if it is incorrect, it will provide guiding feedback, which will be displayed to the user by the user feedback display module; S6: The user generates test questions through the interactive assessment module. After the user answers, the answer assessment submodule compares the user's answer with the standard answer, and the result analysis submodule generates an assessment report based on the result.
[0015] The above technical solution of the present invention has the following beneficial technical effects: 1. This system not only focuses on the stroke order of Chinese characters, but also uses a database and knowledge explanation module, using text, pictures, audio and video and other media to explain the meaning, usage and cultural background of Chinese characters, helping students to fully understand the rich culture and history carried by Chinese characters and avoid a one-sided understanding of Chinese characters. Through the cooperation of the handwriting board and the image recognition and processing module, it can capture the user's writing actions in real time, recognize the written Chinese characters, judge the correctness of the stroke order, and provide timely feedback, which helps students to find their own writing problems and correct them in time; 2. This system uses the animation display module to vividly demonstrate the writing order and method of Chinese characters, providing visually intuitive teaching, making the learning process more vivid and interesting, and improving students' participation and interest. The interactive evaluation module can generate test questions based on students' learning progress, and generate evaluation reports through answer evaluation and result analysis, so that students can understand their learning situation clearly, and it is also convenient for teachers or parents to understand students' learning progress so as to provide targeted guidance. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1This is a structural block diagram of a Chinese character stroke sequence learning system that combines text and image processing according to the present invention. DETAILED DESCRIPTION
[0017] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention is further described in detail below in conjunction with its embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention. For those skilled in the art, other systems, methods and / or features of the present embodiment will become apparent after reviewing the following detailed description. It is intended that all such additional systems, methods, features and advantages are included in this specification, are included within the scope of the present invention, and are protected by the appended claims. Additional features of the disclosed embodiments are described in the following detailed description, and these features will be apparent from the following detailed description.
[0018] The same or similar numbers in the drawings of the embodiments of the present invention correspond to the same or similar parts; in the description of the present invention, it should be understood that if the terms "upper", "lower", "left", "right" and the like indicate the orientation or position relationship based on the orientation or position relationship shown in the drawings, it is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or component referred to must have a specific orientation. It is constructed and operated in a specific orientation. Therefore, the terms describing the position relationship in the drawings are only used for illustrative purposes and cannot be understood as a limitation on this patent. For ordinary technicians in this field, the specific meanings of the above terms can be understood according to specific circumstances. Embodiment 1
[0019] Please see attached Figure 1, A Chinese character stroke order learning system that combines text and image processing, including hardware and software. The hardware includes a touch display screen and a writing tablet; the software includes an image recognition and processing module, an animation display module, a database, a user interface, a knowledge explanation module, and an interactive evaluation and assessment module; the touch display screen is the main interface for users to interact with the system, displaying content such as Chinese character stroke order animations and images; the writing tablet is used for users to practice writing Chinese characters and captures the writing actions of users in real time; the image recognition and processing module is used to recognize the Chinese characters written by users on the writing board, judge the correctness of the stroke order, and provide feedback; the animation display module is used to display the correct writing order of Chinese characters step by step and vividly demonstrate the writing method of each stroke through animations; the database is used to store knowledge materials such as the stroke order, cultural background, pronunciation, meaning, and exercise questions of Chinese characters; the user interface is used to provide an interaction interface between learners and the system; the knowledge explanation module is used to explain the meaning, usage, and cultural background of Chinese characters through multiple media forms such as text, pictures, audio, and video; the interactive evaluation and assessment module is used to generate test questions and evaluate the learning progress of learners.
[0020] In this embodiment, a display engine, a user interaction interface, an animation player, and an image displayer are provided inside the touch display screen; the display engine is used to display content such as Chinese character stroke order animations, images, and texts; the user interaction interface supports touch operations and provides interactive buttons and menus; the animation player is used to play the animations of Chinese character stroke order; the image displayer is used to display Chinese character images, cultural background images, etc.
[0021] Specifically, the display engine is responsible for displaying Chinese character stroke order animations, images, texts, etc. For example, it can display the stroke animation of the character "人", Chinese character images, and related text explanations; the user interaction interface supports touch operations and has interactive buttons and menus, such as buttons like "Start Learning", "Practice", "Assessment", etc.; the animation player is responsible for playing the animations of Chinese character stroke order, such as playing the writing order animation of the character "天"; the image displayer is responsible for displaying Chinese character images, cultural background images, etc., for example, displaying the pictographic picture of the character "山" and its symbolic meaning image in ancient culture.
[0022] In this embodiment, a pressure sensor, a coordinate positioning module, a data transmission interface, and a user feedback display module are provided inside the writing tablet; the sensor is used to sense the writing force of users; the coordinate positioning module is used to capture the stroke position and trajectory of writing; the data transmission interface is used to transmit the captured data to the image recognition and processing module; the user feedback display module is used to display the writing results and feedback information of users.
[0023] Specifically, the pressure sensor can sense the writing force of the user. For example, when writing the character "大", it can sense the degree of force; the coordinate positioning module is responsible for capturing the stroke position and trajectory of the writing, and recording the coordinate position of each stroke when writing the character "木"; the data transmission interface transmits the captured data to the image recognition and processing module, such as transmitting the relevant data of writing the character "水"; the user feedback display module is responsible for displaying the writing result and feedback information of the user. If the stroke order of writing the character "火" is incorrect, an error prompt and guiding opinions will be displayed here.
[0024] In this embodiment, an image recognition engine, a feature extraction sub-module, and a comparison and analysis sub-module are provided in the image recognition and processing module; the image recognition engine is used to obtain and recognize the Chinese character image written by the user from the writing board; the feature extraction sub-module is used to extract features such as the shape and direction of the strokes; the comparison and analysis sub-module is used to compare the extracted features with the standard stroke order information in the database.
[0025] In this embodiment, in the feature extraction sub-module, multi-level features are automatically extracted from the image through the CNN algorithm. The specific steps are as follows: S1: Preprocess the image captured by the writing board, including binarization, denoising, etc.; S2: Use CNN to extract the shape and direction features of the strokes. CNN automatically extracts multi-level features from the image through multiple convolutional and pooling operations; S3: Convert the extracted features into the form of feature vectors for subsequent comparison and analysis; S4: Compare the extracted feature vectors with the standard stroke order information in the database to judge the correctness of the stroke order and generate feedback information.
[0026] Specifically, the image recognition engine is responsible for obtaining and recognizing the Chinese character image written by the user from the writing board, such as recognizing the image of the character "土" written by the user; the feature extraction sub-module extracts features such as the shape and direction of the strokes through the CNN algorithm. Taking the character "口" as an example, it extracts its square shape feature and stroke direction feature; the comparison and analysis sub-module is responsible for comparing the extracted features with the standard stroke order information in the database to judge whether the stroke order is correct when writing the character "日".
[0027] In this embodiment, an animation generator, an animation player, and a stroke annotation module are provided in the animation display module; the animation generator is used to generate an animation of the Chinese character stroke order; the animation player is used to play the animation to show the writing order and method of each stroke; the stroke annotation is used to display the name and order of each stroke in the animation.
[0028] Specifically, the animation generator is responsible for generating animations of the stroke order of Chinese characters, such as generating an animation of the writing order of the character "目"; the animation player is responsible for playing the animation to show the writing order and method of each stroke, such as playing the animation of the character "耳" to show how each stroke is written; the stroke annotation module is responsible for displaying the name and order of each stroke in the animation, such as annotating the name of each stroke in the animation of the character "手".
[0029] In this embodiment, the database includes a Chinese character stroke order database, a Chinese character culture and history database, and an exercise question bank database; the Chinese character stroke order database is used to store the standard stroke order information of Chinese characters, including the writing order, the number of strokes, and the writing method of each Chinese character; the Chinese character culture and history database is used to provide the cultural background, historical origin, evolution process, and its usage in the language related to each Chinese character; the exercise question bank database is used to store various exercise questions and assessment tests related to Chinese character learning.
[0030] Specifically, the Chinese character stroke order database is responsible for storing the standard stroke order information of Chinese characters. For example, the writing order of the character "田" is to write the outer part first, then the inner part, and finally seal it. The number of strokes is 5, and its writing method, etc.; the Chinese character culture and history database is responsible for providing the cultural background, historical origin, evolution process, and its usage in the language related to each Chinese character. For example, the meaning and evolution of the character "月" in ancient poems; the exercise question bank database is responsible for storing various exercise questions and assessment tests related to Chinese character learning, such as exercise questions for judging the writing order of the character "禾".
[0031] In this embodiment, a menu bar, a user information storage module, and a navigation tool are set in the user interface; the menu bar is used to provide function menus to the user; the user information storage module is used to save information such as the user account and password; the navigation tool is used to help the user switch between different function modules.
[0032] Specifically, the menu bar provides function menus, such as options like "Learning Resources", "Writing Practice", "Assessment and Examination", etc.; the user information storage module is responsible for saving information such as the user account and password, such as storing the user name as "Xiaoming" and the password as "123456", etc.; the navigation tool is responsible for helping the user switch between different function modules, facilitating the switch from the "Animation Display" module to the "Interactive Assessment and Evaluation" module.
[0033] In this embodiment, a multimedia content management, a content display engine, and an interactive learning tool are set in the knowledge explanation module; the multimedia content management is used to manage multimedia content such as text, pictures, audio, and video; the content display engine is used to display multimedia content, supporting the playback of text, pictures, audio, and video; the interactive learning tool is used to provide interactive learning tools, such as exercise questions and test questions.
[0034] Specifically, multimedia content management is responsible for managing multimedia content such as text, pictures, audio and video, such as managing the pronunciation audio and meaning pictures of the word "stone"; the content display engine is responsible for displaying multimedia content and supports the playback of text, pictures, audio and video, such as playing an explanation video about the word "gold"; interactive learning tools are responsible for providing interactive learning tools, such as exercises, test questions, etc., including test questions on the meaning of the word "wood".
[0035] In this embodiment, the interactive assessment module is provided with a question generator, an answer evaluation submodule and a result analysis submodule; the question generator is used to generate various types of test questions; the answer evaluation submodule is used to compare user answers with standard answers; the result analysis submodule is used to generate an assessment report based on the results.
[0036] Specifically, the question generator is responsible for generating various types of test questions, such as multiple-choice questions and fill-in-the-blank questions about the stroke order and meaning of the word "water"; the answer evaluation submodule is responsible for comparing the user's answers with the standard answers, and judging whether the user's answers to the test questions related to the word "fire" are right or wrong; the result analysis submodule is responsible for generating an evaluation report based on the results, such as generating an evaluation report on the user after learning the word "earth", showing the degree of mastery, etc. Embodiment 2
[0037] See also Figure 1 The present application also discloses a Chinese teaching interactive method with a teaching effect feedback function, comprising the following steps: S1: The user selects a Chinese character on the touch screen; S2: The system extracts the stroke sequence, cultural background, pronunciation and meaning of the Chinese character from the database, plays the stroke writing animation on the touch screen through the animation display module, and provides the relevant pronunciation and interpretation through the knowledge explanation module; S3: The system generates an animation of the stroke sequence of Chinese characters through the animation generator in the animation display module. The animation player plays the animation to display the writing sequence and method of each stroke. The stroke annotation module displays the name and sequence of each stroke in the animation, and displays it to the user through the touch screen for viewing and learning. S4: The user practices writing Chinese characters in sequence on the handwriting board. The pressure sensor in the handwriting board senses the writing force. The coordinate positioning module captures the stroke position and trajectory. The data transmission interface transmits the captured data to the image recognition and processing module. S5: The image recognition and processing module recognizes the Chinese character image written by the user, extracts the stroke features through the CNN algorithm, and compares them with the standard stroke order information in the database to determine the correctness of the stroke order. If it is correct, the result will be recorded and positive feedback will be provided; if it is incorrect, guiding feedback will be provided, and the feedback will be displayed to the user by the user feedback display module. S6: The user generates test questions through the interactive evaluation module. After the user answers, the answer evaluation sub-module compares the user's answer with the standard answer, and the result analysis sub-module generates an evaluation report based on the result. Embodiment III
[0038] Refer to the appendix Figure 1 , this embodiment is based on the previous embodiment. The difference from the previous embodiment is that this application is further described by taking the study of the character "人" as an example. The specific process is as follows: S1: The user selects the character "人" on the touch display screen. S2: The system extracts relevant knowledge such as the stroke order (first the left-falling stroke and then the right-falling stroke), cultural background (representing the image of a person, etc.), pronunciation and meaning (pronounced as "rén", meaning a higher animal that can make tools and use tools for labor) of the character "人" from the database, plays the stroke writing animation of the character "人" on the touch screen through the animation display module, and at the same time the knowledge explanation module provides the relevant pronunciation and interpretation.
[0039] S3: The system generates an animation of the stroke order of the character "人" through the animation generator in the animation display module. The animation player plays the animation to show the writing order and method of each stroke, and the stroke annotation module displays the name and order of each stroke in the animation, and is displayed to the user through the touch display screen for viewing and learning.
[0040] S4: The user practices writing the character "人" on the writing board according to the order. The pressure sensor in the writing board senses the writing force, the coordinate positioning module captures the stroke position and trajectory, and the data transmission interface transmits the captured data to the image recognition and processing module.
[0041] S5: The image recognition and processing module recognizes the image of the character "人" written by the user, extracts the stroke features through the CNN algorithm, and compares them with the standard stroke order information in the database to determine the correctness of the stroke order. If it is correct, the result will be recorded and positive feedback (such as "The writing is correct, great!") will be provided; if it is incorrect, guiding feedback (such as "The left-falling stroke should be written first, and the right-falling stroke should be written more smoothly") will be provided, and the feedback will be displayed to the user by the user feedback display module.
[0042] S6: The user generates test questions about the character "人" through the interactive evaluation module. After the user answers, the answer evaluation sub-module compares the user's answer with the standard answer, and the result analysis sub-module generates an evaluation report based on the result (showing the mastery of the character "人", etc.).
[0043] This system not only focuses on the stroke order of Chinese characters, but also through the database and knowledge explanation module, uses various media forms such as text, pictures, audio, and video to explain the meaning, usage, and cultural background of Chinese characters, helping students comprehensively understand the rich culture and history carried by Chinese characters and avoiding one-sided understanding of Chinese characters. For example, when learning the character "龙", in addition to showing the stroke order, it can also explain the pronunciation through audio, show the evolution of the image of the dragon with pictures, and introduce the symbolic meaning of the dragon in Chinese culture with videos; the handwriting board and the image recognition and processing module cooperate to be able to capture the user's writing actions in real time, recognize the written Chinese characters, judge the correctness of the stroke order, and provide feedback in a timely manner, which helps students discover and correct their writing problems in a timely manner. For example, when a student writes the wrong stroke order of the character "木", they can immediately get a prompt and correction; the animation display module vividly demonstrates the writing order and method of Chinese characters through animation, providing visual intuitive teaching, making the learning process more vivid and interesting, and improving students' participation and interest; through the interactive evaluation module, test questions can be generated according to the learning progress of students, and an evaluation report can be generated through answer evaluation and result analysis, enabling students to clearly understand their learning situation and also facilitating teachers or parents to understand the learning progress of students for targeted guidance.
[0044] From the above description, it can be seen that the Chinese character stroke order learning system combining text and image processing of the present invention can not only help students accurately master the writing order of Chinese characters, but also deepen the understanding of Chinese characters, stimulate learning interest, and improve learning effects. Through multimedia teaching, real-time feedback, personalized guidance and other methods, the system can provide a comprehensive, interactive and interesting learning experience, promoting the overall improvement of students' language ability and cultural accomplishment.
[0045] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention, according to the technical solution of the present invention and its improved concept, makes equivalent substitutions or changes, and all should be covered by the protection scope of the present invention.
Claims
1. A Chinese character stroke sequence learning system combining text and image processing, comprising hardware and software, wherein the hardware comprises a touch screen and a handwriting board; the software comprises an image recognition and processing module, an animation display module, a database, a user interface, a knowledge explanation module, and an interactive evaluation module; the touch screen is used as the main interface for user interaction with the system, and displays the stroke sequence animation, image and other contents of Chinese characters; the handwriting board is used for the user's Chinese character writing practice and captures the user's writing movements in real time; the image recognition and processing module is used to recognize the Chinese characters written by the user on the writing board, judge the correctness of the stroke sequence, and provide feedback; the animation display module is used to display the correct writing sequence of Chinese characters in steps, and demonstrate the writing method of each stroke in an animated image; the database is used to store knowledge materials such as the stroke sequence, cultural background, pronunciation and meaning, and exercises of Chinese characters; the user interface is used to provide an interactive interface between the learner and the system; the knowledge explanation module is used to explain the meaning, usage and cultural background of Chinese characters through multi-media forms such as text, pictures, audio and video; the interactive evaluation module is used to generate test questions and evaluate the learning progress of the learner.
2. A Chinese character stroke sequence learning system combining text and image processing according to claim 1, characterized in that: The touch screen is provided with a display engine, a user interaction interface, an animation player and an image displayer; the display engine is used to display Chinese character stroke sequence animation, images, texts and other contents; The user interaction interface supports touch operation and provides interactive buttons and menus; the animation player is used to play animations of the stroke sequence of Chinese characters; the image displayer is used to display Chinese character images, cultural background images, etc.; the handwriting board is provided with a pressure sensor, a coordinate positioning module, a data transmission interface and a user feedback display module; the sensor is used to sense the writing force of the user; the coordinate positioning module is used to capture the stroke position and trajectory of the writing; the data transmission interface is used to transmit the captured data to the image recognition and processing module; The user feedback display module is used to display the user's writing results and feedback information.
3. The Chinese character stroke sequence learning system combining text and image processing according to claim 1, characterized in that: The image recognition and processing module is provided with an image recognition engine, a feature extraction submodule and a comparison and analysis submodule; the image recognition engine is used to obtain and recognize the Chinese character image written by the user from the handwriting board; the feature extraction submodule is used to extract the shape, direction and other features of the strokes; The comparison and analysis submodule is used to compare the extracted features with the standard stroke sequence information in the database.
4. A Chinese character stroke sequence learning system combining text and image processing according to claim 3, characterized in that: In the feature extraction submodule, multi-level features are automatically extracted from the image through the CNN algorithm. The specific steps are as follows: S1: Preprocess the image captured by the handwriting tablet, including binarization, denoising, etc.; S2: Use CNN to extract the shape and direction features of the strokes. CNN automatically extracts multi-level features from the image through multi-layer convolution and pooling operations; S3: Convert the extracted features into feature vector form to facilitate subsequent comparative analysis; S4: Compare the extracted feature vector with the standard stroke sequence information in the database, determine the correctness of the stroke sequence, and generate feedback information.
5. The Chinese character stroke sequence learning system combining text and image processing according to claim 1, characterized in that: The animation display module is provided with an animation generator, an animation player and a stroke annotation module; the animation generator is used to generate an animation of the stroke sequence of Chinese characters; the animation player is used to play the animation to display the writing sequence and method of each stroke; the stroke annotation is used to display the name and sequence of each stroke in the animation.
6. The Chinese character stroke sequence learning system combining text and image processing according to claim 1, characterized in that: The database includes a Chinese character stroke order database, a Chinese character culture and history database, and an exercise question database; the Chinese character stroke order database is used to store standard stroke order information of Chinese characters, including the writing order, number of strokes and writing method of each Chinese character; the Chinese character culture and history database is used to provide the cultural background, historical origin, evolution process and usage of each Chinese character in the language; the exercise question database is used to store various exercises and evaluation tests related to Chinese character learning.
7. The Chinese character stroke sequence learning system combining text and image processing according to claim 1, characterized in that: The user interface is provided with a menu bar, a user information storage module and a navigation tool; the menu bar is used to provide a function menu to the user; the user information storage module is used to store user account, password and other information; The navigation tool is used to help the user switch between different functional modules.
8. The Chinese character stroke sequence learning system combining text and image processing according to claim 1, characterized in that: The knowledge explanation module is provided with a multimedia content management, a content display engine and an interactive learning tool; the multimedia content management is used to manage multimedia content such as text, pictures, audio and video; the content display engine is used to display multimedia content and supports the playback of text, pictures, audio and video; The interactive learning tool is used to provide interactive learning tools, such as exercises, test questions, etc.
9. The Chinese character stroke sequence learning system combining text and image processing according to claim 1, characterized in that: The interactive assessment module is provided with a question generator, an answer assessment submodule and a result analysis submodule; the question generator is used to generate various types of test questions; the answer assessment submodule is used to compare the user's answer with the standard answer; The result analysis submodule is used to generate an evaluation report based on the results.
10. The Chinese character stroke sequence learning system combining text and image processing according to claim 1, characterized in that: The Chinese character stroke sequence learning method combining text and image processing comprises the following steps: S1: The user selects a Chinese character on the touch screen; S2: The system extracts the stroke sequence, cultural background, pronunciation and meaning of the Chinese character from the database, plays the stroke writing animation on the touch screen through the animation display module, and provides the relevant pronunciation and interpretation through the knowledge explanation module; S3: The system generates an animation of the stroke sequence of Chinese characters through the animation generator in the animation display module. The animation player plays the animation to display the writing sequence and method of each stroke. The stroke annotation module displays the name and sequence of each stroke in the animation, and displays it to the user through the touch screen for viewing and learning. S4: The user practices writing Chinese characters in sequence on the handwriting board. The pressure sensor in the handwriting board senses the writing force. The coordinate positioning module captures the stroke position and trajectory. The data transmission interface transmits the captured data to the image recognition and processing module. S5: The image recognition and processing module recognizes the Chinese character image written by the user, extracts the stroke features through the CNN algorithm, and compares it with the standard stroke sequence information in the database to determine the correctness of the stroke sequence. If it is correct, it will record the result and provide positive feedback; if it is incorrect, it will provide guiding feedback, which will be displayed to the user by the user feedback display module; S6: The user generates test questions through the interactive assessment module. After the user answers, the answer assessment submodule compares the user's answer with the standard answer, and the result analysis submodule generates an assessment report based on the result.
