Auxiliary learning method and device for high school English reading understanding
By combining OCR recognition and ChatGPT technology, a personalized high school English reading comprehension assisted learning method is provided, which solves the reading comprehension problem of students in the absence of teachers, and realizes efficient English learning experience and multi-difficulty mode analysis, which improves students' Learning efficiency and learning experience.
Patent Information
- Application Number
- CN202411030068.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-30
- Publication Date
- 2024-12-17
- Estimated Expiration
- 2044-07-30
AI Technical Summary
The existing technology cannot effectively assist students in in-depth and intensive reading of high school English reading comprehension in the absence of teachers, resulting in time-consuming and laborious searching for comprehension by word, and lacking personalized learning experience.
By obtaining evaluation scores, dividing learning mode, combining OCR recognition and neural network model to extract text content, using ChatGPT to provide personalized analysis and related article highlighting, realizing multi-difficulty pattern recognition and analysis of high school English reading comprehension, and supporting users' customized learning interests Featured words and collection functions.
It realizes efficient English reading comprehension assisted learning in the absence of teachers, provides personalized article analysis and analysis, simulates teacher explanation, and improves students' English learning experience and learning efficiency.
Smart Images

Figure CN119149721A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of text target extraction in computer vision, and in particular to a method and device for assisting learning of high school English reading comprehension. Background Art
[0002] In the English subject, reading comprehension is a very important part, and it accounts for a particularly high proportion in the exam. In order to fully understand and grasp an English reading comprehension, intensive reading is very necessary. Most English teachers will spend a lot of time on precision analysis for students during teaching to facilitate their understanding. However, many high-quality extracurricular readings cannot be assisted by teachers, and teachers are also unable to intensively read the rest of the articles for each student. Therefore, this software for auxiliary learning is very important to meet the needs of the majority of students and play a substitute role in the absence of teachers.
[0003] There are many question-searching and learning software in the current market, such as Baidu Question Search and Xiaoyuan Question Search, but they can only provide answers through online matching or can only provide users with existing reading comprehension in the database, and cannot perform machine-assisted in-depth reading of paper reading comprehension in reality. In the absence of a teacher's explanation, students can only choose to copy answers or watch articles on the software that may not be high-quality or new. When faced with a good paper article, they can only search and understand it word by word, which is time-consuming and laborious. In this regard, our English reading assistance learning software exists in smartphones, which can take photos anytime and anywhere for machine-assisted understanding, and quickly analyze the essence and key points of an article without a teacher or classmates. Summary of the invention
[0004] The present invention provides a high school English reading comprehension auxiliary learning method and device to solve the problems existing in the prior art.
[0005] In a first aspect, the present invention provides a method for assisting learning of high school English reading comprehension, or in other words, a method for processing pictures or texts containing English reading content, which specifically comprises the following steps:
[0006] Step S1, obtaining evaluation scores, dividing learning modes according to the evaluation scores, and identifying and parsing words and sentences of different difficulty modes;
[0007] Step S2, obtaining learning interest feature words, obtaining high-quality related articles through the interface of ChatGPT using the learning interest feature words, and highlighting the related articles;
[0008] Step S3: Collect important words, article contents and their analysis.
[0009] Preferably, in step S1, the difficulty mode includes "low", "medium" and "high", wherein "low" corresponds to CET-4 words, "medium" corresponds to CET-6 words, and "high" corresponds to IELTS words.
[0010] Preferably, in step S1, an evaluation score is obtained, and after the learning mode is divided according to the evaluation score, words and sentences of different difficulty levels are identified and parsed, which specifically includes the following steps:
[0011] Step S101, based on the uploaded reading comprehension picture or text, combined with OCR recognition technology, segment and extract the article body and the topic body;
[0012] Step S102, traverse the English words in the article, match them one by one with the key words for high school English that are pre-imported into the database, highlight the matched words in red in the article, add a link and click it to open a window to display the analysis of the word;
[0013] Step S103, traverse the English phrases in the article, match them one by one with the key phrases for high school English that have been pre-imported into the database, highlight the matched phrases in yellow in the article, and add a link to open a window to display the analysis of the phrase when clicked;
[0014] Step S104, traverse the English words in the article, and match them with the pre-set databases of different difficulty levels according to the difficulty mode selected by the user, highlight the matched words in blue in the article, and add a link to open a window to display the analysis of the word when clicked;
[0015] Step S105, performing similarity matching between the extracted title content text and the sentence text of the article, and underlining one or two sentences with the highest similarity;
[0016] Step S106: Segment all sentences in the article by periods, match long and difficult sentences according to grammatical analysis and word count, and change them to italics to highlight them.
[0017] Preferably, in step S101, based on the uploaded reading comprehension picture or text, combined with OCR recognition technology, the article body and the topic body are segmented and extracted, which specifically includes the following steps:
[0018] Step S101a, preprocessing the uploaded reading comprehension picture to form a preprocessed reading comprehension picture;
[0019] Step S101b, inputting the preprocessed reading comprehension picture into the neural network model, and separating the characters in the image through the neural network model to form separated characters;
[0020] Step S101c: converting the separated characters through a machine learning algorithm to form editable text obtained after the reading comprehension picture is recognized;
[0021] Step S101d: forming complete text content based on the editable text obtained after the reading comprehension picture is recognized and the uploaded reading comprehension text.
[0022] Preferably, the preprocessing in step S101a includes performing operations such as denoising, binarization, and tilt correction on the image to improve the recognition rate.
[0023] Preferably, in step S105, the similarity matching is implemented by an NLP algorithm, and the semantic similarity between the two texts based on the semantic vectors is calculated, which specifically includes the following steps:
[0024] Step S105a, segment the text using the jieba function library to obtain a vocabulary list for each text;
[0025] Step S105b, converting each word into a vector according to the value in the vocabulary list through the Word2Vec model;
[0026] Step S105c, performing weighted averaging on the vocabulary vectors of each text to form a semantic vector of each text;
[0027] Step S105d: Calculate the semantic similarity between two texts based on the semantic vector of each text.
[0028] Preferably, in step S105a, the vocabulary list of each text includes information such as the number of occurrences of the text and context.
[0029] Preferably, in step S105d, the similarity between the semantic vectors of the two texts is calculated, and the specific formula is as follows:
[0030]
[0031] Among them, similarity semantic (text i ,text j ) indicates text i and text j The semantic similarity between texti Represents text i The semantic vector of ||v texti || represents the semantic vector v texti The norm of <v texti ,v textj > represents the inner product of two semantic vectors.
[0032] Preferably, in step S106, syntactic analysis is performed based on a maximum margin Markov network, specifically comprising the following steps:
[0033] Step S106a, perform word segmentation and part-of-speech tagging on each input sentence through the Jieba function library;
[0034] Step S106b, extracting the current word, part of speech and dependency data provided by the jieba function library from each sentence to form feature data;
[0035] Step S106c, constructing a graph structure according to the feature data;
[0036] Step S106d, calculating the score of each dependency relationship through the maximum margin Markov model, and finding the optimal dependency tree structure through the decoding algorithm;
[0037] Step S106e: convert the optimal dependency tree structure into a syntactic analysis result.
[0038] Preferably, in step S106c, the graph structure includes nodes and edges; wherein the nodes represent each word in the sentence, and the edges represent the dependency relationship between the words.
[0039] Preferably, in step S106d, the decoding algorithm includes a Viterbi algorithm, and the calculation formula of the Viterbi algorithm is as follows:
[0040] δ t (i) = max P(i t =i,i t-1 ,…,i1,o t ,…,o1|λ), i=1,2,…,N
[0041] Among them, δ t (i) represents the maximum probability value of all nodes in state i at time t (i.e., the shortest path from left to right in a graph structure). t represents the shortest path, o t represents the observation matrix parameters, o t is a constant, λ represents the probability matrix parameter, and λ is a constant.
[0042] Preferably, in step S106e, the optimal dependency tree structure is converted into a syntactic analysis result, and the specific calculation formula is as follows:
[0043]
[0044] Among them, Φ(x, y) represents the feature vector of the syntactic tree y corresponding to x, w represents the feature weight, and G(x) represents the syntactic rule to which x belongs.
[0045] Preferably, in step S2, learning interest feature words are obtained, high-quality related articles are obtained by accessing the ChatGPT interface with the learning interest feature words, and the related articles are highlighted, which specifically includes the following steps:
[0046] Step S201: After acquiring the learning interest feature words, call the ChatGPT interface and send a query request to ChatGPT;
[0047] Step S202: After receiving the query request, ChatGPT processes the query request, obtains high-quality articles related to the learning interest feature words, and returns them;
[0048] Step S203: obtaining high-quality articles related to the learning interest feature words obtained through ChatGPT through an interface, and highlighting the related articles.
[0049] Preferably, in step S201, the query request includes a query request formed according to the learning interest feature word for guiding ChatGPT to obtain high-quality articles related to the learning interest feature word.
[0050] Preferably, in step S203, highlighting the relevant articles specifically includes the following steps:
[0051] Step S203a, obtain the key words that must be tested in high school English and import them into the database, traverse the English words in the article, match them one by one with the words in the database, highlight the matched words in red in the article, add a link and click it to open a window to display the analysis of this word;
[0052] Step S203b, obtain the key phrases that must be tested in high school English and import them into the database, traverse the English phrases in the article, match them one by one with the phrases in the database, highlight the matched phrases in yellow in the article, add a link and click it to open a window to display the analysis of this phrase;
[0053] Step S203c, obtain CET-4 words, CET-6 words, and IELTS words and import them into different databases respectively, traverse the English words in the article, match them with different databases according to the selected difficulty mode, highlight the matched words in blue in the article, add a link and click it to open a window to display the analysis of this word.
[0054] Preferably, in step S3, the collected content and analysis can be viewed at any time.
[0055] In a second aspect, the present invention further provides a high school English reading comprehension auxiliary learning device, or a device for processing pictures or texts containing English reading content, which specifically includes the following modules:
[0056] A sentence recognition and parsing module is used to obtain evaluation scores, divide the learning modes according to the evaluation scores, and then recognize and parse the words and sentences of different difficulty modes;
[0057] A highlighting processing module is used to obtain learning interest feature words, obtain high-quality related articles through the interface of ChatGPT using the learning interest feature words, and highlight the related articles;
[0058] The collection processing module is used to collect important words, article contents and their analysis.
[0059] Preferably, in the sentence recognition and parsing module, the difficulty modes include "low", "medium" and "high", wherein "low" corresponds to CET-4 words, "medium" corresponds to CET-6 words, and "high" corresponds to IELTS words.
[0060] Preferably, the sentence recognition and parsing module specifically includes the following submodules:
[0061] The first submodule of sentence recognition and parsing is used to segment and extract the main body of the article and the main body of the title based on the uploaded reading comprehension picture or text combined with OCR recognition technology;
[0062] The second submodule of sentence recognition and analysis is used to traverse the English words in the article and match them one by one with the key high school English test words pre-imported into the database, highlight the matched words in red in the article, and add a link to open a window to display the analysis of this word when clicked;
[0063] The third submodule of sentence recognition and analysis is used to traverse the English phrases in the article and match them one by one with the key phrases for high school English that have been pre-imported into the database. The matched phrases are highlighted in yellow in the article, and a link is added to open a window to display the analysis of the phrase when clicked.
[0064] The fourth submodule of sentence recognition and parsing is used to traverse the English words in the article, match them with the pre-set databases of different difficulty levels according to the difficulty mode selected by the user, highlight the matched words in blue in the article, and add a link to open a window to display the analysis of this word when clicked;
[0065] The fifth submodule of sentence recognition and parsing is used to perform similarity matching between the extracted title content text and the sentence text of the article, and underline one or two sentences with the highest similarity;
[0066] The sixth submodule of sentence recognition and parsing is used to segment all sentences in the article by periods, match long and difficult sentences according to grammatical analysis and word count, and change them to italics to highlight them.
[0067] Preferably, the sentence recognition and parsing first submodule specifically includes the following submodules:
[0068] The first processing module is used to pre-process the uploaded reading comprehension picture to form a pre-processed reading comprehension picture;
[0069] The second processing module is used to input the pre-processed reading comprehension picture into the neural network model, and separate the characters in the image through the neural network model to form separated characters;
[0070] The third processing module is used to convert the separated characters through a machine learning algorithm to form an editable text obtained after the reading comprehension picture recognition;
[0071] The fourth processing module is used to form complete text content based on the editable text obtained after the reading comprehension picture is recognized and the uploaded reading comprehension text.
[0072] Preferably, in the first processing module, the preprocessing includes performing operations such as denoising, binarization, and tilt correction on the image to improve the recognition rate.
[0073] Preferably, the fifth submodule of sentence recognition and parsing specifically includes the following submodules:
[0074] The fifth processing module is used to segment the text through the jieba function library to obtain a vocabulary list for each text;
[0075] The sixth processing module is used to convert each word into a vector according to the value in the vocabulary list through the Word2Vec model;
[0076] The seventh processing module is used to perform weighted averaging on the vocabulary vectors of each text to form a semantic vector of each text;
[0077] The eighth processing module is used to calculate the semantic similarity between two texts according to the semantic vector of each text.
[0078] Preferably, in the fifth processing module, the vocabulary list of each text includes information such as the number of times the text appears and the context.
[0079] Preferably, in the eighth processing module, the similarity between the semantic vectors of two texts is calculated, and the specific formula is as follows:
[0080]
[0081] Among them, similarity semantic (text i ,text j) indicates text i and text j The semantic similarity between texti Represents text i The semantic vector of ||v texti ||×||v textj || represents the semantic vector V texti and v textj The inner product between <v texti , V textj > represents the inner product of two semantic vectors.
[0082] Preferably, the sixth submodule of sentence recognition and analysis specifically includes the following submodules:
[0083] The ninth processing module is used to perform word segmentation and part-of-speech tagging on each input sentence through the jieba function library;
[0084] The tenth processing module is used to extract the current word, part of speech and dependency data provided by the jieba function library from each sentence to form feature data;
[0085] an eleventh processing module, for constructing a graph structure according to the feature data;
[0086] The twelfth processing module is used to calculate the score of each dependency relationship through the maximum margin Markov model and find the optimal dependency tree structure through the decoding algorithm;
[0087] The thirteenth processing module is used to convert the optimal dependency tree structure into a syntactic analysis result.
[0088] Preferably, in the eleventh processing module, the graph structure includes nodes and edges; wherein the nodes represent each word in the sentence, and the edges represent the dependency relationship between the words.
[0089] Preferably, in the twelfth processing module, the decoding algorithm includes a Viterbi algorithm, and the calculation formula of the Viterbi algorithm is as follows:
[0090] δ t (i) = max P(i t =i,i t-1 ,…,i1,o t ,…,o1|λ), i=1,2,…,N
[0091] Among them, δ t (i) represents the maximum probability value of all nodes in state i at time t (i.e., the shortest path from left to right in a graph structure). t represents the shortest path, o trepresents the observation matrix parameters, o t is a constant, λ represents the probability matrix parameter, and λ is a constant.
[0092] Preferably, in the thirteenth processing module, the optimal dependency tree structure is converted into a syntactic analysis result, and the specific calculation formula is as follows:
[0093]
[0094] Among them, Φ(x, y) represents the feature vector of the syntactic tree y corresponding to x, w represents the feature weight, and G(x) represents the syntactic rule to which x belongs.
[0095] Preferably, the highlight processing module specifically includes the following submodules:
[0096] The first submodule of highlight processing is used to obtain the learning interest feature words, call the ChatGPT interface and send a query request to ChatGPT;
[0097] The second submodule of highlighting processing is used to process the query request after ChatGPT receives the query request, obtain high-quality articles related to the learning interest feature words and return them;
[0098] The third submodule of highlighting processing is used to obtain high-quality articles related to the learning interest feature words obtained through ChatGPT through an interface, and highlight the related articles.
[0099] Preferably, in the first submodule of highlighting processing, the query request includes a query request formed according to the learning interest feature words for guiding ChatGPT to obtain high-quality articles related to the learning interest feature words.
[0100] Preferably, the third submodule of highlighting processing specifically includes the following submodules:
[0101] The first submodule of highlight processing is used to obtain the key words that must be tested in high school English and import them into the database, traverse the English words in the article, match them with the words in the database one by one, highlight the matched words in red in the article, add a link and click it to open a window to display the analysis of this word;
[0102] The second module of highlight processing is used to obtain the key phrases that must be tested in high school English and import them into the database, traverse the English phrases in the article, match them with the phrases in the database one by one, highlight the matched phrases in yellow in the article, and add a link to open a window to display the analysis of this phrase when clicked;
[0103] The third module of highlight processing is used to obtain CET-4 words, CET-6 words, and IELTS words and import them into different databases respectively. It traverses the English words in the article and matches them with different databases according to the selected difficulty mode. The matched words are highlighted in blue in the article, and a link is added to open a window to display the analysis of this word when clicked.
[0104] Preferably, the content and analysis after the collection processing by the collection processing module can be viewed at any time.
[0105] In a third aspect, the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a high school English reading comprehension auxiliary learning method as described in any one of the first aspects of the present application.
[0106] In a fourth aspect, the present invention further provides an electronic device, comprising: a memory storing a computer program; and a processor communicatively connected to the memory, for executing a high school English reading comprehension assisted learning method described in any one of the first aspects of the present application when the computer program is called.
[0107] Compared with the prior art, the present invention has the following obvious outstanding substantive features and significant advantages:
[0108] The present invention provides a method and device for assisting learning of high school English reading comprehension, which solves the problems existing in the prior art. It has the following advantages: (1) The present invention is an auxiliary learning software for high school English subject reading comprehension questions, which can effectively help students better improve their English learning ability. With multiple difficulty modes, users can choose a learning method that suits them to learn English reading, which is more personalized. At the same time, the present invention does not provide actual answers. All methods are based on replacing the teacher's ideas to provide detailed article analysis for learning, and truly simulate the teacher's explanation in English class. (2) The present invention provides analysis for English reading by embedding the ChatGPT large model, and further customizes the relevant articles that users want to read. The multimodal analysis capability and real-time processing capability of the large model give unique advantages, allowing users to freely pursue topics of interest, thereby maximizing the release of personalized ideas and concepts. BRIEF DESCRIPTION OF THE DRAWINGS
[0109] The accompanying drawings, which constitute part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention. In the accompanying drawings:
[0110] Figure 1 It is a flow chart of a high school English reading comprehension auxiliary learning method according to a preferred embodiment of the present invention.
[0111] Figure 2 It is a flow chart of a high school English reading comprehension auxiliary learning software according to a preferred embodiment of the present invention.
[0112] Figure 3 It is a structural diagram of a high school English reading comprehension auxiliary learning device according to a preferred embodiment of the present invention. DETAILED DESCRIPTION
[0113] The present invention provides a high school English reading comprehension auxiliary learning method and device. In order to make the purpose, technical solution and effect of the present invention clearer and more specific, the present invention is further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0114] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0115] Embodiment 1:
[0116] The embodiment of the present application provides a method for assisting learning of high school English reading comprehension, the execution subject of the method can be a smart terminal, and the smart terminal can be any user-end device with a learning app installed, specifically a smart phone, a tablet computer and a computer. The smart terminal can assist users in learning high school English subject reading comprehension questions based on the installed learning app. In the process of executing the above processing, the smart terminal can communicate with the background server of the learning app to obtain the relevant data required in the above process. Of course, in another feasible scenario, the above method can also be completed by the background server of the smart terminal and the learning app, that is, the smart terminal can be used to interact with the user, and transmit the interaction-related data to the background server for processing, and receive the processing results sent by the background server, and the background server can be used to receive the interaction-related data transmitted by the smart terminal, and based on the preset data processing logic, generate and feedback the corresponding processing results. This embodiment is explained by taking the execution subject as a smart terminal as an example, and the collaborative processing process of the smart terminal and the background server is similar to it, and this embodiment will not be repeated.
[0117] The following will be combined with specific implementation methods. Figure 1-Figure 2 The processing flow shown in the figure is described in detail. Figure 1-Figure 2 As shown, the high school English reading comprehension auxiliary learning method described in this embodiment specifically includes the following steps:
[0118] Step S1, inquiring the user about the specific learning level, obtaining the evaluation score input by the user, dividing the learning mode according to the evaluation score, and identifying and parsing words and sentences of different difficulty levels.
[0119] The difficulty modes include "low", "medium" and "high", wherein "low" corresponds to CET-4 words, "medium" corresponds to CET-6 words, and "high" corresponds to IELTS words.
[0120] Optionally, step S1 specifically includes the following steps:
[0121] Step S101: Based on the uploaded reading comprehension picture or text, the article body and the title body are segmented and extracted in combination with OCR recognition technology.
[0122] Optionally, step S101 specifically includes the following steps:
[0123] Step S101a: pre-process the uploaded reading comprehension picture to form a pre-processed reading comprehension picture.
[0124] The preprocessing includes performing operations such as denoising, binarization, and tilt correction on the image to improve the recognition rate.
[0125] Step S101b: input the preprocessed reading comprehension image into the neural network model, and separate the characters in the image through the neural network model to form separated characters.
[0126] Step S101c: convert the separated characters through a machine learning algorithm to form an editable text obtained after the reading comprehension picture is recognized.
[0127] Step S101d: forming complete text content based on the editable text obtained after the reading comprehension picture is recognized and the uploaded reading comprehension text.
[0128] Step S102, traverse the English words in the article, and match them one by one with the key high school English test words pre-imported into the database, highlight the matched words in red in the article, add a link and click it to open a window to display the analysis of this word.
[0129] Step S103, traverse the English phrases in the article, match them one by one with the key phrases for high school English that have been pre-imported into the database, highlight the matched phrases in yellow in the article, add a link and click it to open a window to display the analysis of the phrase.
[0130] Step S104, traverse the English words in the article, and match them with different pre-set databases according to the difficulty mode selected by the user, highlight the matched words in blue in the article, add a link and click it to open a window to display the analysis of this word; wherein, different databases are pre-imported into the database, storing words for CET-4, CET-6 and IELTS respectively to correspond to different difficulty levels. When the difficulty mode selected by the user is "low", the program queries the CET-4 database, when the difficulty mode selected by the user is "medium", the program queries the CET-6 database, and when the difficulty mode selected by the user is "high", the program queries the IELTS database.
[0131] Step S105: perform similarity matching between the extracted title content text and the sentence text of the article, and underline one or two sentences with the highest similarity.
[0132] Optionally, step S105 specifically includes the following steps:
[0133] Step S105a: segment the text using the jieba function library to obtain a vocabulary list for each text.
[0134] The vocabulary list of each text includes information such as the number of times the text appears and the context.
[0135] Step S105b: Convert each word into a vector according to the value in the vocabulary list through the Word2Vec model.
[0136] Step S105c: perform weighted averaging on the vocabulary vectors of each text to form a semantic vector for each text.
[0137] Step S105d: Calculate the semantic similarity between two texts based on the semantic vector of each text.
[0138] Among them, the similarity between the semantic vectors of two texts is calculated. The specific formula is as follows:
[0139]
[0140] Among them, similarity semantic (text i ,text j ) indicates text i and text j The semantic similarity between texti Represents text i The semantic vector of ||v texti ||×||v textj || represents the semantic vector V texti and vtextj The inner product between <v texti , V textj > represents the inner product of two semantic vectors.
[0141] Step S106: Segment all sentences in the article by periods, match long and difficult sentences according to grammatical analysis and word count, and change them to italics to highlight them.
[0142] Optionally, syntactic analysis is performed based on a maximum margin Markov network, specifically including the following steps:
[0143] Step S106a: perform word segmentation and part-of-speech tagging on each input sentence through the jieba function library.
[0144] Step S106b: extract the current word, part of speech and dependency data provided by the jieba function library from each sentence to form feature data.
[0145] Step S106c: construct a graph structure according to the feature data.
[0146] The graph structure includes nodes and edges; the nodes represent each word in the sentence, and the edges represent the dependency relationship between the words.
[0147] Step S106d: Calculate the score of each dependency relationship through the maximum margin Markov model, and find the optimal dependency tree structure through the decoding algorithm.
[0148] The decoding algorithm includes the Viterbi algorithm, and the calculation formula of the Viterbi algorithm is as follows:
[0149] δ t (i) = maxP(i t =i,i t-1 ,…,i1,o t ,…,o1|λ), i=1,2,…,N
[0150] Among them, δ t (i) represents the maximum probability value of all nodes in state i at time t (i.e., the shortest path from left to right in a graph structure). t represents the shortest path, o t represents the observation matrix parameters, o t is a constant, λ represents the probability matrix parameter, and λ is a constant.
[0151] Step S106e: convert the optimal dependency tree structure into a syntactic analysis result.
[0152] Among them, the optimal dependency tree structure is converted into a syntactic analysis result. The specific calculation formula is as follows:
[0153]
[0154] Among them, Φ(x, y) represents the feature vector of the syntactic tree y corresponding to x, w represents the feature weight, and G(x) represents the syntactic rule to which x belongs.
[0155] Step S2: further inquire about the user's learning interests, obtain the learning interest feature words input by the user, obtain high-quality related articles through the interface of ChatGPT using the learning interest feature words, and highlight the related articles.
[0156] Optionally, step S2 specifically includes the following steps:
[0157] Step S201: After acquiring the learning interest feature words, call the ChatGPT interface and send a query request to ChatGPT.
[0158] The query request includes information formed based on learning interest feature words for guiding ChatGPT to obtain high-quality articles related to the learning interest feature words.
[0159] Step S202: After receiving the query request, ChatGPT processes the query request, obtains high-quality articles related to the learning interest feature words, and returns them.
[0160] Step S203: obtaining high-quality articles related to the learning interest feature words obtained through ChatGPT through an interface, and highlighting the related articles.
[0161] Optionally, the step S203 specifically includes the following steps:
[0162] Step S203a, traverse the English words in the article, match them one by one with the key high school English test words pre-imported into the database, highlight the matched words in red in the article, add a link and click it to open a window to display the analysis of this word.
[0163] Step S203b, traverse the English phrases in the article, match them one by one with the key phrases for high school English that have been pre-imported into the database, highlight the matched phrases in yellow in the article, and add a link to open a window to display the analysis of this phrase when clicked.
[0164] Step S203c, traverse the English words in the article, and match them with different pre-set databases according to the difficulty mode selected by the user, highlight the matched words in blue in the article, add a link and click it to open a window to display the analysis of this word; among which, different databases are pre-imported into the database, which store words for CET-4, CET-6 and IELTS respectively to correspond to different difficulty levels. When the difficulty mode selected by the user is "low", the program queries the CET-4 database, when the difficulty mode selected by the user is "medium", the program queries the CET-6 database, and when the difficulty mode selected by the user is "high", the program queries the IELTS database.
[0165] Step S3: Collect important words, article contents and their analysis.
[0166] In an embodiment, a collection function is provided to the user to enhance the user's learning and review experience. The user can select necessary words and articles to be collected, and view the collected content and analysis in the collection folder at any time.
[0167] For example, when a user encounters a word that needs special attention during browsing, the user can directly click on the word. Then, the program will pop up a detailed analysis window of this word at the top of the page or at a specified location. In the upper right corner of the analysis window, there is an obvious five-pointed star icon as a collection button. After the user clicks this five-pointed star icon, the word and its analysis information will be automatically recorded in a special collection word database for subsequent reference.
[0168] Similarly, when users want to collect articles, they click on the article title or designated area, and the program will display the full window of the article content. There is a five-pointed star collection button in the upper right corner of the article content. After the user clicks it, the entire article and its related information will be recorded in the special collection article database.
[0169] To facilitate users to manage and view the collected content, the favorites are divided into two parts: word favorites and article favorites, so that users can view them separately. For example, in the word favorites, the collected words themselves can be displayed in a list format, which is convenient for users to quickly identify; in the article favorites, the first 5 words of each article are displayed as a preview to help users quickly recall the content of the article. If users need to view the complete information of a word or article, they only need to click the corresponding item in the favorites, and the program will call and display the collected content from the corresponding database.
[0170] Embodiment 2:
[0171] Based on the same technical concept, this embodiment also provides a high school English reading comprehension auxiliary learning device, such as Figure 3 As shown, the device specifically includes the following modules:
[0172] The sentence recognition and parsing module is used to obtain evaluation scores, divide the learning modes according to the evaluation scores, and then recognize and parse words and sentences of different difficulty modes.
[0173] The difficulty modes include "low", "medium" and "high", wherein "low" corresponds to CET-4 words, "medium" corresponds to CET-6 words, and "high" corresponds to IELTS words.
[0174] Among them, the sentence recognition and parsing module specifically includes the following sub-modules:
[0175] The first submodule of sentence recognition and parsing is used to segment and extract the main body of the article and the main body of the title based on the uploaded reading comprehension picture or text combined with OCR recognition technology.
[0176] Optionally, the sentence recognition and parsing first submodule specifically includes the following submodules:
[0177] The first processing module is used to pre-process the uploaded reading comprehension picture to form a pre-processed reading comprehension picture.
[0178] The preprocessing includes performing operations such as denoising, binarization, and tilt correction on the image to improve the recognition rate.
[0179] The second processing module is used to input the pre-processed reading comprehension picture into the neural network model, and separate the characters in the image through the neural network model to form separated characters.
[0180] The third processing module is used to convert the separated characters through a machine learning algorithm to form an editable text obtained after the reading comprehension picture recognition.
[0181] The fourth processing module is used to form complete text content based on the editable text obtained after the reading comprehension picture is recognized and the uploaded reading comprehension text.
[0182] The second submodule of sentence recognition and analysis is used to traverse the English words in the article and match them one by one with the key high school English test words that have been pre-imported into the database. The matched words are highlighted in red in the article, and a link is added to open a window to display the analysis of this word when clicked.
[0183] The third submodule of sentence recognition and analysis is used to traverse the English phrases in the article and match them one by one with the key phrases for high school English that have been pre-imported into the database. The matched phrases are highlighted in yellow in the article, and a link is added to open a window to display the analysis of this phrase when clicked.
[0184] The fourth submodule of sentence recognition and analysis is used to obtain CET-4 words, CET-6 words, and IELTS words and import them into different databases respectively, traverse the English words in the article, and match them with different pre-set databases according to the difficulty mode selected by the user. The matched words are highlighted in blue in the article, and a link is added and clicked to open a window to display the analysis of the word; among them, different databases are pre-imported into the database, which store CET-4, CET-6 and IELTS words respectively to correspond to different difficulty levels. When the difficulty mode selected by the user is "low", the program queries the CET-4 database, when the difficulty mode selected by the user is "medium", the program queries the CET-6 database, and when the difficulty mode selected by the user is "high", the program queries the IELTS database.
[0185] The fifth submodule of sentence recognition and analysis is used to perform similarity matching between the extracted title content text and the sentence text of the article, and to highlight the one or two sentences with the highest similarity by underlining.
[0186] Optionally, the fifth submodule of sentence recognition and parsing specifically includes the following submodules:
[0187] The fifth processing module is used to segment the text through the jieba function library to obtain a vocabulary list for each text.
[0188] The vocabulary list of each text includes information such as the number of times the text appears and the context.
[0189] The sixth processing module is used to convert each word into a vector according to the value in the vocabulary list through the Word2Vec model.
[0190] The seventh processing module is used to perform weighted averaging on the vocabulary vectors of each text to form a semantic vector for each text.
[0191] The eighth processing module is used to calculate the semantic similarity between two texts according to the semantic vector of each text.
[0192] Among them, the similarity between the semantic vectors of two texts is calculated. The specific formula is as follows:
[0193]
[0194] Among them, similarity semantic (text i ,text j ) indicates text i and text j The semantic similarity between texti Represents text i The semantic vector of ||v texti||×||v textj || represents the semantic vector V texti and v textj The inner product between <v texti , V textj > represents the inner product of two semantic vectors.
[0195] The sixth submodule of sentence recognition and parsing is used to segment all sentences in the article by periods, match long and difficult sentences according to grammatical analysis and word count, and change them to italics to highlight them.
[0196] Optionally, the sixth submodule of sentence recognition and parsing specifically includes the following submodules:
[0197] The ninth processing module is used to perform word segmentation and part-of-speech tagging on each input sentence through the jieba function library.
[0198] The tenth processing module is used to extract the current word, part of speech and dependency data provided by the jieba function library from each sentence to form feature data.
[0199] The eleventh processing module is used to construct a graph structure according to the feature data.
[0200] Preferably, in the eleventh processing module, the graph structure includes nodes and edges; wherein the nodes represent each word in the sentence, and the edges represent the dependency relationship between the words.
[0201] The twelfth processing module is used to calculate the score of each dependency relationship through the maximum margin Markov model and find the optimal dependency tree structure through the decoding algorithm.
[0202] The decoding algorithm includes the Viterbi algorithm, and the calculation formula of the Viterbi algorithm is as follows:
[0203] δ t (i) = max P(i t =i,i t-1 ,…,i1,o t ,…,o1|λ), i=1,2,…,N
[0204] Among them, δ t (i) represents the maximum probability value of all nodes in state i at time t (i.e., the shortest path from left to right in a graph structure). t represents the shortest path, o t represents the observation matrix parameters, o t is a constant, λ represents the probability matrix parameter, and λ is a constant.
[0205] The thirteenth processing module is used to convert the optimal dependency tree structure into a syntactic analysis result.
[0206] Among them, the optimal dependency tree structure is converted into a syntactic analysis result. The specific calculation formula is as follows:
[0207]
[0208] Among them, Φ(x,y) represents the feature vector of the syntactic tree y corresponding to x, w represents the feature weight, and G(x) represents the syntactic rule to which x belongs.
[0209] The highlight processing module is used to obtain learning interest feature words, obtain high-quality related articles through the interface of ChatGPT, and highlight the related articles.
[0210] Optionally, the highlight processing module specifically includes the following submodules:
[0211] The first submodule of highlighting processing is used to obtain the learning interest feature words, call the ChatGPT interface and send a query request to ChatGPT.
[0212] The query request includes information formed based on learning interest feature words for guiding ChatGPT to obtain high-quality articles related to the learning interest feature words.
[0213] The second submodule of highlighting processing is used to process the query request after ChatGPT receives the query request, obtain high-quality articles related to the learning interest feature words and return them.
[0214] The third submodule of highlighting processing is used to obtain high-quality articles related to the learning interest feature words obtained through ChatGPT through an interface, and highlight the related articles.
[0215] Optionally, the third submodule of highlighting processing specifically includes the following submodules:
[0216] The first submodule of highlight processing is used to obtain the key words that must be tested in high school English and import them into the database. It traverses the English words in the article and matches them with the words in the database one by one. The matched words are highlighted in red in the article, and a link is added and clicked to open a window to display the analysis of this word.
[0217] The second module of highlight processing is used to obtain the key phrases that must be tested in high school English and import them into the database. It traverses the English phrases in the article and matches them with the phrases in the database one by one. The matched phrases are highlighted in yellow in the article, and a link is added to open a window to display the analysis of this phrase when clicked.
[0218] The third module of highlight processing is used to obtain CET-4 words, CET-6 words, and IELTS words and import them into different databases respectively. It traverses the English words in the article and matches them with different databases according to the selected difficulty mode. The matched words are highlighted in blue in the article, and a link is added to open a window to display the analysis of this word when clicked.
[0219] The collection processing module is used to collect important words and article content and their analysis, and the content and analysis after the collection processing by the collection processing module can be viewed at any time.
[0220] The embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, it implements the high school English reading comprehension auxiliary learning method described in Embodiment 1 of the present application.
[0221] An embodiment of the present application also provides an electronic device, which includes: a memory storing a computer program; and a processor communicatively connected to the memory, and executing a high school English reading comprehension assisted learning method described in Embodiment 1 of the present application when the computer program is called.
[0222] The specific embodiments of the present invention are described in detail above, but they are only examples, and the present invention is not limited to the specific embodiments described above. For those skilled in the art, any equivalent modifications and substitutions made to the present invention are also within the scope of the present invention. Therefore, the equalization changes and modifications made without departing from the spirit and scope of the present invention should be included in the scope of the present invention.
Claims
1. A method for assisting learning of high school English reading comprehension, characterized in that: The specific steps include: Step S1, obtaining evaluation scores, dividing learning modes according to the evaluation scores, and identifying and parsing words and sentences of different difficulty modes; Step S2, obtaining learning interest feature words, obtaining high-quality related articles through the interface of ChatGPT using the learning interest feature words, and highlighting the related articles; Step S3: Collect important words, article contents and their analysis.
2. The method for assisting learning of high school English reading comprehension according to claim 1 is characterized in that: In step S1, the evaluation score is obtained, and after the learning mode is divided according to the evaluation score, the words and sentences of different difficulty levels are identified and analyzed, which specifically includes the following steps: Step S101, based on the uploaded reading comprehension picture or text, combined with OCR recognition technology, segment and extract the article body and the topic body; Step S102, traverse the English words in the article, match them one by one with the key words for high school English that are pre-imported into the database, highlight the matched words in red in the article, add a link and click it to open a window to display the analysis of the word; Step S103, traverse the English phrases in the article, match them one by one with the key phrases for high school English that have been pre-imported into the database, highlight the matched phrases in yellow in the article, and add a link to open a window to display the analysis of the phrase when clicked; Step S104, traverse the English words in the article, and match them with the pre-set databases of different difficulty levels according to the difficulty mode selected by the user, highlight the matched words in blue in the article, and add a link to open a window to display the analysis of the word when clicked; Step S105, performing similarity matching between the extracted title content text and the sentence text of the article, and underlining one or two sentences with the highest similarity; Step S106: Segment all sentences in the article by periods, match long and difficult sentences according to grammatical analysis and word count, and change them to italics to highlight them.
3. A method for assisting learning of high school English reading comprehension according to claim 2, characterized in that: In step S101, based on the uploaded reading comprehension picture or text, combined with OCR recognition technology, the article body and the title body are segmented and extracted, which specifically includes the following steps: Step S101a, preprocessing the uploaded reading comprehension picture to form a preprocessed reading comprehension picture; Step S101b, inputting the preprocessed reading comprehension picture into the neural network model, and separating the characters in the image through the neural network model to form separated characters; Step S101c: converting the separated characters through a machine learning algorithm to form editable text obtained after the reading comprehension picture is recognized; Step S101d: forming complete text content based on the editable text obtained after the reading comprehension picture is recognized and the uploaded reading comprehension text.
4. The method for assisting high school English reading comprehension learning according to claim 2 is characterized in that: In step S105, the similarity matching is implemented by using an NLP algorithm to calculate the semantic similarity between the two texts based on the semantic vectors, which specifically includes the following steps: Step S105a, segment the text using the jieba function library to obtain a vocabulary list for each text; Step S105b, converting each word into a vector according to the value in the vocabulary list through the Word2Vec model; Step S105c, performing weighted averaging on the vocabulary vectors of each text to form a semantic vector of each text; Step S105d: Calculate the semantic similarity between two texts based on the semantic vector of each text.
5. The method for assisting high school English reading comprehension learning according to claim 2 is characterized in that: In step S106, syntactic analysis is performed based on a maximum margin Markov network, which specifically includes the following steps: Step S106a, perform word segmentation and part-of-speech tagging on each input sentence through the Jieba function library; Step S106b, extracting the current word, part of speech and dependency data provided by the jieba function library from each sentence to form feature data; Step S106c, constructing a graph structure according to the feature data; Step S106d, calculating the score of each dependency relationship through the maximum margin Markov model, and finding the optimal dependency tree structure through the decoding algorithm; Step S106e: convert the optimal dependency tree structure into a syntactic analysis result.
6. The method for assisting high school English reading comprehension learning according to claim 1, characterized in that: In step S2, learning interest feature words are obtained, and high-quality related articles are obtained by accessing the ChatGPT interface with the learning interest feature words, and the related articles are highlighted, which specifically includes the following steps: Step S201: After acquiring the learning interest feature words, call the ChatGPT interface and send a query request to ChatGPT; Step S202: After receiving the query request, ChatGPT processes the query request, obtains high-quality articles related to the learning interest feature words, and returns them; Step S203: obtaining high-quality articles related to the learning interest feature words obtained through ChatGPT through an interface, and highlighting the related articles.
7. A method for assisting high school English reading comprehension learning according to claim 6, characterized in that: In step S203, the relevant articles are highlighted, which specifically includes the following steps: Step S203a, obtain the key words that must be tested in high school English and import them into the database, traverse the English words in the article, match them one by one with the words in the database, highlight the matched words in red in the article, add a link and click it to open a window to display the analysis of this word; Step S203b, obtain the key phrases that must be tested in high school English and import them into the database, traverse the English phrases in the article, match them one by one with the phrases in the database, highlight the matched phrases in yellow in the article, add a link and click it to open a window to display the analysis of this phrase; Step S203c, obtain CET-4 words, CET-6 words, and IELTS words and import them into different databases respectively, traverse the English words in the article, match them with different databases according to the selected difficulty mode, highlight the matched words in blue in the article, add a link and click it to open a window to display the analysis of this word.
8. A device for assisting high school English reading comprehension learning, characterized in that: The modules include: A sentence recognition and parsing module is used to obtain evaluation scores, divide the learning modes according to the evaluation scores, and then recognize and parse the words and sentences of different difficulty modes; A highlight processing module is used to obtain learning interest feature words, obtain high-quality related articles through the interface of ChatGPT using the learning interest feature words, and highlight the related articles; The collection processing module is used to collect important words, article contents and their analysis.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for assisting high school English reading comprehension learning is implemented as described in any one of claims 1 to 7.
10. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a method for assisting high school English reading comprehension learning as described in any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
English text aided teaching method and system based on AI vision
CN111610901A
Machine reading understanding method for traffic infrastructure detection text
CN113312912A
Machine reading understanding method and device
CN114579796A
Multi-feature interaction unsupervised target detection method and system, electronic equipment and readable storage medium
CN114596464A
Computer-implemented hierarchical reading assisting method and related product
CN116483986A
Cited By
Intelligent reading recommendation method and system for assisting learning
CN120832448A
