Method, system and non-transitory computer-readable recording medium for assisting in essay evaluation

The method and system provide objective and accurate essay evaluation by quantitatively assessing essays using predefined criteria, addressing the subjectivity of traditional evaluation methods.

JP2024543663AInactive Publication Date: 2024-11-21WRTN TECHNOLOGIES INC

Patent Information

Application Number
JP2024534654
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-12-09
Filing Date
2022-12-08
Publication Date
2024-11-21
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing essay evaluation methods are subjective and lack objectivity due to the influence of evaluator subjectivity, leading to imprecise results.

Method used

A method and system for quantitatively evaluating essays using predetermined evaluation criteria, extracting evaluation target elements, and determining scores based on these criteria to provide numerical indicators for objective and accurate assessment.

Benefits of technology

Essays are evaluated objectively and accurately using numerical indicators, enabling precise assessment based on predefined criteria.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024543663000001_ABST
    Figure 2024543663000001_ABST
Patent Text Reader

Abstract

According to one aspect of the present invention, there is provided a method for supporting essay evaluation, comprising the steps of extracting evaluation target elements for essay evaluation from a document related to a user, and determining essay evaluation information for the document by referring to a score determined according to evaluation criteria specified for each of the evaluation target elements, wherein the evaluation criteria specified for at least one of the evaluation target elements are determined by referring to a type of the document.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method, a system, and a non-transitory computer-readable recording medium for assisting in essay evaluation. [Background technology]

[0002] Usually, writing (or writing a piece of writing) is done to achieve various goals. For example, writing a personal statement is done to achieve the goal of getting a job or entering a university, while writing a thesis is done to achieve the goal of getting a degree or achieving academic success.

[0003] It is common for such essays to be evaluated in the process of achieving the relevant objectives, but in the past, evaluation of such essays was carried out by specific individuals (e.g., professors, teachers, etc.), and it was not possible to eliminate the possibility that the evaluator's subjectivity would be involved in the evaluation results.

[0004] That is, in the past, there was no technology for quantitatively evaluating compositions, and therefore compositions had to be evaluated in an unobjective and inaccurate manner. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Korean Patent Publication No. 10-2013-0089729 Summary of the Invention [Problem to be solved by the invention]

[0006] An object of the present invention is to solve all of the problems of the prior art described above.

[0007] Another object of the present invention is to quantitatively evaluate an essay based on predetermined evaluation criteria and provide the evaluation results in the form of a numerical index, thereby enabling the evaluation of the essay to be made objectively and accurately. [Means for solving the problem]

[0008] A representative configuration of the present invention for achieving the above object is as follows.

[0009] According to one aspect of the present invention, there is provided a method for supporting essay evaluation, comprising the steps of extracting evaluation target elements for essay evaluation from a document related to a user, and determining essay evaluation information for the document by referring to a score determined according to evaluation criteria specified for each of the evaluation target elements, wherein the evaluation criteria specified for at least one of the evaluation target elements are determined by referring to a type of the document.

[0010] According to another aspect of the present invention, there is provided a system for supporting essay evaluation, comprising: an evaluation target element extraction unit that extracts evaluation target elements for essay evaluation from a document related to a user; and an essay evaluation information determination unit that determines essay evaluation information for the document by referring to a score determined by an evaluation criterion specified for each of the evaluation target elements, wherein the evaluation criterion specified for at least one of the evaluation target elements is determined by referring to a type of the document.

[0011] In addition, other methods for embodying the present invention, other systems, and a non-transitory computer readable recording medium having a computer program for carrying out the methods are also provided. Effect of the Invention

[0012] According to the present invention, an essay is quantitatively evaluated based on a predetermined evaluation criterion, and the evaluation result is provided as a numerical index, thereby enabling an objective and accurate evaluation of the essay. [Brief description of the drawings]

[0013] [Figure 1] 1 is a diagram showing a schematic configuration of an entire system for supporting essay evaluation according to an embodiment of the present invention. [Diagram 2] 2 is a diagram illustrating in detail an internal configuration of an essay evaluation support system according to an embodiment of the present invention. [Diagram 3] 2 is a diagram illustrating an example of a user interface screen provided by an essay evaluation support system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] The following detailed description of the present invention will be made with reference to the accompanying drawings, which show, by way of example, specific embodiments in which the present invention may be practiced. Such embodiments are described in sufficient detail to enable one skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different from one another but are not necessarily mutually exclusive. For example, specific shapes, structures and characteristics described herein may be embodied in one embodiment without departing from the spirit and scope of the present invention. It should also be understood that the location or arrangement of individual components within each embodiment may be changed without departing from the spirit and scope of the present invention. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be taken to include the scope of the claims and all equivalents thereto. In the drawings, like reference numerals indicate the same or similar components throughout the various aspects.

[0015] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, various preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those skilled in the art to which the present invention pertains to easily practice the present invention.

[0016] Overall system configuration

[0017] FIG. 1 is a diagram showing a schematic configuration of an entire system for supporting essay evaluation according to an embodiment of the present invention.

[0018] As shown in FIG. 1, the overall system according to an embodiment of the present invention may include a communication network 100, an essay evaluation support system 200, and a device 300.

[0019] First, the communication network 100 according to an embodiment of the present invention may be configured regardless of the type of communication, such as wired communication or wireless communication, and may be configured as various communication networks, such as a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN). Preferably, the communication network 100 in this specification may be the well-known Internet or World Wide Web (WWW). However, the communication network 100 is not necessarily limited thereto, and may include at least a part of a well-known wired / wireless data communication network, a well-known telephone network, or a well-known wired / wireless television communication network.

[0020] Next, the essay evaluation support system 200 according to an embodiment of the present invention can communicate with a device 300 (described later) through the communication network 100, extract elements to be evaluated for essay evaluation from a document related to a user, and determine essay evaluation information for the document by referring to a score determined according to a specific evaluation criterion for each element to be evaluated. Meanwhile, the essay evaluation support system 200 may be a digital device having a memory means and a microprocessor and a computing capability, and may be, for example, a server system operated on the communication network 100.

[0021] The configuration and functions of the essay evaluation support system 200 according to an embodiment of the present invention will be explained in detail below.

[0022] Next, the device 300 according to one embodiment of the present invention is a digital device having a function of communicating after being connected to the essay evaluation support system 200, and any digital device having a memory means, a microprocessor, and computing power, such as a smartphone, tablet, smart watch, smart band, smart glasses, desktop computer, laptop, workstation, PDA, web pad, mobile phone, etc., may be adopted as the device 300 according to the present invention.

[0023] According to an embodiment of the present invention, the device 300 may further include an application program for performing functions according to the present invention. Such an application may exist in the form of a program module within the device 300. The nature of such a program module may be generally similar to the evaluation target element extraction unit 210, the essay evaluation information determination unit 220, the communication unit 230, and the control unit 240 of the essay evaluation support system 200 described below. Here, at least a part of the application may be replaced with a hardware device or firmware device capable of performing substantially the same or equivalent functions, if necessary.

[0024] Composition of the essay evaluation support system

[0025] Hereinafter, the internal configuration of the essay evaluation support system 200, which performs important functions for implementing the present invention, and the functions of each component will be described in detail.

[0026] FIG. 2 is a diagram illustrating in detail the internal configuration of an essay evaluation support system 200 according to an embodiment of the present invention.

[0027] As shown in FIG. 2, the essay evaluation support system 200 according to an embodiment of the present invention may include an evaluation target element extraction unit 210, an essay evaluation information determination unit 220, a communication unit 230, and a control unit 240. According to an embodiment of the present invention, the evaluation target element extraction unit 210, the essay evaluation information determination unit 220, the communication unit 230, and the control unit 240 of the essay evaluation support system 200 may be program modules, at least some of which communicate with an external system (not shown). Such program modules may be included in the essay evaluation support system 200 in the form of an operating system, an application module, or other program modules, and may be physically stored in various known storage devices. Also, such program modules may be stored in a remote storage device that can communicate with the essay evaluation support system 200. Meanwhile, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform specific tasks or execute specific abstract data types according to the present invention, which will be described later.

[0028] Meanwhile, although the essay evaluation support system 200 has been described above, such description is illustrative, and it will be apparent to those skilled in the art that at least some of the components or functions of the essay evaluation support system 200 may be embodied within the device 300 or a server (not shown) or included in an external system (not shown) as necessary.

[0029] First, the evaluation target element extracting unit 210 according to an embodiment of the present invention may perform a function of extracting evaluation target elements for essay evaluation from a document related to a user.

[0030] According to an embodiment of the present invention, the evaluation target element extraction unit 210 can acquire documents related to the user from the user. For example, the user inputs (or uploads) a document (e.g., a self-introduction, a thesis, a report, etc.) that the user has created to the evaluation target element extraction unit 210 (or a server or platform in which the function of the evaluation target element extraction unit 210 is supported), and the evaluation target element extraction unit 210 can acquire the input document as a document related to the user.

[0031] Furthermore, according to an embodiment of the present invention, the evaluation target element extraction unit 210 can perform pre-processing on the user-related documents acquired as described above. For example, the evaluation target element extraction unit 210 according to an embodiment of the present invention can remove parts (e.g., spaces, special symbols, etc.) that are excluded from composition evaluation from the user-related documents. As another example, the evaluation target element extraction unit 210 according to an embodiment of the present invention can classify text in the user-related documents into morpheme units using a morphological analyzer (e.g., Komoran, Kkma, etc.).

[0032] Furthermore, according to an embodiment of the present invention, the evaluation target element extraction unit 210 can extract evaluation target elements for composition evaluation from the obtained user-related document (or the document on which preprocessing has been performed). Here, the evaluation target elements according to an embodiment of the present invention can include at least one of a word (hereinafter, referred to as a "first evaluation target element"), a sentence (hereinafter, referred to as a "second evaluation target element"), and a paragraph (hereinafter, referred to as a "third evaluation target element").

[0033] Next, the essay evaluation information determination unit 220 according to one embodiment of the present invention may perform a function of determining essay evaluation information for a document related to a user by referring to a score (or evaluation score) determined according to an evaluation criterion specified for each element to be evaluated.

[0034] According to an embodiment of the present invention, the composition evaluation information determination unit 220 may assign (or determine) a score for each evaluation target element based on an evaluation criterion specified for each evaluation target element, and may calculate (or determine) an evaluation score for a document related to a user by calculating (e.g., summing, arithmetic mean, etc.; a weight may be applied to each score based on a predetermined ratio, and this ratio is determined according to the type of document) the determined scores. Here, according to an embodiment of the present invention, the composition evaluation information determination unit 220 may determine composition evaluation information for a document related to a user by referring to the evaluation scores calculated as described above. According to an embodiment of the present invention, the composition evaluation information may include the evaluation score itself, and may also include a score for each evaluation target element used to determine the evaluation score. According to an embodiment of the present invention, the composition evaluation information may include feedback information determined based on the evaluation score. For example, the feedback information according to an embodiment of the present invention may include recommended information for content (e.g., essay class, online mentoring, etc.) determined based on the evaluation score. However, it should be made clear that the essay evaluation information according to one embodiment of the present invention is not necessarily limited to those listed above, and may be modified in various ways within the scope of achieving the objectives of the present invention.

[0035] Hereinafter, the details of determining the score for each of the evaluation target elements based on the evaluation criteria specified for each of the evaluation target elements will be described in detail. Furthermore, according to one embodiment of the present invention, the evaluation criteria specified for at least one of the evaluation target elements may be determined by referring to the type of document related to the user, and the details of this will be described in detail below.

[0036] According to an embodiment of the present invention, the composition evaluation information determination unit 220 may determine a score for the first evaluation target element by referring to the attributes of words included in the evaluation target document (i.e., the document related to the user). According to an embodiment of the present invention, the word attributes may include the vocabulary (or originality) and diversity of the words.

[0037] For example, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score for the first evaluation target element by summing a score for the vocabulary of words included in the document to be evaluated and a score for the diversity of words included in the document to be evaluated. More specifically, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score for the vocabulary of words by referring to the number of words extracted from the document to be evaluated excluding words for language learning (e.g., words corresponding to 5,965 words in the Korean learning vocabulary list published by the National Institute of Korean Language in May 2003). In addition, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score for the diversity of words by referring to the number of words that are not repeatedly used in the document to be evaluated (i.e., words that are not used more than twice). Here, the essay evaluation information determination unit 220 according to one embodiment of the present invention may use the ratio of the number of words excluding words repeatedly used in the document to the total number of words extracted from the document to be evaluated (such ratio is calculated according to the relational expression (the total number of words extracted from the document to be evaluated - the number of words repeatedly used in the document to be evaluated) / (the total number of words extracted from the document to be evaluated)) to the total number of words extracted from the document to be evaluated in order to determine a score regarding word diversity.

[0038] Meanwhile, according to an embodiment of the present invention, the composition evaluation information determination unit 220 may determine a score for the first element to be evaluated (more specifically, a score for the vocabulary of the words) by referring to a comparison result between the words included in the document to be evaluated and the words included in the word cluster corresponding to the type of the document to be evaluated. Specifically, the composition evaluation information determination unit 220 according to an embodiment of the present invention may generate at least one word cluster by clustering (or classifying) the words included in a pre-constructed word database (here, the words included in the word database may exclude the above-mentioned words for language learning) based on the level of each word. Here, according to an embodiment of the present invention, the level of a certain word may be determined by referring to the frequency with which the corresponding word is used in documents used by a specific group (e.g., in the case where the specific group is a group of second-year high school students, the textbook for the second year of high school). Then, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a word cluster corresponding to the type of the document to be evaluated (or a word level required by the type of the document to be evaluated) from the at least one word cluster. For example, if the type of the document to be evaluated is a thesis, a cluster including words at a graduate school level may be determined as a word cluster corresponding to the type of the document to be evaluated. As another example, if the type of the document to be evaluated is a newspaper article, a cluster including words at a junior high school second year level may be determined as a word cluster corresponding to the type of the document to be evaluated. The composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score related to the vocabulary of words by referring to the number of words included in the determined word cluster among the words included in the document to be evaluated.

[0039] Meanwhile, according to one embodiment of the present invention, each score used to determine the score for the first evaluation target element (e.g., the score for word vocabulary and the score for word diversity) may be weighted based on a predetermined ratio (such ratio may be preset or may be dynamically changed depending on the purpose of the essay evaluation), and the scores to which the weights have been applied may be added together to determine the score for the first evaluation target element. For example, if the score for word vocabulary is determined to be 80 points and the score for word diversity is determined to be 60 points, a weight of 1 / 2 may be applied to each score based on a preset ratio of 50:50, and the scores to which the weights have been applied (i.e., the score for word vocabulary: 40 points, the score for word diversity: 30 points) may be added together to determine the score for the first evaluation target element to be 70 points.

[0040] According to an embodiment of the present invention, the composition evaluation information determination unit 220 may determine a score for the second evaluation target element by referring to the attributes of the text included in the evaluation target document (i.e., the document related to the user). According to an embodiment of the present invention, the attributes of the text may include the readability of the text.

[0041] For example, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score for the second evaluation target element based on a score for the readability of a sentence included in the evaluation target document. Here, according to an embodiment of the present invention, the score for the readability of a sentence may be determined by adding up a score for the average length of a sentence included in the evaluation target document and a score for the structure of a sentence included in the evaluation target document. More specifically, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score for the average length of a sentence by referring to an average number of words in each sentence extracted from the evaluation target document. In addition, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score for the structure of a sentence by referring to a ratio of sentences corresponding to a complex sentence among sentences extracted from the evaluation target document. Here, according to an embodiment of the present invention, whether a sentence extracted from the evaluation target document corresponds to a complex sentence may be determined by using at least one ending (e.g., a linking ending, a pre-closing ending, a closing ending, etc.) included in the corresponding sentence.

[0042] Meanwhile, according to an embodiment of the present invention, the composition evaluation information determination unit 220 may determine a score for the second evaluation target element (more specifically, a score for the sentence structure) by referring to the type of the evaluation target document. Specifically, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score for the sentence structure by referring to the degree to which the ratio of sentences corresponding to complex sentences among sentences extracted from the evaluation target document exceeds a complex sentence tolerance ratio preset based on the type of the evaluation target document. For example, if the type of the evaluation target document corresponds to a thesis, the complex sentence tolerance ratio may be set to 30[%], and if the type of the evaluation target document corresponds to a self-introduction book, the complex sentence tolerance ratio may be set to 15[%].

[0043] Meanwhile, according to one embodiment of the present invention, weights may be applied to each score (e.g., score related to average sentence length and score related to sentence structure) used to determine the score related to the second evaluation target element based on a predetermined ratio (such ratio may be preset or may be dynamically changed depending on the purpose of the essay evaluation), and the scores to which the weights have been applied may be added together to determine the score related to the second evaluation target element. For example, if the score related to average sentence length is determined to be 90 points and the score related to sentence structure is determined to be 70 points, weights of 2 / 5 and 3 / 5 may be applied to each score based on a preset ratio of 40:60, and the scores to which the weights have been applied (i.e., score related to average sentence length: 36 points, score related to sentence structure: 42 points) may be added together to determine the score related to the second evaluation target element to be 78 points.

[0044] According to an embodiment of the present invention, the composition evaluation information determination unit 220 may determine a score for the third evaluation target element by referring to attributes of a paragraph included in the evaluation target document (i.e., a document related to a user). According to an embodiment of the present invention, the paragraph attributes may include linkage information (e.g., the degree of linkage between a plurality of paragraphs) included in the evaluation target document.

[0045] For example, the composition evaluation information determination unit 220 according to an embodiment of the present invention may determine a score for the third evaluation target element based on a score for link information between a plurality of paragraphs included in the evaluation target document. More specifically, the composition evaluation information determination unit 220 according to an embodiment of the present invention may extract at least one keyword from each of the first and second paragraphs of the evaluation target document, and determine a score for link information between a plurality of paragraphs by referring to a similarity between at least one keyword extracted from the first paragraph of the evaluation target document and at least one keyword extracted from the second paragraph of the evaluation target document. Here, the first paragraph of the evaluation target document is a paragraph determined by referring to the type of the evaluation target document (i.e., a paragraph in which the core content of the evaluation target document is described according to the type of the evaluation target document), and the second paragraph of the evaluation target document may be a single or multiple paragraphs different from the first paragraph of the evaluation target document. For example, assuming that the type of the evaluation target document is a thesis, the first paragraph of the evaluation target document may be a paragraph included in an abstract (or conclusion) in which the core content of the evaluation target document is described, and the second paragraph of the evaluation target document may be a paragraph included in the body of the evaluation target document.

[0046] According to an embodiment of the present invention, at least one keyword extracted from the first paragraph and at least one keyword extracted from the second paragraph may be extracted using a natural language processing technique (e.g., TF-IDF). According to an embodiment of the present invention, at least one keyword extracted from the first paragraph and at least one keyword extracted from the second paragraph may be embedded and converted into vector values ​​(e.g., keywords may be embedded from a Sentence-BERT model). That is, according to an embodiment of the present invention, a score related to link information between a plurality of paragraphs may be determined by referring to a similarity (e.g., cosine similarity) between a vector value converted by at least one keyword extracted from the first paragraph and a vector value converted by at least one keyword extracted from the second paragraph.

[0047] Meanwhile, according to an embodiment of the present invention, the composition evaluation information determination unit 220 may determine a score regarding link information between a plurality of paragraphs by further referring to the placement positions within the paragraph of at least one keyword extracted from the first paragraph and at least one keyword extracted from the second paragraph. Specifically, according to an embodiment of the present invention, when a paragraph from which a keyword is extracted (i.e., the first paragraph or the second paragraph) is composed of a plurality of sentences, the composition evaluation information determination unit 220 may determine a point sentence from which a keyword is extracted in the plurality of sentences. According to an embodiment of the present invention, such a point sentence may be determined by referring to the type of the document to be evaluated. For example, when the document to be evaluated is a document of a type created in an initial format (e.g., a document created in English) and the paragraph from which a keyword is extracted is composed of a plurality of sentences, the composition evaluation information determination unit 220 may determine a point sentence in a sentence located at the front of the paragraph from which the corresponding keyword is extracted (i.e., the sentence located at the front of the paragraph from which the corresponding keyword is extracted and a predetermined number of sentences located in sequence after that sentence), and extract at least one keyword from the determined point sentence. As another example, when the document to be evaluated is a document of a type written in a tail type (e.g., a document written in Korean) and the paragraph from which the keyword is extracted is composed of a plurality of sentences, the composition evaluation information determination unit 220 may determine a point sentence from a sentence located at the end of the paragraph from which the keyword is extracted (i.e., the sentence located at the end of the paragraph from which the keyword is extracted and a predetermined number of sentences located in sequence before that sentence), and extract at least one keyword from the determined point sentence. That is, according to one embodiment of the present invention, a score regarding link information between a plurality of paragraphs may be determined by referring to the similarity between at least one keyword (or a vector value converted by at least one keyword) extracted from the point sentence of the first paragraph and at least one keyword (or a vector value converted by at least one keyword) extracted from the point sentence of the second paragraph.

[0048] Next, the communication unit 230 according to an embodiment of the present invention can perform a function of enabling data transmission / reception to / from the evaluation target element extraction unit 210 and the essay evaluation information determination unit 220 .

[0049] Finally, the control unit 240 according to an embodiment of the present invention can perform a function of controlling data flow between the evaluation target element extraction unit 210, the essay evaluation information determination unit 220, and the communication unit 230. That is, the control unit 240 according to the present invention can control the evaluation target element extraction unit 210, the essay evaluation information determination unit 220, and the communication unit 230 to perform their respective unique functions by controlling the data flow from / to the outside of the essay evaluation support system 200 or the data flow between each component of the essay evaluation support system 200.

[0050] FIG. 3 is a diagram illustrating an example of a user interface screen provided by the essay evaluation support system 200 according to an embodiment of the present invention.

[0051] Referring to FIG. 3, the essay evaluation support system 200 according to an embodiment of the present invention can provide the essay evaluation information determined as described above to a user through a user interface screen.

[0052] According to an embodiment of the present invention, an evaluation score for a document related to a user may be displayed on the first screen 310 of the user interface screen. According to an embodiment of the present invention, the evaluation score may be set on a scale of 100 points, but is not necessarily limited thereto.

[0053] According to an embodiment of the present invention, the second screen 320 of the user interface screen may display the transition of the evaluation score over time. For example, the transition of the evaluation score may be displayed on a monthly basis.

[0054] Furthermore, according to an embodiment of the present invention, the scores used to determine the evaluation score may be displayed on the third screen 330 of the user interface screen. For example, the third screen 330 may display the scores for each element to be evaluated.

[0055] Additionally, according to an embodiment of the present invention, other information regarding documents associated with the user may be displayed in the fourth view 340 of the user interface screen, such as the average creation time of documents (i.e., documents associated with the user) and the like.

[0056] Furthermore, according to an embodiment of the present invention, content recommendation information determined based on the evaluation scores may be displayed on the fifth screen 350 of the user interface screen. For example, recommendation information such as essay classes, online mentoring, etc. determined based on the evaluation scores may be displayed on the fifth screen 350.

[0057] The above-described embodiments of the present invention may be embodied in the form of program instructions that can be executed by various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and constructed for the present invention, or may be available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROMs, RAMs, flash memories, and the like. Examples of program instructions include not only machine language codes, such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, and the like. The hardware devices may be replaced by one or more software modules to perform the processes of the present invention, and vice versa.

[0058] Although the present invention has been described above using specific details such as specific components and limited examples and drawings, this is merely provided to assist in a more general understanding of the present invention, and the present invention is not limited to the above examples. Those skilled in the art to which the present invention pertains may attempt various modifications and changes from such descriptions.

[0059] Therefore, the concept of the present invention should not be limited to the above-described embodiments, and all scopes equivalent to or modified equivalently to the scope of the claims below, as well as the scope of the claims, fall within the scope of the concept of the present invention. [Explanation of symbols]

[0060] 100:Communication network 200: Essay evaluation support system 210: Evaluation target element extraction unit 220: Essay evaluation information determination unit 230: Communications Department 240: Control unit 300:Device

Claims

1. 1. A method for supporting essay evaluation, comprising: Extracting evaluation target elements for essay evaluation from a document related to a user; determining composition evaluation information for the document by referring to a score determined according to an evaluation criterion specified for each of the evaluation target elements; Including, The evaluation criteria specified for at least one of the evaluated elements are determined with reference to a type of the document.

2. The method of claim 1 , wherein the elements to be evaluated include a first element to be evaluated, and the score for the first element to be evaluated is determined by referring to a comparison result between words contained in the document and words contained in a word cluster corresponding to a type of the document.

3. The method according to claim 1 , wherein the elements to be evaluated include a second element to be evaluated, and the score for the second element to be evaluated is determined by referring to an attribute of a sentence included in the document.

4. The method according to claim 1 , wherein the elements to be evaluated include a third element to be evaluated, and the score for the third element to be evaluated is determined by referring to link information between a plurality of paragraphs included in the document.

5. The method of claim 4 , wherein the link information is determined with reference to a similarity between at least one keyword extracted from a first paragraph of the document and at least one keyword extracted from a second paragraph of the document.

6. The method according to claim 5 , wherein the link information is determined by further referring to the positions within the paragraphs of at least one keyword extracted from the first paragraph and at least one keyword extracted from the second paragraph.

7. A non-transitory computer-readable recording medium having a computer program recorded thereon for carrying out the method according to claim 1.

8. A system for supporting essay evaluation, comprising: an evaluation target element extraction unit that extracts evaluation target elements for essay evaluation from a document related to a user; an essay evaluation information determination unit that determines essay evaluation information for the document by referring to a score determined by an evaluation criterion specified for each of the evaluation target elements; Equipped with The evaluation criteria specified for at least one of the evaluation target elements are determined with reference to a type of the document.

9. The system of claim 8, wherein the elements to be evaluated include a first element to be evaluated, and the score for the first element to be evaluated is determined by referring to a comparison result between words contained in the document and words contained in a word cluster corresponding to the type of the document.

10. The system according to claim 8 , wherein the elements to be evaluated include a second element to be evaluated, and the score for the second element to be evaluated is determined by referring to attributes of sentences included in the document.

11. The system according to claim 8 , wherein the elements to be evaluated include a third element to be evaluated, and the score for the third element to be evaluated is determined by referring to link information between a plurality of paragraphs included in the document.

12. The system of claim 11 , wherein the link information is determined with reference to a similarity between at least one keyword extracted from a first paragraph of the document and at least one keyword extracted from a second paragraph of the document.

13. The system according to claim 12 , wherein the link information is determined by further referring to the positions within the paragraphs of at least one keyword extracted from the first paragraph and at least one keyword extracted from the second paragraph.

Citation Information

Patent Citations

  • Program, method and system for evaluating document

    JP2005216258A

  • Document calibration support device, document calibration support method, and document calibration support program

    JP2017041164A

  • Transliteration work support device, transliteration work support method, and computer program product

    US20160217782A1

  • Method of correcting writing on web

    KR1020130089729A

Cited By

  • Methods for evaluating and grading essays and short papers

    JP2026132157A