Evaluation program and evaluation system

Abstract

To provide an evaluation program and an evaluation system which improve convenience of a user acquiring an analysis result of a legal document.SOLUTION: In an evaluation program for analyzing legal document data, a computer functions as: an analysis section 22 for analyzing the legal document data on the basis of a predetermined examination standard, so as to generate the entire result data in association of at least one of a plurality of types of evaluation with each item included in the legal document data and also generate partial result data indicating an analysis result corresponding to a partial predetermined type of evaluation among the plurality of types of evaluation; and an output section 23 for outputting the entire result data and the partial result data.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to an evaluation program and an evaluation system. [Background technology]

[0002] Legal documents such as contracts are reviewed by a person in charge of legal documents in a company, for example. However, the review requires prior knowledge of legal documents, which can be a burden.

[0003] For example, Patent Document 1 describes a method for reviewing legal documents using a computer, which reduces the burden on people in charge of legal documents. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-134983 A Summary of the Invention [Problem to be solved by the invention]

[0005] In Patent Document 1, each clause of a legal document is analyzed using, for example, a judgment criterion, and the risk is evaluated as low or high, and the entire evaluation result is output and displayed as the analysis result. There is room for improvement in user convenience regarding the provision of the analysis results of legal documents.

[0006] In view of the above problems, the present disclosure aims to provide an evaluation program and an evaluation system that can improve the convenience of users who obtain analysis results of legal documents. [Means for solving the problem]

[0007] In order to solve the above problems, the evaluation program of the first aspect of the present disclosure is an evaluation program that analyzes legal document data, and causes a computer to function as an analysis unit that performs analysis of the legal document data based on specified review criteria, and generates overall result data by matching at least one of multiple types of evaluations to each item included in the legal document data, and generates partial result data indicating analysis results corresponding to a certain specified type of evaluation among the multiple types of evaluations, and an output unit that outputs the overall result data and the partial result data.

[0008] In addition, in the evaluation program related to the second aspect of the present disclosure, in the first aspect, the contents of the partial result data are displayed on the screen without user operation, and the contents of the entire result data are displayed on the screen by user operation.

[0009] In addition, in the evaluation program related to the third aspect of the present disclosure, in the first aspect, the contents of the overall result data are displayed on a screen on which the contents of the partial result data are displayed by a user performing an operation on the screen.

[0010] In addition, in the evaluation program relating to the fourth aspect of the present disclosure, in the first or second aspect, the analysis unit associates an evaluation of match, mismatch, or inapplicability with the review criteria with an item of the legal document data, and the analysis unit generates the partial result data indicating an analysis result corresponding to at least one of the evaluations of mismatch and inapplicability.

[0011] In addition, in the evaluation program related to the fifth aspect of the present disclosure, in the fourth aspect, the analysis unit generates the partial result data by correlating an item of the legal document data, an evaluation associated with the item, and the review criteria that serve as the basis for the evaluation.

[0012] In addition, an evaluation system according to a sixth aspect of the present disclosure is an evaluation system comprising a terminal device and an evaluation device capable of communicating with the terminal device, wherein the evaluation device performs an analysis of legal document data received from the terminal device based on predetermined review criteria, and generates overall result data by associating at least one of a plurality of types of evaluations with each item included in the legal document data, and also comprises an analysis unit that generates partial result data indicating an analysis result corresponding to a predetermined type of evaluation among the plurality of types of evaluations, and an output unit that outputs the overall result data and the partial result data to the terminal device, wherein the terminal device displays the contents of the output partial result data, and displays the contents of the overall result data in response to a user's operation. Effect of the Invention

[0013] According to the evaluation program and evaluation system of the present disclosure, it is possible to improve the convenience for users who obtain analysis results of legal documents. [Brief description of the drawings]

[0014] [Figure 1] 1 is a schematic diagram illustrating an example of an overall configuration of an evaluation system according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server device. [Diagram 3] FIG. 2 is a block diagram showing an example of various functions of the server device. [Figure 4] FIG. 13 is a diagram showing an example of the examination criteria for a type of confidentiality agreement. [Diagram 5] 13 is a flowchart showing an example of the flow of an analysis process. [Figure 6] FIG. 13 is a diagram showing an example of a screen (for accepting legal documents) of a user terminal. [Figure 7] FIG. 13 is a diagram showing an example of a screen of a user terminal (while analysis is being performed). [Figure 8] FIG. 13 is a diagram showing an example of a screen (analysis results) of a user terminal. [Figure 9]FIG. 13 is a diagram showing an example of legal document data with "match" comments. [Figure 10] FIG. 13 is a diagram showing an example of legal document data with a "mismatch" comment. [Figure 11] FIG. 13 is a diagram showing an example of legal document data with a comment "no description." DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. In order to facilitate understanding of the description, the same components and steps in each drawing are denoted by the same reference numerals as much as possible, and duplicated description will be omitted.

[0016] <Overall composition> FIG. 1 is an overall configuration diagram of an evaluation system 1 according to an embodiment of the present disclosure. The evaluation system 1 is capable of analyzing legal document data and providing the data to a user. The legal document data is, for example, data of a document having legal effect, such as a contract. In this embodiment, a case will be described in which non-disclosure agreement data is used as an example of the legal document data. The non-disclosure agreement data includes content information related to the non-disclosure agreement as document data. The legal document data is, for example, data created by document creation software.

[0017] The evaluation system 1 includes a server device 2 and a user terminal 3. The user devices are operated by respective users. The server device 2 and the user terminal 3 are capable of communicating with each other via a network NT.

[0018] The server device 2 is an evaluation device, and is an information processing device that performs analysis on legal document data. The analysis (review) means to check the legal document data. The server device 2 may be a cloud type or an on-premise type.

[0019] The user terminal 3 is a terminal device and an information processing device used by a user. The user terminal 3 is, for example, a personal computer, a smartphone, a tablet, etc. In this embodiment, the user terminal 3 is, for example, a personal computer.

[0020] <Hardware configuration> FIG. 2 is a diagram illustrating an example of a hardware configuration of the server device 2. As shown in FIG.

[0021] 2, the server device 2 includes a control device 10, a communication device 11, a storage device 12, an operation device 13, and a display device 14. The control device 10 is mainly configured with a CPU (Central Processing Unit) 15 and a memory 16.

[0022] In the control device 10, the CPU 15 executes a predetermined program stored in the memory 16 or the storage device 12, etc., to function as various functional configurations described below. The memory 16 is a computer-readable storage medium, and may be composed of at least one of, for example, a random access memory (RAM), a read only memory (ROM), an erasable program ROM (EPROM), an electrically erasable program ROM (EEPROM), etc. The memory 16 can store various data, and stores, for example, a program required for executing processing in the server device 2.

[0023] The communication device 11 is composed of a communication interface for communicating with an external device.

[0024] The storage device 12 is a computer-readable instruction recording medium, and is configured, for example, with a hard disk, a solid state drive, etc. The storage device 12 stores various programs and various information required for executing the processes in the control device 10, as well as information on the results of the processes. Note that other examples of non-transitory computer-readable instruction recording media include portable recording media such as magnetic tapes, flexible disks, optical disks, digital versatile disks, Blu-ray disks, magneto-optical disks, memory cards, and USB memories.

[0025] The operation device 13 is an input device (for example, a keyboard, a mouse, etc.) that accepts an input. The operation device 13 accepts an operation by a user and inputs the operation to the server device 2.

[0026] The display device 14 is a display device (for example, a display, etc.) The display device 14 outputs characters and images.

[0027] The server device 2 can be realized by using an information processing device such as a dedicated or general-purpose computer. The server device 2 may be configured by a single information processing device or by multiple information processing devices. FIG. 2 shows only a part of the main hardware configuration of the server device 2, and the server device 2 may have other configurations. The basic configuration of the user terminal 3 as an information processing device is the same as that shown in FIG. 2.

[0028] <Functional configuration> 3 is a block diagram showing an example of various functions in the server device 2. Analysis processing is executed by the functions in each block.

[0029] As shown in FIG. 3, the server device 2 includes, as its functional configuration, a reception unit 21, an analysis unit 22, and an output unit 23 as main components.

[0030] The reception unit 21 has a function of receiving legal document data. Specifically, the reception unit 21 receives legal document data to be analyzed from the user terminal 3 by a user operation. For example, the reception is performed by the user uploading the legal document data to the user terminal 3. The received legal document data becomes the subject of analysis.

[0031] The analysis unit 22 performs an analysis of the legal document data based on a predetermined examination criterion. Specifically, the analysis unit 22 performs a detailed analysis of the legal document data.

[0032] The screening criteria are information that serves as the basis for analyzing legal document data. The screening criteria include multiple criteria items. The screening criteria are summarized as important aspects of the analysis of legal document data as each criterion item, and are set corresponding to the type of legal document data. The type is the type of legal document data. The types are classified, for example, by type of contract. Specifically, types are set in advance according to the type of contract, such as a confidentiality agreement, a real estate purchase and sale contract, a lease contract, and a service outsourcing contract. The screening criteria are set corresponding to each type. For example, screening criteria corresponding to a confidentiality agreement and screening criteria corresponding to a real estate purchase and sale contract are set.

[0033] Figure 4 is a diagram showing an example of the screening criteria for the confidentiality agreement category. As shown in Figure 3, the screening criteria include multiple criteria items of important viewpoints regarding confidentiality agreements. For example, the criteria items are "For the purpose of entering into a confidentiality agreement between Party A and Party B, the specific transaction contents regarding the commercial relationship or potential commercial relationship between the parties are specified," "Means for identifying confidential information when disclosing confidential information are specified," etc.

[0034] The screening criteria may be preset, or may be set or changeable by the user.

[0035] The analysis unit 22 performs an analysis of the legal document data based on the examination criteria corresponding to the type of the legal document data. For example, if the legal document data is document data related to a confidentiality agreement, the analysis unit 22 performs the analysis based on the examination criteria corresponding to the confidentiality agreement.

[0036] The type is selected by the user. For example, the type of legal document data is selected by the user who uploaded the legal document data. Then, the analysis unit 22 uses the examination criteria of the selected type.

[0037] The analysis unit 22 analyzes whether the legal document data conforms to the screening criteria. Specifically, the analysis unit 22 performs an analysis on each item of the legal document data. Each item is, for example, each clause included in the legal document data, and is a delimited sentence (such as a phrase). The analysis unit 22 analyzes the conformity status of each criterion item of the screening criteria with respect to the legal document data. That is, the analysis unit 22 analyzes whether the item of the legal document data is "matched", "mismatched", or "not stated" for each criterion item of the screening criteria. "Matched" indicates that the item conforms to the criterion item of the screening criteria. The expression of "matched" is not limited as long as it is synonymous. "Mismatched" indicates that the item corresponds to the criterion item of the screening criteria but does not conform. The expression of "mismatched" is not limited as long as it is synonymous. "Not stated" indicates that there is no item corresponding to the criterion item of the screening criteria (not conforming). "Not stated" is synonymous with "not applicable" or "no applicable statement", and the expression is not limited. That is, the analysis unit 22 associates at least one of a plurality of types of evaluations with each item included in the legal document data. In this embodiment, the plurality of types of evaluations are three types of evaluations, namely, "match", "mismatch", and "not stated", with respect to the screening criteria, but are not limited to the above.

[0038] The analysis by the analysis unit 22 is performed using AI such as GPT (Generative Pre-trained Transformer). The analysis unit 22 selects an item corresponding to each criterion item of the screening criteria from each item of the legal document data, and judges whether or not the selected item matches the criterion item. If the selected item matches the criterion item, it is determined as "matched", and if it does not match, it is determined as "mismatched". If there is no item corresponding to a criterion item of the screening criteria (if not selected), it is determined as "not stated". Note that the analysis by the analysis unit 22 is not limited to using AI such as GPT.

[0039] The analysis unit 22 generates the analysis results including all the analysis results based on the screening criteria as overall result data. That is, the overall result data includes the evaluation of the legal document data for all the criteria items of the screening criteria. For example, the overall result data includes the evaluation results of "match", "mismatch", and "no description". Note that the analysis results for all the criteria items of the screening criteria, for example, the result of "no description", may not be included.

[0040] The overall result data is, for example, data in which a comment on the analysis result is added to the legal document data. That is, the overall result data is file data. For example, if the legal document data is a document file created by word processing software, the overall result data is also a document file. The user can check the contents of the overall result data by opening the file data.

[0041] The analysis unit 22 also generates partial result data. The partial result data is data indicating a part of the analysis results based on the screening criteria. Specifically, the partial result data is data indicating an analysis result corresponding to a specific type of evaluation, which is a predetermined type of evaluation among multiple types of evaluation. The specific type of evaluation is selected as an analysis result that is important to the user among all types of evaluation. An important analysis result is, for example, an evaluation result that does not comply with the screening criteria. In the partial result data, an item of the legal document data, an evaluation associated with the item (specific type of evaluation), and the screening criteria that are the basis for the evaluation are associated with each other.

[0042] In this embodiment, three types of evaluations are used: "match", "mismatch", and "no description", and therefore the partial result data shows analysis results corresponding to some specific types of evaluations among the three types. Specifically, the specific types of evaluations are "mismatch" and "no description". In other words, the partial result data does not include the contents of analysis results corresponding to evaluations other than the specific types of evaluations (e.g., "match"). Note that the specific type of evaluation may be either "mismatch" or "no description" rather than both.

[0043] In this way, the partial result data shows analysis results corresponding to some types of evaluations in the overall result data. Specifically, the partial result data shows analysis results corresponding to the evaluation of "mismatch" and the evaluation of "not stated" in the overall result data.

[0044] The partial result data is, for example, message data. The partial result data has a different data format from the legal document data and the full result data. As described later, the message data corresponds to, for example, a predetermined chat tool, and the partial result data is displayed in the chat tool.

[0045] The output unit 23 outputs the analysis results to a predetermined display device for display. In this embodiment, the output unit 23 outputs the analysis results to the user terminal 3 for display. Specifically, the output unit 23 outputs the entire result data and the partial result data generated in the analysis unit 22 to the user terminal 3 for display. The contents of the output partial result data are displayed on the screen of the user terminal 3 without any user operation. The contents of the output entire result data are displayed on the screen of the user terminal 3 by user operation. Specifically, the contents of the entire result data are displayed on the screen when the user performs an operation to open the file of the entire result data on the screen where the partial result data is displayed.

[0046] <Processing flow> 5 is a flowchart showing an example of the flow of the analysis process according to this embodiment. Each process of the following steps is started by a start instruction from the user. Note that the order and contents of each step can be changed as appropriate.

[0047] For example, a user can analyze legal document data using a chat tool on the user terminal 3. The chat tool may be a dedicated tool or a general-purpose tool. Use of a chat tool is just an example, and other tools may be used.

[0048] (Step SP10) The reception unit 21 receives legal document data. When the legal document data is uploaded from the user terminal 3 by the user, the reception unit 21 receives the data.

[0049] 6 shows an example of a screen 27 of a user terminal 3 related to the reception of a legal document. The user uses a chat tool to upload data D1 of a "non-disclosure agreement" which is legal document data. The data may be uploaded via chat or may be uploaded to cloud storage and then sent.

[0050] When the legal document data is uploaded at the user terminal 3, a reply R1 stating "The non-disclosure agreement has been accepted" is displayed. Returning to FIG. 5, the process proceeds to step SP11.

[0051] (Step SP11) The receiving unit 21 determines whether or not a designation of the type of legal document data has been received from the user.

[0052] As shown in Fig. 6, the type of legal document data can be specified as a reply R1. The type can be selected from types corresponding to prepared screening criteria, for example. For example, the legal document data uploaded by the user is accepted by selecting a type corresponding to the data. Fig. 6 shows an example in which "confidentiality agreement" is selected as the type.

[0053] 5, if a designation of the type of legal document data is accepted, the process proceeds to step SP12, and if a designation of the type of legal document data is not accepted, the process returns to step SP11 and repeats. Note that the process may be terminated if a predetermined time has elapsed while repeating the process of step SP11.

[0054] (Step SP12) The analysis unit 22 executes analysis on the legal document data using the examination criteria of the specified type. The specification (acceptance) of the type has a function of instructing the start of analysis. In the present embodiment, the case where the specification of the type has a function of instructing the start of analysis has been exemplified, but the user may give an instruction to start analysis separately from the specification of the type.

[0055] Fig. 7 shows an example of a screen 27 of the user terminal 3 during the analysis. When the analysis unit 22 starts the analysis, a reply R2 is displayed indicating that the analysis is being performed. Returning to Fig. 5, the process proceeds to step SP13.

[0056] (Step SP13) When the analysis unit 22 completes the analysis, the output unit 23 outputs the results of the analysis to the user terminal 3. Specifically, the analysis unit 22 generates overall result data and partial result data as analysis results, and the output unit 23 outputs the overall result data and partial result data to the user terminal 3. The overall result data becomes file data to which analysis comments are added to the data D1 of the "non-disclosure agreement." The partial result data becomes message data indicating part of the analysis result. The message data becomes a reply message for the chat tool used.

[0057] Fig. 8 shows an example of the screen 27 of the user terminal 3 when the analysis results are displayed. Reply R3 shows a simplified analysis result. The simplified result is information that simply summarizes the results of the analysis by the analysis unit 22, and shows the number of "matches", the number of "mismatches", the number of "not stated", and the match rate. The match rate is the ratio of the number of "matches" to the number of criteria items in the screening criteria.

[0058] Moreover, reply R4 is the content of the partial result data. Specifically, reply R4 shows the analysis result corresponding to the evaluation of "mismatch" and the analysis result corresponding to the evaluation of "no description". The analysis results corresponding to the evaluations of "mismatch" and "no description" included in the overall result data are all displayed as partial result data. Reply R4 shows an item of legal document data shown as M1, an evaluation associated with the item shown as M2, and the review criteria on which the evaluation is based shown as M3 in association with each other. Since the partial result data is message data, it is automatically displayed in the chat tool (without depending on the user's operation).

[0059] Also, data D2 of the overall result data is displayed as reply R5. Since data D2 is file data, an icon of data D2 is displayed in reply R5, and the user can open data D2 by clicking on data D2 or performing other operations to display the contents of the overall result data.

[0060] 9 to 11 are diagrams showing an example of the contents of the overall result data. That is, FIG. 9 to FIG. 11 show an example of legal document data with comments. FIG. 9 shows an example in which the comment C1 of "match" is added. In FIG. 9, comments other than the comment C1 are omitted. As shown in FIG. 9, the comment C1 is added to the relevant item of the legal document data, and the analysis result is described in the comment C1. Specifically, the comment C1 describes the criterion item of the corresponding screening criteria and the result of the criterion item, "match". This allows the user to recognize that the item to which the comment C1 is added conforms to the criterion item of the screening criteria.

[0061] FIG. 10 shows an example where comment C2 of "mismatch" has been added. Note that comments other than comment C2 have been omitted in FIG. 10. As shown in FIG. 10, comment C2 has been added to the relevant item of the legal document data, and comment C2 contains the analysis result. Specifically, comment C2 contains the corresponding criterion item of the screening criteria and the result for that criterion item, "mismatch." This allows the user to recognize that the item to which comment C2 has been added does not conform to the criterion item of the screening criteria.

[0062] FIG. 11 shows an example in which the comment C3 "not stated" is added. In FIG. 11, comments other than comment C3 are omitted. As shown in FIG. 11, for example, comment C3 is added to the title of legal document data, and comment C3 contains the analysis result. Specifically, comment C3 contains the criterion items of the screening criteria and the result for the criterion item, "not stated." This allows the user to recognize the criterion items of the screening criteria that are not stated in the legal document data.

[0063] In this manner, legal document data is analyzed and the analysis results are provided.

[0064] <Action and effect> As described above, the evaluation program of this embodiment is an evaluation program that analyzes legal document data, and causes a computer to function as an analysis unit 22 that executes analysis of the legal document data based on specified review criteria, generates overall result data by matching at least one of multiple types of evaluations to each item included in the legal document data, and generates partial result data indicating analysis results corresponding to a certain specified type of evaluation among the multiple types of evaluations, and an output unit 23 that outputs the overall result data and the partial result data.

[0065] According to this configuration, in addition to the overall result data showing the entire analysis result, partial result data corresponding to some types of evaluations are generated, and the overall result data and the partial result data are output. Therefore, not only the overall result data but also the partial result data can be provided to the user, improving the convenience of the user obtaining the analysis result of the legal document data. For example, the user can easily understand the analysis result corresponding to a specific evaluation by checking the partial result data.

[0066] In the evaluation program, the contents of the partial result data are displayed on the screen without any user operation, and the contents of the entire result data are displayed on the screen in response to a user operation.

[0067] According to this configuration, the contents of the partial result data are displayed on the screen without user operation, so that the analysis results corresponding to a specific evaluation can be easily understood. Then, if necessary, the user can perform an operation to display the contents of the entire result data and check the whole. For example, the partial result data is displayed on the chat tool screen without the user performing an operation, and the contents of the entire result data are displayed when the user performs an operation to open the file data.

[0068] In the evaluation program, the contents of the entire result data are displayed on the screen when the user performs an operation on the screen on which the contents of the partial result data are displayed.

[0069] According to this configuration, the user can understand the analysis results corresponding to a specific evaluation from the partial result data, and can then display the entire result data.

[0070] In addition, in the evaluation program, the analysis unit 22 associates each item of the legal document data with one of the evaluations of match, mismatch, or inapplicability with the review criteria, and the analysis unit 22 generates partial result data indicating an analysis result corresponding to at least one of the evaluations of mismatch and inapplicability.

[0071] According to this configuration, the partial result data shows analysis results corresponding to an evaluation of non-conformity or non-applicability with respect to the screening criteria, so that the non-conforming parts of the legal document data can be easily identified.

[0072] In addition, in the evaluation program, the analysis unit 22 generates partial result data by associating items of legal document data, evaluations associated with the items, and review criteria that are the basis for the evaluations.

[0073] According to this configuration, the user can easily understand the analysis content of the legal document data by checking the partial result data.

[0074] <Modification> The present disclosure is not limited to the above-mentioned embodiment. In other words, the above-mentioned embodiment with appropriate design modifications made by a person skilled in the art is also included in the scope of the present disclosure as long as it has the features of the present disclosure. In addition, the elements of the above-mentioned embodiment and the modified examples described below can be combined to the extent technically possible, and the combination of these is also included in the scope of the present disclosure as long as it has the features of the present disclosure.

[0075] For example, in the above embodiment, the server device 2 has each function, but each function may be provided in the user terminal 3. Also, each function may be distributed between the server device 2 and the user terminal 3.

[0076] Furthermore, in the above embodiment, the analysis result is added to the legal document data as a comment. However, the present invention is not limited to the above as long as the analysis result can be provided to the user.

[0077] In the above embodiment, the case where the type of legal document data is selected by the user has been described as an example, but the type may be determined and specified by the uploaded legal document data on the computer side. Specifically, the analysis unit 22 may determine the type based on the legal document data, and analyze the legal document data based on the examination criteria corresponding to the determined type. The ability to determine the type on the computer side reduces the burden on the user.

[0078] In addition, in the above embodiment, an example was described in which the entire result data is file data and the partial result data is message data, but both may be file data, or both may be message data. [Explanation of symbols]

[0079] 22:Analysis Department 23: Output section D1: Data (legal document data) D2: Data (overall results data)

Claims

1. An evaluation program for performing analysis on legal document data, Computer, an analysis unit that executes an analysis of the legal document data based on a predetermined review criterion, and generates overall result data by associating at least one of a plurality of types of evaluation with each item included in the legal document data, and generates partial result data indicating an analysis result corresponding to a portion of a predetermined type of evaluation among the plurality of types of evaluation; an output unit that outputs the entire result data and the partial result data; To function as Evaluation program.

2. The content of the partial result data is displayed on a screen without user operation, The contents of the overall result data are displayed on the screen by a user operation. The evaluation program according to claim 1 .

3. the content of the entire result data is displayed on the screen on which the content of the partial result data is displayed by a user performing an operation on the screen; The evaluation program according to claim 1 .

4. The analysis unit associates an evaluation of a match, a mismatch, or no match with the screening criteria with the item of the legal document data, and The analysis unit generates the partial result data indicating an analysis result corresponding to at least one of an evaluation of mismatch and no match. The evaluation program according to claim 1 or 2.

5. The analysis unit generates the partial result data by associating items of the legal document data, evaluations associated with the items, and the examination criteria that are the basis for the evaluations. The evaluation program according to claim 4.

6. An evaluation system including a terminal device and an evaluation device capable of communicating with the terminal device, The evaluation device includes: an analysis unit that performs an analysis of the legal document data received from the terminal device based on a predetermined review criterion, and generates overall result data by associating at least one of a plurality of types of evaluation with each item included in the legal document data, and generates partial result data indicating an analysis result corresponding to a part of a predetermined type of evaluation among the plurality of types of evaluation; an output unit that outputs the entire result data and the partial result data to the terminal device; Equipped with the terminal device displays the contents of the output partial result data, and displays the contents of the entire result data in response to a user operation. Rating system.

Images