Evaluation program and evaluation system

Abstract

To provide an evaluation program and an evaluation system which improve convenience of a user acquiring an analysis result of a legal document.SOLUTION: In an evaluation program for analyzing legal document data, a computer functions as: a first analysis section 22 for executing simplified analysis of the legal document data; a second analysis section 23 for executing detailed analysis requiring the more amount of calculation and a more calculation time than the simplified analysis relative to the legal document data; and an output section 24 for outputting a result of the simplified analysis after the completion of the simplified analysis and before the completion of the detailed analysis, and outputting a result of the detailed analysis after the completion of the detailed analysis.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to an evaluation program and an evaluation system. [Background technology]

[0002] Legal documents such as contracts are reviewed by a person in charge of legal documents in a company, for example. However, the review requires prior knowledge of legal documents, which can be a burden.

[0003] For example, Patent Document 1 describes a method for reviewing legal documents using a computer, which reduces the burden on people in charge of legal documents. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-134983 A Summary of the Invention [Problem to be solved by the invention]

[0005] In Patent Document 1, each clause of a legal document is analyzed using, for example, a criterion, and the results are output and displayed. There is room for improvement in user convenience with regard to providing the results of the analysis of legal documents.

[0006] In view of the above problems, the present disclosure aims to provide an evaluation program and an evaluation system that can improve the convenience of users who obtain analysis results of legal documents. [Means for solving the problem]

[0007] In order to solve the above problems, an evaluation program according to a first aspect of the present disclosure is an evaluation program for analyzing legal document data, and causes a computer to function as a first analysis unit that performs a first analysis on the legal document data, a second analysis unit that performs a second analysis on the legal document data, the second analysis requiring more calculations or time than the first analysis, and an output unit that outputs a result of the first analysis after completion of the first analysis but before completion of the second analysis, and outputs a result of the second analysis after completion of the second analysis.

[0008] In addition, in the evaluation program relating to the second aspect of the present disclosure, in the first aspect, the first analysis unit analyzes the bibliographic information of the legal document data, and the second analysis unit analyzes the legal document data based on predetermined review criteria.

[0009] In addition, in the evaluation program according to a third aspect of the present disclosure, in the first aspect, the second analysis unit starts the second analysis after outputting a result of the first analysis.

[0010] In addition, in the evaluation program according to the fourth aspect of the present disclosure, in a third aspect, the second analysis unit starts the second analysis based on input from a user received after outputting the results of the first analysis.

[0011] In addition, in the evaluation program according to the fifth aspect of the present disclosure, in a second aspect, the second analysis unit analyzes the legal document data based on the examination criteria corresponding to a type of the legal document data.

[0012] In addition, in the evaluation program relating to the sixth aspect of the present disclosure, in the fifth aspect, the second analysis unit determines a type based on the legal document data, and analyzes the legal document data based on the examination criteria corresponding to the determined type.

[0013] In addition, in the evaluation program related to the seventh aspect of the present disclosure, in the second or fifth aspect, the bibliographic information is at least one of the data name of the legal document data, the page number of the legal document data, and the number of characters of the legal document data.

[0014] Moreover, an evaluation system according to an eighth aspect of the present disclosure is an evaluation system comprising a terminal device and an evaluation device capable of communicating with the terminal device, wherein the evaluation device comprises a first analysis unit that performs a first analysis on legal document data received from the terminal device, a second analysis unit that performs a second analysis on the legal document data, the second analysis having a larger amount of calculation or time than the first analysis, and an output unit that outputs a result of the first analysis to the terminal device after completion of the first analysis but before completion of the second analysis, and outputs a result of the second analysis to the terminal device after completion of the second analysis, and the terminal device displays the output results of the first analysis and the second analysis, respectively. Effect of the Invention

[0015] According to the evaluation program and evaluation system of the present disclosure, it is possible to improve the convenience for users who obtain analysis results of legal documents. [Brief description of the drawings]

[0016] [Figure 1] 1 is a schematic diagram illustrating an example of an overall configuration of an evaluation system according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server device. [Diagram 3] FIG. 2 is a block diagram showing an example of various functions of the server device. [Figure 4] FIG. 13 is a diagram showing an example of the examination criteria for a type of confidentiality agreement. [Diagram 5] 13 is a flowchart showing an example of the flow of an analysis process. [Figure 6] FIG. 13 is a diagram showing an example of a screen (for accepting legal documents) of a user terminal. [Figure 7]FIG. 13 is a diagram showing an example of a screen (result of simple analysis) of a user terminal. [Figure 8] FIG. 13 is a diagram showing an example of a screen of a user terminal (when a detailed analysis is being performed). [Figure 9] FIG. 13 is a diagram showing an example of a screen (result of detailed analysis) of a user terminal. [Figure 10] FIG. 13 is a diagram showing an example of legal document data with "match" comments. [Figure 11] FIG. 13 is a diagram showing an example of legal document data with a "mismatch" comment. [Figure 12] FIG. 13 is a diagram showing an example of legal document data with a comment "no description." DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. In order to facilitate understanding of the description, the same components and steps in each drawing are denoted by the same reference numerals as much as possible, and duplicated description will be omitted.

[0018] <Overall composition> FIG. 1 is an overall configuration diagram of an evaluation system 1 according to an embodiment of the present disclosure. The evaluation system 1 is capable of analyzing legal document data and providing the data to a user. The legal document data is, for example, data of a document having legal effect, such as a contract. In this embodiment, a case will be described in which non-disclosure agreement data is used as an example of the legal document data. The non-disclosure agreement data includes content information related to the non-disclosure agreement as document data. The legal document data is, for example, data created by document creation software.

[0019] The evaluation system 1 includes a server device 2 and a user terminal 3. The user devices are operated by respective users. The server device 2 and the user terminal 3 are capable of communicating with each other via a network NT.

[0020] The server device 2 is an evaluation device, and is an information processing device that performs analysis on legal document data. The analysis (review) means checking the legal document data. The server device 2 may be a cloud type or an on-premise type.

[0021] The user terminal 3 is a terminal device and an information processing device used by a user. The user terminal 3 is, for example, a personal computer, a smartphone, a tablet, etc. In this embodiment, the user terminal 3 is, for example, a personal computer.

[0022] <Hardware configuration> FIG. 2 is a diagram illustrating an example of a hardware configuration of the server device 2. As shown in FIG.

[0023] 2, the server device 2 includes a control device 10, a communication device 11, a storage device 12, an operation device 13, and a display device 14. The control device 10 is mainly configured with a CPU (Central Processing Unit) 15 and a memory 16.

[0024] In the control device 10, the CPU 15 executes a predetermined program stored in the memory 16 or the storage device 12, etc., to function as various functional configurations described below. The memory 16 is a computer-readable storage medium, and may be composed of at least one of, for example, a random access memory (RAM), a read only memory (ROM), an erasable program ROM (EPROM), an electrically erasable program ROM (EEPROM), etc. The memory 16 can store various data, and stores, for example, a program required for executing processing in the server device 2.

[0025] The communication device 11 is composed of a communication interface for communicating with an external device.

[0026] The storage device 12 is a computer-readable instruction recording medium, and is configured, for example, with a hard disk, a solid state drive, etc. The storage device 12 stores various programs and various information required for executing the processes in the control device 10, as well as information on the results of the processes. Note that other examples of non-transitory computer-readable instruction recording media include portable recording media such as magnetic tapes, flexible disks, optical disks, digital versatile disks, Blu-ray disks, magneto-optical disks, memory cards, and USB memories.

[0027] The operation device 13 is an input device (for example, a keyboard, a mouse, etc.) that accepts an input. The operation device 13 accepts an operation by a user and inputs the operation to the server device 2.

[0028] The display device 14 is a display device (for example, a display, etc.) The display device 14 outputs characters and images.

[0029] The server device 2 can be realized by using an information processing device such as a dedicated or general-purpose computer. The server device 2 may be configured by a single information processing device or by multiple information processing devices. FIG. 2 shows only a part of the main hardware configuration of the server device 2, and the server device 2 may have other configurations. The basic configuration of the user terminal 3 as an information processing device is the same as that shown in FIG. 2.

[0030] <Functional configuration> 3 is a block diagram showing an example of various functions in the server device 2. Analysis processing is executed by the functions in each block.

[0031] As shown in FIG. 3, the server device 2 includes, as its functional configuration, a reception unit 21, a first analysis unit 22, a second analysis unit 23, and an output unit 24 as main components.

[0032] The reception unit 21 has a function of receiving legal document data. Specifically, the reception unit 21 receives legal document data to be analyzed from the user terminal 3 by a user operation. For example, the reception is performed by the user uploading the legal document data to the user terminal 3. The received legal document data becomes the subject of analysis.

[0033] The first analysis unit 22 performs an analysis of bibliographic information on the legal document data. Specifically, the first analysis unit 22 performs a simplified analysis (first analysis) on the legal document data. The simplified analysis is an analysis that requires less processing time than the analysis (detailed analysis) by the second analysis unit 23 described below. As described below, the second analysis unit 23 performs the analysis based on a predetermined review criterion, whereas the first analysis unit 22 performs the analysis without based on the review criterion.

[0034] Bibliographic information is information that indicates the bibliographic items of legal document data. The bibliographic information represents the characteristics of legal document data, and includes at least one of the following: the name of the legal document data, the number of pages of the legal document data, and the number of characters of the legal document data. Note that the bibliographic information may also include other information.

[0035] The first analysis unit 22 performs an analysis on the legal document data to produce a simplified analysis result. For example, if the file name of the legal document data is "non-disclosure agreement", then in the simplified analysis result, "non-disclosure agreement" is associated with the file name of the legal document data. For example, if the number of pages of the legal document data is "2", then in the simplified analysis result, "2" is associated with the number of pages of the legal document data. For example, if the number of characters in the legal document data is "2191 characters", then in the simplified analysis result, "2191 characters" is associated with the number of characters in the legal document data.

[0036] The first analysis unit 22 associates the simplified analysis result with the legal document data to be analyzed, and completes the analysis.

[0037] The second analysis unit 23 executes an analysis of the legal document data based on a predetermined examination criterion. Specifically, the second analysis unit 23 executes a detailed analysis (second analysis) of the legal document data. The detailed analysis is an analysis that requires more processing than the analysis (simple analysis) performed by the first analysis unit 22. In other words, the detailed analysis requires a larger amount of calculation (processing amount) or calculation time (processing time) than the simple analysis.

[0038] The screening criteria are information that serves as the basis for analyzing legal document data. The screening criteria include multiple criteria items. The screening criteria are summarized as important aspects of the analysis of legal document data as each criterion item, and are set corresponding to the type of legal document data. The type is the type of legal document data. The types are classified, for example, by type of contract. Specifically, types are set in advance according to the type of contract, such as a confidentiality agreement, a real estate purchase and sale contract, a lease contract, and a service outsourcing contract. The screening criteria are set corresponding to each type. For example, screening criteria corresponding to a confidentiality agreement and screening criteria corresponding to a real estate purchase and sale contract are set.

[0039] Figure 4 is a diagram showing an example of the screening criteria for the confidentiality agreement category. As shown in Figure 3, the screening criteria include multiple criteria items of important viewpoints regarding confidentiality agreements. For example, the criteria items are "For the purpose of entering into a confidentiality agreement between Party A and Party B, the specific transaction contents regarding the commercial relationship or potential commercial relationship between the parties are specified," "Means for identifying confidential information when disclosing confidential information are specified," etc.

[0040] The screening criteria may be preset, or may be set or changeable by the user.

[0041] The second analysis unit 23 performs an analysis of the legal document data based on the examination criteria corresponding to the type of the legal document data. For example, if the legal document data is document data related to a confidentiality agreement, the second analysis unit 23 performs the analysis based on the examination criteria corresponding to the confidentiality agreement.

[0042] The type is selected by the user. For example, the type of the legal document data is selected by the user who uploaded the legal document data. Then, the second analysis unit 23 uses the examination criteria of the selected type.

[0043] The second analysis unit 23 analyzes whether the legal document data conforms to the screening criteria. Specifically, the second analysis unit 23 performs an analysis on each item of the legal document data. Each item is, for example, each clause included in the legal document data, and is a delimited sentence (such as a phrase). The second analysis unit 23 analyzes the conformity status of each criterion item of the screening criteria with respect to the legal document data. That is, the second analysis unit 23 analyzes whether the item of the legal document data is "matched", "mismatched", or "not stated" for each criterion item of the screening criteria. "Matched" indicates that the item conforms to the criterion item of the screening criteria. The notation of "matched" is not limited as long as it is synonymous. "Mismatched" indicates that the item corresponds to the criterion item of the screening criteria but does not conform. The notation of "mismatched" is not limited as long as it is synonymous. "Not stated" indicates that there is no item corresponding to the criterion item of the screening criteria. "Not stated" is synonymous with "not applicable" or "no applicable notation", and the notation is not limited.

[0044] The analysis by the second analysis unit 23 is performed using AI such as GPT (Generative Pre-trained Transformer). The second analysis unit 23 selects an item corresponding to each criterion item of the screening criteria from each item of the legal document data, and judges whether or not the selected item matches the criterion item. If the selected item matches the criterion item, it is determined as "matched", and if it does not match, it is determined as "mismatched". If there is no item corresponding to a criterion item of the screening criteria (if not selected), it is determined as "not stated". The analysis by the second analysis unit 23 is not limited to using AI such as GPT.

[0045] The second analysis unit 23 starts the analysis after outputting the analysis result of the first analysis unit 22. Specifically, the second analysis unit 23 starts the analysis based on an input from the user received after outputting the analysis result of the first analysis unit 22. The input from the user is a selection of a type, as described below. Thus, in this embodiment, the processing order is that the first analysis unit 22 performs a simple analysis, and then the second analysis unit 23 performs a detailed analysis.

[0046] The second analysis unit 23, for example, adds a comment on the analysis result to the legal document data. That is, legal document data with a comment on the analysis result is generated.

[0047] The output unit 24 outputs the analysis result to a predetermined display device for display. In this embodiment, the output unit 24 outputs the analysis result to the user terminal 3 for display. Specifically, the output unit 24 outputs the analysis result of the first analysis unit 22 to the user terminal 3 for display, and then outputs the analysis result of the second analysis unit 23 to the user terminal 3 for display. In particular, the output unit 24 outputs the result of the simple analysis after completion of the simple analysis but before completion of the detailed analysis, and outputs the result of the detailed analysis after completion of the detailed analysis.

[0048] <Processing flow> 5 is a flowchart showing an example of the flow of the analysis process according to this embodiment. Each process of the following steps is started by a start instruction from the user. Note that the order and contents of each step can be changed as appropriate.

[0049] For example, a user can analyze legal document data using a chat tool on the user terminal 3. The chat tool may be a dedicated tool or a general-purpose tool. Use of a chat tool is just an example, and other tools may be used.

[0050] (Step SP10) The reception unit 21 receives legal document data. The reception unit 21 receives the legal document data when the user uploads the legal document data from the user terminal 3. Then, the process proceeds to step SP11.

[0051] (Step SP11) The first analysis unit 22 performs a simple analysis of the received legal document data.

[0052] 6 shows an example of a screen 27 of a user terminal 3 related to the reception of a legal document. The user uses a chat tool to upload data D1 of a "non-disclosure agreement" which is legal document data. The data may be uploaded via chat or may be uploaded to cloud storage and then sent.

[0053] When the legal document data is uploaded at the user terminal 3, the legal document data is accepted and simple analysis is started. As shown in Fig. 6, a reply R1 is displayed saying "The non-disclosure agreement has been accepted. Simple analysis is being performed...". Returning to Fig. 5, the process proceeds to step SP12.

[0054] (Step SP12) When the first analysis unit 22 completes the simple analysis, the output unit 24 outputs the result of the simple analysis to the user terminal 3. That is, the result of the simple analysis is output after the completion of the simple analysis and before the completion of the detailed analysis.

[0055] Fig. 7 shows an example of the screen 27 of the user terminal 3 when the result of the simple analysis is displayed. The result of the simple analysis is displayed as a reply R2. The result of the simple analysis includes the analysis result of the bibliographic information. Specifically, the file name (non-disclosure agreement), the number of pages (2), and the number of characters (2191 characters) are displayed. Returning to Fig. 5, the process proceeds to step SP13.

[0056] (Step SP13) The receiving unit 21 determines whether or not a designation of the type of legal document data has been received from the user.

[0057] As shown in Fig. 7, the type of legal document data can be specified as a reply R3. The type can be selected from types corresponding to prepared screening criteria, for example. For example, the legal document data uploaded by the user is accepted by selecting a type corresponding to the data. Fig. 7 shows an example in which "confidentiality agreement" is selected as the type.

[0058] 5, if a designation of the type of legal document data is accepted, the process proceeds to step SP14, and if a designation of the type of legal document data is not accepted, the process returns to step SP13 and repeats. Note that the process may be terminated if a predetermined time has elapsed while repeating the process of step SP13.

[0059] (Step SP14) The second analysis unit 23 executes a detailed analysis on the legal document data using the examination criteria of the specified type. That is, the specification (acceptance) of the type has a function of instructing the start of the detailed analysis. In the present embodiment, the specification of the type has a function of instructing the start of the detailed analysis, but the user may issue an instruction to start the detailed analysis separately from the specification of the type.

[0060] Fig. 8 shows an example of the screen 27 of the user terminal 3 during the detailed analysis. When the second analysis unit 23 starts the detailed analysis, a reply R4 is displayed indicating that the detailed analysis is being performed. Returning to Fig. 5, the process proceeds to step SP15.

[0061] (Step SP15) When the second analysis unit 23 completes the detailed analysis, the output unit 24 outputs the result of the detailed analysis to the user terminal 3. Specifically, data with comments on the detailed analysis added to the data D1 of the “non-disclosure agreement” is generated, and the data is output to the user terminal 3.

[0062] FIG. 9 shows an example of the screen 27 of the user terminal 3 when the result of the detailed analysis is displayed. As the reply R5, data D2, which is legal document data with comments on the detailed analysis, can be opened on the user terminal 3, and the legal document data can be viewed by the user's selection. Note that the screen 27 may display information such as the number of "matches", the number of "mismatches", the number of "no description", and the match rate. The match rate is the ratio of the number of "matches" to the number of criteria items in the screening criteria.

[0063] 10 to 12 are diagrams showing an example of legal document data with comments. FIG. 10 shows an example in which the comment C1 of "match" is added. In FIG. 10, comments other than comment C1 are omitted. As shown in FIG. 10, comment C1 is added to the relevant item of the legal document data, and comment C1 describes the analysis result. Specifically, comment C1 describes the corresponding criterion item of the screening criteria and the result "match" for that criterion item. This allows the user to recognize that the item to which comment C1 is added conforms to the criterion item of the screening criteria.

[0064] FIG. 11 shows an example where comment C2 of "mismatch" has been added. Note that comments other than comment C2 have been omitted in FIG. 11. As shown in FIG. 11, comment C2 has been added to the relevant item of the legal document data, and comment C2 contains the analysis result. Specifically, comment C2 contains the corresponding criterion item of the screening criteria and the result for that criterion item, "mismatch." This allows the user to recognize that the item to which comment C2 has been added does not conform to the criterion item of the screening criteria.

[0065] FIG. 12 shows an example in which the comment C3 "not stated" is added. Note that in FIG. 12, comments other than comment C3 are omitted. As shown in FIG. 12, for example, comment C3 is added to the title of legal document data, and comment C3 states the analysis result. Specifically, comment C3 states the criterion items of the screening criteria and the result for the criterion item, "not stated." This allows the user to recognize the criterion items of the screening criteria that are not stated in the legal document data.

[0066] In this manner, simple and detailed analyses are performed on legal document data, and the analysis results are provided.

[0067] <Action and effect> As described above, the evaluation program of this embodiment is an evaluation program for analyzing legal document data, and causes a computer to function as a first analysis unit 22 that performs a simple analysis (first analysis) on the legal document data, a second analysis unit 23 that performs a detailed analysis (second analysis) on the legal document data, which requires more calculations or takes more time than the simple analysis, and an output unit 24 that outputs the results of the simple analysis after completion of the simple analysis but before completion of the detailed analysis, and outputs the results of the detailed analysis after completion of the detailed analysis.

[0068] According to this configuration, a simple analysis and a detailed analysis are performed on the legal document data, the simple analysis is output and displayed first, and then the detailed analysis is output and displayed. This allows the user to quickly check the results of the simple analysis, and the simple analysis result allows the user to understand the simple content of the legal document data. Then, the detailed analysis result is displayed, and the detailed content of the legal document data can be understood. This allows the user to check the results of the simple analysis in advance, even if the detailed analysis takes some time, improving the convenience of the user obtaining the analysis results.

[0069] In the evaluation program, a first analysis unit 22 analyzes the bibliographic information of the legal document data, and a second analysis unit 23 analyzes the legal document data based on a predetermined examination criterion.

[0070] According to this configuration, a simplified analysis can be performed by analyzing the bibliographic information, and a detailed analysis of the legal document data can be performed based on predetermined examination criteria.

[0071] In the evaluation program, the second analysis unit 23 starts a detailed analysis after outputting the result of the simple analysis.

[0072] According to this configuration, by performing a simple analysis in advance, which has a small processing load, the results of the simple analysis can be quickly provided to the user.

[0073] Furthermore, in the evaluation program, the second analysis unit 23 starts a detailed analysis based on an input received from the user after outputting the result of the simple analysis.

[0074] According to this configuration, for example, if a user who has checked the result of the simple analysis does not want a detailed analysis, it is possible not to execute the detailed analysis. For example, the simple analysis result may lead the user to determine that there are too many pages and that he or she does not have time for a detailed analysis. In such a case, the detailed analysis is not executed according to the user's input.

[0075] In addition, in the evaluation program, the second analysis unit 23 analyzes the legal document data based on the examination criteria corresponding to the type of the legal document data.

[0076] According to this configuration, detailed analysis can be performed using examination criteria suited to the content of the legal document data, thereby improving the accuracy of the analysis.

[0077] In the evaluation program, the bibliographic information is at least one of the name of the legal document data, the number of pages of the legal document data, and the number of characters of the legal document data.

[0078] According to this configuration, legal document data can be analyzed by simple processing as simplified analysis.

[0079] <Modification> The present disclosure is not limited to the above-mentioned embodiment. In other words, the above-mentioned embodiment with appropriate design modifications made by a person skilled in the art is also included in the scope of the present disclosure as long as it has the features of the present disclosure. In addition, the elements of the above-mentioned embodiment and the modified examples described below can be combined to the extent technically possible, and the combination of these is also included in the scope of the present disclosure as long as it has the features of the present disclosure.

[0080] For example, in the above embodiment, the server device 2 has each function, but each function may be provided in the user terminal 3. Also, each function may be distributed between the server device 2 and the user terminal 3.

[0081] In addition, in the above embodiment, a processing order in which a simple analysis is performed by the first analysis unit 22 and then a detailed analysis is performed by the second analysis unit 23 is described as an example, but the analysis processing may be performed in parallel, for example, and is not limited to the above.

[0082] Furthermore, in the above embodiment, the detailed analysis result is added to the legal document data as a comment. However, the present invention is not limited to the above as long as the detailed analysis result can be provided to the user.

[0083] In the above embodiment, the case where the type of legal document data is selected by the user has been described as an example, but the type may be determined and specified by the uploaded legal document data on the computer side. Specifically, the second analysis unit 23 may determine the type based on the legal document data (or based on the analysis result of the first analysis unit 22), and analyze the legal document data based on the examination criteria corresponding to the determined type. The ability to determine the type on the computer side reduces the burden on the user.

[0084] In the above embodiment, the first analysis unit 22 performs an analysis of bibliographic information as the simplified analysis, but is not limited to the above. For example, the simplified analysis may analyze the degree of agreement (similarity) with past legal document data. The simplified analysis may analyze the presence or absence of similar past legal document data and provide the result to the user, or if present, provide the similar past legal document data to the user. Information on the person in charge of the similar past legal document data may be provided to the user. The simplified analysis is not limited to the case where a type is specified by the user, and the corresponding type may be estimated and proposed to the user. As a result of the simplified analysis, the processing time of the detailed analysis may be estimated based on the results of other simplified analyses such as bibliographic information and proposed to the user. The processing time of the detailed analysis may be based on, for example, bibliographic information or on the type (type) of the contract. The simplified analysis may also be proposed to the user as a correction proposal for clerical errors, etc. [Explanation of symbols]

[0085] 22:First analysis department 23:Second analysis section 24: Output section D1: Data (legal document data)

Claims

1. An evaluation program for performing analysis on legal document data, Computer, a first analysis unit that performs a first analysis on the legal document data; a second analysis unit that performs a second analysis on the legal document data, the second analysis having a larger amount of calculation or a larger calculation time than the first analysis; an output unit that outputs a result of the first analysis after completion of the first analysis and before completion of the second analysis, and outputs a result of the second analysis after completion of the second analysis; To function as Evaluation program.

2. The first analysis unit analyzes bibliographic information of the legal document data, The second analysis unit analyzes the legal document data based on predetermined review criteria. The evaluation program according to claim 1 .

3. The second analysis unit starts the second analysis after outputting a result of the first analysis. The evaluation program according to claim 1 .

4. the second analysis unit starts the second analysis based on an input from a user received after outputting a result of the first analysis. The evaluation program according to claim 3 .

5. The second analysis unit analyzes the legal document data based on the examination criteria corresponding to a type of the legal document data. The evaluation program according to claim 2 .

6. The second analysis unit determines a type based on the legal document data, and analyzes the legal document data based on the examination criteria corresponding to the determined type. The evaluation program according to claim 5 .

7. The bibliographic information is at least one of a data name of the legal document data, a page number of the legal document data, and a character number of the legal document data. The evaluation program according to claim 2 or 5.

8. An evaluation system including a terminal device and an evaluation device capable of communicating with the terminal device, The evaluation device includes: a first analysis unit that performs a first analysis on the legal document data received from the terminal device; a second analysis unit that performs a second analysis on the legal document data, the second analysis having a larger amount of calculation or a larger amount of calculation time than the first analysis; an output unit that outputs a result of the first analysis to the terminal device after the first analysis is completed and before the second analysis is completed, and outputs a result of the second analysis to the terminal device after the second analysis is completed; Equipped with the terminal device displays the output result of the first analysis and the output result of the second analysis, Rating system.

Images