Comment generation program, comment generation device, and comment generation method

Abstract

Generate an appropriate comment proposal in response to the pointed-out matters. 【Solution means】A program for assisting in creating a document regarding an agreement exchanged among a plurality of parties, which causes a computer to function as an acquisition unit and a generation unit. The acquisition unit acquires pointed-out matters indicating the points pointed out by the counterparty of the agreement in the draft of the document regarding the agreement. The generation unit outputs, to the generation device, an instruction to generate a comment proposal regarding the pointed-out matters based on the pointed-out matters and the reference matters corresponding to the pointed-out matters, which are specified from among a plurality of reference matters that can be referred to for creating comments. Comment generation program.

Description

Technical Field

[0001] The present invention relates to a comment generation program, a comment generation device, and a comment generation method.

Background Art

[0002] Legal work includes tasks such as document creation and modification. For example, tasks such as repeatedly creating a document through confirmation and modification among internal stakeholders, or tasks that involve repeatedly modifying a draft (document proposal) multiple times with the other party when making an agreement with an external party have been very time-consuming.

[0003] Among such document creation tasks, one of the particularly time-consuming tasks is creating comments for document reviewers. For example, in large companies, etc., after sending a contract template from the company, if the other party modifies it and the company cannot accept the modification, there are many tasks of commenting on the reasons to the other party, and such comment creation tasks have been a heavy burden.

[0004] Conventionally, as a technology for supporting document creation, a technology for providing reference information for document modification has been known. For example, Patent Document 1 discloses a technology that stores modifications and modification comments for each version of past contracts, and presents modified versions of similar clauses in past contracts and comments on the modifications as modification candidates when modifying a predetermined clause in an input contract.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, the technique described in Patent Document 1 only presents past amendments to similar contracts and their comments for reference. Therefore, it is insufficient as support for creating comments, and more effective support is required. Thus, the present invention aims to solve the above problems.

Means for Solving the Problem

[0007] In order to solve the above problems, the present invention is a program for assisting in creating a document regarding an agreement exchanged among a plurality of parties, causing a computer to function as an acquisition unit and a generation unit, the acquisition unit acquires pointed-out matters indicating the points pointed out by the other party of the agreement in the draft of the document regarding the agreement, and the generation unit outputs an instruction to a generation device to generate a comment draft regarding the pointed-out matter based on the pointed-out matter and a reference matter corresponding to the pointed-out matter specified from among a plurality of reference matters that can be referred to for creating a comment, which is a comment generation program.

[0008] By adopting such a configuration, more effective support regarding the creation of comments can be provided. Specifically, it becomes possible to provide a comment draft based on the pointed-out matters made by the other party, and the creation of comments to be presented to the other party can be supported more effectively.

[0009] In order to solve the above problems, the present invention is a program for assisting in creating a document regarding an agreement exchanged among a plurality of parties, causing a computer to function as an acquisition unit and a generation unit, the acquisition unit acquires pointed-out matters as a result of an evaluation process for the draft of the document regarding the agreement, and the generation unit outputs an instruction to a generation device to generate a comment draft regarding the pointed-out matter based on the pointed-out matter and a reference matter corresponding to the pointed-out matter specified from among a plurality of reference matters that can be referred to for creating a comment, which is a comment generation program.

[0010] By adopting such a configuration, it is possible to provide more effective support for creating comments. Specifically, it becomes possible to provide a comment draft based on the pointed-out matters obtained as a result of the evaluation process, and support for creating efficient comments can be provided. Also, by generating comments on the pointed-out matters obtained as a result of the evaluation process, it can be used, for example, to reduce the burden of the checking work within the company.

[0011] In a preferred form of the present invention, the pointed-out matters include the content changed by the other party to the agreement from the original document in the draft, or the comments pointed out by the other party in the draft, and the generation unit transmits an instruction to the generation device to generate the comment draft indicating an answer to the pointed-out matters based on the pointed-out matters and the reference matters.

[0012] In a preferred form of the present invention, the draft is a document in which the other party to the agreement has added the pointed-out matters to the document draft presented by the user-side party in the agreement.

[0013] In a preferred form of the present invention, when it is a response indicating an answer to a past pointed-out matter which is a past pointed-out matter made during the negotiation process of the agreement, the generation unit outputs an instruction to the generation device to generate a comment draft regarding the pointed-out matter based on the pointed-out matter, the past pointed-out matter related to the pointed-out matter, and the reference matter.

[0014] By adopting such a configuration, it becomes possible to generate a comment draft not only based on the most recent pointed-out matters but also taking into account the past exchanges up to the time when the pointed-out matters were made. As a result, it is expected to prevent problems such as creating comments that are contrary to a series of past pointed-out matters related to the target pointed-out matter, or creating the same comments as those made by the company in the past again.

[0015] In a preferred form of the present invention, the past pointed-out matters include the pointed-out matters made by the other party in a past version of the draft.

[0016] In a preferred embodiment of the present invention, the past remarks include the matters pointed out by the user-side party in the document draft presented by the user-side party.

[0017] In a preferred embodiment of the present invention, the reference matters include reference texts or reference guidelines that serve as the basis for creating comments.

[0018] In a preferred embodiment of the present invention, the reference matters include reference texts or reference guidelines stating the rejection of document changes.

[0019] In the amendment of a document regarding an agreement, it is highly important to comment on the reasons when rejecting a change. With such a configuration, comments when rejecting a change can be appropriately created.

[0020] In a preferred embodiment of the present invention, the reference text includes comment examples showing examples of response comments.

[0021] With such a configuration, based on the comment examples, a natural comment draft corresponding to the pointed-out matters can be generated.

[0022] In a preferred embodiment of the present invention, the computer is further made to function as a specific part, the document includes a plurality of items, the reference matters are pre-registered in association with the items, the specific part specifies the item corresponding to the pointed-out matter and specifies the reference matter corresponding to the item, and the generation part outputs to the generation device an instruction to generate a comment draft regarding the pointed-out matter based on the pointed-out matter and the reference matter specified by the specific part.

[0023] With such a configuration, for example, based on reference matters corresponding to items in a document such as contract terms and points of argument, a more appropriate comment draft can be generated.

[0024] In a preferred embodiment of the present invention, the items include a group of a plurality of clauses that define a collection of regulations sharing a common legal perspective.

[0025] In a preferred form of the present invention, one or more of the reference items are registered for each of the items, and the specific part specifies one of the reference items associated with the item corresponding to the pointed-out item based on the background information regarding the decision.

[0026] With such a configuration, it is possible to generate appropriate comments in line with the background of the target decision or document.

[0027] In a preferred form of the present invention, the instruction includes an instruction to cause the generation device to specify a reference item corresponding to the pointed-out item from among a plurality of reference items and generate the comment draft using the reference item.

[0028] With such a configuration, for example, it becomes possible to have the generation device pre-store candidate reference items in advance and generate a comment draft using appropriate reference items.

[0029] In a preferred form of the present invention, a computer further functions as a specific part, a plurality of the reference items are registered in a database, the reference items include standard reference items and user reference items, the specific part refers to a setting indicating which of the standard reference items or user reference items to use for generating the comment draft, specifies the reference items according to the setting, and the generation part outputs an instruction to cause the generation device to generate a comment draft regarding the pointed-out item based on the pointed-out item and the reference items specified by the specific part.

[0030] With such a configuration, the user can select a reference item to be used for generating the comment draft from among the standard reference items and user reference items. That is, the user can switch between using standard content (standard reference items) and content customized by the user such as adding or modifying information (user reference items).

[0031] In a preferred embodiment of the present invention, the user reference matters include past document comments given in past documents regarding past agreements.

[0032] With such a configuration, it is possible to generate a comment draft by referring to the past document comments. As a result, it is expected that the habits of the user or the company to which the user belongs, the tendency of answers, etc. will be reflected, and a comment draft that conforms more to the intentions of the parties can be generated.

[0033] In a preferred embodiment of the present invention, the document includes a plurality of items, the past document comments are registered in the database in association with the items in the past document, and when the specific part is set to use the user reference matters for the comment draft, the item corresponding to the pointed-out matter is specified, and the past document comment corresponding to the item is specified as the reference matter.

[0034] With such a configuration, in the past document, the past document comment made for the same item as the item corresponding to the pointed-out matter of interest can be used for generating the comment draft. As a result, it is expected that a more appropriate comment draft will be generated.

[0035] In a preferred embodiment of the present invention, the pointed-out matters are associated with the pointed-out locations in the draft, and in addition to the pointed-out matters and the reference matters, the generation unit outputs an instruction to generate the comment draft to the generation device based further on the description content of the pointed-out locations in the draft.

[0036] With such a configuration, it is possible to generate a comment draft according to the description of the pointed-out location.

[0037] In a preferred embodiment of the present invention, in addition to the pointed-out matters and the reference matters, the generation unit outputs an instruction to generate the comment draft to the generation device based further on the background information regarding the agreement.

[0038] By adopting such a configuration, it is possible to generate appropriate comments in line with the target agreement or the background of the document.

[0039] In a preferred embodiment of the present invention, when the user rejects the change indicated by the pointed-out matter, the acquisition unit accepts a selection of the strength of the rejection, and in addition to the pointed-out matter and the reference matter, the generation unit outputs an instruction to generate the comment draft to the generation device based on the strength of the rejection.

[0040] By adopting such a configuration, it is possible to generate a comment draft that reflects the nuance desired by the user.

[0041] In a preferred embodiment of the present invention, the acquisition unit accepts from the user a designation of the pointed-out matters to be the generation targets of the comment draft, and the generation unit transmits an instruction to generate the comment draft for the selected pointed-out matters to the generation device.

[0042] By adopting such a configuration, the user can obtain a comment draft only for the parts that the user considers necessary after seeing the evaluation results. As a result, it is possible to make an easy-to-understand proposal to the user without presenting unnecessary content. Further, by generating an instruction to generate a comment draft for the necessary parts, the amount of information to be transmitted and received and the processing amount in the generation device are reduced. Thereby, an effect of improving the processing speed can be expected, and a further effect of improving the user experience is anticipated.

[0043] In a preferred embodiment of the present invention, one or more of the pointed-out matters are associated with the draft, the acquisition unit accepts from the user a selection of whether to accept the change indicated by each pointed-out matter for each pointed-out matter, and the generation unit transmits an instruction to generate the comment draft for the pointed-out matters for which the user has selected to reject the change to the generation device.

[0044] In the amendment of a document related to a decision, it is highly important to comment on the reasons when rejecting a change. With such a configuration, it is possible to generate a comment proposal for the pointed-out matters for which the change is rejected.

[0045] In a preferred form of the present invention, a plurality of the pointed-out matters are associated with the proposed document, and the generation unit transmits, to the generation device, an instruction to generate the comment proposal collectively for the plurality of the pointed-out matters.

[0046] In a preferred form of the present invention, the acquisition unit acquires, as the pointed-out matters, comments described in the body of the draft or in a file representing the draft.

[0047] Points and amendments to a document can be made by a company in various forms. With such a configuration, it is possible to acquire various comments as pointed-out matters and generate a comment proposal for the pointed-out matters.

[0048] In a preferred form of the present invention, the computer further functions as a specifying unit, the document includes a plurality of items, the specifying unit specifies the item corresponding to the pointed-out matter, and specifies an additional matter corresponding to the item from among the additional matters pre-registered in association with the item, and the generation unit transmits, to the generation device, an instruction to generate the comment proposal to the generation device based on, in addition to the pointed-out matter and the reference matter, the additional matter specified by the specifying unit.

[0049] With such a configuration, it is possible to generate a comment draft while further considering additional matters according to the items. For example, when the generation device generates a comment draft by means of a text generation model that has learned information on the Web, there may be a case where it has learned information based on old laws before amendment or incorrect information. In this case, there is a possibility that a comment draft including incorrect or unnecessary content will be generated. On the other hand, by registering exclusion matters and supplementary matters in advance as additional matters according to the items and generating a comment draft based on this, the occurrence of the above-described problems can be suppressed.

[0050] In order to solve the above problems, the present invention is an apparatus for assisting in creating a document regarding an agreement exchanged among a plurality of parties, comprising an acquisition unit and a generation unit, wherein the acquisition unit acquires pointed-out matters indicating the points pointed out by the other party of the agreement in the draft of the document regarding the agreement, and the generation unit outputs, to a generation device, an instruction to generate a comment draft regarding the pointed-out matters based on the pointed-out matters and a reference matter corresponding to the pointed-out matters, which is specified from among a plurality of reference matters that can be referred to for creating a comment.

[0051] In order to solve the above problems, the present invention is an apparatus for assisting in creating a document regarding an agreement exchanged among a plurality of parties, comprising an acquisition unit and a generation unit, wherein the acquisition unit acquires pointed-out matters as a result of an evaluation process for the draft of the document regarding the agreement, and the generation unit outputs, to a generation device, an instruction to generate a comment draft regarding the pointed-out matters based on the pointed-out matters and a reference matter corresponding to the pointed-out matters, which is specified from among a plurality of reference matters that can be referred to for creating a comment.

[0052] In order to solve the above problems, the present invention is a computer - used method for assisting in creating a document regarding an agreement exchanged among a plurality of parties, wherein the computer acquires matters for pointing out indicated by the counterparty of the agreement in a draft of the document regarding the agreement, and outputs an instruction to a generation device to generate a comment draft regarding the matter for pointing out based on the matter for pointing out and a reference matter corresponding to the matter for pointing out, which is specified from among a plurality of reference matters that can be referred to for creating a comment.

[0053] In order to solve the above problems, the present invention is a computer - used method for assisting in creating a document regarding an agreement exchanged among a plurality of parties, wherein the computer acquires matters for pointing out as a result of an evaluation process for a draft of the document regarding the agreement, and outputs an instruction to a generation device to generate a comment draft regarding the matter for pointing out based on the matter for pointing out and a reference matter corresponding to the matter for pointing out, which is specified from among a plurality of reference matters that can be referred to for creating a comment.

Advantages of the Invention

[0054] According to the present invention, an appropriate comment draft corresponding to the matter for pointing out can be generated.

Brief Description of the Drawings

[0055]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Mode for Carrying Out the Invention

[0056] The present invention relates to a technology for assisting in creating comments to be attached to a draft (document draft, rough draft) of a document in the creation of a document related to an agreement exchanged among multiple parties. For example, a contract is often created by repeatedly revising it back and forth between the contracting parties. The present invention is a technology for generating a comment draft as a response to the points pointed out for a document based on the pointed-out matters and reference matters.

[0057] Hereinafter, it will be described in more detail with reference to the accompanying drawings. Although preferred embodiments are shown in the drawings, it can be implemented in many different forms and is not limited to the embodiments described in this specification.

[0058] For example, in the following embodiments, the configuration, operation, etc. of the comment generation system will be described, but the same effects can also be achieved by a comment generation device, a comment generation system, a method executed by the comment generation device, a comment generation program, etc. In this embodiment, the comment generation system takes a so-called cloud computing mode in which the comment generation program is executed in a server (comment generation device) connected via a network to a client terminal (user terminal) in order to realize its functions in the client terminal.

[0059] The comment generation program may be provided to a computer device as a non-transitory computer-readable storage medium to cause any computer device to function as a comment generation device, or may be provided to be downloadable from an external server. Further, the comment generation program may be a program that is add-on (plug-in) in document editing software such as Microsoft Word (registered trademark).

[0060] In the following embodiments, the "section" may include, for example, a combination of hardware resources implemented by a circuit in a broad sense and information processing of software that can be specifically realized by these hardware resources. In this embodiment, "information" is represented, for example, by a physical value of a signal value representing voltage or current, a high or low of a signal value as a binary bit aggregate composed of 0 or 1, or a quantum superposition (so-called quantum bit), and communication and calculation can be executed on a circuit in a broad sense. A circuit in a broad sense is circuitry realized by appropriately combining a circuit, a processor, a memory, and the like. For example, it is circuitry including any one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), and the like.

[0061] <Definition> First, the definitions of the terms in the present invention will be described. In the present invention, the "agreement" is a decision made among a plurality of parties, and includes terms of use, a declaration to the user, an agreement with the other party, and the like.

[0062] In addition, the "document regarding a resolution" refers to any document indicating a resolution, particularly a legal document that has some relevance to the law. Specifically, examples of documents regarding a resolution include contracts, rules, regulations, notices, agreement documents, demand letters, letters of commission, etc. As for rules, documents of legal norms such as employment rules can be considered. Also, as for notices, documents such as policy declarations regarding privacy can be considered.

[0063] Some legal documents contain units divided into articles, paragraphs, clauses, etc. In this embodiment, each of such units is referred to as an "article or clause". In the following embodiments, the case where the document to be created is a legal document regarding a resolution with a specific counterparty, particularly a contract, that includes a plurality of articles or clauses will be assumed and described.

[0064] In addition, in the present invention, an "item" is, for example, one of the viewpoints that are the objects of examination or evaluation of a legal document. For example, an article or clause may be an item of the present invention, or an argument stipulated in a legal document may be an item of the present invention. In particular, it is preferable to define the necessary items for each type of resolution (contract type, etc.). When referring to an "item" in the embodiments shown below, it refers to the items divided for each type of resolution.

[0065] In a legal document including a contract, from a legal perspective, there are matters regarding its content, necessity, and other matters that allow for discussion or negotiation currently or in the future. Generally, these are called arguments. Specifically, examples of the arguments in the present invention include the contract period, the object of the contract, each specific type of exception defined as an exception to the confidential information in a confidentiality contract, etc. Also, when a set of regulations is defined by a plurality of articles or clauses, the set of regulations can be regarded as one argument. For example, the regulations defined for each of the five types of exceptions to confidential information can be grouped into a group called exceptions to confidential information, and this group can be regarded as one argument. In this embodiment, the form in which an argument is taken as an "item" will be exemplified and described.

[0066] In the present invention, "draft" refers to a proposal or a draft of a document to be created. For example, when making a contract between a company and an external party, one party sends the first draft of the document to the other party (the other party), and then they repeatedly confirm and revise it with each other, and usually multiple versions are created before completion. The "draft" of the present invention widely includes the document proposals in a state of consideration created before the completion of the document.

[0067] Also, the "draft" of the present invention does not have to be the entire text of the document proposal, and it is sufficient if it includes at least a part of the proposal. For example, when partially considering the revision of a document, only the relevant part may be treated as a draft.

[0068] When a point is pointed out in such a draft, the present invention creates a comment regarding the pointed-out point. The information indicating this pointed-out point is called "pointed-out matter" in the present invention. In the present embodiment, the information indicating the pointed-out point from the other party is assumed to be the pointed-out matter. Specifically, the comment (text) created by the other party and the changes from the original document in the draft are included in the pointed-out matter.

[0069] Here, in the creation of a document, it is often the case that multiple rounds of revisions are repeated as described above. Therefore, in such a case, the response made by the other party to the pointed-out points made by the company in the past in the negotiation process of the subject matter may be included in the pointed-out matter. Also, the pointed-out points made by the company in the past may themselves be responses to the pointed-out points made by the other party even earlier. In this way, the pointed-out matter in the target draft may be based on a series of exchanges regarding past pointed-out points.

[0070] In the present invention, such past pointed-out points (past pointed-out points made in the negotiation process of the same agreement) in general are called "past pointed-out points". When referring to past pointed-out points hereinafter, it particularly refers to the pointed-out points that are the premise of the target pointed-out matter. That is, the past pointed-out points include the pointed-out matters made by the other party in the past versions of the draft and the pointed-out matters made by the user-side party in the document proposals presented by the user-side party.

[0071] The acquisition of past remarks may be performed by any method. For example, version management of drafts may be carried out, and past remarks may be acquired from past versions of the same agreement. Also, the date and time of comments included in the draft may be acquired, and comments with an older time period may be acquired as past remarks. For example, among the remarks included in the draft, the most recent remark among the remarks given with the ID of the other party (or an ID other than the company's own) is set as the matter for remark, and remarks made before that remark are acquired as past remarks. Note that since comments may be made in multiple parts, comments of the other party within a predetermined time from the most recent comment of the other party, or comments of the other party after the date and time of the most recent comment of the company's own may be acquired as matters for remark.

[0072] In other embodiments, for example, information indicating remarks made by a supervisor within the company or information indicating remarks obtained as an evaluation result by a computer may be used as matters for remark. By generating a comment proposal for such matters for remark, for example, it is possible to assist in creating a reply to a supervisor or a comment based on the evaluation result by a check tool, and it is possible to assist in document creation and check work within the company. Note that the above-mentioned "evaluation by a computer" can be performed in the same manner as the evaluation process in Embodiment 2 described later.

[0073] The "reference items" of the present invention refer to any information that can be referred to for generating a comment on the matter for remark. Specifically, it includes reference articles and reference guidelines that are the basis for creating a comment. The reference articles include comment examples showing examples of reply comments for the matter for remark, and past comments may be used as comment examples. Also, the reference guidelines are the gist and creation guidelines of the comment. For example, approval or rejection, or the strength of rejection, can be used as the reference guidelines.

[0074] In this embodiment, reference items are associated with items and registered in advance. As a result, in this embodiment, reference items used for generating comment drafts are selected according to the items corresponding to the pointed-out items. In the following embodiments, a case where reference sentences are used as reference items will be assumed and described.

[0075] A specific example of reference items will be described. Among the reference items, as a reference sentence, for example, it is conceivable to register a sentence such as "Thank you for your pointed-out. We are very sorry, but removing the ceiling for the damages we pay will greatly increase our risk, so we cannot remove the ceiling. Therefore, we have reverted to the original text. Please kindly understand and give us your kind consideration." in association with an item regarding the amount of damages.

[0076] By generating comments based on such reference items and taking into account the pointed-out items, comments corresponding to the pointed-out items can be generated based on the reference items. For example, when the other party's pointed-out comment is something like "Please remove the cap on damages", it is expected that comments will be generated in a form that matches the pointed-out items, such as "Thank you for your pointed-out. We are very sorry, but removing the cap for the damages we pay will greatly increase our risk, so we cannot remove the cap. Therefore, we have reverted to the original text. Please kindly understand and give us your kind consideration."

[0077] (Embodiment 1) <1. System Configuration> First, Embodiment 1 will be described. As shown in FIG. 1, the comment generation system 0 includes a comment generation device 1 and a user terminal 2. The comment generation device 1 and the user terminal 2 are configured to be communicable via a network NW. The comment generation device 1 operates as a server, and the user terminal 2 operates as a client terminal. Further, the comment generation device 1 is connected to a generation device 3 via the network NW. The generation device 3 is an external server device that provides a text generation model. In this embodiment, the network NW is an IP (Internet Protocol) network, but there are no restrictions on the type of communication protocol, the type of network, etc.

[0078] The user terminal 2 receives input of information regarding drafts and points from the user, and performs transmission and reception of information with the comment generation device 1. Further, it displays information regarding the comment draft received from the comment generation device 1. Based on the information received from the user terminal 2, the comment generation device 1 transmits to the generation device 3 an instruction to cause the generation device to generate a comment draft based on the pointed-out matters and reference matters. The generation device 3 is a device that provides a text generation model. It receives an instruction from the comment generation device 1, inputs it to the text generation model, and transmits a comment draft as the output of the text generation model to the comment generation device 1. The text generation model will be described later.

[0079] Note that the comment generation device 1 may store the text generation model and be configured to be able to generate a comment draft without using an external device. Or, a configuration may be adopted in which part or all of the processing executed by the comment generation device 1 in this embodiment is executed by the user terminal 2. Also, a configuration may be adopted in which part of the processing executed by the comment generation device 1 in this embodiment is executed by the generation device 3.

[0080] Based on the request sent from the application of the user terminal 2, the comment generation device 1 sends data in a predetermined format as various display information to the application of the user terminal 2. The data in the predetermined format is, for example, data in JSON (JavaScript (registered trademark) Object Notation) format or XML format. The application of the user terminal 2 renders the display data based on the received data and displays various types of information based on the comment draft on the display (display device) of the user terminal 2.

[0081] For example, when executing the display processing of various types of information on the web browser application of the user terminal 2, first, the web browser application sends an HTTP (Hypertext Transfer Protocol) request to the web server and receives an HTTP response including the file requested by the HTTP request. The file to be received is display information including the comment draft, indicating the content or instructions of the web page to be displayed, and is described using a markup language such as HTML (Hypertext Markup Language), for example. A script, which is a program executed on the web browser application, may be added to the received file. The web browser application renders the web page in the display area based on the received file. When a script is added to the file, the browser executes the script and displays the web page according to the execution result.

[0082] <2. Hardware Configuration> As the comment generation device 1 and the generation device 3, one or more information processing devices 10 (computer devices) such as general-purpose servers and personal computers can be used. In this embodiment, the comment generation device 1 is an information processing device 10 installed with a computer program (comment generation program) that executes the comment generation method. However, the comment generation device 1 may be made to function by installing the comment generation program on the terminal device 90.

[0083] As for the user terminal 2, a terminal device 90 (computer device) such as a personal computer, a smartphone, or a tablet terminal can be used. The user terminal 2 has an application (web browser application or dedicated application) for making a request to the comment generation device 1 and receiving a response, and uses the processing result by the comment generation program executed in the comment generation device 1 via this application.

[0084] FIG. 2(a) is a hardware configuration diagram of the information processing apparatus 10. As shown in FIG. 2, the information processing apparatus 10 includes a control unit 101, a storage unit 102, and a communication unit 103, and is used to exert the functions of each unit and each process.

[0085] The control unit 101 includes a processor such as a CPU capable of executing an instruction set, and executes an OS and a program. The storage unit 102 includes a volatile memory such as a RAM capable of storing an instruction set, and a non-volatile recording medium such as an HDD or an SSD capable of recording an OS, a comment generation program, a DBMS (database server), etc. The communication unit 103 includes an interface for physically connecting to a network, executes communication control with the network NW, and performs input / output of information.

[0086] FIG. 2(b) is a hardware configuration diagram of the terminal device 90. As shown in FIG. 2, the terminal device 90 includes a control unit 901, a storage unit 902, a communication unit 903, an input unit 904, and an output unit 905, and is used to exert the functions of each unit and each process.

[0087] The control unit 901 includes a processor such as a CPU capable of executing an instruction set, and executes an OS, a program, etc. The storage unit 902 includes a volatile memory such as a RAM capable of storing an instruction set, and a non-volatile recording medium such as an HDD or an SSD capable of recording an OS, a determination program, etc. The communication unit 903 has an interface for physically connecting to a network, executes communication control with the network NW, and performs input / output of information. The input unit 904 includes an operation input device capable of input processing such as a touch panel or a keyboard, a voice input device capable of voice input such as a microphone, and the like. The output unit 905 includes a display device capable of display processing such as a display, and a voice output device such as a speaker.

[0088] <3. Functional Configuration> Next, the functional configuration will be described. FIG. 3 is a block diagram showing the functional configuration of the comment generation system according to the present embodiment. The comment generation device 1 includes an acquisition unit 11, a specification unit 12, a generation unit 13, an output unit 14, and a database DB. This is specifically realized by hardware for information processing by software.

[0089] Each of the following functional configurations will be described in detail. First, the information stored in the database DB will be described. FIG. 4 is a diagram showing an example of information stored in the database DB in the present embodiment. The database DB pre-registers a plurality of reference items. In the present embodiment, the reference items are registered in association with each item. In particular, in the present embodiment, for each contract type, arguments are registered as items, and one or more reference items are associated and stored for each argument.

[0090] In the present embodiment, one or more reference items are associated and registered for all items, but reference items may be registered only for some items, and reference items without specifying an item may be prepared separately. In this case, a comment draft regarding an item not associated with a reference item may be created using a reference item without specifying an item.

[0091] In this embodiment, as reference information, a reference text showing an example comment is registered, but a reference policy may be registered instead of the reference text. When registering a reference policy in association with an item, for example, it is assumed that the strength of rejection is registered for each item. For example, in an important item, a reference item indicating that the content (e.g., modification) shown in the pointed-out item is strongly rejected may be registered, and in an item that is not so important, a reference item indicating weak rejection may be registered.

[0092] Here, in this embodiment, a plurality of data sets in which one or more reference items are registered for each item are prepared. Specifically, a standard data set consisting of standard reference items that are available to all users at the initial time, and a user data set consisting of user reference items customized by the user's settings or continuous use, are registered in the database DB.

[0093] The user reference item is created by the user editing or adding data to the data set of the standard reference item. For example, the user can create a user data set by adding a past document comment given in a past document regarding a past decision as a user reference item to the standard data set. The reference text in FIG. 4 is an example of a user reference item when such a past document comment is registered. The past document comment is associated with the contract background information by the contract ID. Also in this case, the item corresponding to the past document comment in the past document is specified, and the past document comment is registered as a user reference item in association with the item.

[0094] In addition, in this embodiment, it is assumed that the database DB stores various types of information including reference items in advance in this way. However, it is not necessarily required that this information be stored in a medium accessible from the comment generation device 1. For example, the acquisition unit 11 described later may acquire the reference items by receiving them from the user together with the pointed-out items. Alternatively, the generation device 3 may store the reference items in advance, and the reference items used for generating the comment draft may be specified in the generation device 3. For example, the generation device 3 may be made to learn the reference items, or the reference items may be input and specified so as to be the reference target when generating the comment draft.

[0095] Also, in this embodiment, the database DB stores additional items in association with some items. The additional items are additional information for each item that the generation unit 13 uses for generating instructions. When the text generation model used in the generation device 3 has learned information on the Web, there may be cases where it has learned information based on old laws before amendment or incorrect information. In this case, there is a possibility that a comment draft containing incorrect or unnecessary content may be generated. In contrast, by registering exclusion items and supplementary items in advance as additional items according to the items and generating a comment draft based on this, the above-described problem can be solved.

[0096] Therefore, in this embodiment, additional items are registered in association with items for which such problems are particularly likely to occur. Unlike the reference items, it is not necessary to register the additional items for all items. It is preferable that the additional items be configured so that the user can appropriately add, edit, and delete them.

[0097] In addition to the above, the database DB may further store document background information and contract background information in past documents in association with user reference items. Both the document background information and the contract background information are included in the "background information regarding agreements" in the present invention. The document background information is information regarding the background of a document, such as identification, status, and person in charge in an agreement. For example, it includes information indicating a document ID, a status tag indicating the stage in the adjustment of a contract (agreement) defined by each document, the creation date and time of the document, the inputter who input the document into the database DB, and the legal affairs person in charge of the document. Also, in association with the document background information, a data body indicating the content of the document may be stored.

[0098] The document background information is linked to the contract background information by a contract ID that identifies the contract background information regarding the contract (agreement) defined by each document. Regarding the information of the legal affairs person in charge, it may be input by the user's selection at the time of document registration, or may be specified from the ID of the creator of the pointed-out items (revision history and comments), etc.

[0099] The contract background information is information regarding the background of a contract, such as the type and relationship in an agreement. For example, it includes information on the contract type, the contractor (the other party to the contract), the company's position, and the contract object. The contract type is an example of the "type of agreement" in the present invention. Other examples of the type of agreement include non-standard contracts, regulations, or rules. Also, the company's position refers to the contractual position, such as information on the information discloser or recipient in a confidentiality agreement. The contract object is an example of the "object of the agreement" and refers to goods, services, or businesses, etc. that are the object in each contract (agreement). For example, the target goods in a sales contract correspond to the contract object.

[0100] As described above, during the process of concluding one contract, it is often the case that multiple documents are created with repeated revisions. In the present embodiment, the document background information related to multiple documents created during the process of concluding the same contract is linked to the same contract background information in the database DB. Thereby, in the present embodiment, documents related to the same agreement can be identified.

[0101] Note that the data structure can be arbitrarily changed. For example, in addition to document background information and contract background information, contract family information for managing a group of related contracts may be defined. Specifically, the document background information may include a contract family ID that identifies the contract family information, and the document background information related to a plurality of documents created during the process of concluding the same contract may be managed by the contract family ID. In this case, the contract family information may include a contract ID that identifies the contract background information, and the document background information may not include the contract ID.

[0102] Next, an overview of the processing of each part included in the comment generation device 1 will be described. The acquisition unit 11 acquires a pointed-out matter indicating the point-out of the other party of the decision in the draft of the document regarding the decision. In the present embodiment, the acquisition unit 11 acquires, as the pointed-out matter, a comment described in the document file expressing the draft received from the user terminal 2. Specifically, a message described in the text in the document file, a comment added separately from the text, a record of the change history, etc. can be acquired as the pointed-out matter. Note that the change history is information including the changed content, and may be information including the text before the change and the text after the change, or may be information including the content of the changed part.

[0103] In addition, separately from the document file expressing the draft, a file describing the pointed-out matter may be acquired. As an example of the case where the pointed-out matter is acquired by another file, for example, it is assumed that a file expressing in a table format the description content of the text of the pointed-out part, the changed content, and the comment regarding the change is acquired. In this case, the changed content and the comment are acquired as the pointed-out matter.

[0104] Also, in the present embodiment, in addition to the pointed-out matters, the acquisition unit 11 acquires past pointed-out matters related to each pointed-out matter, the content of the draft, and reference matters corresponding to the pointed-out matters. Further, the acquisition unit 11 may acquire document background information indicating the background of the document and contract background information (agreement background information) indicating the background of the contract defined by the document for the target document. Regarding the draft, only the description content of the part related to the pointed-out matters may be used, but it is preferable to acquire the entire text. Also, regarding the reference matters, the acquisition unit 11 acquires the reference matters specified by the specifying unit 12 from among a plurality of reference matters registered in the database DB.

[0105] The specifying unit 12 specifies an item corresponding to the pointed-out matter and specifies a reference matter corresponding to the item from among the reference matters registered in the database DB. When a plurality of reference matters corresponding to the item are registered, the specifying unit 12 specifies a reference matter to be used for generating a comment draft based on the background information including the document background information and the contract background information. Note that the reference matters may be learned in advance by the generation device 3, and the generation device 3 may include a configuration corresponding to the specifying unit 12.

[0106] The generation unit 13 outputs an instruction to generate a comment draft regarding the pointed-out matter to the generation device 3 based on the pointed-out matter acquired by the acquisition unit 11 and the reference matter corresponding to the pointed-out matter specified from among a plurality of reference matters that can be referred to for creating a comment. The generation unit 13 in the present embodiment generates an instruction sentence indicating that a comment draft showing an answer to the pointed-out matter is generated based on the pointed-out matter and the reference matter specified by the specifying unit 12.

[0107] In the present embodiment, the generation unit 13 generates, as an instruction, a sentence including the pointed-out matter and the reference matter. When additional matters are registered in the database DB in association with the item corresponding to the pointed-out matter, an instruction is further generated based on the additional matters. An instruction may be generated using the background information further. Specifically, a sentence including the pointed-out matter, the reference matter, the additional matter, and the background information is generated as an instruction. The generation unit 13 transmits the instruction generated in this way to the generation device 3.

[0108] The output unit 14 transmits information regarding the comment draft, which is output by the generation device 3 according to the command output by the generation unit 13, to the user terminal 2. Specifically, by performing display processing on the information based on the comment draft and transmitting the processing result to the user terminal 2, the comment draft is displayed on the user terminal 2. In addition, the output unit 14 also performs display processing on various types of information, transmits the processing result, and causes various types of screens to be displayed on the user terminal 2.

[0109] Next, the generation device 3 will be described. The generation device 3 is a device that provides a text generation model. It receives a command from the comment generation device 1, inputs it into the text generation model, and transmits the comment draft as the output of the text generation model to the comment generation device 1.

[0110] The text generation model refers to any model capable of outputting text. As the text generation model, a model generated by machine learning can typically be used. In the present embodiment, it is assumed and described that a conversational text generation model that generates text as an answer to the input text by inputting text is used.

[0111] More specifically, the text generation model is a machine learning model for natural language processing and is a model having a function of generating text based on the input information. For example, the text generation model is a machine learning model based on a Transformer model having a self-attention mechanism. The Transformer model is, for example, a GPT (Generative Pre-trained Transformer) model. The text generation model can perform learning with a large-scale dataset, enabling not only general natural language generation tasks but also highly specialized text generation tasks.

[0112] For example, the text generation model can be a model trained with a large dataset using the GPT-3 or GPT-4 algorithm developed by OpenAI (e.g., the ChatGPT model generated by combining learning with a large dataset and reinforcement learning using a reward prediction model). Also, in this embodiment, although the input to the model is described as an example of text information, it may be input of image information or voice information.

[0113] <4. Processing Procedure> Next, the processing procedure for generating a comment proposal in this embodiment will be described in detail with reference to FIG. 5. FIG. 5 is a sequence diagram showing the flow related to the generation of a comment proposal. First, in step S501, the user terminal 2 transmits a document file representing a draft (including the pointed-out matters) to which a comment has been made by the other party to the comment generation device 1.

[0114] In the comment generation device 1, in step S502, the acquisition unit 11 receives the document file and recognizes the pointed-out matters from the document file. Specifically, when the document file is in a format by document creation software (e.g., a format by Microsoft Word (registered trademark) or a document creation software executed on the cloud), if comments are inserted in a data format different from the main text or a change history is recorded, the comments or the change history are acquired as the pointed-out matters. For example, each comment or change history, the ID of the person who made the comment or change, and the date and time when the comment or change was made are acquired, and based on the ID and the date and time, the latest comment or change history of the other party is acquired as the pointed-out matter.

[0115] In addition, in the case where a document file is in a format created by spreadsheet software (for example, a format created by Microsoft Excel (registered trademark) or a format created by spreadsheet software executed on the cloud), when the company or the other party enters the content of changes (amendments) or comments for each column in a table format, the content of the column in which the content before and after the change and the comments are described is obtained as a matter to be pointed out. For example, based on the column title of a predetermined column in the table, the latest comment or change history of the other party is determined, and the content described in the determined column is obtained as a matter to be pointed out.

[0116] In addition, when a comment is directly described in the text, the entire text may be transmitted to the generation device 3 to extract the comment therefrom. For example, since the text and the comment often have different styles and are often enclosed by parentheses or symbols, for a portion described in a style, format, or description tendency different from that of the text, an instruction to extract the corresponding item and the description content, and the information including the text are transmitted to the generation device 3, and the result output by the generation device 3 is obtained as a matter to be pointed out.

[0117] In addition, the acquisition unit 11 specifies the pointed-out location in the text together with the matter to be pointed out. Specifically, for example, in a document file, when a comment is added in association with the pointed-out location, the pointed-out location is specified. Then, the acquisition unit 11 also acquires the description content (a part of the description content of the text) indicated by the pointed-out location. In addition, the acquisition unit 11 also acquires background information. For example, the acquisition unit 11 acquires an item to which a comment or a change history is given as a pointed-out location. In addition, for example, the acquisition unit 11 also acquires the description content (a part of the text) of an item to which a comment or a change history is given.

[0118] Next, in step S503, the output unit 14 performs display processing on the recognition result in step S502 and transmits the processing result to the user terminal 2. FIG. 6 is a diagram showing an example of displaying the recognition result on the user terminal 2.

[0119] The issue notification screen W6 displays the document summary and the number of recognized issues at the top of the screen. The content of the draft identified by the document file is displayed on the left side of the screen. Also, a button for "editing the recognized content" is arranged, and if there are errors in the content of the document, the content can be edited by selecting this button.

[0120] On the right side of the screen, the recognition results of the issues are displayed. For each issue, an issue display section W61 is displayed together with the number of the clause corresponding to the issue, and the content of the issue, the date, and a selection button W62 for the comment creation policy are displayed.

[0121] Also, for each issue, an issue mark is attached and a sequential number is displayed. The same issue mark is also displayed with the sequential number at the corresponding part (the pointed part) of the issue in the document on the left side of the screen, so that the user can recognize the position corresponding to the issue in the target document, and the target part in the target document is highlighted and displayed.

[0122] For issues that are responses to past issues, such as the issue display section W61 of "Article 6" in FIG. 6, the content of the past issue, the date, and the party that made the issue are also displayed.

[0123] The user can instruct the generation of a comment draft for each issue by selecting the selection button W62. Then, when the user selects the comment creation button W63, a comment generation request for step S505 in FIG. 5 is transmitted.

[0124] Here, the user does not need to select the selection button W62 for all the pointed-out matters. If the selection is made only for some of the pointed-out matters, a comment generation request is sent for one or more of the pointed-out matters for which the comment creation policy has been selected by the selection button W62. That is, the user can specify, by the selection button W62, which of the pointed-out matters added to the draft are to be the targets for generating comment drafts. Here, the selection of the comment creation policy by the selection button W62 corresponds to the selection of whether to accept the target pointed-out matter and the strength of rejection.

[0125] Here, when making a comment creation request for some of the pointed-out matters, the comment creation request includes only the matters related to the pointed-out matters. As a result, the instructions generated by the generation unit 13 are shorter than when generating comment drafts for all the pointed-out matters in the entire draft at once. Further, by the user selecting the parts that are individually necessary and making a comment creation request, the processing time is shortened. Due to these operations, an effect of improving the user experience can be expected. Therefore, it is more preferable to generate a comment draft for a part of the plurality of pointed-out matters, particularly the part corresponding to the pointed-out matters selected by the user.

[0126] In step S506, the specifying unit 12 specifies the reference matters corresponding to each of the pointed-out matters that are the targets for generating comment drafts. The process of specifying the reference matters will be described with reference to FIG. 7. First, in step S701, the specifying unit 12 acquires the background information that the acquisition unit 11 acquired together with the draft in step S501.

[0127] Then, in steps S702 to S704, the specifying unit 12 specifies the reference matters. In the present embodiment, first, in step S702, the specifying unit 12 specifies the item corresponding to the pointed-out location of the pointed-out matter. For example, if the pointed-out location is the description location of the defined clause, the item related to the defined clause is specified as the item corresponding to the pointed-out matter.

[0128] Next, in step S703, the specifying unit 12 specifies a reference sentence (reference item) registered in association with the item in the database DB. At this time, the specifying unit 12 refers to a setting registered in advance indicating which of the pre-registered standard dataset or user dataset is to be used for generating a comment proposal. Then, among the datasets of the reference items registered in the database DB, the reference sentence is specified from the dataset corresponding to the setting.

[0129] When there are a plurality of reference sentences registered in association with the item, in step S703, the specifying unit 12 specifies a reference sentence to be used for generating a comment proposal based on the background information acquired by the acquisition unit 11 in step S501.

[0130] Specifically, for example, the input background information may be compared with the background information corresponding to each reference sentence registered in the database DB, and the reference sentence with more matching information may be specified as the reference sentence to be used for generating a comment proposal.

[0131] Also, in the database DB, a comment creation policy may be registered for each reference sentence, and the reference sentence may be specified based on the comment creation policy selected by the user. For example, for each item, a reference sentence corresponding to each comment creation policy may be registered, and the one corresponding to the comment creation policy selected by the user may be specified as the reference item to be used for generating a comment proposal.

[0132] Returning to FIG. 5, when the specification of the reference item in step S506 is completed as described above, in step S507, the generation unit 13 generates an instruction for the generation device 3. The generation unit 13 generates a comment instruction for causing the text generation model to generate a comment proposal indicating an answer to the pointed-out item based on the specified reference sentence and the pointed-out item.

[0133] Since the text generation model of this embodiment is a conversational model that generates a response text using a natural language text as input, the generation instruction is generated as a natural language text. More specifically, the generation unit 13 can generate a comment instruction by generating a text combining a prepared instruction text, a pointed-out matter, and a reference text.

[0134] As the instruction text, for example, texts for each comment creation policy selected by the user such as "Please create a reply strongly rejecting the following pointed-out matter based on the following reference text.", "Please create a reply weakly rejecting the following pointed-out matter based on the following reference text.", "Please create a reply accepting the following pointed-out matter." etc. can be stored in advance in the database DB.

[0135] Here, when an additional matter associated with an item corresponding to the pointed-out matter is registered in the database DB, it is preferable to include the additional matter in the text of the comment instruction as well. For example, in order to make it appropriate that the term "defect" is no longer used according to the revised Civil Code, regarding the provisions on contract non - conformity in a sales contract, it is assumed that a rule of replacing the word "defect" with "contract non - conformity" is used as an additional matter. If the text generation model has old or incorrect learning data, it may generate incorrect texts (for example, generation of texts including words that should not be used or redundant texts). For example, when learning is performed using a contract before a law amendment, it may generate a text including words (such as "defect") that are no longer used depending on the type of provisions due to the law amendment. Since the tendency for such incorrect texts to be generated varies for each item (argument), it is preferable to adjust so that incorrect texts do not occur for each item. Therefore, by including in the text of the comment instruction an additional matter, which is a rule for adjustment so that incorrect texts are not generated, corresponding to each item registered in advance, more appropriate text generation becomes possible.

[0136] In addition to this, it is also preferable to include in the comment instruction sentence the background information and the description content of the pointed-out parts in the draft text related to the pointed-out matters.

[0137] As a modification, when the generation device 3 performs the specific processing of the reference matters, a sentence instructing to specify the reference matters to be used for generating the comment proposal from among a plurality of reference matters based on the pointed-out matters is further included in the comment instruction.

[0138] When the generation instruction is generated, the process proceeds to step S508, and the generation unit 13 transmits the comment instruction to the generation device 3. When the generation device 3 receives the comment instruction, it inputs the comment instruction into the sentence generation model. As a result, the sentence generation model outputs a comment proposal (step S509).

[0139] The generation device 3 transmits the comment proposal output by the sentence generation model to the comment generation device 1 in step S510. Then, in step S511, the output unit 14 transmits information based on the comment proposal output by the sentence generation model to the user terminal 2. Through the above processing, the user can obtain a comment proposal by inputting a document file representing the draft.

[0140] FIG. 8 is an example of the display of the comment proposal display screen W8 output on the user terminal 2. Similar to the pointed-out matter display screen W6, the outline of the document and the number of recognized pointed-out matters are displayed at the upper part of the screen. The content of the draft specified by the document file is displayed on the left side of the screen. Also, a button for "editing the read content" is arranged, and if there is an error in the content of the document, the content can be edited by selecting this button.

[0141] On the right side of the screen, comment drafts generated for each pointed-out item are displayed. For each pointed-out item, the content, date, and the comment draft display section W81 corresponding to the pointed-out item are displayed together with the number of the clause corresponding to the pointed-out item. In the comment draft display section W81, a copy button is displayed together with the generated comment draft, and the user can copy the text by selecting the copy button. Also, when the comment generation program of the present invention is provided as a program to be added (add-in, plug-in) to document editing software, a comment addition button may be arranged instead of the copy button. In this case, when the user operates the comment addition button, a comment (reply) based on the comment draft is directly added on the document editing software.

[0142] Also, similar to the pointed-out item display screen W6, a pointed-out mark is attached to each pointed-out item, and a sequential number is displayed. Similar pointed-out marks are also displayed together with the sequential number at the corresponding part (pointed-out location) of the pointed-out item in the document on the left side of the screen, so that the user can recognize the position corresponding to the pointed-out item in the target document, and the target part in the target document is highlighted and displayed.

[0143] As described above, according to the comment generation system according to Embodiment 1, a comment draft indicating a reply corresponding to the pointed-out item made by the other party can be generated. Thereby, the burden of the work of creating comments related to the communication such as a contract can be significantly reduced.

[0144] Furthermore, not only comment drafts but also amendments corresponding to the pointed-out locations may be generated. Specifically, the generation unit 13 may output an instruction to generate an amendment regarding the pointed-out item to the generation device 3 based on the pointed-out item, reference item, description content of the pointed-out location in the draft, background information, etc. Specifically, the generation unit 13 generates an instruction sentence based on the pointed-out item, reference item, description content of the pointed-out location in the draft, and background information, and transmits this to the generation device 3. Thereby, the modification corresponding to the other party's pointed-out and the accompanying comment draft can be generated collectively.

[0145] Further, not only the pointed-out matters but also a comment draft based on the company's own amendment may be generated. Specifically, the generation unit 13 may output an instruction for generating a comment regarding the pointed-out matters and the company's own amendment to the generation device 3 based on the pointed-out matters, reference matters, the company's own amendment, etc. The company's own amendment may be an amendment generated by the generation device 3 or an amendment input by the user. This enables comments (e.g., the intention of the amendment, etc.) corresponding not only to the other party's pointed-out matters but also to the company's own amendment.

[0146] Note that based on the company's own amendment, reference matters corresponding to the pointed-out matters may be specified. For example, it may be configured to allow the user to select the type of amendment, and to specify reference matters associated with the type of amendment. For example, the specifying unit 12 determines the type of the company's own amendment selected by the user. If the selected type of amendment is a correction of a misspelling, it specifies, as the reference matters associated with the correction of the misspelling, a reference sentence such as "This was a misspelling, so we corrected it." At this time, when the other party's pointed-out comment is "What does 'damage compensation' mean?" and the company's own amendment is "compensation for damages", it is expected that a comment will be generated that takes into account the company's own amendment and the other party's pointed-out matters, such as "The term 'damage compensation' was a misspelling, so we corrected it to 'compensation for damages'." The method of specifying reference matters based on the company's own amendment is not limited to user selection, and any method may be used as long as it can specify reference matters corresponding to the content of the company's own amendment. For example, the text before the amendment and the text after the company's amendment may be input into a text generation model, and reference matters to be referred to may be specified from a plurality of predetermined reference matters.

[0147] (Embodiment 2) Next, Embodiment 2 will be described. Also in Embodiment 2, the point of generating a comment draft regarding the pointed-out matters based on the pointed-out matters and reference matters is the same as in Embodiment 1. On the other hand, the comment generation device 1 of Embodiment 2 further includes an evaluation unit and a correction unit, and is different from Embodiment 1 in that it performs an evaluation process and a correction process on the draft and generates a comment draft according to the content.

[0148] In Embodiment 1, an example of creating a comment proposal for the matters pointed out by the other party for the draft pointed out by the other party was shown. In Embodiment 2, an example of creating a comment proposal for the matters pointed out by the company itself, rather than the matters pointed out by the other party, will be described. For example, a form of making corrections and comments to the other party regarding the corrections is assumed in the case where a document template that does not include the matters pointed out by the other party is used as the draft.

[0149] In the following, the description will be centered on the parts different from Embodiment 1, and the description of the parts common to Embodiment 1 will be omitted. That is, the parts not described are the same as those in Embodiment 1.

[0150] <1. Functional Configuration> FIG. 9 is a block diagram showing the functional configuration of the comment generation system in the present embodiment. The comment generation device 1 includes an acquisition unit 11, a specification unit 12, a generation unit 13, an output unit 14, a database DB, and in addition, an evaluation unit 15 and a correction unit 16.

[0151] The evaluation unit 15 executes an evaluation process on the draft and acquires evaluation information including the matters pointed out associated with a part of the draft. The evaluation information may be acquired from an external device that evaluates the input document, but in the present embodiment, the evaluation unit 15 executes an evaluation process on the draft to acquire the evaluation information.

[0152] The evaluation information includes, for each of one or more identified issues, the clause in the draft corresponding to the identified issue and the evaluation comment. The evaluation comment is a statement that proposes corrections or points out problems regarding the content of the input document, such as "Is it necessary to stipulate the negotiation terms?" or "Is the period for assuming the confidentiality obligation set longer than necessary?" In addition, information such as an explanatory statement about the clause related to the identified issue, a template of the clause, and a risk level indicating the importance of the identified issue may be included in the evaluation comment. The identified issues are legal evaluations, for example, evaluations from perspectives that can be legally argued.

[0153] Specifically, the acquisition unit 11 acquires at least a part of the draft together with the background information, and the evaluation unit 15 acquires this information. Then, based on the background information, the draft is evaluated. The evaluation may be performed by any method, such as evaluation by a machine learning model or rule-based evaluation. For example, when rule-based evaluation is applied, the evaluation unit 15 determines which evaluation comment to associate with each part (e.g., clause) of the draft based on the keywords included in that part of the draft and a predetermined keyword criterion (rule-based model).

[0154] In addition, when the evaluation by machine learning is applied, the evaluation unit 15 determines an evaluation comment to be associated with a part of the input draft by using a machine learning model that outputs an estimation result which is a result of estimating which of a plurality of predetermined evaluation comments should be associated based on a part of the content of the draft. Alternatively, as a type of machine learning model, a text generation model may be applied, and the evaluation unit 15 may be configured to generate an evaluation comment for a part of the draft under a predetermined evaluation rule. For example, as background information, the contract type and the contractual position, and the title of each clause in the draft can be used to evaluate the content of each clause and the relationship between the plurality of clauses. In the evaluation, the evaluation may be performed from viewpoints such as whether there are any unnecessary clauses (or clauses that are disadvantageous to oneself from the relationship with the other party included in the background information), whether there are any clauses to be added, and whether the content of the clauses is appropriate.

[0155] In this embodiment, since the evaluation process is performed for each item based on rules, the evaluation comments (points to be noted) are associated with the items. As a result, the item for each pointed-out matter is specified.

[0156] The correction unit 16 inputs the draft and the evaluation information to the generation device 3, causes the generation device 3 to generate an amendment corresponding to the draft, and acquires the amendment. In this embodiment, an example will be described in which the correction unit 16 generates a correction instruction in natural language and transmits it to the generation device 3, and the generation device 3 uses a text generation model to generate an amendment. As the text generation model, a model similar to the text generation model for generating comments can be used.

[0157] The correction instruction includes the text of the draft and the evaluation information, and is information indicating an instruction for causing the text generation model to output an amendment to the draft. In this embodiment, since a conversational text generation model that takes a text as an input is used, as the correction instruction, a sentence or text in natural language that instructs the correction of the input document information using the draft and the evaluation information is generated and transmitted. Then, the correction unit 16 receives the sentence or text output by the text generation model as an answer and acquires the amendment.

[0158] In addition, in generating the amendment, instead of or in addition to the evaluation information, related document information indicating the content of the related documents may be used. The related documents refer to the documents related to the document to be created and regarded as a reference for amending the document to be created. In particular, the related documents are preferably the documents that are common with the document to be created in terms of background information such as the type of agreement, the other party, the company's position, and the contract target.

[0159] The related document information is the information indicating the content of the part corresponding to the input document information in particular among the related documents. For example, when the input document information is the information indicating the content of the clause defining a certain regulation in the input document, the information indicating the content of the clause defining the same regulation in the related documents becomes the related document information.

[0160] In addition, the related document information of the present embodiment includes information regarding the amendments made to the part indicated by the related document information when creating the related documents. The information regarding the amendments may be, for example, the information such as the description content before and after the amendment, the amendment location, the user who made the amendment, and the comment related to the amendment. The amendment location may be specified based on the difference between the description contents before and after the amendment and is the information specifying the position in the document.

[0161] Here, the correction unit 16 of the present embodiment generates a correction instruction for each of the pointed-out matters included in the evaluation information. At this time, when additional matters are registered in association with the items corresponding to the pointed-out matters in the database DB, it is preferable to include the additional matters in the correction instruction as well. Thereby, it is expected to prevent the generation of an amendment including incorrect or unnecessary content by the generation device 3 that has learned information based on the old law before the amendment or incorrect information.

[0162] In addition, the acquisition unit 11 of the present embodiment acquires, as the pointed-out matters, the evaluation comments constituting the above-described evaluation information and the correction content performed by the correction unit, instead of the pointed-out matters indicating the points pointed out by the other party acquired in the first embodiment. In addition, the same information as the information acquired in the first embodiment is acquired.

[0163] <2. Processing Procedure> Next, the processing procedure related to evaluation, generation of amendments, and generation of comment drafts will be described with reference to FIG. 10. FIG. 10 is a sequence diagram showing the flow related to evaluation, generation of amendments, and generation of comment drafts.

[0164] (1) Evaluation Process First, in steps S1001 to S1004, an evaluation process is executed. This process is for obtaining evaluation information indicating the evaluation of the draft. In the present embodiment, as will be described below, the evaluation unit 15 performs the evaluation of the draft, but evaluation information may be obtained by having an external device perform the evaluation of the draft.

[0165] In step S1001, the user terminal 2 transmits an evaluation request together with the draft to the comment generation device 1. The evaluation request includes the draft and background information. In the present embodiment, a file of a document describing the draft of the contract is uploaded. The background information is the same as in Embodiment 1.

[0166] In the comment generation device 1, the acquisition unit 11 receives the evaluation request, and in step S1002, the evaluation unit 15 executes an evaluation process based on the draft and the background information. The evaluation of the draft may be performed by any method such as evaluation by a machine learning model or rule-based evaluation. As an example, in the present embodiment, a method of evaluating arguments and clauses based on rules according to the background information is used.

[0167] In particular, in the present embodiment, using the contract type and the contractual position in the background information and the title of each clause in the draft, the content of each clause and the relationship between a plurality of clauses are evaluated. Here, the plurality of clauses refers to a group of a plurality of clauses that define a coherent regulation. For example, within the group, the presence or content of Clause B is determined according to the content of Clause A, and further, Clause C is confirmed based on the result, etc. By stipulating so that the evaluation process branches according to the content, the relationship between the plurality of clauses can be evaluated based on rules.

[0168] In the evaluation of a draft, the evaluation is carried out from the viewpoints such as whether there are any unnecessary clauses (or clauses that are disadvantageous to oneself due to the relationship with the other party in the background information), whether there are clauses to be added, and whether the content of the clauses is appropriate.

[0169] In this embodiment, by registering the pointed-out matters in advance in the database DB in association with the above rules, the pointed-out matters for the draft are specified. Specifically, for each pointed-out matter, the above evaluation rules, the type of pointing out (any one of clause deletion, addition, and content modification), the evaluation comment, and the risk level are stored in the storage unit in advance.

[0170] The evaluation comment is a sentence that makes a proposal for modification or points out problems regarding the content of the draft, such as "Is it necessary to stipulate the negotiation clause?" or "Is the period for assuming the confidentiality obligation set longer than necessary?" In addition, further, an explanatory sentence about the clause related to the pointing out and information on the template of the clause may be included in the evaluation comment. The risk level is information indicating the degree of risk assumed in each pointed-out matter. The risk level may be fixed (unchangeable) on the system side, or may be made changeable by the user's input.

[0171] Examples of setting the risk level are as follows. For pointed-out matters related to issues that are likely to become problems after the contract and are related to important rights and obligations of the company, the risk level "A" can be set. For example, it includes "ownership of intellectual property", "scope of damages", "definition of confidential information", etc. Also, for pointed-out matters related to issues that are less likely to become problems even if omitted, the risk level "C" can be set. For example, it includes "exceptions to confidential information", "obligation to report during the process", etc. And among multiple groups, pointed-out matters that do not fall under A and C can be set to the risk level "B". Note that the risk level may be set for each issue, or may be a risk determined based on the language of the clause. For example, the risk level may be a risk level set based on a determination of whether the company is advantaged or disadvantaged based on the language of the clause.

[0172] As described above, the evaluation unit 15 executes an evaluation process, creates evaluation information indicating the evaluation of the draft, and the acquisition unit 11 acquires the evaluation information (step S1003). The evaluation information includes, for each of the one or more pointed-out matters identified in the above process, an item corresponding to the pointed-out matter, an evaluation comment, and a risk level. Also, when acquiring evaluation information from an external device, evaluation information including a clause corresponding to the pointed-out matter, an evaluation comment, and a risk level is acquired for each pointed-out matter.

[0173] Note that the draft may be evaluated using a text generation model. The text generation model may be the same as or different from the text generation model used for comment generation or the text generation model used for correction. For example, the comment generation device 1 acquires the draft and background information by the acquisition unit 11, reads out evaluation rules stored in advance based on the background information by the evaluation unit 15, generates an evaluation instruction based on the draft and the evaluation rules corresponding to the background information, transmits it to the generation device 3, and acquires the evaluation result (evaluation information) generated by the generation device 3.

[0174] At this time, the evaluation instruction is generated as a sentence in natural language. Thereby, an effect of reducing the influence on the evaluation due to fluctuations in the notation of the sentence, differences in expressions, etc. can be expected. Also, among a plurality of evaluation rules, it is expected that an appropriate evaluation can be performed by using the evaluation rules read out based on the background information (for example, contract type) (for example, evaluation rules set for each contract type).

[0175] Furthermore, the evaluation by the text generation model and the rule-based evaluation may be performed simultaneously. At this time, when the evaluation by the text generation model and the rule-based evaluation are different, it is preferable to perform a process that prioritizes the rule-based evaluation. Thereby, even if uncertainty in the evaluation by machine learning occurs, a minimum evaluation can be guaranteed based on the rules. Among a plurality of evaluation rules corresponding to each piece of background information, the evaluation unit 15 may determine the evaluation rule to be included in the evaluation instruction based on the background information, or include a plurality of evaluation rules in the evaluation instruction and include in the evaluation instruction that an appropriate rule is to be used from the plurality of rules based on the background information, so that the evaluation rule used by the text generation model may be determined.

[0176] When the evaluation unit 15 finishes evaluating the draft, in step S1004, the output unit 14 performs display processing on the evaluation information and transmits the processing result to the user terminal 2. When the user terminal 2 receives the evaluation information, the evaluation information is subjected to display processing and the processing result is displayed on the display.

[0177] FIG. 11 shows a display example of an evaluation screen displayed on the user terminal 2 as a display processing result of the evaluation information. The evaluation screen W11 displays an outline of the draft of the document and an outline of the evaluation result at the upper part of the screen. The content of the draft specified by the draft information is displayed on the left side of the screen. Also, a button for "editing the read content" is arranged, and if there is an error in the content specified from the draft information, the content can be edited by selecting this button.

[0178] On the right side of the screen, the evaluation result based on the evaluation information is displayed. For each pointed-out matter, the type indicating which of deletion, addition, and content correction of the clause the pointed-out is, and the explanation are displayed as evaluation comments.

[0179] For each of the pointed-out matters, a pointed-out mark with a different shape is attached according to the type of the pointing-out, and a serial number for each type is displayed. Similar pointed-out marks are also displayed together with the serial number at the corresponding part of the pointed-out matter in the draft on the left side of the screen, so that the user can recognize the position corresponding to the pointed-out matter in the draft, and the target part in the draft is highlighted and displayed. In the example of FIG. 11, the round mark indicates the correction of the content of the clause, and the triangular mark indicates the pointed-out matters related to the missing clauses.

[0180] Also, in the present embodiment, a correction input section W111 is displayed for each pointed-out matter. In the present embodiment, since both the evaluation information and the related contract are used in the correction process, the related contract is displayed in the correction input section W111. And a correction button W112 is arranged, and correction can be performed using the displayed related contract. Note that a plurality of related contract candidates may be displayed and the user may select the related contract to be used for correction.

[0181] The comment instruction section W113 is displayed operably when the correction button W112 is selected, and accepts an input from the user indicating a desire to generate a comment draft regarding the correction. Then, the correction request in step S1006 is transmitted.

[0182] Here, it is preferable that the user does not need to select the correction button W112 for all the pointed-out matters, and the configuration is such that the user selects the correction button W112 only for the pointed-out matters for which the user desires correction or generation of a comment draft regarding the correction. Thereby, correction or generation of a comment draft regarding the correction can be performed only for the pointed-out matters for which the user desires correction or generation of a comment draft regarding the correction. For example, for one or a plurality of pointed-out matters for which a correction instruction is given by the correction button W112 selected by the user, a correction request is transmitted.

[0183] Also, among the pointed-out matters for which the correction button W112 is selected, when "Yes" is selected in the comment instruction section W113, a comment generation request regarding the correction of the pointed-out matter is also transmitted together with the correction request. That is, the user can specify, using the correction button W112 and the comment instruction section W113, which of the pointed-out matters resulting from the evaluation process are to be corrected and which are to be the targets for generating comment drafts. In the comment instruction section W113, similar to the first embodiment, it may further accept comment creation policies such as strongly rejecting or weakly rejecting. Also, the correction button W112 and the comment instruction section W113 may be integrated, and configured such that when the user presses the integrated correction button, generation of the amendment and generation of the comment are simultaneously instructed.

[0184] (2) Correction process Next, the correction process for the draft will be described. In steps S1005 to S1010, the correction process is executed. When a correction request is received as described above, in step S1006, the acquisition unit 11 acquires the draft, the evaluation information, and the related contract document. Also, the acquisition unit 11 of this embodiment further acquires the above-described background information. In this embodiment, the draft and background information received in step S1001 and the evaluation information generated by the evaluation unit 15 in step S1002 are stored in the database DB, and the acquisition unit 11 acquires the draft, background information, evaluation information, and related contract document based on them. When the evaluation is performed by an external device, the acquisition unit 11 may acquire the evaluation information from the user terminal 2 or the external device.

[0185] Note that the draft does not necessarily need to include the entire content of the document, and it may be configured such that only the part related to the pointed-out matter to be corrected is included in the draft. However, for example, when there is a group of multiple clauses that define a set of regulations and corrections are to be made to the pointed-out matters regarding the clauses included in the group, it is preferable to include not only the single clause corresponding to the pointed-out matter but also the entire content of the multiple clauses in the group.

[0186] Next, in step S1007, based on the draft, background information, evaluation information, and related contract documents acquired by the acquisition unit 11, the correction unit 16 generates a correction instruction for causing the sentence generation model to generate an amendment to the draft. Since the sentence generation model of the present embodiment is a conversation type model that takes a sentence in natural language as input and generates a sentence as an answer, the correction instruction is generated as a sentence in natural language.

[0187] The correction unit 16 of the present embodiment generates, as a correction instruction, a sentence in which instructions regarding corrections are described for each clause corresponding to the pointed-out matters. In particular, for example, when there are a plurality of pointed-out matters in one clause or a group of a plurality of clauses defining a set of regulations, if a correction instruction is generated in units of the pointed-out matters, there is a possibility that a plurality of conflicting amendments will be generated. Therefore, the correction unit 16 of the present embodiment generates a sentence of the correction instruction for each clause or group of clauses corresponding to the plurality of pointed-out matters as a correction instruction regarding the clause or group of clauses in which the plurality of pointed-out matters exist.

[0188] The generation of the following correction instructions will be specifically described. First, regarding the background information, when the background information is input by selection, first, the words corresponding to the selected background information are specified. For example, by presetting the corresponding words for each option of the background information in advance, the words corresponding to the selected background information can be specified.

[0189] Then, based on the words, the draft, and the instruction sentences registered in advance in the storage unit of the comment generation device 1, the correction unit 16 generates a correction instruction. When the background information is input as free-form text, a correction instruction may be generated using the input background information and the instruction sentences prepared in advance.

[0190] Here, as words corresponding to the background information, it is preferable to store a character string describing the rules for document creation according to the background information. For example, in legal documents, the legal meaning may be different depending on whether an exception is described within a single sentence of a regulation or a proviso sentence is separately described after a sentence. By combining words that specify the rules of such description methods according to the background information, an appropriate legal document can be created. Among the multiple rules corresponding to each background information, the comment generation device 1 may determine the rules to be included in the correction instruction based on the background information, or include multiple rules in the correction instruction and include in the correction instruction that an appropriate rule is to be used from the multiple rules based on the background information, and the configuration may be such that the rule used by the sentence generation model is determined.

[0191] As an instruction sentence, for example, sentences such as "Regarding the above draft, the following points have been pointed out as a result of the review. Based on the following conditions, please create an amendment considering these points." or "Regarding the above draft, the following points have been pointed out as a result of the review. Based on the following rules, please create an appropriate contract text." can be stored in the database DB in advance. Then, a sentence combining the content of the draft, the instruction sentence, and the words based on the background information may be generated as a correction instruction for instructing the sentence generation model to correct the draft.

[0192] Here, when additional matters associated with items corresponding to the pointed-out matters are registered in the database DB, it is preferable to also include the additional matters in the text of the comment instruction. Alternatively, by making the above instruction sentence different for each item, exclusion matters, supplementary matters, etc. for each item may be included in the instruction sentence. As a result, it is expected to have the effect of preventing the generation of an amendment containing incorrect or unnecessary content by the generation device 3 that has learned information based on an old law before amendment or incorrect information.

[0193] When a correction command is generated, the process proceeds to step S1008, and the correction unit 16 transmits the generated correction command to the generation device 3. Note that the correction commands for each pointed-out matter, each clause, or each group of clauses generated as described above may be transmitted separately in multiple times. For example, it is also possible to configure such that first the part of the instruction statement in the correction command is transmitted, and subsequently words corresponding to the pointed-out matters and requests are transmitted. Further, it may be configured to determine whether to transmit at once or in multiple times according to the number of characters of the correction command.

[0194] When the generation device 3 receives the correction command, it inputs the correction command into the text generation model. As a result, the text generation model outputs an amendment to the draft (step S1009), and in step S1010, the amendment is transmitted to the comment generation device 1. Note that the correction unit 16 may generate a correction command for instructing to propose a plurality of amendments for one pointed-out matter in step S1008, and in step S1009, the generation device 3 may obtain a plurality of amendments for some or all of the pointed-out matters.

[0195] (3) Comment generation process Next, the comment generation process will be described. In steps S1011 to S1016, the comment generation process is performed. The flow of the process in steps S1011 to S1016 is generally the same as that in steps S506 to S511 in Embodiment 1.

[0196] However, in the generation of the command in step S1012, the information used and the gist of the command are different from those in Embodiment 1. Specifically, the generation unit 13 in the present embodiment uses, as the pointed-out matter, the above-described evaluation information (evaluation comment) and the amendment received from the generation device 3 by the correction unit 16 in step S1010 or the correction content based thereon. Then, based on this information, the generation unit 13 generates a command for generating a comment draft for conveying the gist, intention, or reason of the pointed-out matter to the checker.

[0197] Then, in steps S1013 to S1016, comment proposals are similarly generated and information is output, and in step S1016, a screen including a comment proposal is displayed to the user.

[0198] As described above, according to the comment generation system according to Embodiment 2, corrections are made corresponding to the pointed-out matters obtained as a result of the evaluation process, and a comment proposal indicating the gist, intention, or reason for the correction can be generated. Thereby, for example, when correcting a draft received from the other party, the burden of the work of creating comments for the other party can be significantly reduced.

Explanation of Signs

[0199] 0: Comment generation system 1: Comment generation device 11: Acquisition unit 12: Identification unit 13: Generation unit 14: Output unit 15: Evaluation unit 16: Correction unit 2: User terminal 3: Generation device 90: Terminal device 901: Control unit 902: Storage unit 903: Communication unit 904: Input unit 905: Output unit 10: Information processing device 101: Control unit 102: Storage unit 103: Communication unit W11: Evaluation screen W111: Correction input unit W112: Correction button W113: Comment instruction unit W6: Pointed-out matter display screen W61: Pointed-out matter display unit W62: Selection button W63: Comment creation button W8: Comment proposal display screen W81: Comment Proposal Display Section

Claims

1. A program for assisting in creating a document regarding an agreement exchanged among a plurality of parties, wherein a computer functions as an acquisition unit and a generation unit, the acquisition unit acquires matters for pointing out indicated by the other party of the agreement in a draft of the document regarding the agreement, and the generation unit outputs, to a generation device, an instruction to generate a comment draft regarding the matter for pointing out, based on the matter for pointing out and a reference matter corresponding to the matter for pointing out, which is specified from among a plurality of reference matters that can be referred to for creating a comment. A comment generation program.

2. The matter for pointing out includes content changed by the other party of the agreement from an original document in the draft, or a comment pointed out by the other party in the draft, and the generation unit transmits, to the generation device, an instruction to generate, based on the matter for pointing out and the reference matter, a comment draft indicating an answer to the matter for pointing out. The comment generation program according to claim 1.

3. The draft is a document in which the other party of the agreement added the matter for pointing out to a document draft presented by the user-side party in the agreement. The comment generation program according to claim 1.

4. When the matter for pointing out indicates an answer to a past pointing out that was a past pointing out made during the negotiation process of the agreement, the generation unit outputs, to the generation device, an instruction to generate a comment draft regarding the matter for pointing out, based on the matter for pointing out, the past pointing out related to the matter for pointing out, and the reference matter. The comment generation program according to claim 3.

5. The past pointing out includes the matter for pointing out made by the other party in a past version of the draft. The comment generation program according to claim 4.

6. The past pointing out includes the matter for pointing out made by the user-side party in a document draft presented by the user-side party. The comment generation program according to claim 4.

7. The reference matter includes a reference text or reference guideline that serves as a basis for creating a comment. The comment generation program according to claim 1.

8. The reference matter includes a reference text or reference guideline for rejecting a change to a document. The comment generation program according to claim 7.

9. The reference text includes a comment example showing an example of an answer comment. The comment generation program according to claim 7.

10. The computer further functions as a specifying unit, the document includes a plurality of items, the reference items are pre-registered in association with the items, the specifying unit specifies the item corresponding to the pointed-out item and specifies the reference item corresponding to the item, the generating unit outputs, to the generating device, an instruction to generate a comment draft regarding the pointed-out item based on the pointed-out item and the reference item specified by the specifying unit. The comment generation program according to claim 1.

11. The item includes a group of a plurality of clauses that define a collection of regulations with a common legal perspective. The comment generation program according to claim 10.

12. One or more reference items are registered for each item, the specifying unit specifies one of the reference items associated with the item corresponding to the pointed-out item based on the background information regarding the decision. The comment generation program according to claim 10.

13. The instruction includes an instruction to cause the generating device to specify the reference item corresponding to the pointed-out item from among a plurality of reference items and generate the comment draft using the reference item. The comment generation program according to claim 1.

14. The computer further functions as a specifying unit, a plurality of the reference items are registered in a database, the reference items include standard reference items and user reference items, the specifying unit refers to a setting indicating which of the standard reference items or user reference items is to be used for generating the comment draft, and specifies the reference item according to the setting, the generating unit outputs, to the generating device, an instruction to generate a comment draft regarding the pointed-out item based on the pointed-out item and the reference item specified by the specifying unit. The comment generation program according to claim 1.

15. The user reference item includes a past document comment given in a past document regarding a past decision. The comment generation program according to claim 14.

16. the document includes a plurality of items, the past document comment is registered in the database in association with the item in the past document. The specific part specifies the item corresponding to the pointed-out matter and specifies the past document comment corresponding to the item as the reference matter when the setting for using the user reference matter in the comment proposal is made. The comment generation program according to claim 15.

17. The pointed-out matter is associated with the pointed-out location in the draft, In addition to the pointed-out matter and the reference matter, the generation unit outputs an instruction to generate the comment proposal to the generation device based on the description content of the pointed-out location in the draft. The comment generation program according to claim 1.

18. In addition to the pointed-out matter and the reference matter, the generation unit outputs an instruction to generate the comment proposal to the generation device based on the background information regarding the agreement. The comment generation program according to claim 1.

19. When the user rejects the change indicated by the pointed-out matter, the acquisition unit accepts a selection of the strength of the rejection, In addition to the pointed-out matter and the reference matter, the generation unit outputs an instruction to generate the comment proposal to the generation device based on the strength of the rejection. The comment generation program according to claim 1.

20. The acquisition unit accepts from the user a designation of which of the pointed-out matters are to be the generation targets of the comment proposal, For the selected pointed-out matters, the generation unit transmits the instruction to generate the comment proposal to the generation device. The comment generation program according to claim 1.

21. One or more of the pointed-out matters are associated with the draft, The acquisition unit accepts from the user for each pointed-out matter a selection of whether to accept the change indicated by each pointed-out matter, For the pointed-out matters for which the user has selected to reject the change, the generation unit transmits the instruction to generate the comment proposal to the generation device. The comment generation program according to claim 1.

22. A plurality of the pointed-out matters are associated with the draft, For the plurality of pointed-out matters, the generation unit transmits an instruction to generate the comment proposal collectively to the generation device. The comment generation program according to claim 1.

23. The acquisition unit acquires the comment described in the text of the draft or the file representing the draft as the pointed-out matter. The comment generation program according to claim 1.

24. The computer is further made to function as a specific part, the document includes a plurality of items, the specific part specifies the item corresponding to the pointed-out matter, and specifies the additional matter corresponding to the item from among the additional matters registered in advance in association with the item, The generation unit transmits, to the generation device, an instruction to generate the comment draft to the generation device based on the pointed-out matter, the reference matter, and further the additional matter specified by the specific part, according to the comment generation program of claim 1.

25. An apparatus for assisting in creating a document regarding an agreement exchanged among a plurality of parties, comprising an acquisition unit and a generation unit, the acquisition unit acquires a pointed-out matter indicating a pointed-out by the other party to the agreement in the draft of the document regarding the agreement, the generation unit outputs, to the generation device, an instruction to generate a comment draft regarding the pointed-out matter based on the pointed-out matter and a reference matter corresponding to the pointed-out matter, which is specified from among a plurality of reference matters that can be referred to for creating a comment, Comment generation device.

26. A method using a computer for assisting in creating a document regarding an agreement exchanged among a plurality of parties, wherein the computer acquires a pointed-out matter indicating a pointed-out by the other party to the agreement in the draft of the document regarding the agreement, outputs, to the generation device, an instruction to generate a comment draft regarding the pointed-out matter based on the pointed-out matter and a reference matter corresponding to the pointed-out matter, which is specified from among a plurality of reference matters that can be referred to for creating a comment, Comment generation method.

Images