Computer systems for assisting in the creation of structured documents, methods and programs for which such computer systems are executed.

Abstract

To provide a computer system to assist in the creation of structured documents. [Solution] The computer system of the present invention comprises means for receiving a first user input for generating a structured document, means for generating a variable prompt based on the first user input, and means for generating a first structured document based on the variable prompt and a fixed prompt. In one embodiment, the variable prompt may include a history of received user inputs.

Description

Technical Field

[0001] The present invention relates to a computer system, method, and program for assisting in the creation of structured documents.

Background Art

[0002] Conventionally, for the purpose of improving work efficiency, etc., it has been known to create and use electronic manuals (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, creating an electronic manual still requires time and effort. Also, creating structured documents such as articles, not limited to electronic manuals, also requires time and effort.

[0005] An object of the present invention is to reduce the time and effort required for creating a structured document by providing a computer system, method, and program for assisting in the creation of a structured document.

Means for Solving the Problems

[0006] In one aspect of the present invention, the computer system of the present invention is a computer system for assisting in the creation of a structured document, and the computer system includes means for receiving a first user input for generating a structured document, means for generating a variable prompt based on the first user input, and means for generating a first structured document based on the variable prompt and a fixed prompt.

[0007] In one embodiment of the present invention, the variable prompt may include a history of received user input.

[0008] In one embodiment of the present invention, the computer system may further include means for receiving a second user input for modifying the generated first structured document; means for updating the variable prompt based on the generated first structured document and the second user input; and means for generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt.

[0009] In one embodiment of the present invention, the updated variable prompt may include a history of generated structured documents, a history of received user input, and information indicating the correspondence between received user input and generated structured documents.

[0010] In one embodiment of the present invention, the means for updating the variable prompt may include means for updating the history of generated structured documents included in the variable prompt based on the generated first structured document, and means for updating the history of received user inputs included in the variable prompt based on the second user input.

[0011] In one embodiment of the present invention, the computer system may further include means for performing processing to assist in the input of user input.

[0012] In one embodiment of the present invention, the means for performing processing to assist in the input of user input may include means for presenting one or more input frameworks for user input.

[0013] In one embodiment of the present invention, the computer system may further include means for receiving user input indicating that one or more model documents should be the basis for a structured document, means for identifying the one or more model documents, and means for updating the fixed prompt based on the one or more model documents.

[0014] In one embodiment of the present invention, the computer system may include means for receiving one or more image data; means for receiving a third user input for incorporating at least one of the one or more image data into a structured document to be generated; means for updating the variable prompt based on the third user input and the one or more image data; and means for updating the structured document based on the updated variable prompt and the fixed prompt.

[0015] In one embodiment of the present invention, the computer system further comprises means for generating text data indicating the content of the one or more image data in response to receiving the one or more image data, and means for updating the variable prompt updating the variable prompt based on the third user input, the one or more image data, and the text data, wherein the third user input does not have to include information indicating where the image data should be incorporated in the updated structured document.

[0016] In one embodiment of the present invention, the computer system may include means for receiving a second user input for modifying the generated first structured document, wherein the second user input includes information indicating a portion of the generated first structured document to be modified and information indicating a portion of the generated first structured document not to be modified; means for identifying and recording the portion of the generated first structured document not to be modified based on the information indicating the portion of the generated first structured document not to be modified; means for updating the variable prompt based on the generated first structured document and the information indicating a portion of the generated first structured document to be modified; means for provisionally generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt; and means for generating a fourth structured document different from the first structured document based on the second structured document and the portion of the generated first structured document not to be modified.

[0017] In one embodiment of the present invention, the first user input includes an instruction that references one or more image data, audio data, or document data, the computer system further includes means for receiving one or more image data, audio data, or document data, and means for generating text data that describes the characteristics of the one or more image data, audio data, or document data based on the one or more image data, audio data, or document data, and means for generating the first structured document may, in response to receiving the instruction, generate the first structured document based on the variable prompt, the fixed prompt, the one or more image data, audio data, or document data, and the text data.

[0018] In one embodiment of the present invention, the fixed prompt may include structural information indicating the structure of the structured document.

[0019] In one embodiment of the present invention, the structured document is an electronic manual, the information indicating the structure of the structured document includes step structure information indicating the step structure of the electronic manual, and the means for generating the first structured document may generate the first structured document having a step structure.

[0020] In one embodiment of the present invention, the first user input includes identification information for identifying one of a plurality of structures for the structured document, and the computer system may further include means for specifying the structure to be used based on the identification information and means for updating the variable prompt based on the structure to be used in the previous period.

[0021] In one aspect of the present invention, the method of the present invention is a method executed in a computer system for assisting in creating a structured document, the computer system includes a processor unit, and the method includes the processor unit receiving a first user input for generating a structured document, the processor unit generating a variable prompt based on the first user input, and the processor unit generating a first structured document based on the variable prompt and a fixed prompt.

[0022] In one aspect of the present invention, the program of the present invention is a program executed in a computer system for assisting in creating a structured document, the computer system includes a processor unit, and when the program is executed by the processor unit, the processor unit is caused to at least receive a first user input for generating a structured document, generate a variable prompt based on the first user input, and generate a first structured document based on the variable prompt and a fixed prompt.

[0023] In one aspect of the present invention, the computer system of the present invention is a computer system for assisting in the creation of a structured document, and the computer system includes means for receiving a first user input for identifying a first structured document, means for identifying the first structured document based on the first user input, means for receiving a second user input for modifying the identified first structured document, means for updating the variable prompt based on the identified first structured document and the second user input, and means for generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt.

[0024] In one aspect of the present invention, the method of the present invention is a method executed in a computer system for assisting in the creation of a structured document, the computer system includes a processor unit, and the method includes the processor unit receiving a first user input for identifying a first structured document, the processor unit identifying the first structured document based on the first user input, the processor unit receiving a second user input for modifying the identified first structured document, the processor unit updating the variable prompt based on the identified first structured document and the second user input, and the processor unit generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt.

[0025] In one aspect of the present invention, the program of the present invention is a program executed in a computer system for assisting in the creation of structured documents, the computer system comprising a processor unit, and when executed by the processor unit, the program causes the processor unit to at least: receive a first user input for identifying a first structured document; identify the first structured document based on the first user input; receive a second user input for modifying the identified first structured document; update a variable prompt based on the identified first structured document and the second user input; and generate a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt. [Effects of the Invention]

[0026] According to the present invention, by providing a computer system, method, and program for assisting in the creation of structured documents, it is possible to reduce the time and effort required to create structured documents. [Brief explanation of the drawing]

[0027] [Figure 1A] This diagram shows an example of a screen displayed on a user device used by a user creating structured documents. [Figure 1B] This diagram shows another example of a screen displayed on a user device used by a user creating structured documents. [Figure 2] A diagram showing an example of a system configuration to support the creation of structured documents. [Figure 3A] This diagram shows an example of the structure of information stored in the user database unit 241. [Figure 3B] This diagram shows an example of the structure of information stored in the document database unit 242. [Figure 4] A diagram illustrating an example of the processes performed in computer system 210. [Modes for carrying out the invention]

[0028] The following definitions are used in this specification.

[0029] A "structured document" refers to a document that has a predetermined structure. Structured documents include documents that have been customized to have a predetermined structure. For example, a structured document may include a document with a step structure showing multiple steps, or a document with a structure suitable for an article. A document may include, for example, an electronic manual.

[0030] Embodiments of the present invention will be described below with reference to the drawings.

[0031] Figure 1A shows an example of a screen displayed on a user device used by a user creating a structured document. The screen 100 shown in Figure 1A is a screen for creating a structured document having a step structure that shows multiple steps. In the embodiment shown in Figure 1A, the screen 100 includes a communication area 110 showing communication between an assistant (i.e., a computer system) that assists in creating the structured document and the user, an outline area 120 showing one or more input outlines that assist in responding to the assistant's comments, an input area 130 for entering user input, a document area 140 for displaying the generated structured document, a return area 150 for returning to the previous screen, and an output area 160 for outputting the generated structured document. The communication area 110 and the document area 140 may be configured to be scrollable or swipeable for viewing their entirety. The return area 150 and the output area 160 are configured to be selectable.

[0032] In the embodiment shown in Figure 1A, the communication area 110 includes a comment area 111 displaying the assistant's comments, a comment area 112 displaying the user's comments in response to the assistant's comments displayed in comment area 111, a comment area 113 displaying the assistant's comments in response to the user's comments displayed in comment area 112, a comment area 114 displaying the user's comments in response to the assistant's comments displayed in comment area 113, and a comment area 115 displaying the assistant's comments in response to the user's comments displayed in comment area 114. In the embodiment shown in Figure 1A, the user inputs "a display manual for delivering goods for store opening preparations" as the content of the document to be created, and "new part-time / temporary employees" as the target audience for viewing the display manual. When the assistant receives the content of the document the user wants to create from the user, it presents the user with questions to elicit the missing information necessary to create the document, as shown in comment area 113. This allows the user to proceed smoothly with the creation of the structured document.

[0033] When assistant comments are displayed, as shown in comment areas 113 and 115, one or more input outlines are displayed in outline area 120 to further assist in creating or modifying the structured document. Each input outline is configured to be selectable. When an input outline is selected, it is reflected in input area 130. In the embodiment shown in Figure 1A, outline area 120 displays "I want to change the number of steps to XX" and "I want to reduce the number of characters in each step" as input outlines. Thus, input outlines may be incomplete, including parts that are not specifically identified (e.g., "XX"), or they may be complete, not including parts that are not specifically identified.

[0034] The input area 130 is configured to allow the user to enter user input. User input may be achieved, for example, by directly entering into the input area 130, by having voice input from the user reflected in the input area 130, or at least partially by the user selecting one or more input outlines displayed in the outline area 120. If the user performs user input by selecting an incomplete input outline in the outline area 120 that includes unspecified parts, the user can directly modify the unspecified parts in the input area 130 after the input outline has been reflected in the input area 130. User comments displayed in the comment areas 112 and 114 are entered by the user into the input area 130 and sent by selecting the send button 131.

[0035] In response to a user entering user input into the input area 130 and submitting it, a structured document is generated and displayed in the document area 140. Once generated, the structured document can be regenerated each time user input is entered and submitted to modify the generated structured document. In the embodiment shown in Figure 1A, the document area 140 displays an electronic manual 141 having a step structure showing multiple steps as a structured document. In the embodiment shown in Figure 1A, the document area 140 displays a step area 142 showing the first step and a step area 143 showing the second step among the multiple steps included in the electronic manual 141. The user may be able to view the remaining steps by scrolling through the document area 140. Alternatively, the user may be able to view the remaining steps by swiping through the document area 140.

[0036] Users can easily modify or edit a structured document by viewing the structured document displayed in document area 140 and entering user input for modifying that structured document into input area 130. In this way, even if there are circumstances preventing users from directly modifying or editing the structured document (for example, if they cannot think of a good expression or do not know the appropriate structure), they can easily modify, edit, or generate a structured document. Note that the structured document displayed in document area 140 may be configured to allow users to directly modify or edit it.

[0037] When output area 160 is selected by the user, the most recent structured document among the one or more generated structured documents is output.

[0038] Figure 1B shows another example of a screen displayed on a user device used by a user creating a structured document. The screen 170 shown in Figure 1B is a screen for creating a structured document having a step structure that shows multiple steps. In the embodiment shown in Figure 1B, the screen 170 includes a communication area 110, an outline area 120, an input area 130, a document area 140, a return area 150, and an output area 160.

[0039] In the embodiment shown in Figure 1B, the communication area 110 includes a comment area 111 displaying the assistant's comments, a comment area 116 displaying the user's comments in response to the assistant's comments displayed in comment area 111, a comment area 117 displaying the assistant's comments in response to the user's comments displayed in comment area 116, a comment area 118 displaying the user's comments in response to the assistant's comments displayed in comment area 117, and a comment area 119 displaying the assistant's comments in response to the user's comments displayed in comment area 118. In the embodiment shown in Figure 1B, the user inputs "interview article" as the content of the document they want to create, and "Mr. / Ms. XX from XX Company" as the person interviewed to be included in the interview article. When the assistant receives the content of the document the user wants to create from the user, it presents the user with questions to elicit the missing information necessary to create the document, as shown in comment area 117. This allows the user to proceed smoothly with the creation of the structured document.

[0040] When assistant comments are displayed, as shown in comment areas 117 and 119, one or more input outlines are displayed in outline area 120 to further assist in creating or modifying the structured document. Each input outline is configured to be selectable. When an input outline is selected, it is reflected in input area 130. In the embodiment shown in Figure 1B, outline area 120 displays "I want to change the image to a different one" and "I want to change the number of items in the table of contents to △△" as input outlines.

[0041] In the embodiment shown in Figure 1B, the document area 140 displays an electronic article 144 having a structure suitable for an article as a structured document. In the embodiment shown in Figure 1B, the document area 140 displays an image area 145 that presents images related to the interview article contained in the electronic article 144, a table of contents area 146 that shows the table of contents of the interview article contained in the electronic article 144, and a detail area 147 that shows a detailed description of the interview article contained in the electronic article 144. The user may be able to view the rest of the interview article by scrolling through the document area 140. Alternatively, the user may be able to view the rest of the interview article by swiping through the document area 140.

[0042] The structure used in the generated structured document may be specified by user input, as shown in comment areas 116 and 118. Alternatively, if the structure used in the generated structured document cannot be specified by user input or is not specified by the user, it may be a predetermined structure.

[0043] Furthermore, while the embodiments shown in Figures 1A and 1B illustrate an example where the user and the assistant communicate in a chat-like format within the communication area 110, the present invention is not limited thereto. Communication can be displayed in the communication area 110 in any format, as long as the user can view the history of their communication with the assistant. For example, the user and the assistant may communicate in a way that displays past communications sequentially below, similar to email replies.

[0044] 2. System configuration to support the creation of structured documents Figure 2 shows an example of a system configuration to support the creation of structured documents.

[0045] In the embodiment shown in Figure 2, system 200 includes a computer system 210 for assisting in the creation of structured documents and user devices 2201-220. N The computer system 210 is provided with the internet 230 and user devices 2201-220. N It is configured to be able to communicate with each of them. User devices 2201~220 N This can be manipulated by a user who wishes to create a structured document, where N is an integer greater than or equal to 1.

[0046] Computer system 210 is an information processing system that performs processing for companies that provide support for the creation of structured documents. In the embodiment shown in Figure 2, computer system 210 comprises an interface unit 211, a processor unit 212 including one or more CPUs (Central Processing Units), and a memory unit 213. The hardware configuration of computer system 210 is not particularly limited as long as it can realize its functions, and may consist of a single machine or a combination of multiple machines.

[0047] The interface unit 211 is connected to user devices 2201-220 N It controls communication with each of them.

[0048] The memory unit 213 stores the program required to execute the process and the data required to execute that program. The method by which the program is stored in the memory unit 213 is not specified. For example, the program may be pre-installed in the memory unit 213. Alternatively, the program may be installed in the memory unit 213 by being downloaded via a network such as the Internet 230, or it may be installed in the memory unit 213 via a storage medium such as an optical disc or USB.

[0049] The processor unit 212 controls the operation of the entire computer system 210. The processor unit 212 reads the program stored in the memory unit 213 and executes the program. As a result, the computer system 210 can function as a device that executes desired steps, and the processor unit 212 of the computer system 210 can operate as a means to achieve desired functions.

[0050] In the embodiment shown in Figure 2, the computer system 210 is connected to the database unit 240. The database unit 240 includes a user database unit 241 and a document database unit 242.

[0051] User device 2201 is configured to communicate with computer system 210 via the Internet 230. For example, user device 2201 may include an interface unit, a processor unit, a memory unit, a display unit, and an input unit for receiving input (e.g., sound, selection (e.g., tap, click)). User device 2201 may be a portable wireless terminal such as a mobile phone, smartphone, or tablet terminal, or a personal computer such as a laptop PC or note PC. The configuration of the interface unit, processor unit, and memory unit of user device 2201 is the same as that of the interface unit, processor unit, and memory unit of computer system 210, so a detailed explanation is omitted here. User devices 2202-220 N The same applies to this matter.

[0052] In the embodiment shown in Figure 2, user devices 2201 to 220 N Although it has been explained that each of these can communicate with the computer system 210 via the Internet 230, the present invention is not limited thereto. Any type of network can be used instead of the Internet 230.

[0053] Furthermore, in the embodiment shown in Figure 2, the database unit 240 is located outside the computer system 210, but the present invention is not limited thereto. The database unit 240 can also be located inside the computer system 210. The configuration of the database unit 240 is not limited to a specific hardware configuration. For example, the database unit 240 may consist of a single hardware component or multiple hardware components. For example, the database unit 240 may be configured as a single external hard disk drive for the computer system 210, or as cloud storage connected via a network. Moreover, the configuration of each database unit included in the database unit 240 is also not limited to a specific hardware configuration. For example, each database unit included in the database unit 240 may also consist of a single hardware component or multiple hardware components.

[0054] Figure 3A shows an example of the structure of information stored in the user database unit 241.

[0055] The user database unit 241 stores information about the user. User information can be identified by information for identifying the user (user ID). User information may include, for example, the worker's name, gender, date of birth, telephone number, and email address. User information may further include one or more image data, audio data, or document data uploaded by the user, information for identifying structured documents previously generated by the user (document ID), and information indicating variable prompts created when the user previously generated structured documents.

[0056] Figure 3B shows an example of the structure of information stored in the document database unit 242.

[0057] The document database section 242 stores information about structured documents. Information about structured documents can be identified by information for identifying structured documents (document ID). Information about structured documents is associated with information for identifying the user who generated the structured document, which is identified by the document ID (user ID). Information about structured documents includes, for example, the data of the structured document and structural conditions that indicate the structure of the structured document. Structural conditions include, but are not limited to, conditions related to text arrangement (e.g., vertical reading, horizontal reading), conditions related to titles (e.g., title position, number of characters, etc.), conditions related to the table of contents (e.g., presence, position, number of items, etc.), conditions related to subheadings (e.g., presence, number of characters in subheadings, font size, position of subheadings, etc.), conditions related to images (e.g., number of images to be included in the structured document, position, size, frame shape, etc.), and conditions related to steps (e.g., presence, number of steps, number of characters in the explanation to be written in each step, etc.). Structural conditions may also be identified by information for identifying structural conditions (structural condition ID).

[0058] 3. Processes executed in a computer system Figure 4 shows an example of a process performed in the computer system 210. Each step shown in Figure 4 is performed, for example, by the processor unit 212 of the computer system 210. The steps shown in Figure 4 will be described below.

[0059] Step S401: A first user input is received for generating a structured document. The first user input is received, for example, from a user device 2201 operated by the user. The first user input may be for generating a new structured document. The first user input may correspond, for example, to comment areas 112 and 114 shown in Figure 1A, and to comment areas 116 and 118 shown in Figure 1B. The first user input includes information necessary for generating the structured document. The information necessary for generating the structured document may include, for example, information to identify the type of structured document (e.g., predetermined keywords (e.g., "manual", "article", etc.)), information indicating the target audience, etc.

[0060] Furthermore, the first user input for generating a structured document is not necessarily received all at once to contain all the information necessary to generate the structured document. For example, as shown in Figures 1A and 1B, the first user input for generating a structured document may be received in multiple parts to contain all the information necessary to generate the structured document.

[0061] Furthermore, after receiving user input for generating a structured document, the computer system 210 may determine whether or not there is missing information necessary to generate the structured document. If it is determined that there is missing information necessary to generate the structured document, the computer system 210 may identify the missing information, generate a comment to elicit that information from the user, and execute a process to present that comment to the user. In this way, the computer system 210 can resolve the missing information necessary to generate the structured document by receiving the user's comments in response to the comment to elicit the missing information from the user. As a result, the computer system 210 can generate the structured document once all the necessary information is available, and the user can reach the generation of the structured document simply by answering questions from the computer system 210, without having to grasp all the information necessary to generate the structured document.

[0062] Step S402: A variable prompt is generated based on the first user input. The variable prompt generated based on the first user input includes a history of received user inputs. The variable prompt generated based on the first user input may also include communication information, including received user inputs and comments from the computer system 210. The generated variable prompt may be stored in the memory unit 213 of the computer system 210, or it may be stored in the database unit 240 connected to the computer system 210.

[0063] Step S403: A first structured document is generated based on the variable prompts and fixed prompts generated in step S402. This process may be performed using, for example, a machine learning model (e.g., artificial intelligence (AI) (e.g., a large-scale language model (LLM))). Variable prompts may be updated in response to user input, while fixed prompts are not, in principle, updated in response to user input, except when referring to the model document described later. Fixed prompts may be stored in the memory unit 213 of the computer system 210, or in the database unit 240 connected to the computer system 210. Fixed prompts include, for example, know-how for generating structured documents (e.g., information indicating the role of the machine learning model (e.g., LLM), information indicating constraints on the machine learning model (e.g., LLM), information indicating best practices in generating structured documents), information indicating the structure of the structured document (e.g., a predetermined structure), and information indicating rules for comments to the user. Both variable prompts and fixed prompts are used each time a structured document is generated. The processing in step S403 can be achieved, for example, by inputting variable prompts and fixed prompts into a machine learning model (e.g., LLM) and generating a first structured document. Along with the generation of the first structured document, comments to the user may be further generated (for example, using a machine learning model (e.g., LLM)).

[0064] The computer system 210 performs processing to present the generated first structured document to the user. This processing can be achieved, for example, by sending the generated first structured document to the user device 2201. This processing may correspond to displaying the structured document in the document area 140 shown in Figures 1A and 1B. The computer system 210 may further perform processing to present comments to the user. This processing can be achieved, for example, by sending the generated comments to the user to the user device 2201. This processing may correspond to displaying the comments to the user in the comment area 115 shown in Figures 1A and 1B.

[0065] Step S404: It is determined whether user input for modifying the structured document has been received. User input for modifying the structured document includes, for example, instructions for modifying the structured document. An example of user input for modifying the structured document is the second user input for modifying the first structured document generated in step S403. If the determination result is "Yes", the process proceeds to step S405; if the determination result is "No", the process proceeds to step S407.

[0066] Step S405: A variable prompt is updated based on user input for modifying a structured document. The variable prompt, updated based on user input for modifying a structured document, includes a history of generated structured documents, a history of received user input, and information indicating the correspondence between received user input and generated structured documents. Updating the variable prompt can be achieved, for example, by updating the history of generated structured documents included in the variable prompt based on a first structured document generated in step S403, and by updating the history of received user input included in the variable prompt based on a second user input for modifying the first structured document. The updated variable prompt may be stored in the memory unit 213 of the computer system 210, or it may be stored in the database unit 240 connected to the computer system 210.

[0067] The history of generated structured documents shows the data of one or more structured documents generated so far in generating or modifying the structured document being modified, including, for example, the data of the first structured document generated in step S403. The history of received user input shows one or more user inputs received so far in generating or modifying the structured document being modified, including, for example, the user inputs received in step S404 (and step S401). The information showing the correspondence between received user inputs and generated structured documents indicates which structured document was generated in response to which user input.

[0068] Step S406: A modified structured document is generated based on the variable prompt and fixed prompt updated in step S405. For example, if the variable prompt is updated in response to receiving a second user input to modify the first structured document generated in step S403, a second structured document different from the first structured document is generated as the modified structured document. This process can be performed, for example, using a machine learning model (e.g., artificial intelligence (AI) (e.g., a large-scale language model (LLM))). The process in step S406 can be achieved, for example, by inputting the variable prompt and fixed prompt into a machine learning model (e.g., LLM) and generating a modified structured document. Along with the generation of the modified structured document, comments to the user may be further generated (e.g., using a machine learning model (e.g., LLM)).

[0069] The computer system 210 performs processing to present the modified structured document to the user. This processing can be achieved, for example, by sending the modified structured document to the user device 2201. This processing may correspond to displaying the modified structured document in the document area 140 shown in Figures 1A and 1B. The computer system 210 may further perform processing to present the user with comments generated along with the modified structured document. This processing can be achieved, for example, by sending the comments generated along with the modified structured document to the user device 2201. This processing may correspond to displaying the comments in the comment area 115 shown in Figures 1A and 1B.

[0070] Each time steps S404 to S406 in Figure 4 are repeated, the history of generated structured documents contained in the variable prompt, the history of received user input, and information indicating the correspondence between received user input and generated structured documents are updated and used together with the fixed prompt to generate the structured document. Because the updated variable prompt includes the history of generated structured documents, the history of received user input, and information indicating the correspondence between received user input and generated structured documents, the computer system 210 can perform modifications to the structured document in light of the context of the communication related to the structured document being modified that has been made between the user and the computer system 210 so far, and the user can experience such modifications. As a result, even if the user input includes a modification instruction such as "Make it B instead of A," the computer system 210 can identify what "A" is from the information contained in the updated variable prompt and respond flexibly to such modification instructions. Furthermore, even if user input includes a modification instruction such as, "Based on the previously generated structured document, modify XX to YY," the computer system 210 can identify what the "previously generated structured document" is from the information contained in the updated variable prompt, and can respond flexibly to such modification instructions.

[0071] Step S407: It is determined whether user input for outputting a structured document has been received. If the result is "Yes", the process proceeds to step S408; if the result is "No", the process returns to step S404.

[0072] Step S408: In response to receiving user input for outputting a structured document, the structured document is output. The output structured document may be the most recent of the one or more structured documents generated. The output structured document may also be a structured document specified by the user from among the one or more structured documents generated. In this case, user input specifying which structured document to output may be received along with user input for outputting a structured document.

[0073] Multiple structures may exist for a structured document. In this case, user input received by the computer system 210 (for example, user input received in step S401 or S404 of Figure 4) may include structure identification information for identifying one of the multiple structures for the structured document. The structure identification information may be, for example, a predetermined keyword included in the user input (e.g., "manual," "article," etc.), information for identifying a previously generated structured document (document ID), a structure condition ID, or a detailed description for identifying the structure conditions. This allows the user to select the desired structure to be adopted for the structured document from among the predetermined multiple structures.

[0074] If the user input received by the computer system 210 includes structure identification information, the computer system 210 identifies the structure to be used based on the structure identification information and updates the variable prompt based on the identified structure to be used. This allows the computer system 210 to generate a structured document having the identified structure to be used by generating the structured document based on the updated variable prompt.

[0075] 4. Various features to further support the generation of structured documents • User input support The computer system 210 (in particular, the processor unit 212 of the computer system 210) may be configured to perform processing to assist in user input. Processing to assist in user input may include, for example, presenting one or more input frameworks for user input. One or more input frameworks may be one or more input frameworks that assist in responding to comments from the computer system 210, for example, as shown in the framework area 120 of Figures 1A and 1B. This allows the user to perform user input by referring to the one or more presented input frameworks, even if they do not know what to input.

[0076] The computer system 210 may, for example, identify one or more input frameworks that are linguistic expressions used to prompt the user to input missing information for generating a structured document, or it may identify one or more input frameworks that are frequently entered by the user. The computer system 210 may, for example, use a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language model (LLM))) to identify one or more input frameworks.

[0077] • Using examples The computer system 210 (in particular, the processor unit 212 of the computer system 210) can receive user input indicating that one or more exemplary documents should be used as the basis for a structured document (for example, in step S401 or step S404 in Figure 4). The data for one or more exemplary documents may be received along with the user input indicating that one or more exemplary documents should be used as the basis for a structured document, or it may have been received in advance. If the computer system 210 has received the data for one or more exemplary documents in advance, it may issue information for identifying the exemplary documents (exemplary document IDs). In this case, the user input indicating that one or more exemplary documents should be used as the basis for a structured document may include the exemplary document IDs of one or more exemplary documents. The received data for one or more exemplary documents may be stored in the database unit 240 connected to the computer system 210.

[0078] When the computer system 210 receives data from one or more model documents, it may analyze the data from one or more model documents and generate text data that shows the rules embodied in one or more model documents (for example, the structure of the model documents, how to write titles in the model documents, how to write explanations in the model documents, the writing style in the model documents, etc.).

[0079] The computer system 210 is configured to identify one or more exemplary documents in response to user input indicating that one or more exemplary documents should be the basis for a structured document, and to update a fixed prompt based on the identified one or more exemplary documents. Identifying one or more exemplary documents may be achieved by receiving data for one or more exemplary documents along with user input indicating that one or more exemplary documents should be the basis for a structured document, or by using the exemplary document IDs included in the user input indicating that one or more exemplary documents should be the basis for a structured document. Updating the fixed prompt based on the identified one or more exemplary documents may include, for example, reflecting text data in the fixed prompt that represents rules embodied in the identified one or more exemplary documents. The computer system 210 may generate a structured document based on the updated fixed prompt and the variable prompt. This process may be performed, for example, using a machine learning model (e.g., artificial intelligence (AI) (e.g., a large-scale language model (LLM))). This enables the computer system 210 to generate structured documents that adhere to the rules embodied in one or more identified model documents, and allows users to easily customize them to conform to the rules embodied in one or more model documents simply by submitting one or more model documents to the computer system 210.

[0080] • Insert images as appropriate. The computer system 210 (in particular, the processor unit 212 of the computer system 210) can receive, for example, one or more image data from a user device 2201 and receive user input (for example, in step S401 or step S404 of Figure 4) for incorporating at least one of the image data into the structured document to be generated. The one or more image data may be received together with the user input for incorporating at least one of the image data into the structured document to be generated, or it may have been received in advance. The received one or more image data may be stored in the database unit 240 connected to the computer system 210. The received one or more image data may be associated with a user ID. The user input for incorporating at least one of the image data into the structured document does not include information indicating where the image data should be incorporated in the updated structured document. The images may be still images or moving images.

[0081] The computer system 210 may, in response to receiving one or more image data, analyze one or more image data and generate text data indicating the content of one or more image data.

[0082] If user input for incorporating at least one of one or more image data into the generated structured document includes a user ID, the computer system 210 can identify one or more images associated with the user ID (i.e., one or more images sent by the user generating or modifying the structured document) based on the user ID. In response to receiving user input for incorporating at least one of one or more image data into the generated structured document, the computer system 210 is configured to update a variable prompt based on the user input for incorporating at least one of one or more image data into the generated structured document and the received one or more image data, and to update the structured document (for example, the first structured document generated in step S403 in Figure 4, the modified structured document generated in step S406 in Figure 4) based on the updated variable prompt and a fixed prompt.

[0083] Updating a variable prompt based on user input to incorporate at least one of one or more image data into the generated structured document, and the received image data, may include updating the variable prompt based on user input to incorporate at least one of one or more image data into the generated structured document, the received image data, and text data indicating the content of the image data. In this case, the structured document is updated to place images corresponding to the descriptions and content-appropriate text data within the structured document near the descriptions (for example, placing images in at least one of the steps of a structured document having a step structure, or placing images in the image area of ​​a structured document having an article-appropriate structure). Updating the structured document may be performed, for example, using a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language models (LLMs))).

[0084] Thus, the computer system 210 can automatically embed images that match the descriptions within the structured document, and the user can embed images in the appropriate locations within the structured document without having to specify where the images should be embedded.

[0085] Identifying areas that will not be modified. The user input received in step S404 of Figure 4 may include information indicating the parts of the structured document that should be modified and information indicating the parts of the structured document that should not be modified. The structured document referred to here may be, for example, the first structured document generated in step S403 of Figure 4, or the first structured document identified by the database unit 240. The parts of the structured document that should not be modified may be at least one step among a plurality of steps of a structured document having a step structure, or a specific area within a structured document having a structure suitable for an article (e.g., title, subheading, etc.).

[0086] In this case, the computer system 210 (particularly the processor unit 212 of the computer system 210) is configured to identify and record parts of the structured document that should not be modified, based on information indicating parts of the structured document that should not be modified. This information indicating parts of the structured document that should not be modified may be stored, for example, in a database unit 240 connected to the computer system 210. The computer system 210 is configured to update variable prompts based on the structured document (e.g., the first structured document generated in step S403 of Figure 4, the first structured document identified from the database unit 240) and the information indicating parts that should not be modified; to tentatively generate a structured document (e.g., a second structured document different from the first structured document) based on the updated variable prompts and fixed prompts; and to generate a modified structured document based on the tentatively generated structured document and the recorded parts that should not be modified. The computer system 210 may perform processing to present the modified structured document to the user. A revised structured document can be generated by merging a provisionally generated structured document with recorded sections that should not be modified (for example, replacing sections in the provisionally generated structured document that correspond to sections in the structured document that should not be modified with the recorded sections that should not be modified). Provisional generation of the structured document can be performed, for example, using a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language models (LLMs))).

[0087] By updating the variable prompt based on the structured document and information indicating areas that should not be modified, it is possible to reflect areas that should not be modified in the structured document in the variable prompt. However, when the computer system 210 provisionally generates the structured document based on the updated variable prompt and the fixed prompt, it may inadvertently modify areas that should not be modified in the structured document. Therefore, by recording areas that should not be modified in the structured document and generating a modified structured document based on the provisionally generated structured document and the recorded areas that should not be modified, it is possible to maintain the structured document in a way that prevents areas that should not be modified from being modified, even if they are inadvertently modified. If areas that should not be modified in the structured document are not modified when the structured document is provisionally generated, the provisionally generated structured document may be identical to the modified structured document.

[0088] • Reference to an image or document The computer system 210 (in particular, the processor unit 212 of the computer system 210) can receive one or more image data, audio data, or document data from, for example, the user device 2201. Image data may include, but is not limited to, still image data, video data, etc. Document data may include, but is not limited to, Word data, PDF data, PowerPoint data, Excel data, etc. In response to receiving one or more image data, audio data, or document data, the computer system 210 may analyze the received one or more image data, audio data, or document data and generate text data that describes the characteristics of one or more image data, audio data, or document data. User input received by the computer system 210 (for example, user input received in step S401 or S404 of Figure 4) may include instructions that refer to one or more image data, audio data, or document data. One or more image data, audio data, or document data may be received together with instructions that refer to one or more image data, audio data, or document data, or may have been received beforehand. One or more received image data, audio data, or document data may be stored in a database unit 240 connected to the computer system 210. One or more received image data, audio data, or document data may be associated with a user ID.

[0089] If an instruction to reference one or more image data, audio data, or document data includes a user ID, the computer system 210 can identify, based on the user ID, one or more image data, audio data, or document data associated with the user ID (i.e., one or more image data, audio data, or document data sent by the user generating or modifying the structured document). In response to receiving an instruction to reference one or more image data, audio data, or document data, the computer system 210 is configured to update the structured document (for example, the first structured document generated in step S403 of Figure 4, the modified structured document generated in step S406 of Figure 4) based on the instruction to reference one or more image data, audio data, or document data, the received one or more image data, audio data, or document data, a variable prompt, and a fixed prompt. This process may include, for example, updating the variable prompt based on the instruction to reference one or more image data, audio data, or document data and the received one or more image data, audio data, or document data, and updating the structured document based on the updated variable prompt and the fixed prompt.

[0090] This allows the computer system 210 to generate or modify a structured document by referencing one or more image data, audio data, or document data sent by the user. Even if the user doesn't know exactly how to generate or modify a structured document, but vaguely wants it to look like one or more image data, audio data, or document data, they can easily generate or modify a structured document.

[0091] Furthermore, instructions referencing one or more image data, audio data, or document data may include information indicating the parts of the image data, audio data, or document data that are particularly noteworthy. This allows the computer system 210 to generate or modify a structured document to specifically reproduce the parts of the image data, audio data, or document data that are particularly noteworthy, and allows the user to, for example, specify and modify only the parts of the structured document being modified that they wish to modify based on the parts of the image data, audio data, or document data that are particularly noteworthy.

[0092] Although an example of generating a new first structured document was described in steps S401 to S403 of Figure 4, the present invention is not limited thereto. The computer system 210 (in particular, the processor unit 212 of the computer system 210) may be configured to receive a first user input for identifying the first structured document in step S401' instead of steps S401 to S403, and to identify the first structured document based on the received first user input. The first user input for identifying the first structured document may include, for example, a document ID. The first user input for identifying the first structured document may further include a user ID. In this case, after step S401', the computer system 210 performs the processing described with reference to steps S404 onwards in Figure 4, and the history of the generated structured documents includes the data of the first structured document identified in step S401'. This allows users to easily modify or edit existing structured documents by retrieving them (for example, previously generated structured documents).

[0093] In the embodiment shown in Figure 4, an example was described in which the processing of each step shown in Figure 4 is realized by the processor executing a program stored in the memory unit. However, the present invention is not limited to this. At least some of the processing of each step shown in Figure 4 may be realized by hardware configurations such as control circuits.

[0094] As described above, the present invention has been illustrated using preferred embodiments, but the present invention should not be construed as being limited to these embodiments. It should be understood that the scope of the present invention should be interpreted solely by the claims. Those skilled in the art will understand that, based on the description of the specific preferred embodiments of the present invention and common technical knowledge, an equivalent scope can be implemented. [Industrial applicability]

[0095] The present invention is useful in reducing the time and effort required to create structured documents by providing a computer system, method, and program for assisting in the creation of structured documents. [Explanation of Symbols]

[0096] 200 Systems 210 Computer Systems 2201~220 N User device 230 Internet 240 Database Department

Claims

1. A computer system for assisting in the creation of structured documents, wherein the computer system is A means for receiving first user input for generating a structured document, A means for generating a variable prompt based on the first user input, A means for generating a first structured document based on the variable prompt and the fixed prompt. A computer system equipped with these features.

2. The computer system according to claim 1, wherein the variable prompt includes a history of received user input.

3. The aforementioned computer system, Means for receiving a second user input for modifying the first structured document generated, A means for updating the variable prompt based on the generated first structured document and the second user input, Means for generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt. The computer system according to claim 1, further comprising:

4. The computer system according to claim 3, wherein the updated variable prompt includes a history of generated structured documents, a history of received user input, and information indicating the correspondence between received user input and generated structured documents.

5. The means for updating the variable prompt is, A means for updating the history of generated structured documents included in the variable prompt based on the first generated structured document, A means for updating the history of received user inputs included in the variable prompt based on the second user input, The computer system according to claim 4, comprising:

6. The computer system according to claim 1, further comprising means for performing processing to assist in the input of user input.

7. The computer system according to claim 6, wherein the means for performing processing to assist in the input of user input includes means for presenting one or more input frameworks for user input.

8. The aforementioned computer system, A means for receiving user input indicating that one or more model documents should be used as the basis for a structured document, Means for identifying one or more model documents, means for updating the fixed prompt based on one or more model documents, The computer system according to claim 1, further comprising:

9. The aforementioned computer system, A means for receiving one or more image data, A means for receiving a third user input for incorporating at least one of the one or more image data into the generated structured document, A means for updating the variable prompt based on the third user input and one or more image data, A means for updating the structured document based on the updated variable prompt and the fixed prompt. The computer system according to claim 1, comprising:

10. The aforementioned computer system, Means for generating text data indicating the content of one or more image data in response to receiving one or more image data. Furthermore, The means for updating the variable prompt updates the variable prompt based on the third user input, the one or more image data, and the text data. The computer system according to claim 9, wherein the third user input does not include information indicating where image data should be incorporated in the updated structured document.

11. The aforementioned computer system, Means for receiving second user input for modifying the generated first structured document, wherein the second user input includes information indicating the portion of the generated first structured document to be modified and information indicating the portion of the generated first structured document not to be modified. A means for identifying and recording the parts of the generated first structured document that should not be modified, based on information indicating the parts of the generated first structured document that should not be modified, A means for updating the variable prompt based on the generated first structured document and information indicating the parts of the generated first structured document that need to be corrected, Means for provisionally generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt, A means for generating a fourth structured document different from the first structured document, based on the second structured document and the parts of the generated first structured document that should not be modified. The computer system according to claim 1, comprising:

12. The first user input includes an instruction that references one or more image data, audio data, or document data. The computer system further comprises means for receiving one or more image data, audio data, or document data, and means for generating text data that describes the characteristics of the one or more image data, audio data, or document data based on the one or more image data, audio data, or document data. The computer system according to claim 1, wherein the means for generating the first structured document generates the first structured document in response to receiving the instruction, based on the variable prompt, the fixed prompt, one or more image data or audio data or document data, and the text data.

13. The computer system according to claim 1, wherein the fixed prompt includes structural information indicating the structure of the structured document.

14. The aforementioned structured document is an electronic manual. The information indicating the structure of the aforementioned structured document includes step structure information indicating the step structure of the electronic manual, The means for generating the first structured document generates the first structured document having a step structure, according to the computer system of claim 13.

15. The first user input includes identification information for identifying one of a plurality of structures for the structured document, The aforementioned computer system, A means for identifying the structure to be used based on the aforementioned identification information, Based on the structure to be used in the previous period, means for updating the variable prompt and The computer system according to claim 1, further comprising:

16. A method performed in a computer system for assisting in the creation of structured documents, wherein the computer system comprises a processor unit, The aforementioned method, The processor unit receives a first user input for generating a structured document, The processor unit generates a variable prompt based on the first user input, The processor unit generates a first structured document based on the variable prompt and the fixed prompt. Methods that include...

17. A program to be executed in a computer system for assisting in the creation of structured documents, wherein the computer system comprises a processor unit, When the aforementioned program is executed by the processor unit, Receiving a first user input for generating a structured document, Based on the first user input, a variable prompt is generated, To generate a first structured document based on the variable prompt and the fixed prompt. A program that causes the processor unit to perform at least the above.

18. A computer system for assisting in the creation of structured documents, wherein the computer system is Means for receiving first user input to identify a first structured document, A means for identifying the first structured document based on the first user input, Means for receiving a second user input for modifying the identified first structured document, Means for updating the variable prompt based on the identified first structured document and the second user input, Means for generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt. A computer system equipped with these features.

19. A method performed in a computer system for assisting in the creation of structured documents, wherein the computer system comprises a processor unit, The aforementioned method, The processor unit receives a first user input for identifying a first structured document, The processor unit identifies the first structured document based on the first user input, The processor unit receives a second user input for modifying the identified first structured document, The processor unit updates the variable prompt based on the identified first structured document and the second user input. The processor unit generates a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt. Methods that include...

20. A program to be executed in a computer system for assisting in the creation of structured documents, wherein the computer system comprises a processor unit, When the aforementioned program is executed by the processor unit, Receiving a first user input to identify a first structured document, Based on the first user input, the first structured document is identified, Receiving a second user input for modifying the first structured document identified above, The variable prompt is updated based on the identified first structured document and the second user input. Based on the updated variable prompt and the fixed prompt, a second structured document different from the first structured document is generated. A program that causes the processor unit to perform at least the above.

Images