Computer system for supporting the creation of structured documents, and method and program executed in the computer system

Abstract

To provide a computer system for supporting the creation of structured documents. The computer system includes a means for receiving a first user input for generating a structured document, a means for generating a variable prompt based on the first user input, and a means for generating the first structured document based on the variable prompt and a fixed prompt. In one embodiment, the variable prompt may include a history of received user inputs.

Description

[Technical Field]

[0001] The present invention relates to a computer system, method, and program for supporting the creation of structured documents. [Background technology]

[0002] BACKGROUND ART It has been known for some time that electronic manuals are created and used for the purpose of improving work efficiency and the like (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 183064 Summary of the Invention [Problem to be solved by the invention]

[0004] However, creating an electronic manual still requires time and effort, and creating structured documents such as articles, not just electronic manuals, also requires time and effort.

[0005] The present invention aims to reduce the time and effort required to create a structured document by providing a computer system, method, and program for supporting the creation of a structured document. [Means for solving the problem]

[0006] In one aspect of the present invention, a computer system of the present invention is a computer system for assisting in the creation of a structured document, the computer system comprising: means for receiving a first user input for generating a structured document; means for generating a variable prompt based on the first user input; and means for generating the first structured document based on the variable prompt and a fixed prompt.

[0007] In one embodiment of the present invention, the variable prompts may include a history of received user input.

[0008] In one embodiment of the present invention, the computer system may further include means for receiving a second user input for modifying the generated first structured document, means for updating the variable prompt based on the generated first structured document and the second user input, and means for generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt.

[0009] In one embodiment of the present invention, the updated variable prompt may include a history of generated structured documents, a history of received user inputs, and information indicating a correspondence between the received user inputs and the generated structured documents.

[0010] In one embodiment of the present invention, the means for updating the variable prompt may include means for updating a history of generated structured documents included in the variable prompt based on the generated first structured document, and means for updating a history of received user inputs included in the variable prompt based on the second user input.

[0011] In one embodiment of the present invention, the computer system may further comprise means for performing processing to assist in entering user input.

[0012] In one embodiment of the present invention, the means for performing a process to assist in the entry of user input may include means for presenting one or more input skeletons for user input.

[0013] In one embodiment of the present invention, the computer system may further include means for receiving user input indicating that one or more model documents should be used as the basis for the structured document, means for identifying the one or more model documents, and means for updating the fixed prompt based on the one or more model documents.

[0014] In one embodiment of the present invention, the computer system may include means for receiving one or more image data, means for receiving a third user input for incorporating at least one of the one or more image data into a structured document to be generated, means for updating the variable prompt based on the third user input and the one or more image data, and means for updating the structured document based on the updated variable prompt and the fixed prompt.

[0015] In one embodiment of the present invention, the computer system further includes means for generating text data indicating the content of the one or more image data in response to receiving the one or more image data, and means for updating the variable prompt updates the variable prompt based on the third user input, the one or more image data, and the text data, and the third user input may not include information indicating where the image data should be incorporated in the updated structured document.

[0016] In one embodiment of the present invention, the computer system may include: means for receiving a second user input for modifying the generated first structured document, the second user input including information indicating portions of the generated first structured document that should be modified and information indicating portions of the generated first structured document that should not be modified; means for identifying and recording the portions of the generated first structured document that should not be modified based on the information indicating the portions of the generated first structured document that should not be modified; means for updating the variable prompt based on the generated first structured document and the information indicating the portions of the generated first structured document that should be modified; means for provisionally generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt; and means for generating a fourth structured document different from the first structured document based on the second structured document and the portions of the generated first structured document that should not be modified.

[0017] In one embodiment of the present invention, the first user input includes an instruction referencing one or more image data, audio data, or document data, and the computer system further includes means for receiving one or more image data, audio data, or document data, and means for generating text data indicating characteristics of the one or more image data, audio data, or document data based on the one or more image data, audio data, or document data, and the means for generating the first structured document may generate the first structured document based on the variable prompt, the fixed prompt, the one or more image data, audio data, or document data, and the text data in response to receiving the instruction.

[0018] In one embodiment of the present invention, the fixed prompt may include structural information indicating a structure of the structured document.

[0019] In one embodiment of the present invention, the structured document is an electronic manual, the information indicating the structure of the structured document includes step structure information indicating the step structure of the electronic manual, and the means for generating the first structured document may generate the first structured document having a step structure.

[0020] In one embodiment of the present invention, the first user input includes identification information for identifying one of a plurality of structures for the structured document, and the computer system may further include means for identifying a structure to be used based on the identification information, and means for updating the variable prompt based on the structure to be used.

[0021] In one aspect of the present invention, a method of the present invention is a method executed in a computer system for assisting in the creation of a structured document, the computer system having a processor unit, and the method includes the processor unit receiving a first user input for generating a structured document, the processor unit generating a variable prompt based on the first user input, and the processor unit generating the first structured document based on the variable prompt and the fixed prompt.

[0022] In one aspect of the present invention, the program of the present invention is a program executed in a computer system for assisting in the creation of structured documents, the computer system having a processor unit, and when executed by the processor unit, the program causes the processor unit to at least perform the following actions: receive a first user input for generating a structured document; generate a variable prompt based on the first user input; and generate the first structured document based on the variable prompt and the fixed prompt.

[0023] In one aspect of the present invention, a computer system of the present invention is a computer system for assisting in the creation of structured documents, and the computer system includes means for receiving a first user input for identifying a first structured document, means for identifying the first structured document based on the first user input, means for receiving a second user input for modifying the identified first structured document, means for updating the variable prompt based on the identified first structured document and the second user input, and means for generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt.

[0024] In one aspect of the present invention, a method of the present invention is a method executed in a computer system for assisting in the creation of structured documents, the computer system including a processor unit, the method including the processor unit receiving a first user input for identifying a first structured document, the processor unit identifying the first structured document based on the first user input, the processor unit receiving a second user input for modifying the identified first structured document, the processor unit updating the variable prompt based on the identified first structured document and the second user input, and the processor unit generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt.

[0025] In one aspect of the present invention, the program of the present invention is a program executed in a computer system for assisting in the creation of structured documents, the computer system having a processor unit, and when executed by the processor unit, the program causes the processor unit to at least perform the following actions: receive a first user input for identifying a first structured document; identify the first structured document based on the first user input; receive a second user input for modifying the identified first structured document; update the variable prompt based on the identified first structured document and the second user input; and generate a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt. [Effects of the Invention]

[0026] According to the present invention, by providing a computer system, method, and program for supporting the creation of structured documents, it is possible to reduce the time and effort required to create structured documents. [Brief explanation of the drawings]

[0027] [Figure 1A] FIG. 10 is a diagram showing an example of a screen displayed on a user device used by a user creating a structured document. [Figure 1B] FIG. 10 is a diagram showing another example of a screen displayed on a user device used by a user creating a structured document. [Figure 2] FIG. 1 is a diagram showing an example of the configuration of a system for supporting the creation of structured documents. [Figure 3A] FIG. 10 is a diagram showing an example of the configuration of information stored in a user database unit 241. [Figure 3B] FIG. 2 is a diagram showing an example of the configuration of information stored in the document database unit 242. [Figure 4] FIG. 2 is a diagram illustrating an example of processing executed in the computer system 210. DETAILED DESCRIPTION OF THE INVENTION

[0028] The terms used in this specification are defined below.

[0029] A "structured document" refers to a document having a predetermined structure. A structured document includes a document that is customized to have a predetermined structure. A structured document may include, for example, a document having a step structure indicating multiple steps, or a document having a structure suitable for an article. A document may include, for example, an electronic manual.

[0030] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0031] FIG. 1A shows an example of a screen displayed on a user device used by a user creating a structured document. Screen 100 shown in FIG. 1A is a screen for creating a structured document having a step structure showing multiple steps. In the embodiment shown in FIG. 1A, screen 100 includes a communication area 110 showing communication between the user and an assistant (i.e., a computer system) that supports the creation of the structured document; a skeleton area 120 displaying one or more input skeletons that support responses to the assistant's comments; an input area 130 for inputting user input; a document area 140 for displaying the generated structured document; a back area 150 for returning to the previous screen; and an output area 160 for outputting the generated structured document. Communication area 110 and document area 140 may be configured to be scrollable or swipeable to view the entire contents. Back area 150 and output area 160 are configured to be selectable.

[0032] In the embodiment shown in FIG. 1A , the communication area 110 includes a comment area 111 displaying an assistant's comment, a comment area 112 displaying a user's comment in response to the assistant's comment displayed in comment area 111, a comment area 113 displaying the assistant's comment in response to the user's comment displayed in comment area 112, a comment area 114 displaying the user's comment in response to the assistant's comment displayed in comment area 113, and a comment area 115 displaying the assistant's comment in response to the user's comment displayed in comment area 114. In the embodiment shown in FIG. 1A , the user inputs "Delivery display manual for store opening preparation" as the content of the document they want to create and "New part-time / casual worker" as the intended audience for viewing the display manual. When the assistant receives the content of the document they want to create from the user, the assistant presents the user with questions to elicit missing information for creating the document, as shown in comment area 113. This allows the user to smoothly proceed with creating a structured document.

[0033] When the assistant's comments are displayed as shown in comment area 113 and comment area 115, one or more input skeletons are displayed in skeleton area 120 to further assist in creating or modifying a structured document. Each input skeleton is configured to be selectable. When selected, each input skeleton is reflected in input area 130. In the embodiment shown in FIG. 1A , the input skeletons displayed in skeleton area 120 are "I would like to change the number of steps to XX" and "I would like to reduce the number of characters in each step." In this way, the input skeleton may be incomplete, including a non-specifically specified portion (e.g., "XX"), or may be complete, not including a non-specifically specified portion.

[0034] The input area 130 is configured to allow a user to input user input. The user input may be achieved, for example, by direct input into the input area 130, by a voice input from the user reflected in the input area 130, or by the user selecting, at least in part, one of one or more input skeletons displayed in the skeleton area 120. If the user performs user input by selecting an incomplete input skeleton containing an unspecified portion in the skeleton area 120, the unspecified portion can be directly corrected in the input area 130 after the input skeleton is reflected in the input area 130. User comments displayed in the comment area 112 and the comment area 114 are entered by the user in the input area 130 and sent by selecting the send button 131.

[0035] In response to a user input entered and submitted in input area 130, a structured document is generated, and the generated structured document is displayed in document area 140. Once generated, a structured document may be generated anew each time a user input is entered and submitted to modify the generated structured document. In the embodiment shown in FIG. 1A , an electronic manual 141 having a step structure showing multiple steps is displayed as a structured document in document area 140. In the embodiment shown in FIG. 1A , a step area 142 showing a first step and a step area 143 showing a second step of the multiple steps included in electronic manual 141 are displayed in document area 140. A user may be able to view the remaining steps by scrolling document area 140. Alternatively, a user may be able to view the remaining steps by swiping document area 140.

[0036] The user can easily modify or edit the structured document displayed in document area 140 by looking at the structured document and inputting user input for modifying the structured document into input area 130. In this way, even if the user is unable to directly modify or edit the structured document (for example, if they cannot think of a good expression or do not know an appropriate structure), they can easily modify, edit, and generate a structured document. Note that the structured document displayed in document area 140 may be configured so that it can be directly modified or edited by the user.

[0037] When the output area 160 is selected by the user, the latest structured document among the one or more structured documents that have been generated is output.

[0038] 1B shows another example of a screen displayed on a user device used by a user creating a structured document. Screen 170 shown in FIG. 1B is a screen for creating a structured document having a step structure showing multiple steps. In the embodiment shown in FIG. 1B, screen 170 includes a communication area 110, an outline area 120, an input area 130, a document area 140, a return area 150, and an output area 160.

[0039] In the embodiment shown in FIG. 1B , communication area 110 includes comment area 111 displaying an assistant's comment, comment area 116 displaying a user's comment in response to the assistant's comment displayed in comment area 111, comment area 117 displaying the assistant's comment in response to the user's comment displayed in comment area 116, comment area 118 displaying the user's comment in response to the assistant's comment displayed in comment area 117, and comment area 119 displaying the assistant's comment in response to the user's comment displayed in comment area 118. In the embodiment shown in FIG. 1B , the user inputs "interview article" as the content of the document they want to create and "Mr. / Ms. XX from XX Company" as the interviewee to be included in the interview article. Upon receiving the content of the document they want to create from the user, the assistant presents the user with questions to elicit missing information from the user for creating the document, as shown in comment area 117. This allows the user to smoothly proceed with creating a structured document.

[0040] Once the assistant's comments are displayed as shown in comment area 117 and comment area 119, one or more input skeletons are displayed in skeleton area 120 to further assist in creating or modifying the structured document. Each input skeleton is configured to be selectable. When selected, each input skeleton is reflected in input area 130. In the embodiment shown in FIG. 1B , the input skeletons displayed in skeleton area 120 are "I want to change the image to something else" and "I want to change the number of items in the table of contents to △△."

[0041] In the embodiment shown in FIG. 1B , an electronic article 144 having a structure suitable for an article is displayed as a structured document in the document area 140. In the embodiment shown in FIG. 1B , the document area 140 displays an image area 145 presenting images related to the interview article described in the electronic article 144, a table of contents area 146 showing a table of contents of the interview article described in the electronic article 144, and a details area 147 showing a detailed description of the interview article described in the electronic article 144. The user may be able to view the remaining part of the interview article by scrolling the document area 140. Alternatively, the user may be able to view the remaining part of the interview article by swiping the document area 140.

[0042] It should be noted that the structure to be used in the generated structured document may be specified by user input as shown in comment area 116 and comment area 118. Alternatively, the structure to be used in the generated structured document may be a predetermined structure if it cannot be specified by user input or if it is not specified by the user.

[0043] 1A and 1B, an example is shown in which the user and the assistant communicate in a chat-like manner in the communication area 110, but the present invention is not limited to this. As long as the user can view the history of communication with the assistant, communication can be displayed in any format in the communication area 110. For example, the user and the assistant may communicate in such a way that past communications are displayed consecutively below each other, like email replies.

[0044] 2. System configuration for supporting the creation of structured documents FIG. 2 shows an example of the configuration of a system for supporting the creation of structured documents.

[0045] In the embodiment shown in FIG. 2, the system 200 includes a computer system 210 for supporting the creation of structured documents and user devices 2201-220. N The computer system 210 is provided with the user devices 2201 to 220 via the Internet 230. N The user devices 2201 to 220 are configured to be able to communicate with each of the user devices 2201 to 220. N can be manipulated by a user wishing to create a structured document, where N is an integer greater than or equal to 1.

[0046] Computer system 210 is an information processing system that executes processes for a company that provides support for the creation of structured documents. In the embodiment shown in Fig. 2, computer system 210 includes an interface unit 211, a processor unit 212 including one or more CPUs (Central Processing Units), and a memory unit 213. The hardware configuration of computer system 210 is not particularly limited as long as it can realize its functions, and may be configured as a single machine or a combination of multiple machines.

[0047] The interface unit 211 is connected to the user devices 2201 to 220 N Controls communication with each of the

[0048] The memory unit 213 stores programs required to execute processing, data required to execute the programs, and the like. Here, it does not matter how the programs are stored in the memory unit 213. For example, the programs may be pre-installed in the memory unit 213. Alternatively, the programs may be installed in the memory unit 213 by being downloaded via a network such as the Internet 230, or may be installed in the memory unit 213 via a storage medium such as an optical disk or USB.

[0049] The processor unit 212 controls the overall operation of the computer system 210. The processor unit 212 reads and executes programs stored in the memory unit 213. This allows the computer system 210 to function as a device that executes desired steps, and the processor unit 212 of the computer system 210 to operate as a means for achieving desired functions.

[0050] 2, the computer system 210 is connected to a database section 240. The database section 240 includes a user database section 241 and a document database section 242.

[0051] The user device 2201 is configured to be able to communicate with the computer system 210 via the Internet 230. For example, the user device 2201 may include an interface unit, a processor unit, a memory unit, a display unit, and an input unit for receiving input (e.g., input by sound, selection (e.g., tap, click)). The user device 2201 may be a mobile wireless terminal such as a mobile phone, a smartphone, or a tablet terminal, or may be a personal computer such as a laptop PC or a notebook PC. The configurations of the interface unit, processor unit, and memory unit of the user device 2201 are similar to those of the interface unit, processor unit, and memory unit of the computer system 210, and therefore detailed description thereof will be omitted here. The user devices 2202 to 220 N The same is true for .

[0052] In the embodiment shown in FIG. 2, the user devices 2201 to 220 N Although each of these is described as being capable of communicating with computer system 210 via Internet 230, the invention is not so limited. Any type of network may be used in place of Internet 230.

[0053] In the embodiment shown in FIG. 2 , the database unit 240 is provided outside the computer system 210, but the present invention is not limited to this. The database unit 240 can also be provided inside the computer system 210. The configuration of the database unit 240 is not limited to a specific hardware configuration. For example, the database unit 240 may be configured as a single hardware component or multiple hardware components. For example, the database unit 240 may be configured as a single external hard disk drive of the computer system 210, or as cloud storage connected via a network. Furthermore, the configuration of each database unit included in the database unit 240 is also not limited to a specific hardware configuration. For example, each database unit included in the database unit 240 may also be configured as a single hardware component or multiple hardware components.

[0054] FIG. 3A shows an example of the configuration of information stored in user database unit 241. As shown in FIG.

[0055] The user database unit 241 stores information about users. The information about users can be identified by information for identifying the users (user ID). The information about users includes, for example, the name, gender, date of birth, telephone number, email address, etc. of the worker. The information about users may further include one or more pieces of image data, audio data, or document data uploaded by the user, information for identifying a structured document generated by the user in the past (document ID), information indicating a variable prompt created when the user generated a structured document in the past, etc.

[0056] FIG. 3B shows an example of the configuration of information stored in document database unit 242.

[0057] The document database unit 242 stores information about structured documents. The information about the structured documents can be identified by information (document ID) for identifying the structured documents. The information about the structured documents is associated with information (user ID) for identifying the user who created the structured documents identified by the document ID. The information about the structured documents includes, for example, data about the structured documents and structural conditions that indicate the structure of the structured documents. The structural conditions include, but are not limited to, conditions related to text arrangement (e.g., vertical reading, horizontal reading), conditions related to titles (e.g., title position, number of characters, etc.), conditions related to a table of contents (e.g., presence or absence of a table of contents, position, number of items, etc.), conditions related to subheadings (e.g., presence or absence of subheadings, number of characters in subheadings, character size of subheadings, position of subheadings, etc.), conditions related to images (e.g., number of images to be included in a structured document, position, size, frame shape, etc.), and conditions related to steps (e.g., presence or absence of steps, number of steps, number of characters of explanation to be written for each step, etc.). The structural conditions may be identified by information (structural condition ID) for identifying the structural conditions.

[0058] 3. Processing performed in a computer system Fig. 4 shows an example of processing executed in computer system 210. Each step shown in Fig. 4 is executed, for example, by processor unit 212 of computer system 210. Each step shown in Fig. 4 will be described below.

[0059] Step S401: A first user input for generating a structured document is received. The first user input is received, for example, from a user device 2201 operated by a user. The first user input may be for newly generating a structured document. The first user input may correspond, for example, to comment area 112 and comment area 114 shown in FIG. 1A, or to comment area 116 and comment area 118 shown in FIG. 1B. The first user input includes information necessary for generating a structured document. The information necessary for generating a structured document may include, for example, information for identifying the type of structured document (e.g., predetermined keywords (e.g., "manual," "article," etc.)), information indicating the target audience, etc.

[0060] It should be noted that the first user input for generating a structured document does not necessarily have to be received all at once so as to include all the information necessary for generating the structured document. For example, the first user input for generating a structured document may be received in multiple batches, as shown in Figures 1A and 1B.

[0061] Furthermore, after receiving user input for generating a structured document, the computer system 210 may determine whether information necessary for generating the structured document is missing. If it is determined that information necessary for generating the structured document is missing, the computer system 210 may identify the information missing for generating the structured document, generate a comment for eliciting the information missing from the user for generating the structured document, and execute processing to present the comment to the user. In this way, the computer system 210 can resolve the lack of information necessary for generating the structured document by receiving a user's comment in response to the comment for eliciting the information missing from the user for generating the structured document. This allows the computer system 210 to generate a structured document when the information necessary for generating the structured document is available, and the user can generate the structured document simply by answering questions from the computer system 210 without having to grasp all of the information necessary for generating the structured document.

[0062] Step S402: A variable prompt is generated based on the first user input. The variable prompt generated based on the first user input includes a history of received user inputs. The variable prompt generated based on the first user input may include communication information including the received user input and a comment from the computer system 210. The generated variable prompt may be stored in the memory unit 213 of the computer system 210 or in the database unit 240 connected to the computer system 210.

[0063] Step S403: A first structured document is generated based on the variable prompts generated in step S402 and fixed prompts. This process may be performed using, for example, a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language model (LLM))). The variable prompts may be updated in response to user input, while the fixed prompts are not updated in response to user input in principle, except when referring to a model document, which will be described later. The fixed prompts may be stored in the memory unit 213 of the computer system 210, or may be stored in the database unit 240 connected to the computer system 210. The fixed prompts include, for example, know-how for generating a structured document (e.g., information indicating the role of the machine learning model (e.g., LLM), information indicating constraints on the machine learning model (e.g., LLM), information indicating best practices in generating a structured document), information indicating the structure of the structured document (e.g., a predetermined structure), and information indicating rules for comments to the user. Both the variable prompts and the fixed prompts are used each time a structured document is generated. The process in step S403 may be achieved, for example, by inputting the variable prompts and the fixed prompts into a machine learning model (e.g., LLM) to generate a first structured document. Along with the generation of the first structured document, comments for the user may also be generated (for example, using the machine learning model (e.g., LLM)).

[0064] The computer system 210 executes a process for presenting the generated first structured document to a user. This process may be achieved, for example, by transmitting the generated first structured document to the user device 2201. This process may correspond to displaying the structured document in the document area 140 shown in FIGS. 1A and 1B. The computer system 210 may further execute a process for presenting a comment to the user to the user. This process may be achieved, for example, by transmitting the generated comment to the user to the user device 2201. This process may correspond to displaying the comment to the user in the comment area 115 shown in FIGS. 1A and 1B.

[0065] Step S404: It is determined whether a user input for modifying the structured document has been received. The user input for modifying the structured document includes, for example, an instruction to modify the structured document. An example of a user input for modifying the structured document is a second user input for modifying the first structured document generated in step S403. If the determination result is "Yes," the process proceeds to step S405; if the determination result is "No," the process proceeds to step S407.

[0066] Step S405: The variable prompt is updated based on the user input for modifying the structured document. The variable prompt updated based on the user input for modifying the structured document includes a history of the generated structured document, a history of received user input, and information indicating a correspondence between the received user input and the generated structured document. The variable prompt can be updated, for example, by updating the history of the generated structured document included in the variable prompt based on the first structured document generated in step S403, and updating the history of the received user input included in the variable prompt based on a second user input for modifying the first structured document. The updated variable prompt may be stored in the memory unit 213 of the computer system 210 or in the database unit 240 connected to the computer system 210.

[0067] The history of generated structured documents indicates data of one or more structured documents generated so far in generating or modifying the structured document being modified, and includes, for example, data of the first structured document generated in step S403. The history of received user inputs indicates one or more user inputs received so far in generating or modifying the structured document being modified, and includes, for example, user inputs received in step S404 (and step S401). Information indicating the correspondence between received user inputs and generated structured documents indicates which structured documents were generated in response to which user inputs.

[0068] Step S406: A modified structured document is generated based on the variable prompts updated in step S405 and the fixed prompts. For example, if the variable prompts are updated in response to receiving a second user input for modifying the first structured document generated in step S403, a second structured document different from the first structured document is generated as the modified structured document. This process may be performed, for example, using a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language model (LLM))). The process in step S406 may be achieved, for example, by inputting the variable prompts and the fixed prompts into the machine learning model (e.g., LLM) and generating the modified structured document. Along with the generation of the modified structured document, a comment for the user may also be generated (e.g., using the machine learning model (e.g., LLM)).

[0069] The computer system 210 executes a process for presenting the modified structured document to the user. This process may be achieved, for example, by transmitting the modified structured document to the user device 2201. This process may correspond to displaying the modified structured document in the document area 140 shown in FIGS. 1A and 1B. The computer system 210 may further execute a process for presenting to the user a comment for the user that has been generated together with the modified structured document. This process may be achieved, for example, by transmitting to the user device 2201 a comment for the user that has been generated together with the modified structured document. This process may correspond to displaying the comment for the user in the comment area 115 shown in FIGS. 1A and 1B.

[0070] 4 are repeated, the history of the generated structured document, the history of the received user input, and information indicating the correspondence between the received user input and the generated structured document, which are included in the variable prompt, are updated and used together with the fixed prompt to generate a structured document. Because the updated variable prompt includes the history of the generated structured document, the history of the received user input, and information indicating the correspondence between the received user input and the generated structured document, computer system 210 can modify the structured document in consideration of the context of communication related to the structured document being modified that has been made between the user and computer system 210, and the user can experience such modifications. As a result, even if a user input includes a modification instruction such as "Make it B, not A," computer system 210 can identify what "A" is from the information included in the updated variable prompt and can flexibly respond to such modification instructions. Furthermore, even if a user input includes a modification instruction such as, for example, "Based on the previously generated structured document, modify XX to XX," the computer system 210 can identify what the "previously generated structured document" is from the information contained in the updated variable prompt, and can flexibly respond to such modification instructions.

[0071] Step S407: It is determined whether a user input for outputting a structured document has been received. If the determination result is "Yes," the process proceeds to step S408; if the determination result is "No," the process returns to step S404.

[0072] Step S408: In response to receiving a user input for outputting a structured document, the structured document is output. The structured document to be output may be the latest structured document among the one or more generated structured documents. The structured document to be output may also be a structured document specified by the user among the one or more generated structured documents. In this case, the user input specifying the structured document to be output may be received together with the user input for outputting the structured document.

[0073] There may be multiple structures for a structured document. In this case, the user input received by the computer system 210 (e.g., the user input received in step S401 or S404 of FIG. 4) may include structure identification information for identifying one of the multiple structures for the structured document. The structure identification information may be, for example, a predetermined keyword included in the user input (e.g., "manual," "article," etc.), information for identifying a previously generated structured document (document ID), a structural condition ID, or a detailed description for identifying the structural condition. This allows the user to select a desired structure to be adopted in the structured document from among the multiple predetermined structures.

[0074] When the user input received by the computer system 210 includes structure identification information, the computer system 210 identifies a structure to be used based on the structure identification information and updates variable prompts based on the identified structure to be used, thereby enabling the computer system 210 to generate a structured document having the identified structure to be used by generating a structured document based on the updated variable prompts.

[0075] 4. Various functions to further support the generation of structured documents - User input assistance The computer system 210 (particularly, the processor unit 212 of the computer system 210) may be configured to execute a process for assisting the user in entering an input. The process for assisting the user in entering an input may include, for example, presenting one or more input skeletons for the user input. The one or more input skeletons may be, for example, one or more input skeletons that support a reply to a comment from the computer system 210, as shown in the skeleton area 120 of FIGS. 1A and 1B. This allows the user to enter the user input by referring to the one or more presented input skeletons, even when the user does not know what to enter.

[0076] The computer system 210 may, for example, identify, as one or more input skeletons, linguistic expressions that prompt a user to input information that is missing for generating a structured document, or may identify, as one or more input skeletons, input patterns that are frequently input by users. The computer system 210 may, for example, identify, as one or more input skeletons, using a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language model (LLM))).

[0077] Use of models The computer system 210 (particularly, the processor unit 212 of the computer system 210) may receive a user input indicating that one or more example documents should be used as the basis for a structured document (e.g., in step S401 or step S404 of FIG. 4). The data of the one or more example documents may be received together with the user input indicating that one or more example documents should be used as the basis for a structured document, or may have been received in advance. If the computer system 210 has received the data of one or more example documents in advance, it may have issued information for identifying the example documents (example document IDs). In this case, the user input indicating that one or more example documents should be used as the basis for a structured document may include the example document IDs of the one or more example documents. The received data of the one or more example documents may be stored in the database unit 240 connected to the computer system 210.

[0078] Upon receiving data of one or more model documents, the computer system 210 may analyze the data of the one or more model documents and generate text data indicating the rules embodied in the one or more model documents (e.g., the structure of the model document, the way titles are written in the model document, the way descriptions are written in the model document, the writing style in the model document, etc.).

[0079] The computer system 210 is configured to identify one or more example documents and update a fixed prompt based on the identified one or more example documents in response to receiving user input indicating that the structured document should be based on one or more example documents. Identifying the one or more example documents may be achieved by receiving data of the one or more example documents along with the user input indicating that the structured document should be based on one or more example documents, or by using example document IDs included in the user input indicating that the structured document should be based on one or more example documents. Updating the fixed prompt based on the identified one or more example documents may include, for example, reflecting text data indicating rules embodied in the identified one or more example documents in the fixed prompt. The computer system 210 may generate a structured document based on the updated fixed prompt and the variable prompt. This process may be performed, for example, using a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language model (LLM))). This enables the computer system 210 to generate structured documents that adhere to the rules embodied in one or more identified model documents, and allows a user to easily customize one or more model documents to conform to the rules embodied in the one or more model documents simply by sending the model documents to the computer system 210.

[0080] Please incorporate images carefully The computer system 210 (particularly, the processor unit 212 of the computer system 210) can receive one or more image data from, for example, the user device 2201 and receive user input for incorporating at least one of the one or more image data into the structured document to be generated (e.g., in step S401 or step S404 of FIG. 4). The one or more image data may be received together with the user input for incorporating at least one of the one or more image data into the structured document to be generated, or may have been received in advance. The received one or more image data may be stored in the database unit 240 connected to the computer system 210. The received one or more image data may be associated with a user ID. The user input for incorporating at least one of the one or more image data into the structured document does not include information indicating where the image data should be incorporated in the updated structured document. The images may be still images or moving images.

[0081] In response to receiving the one or more image data, the computer system 210 may analyze the one or more image data and generate text data indicative of the content of the one or more image data.

[0082] When the user input for incorporating at least one of the one or more image data into the structured document to be generated includes a user ID, computer system 210 can identify, based on the user ID, one or more images associated with the user ID (i.e., one or more images submitted by the user generating or modifying the structured document). In response to receiving the user input for incorporating at least one of the one or more image data into the structured document to be generated, computer system 210 is configured to update the variable prompt based on the user input for incorporating at least one of the one or more image data into the structured document to be generated and the received one or more image data, and update the structured document (e.g., the first structured document generated in step S403 of FIG. 4 or the modified structured document generated in step S406 of FIG. 4) based on the updated variable prompt and the fixed prompt.

[0083] Updating the variable prompt based on a user input for incorporating at least one of the one or more image data into the generated structured document and the received one or more image data may include updating the variable prompt based on a user input for incorporating at least one of the one or more image data into the generated structured document, the received one or more image data, and text data indicating the content of the one or more image data. In this case, the structured document is updated to place an image corresponding to text data that is content-appropriate for a description in the structured document near the description (e.g., to place an image in at least one step of a structured document having a step structure, or to place an image in an image region of a structured document having a structure appropriate for an article). Updating the structured document may be performed, for example, using a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language model (LLM))).

[0084] In this way, the computer system 210 can automatically incorporate images that match descriptions in the structured document into the structured document, and the user can incorporate the image in the appropriate location within the structured document without having to specify where the image should be incorporated.

[0085] -Identifying areas that should not be corrected The user input received in step S404 of Fig. 4 may include information indicating portions of the structured document that should be corrected and information indicating portions of the structured document that should not be corrected. The structured document referred to here may be, for example, the first structured document generated in step S403 of Fig. 4, or the first structured document identified from database unit 240. The portion of the structured document that should not be corrected may be at least one step among multiple steps of a structured document having a step structure, or a specific area (e.g., title, subheading, etc.) within a structured document that has a structure suitable for an article.

[0086] In this case, the computer system 210 (particularly, the processor unit 212 of the computer system 210) is configured to identify and record portions of the structured document that should not be corrected based on information indicating portions of the structured document that should not be corrected. The information indicating portions of the structured document that should not be corrected can be stored, for example, in the database unit 240 connected to the computer system 210. The computer system 210 is configured to update the variable prompts based on the structured document (e.g., the first structured document generated in step S403 of FIG. 4, the first structured document identified from the database unit 240) and the information indicating the portions that should not be corrected, provisionally generate a structured document (e.g., a second structured document different from the first structured document) based on the updated variable prompts and the fixed prompts, and generate a corrected structured document based on the provisionally generated structured document and the recorded portions that should not be corrected. The computer system 210 can execute processing to present the corrected structured document to a user. The modified structured document can be generated by merging the provisionally generated structured document with the recorded portions that should not be modified (e.g., replacing portions in the provisionally generated structured document that correspond to portions that should not be modified in the structured document with the recorded portions that should not be modified). The provisional generation of the structured document can be performed, for example, using a machine learning model (e.g., artificial intelligence (AI) (e.g., large-scale language model (LLM))).

[0087] By updating the variable prompts based on the structured document and information indicating the portions that should not be corrected, it is possible to reflect the portions in the structured document that should not be corrected in the variable prompts. However, when the computer system 210 provisionally generates a structured document based on the updated variable prompts and fixed prompts, it may be necessary to correct the portions in the structured document that should not be corrected. Therefore, by recording the portions in the structured document that should not be corrected and generating a corrected structured document based on the provisionally generated structured document and the recorded portions that should not be corrected, it is possible to prevent the portions that should not be corrected from being corrected, even if they are inevitably corrected in the structured document. If the portions that should not be corrected in the structured document are not corrected when the structured document is provisionally generated, the provisionally generated structured document may be identical to the corrected structured document.

[0088] · Reference to an image or document The computer system 210 (particularly, the processor unit 212 of the computer system 210) may receive one or more image data, audio data, or document data, for example, from the user device 2201. The image data may include, but is not limited to, still image data, video data, etc. The document data may include, but is not limited to, Word data, PDF data, PowerPoint data, Excel data, etc. In response to receiving the one or more image data, audio data, or document data, the computer system 210 may analyze the received one or more image data, audio data, or document data and generate text data indicating characteristics of the one or more image data, audio data, or document data. User input received by the computer system 210 (e.g., user input received in step S401 or S404 of FIG. 4) may include instructions referencing the one or more image data, audio data, or document data. The one or more image data, audio data, or document data may be received together with the instructions referencing the one or more image data, audio data, or document data, or may have been received in advance. The received one or more pieces of image data, audio data, or document data may be stored in a database unit 240 connected to the computer system 210. The received one or more pieces of image data, audio data, or document data may be associated with a user ID.

[0089] If the instruction referencing the one or more image data, audio data, or document data includes a user ID, the computer system 210 can identify, based on the user ID, the one or more image data, audio data, or document data associated with the user ID (i.e., the one or more image data, audio data, or document data sent by the user creating or modifying the structured document). In response to receiving the instruction referencing the one or more image data, audio data, or document data, the computer system 210 is configured to update a structured document (e.g., the first structured document generated in step S403 of FIG. 4 or the modified structured document generated in step S406 of FIG. 4) based on the instruction referencing the one or more image data, audio data, or document data, the received one or more image data, audio data, or document data, a variable prompt, and a fixed prompt. This processing may include, for example, updating the variable prompt based on the instruction referencing the one or more image data, audio data, or document data, the received one or more image data, audio data, or document data, and updating the structured document based on the updated variable prompt and the fixed prompt.

[0090] This allows the computer system 210 to generate or modify a structured document by referencing one or more image data, audio data, or document data sent by the user, and enables the user to easily generate or modify a structured document when they do not know specifically how to generate or modify the structured document but have a vague idea that they would like it to look like one or more image data, audio data, or document data.

[0091] Furthermore, the instruction to reference one or more pieces of image data, audio data, or document data may include information indicating a portion of the one or more pieces of image data, audio data, or document data that is to be particularly referenced. This enables computer system 210 to generate or modify a structured document so as to particularly reproduce the portion of the one or more pieces of image data, audio data, or document data that is to be particularly referenced, and enables a user to, for example, cause computer system 210 to specify and modify only the portion of the structured document that the user particularly wants to modify, based on the portion of the one or more pieces of image data, audio data, or document data that is to be particularly referenced.

[0092] Although an example of newly generating a first structured document has been described in steps S401 to S403 of FIG. 4, the present invention is not limited thereto. Instead of steps S401 to S403, computer system 210 (particularly, processor unit 212 of computer system 210) may be configured to receive a first user input for identifying the first structured document in step S401′, and identify the first structured document based on the received first user input. The first user input for identifying the first structured document may include, for example, a document ID. The first user input for identifying the first structured document may further include a user ID. In this case, after step S401′, computer system 210 executes the processing described with reference to steps S404 and onward of FIG. 4, and the history of the generated structured document includes data of the first structured document identified in step S401′. This allows the user to easily modify or edit an existing structured document (for example, a structured document created in the past) by reading the existing structured document.

[0093] In the embodiment shown in Fig. 4, an example has been described in which the processing of each step shown in Fig. 4 is realized by the processor executing a program stored in the memory, but the present invention is not limited to this. At least some of the processing of each step shown in Fig. 4 may be realized by a hardware configuration such as a control circuit.

[0094] As described above, the present invention has been illustrated using the preferred embodiment of the present invention, but the present invention should not be interpreted as being limited to this embodiment. It is understood that the scope of the present invention should be interpreted only by the claims. It is understood that a person skilled in the art can implement an equivalent scope based on the description of the present invention and common technical knowledge from the description of the specific preferred embodiment of the present invention. [Industrial Applicability]

[0095] The present invention is useful for reducing the time and effort required to create a structured document by providing a computer system, method, and program for supporting the creation of a structured document. [Explanation of symbols]

[0096] 200 systems 210 Computer Systems 2201~220 N User Device 230 Internet 240 Database Department

Claims

1. 1. A computer system for supporting the creation of a structured document, the computer system comprising: means for receiving a first user input for generating a structured document; means for generating a variable prompt based on the first user input; means for generating a first structured document based on the variable prompts and the fixed prompts; means for receiving a second user input for modifying the generated first structured document; means for updating the variable prompt based on the generated first structured document and the second user input, the updated variable prompt including a history of the generated structured document, a history of the received user input, and information indicating a correspondence between the received user input and the generated structured document; means for generating a second structured document that is different from the first structured document based on the updated variable prompt and the fixed prompt; A computer system comprising:

2. The computer system of claim 1 , wherein the variable prompt comprises a history of received user input.

3. The means for updating the variable prompt comprises: means for updating a history of generated structured documents included in the variable prompt based on the generated first structured document; means for updating a history of received user inputs included in the variable prompt based on the second user input; 10. The computer system of claim 1, comprising:

4. The computer system of claim 1 , further comprising means for performing processing to assist in entering user input.

5. 5. The computer system of claim 4, wherein the means for performing a process to assist in the entry of user input includes means for presenting one or more input skeletons for user input.

6. The computer system includes: means for receiving user input indicating that one or more exemplar documents should be used as a basis for a structured document; means for identifying the one or more example documents; means for updating the fixed prompt based on the one or more example documents; The computer system of claim 1 further comprising:

7. The computer system includes: means for receiving one or more image data; means for receiving a third user input for incorporating at least one of the one or more image data into a generated structured document; means for updating the variable prompt based on the third user input and the one or more image data; means for updating the structured document based on the updated variable prompt and the fixed prompt; 10. The computer system of claim 1, comprising:

8. The computer system includes: means for generating text data indicative of the content of the one or more image data in response to receiving the one or more image data; Furthermore, the means for updating the variable prompt updates the variable prompt based on the third user input, the one or more image data, and the text data; 8. The computer system of claim 7, wherein the third user input does not include information indicating where image data is to be embedded in the updated structured document.

9. The second user input includes information indicating a portion of the generated first structured document that should be modified and information indicating a portion of the generated first structured document that should not be modified; The computer system includes: a means for identifying and recording portions of the generated first structured document that should not be modified based on information indicating portions of the generated first structured document that should not be modified; means for updating the variable prompt based on the generated first structured document and information indicating a portion of the generated first structured document to be corrected; means for provisionally generating a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt; means for generating a fourth structured document different from the first structured document based on the second structured document and the portion of the generated first structured document that should not be modified; The computer system of claim 1 further comprising:

10. the first user input includes an instruction referencing one or more image data, audio data, or document data; The computer system further comprises means for receiving one or more pieces of image data, audio data, or document data, and means for generating text data indicating characteristics of the one or more pieces of image data, audio data, or document data based on the one or more pieces of image data, audio data, or document data; 2. The computer system of claim 1, wherein the means for generating the first structured document generates the first structured document based on the variable prompt, the fixed prompt, the one or more image data, audio data, or document data, and the text data in response to receiving the instruction.

11. The computer system of claim 1 , wherein the fixed prompt includes structural information indicating a structure of the structured document.

12. the structured document is an electronic manual, the information indicating the structure of the structured document includes step structure information indicating a step structure of the electronic manual; 12. The computer system of claim 11, wherein the means for generating the first structured document generates the first structured document having a step structure.

13. the first user input includes identification information for identifying one of a plurality of structures for the structured document; The computer system includes: means for identifying a structure to be used based on the identification information; means for updating said variable prompt based on the structure to be used; The computer system of claim 1 further comprising:

14. 1. A method executed in a computer system for supporting the creation of a structured document, the computer system comprising: The method comprises: receiving, by the processor unit, a first user input for generating a structured document; generating a variable prompt based on the first user input; the processor unit generating a first structured document based on the variable prompts and the fixed prompts; receiving, by the processor unit, a second user input for modifying the generated first structured document; the processor unit updates the variable prompt based on the generated first structured document and the second user input, the updated variable prompt including a history of generated structured documents, a history of received user inputs, and information indicating a correspondence between the received user inputs and the generated structured documents; the processor unit generates a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt; A method comprising:

15. A program executed in a computer system for supporting the creation of a structured document, the computer system comprising: a processor; When the program is executed by the processor unit, receiving a first user input for generating a structured document; generating a variable prompt based on the first user input; generating a first structured document based on the variable prompts and the fixed prompts; receiving a second user input to modify the generated first structured document; updating the variable prompt based on the generated first structured document and the second user input, wherein the updated variable prompt includes a history of the generated structured document, a history of the received user input, and information indicating a correspondence between the received user input and the generated structured document; generating a second structured document different from the first structured document based on the updated variable prompts and the fixed prompts; a program causing the processor unit to perform at least the above.

16. 1. A computer system for supporting the creation of a structured document, the computer system comprising: means for receiving a first user input for identifying a first structured document, the first structured document being generated based on a variable prompt and a fixed prompt that are generated based on the user input for generating the first structured document; means for identifying the first structured document based on the first user input; means for receiving a second user input for modifying the identified first structured document; means for updating the variable prompt based on the identified first structured document and the second user input, the updated variable prompt including a history of generated structured documents, a history of received user inputs, and information indicating a correspondence between the received user inputs and the generated structured documents; means for generating a second structured document that is different from the first structured document based on the updated variable prompt and the fixed prompt; A computer system comprising:

17. 1. A method executed in a computer system for supporting the creation of a structured document, the computer system comprising: The method comprises: the processor unit receiving a first user input for identifying a first structured document, the first structured document being generated based on a variable prompt and a fixed prompt that are generated based on the user input for generating the first structured document; the processor unit identifying the first structured document based on the first user input; receiving, by the processor unit, a second user input for modifying the identified first structured document; the processor unit updates the variable prompt based on the identified first structured document and the second user input, the updated variable prompt including a history of generated structured documents, a history of received user inputs, and information indicating a correspondence between the received user inputs and the generated structured documents; the processor unit generates a second structured document different from the first structured document based on the updated variable prompt and the fixed prompt; A method comprising:

18. A program executed in a computer system for supporting the creation of a structured document, the computer system comprising: a processor; When the program is executed by the processor unit, receiving a first user input to identify a first structured document, the first structured document being generated based on a variable prompt and a fixed prompt that are generated based on the user input for generating the first structured document; identifying the first structured document based on the first user input; receiving a second user input for modifying the identified first structured document; updating the variable prompt based on the identified first structured document and the second user input, wherein the updated variable prompt includes a history of generated structured documents, a history of received user inputs, and information indicating a correspondence between the received user inputs and the generated structured documents; generating a second structured document different from the first structured document based on the updated variable prompts and the fixed prompts; a program causing the processor unit to perform at least the above.

Images