Information processing system, information processing device, information processing method, and program

Abstract

To provide a technique which enables acquisition of desired output information.SOLUTION: An information processing system provided herein is configured to: acquire information on an output format; search for multiple pieces of reference information based on a search request; acquire one or more pieces of reference information to be used for generation of output information, on the basis of a result of the search; generate input information for a machine learning model, on the basis of the information on the output format and the one or more reference information; input the input information to the machine learning model to generate output information; acquire one or more other pieces of reference information to be used for generation of second output information, on the basis of the result of the search; generate second input information on the basis of the information on the output format and the one or more other reference information; input the second input information to the machine learning model to generate second output information; and output information on difference between the output information and the second output information.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system, an information processing device, an information processing method, and a program. [Background technology]

[0002] Known foundational models include large-scale language models (LLMs). Foundational models are machine learning models that can perform various tasks by learning from large datasets. Foundational models perform tasks according to input information called prompts, and output the resulting data.

[0003] To obtain good output results from the underlying model, a technique is known in which prompts contain reference information obtained by searching a specific data source, such as Retrieval Augmented Generation (RAG). [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Kuttler, Mike Lewis, Wen-tau Yih, Tim Rocktaschel, Sebastian Riedel, Douwe Kiela, "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks", [online], [Searched on December 20, 2020], Internet<URL: https: / / arxiv.org / pdf / 2005.11401v4.pdf> Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present disclosure is to provide a technology that can acquire desired output information. [Means for solving the problem]

[0006] An information processing system according to one aspect of the present disclosure includes at least one memory and at least one processor, wherein the at least one processor acquires information regarding an output format, searches for multiple reference information based on a search request, acquires one or more reference information to be used for generating output information based on the search results, generates input information for a machine learning model based on the information regarding the output format and the one or more reference information, and generates output information by inputting the input information into the machine learning model. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a block diagram illustrating an example of the overall configuration of an information processing system. [Figure 2] FIG. 2 is a block diagram illustrating an example of a functional configuration of a reporting device. [Figure 3] FIG. 10 is a diagram illustrating an example of a template. [Figure 4] FIG. 10 is a diagram showing a first example of a format designation screen. [Figure 5] FIG. 10 is a diagram showing a second example of a format designation screen. [Figure 6] FIG. 10 is a diagram illustrating an example of a condition setting screen. [Figure 7] FIG. 10 is a diagram illustrating an example of a selection screen. [Figure 8] FIG. 10 is a diagram illustrating an example of a display screen. [Figure 9] 10 is a flowchart illustrating an example of a report generation process according to the first embodiment. [Figure 10] 10 is a flowchart showing an example of a report generation process according to the second embodiment. [Figure 11] FIG. 2 is a block diagram illustrating an example of a hardware configuration of a computer. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0009] [First embodiment] A first embodiment of the present disclosure is an information processing system that generates various reports based on a base model. In this embodiment, the base model may be, for example, a large language model (LLM). The base model is not limited to a large language model, but may be a generative model that generates various data such as audio, images, and videos. Note that this embodiment is not limited to the base model, and may be configured using a machine learning model. The machine learning model may include, for example, a base model, a generative model, or a neural network. The machine learning model may be multimodal.

[0010] The information processing system of this embodiment executes a predetermined generation task according to a search expansion generation framework. In this embodiment, the generation task may be, for example, a task to generate a report. For example, the report may be a report intended for information sharing within an organization such as a company, local government, or school, or a report intended for information provision outside the organization. For example, the report may be a research report reporting research results. The report may be a document containing information desired by a user.

[0011] Search expansion generation is a technique used to obtain good generation results from a foundation model. In search expansion generation, reference information is searched for from a specified data source based on instruction information that instructs the execution of a task, and a prompt including the instruction information and the search results for the reference information is input to the foundation model. The foundation model performs the task while taking into account, for example, reference information that is not included in the training data, and can generate data appropriate for the instruction information.

[0012] This embodiment provides a technology that enables desired output information to be obtained within a search expansion generation framework. In this embodiment, input information to a base model includes information about an output format and reference information searched based on the input information, thereby generating output information according to the output format. In one aspect, this embodiment allows the output format to be changed with a simple operation, making it easy to obtain desired output information.

[0013] <Overall configuration of information processing system> The overall configuration of an information processing system according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an example of the overall configuration of an information processing system.

[0014] 1, the information processing system 1000 includes a report device 10, a search device 20, a generation device 30, and a terminal device 40. The report device 10, the search device 20, the generation device 30, and the terminal device 40 may be connected to each other via a communication network such as a LAN (Local Area Network) or the Internet so as to be able to communicate data with each other.

[0015] The report device 10 is an example of an information processing device such as a personal computer, a workstation, or a server that instructs the generation device 30 to execute a predetermined task in response to a request from a terminal device 40. In this embodiment, the predetermined task may be a task to generate a report, which is an example of output information.

[0016] The report device 10 may acquire the search results for the reference information from the search device 20 based on the generation request received from the terminal device 40. The report device 10 may transmit a search request to the search device 20 based on the generation request.

[0017] A generation request is information or a signal that requests the generation of a report. The generation request may include information about the output format, input information entered by the user, and search criteria set by the user. Hereinafter, information about the output format will also be referred to as "output format information," and input information entered by the user will also be referred to as "user input information." Note that at least a portion of the "output format information" may be information entered by the user.

[0018] A search request is information or a signal requesting a search for reference information. The search request may include, for example, a query and search criteria. The query may include user-entered information included in the generation request. The search criteria may include search criteria included in the generation request.

[0019] The report device 10 may generate input information for the base model 35 based on the search results for the reference information acquired from the search device 20. The report device 10 may transmit the search results for the reference information to the terminal device 40, and generate input information for the base model 35 based on the reference information selected by the terminal device 40.

[0020] The report device 10 may obtain output information generated by inputting input information to the base model 35 into the base model 35 from the generation device 30. The report device 10 may generate a report based on the output information and transmit it to the terminal device 40 as a generation result in response to a generation request.

[0021] The search device 20 is an example of an information processing device such as a personal computer, workstation, or server that searches for reference information in response to a request from the report device 10. The search device 20 may include a data source 25 that stores various pieces of reference information. As an example, the data source 25 may be a storage device or a database in which the reference information is stored. The data source 25 may be provided by an external device or system. Note that "external" means that it is not included in the information processing system 1000.

[0022] The search device 20 may be implemented in multiple devices or systems with different data sources 25. The search device 20 may be implemented in one device or system with multiple data sources 25. The search device 20 may be an external device or system. The search device 20 may retrieve reference information from external data sources 25.

[0023] The generating device 30 is an example of an information processing device such as a personal computer, workstation, or server that executes a predetermined task using a base model in response to a request from the reporting device 10. The generating device 30 may include a base model 35. The base model 35 is a machine learning model for executing the predetermined task. The base model 35 may be, for example, a large-scale language model.

[0024] The base model 35 may be realized by one base model. The base model 35 may be realized by linking multiple base models. The base model 35 may be configured from multiple base models according to the tasks to be executed.

[0025] The generation device 30 may be realized in multiple devices or systems having different base models 35. The generation device 30 may be realized in one device or system having multiple base models 35. The generation device 30 may be an external device or system. The generation device 30 may execute a predetermined task based on the external base model 35.

[0026] The terminal device 40 is an example of an information processing terminal such as a personal computer, a smartphone, or a tablet terminal operated by a user of the information processing system 1000. The terminal device 40 may request the report device 10 to execute a predetermined task. The terminal device 40 may send a generation request including output format information and user input information to the report device 10. The terminal device 40 may receive the generation result from the report device 10 and present it to the user.

[0027] For example, the terminal device 40 may display the generation result on a display device of the terminal device 40. For example, the terminal device 40 may emit a voice synthesized from the generation result from a speaker of the terminal device 40.

[0028] The overall configuration of the information processing system 1000 shown in FIG. 1 is one example, and various configuration examples of information processing systems are possible depending on the application and purpose. The information processing system 1000 may be configured with one or more devices. The devices included in the information processing system 1000 may be a system configured with multiple devices. Each function included in the information processing system 1000 may be realized by any device that constitutes the system. Each component included in the information processing system 1000 may be included in any device that constitutes the system.

[0029] The data source 25 may be built into the report device 10 or the generation device 30. The data source 25 may be distributed and held in an external information processing system consisting of multiple devices. In this case, the information processing system 1000 may not include the search device 20.

[0030] The base model 35 may be built into the report device 10 or the search device 20. The base model 35 may be distributed and held in an external information processing system consisting of multiple devices. In this case, the information processing system 1000 may not include the generation device 30.

[0031] The information processing system 1000 may include a plurality of units of one or more of the report device 10, search device 20, generation device 30, and terminal device 40. The report device 10, search device 20, or generation device 30 may be realized by a plurality of computers, or may be realized as a cloud computing service. Two or more of the report device 10, search device 20, and generation device 30 may be realized by a standalone computer. The classification of devices such as the report device 10, search device 20, generation device 30, and terminal device 40 shown in FIG. 1 is an example.

[0032] As an example, the information processing system 1000 may be configured with a server device and one or more terminal devices 40. The server device may have the functions of a report device 10, a search device 20, and a generation device 30. The server device may be realized as a system including multiple information processing devices. The server device may also be realized as a cloud computing service.

[0033] As an example, the information processing system 1000 may be configured with a first server device, a second server device, and one or more terminal devices 40. The first server device may have the functions of a report device 10 and a generation device 30. The second server device may have the functions of a search device 20. The first server device and the second server device may each be realized as a system including a plurality of information processing devices. The first server device and the second server device may each be realized as a cloud computing service.

[0034] As an example, the information processing system 1000 may be configured with one or more information processing devices. The one or more information processing devices constituting the information processing system 1000 may have the functions of the report device 10, the search device 20, the generation device 30, and the terminal device 40. As another example, the information processing system may be configured with one or more information processing devices having the functions of the report device 10, the search device 20, and the generation device 30. The information processing system may also be configured with one or more information processing devices having the functions of the report device 10 and the generation device 30. The information processing system may also be configured with one or more information processing devices having at least some of the functions of the report device 10, the search device 20, the generation device 30, and the terminal device 40.

[0035] <Functional configuration of the report device> The functional configuration of the report device 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the functional configuration of the report device.

[0036] 2, the report device 10 includes a request receiving unit 110, a search unit 120, a presentation unit 130, a selection receiving unit 140, a generation unit 150, a history storage unit 160, an output unit 170, and a billing unit 180. The report device 10 functions as the request receiving unit 110, the search unit 120, the presentation unit 130, the selection receiving unit 140, the generation unit 150, the history storage unit 160, the output unit 170, and the billing unit 180 by executing a program installed in advance.

[0037] The request receiving unit 110 receives a request to generate a report. The request receiving unit 110 may receive a generation request from the terminal device 40. The generation request may be transmitted from the terminal device 40 in response to an operation on a screen displayed on a display device of the terminal device 40. The request receiving unit 110 may receive a generation request input to the report device 10. The generation request may be input to the report device 10 in response to an operation on a screen displayed on a display device of the report device 10.

[0038] The generation request may include output format information and user input information. The output format information may include information specifying the output format. The output format information may include information regarding one or more output formats selected from a plurality of output formats. The output format information may be information that can identify the output format. For example, the information that can identify the output format may be identification information that identifies the output format, or information that indicates the location of a file that describes the output format.

[0039] The output format information may include information about the structure of the report. The information about the structure of the report may be information indicating the structure of one or more items included in the report. The information indicating the structure may include, for example, information about at least one of the item names, the order of the items, or the hierarchy of the items. The structure of the report may include, for example, at least one of the title, subtitle, or table of contents of the report. The table of contents may include one or more headings.

[0040] The output format information may be information specifying the format of the output information, which may include, for example, natural language text, Markdown notation, HTML (HyperText Markup Language), XML (Extensible Markup Language), JSON (JavaScript Object Notation), CSV (Comma Separated Values), Mermaid, etc.

[0041] The output format information may be information indicating a file format. For example, the information indicating the file format may be a file extension. For example, the file format may include text, image data, video data, audio data, a table format, a presentation format, or a portable document format (PDF).

[0042] The output format information may be selected from a plurality of pieces of output format information created in advance. The output format information may be newly created in response to an operation by a user. The output format information may be selected or generated in response to an operation on a screen displayed on the display device of the terminal device 40. As an example, the output format information may be written using a tool such as a text editor. The pre-created output format information may include reports created in the past.

[0043] The output format information may be, for example, a research report format, which may include items such as an outline, experimental details, results (discussion), and a summary (conclusion).

[0044] The user-entered information may include search terms to be included in the query. The user-entered information may include, for example, the title of the report and headings included in the table of contents. The user-entered information may include, for example, one or more natural language sentences describing the contents of the entire report or the contents of each item included in the report.

[0045] The user input information may include text data, structured data, image data, or audio data. Image data may be, for example, a still image or a video. Text data may be text data generated by speech recognition of audio data or video. Text data may be text generated by character recognition of image data. Audio data may be audio data generated by speech synthesis of text data. Structured data may be, for example, a table or graph.

[0046] The generation request may include search conditions for the reference information, which may include, for example, at least one of information indicating a data source to be searched, a type of the data source, a time range of the creation date, attribute information of the reference information to be searched, the number of items to be included in the search result, and a usage condition.

[0047] The information indicating the data source may be information capable of identifying the data source. For example, the information capable of identifying the data source may be identification information for identifying the data source, or information indicating the location of the data source (e.g., a host name, an Internet Protocol (IP) address, a connection string, or a Uniform Resource Locator (URL)).

[0048] The information indicating the data source may be set for the entire report. The information indicating the data source may be set for each item included in the report. The information indicating the data source may include multiple data sources. The information indicating the data source may include a data source for the entire report and a data source for each item. When the information indicating the data source includes multiple data sources, it may include information indicating the priority of each data source.

[0049] The type of data source may include, for example, information indicating whether it is inside or outside the organization. The type of data source inside the organization may include, for example, at least one of the entire organization, a department of the organization (e.g., a corporate division), or a business database (e.g., product information or sales information). The type of data source outside the organization may include, for example, at least one of a website (e.g., a news site or a dictionary site), a search engine, or a social networking service (SNS).

[0050] The attribute information of the reference information to be searched may include at least one of information indicating the file format, creation date, and usage conditions. The information indicating the file format may be, for example, a file extension. The usage conditions may include billing information regarding the use of the reference information. The billing information may be information indicating whether or not paid reference information is to be searched.

[0051] The generation request may include user information about the user. For example, the user information may include at least one of the user's authority, attributes, affiliation, position, or usage plan. For example, the user's authority may include information indicating whether the user is a member of the management level of an organization. For example, the usage plan may include information indicating whether paid reference information is available.

[0052] The search unit 120 searches for reference information based on the generation request received by the request receiving unit 110. For example, the search unit 120 may transmit a search request including user input information included in the generation request to the search device 20. The search unit 120 may receive search results transmitted by the search device 20 in response to the search request. The search results may include multiple pieces of reference information that satisfy the search conditions indicated in the search request.

[0053] The search request may include at least one of a query and a search condition. The query may be generated based on user input information included in the generation request. As an example, the query may include a keyword included in the user input information. The search condition may include a search condition included in the generation request. The search condition may include a predetermined search condition. The search unit 120 may set the search condition based on the user information included in the generation request.

[0054] The search unit 120 may search for reference information from multiple data sources specified in the search criteria. The search unit 120 may control the data sources to be searched based on user information included in the generation request. For example, if the user's authority or usage plan indicates that paid reference information is not available, the search unit 120 may exclude data sources storing paid reference information from the search targets.

[0055] The search unit 120 may include in the search results the number of reference information items specified in the search conditions. The search unit 120 may include in the search results a predetermined number of reference information items. The search unit 120 may set the number of reference information items to be included in the search results based on the user's authority or usage plan. The search unit 120 may set the number of reference information items to be included in the search results based on the amount of data that can be input into the base model 35.

[0056] The presentation unit 130 presents to the user information about the search results of the reference information searched by the search unit 120. The information about the search results may include, for example, at least one of the data source of the reference information, link information, at least a portion of the information, a summary, a thumbnail image, the owner, the copyright holder, the creation date, or the terms of use. The terms of use may include information indicating whether or not the use of the reference information is chargeable. The information indicating whether or not the use of the reference information is chargeable may include information indicating whether or not the use of the reference information is free of charge, a usage fee, or points to be consumed. The usage fee and points to be consumed may be numerical values, or may be 0 if the use is free of charge.

[0057] The presentation unit 130 may transmit the search results for the reference information to the terminal device 40 and display the search results for the reference information on a display device of the terminal device 40. The presentation unit 130 may display the search results for the reference information on a display device of the report device 10. Note that presenting information to the user may include the processor executing at least a part of the processing required for displaying the information on the display device. The display device may be provided in the same device as the processor, or in a device different from the processor. The display device may be a plurality of display devices.

[0058] The presentation unit 130 presents the search results for reference information in a manner that allows the user to select it. The presentation unit 130 may control the selectable reference information based on user information. As an example, if the user information indicates that paid reference information is not available, the presentation unit 130 may present paid reference information to the user in a manner that makes it unselectable.

[0059] The presentation unit 130 may present information about the search results (hereinafter also referred to as auxiliary information of the reference information) together with the search results of the reference information. The auxiliary information of the reference information may include, for example, at least one of a data source, link information, partial information, summary, thumbnail image, owner, copyright holder, creation date, or terms of use. The auxiliary information of the reference information may present any combination of two or more of these. The presentation unit 130 may generate at least a part of the auxiliary information of the reference information based on the base model 35 or another base model.

[0060] The data source is information indicating the data source in which the reference information was stored. The link information is information indicating the location of the reference information (e.g., a URL, etc.). For example, the part of information may include at least one of the title or heading of the reference information, a predetermined number of characters or a predetermined number of lines from the beginning, or keywords extracted from the reference information. For example, the summary or thumbnail image may be obtained from the data source 25 or may be generated based on the foundation model 35 or another foundation model.

[0061] The usage conditions may include billing information. The billing information may include information indicating whether the reference information is available for a fee or free of charge. The usage conditions may include copyright information. The copyright information may include terms of use. The usage conditions may be set by the owner or copyright holder of the reference information. If the usage conditions of the reference information indicate that the reference information is unavailable, the presentation unit 130 may present the user with a message urging them to enter into a contract with the owner or copyright holder of the reference information.

[0062] The selection receiving unit 140 receives a selection request for reference information. The selection receiving unit 140 may receive a selection request from the terminal device 40. The selection request may be transmitted from the terminal device 40 in response to an operation on a screen displayed on a display device of the terminal device 40. The selection receiving unit 140 may receive a selection request input to the report device 10. The selection request may be input to the report device 10 in response to an operation on a screen displayed on a display device of the report device 10.

[0063] The selection request is information or a signal requesting the selection of one or more pieces of reference information to be used in generating output information. The selection request may be information indicating one or more pieces of reference information selected by the user from the search results of the reference information presented by the presentation unit 130.

[0064] The selection receiving unit 140 acquires the reference information indicated in the selection request. The selection receiving unit 140 may acquire information that can identify the reference information. The information that can identify the reference information may be, for example, identification information that identifies the reference information or information that indicates the location of a file that describes the reference information.

[0065] The selection request may include one or more pieces of reference information specified by the user. The reference information specified by the user may be reference information that is not included in the search results for reference information. For example, the reference information specified by the user may be information indicating the location of the reference information (e.g., a URL, etc.).

[0066] The generation unit 150 acquires output information from the base model 35 based on the generation request accepted by the request acceptance unit 110 and one or more pieces of reference information acquired by the selection acceptance unit 140. As an example, the generation unit 150 may generate input information for the base model 35 based on the generation request and the reference information, and transmit the information to the generation device 30. Hereinafter, the input information for the base model 35 will also be referred to as "model input information."

[0067] The generation unit 150 may acquire output format information and user input information from the generation request and generate model input information by embedding the output format information, user input information, and reference information in a predetermined template. The generation unit 150 may generate model input information by processing the template, output format information, user input information, and reference information based on predetermined rules. The generation unit 150 may generate model input information by inputting the template, output format information, user input information, and reference information into another base model. The generation unit 150 may receive, from the generation device 30, output information generated by the generation device 30 inputting the model input information into the base model 35.

[0068] The generation unit 150 may generate the model input information based on one or more pieces of reference information searched by the search unit 120, one or more pieces of reference information selected by the user, or one or more pieces of reference information specified by the user. The generation unit 150 may generate the model input information based on any combination of one or more pieces of reference information searched by the search unit 120, one or more pieces of reference information selected by the user, and one or more pieces of reference information specified by the user. The generation unit 150 may generate the model input information using at least a portion of the information included in each piece of reference information. The generation unit 150 may also generate the model input information using information obtained by processing each piece of reference information. The generation unit 150 may also generate the model input information using at least a portion of the information included in the output format information, or may generate the model input information using information obtained by processing the output format information. The generation unit 150 may also generate the model input information using at least a portion of the information included in the user input information, or may generate the model input information using information obtained by processing the user input information.

[0069] The generation unit 150 may generate output information by inputting model input information into one base model 35 selected from multiple base models 35. The base model 35 used to generate the output information may be specified by a generation request, for example. The base model specified by the generation request may be selected by the user. The base model 35 used to generate the output information may be selected based on the user's authority or usage plan, for example.

[0070] A template for generating model input information may include one or more placeholders for embedding output format information, user input information, or reference information. The template may include instruction information for instructing report generation. The template may include information specifying the output format. The template may include constraint information regarding the output information. The instruction information and constraint information may be predetermined fixed sentences.

[0071] The model input information may include text data, image data, or audio data. The text data may be, for example, a natural language sentence called a prompt. The image data may be, for example, a still image or a video. The text data may be text data obtained by speech recognition of audio data or video. The text data may be text obtained by character recognition of image data. The image data may include, for example, an image of a user. The audio data may include, for example, audio spoken by a user. The audio data may be audio data obtained by speech synthesis of text data.

[0072] The history storage unit 160 stores history information of the output information generated by the generation unit 150. The output information may be accumulated in chronological order in the history storage unit 160. The history storage unit 160 may store information used to generate the output information. The information used to generate the output information may include, for example, at least one of the data source to be searched, the base model used to generate the output information, user input information, output format information, reference information used to generate the output information, and model input information.

[0073] The output information and the information used for generation may be associated and stored in the history storage unit 160. As a method for associating the output information and the information used for generation, for example, the output information and the information used for generation may be stored as a set, information that allows one piece of information to be acquired from the other piece of information may be stored, or one piece of information and identification information for the other piece of information may be stored as a set.

[0074] The output unit 170 outputs a generation result in response to the generation request accepted by the request accepting unit 110, based on the output information acquired by the generation unit 150. The output unit 170 may transmit the generation result including the output information to the terminal device 40. The output unit 170 may display the generation result including the output information on the display device of the report device 10.

[0075] The output unit 170 may generate a report based on the output information and output the generated result including the report. The output unit 170 may generate the output information itself as a report. The output unit 170 may generate a report including part of the output information. The output unit 170 may generate a report by processing the output information.

[0076] The output unit 170 may include, in the report, auxiliary information of the reference information used to generate the output information. The auxiliary information of the reference information may be the same as the auxiliary information displayed by the presentation unit 130 together with the search results of the reference information.

[0077] The output unit 170 may output the report in a predetermined file format so that it can be saved. The output unit 170 may output the report in an editable form. The output unit 170 may output the edited report in a predetermined file format so that it can be saved. The file format may be selectable by the user. As an example, the output unit 170 may output output information written in Markdown notation so that it can be edited. The output unit 170 may output the Markdown notation so that it can be extended.

[0078] The output unit 170 may set a usage range for the report. The usage range may include, for example, at least one of the number of copies or the range of disclosure. The output unit 170 may determine the usage range for the report based on the usage conditions of the reference information used to generate the report.

[0079] The output unit 170 may display a plurality of reports so that they can be compared. The output unit 170 may display a plurality of reports arranged vertically or horizontally. The plurality of reports may each include output information acquired by the generation unit 150 and output information stored in the history storage unit 160. The plurality of reports may include a plurality of pieces of output information acquired by the generation unit 150 at different times.

[0080] The multiple reports may be multiple reports generated based on different information. For example, the multiple reports may be multiple reports using different base models to generate output information. For example, the multiple reports may be multiple reports using different data sources as search targets. For example, the multiple reports may be multiple reports using different user input information. For example, the multiple reports may be multiple reports using different base models, data sources, or two or more of different user input information.

[0081] The output unit 170 may output difference information between the multiple reports that are displayed for comparison. The output unit 170 may highlight the differences between the multiple reports. For example, the highlighting may be performed by changing at least one of the font type, font color, background color, and size.

[0082] The charging unit 180 charges the user for the cost of generating the report. The cost may be in currency or points. For example, charging in currency may be settled on a one-time basis, or the charged amount may be settled in a lump sum at predetermined time intervals (for example, one month). For example, charging in points may be done by consuming points purchased in advance by the user or points granted to the user in advance.

[0083] When the search unit 120 searches a data source storing reference information for which a fee is charged, or when the selection receiving unit 140 receives a selection of reference information for which a fee is charged, the billing unit 180 may charge the user for the cost of generating the report. The billing unit 180 may determine the cost to be charged to the user based on at least one of the amount and number of reference information used to generate the report. The billing unit 180 may control the search unit 120, the selection receiving unit 140, or the generation unit 150 so as not to use more reference information than the number specified in the user's usage plan.

[0084] The billing unit 180 may charge the user a fee for using the report. The billing unit 180 may determine the fee required for generating or using the report based on the conditions of use of each piece of reference information used to generate the report. Using the report may include, for example, making the report available for the user to check, downloading the report, or duplicating the report. The billing unit 180 may charge the user a fee for using the report when the user displays the report or saves the report. The billing unit 180 may determine the fee to be charged to the user based on at least one of the number of times the report is displayed or the number of times the report is saved.

[0085] The billing unit 180 may present additional information to the user regarding the generation or use of the report, including at least one of the time, cost, or computing resources required to generate or use the report.

[0086] The billing unit 180 may present additional information regarding report generation to the user before outputting the report. The billing unit 180 may present the cost required to generate the report to the user before outputting the report. For example, the billing unit 180 may present the additional information, including the cost, to the user before the search unit 120 searches a data source that stores paid reference information or before the generation unit 150 generates model input information using paid reference information.

[0087] If the billing unit 180 receives a generation instruction from the user after presenting the user with additional information regarding report generation, the billing unit 180 may notify the generation unit 150 that the generation instruction has been received. When the generation unit 150 is notified by the billing unit 180 that the generation instruction has been received, the generation unit 150 may generate model input information and send it to the generation device 30. By presenting the cost to the user before generating the report, the user can confirm the cost required for report generation before generating the report and then instruct the generation process to be executed. If the cost turns out to be higher than the user expected, the user can cancel the generation process.

[0088] After outputting the report, the billing unit 180 may present the user with additional information regarding the use of the report. For example, the billing unit 180 may present the user with additional information, including the cost, before the user views the report or before the user saves the report.

[0089] 2 is an example, and various configuration examples are possible depending on the application and purpose. The report device 10 may not include the presentation unit 130 and the selection reception unit 140. In this case, the generation unit 150 may generate model input information based on the search results of the reference information searched by the search unit 120. As an example, the generation unit 150 may generate model input information by inputting all or a predetermined number of reference information included in the search results into a template.

[0090] There may be multiple users operating terminal device 40. For example, the user who inputs output format information and user input information, the user who selects reference information, and the user who views the generated results may be the same user or different users. The terminal device that performs the operation to input output format information and user input information, the terminal device that performs the operation to select reference information, and the terminal device that displays the generated results may be the same terminal device or different terminal devices.

[0091] <Prompt template> A template for generating a prompt, which is an example of model input information, will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the template.

[0092] 3, the template 300 includes instruction information 301, source information 302, search result 303, instruction information 304, and output format 305. The instruction information 301 and 304 include information instructing the generation of a report and constraint information regarding the generation of the report. The instruction information 301 and 304 may be predetermined fixed sentences.

[0093] The source information 302 includes a placeholder {info}. The placeholder {info} contains information about the data source that stored the reference information used to generate the output information. The search results 303 include a placeholder {context}. The placeholder {context} contains information about the data source that stored the reference information used to generate the output information.

[0094] The output format 305 contains output format information. The output format 305 contains placeholders {title}, {prompt}. The placeholder {title} is filled with user-entered information entered in the report title. The placeholder {prompt} is filled with user-entered information entered in the report heading.

[0095] Template 300 includes one placeholder {context} for embedding reference information, but the template may include multiple placeholders for embedding reference information. Multiple pieces of reference information may be embedded in the multiple placeholders. Each placeholder may be embedded with at least a portion of the information included in the reference information, or may be embedded with information that has been processed from the reference information.

[0096] The generation unit 150 can generate model input information by filling in the placeholders of the template with necessary information. The generation unit 150 may generate the model input information without using a template. However, the generation unit 150 can easily generate the model input information by using a template. The template may be optimized in advance to obtain good output information. By generating a prompt using an optimized template, good output information can be stably obtained from the foundation model 35.

[0097] <User Interface> The user interface provided by the report device 10 will be described with reference to Fig. 4 to Fig. 7. As an example, the user interface of the report device 10 is displayed on a display device of the report device 10 or the terminal device 40. In this embodiment, an example in which each screen is displayed on a display device of the terminal device 40 will be described.

[0098] The user interface of the report device 10 may include, for example, a format specification screen, a condition setting screen, a selection screen, and a display screen. The format specification screen is a screen for specifying the output format of the report. The condition setting screen is a screen for setting search conditions for reference information. The selection screen is a screen for selecting reference information to be used in generating the report. The display screen is a screen for displaying the report.

[0099] ≪Format specification screen≫ 4 is a diagram showing a first example of a format designation screen. The first example of the format designation screen is an example of a format designation screen for designating the structure of a report.

[0100] As shown in FIG. 4, the format specification screen 600 has a style selection section 601, a new creation button 602, a title input section 603, a hierarchy selection section 604, a heading input section 605, a delete link 606, an add link 607, a settings button 608, and a start button 609.

[0101] The style selection section 601 displays a list of report styles that have been created. A report style is an example of output format information. A report style is information that defines the structure of a report. The report structure includes a title and a table of contents. When a user selects a report style in the style selection section 601, the title and table of contents defined in the report style are displayed on the format specification screen 600.

[0102] The new creation button 602 is a button for creating a new report style. When the user presses the new creation button 602, the title and table of contents displayed on the format specification screen 600 are initialized, and input becomes possible.

[0103] The title input section 603 is an input field for inputting the title of the report. The title input section 603 may accept input of the report title by the user. The title input section 603 may initially display a title set in the report style selected in the style selection section 601. The title input section 603 may also accept editing of the initially displayed title. The title initially displayed in the title input section 603 or the title edited by the user is embedded in the placeholder {title} of the template 300 shown in FIG. 3.

[0104] The layer selection section 604 is a selection field for selecting the layer of each item included in the table of contents. H2, H3, and H4 displayed in the layer selection section 604 are symbols indicating the heading layer. The layer selection section 604 may be added or deleted in response to a user operation.

[0105] The heading input section 605 is an input field for inputting the heading of each item included in the table of contents. The heading input section 605 may accept input of an item heading by the user. The heading input section 605 may initially display a heading set in the report style selected in the style selection section 601. The heading input section 605 may accept editing of the initially displayed heading. The heading initially displayed in the heading input section 605 or a heading edited by the user is embedded in the placeholder {prompt} of the template 300 shown in FIG. 3.

[0106] The delete link 606 is an operation section for deleting the heading input section 605. When the user operates the delete link 606, the layer selection section 604 and heading input section 605 corresponding to the delete link 606 are deleted from the format specification screen 600.

[0107] The add link 607 is an operation section for adding a heading input section 605. When the user operates the add link 607, a new layer selection section 604 and heading input section 605 are added to the format specification screen 600.

[0108] The setting button 608 is a button for setting search conditions. When the user presses the setting button 608, a condition setting screen is launched.

[0109] The start button 609 is a button for starting the generation of a report. When the user presses the start button 609, a generation request is sent to the report device 10 based on the information entered on the format specification screen 600.

[0110] 5 is a diagram showing a second example of a format designation screen, which is an example of a format designation screen for designating a file format of a report.

[0111] As shown in FIG. 5, the format designation screen 610 has a style selection section 601 , a new creation button 602 , a file format selection section 611 , an output item selection section 612 , a settings button 608 , and a start button 609 .

[0112] The file format selection section 611 displays a selection of file formats for the report. The file format options may be predetermined. The file format options may include template files created in advance for each file format. The template file may describe the structure of the report. For example, the template file may describe a title and a heading.

[0113] The output item selection section 612 displays a selection of output items for the report. The output item selections may be predetermined or may be read from a template file. The output items selected by the user in the output item selection section 612 may be included in the output format information as a table of contents for the report, for example.

[0114] <Condition setting screen> Fig. 6 is a diagram showing an example of a condition setting screen. As shown in Fig. 6, a condition setting screen 620 has a category selection section 621, a data source input section 622, a fee setting section 623, a type input section 624, a period input section 625, a delete link 626, an add link 627, and a confirm button 628.

[0115] The category selection section 621 displays a selectable category option for the data source. The category options may include, for example, inside the organization and outside the organization.

[0116] The data source input section 622 is an input field for inputting a data source. The data source input in the data source input section 622 is used to search for reference information. When the user inputs the name of a data source in the data source input section 622, the name of a predetermined data source may be completed. Note that the data source input section 622 is an input field for setting the data source for the entire report, but it may also be possible to set a data source for each item in the report.

[0117] The fee setting section 623 displays whether or not to search for paid reference information for each data source, allowing the user to select. If searching for paid reference information is selected in the fee setting section 623, reference information will be searched for from the data source, regardless of whether it is paid or free. On the other hand, if not searching for paid reference information is selected in the fee setting section 623, only free reference information will be searched from the data source. Note that the fee setting section 623 may be displayed only for data sources external to the organization.

[0118] The type input field 624 is an input field for inputting the file format of the reference information. The type input field 624 may also accept input of a file extension. When a file format is input into the type input field 624, only reference information in that file format will be searched for.

[0119] The period input field 625 is an input field for inputting the time range of the reference information. The period input field 625 may accept input of both the start and end of the time range to be searched. When a time range is input in the period input field 625, only reference information whose creation date falls within the time range will be searched.

[0120] The delete link 626 is an operation section for deleting the data source input section 622. When the user operates the delete link 626, the category selection section 621 and the data source input section 622 corresponding to the delete link 626 are deleted from the condition setting screen 620.

[0121] The add link 627 is an operation section for adding a data source input section 622. When the user operates the add link 627, a new category selection section 621 and a new data source input section 622 are added to the condition setting screen 620.

[0122] The Confirm button 628 is a button for confirming the setting of the search conditions. When the user presses the Confirm button 628, the search conditions are set based on the information entered on the condition setting screen 620. The set search conditions are included in the generation request sent to the report device 10.

[0123] On the condition setting screen 620, the information that can be set in the category selection section 621, data source input section 622, type input section 624, and period input section 625 may be controlled based on the user's authority or usage plan.

[0124] Here, an example has been described in which the condition setting screen 620 is launched by an operation on the format designation screens 600 and 610, but the condition setting screen 620 may be launched at any timing. For example, the condition setting screen 620 may be launched before the format designation screens 600 and 610 are launched. In other words, the search conditions may be set before the output format information and user input information are input.

[0125] <Selection Screen> 7 is a diagram showing an example of a selection screen 630. When the terminal device 40 receives the search results for the reference information from the report device 10, a selection screen 630 is displayed on the display device of the terminal device 40.

[0126] As shown in FIG. 7, the selection screen 630 has a list display section 631, a create button 632, and a search again button 633.

[0127] The list display unit 631 displays search results for reference information. The list display unit 631 displays reference information included in the search results in a selectable manner. The list display unit 631 displays auxiliary information for the reference information along with information indicating the reference information. The list display unit 631 may display the title, summary, data source, creation date, owner, copyright holder, and terms of use (paid or free) for each piece of reference information. The title is an example of information indicating the reference information. The summary, data source, creation date, owner, copyright holder, and terms of use are examples of auxiliary information. At least a portion of the auxiliary information for the reference information may be generated based on the foundation model 35 or another foundation model.

[0128] The list display section 631 may display link information of the reference information. The user may be able to check the entire text of the reference information by clicking the link information. The list display section 631 may display thumbnails of the reference information.

[0129] The list display unit 631 may display information indicating whether each piece of reference information is selected. The information indicating whether or not each piece of reference information is selected may be, for example, at least one of a check box, a check mark, a background color, or a text color. The background color or text color may be displayed in a different color depending on whether or not the piece of reference information is selected.

[0130] The list display unit 631 may accept input of new reference information. The new reference information may be specified by a user of the terminal device 40 displaying the selection screen 630. The selection screen 630 may accept input of new reference information on a screen component other than the list display unit 631. The input of new reference information may be accepted on a screen other than the selection screen 630, and the selection screen 630 may accept an operation to launch that screen. The list display unit 631 may accept input of auxiliary information along with the new reference information. At least a portion of the auxiliary information of the new reference information may be generated based on the base model 35 or another base model.

[0131] The list display unit 631 may have an add button for adding new reference information. The user may add new reference information by pressing the add button. The user may add reference information by simply specifying link information for the reference information. The list display unit 631 may generate and display the title, summary, etc. of the new reference information based on the information at the link destination.

[0132] A user may add new reference information by dragging and dropping a file to a specified location. In this case, the information contained in the file becomes the new reference information. The specified location may be the list display section 631 or may be newly set within the selection screen 630. As an example, reference information may be added by moving a file into the frame of the list display section 631. The drag-and-drop target is not limited to files; it may also be text, images, link information, or other objects that are generally subject to drag-and-drop operations. Even when an object other than a file is dragged and dropped, the information contained in the object or information associated with the object becomes the new reference information. A user may add new reference information by storing a file to be used as reference information in a specified directory. The specified directory may be a directory specified by the user or a directory assigned to each user by the information processing system.

[0133] New reference information added by the user may be displayed in a manner that allows it to be distinguished from other reference information in the list display area 631. For example, information indicating that new reference information has been added by the user may be displayed in the "Data Source" field. For reference information added by dragging and dropping a file, the file name may be displayed in the "Title" field.

[0134] The list display unit 631 may display information for specifying new reference information. The information for specifying reference information may be, for example, information about drag and drop, or information about a directory for storing new reference information. The information about drag and drop may include, for example, information about the destination of drag and drop (which may be the destination frame itself), or an indication (which may be an explanatory text) that addition by drag and drop is possible. The information for specifying reference information may be information for separately specifying, by drag and drop, reference information included in multiple pieces of reference information. In other words, the information for specifying reference information does not have to be information for specifying only new reference information.

[0135] The generate button 632 is a button for issuing an instruction to generate output information. When the user presses the generate button 632, a selection request indicating the reference information selected in the list display section 631 is transmitted to the report device 10.

[0136] The search again button 633 is a button for searching for reference information again. When the user presses the search again button 633, the selection screen 630 closes and the screen returns to the format specification screen 600. At this time, the search results for reference information displayed in the list display area 631 may be discarded or may be retained. If the search results for reference information are retained, the two search results may be displayed for comparison on the selection screen 630 that is displayed after the re-search.

[0137] ≪Display screen≫ 8 is a diagram showing an example of a display screen. When the terminal device 40 receives the generated result from the report device 10, a display screen 640 is displayed on the display device of the terminal device 40.

[0138] As shown in FIG. 8, the display screen 640 includes a report display section 641 , a source display section 642 , a regenerate button 643 , a reselect button 644 , and a save button 645 .

[0139] The report display unit 641 displays the report received from the report device 10. The report display unit 641 may display the report in an editable manner. For example, the report display unit 641 may have a function of a text editor.

[0140] The source display section 642 displays source information of the reference information used to generate the report. The source information may include, for example, a link to the reference information, a data source that stored the reference information, and terms of use (paid or free) of the reference information. The user may be able to view the reference information by operating the link to the reference information.

[0141] The regenerate button 643 is a button for regenerating a report. When the user presses the regenerate button 643, the display screen 640 closes and returns to the format specification screen 600. When the user returns to the format specification screen 600, the user can change the output format or user-entered information and start generating a new report.

[0142] The reselect button 644 is a button for reselecting reference information. When the user presses the reselect button 644, the display screen 640 closes and the screen returns to the selection screen 630. When the user returns to the selection screen 630, the user can change the selected reference information and start generating a new report.

[0143] The save button 645 is a button for saving a report. When the user presses the save button 645, the report displayed in the report display section 641 is stored in the storage device of the terminal device 40. When the user edits the report in the report display section 641, the edited report is saved. Whether the save button 645 can be pressed may be controlled depending on the user's authority or usage plan.

[0144] <Other screens> The user interface of the reporting device 10 may include a screen for selecting a base model to be used for generating a report from a plurality of base models. The user interface of the reporting device 10 may include a screen for selecting a data source to be used for searching for reference information from a plurality of data sources. The user interface of the reporting device 10 may include a screen for setting selectable data sources or base models.

[0145] The user interface of the report device 10 may include a screen for confirming the charges charged to the user. The user interface of the report device 10 may include a screen for settling the charges charged to the user.

[0146] <Report generation process flow> The report generation process executed by the information processing system 1000 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of the report generation process according to the first embodiment.

[0147] In step S1, the terminal device 40 transmits a generation request to the report device 10 in response to a user's operation on the format designation screen 600. The generation request includes the output format information and user input information input on the format designation screen 600. The generation request may also include search conditions input on the condition setting screen 620.

[0148] The request receiving unit 110 of the report device 10 receives a generation request from the terminal device 40. The request receiving unit 110 accepts the received generation request. The request receiving unit 110 sends the user input information and search conditions to the search unit 120. The request receiving unit 110 also sends the output format information and the user input information to the generation unit 150.

[0149] In step S2, the search unit 120 of the report device 10 receives the user-input information and search conditions from the request receiving unit 110. The search unit 120 transmits a search request to the search device 20 based on the user-input information and search conditions. The search request includes a query including the user-input information and the search conditions.

[0150] The search device 20 receives a search request from the report device 10. Based on the search request, the search device 20 searches for reference information from the data source 25. The search device 20 transmits the search results for the reference information to the report device 10. Note that the search device 20 may search for reference information using any method based on the search request.

[0151] The search unit 120 of the report device 10 receives the search results for the reference information from the search device 20. The search unit 120 sends the search results for the reference information to the presentation unit 130.

[0152] In step S3, the presentation unit 130 of the report device 10 receives the search results for the reference information from the search unit 120. The presentation unit 130 transmits the search results for the reference information to the terminal device 40.

[0153] The terminal device 40 receives the search results for the reference information from the report device 10. The terminal device 40 displays a selection screen 630 on the display device. The selection screen 630 displays the search results for the reference information.

[0154] In step S4, the terminal device 40 determines whether to search for reference information again. Specifically, if the search again button 633 on the selection screen 630 is pressed, the terminal device 40 determines to search for reference information again. On the other hand, if the generate button 632 on the selection screen 630 is pressed, the terminal device 40 determines not to search for reference information again.

[0155] If the reference information is to be searched again (YES), the terminal device 40 requests the report device 10 to search again. In response to the request from the terminal device 40, the report device 10 returns the process to step S2. On the other hand, if the reference information is not to be searched again (NO), the terminal device 40 transmits a selection request to the report device 10. The selection request includes information indicating the reference information selected on the selection screen 630.

[0156] In step S5, the selection receiving unit 140 of the report device 10 receives a selection request from the terminal device 40. The selection receiving unit 140 accepts the received selection request. The selection receiving unit 140 acquires the reference information indicated in the selection request. The selection receiving unit 140 sends the acquired reference information to the generation unit 150. The selection receiving unit 140 may also send new reference information added by the user to the generation unit 150.

[0157] The processes from step S3 to step S5 may be omitted. In this case, in step S2, the search unit 120 may send the search results of the reference information received from the search device 20 to the generation unit 150. Also, the selection receiving unit 140 may send new reference information added by the user to the generation unit 150.

[0158] In step S6, the generating unit 150 of the report device 10 receives the reference information from the selection receiving unit 140. The generating unit 150 also receives the output format information and the user input information from the request receiving unit 110.

[0159] The generation unit 150 generates model input information based on the output format information, the user input information, and the reference information. The generation unit 150 may generate the model input information by embedding the output format information, the user input information, and the reference information in a predetermined template. The generation unit 150 transmits the model input information to the generation device 30.

[0160] In step S7, the generation device 30 receives model input information from the report device 10. The generation device 30 inputs the received model input information into the base model 35. The base model 35 executes a predetermined task based on the model input information and outputs output information generated as a result. The generation device 30 transmits the output information output from the base model 35 to the report device 10.

[0161] The generation unit 150 of the report device 10 receives output information from the generation device 30. The generation unit 150 associates the received output information with information used to generate the output information and stores the information in the history storage unit 160. The generation unit 150 also sends the output information to the output unit 170.

[0162] In step S8, the output unit 170 of the report device 10 receives the output information from the generation unit 150. The output unit 170 generates a report based on the output information. The output unit 170 transmits the generation result including the generated report to the terminal device 40. The report may include auxiliary information for the reference information.

[0163] The terminal device 40 receives the generated results from the report device 10. The terminal device 40 displays a display screen 640 on a display device. A report included in the generated results is displayed on the display screen 640. Auxiliary information included in the report may also be displayed on the display screen 640.

[0164] In step S9, the terminal device 40 determines whether or not to reselect the reference information. Specifically, if the reselection button 644 on the display screen 640 is pressed, the terminal device 40 determines that the reference information will be reselected. On the other hand, if the reselection button 644 on the display screen 640 is not pressed, the terminal device 40 determines that the reference information will not be reselected.

[0165] If the reference information is to be reselected (YES), the terminal device 40 displays the selection screen 630 again. The terminal device 40 transmits a selection request to the report device 10 in response to a user's operation on the selection screen 630. When the report device 10 receives the selection request from the terminal device 40, it returns the process to step S5. The terminal device 40 returns the process to step S2 and displays the condition setting screen 620, whereby the search conditions may be changed and the reference conditions may be searched again. On the other hand, if the reference information is not to be reselected (NO), the terminal device 40 proceeds to step S10.

[0166] In step S10, it is determined whether or not to regenerate the report. Specifically, if the regeneration button 643 on the display screen 640 is pressed, the terminal device 40 determines that the report will be regenerated. On the other hand, if the regeneration button 643 on the display screen 640 is not pressed, the terminal device 40 determines that the report will not be regenerated.

[0167] If the report is to be regenerated (YES), the terminal device 40 displays the format designation screen 600 again. The terminal device 40 transmits a generation request to the report device 10 in response to a user's operation on the format designation screen 600. When the report device 10 receives the generation request from the terminal device 40, it returns the process to step S1. On the other hand, if the report is not to be regenerated (NO), the terminal device 40 ends the report generation process.

[0168] <Modification> The report generation process may be performed in the following manner.

[0169] (1) The user specifies information about the output format. The user may select one output format from multiple output formats. The output format may be predetermined. The user may specify information about the output format through text editing, etc.

[0170] (2) The user specifies one or more pieces of reference information to be used in generating output information. Note that in this modification, the search for reference information by the search unit 120 may be omitted. The user may specify one or more pieces of reference information through a drag-and-drop operation or the like. The method by which the user specifies one or more pieces of reference information may be the method described in the input acceptance of new reference information.

[0171] (3) The generation unit 150 generates input information for the machine learning model based on the information about the output format and one or more pieces of reference information specified by the user. The generation unit 150 inputs the generated input information into the machine learning model to generate output information and presents it to the user.

[0172] (4) The output unit 170 returns to the process of (1) or (2) and generates different output information. If the user wants to further improve the output information, the user may return to the process of (1) or (2). The output unit 170 may generate difference information between multiple reports and present it to the user. Steps (1) to (4) may be repeated until specified by the user or until a predetermined number of times has been reached.

[0173] (5) Finally, the output information selected by the user is output in a predetermined output format (e.g., PDF file, etc.). The output format may be specified by the user in (1).

[0174] [Second embodiment] In the first embodiment, a configuration was described in which output format information for all items included in a report is included in the model input information, and output information indicating the entire report is generated from a foundation model. In the second embodiment, a configuration is described in which output format information for each item included in a report is included in the model input information, output information for each item is generated based on the foundation model, and output information indicating the entire report is generated by integrating the output information for each item.

[0175] <Report generation process flow> The report generation process according to this embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of the report generation process according to the second embodiment. The report generation process according to this embodiment will be described below, focusing on the differences from the first embodiment.

[0176] In step S11, the request receiving unit 110 of the report device 10 receives a generation request from the terminal device 40. The output format information and user input information included in the generation request include information about a plurality of items to be included in the report.

[0177] The generation request may include search conditions. The search conditions may include at least one of search conditions for the entire report or search conditions for each item to be included in the report. The search conditions included in the generation request may be set by operating the condition setting screen 620.

[0178] In step S12, the search unit 120 of the report device 10 selects one item from the items included in the report. The items included in the report may be predetermined or may not be predetermined. If the items included in the report are not predetermined, the user may specify the content of the headings, the order of the headings, or the hierarchical information of the headings by text input.

[0179] The search unit 120 may select any item included in the report. As an example, the search unit 120 may select the first item in the report. The first item in the report may be, for example, the title of the report. The search unit 120 obtains user-input information and search conditions related to the selected item from the generation request.

[0180] The search unit 120 transmits a search request to the search device 20 based on the acquired user-input information and search conditions. When the search conditions acquired from the generation request include both search conditions related to the entire report and search conditions related to items, the search unit 120 may generate a search request based on the search conditions related to the items. In this case, the search unit 120 may generate a search request based on both the search conditions related to the entire report and the search conditions related to the items. When a search is performed based on both the search conditions related to the entire report and the search conditions related to the items, the list display section 631 of the selection screen 630 may display information indicating which search conditions each piece of reference information was searched for.

[0181] The search device 20 receives a search request from the report device 10. Based on the search request, the search device 20 searches for reference information from the data source 25 specified in the search conditions. The search device 20 transmits the search results for the reference information to the report device 10. The search unit 120 of the report device 10 receives the search results for the reference information from the search device 20. The search unit 120 sends the search results for the reference information to the presentation unit 130.

[0182] The processes from step S13 to step S15 are the same as steps S3 to S5 in the first embodiment. Note that, like the first embodiment, the processes from step S13 to step S15 may be omitted.

[0183] In step S16, the generation unit 150 of the report device 10 generates model input information based on the output format information and user input information related to the items acquired in step S12, and the reference information acquired in step S15 (or the reference information included in the search results acquired in step S12). That is, the generation unit 150 generates model input information that instructs the generation of output information for each item included in the report. The generation unit 150 transmits the generated model input information to the generation device 30.

[0184] In step S17, the generation device 30 inputs the model input information received from the report device 10 to the base model 35. The base model 35 executes a predetermined task based on the model input information and outputs the resulting generated output information. The generation device 30 transmits the output information output from the base model 35 to the report device 10.

[0185] The generating device 30 may generate output information by inputting model input information to a different base model for each item. The base model to be input for each item may be determined based on instructions from the user.

[0186] The generation unit 150 of the report device 10 receives output information from the generation device 30. The output information received here is output information corresponding to the item selected in step S12. The report device 10 returns the process to step S12. When the process returns to step S12, the search unit 120 selects any item included in the report for which output information has not been generated. As an example, the search unit 120 may select items for which output information has not been generated, starting from the top of the report. The search unit 120 may select an item specified by the user.

[0187] Thereafter, the report device 10 executes the processes from step S12 to step S17 again. In this way, the report device 10 repeatedly executes the search for reference information and the generation of output information until it acquires output information for all items included in the report. When the generation unit 150 acquires output information for all items included in the report, it sends the output information for each item acquired in step S17 to the output unit 170.

[0188] In step S18, the output unit 170 of the report device 10 receives the output information for each item from the generation unit 150. The output unit 170 generates a report based on the output information for each item. The output unit 170 transmits the generation result including the generated report to the terminal device 40. The report may include auxiliary information of the reference information used to generate the output information for each item.

[0189] The output unit 170 may generate a report by integrating the output information for each item. As an example, the output unit 170 may generate a report by combining the output information for each item in the order acquired by the generation unit 150. Furthermore, the output unit 170 may generate a report by combining the output information for each item in the order of the items indicated in the output format information.

[0190] As an example, the output unit 170 may integrate the output information for each item based on the foundation model 35. Specifically, the output unit 170 may generate model input information based on configuration information of the items included in the report and output information for each item, and cause the foundation model 35 to generate a report based on the model input information. The configuration information is information indicating the configuration of the items included in the report. As an example, the configuration information may be information listing the titles and headings included in the report. The configuration information may be output format information, or may be information obtained by processing the output format information. The output unit 170 may integrate the output information for each item based on another foundation model. The other foundation model may be the foundation model used to generate the output information for each item, or may be a foundation model different from the foundation model.

[0191] The output unit 170 may generate model input information including configuration information of items included in the report, a report combining output information for each item, and instruction information instructing formatting of the report, and may cause the base model 35 to generate the report based on the model input information. The instruction information may include constraint information instructing that the output information for each item be maintained.

[0192] All of the configurations related to the information processing system 1000 according to the first embodiment are applicable to the information processing system 1000 according to the second embodiment. Similarly, all of the configurations related to the information processing system 1000 according to the second embodiment are applicable to the information processing system 1000 according to the first embodiment.

[0193] <Summary> As is clear from the above explanation, an information processing system according to one embodiment of the present disclosure acquires information regarding the output format, searches for multiple pieces of reference information based on a search request, acquires one or more pieces of reference information to be used for generating output information based on the search results, generates input information for a machine learning model based on the information regarding the output format and the one or more pieces of reference information, and generates output information by inputting the input information into the machine learning model.

[0194] The information processing system may output information about the search results and, based on a user's selection, acquire one or more pieces of reference information. The information about the search results may include at least one of the data source, link information, at least a portion of the information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, or terms of use of the reference information. Based on a user's instruction, the information processing system may acquire reference information other than the plurality of reference information as one or more pieces of reference information to be used in generating the output information.

[0195] The information about the output format may include information about one or more output formats selected from a plurality of output formats. The information about the output format may include information about the structure of the output information. The information about the structure may include information about one or more items to be included in the output information. The information about the one or more items may include information about the names of the items to be included in the output information and the hierarchy of the items.

[0196] The search request may include at least one of search conditions or a query generated based on user input information. The search conditions may include at least one of the data source, type, creation date, or usage conditions to be searched. The information processing system may set the search conditions based on user information. The user information may include at least one of the user's authority, attribute, affiliation, job title, or usage plan.

[0197] The information processing system may acquire one or more other reference information to be used in generating the second output information based on the search result, generate second input information based on the information on the output format and the one or more other reference information, and generate the second output information by inputting the second input information to a machine learning model. The information processing system may output difference information between the output information and the second output information.

[0198] The information processing system may search for other multiple pieces of reference information based on another search request, acquire one or more other pieces of reference information to be used for generating second output information based on a result of the search for the other multiple reference information, generate second input information for the machine learning model based on information about the output format and the one or more other reference information, and generate the second output information by inputting the second input information to the machine learning model. The information processing system may output difference information between the output information and the second output information.

[0199] The information processing system may output at least one of the data source, at least a portion of the information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, or terms of use of one or more reference information together with the output information. The information processing system may output additional information regarding the output information before generating the output information. The additional information may include at least one of the time, cost, or computing resources required to generate the output information.

[0200] The information processing system may output the usage conditions. The usage conditions may include information indicating whether or not the use of the reference information is chargeable. The information processing system may determine the cost required for generating or using the output information based on at least the information indicating whether or not each of the one or more pieces of reference information is chargeable. The information processing system may output the determined cost before executing the output information generation process. After outputting the determined cost, if the information processing system receives a generation instruction from a user, it may generate the output information by inputting the input information into a machine learning model.

[0201] As a result, according to an embodiment of the present disclosure, a technique that allows desired output information to be acquired can be provided. In one aspect, according to an embodiment, a report written in a desired output format can be easily generated.

[0202] [Hardware configuration of information processing device] Some or all of the devices (report device 10, search device 20, generation device 30, and terminal device 40) in the above-described embodiments may be configured as hardware, or may be configured as software (program) information processing executed by a CPU (Central Processing Unit), GPU (Graphics Processing Unit), or the like. In the case of software information processing, software that realizes at least some of the functions of each device in the above-described embodiments may be stored on a non-transitory storage medium (non-transitory computer-readable medium) such as a CD-ROM (Compact Disc-Read Only Memory) or a USB (Universal Serial Bus) memory, and the software information processing may be executed by loading the software into a computer. The software may also be downloaded via a communication network. Furthermore, all or part of the software processing may be implemented in a circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array), thereby allowing the software information processing to be executed by hardware.

[0203] The storage medium that stores the software may be a removable medium such as an optical disk, or a fixed medium such as a hard disk, memory, etc. The storage medium may be provided inside the computer (main storage device, auxiliary storage device, etc.) or outside the computer.

[0204] 11 is a block diagram showing an example of the hardware configuration of each device (report device 10, search device 20, generation device 30, and terminal device 40) in the above-described embodiment. Each device may be realized as a computer 7 including, for example, a processor 71, a main storage device 72 (memory), an auxiliary storage device 73 (memory), a network interface 74, and a device interface 75, which are connected via a bus 76.

[0205] Although the computer 7 in FIG. 11 includes one of each component, it may also include multiple of the same component. Also, while FIG. 11 shows one computer 7, the software may be installed on multiple computers, and each of the multiple computers may execute the same or different parts of the software. In this case, a distributed computing configuration may be used in which each computer communicates with the other computers via a network interface 74 or the like to execute the processing. That is, each device in the above-described embodiment (report device 10, search device 20, generation device 30, and terminal device 40) may be configured as a system in which one or more computers execute instructions stored in one or more storage devices to realize its functions. Furthermore, the system may be configured such that information sent from a terminal is processed by one or more computers located on a cloud, and the processing results are sent to the terminal.

[0206] The various calculations of each device (report device 10, search device 20, generation device 30, and terminal device 40) in the above-described embodiments may be executed in parallel using one or more processors, or using multiple computers via a network. Furthermore, the various calculations may be distributed to multiple processing cores within a processor and executed in parallel. Furthermore, some or all of the processes, means, etc. of the present disclosure may be realized by at least one of a processor and a storage device provided on a cloud that can communicate with computer 7 via a network. Thus, each device in the above-described embodiments may be implemented in the form of parallel computing using one or more computers.

[0207] The processor 71 may be an electronic circuit (processing circuit, processing circuitry, CPU, GPU, FPGA, ASIC, etc.) that at least controls a computer or performs calculations. The processor 71 may be a general-purpose processor, a dedicated processing circuit designed to perform a specific calculation, or a semiconductor device that includes both a general-purpose processor and a dedicated processing circuit. The processor 71 may also include an optical circuit or a calculation function based on quantum computing.

[0208] The processor 71 may perform arithmetic processing based on data or software input from each device or the like configured inside the computer 7, and may output the calculation results or control signals to each device or the like. The processor 71 may control each component constituting the computer 7 by executing the OS (Operating System) of the computer 7, applications, etc.

[0209] Each device in the above-described embodiment (report device 10, search device 20, generation device 30, and terminal device 40) may be realized by one or more processors 71. Here, the processor 71 may refer to one or more electronic circuits arranged on one chip, or may refer to one or more electronic circuits arranged on two or more chips or two or more devices. When multiple electronic circuits are used, the electronic circuits may communicate with each other via wire or wirelessly.

[0210] The main memory device 72 may store instructions executed by the processor 71, various data, etc., and information stored in the main memory device 72 may be read by the processor 71. The auxiliary memory device 73 is a memory device other than the main memory device 72. Note that these memory devices refer to any electronic component capable of storing electronic information, and may be semiconductor memory. The semiconductor memory may be either volatile memory or non-volatile memory. The memory devices for saving various data, etc. in each device (report device 10, search device 20, generation device 30, and terminal device 40) in the above-described embodiments may be realized by the main memory device 72 or the auxiliary memory device 73, or may be realized by an internal memory built into the processor 71. For example, each memory unit in the above-described embodiments may be realized by the main memory device 72 or the auxiliary memory device 73.

[0211] When each device (report device 10, search device 20, generation device 30, and terminal device 40) in the above-described embodiments is configured with at least one storage device (memory) and at least one processor connected (coupled) to this at least one storage device, at least one processor may be connected to one storage device. Also, at least one storage device may be connected to one processor. Also, a configuration in which at least one processor out of multiple processors is connected to at least one storage device out of multiple storage devices may be included. Also, this configuration may be realized by storage devices and processors included in multiple computers. Furthermore, a configuration in which a storage device is integrated with a processor (for example, a cache memory including an L1 cache and an L2 cache) may be included.

[0212] The network interface 74 is an interface for connecting to the communication network 8 wirelessly or via a wire. The network interface 74 may be an appropriate interface, such as one that conforms to an existing communication standard. Information may be exchanged with an external device 9A connected via the communication network 8 via the network interface 74. The communication network 8 may be any one of a WAN (Wide Area Network), a LAN (Local Area Network), a PAN (Personal Area Network), etc., or a combination thereof, as long as information is exchanged between the computer 7 and the external device 9A. An example of a WAN is the Internet, an example of a LAN is IEEE802.11 or Ethernet (registered trademark), and an example of a PAN is Bluetooth (registered trademark) or NFC (Near Field Communication), etc.

[0213] The device interface 75 is an interface such as a USB that directly connects to the external device 9B.

[0214] The external device 9A is a device connected to the computer 7 via a network. The external device 9B is a device connected directly to the computer 7.

[0215] For example, the external device 9A or the external device 9B may be an input device. The input device may be a device such as a camera, a microphone, a motion capture device, various sensors, a keyboard, a mouse, or a touch panel, and provides acquired information to the computer 7. Alternatively, the external device 9A or the external device 9B may be a device equipped with an input unit, a memory, and a processor, such as a personal computer, a tablet terminal, or a smartphone.

[0216] Furthermore, the external device 9A or the external device 9B may be, for example, an output device. The output device may be, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) panel, or a speaker that outputs sound or the like. Alternatively, the output device may be a device including an output unit, a memory, and a processor, such as a personal computer, a tablet terminal, or a smartphone.

[0217] Furthermore, the external device 9A or the external device 9B may be a storage device (memory). For example, the external device 9A may be a network storage or the like, and the external device 9B may be a storage such as an HDD.

[0218] Furthermore, the external device 9A or the external device 9B may be a device having some of the functions of the components of each device (the report device 10, the search device 20, the generation device 30, and the terminal device 40) in the above-described embodiments. In other words, the computer 7 may transmit some or all of the processing results to the external device 9A or the external device 9B, or may receive some or all of the processing results from the external device 9A or the external device 9B.

[0219] In this specification (including the claims), when the expression "at least one of a, b, and c" or "at least one of a, b, or c" (including similar expressions) is used, it includes any of a, b, c, ab, ac, bc, or abc. It may also include multiple instances of any element, such as aa, abb, aabbcc, etc. Furthermore, it also includes the addition of elements other than the enumerated elements (a, b, and c), such as having d, as in abcd.

[0220] In this specification (including claims), when expressions such as "using data as input / based on / according to / in response to data" (including similar expressions) are used, unless otherwise specified, this includes cases where the data itself is used, or where data that has been processed in some way (e.g., data with noise added, normalized data, features extracted from data, intermediate representations of data, etc.) is used. Furthermore, when a statement is made that a result is obtained "using data as input / based on / according to / in response to data" (including similar expressions), this includes cases where the result is obtained based solely on the data, or where the result is influenced by other data, factors, conditions, and / or states other than the data itself, unless otherwise specified. Furthermore, when a statement is made that "data is output" (including similar expressions), this includes cases where the data itself is used as output, or where data that has been processed in some way (e.g., data with noise added, normalized data, features extracted from data, intermediate representations of various data, etc.) is used as output, unless otherwise specified.

[0221] When the terms "connected" and "coupled" are used in this specification (including the claims), they are intended as open-ended terms that encompass any of direct connection / coupling, indirect connection / coupling, electrically connection / coupling, communicatively connection / coupling, functionally connection / coupling, and physically connection / coupling. These terms should be interpreted appropriately according to the context in which they are used, but any form of connection / coupling that is not intentionally or naturally excluded should be interpreted as being included in these terms without limitation.

[0222] In this specification (including the claims), the expression "A configured to B" may include the physical structure of element A having a configuration capable of performing operation B, and the permanent or temporary setting / configuration of element A being configured / set to actually perform operation B. For example, if element A is a general-purpose processor, it is sufficient that the processor has a hardware configuration capable of performing operation B, and is configured to actually perform operation B by setting a permanent or temporary program (instruction). Also, if element A is a dedicated processor, dedicated arithmetic circuit, etc., it is sufficient that the circuit structure, etc. of the processor is implemented to actually perform operation B, regardless of whether control instructions and data are actually attached.

[0223] Whenever words implying containing or possessing (e.g., "comprising / including," "having," etc.) are used in this specification (including the claims), they are intended to be open-ended terms that include the inclusion or possession of things other than the object designated by the object of the term. When the object of such words implying containing or possessing does not specify a quantity or suggests a singular number (e.g., expressions using the articles "a" or "an"), the expression should be construed as not being limited to a specific number.

[0224] In this specification (including the claims), even if expressions such as "one or more" and "at least one" are used in some places and expressions that do not specify a quantity or that imply a singular number (expressions using the articles "a" or "an") are used in other places, the latter expressions are not intended to mean "one." In general, expressions that do not specify a quantity or that imply a singular number (expressions using the articles "a" or "an") should be interpreted as not necessarily being limited to a specific number.

[0225] In this specification, when a particular advantage / result is described as being obtained with respect to a particular configuration of an embodiment, it should be understood that the same advantage / result can also be obtained with one or more other embodiments having the same configuration, unless otherwise stated. However, it should be understood that the presence or absence of the effect generally depends on various factors, conditions, and / or circumstances, and that the effect is not necessarily obtained with the configuration. The effect is merely obtained by the configuration described in the embodiment when various factors, conditions, and / or circumstances are satisfied, and the effect does not necessarily occur in a claimed invention that defines the same or a similar configuration.

[0226] In this specification (including claims), when multiple pieces of hardware perform a predetermined process, the pieces of hardware may cooperate to perform the predetermined process, or some of the hardware may perform all of the predetermined process. Furthermore, some of the hardware may perform part of the predetermined process, and other hardware may perform the rest of the predetermined process. In this specification (including claims), when an expression such as "one or more pieces of hardware perform a first process, and the one or more pieces of hardware perform a second process" (including similar expressions) is used, the hardware performing the first process and the hardware performing the second process may be the same or different. In other words, it is sufficient that the hardware performing the first process and the hardware performing the second process are included in the one or more pieces of hardware. Note that hardware may include electronic circuits, devices including electronic circuits, etc.

[0227] In this specification (including the claims), when multiple storage devices (memories) store data, each of the multiple storage devices may store only a portion of the data, or may store the entire data. Also, a configuration in which only some of the multiple storage devices store data may be included.

[0228] In this specification (including the claims), terms such as "first," "second," etc. are used merely as a way of distinguishing between two or more elements, and are not necessarily intended to impose technical meanings such as temporal aspect, spatial aspect, sequence, quantity, etc. Thus, for example, a reference to a first element and a second element does not necessarily mean that only two elements can be employed therein, that the first element must precede the second element, that the first element must be present in order for the second element to be present, etc.

[0229] Although the embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the individual embodiments described above. Various additions, modifications, substitutions, partial deletions, etc. are possible within the scope of the conceptual idea and spirit of the present invention, which is derived from the content defined in the claims and their equivalents. For example, when numerical values ​​or formulas are used in the above-described embodiments, they are shown for illustrative purposes and do not limit the scope of the present disclosure. Furthermore, the order of each operation shown in the embodiments is also illustrative and does not limit the scope of the present disclosure.

[0230] The disclosed technology may take the following forms as described below.

[0231] (Appendix 1) At least one memory; at least one processor; The at least one processor: Get information about the output format, Retrieving multiple references based on the search request; obtaining one or more pieces of reference information to be used in generating output information based on the results of the search; generating input information for a machine learning model based on the information about the output format and the one or more reference information; generating the output information by inputting the input information into the machine learning model; Information processing system.

[0232] (Appendix 2) The at least one processor: outputting information relating to the results of said search; obtaining said one or more references based on a selection made by the user; 10. The information processing system of claim 1.

[0233] (Appendix 3) The information about the search results includes at least one of the data source, link information, at least a part of the information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, or terms of use of the reference information; 10. The information processing system of claim 2.

[0234] (Appendix 4) The at least one processor: acquiring, based on an instruction from the user, reference information other than the plurality of pieces of reference information as the one or more pieces of reference information to be used in generating the output information; 10. The information processing system of claim 3.

[0235] (Appendix 5) the information about the output format includes information about one or more output formats selected from a plurality of output formats; 5. An information processing system according to any one of appendices 1 to 4.

[0236] (Appendix 6) the information about the output format includes information about a structure of the output information; 6. The information processing system according to claim 5.

[0237] (Appendix 7) The information about the structure includes information about one or more items to be included in the output information. 7. The information processing system according to claim 6.

[0238] (Appendix 8) The information about the one or more items includes information about the item names and hierarchical structure of the items to be included in the output information. 8. The information processing system of claim 7.

[0239] (Appendix 9) The search request includes at least one of a search condition or a query generated based on user input information. 9. An information processing system according to any one of appendices 1 to 8.

[0240] (Appendix 10) The search conditions include at least one of the data source, type, creation date, or usage conditions to be searched. 10. The information processing system of claim 9.

[0241] (Appendix 11) The at least one processor: setting the search conditions based on user information; 11. The information processing system according to claim 9 or 10.

[0242] (Appendix 12) The user information includes at least one of the user's authority, attribute, affiliation, position, or usage plan. 12. The information processing system of claim 11.

[0243] (Appendix 13) The at least one processor: obtaining one or more other pieces of reference information to be used in generating second output information based on a result of the search; generating second input information based on the information about the output format and the one or more other reference information; generating the second output information by inputting the second input information into the machine learning model; 13. An information processing system according to any one of appendices 1 to 12.

[0244] (Appendix 14) The at least one processor: outputting difference information between the output information and the second output information; 14. The information processing system of claim 13.

[0245] (Appendix 15) The at least one processor: Retrieving other references based on other search requests; acquiring one or more other pieces of reference information to be used in generating second output information based on a result of searching the other plurality of pieces of reference information; generating second input information for the machine learning model based on the information about the output format and the one or more other reference information; generating the second output information by inputting the second input information into the machine learning model; 15. An information processing system according to any one of appendices 1 to 14.

[0246] (Appendix 16) The at least one processor: outputting difference information between the output information and the second output information; 16. The information processing system of claim 15.

[0247] (Appendix 17) The at least one processor: outputting at least one of a data source, at least a part of information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, or a usage condition of the one or more reference information together with the output information; 17. An information processing system according to any one of appendices 1 to 16.

[0248] (Appendix 18) The at least one processor: outputting additional information related to the output information before generating the output information; 18. An information processing system according to any one of appendices 1 to 17.

[0249] (Appendix 19) the additional information includes at least one of the time, cost, or computational resources required to generate the output information; 19. The information processing system of claim 18.

[0250] (Appendix 20) The at least one processor: outputting the terms of use; The usage conditions include information indicating whether or not the use of the reference information is chargeable. 5. The information processing system according to claim 3 or 4.

[0251] (Appendix 21) The at least one processor: determining a cost required for generating or using the output information based on at least information indicating whether each of the one or more pieces of reference information is chargeable; 21. The information processing system of claim 20.

[0252] (Appendix 22) The at least one processor: outputting the determined cost before executing the process of generating the output information; 22. The information processing system of claim 21.

[0253] (Appendix 23) The at least one processor: After outputting the determined cost, if a generation instruction is received from a user, the input information is input into the machine learning model to generate the output information. 23. The information processing system of claim 22.

[0254] (Appendix 24) At least one memory; at least one processor; The at least one processor: Displaying information for specifying an output format on a display device, displaying the results of searching the plurality of reference information based on the search request on the display device; displaying information for selecting one or more pieces of reference information from the plurality of pieces of reference information on the display device; displaying, on the display device, output information generated by inputting input information to the machine learning model generated based on information regarding the specified output format and the one or more selected reference information into the machine learning model; Information processing device.

[0255] (Appendix 25) The at least one processor: As a result of searching the plurality of pieces of reference information, at least one of a data source, link information, at least a part of information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, and a usage condition of the reference information is displayed on the display device. 25. The information processing device according to claim 24.

[0256] (Appendix 26) The at least one processor: displaying, on the display device, information for specifying reference information other than the plurality of pieces of reference information; 26. The information processing device according to claim 25.

[0257] (Appendix 27) The at least one processor: displaying information for selecting the output format from a plurality of output formats on the display device; 27. An information processing device according to any one of appendices 24 to 26.

[0258] (Appendix 28) The at least one processor: displaying, together with the output information, at least one of a data source, at least a part of information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, or a usage condition of the one or more reference information on the display device; 28. An information processing device according to any one of appendices 24 to 27.

[0259] (Appendix 29) The at least one processor: and displaying, on the display device, information indicating whether or not each of the plurality of pieces of reference information has been selected, as information for selecting one or more pieces of reference information from the plurality of pieces of reference information. 29. An information processing device according to any one of appendices 24 to 28.

[0260] (Appendix 30) The at least one processor: displaying, on the display device, information relating to drag and drop as information for specifying reference information other than the plurality of reference information; 27. The information processing device according to claim 26.

[0261] (Appendix 31) At least one memory; at least one processor; The at least one processor: Obtain a first search request for a first item; retrieving a plurality of first reference information based on the first search request; obtaining one or more pieces of first reference information to be used in generating first output information based on a result of the search based on the first search request; generating first input information for a machine learning model based on the information about the first item and the one or more first reference information; generating the first output information by inputting the first input information into the machine learning model; getting a second search request for a second item; retrieving a plurality of second reference information based on the second search request; obtaining one or more pieces of second reference information to be used in generating second output information based on a result of the search based on the second search request; generating second input information for the machine learning model based on information about a second item and the one or more second reference information; generating the second output information by inputting the second input information into the machine learning model; generating third output information based on the first output information and the second output information; Information processing system.

[0262] (Appendix 32) The at least one processor: outputting information regarding the results of the search based on the first search request; obtaining the one or more first references based on a selection by a user; outputting information regarding the results of the search based on the second search request; obtaining the one or more second references based on a selection by the user; 32. The information processing system of claim 31.

[0263] (Appendix 33) The at least one processor: generating third input information for the machine learning model based on the first output information and the second output information; generating the third output information by inputting the third input information into the machine learning model; 33. The information processing system according to claim 31 or 32.

[0264] (Appendix 34) At least one processor Get information about the output format, Retrieving multiple references based on the search request; obtaining one or more pieces of reference information to be used in generating output information based on the results of the search; generating input information for a machine learning model based on the information about the output format and the one or more reference information; generating the output information by inputting the input information into the machine learning model; An information processing method that performs processing.

[0265] (Appendix 35) At least one processor Displaying information for specifying an output format on a display device, displaying the results of searching the plurality of reference information based on the search request on the display device; displaying information for selecting one or more pieces of reference information from the plurality of pieces of reference information on the display device; displaying, on the display device, output information generated by inputting input information to the machine learning model generated based on information regarding the specified output format and the one or more selected reference information into the machine learning model; An information processing method that performs processing.

[0266] (Appendix 36) At least one processor Obtain a first search request for a first item; retrieving a plurality of first reference information based on the first search request; obtaining one or more pieces of first reference information to be used in generating first output information based on a result of the search based on the first search request; generating first input information for a machine learning model based on the information about the first item and the one or more first reference information; generating the first output information by inputting the first input information into the machine learning model; getting a second search request for a second item; retrieving a plurality of second reference information based on the second search request; obtaining one or more pieces of second reference information to be used in generating second output information based on a result of the search based on the second search request; generating second input information for the machine learning model based on information about a second item and the one or more second reference information; generating the second output information by inputting the second input information into the machine learning model; generating third output information based on the first output information and the second output information; An information processing method that performs processing.

[0267] (Appendix 37) At least one processor has Get information about the output format, Retrieving multiple references based on the search request; obtaining one or more pieces of reference information to be used in generating output information based on the results of the search; generating input information for a machine learning model based on the information about the output format and the one or more reference information; generating the output information by inputting the input information into the machine learning model; A program for executing a process.

[0268] (Appendix 38) At least one processor has Displaying information for specifying an output format on a display device, displaying the results of searching the plurality of reference information based on the search request on the display device; displaying information for selecting one or more pieces of reference information from the plurality of pieces of reference information on the display device; displaying, on the display device, output information generated by inputting input information to the machine learning model generated based on information regarding the specified output format and the one or more selected reference information into the machine learning model; A program for executing a process.

[0269] (Appendix 39) At least one processor has Obtain a first search request for a first item; retrieving a plurality of first reference information based on the first search request; obtaining one or more pieces of first reference information to be used in generating first output information based on a result of the search based on the first search request; generating first input information for a machine learning model based on the information about the first item and the one or more first reference information; generating the first output information by inputting the first input information into the machine learning model; getting a second search request for a second item; retrieving a plurality of second reference information based on the second search request; obtaining one or more pieces of second reference information to be used in generating second output information based on a result of the search based on the second search request; generating second input information for the machine learning model based on information about a second item and the one or more second reference information; generating the second output information by inputting the second input information into the machine learning model; generating third output information based on the first output information and the second output information; A program for executing a process. [Explanation of symbols]

[0270] 10: Reporting device 20: Search device 25: Data Source 30:Generation device 35: Base model 40: Terminal device 110: Request reception unit 120: Search section 130: Presentation part 140: Selection reception section 150: Generation part 160: History memory unit 170: Output section 180: Billing Department 1000: Information Processing Systems

Claims

1. at least one memory; at least one processor; The at least one processor Get information about the output format, Retrieving multiple references based on the search request; obtaining one or more pieces of reference information to be used in generating output information based on the results of the search; generating input information for a machine learning model based on the information about the output format and the one or more reference information; generating the output information by inputting the input information into the machine learning model; Information processing system.

2. The at least one processor outputting information relating to the results of said search; obtaining the one or more references based on a user selection; The information processing system according to claim 1 .

3. The information about the search results includes at least one of the data source, link information, at least a part of the information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, or terms of use of the reference information. The information processing system according to claim 2 .

4. The at least one processor acquiring, based on an instruction from the user, reference information other than the plurality of pieces of reference information as the one or more pieces of reference information to be used in generating the output information; The information processing system according to claim 3 .

5. the information about the output format includes information about one or more output formats selected from a plurality of output formats; 5. The information processing system according to claim 1.

6. the information about the output format includes information about a structure of the output information; The information processing system according to claim 5 .

7. The information about the structure includes information about one or more items to be included in the output information. The information processing system according to claim 6.

8. The information about the one or more items includes information about the item names, the order of the items, and the hierarchy of the items to be included in the output information. The information processing system according to claim 7 .

9. The search request includes at least one of a search condition or a query generated based on user input information.

5. The information processing system according to claim 1.

10. The search conditions include at least one of the data source, type, creation date, and usage conditions to be searched. The information processing system according to claim 9 .

11. The at least one processor setting the search conditions based on user information; The information processing system according to claim 9 .

12. The user information includes at least one of the user's authority, attribute, affiliation, position, or usage plan. The information processing system according to claim 11.

13. The at least one processor obtaining one or more other pieces of reference information to be used in generating second output information based on the search results; generating second input information based on the information about the output format and the one or more other reference information; generating the second output information by inputting the second input information into the machine learning model; 5. The information processing system according to claim 1.

14. The at least one processor outputting difference information between the output information and the second output information; The information processing system according to claim 13.

15. The at least one processor Retrieving other references based on other search requests; acquiring one or more other pieces of reference information to be used in generating second output information based on a result of searching the other plurality of pieces of reference information; generating second input information for the machine learning model based on the information about the output format and the one or more other reference information; generating the second output information by inputting the second input information into the machine learning model; 5. The information processing system according to claim 1.

16. The at least one processor outputting difference information between the output information and the second output information; 16. The information processing system according to claim 15.

17. The at least one processor outputting at least one of a data source, at least a part of information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, or a usage condition of the one or more reference information together with the output information; 5. The information processing system according to claim 1.

18. The at least one processor outputting additional information related to the output information before generating the output information; 5. The information processing system according to claim 1.

19. the additional information includes at least one of the time, cost, or computational resources required to generate the output information; 19. The information processing system according to claim 18.

20. The at least one processor outputting the terms of use; The usage conditions include information indicating whether or not the use of the reference information is chargeable. The information processing system according to claim 3 .

21. The at least one processor determining a cost required for generating or using the output information based on at least information indicating whether each of the one or more pieces of reference information is chargeable; 21. The information processing system according to claim 20.

22. The at least one processor outputting the determined cost before executing the process of generating the output information; 22. The information processing system according to claim 21.

23. The at least one processor After outputting the determined cost, if a generation instruction is received from the user, the input information is input into the machine learning model to generate the output information.

23. The information processing system according to claim 22.

24. at least one memory; at least one processor; The at least one processor Displaying information for specifying an output format on a display device, displaying the results of searching the plurality of pieces of reference information based on the search request on the display device; displaying information for selecting one or more pieces of reference information from the plurality of pieces of reference information on the display device; displaying, on the display device, output information generated by inputting input information to the machine learning model generated based on information regarding the specified output format and the one or more selected reference information into the machine learning model; Information processing device.

25. The at least one processor As a result of searching the plurality of pieces of reference information, at least one of a data source, link information, at least a part of information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, and a usage condition of the reference information is displayed on the display device. The information processing device according to claim 24.

26. The at least one processor displaying, on the display device, information for specifying reference information other than the plurality of pieces of reference information; The information processing device according to claim 25.

27. The at least one processor displaying information for selecting the output format from a plurality of output formats on the display device; 27. The information processing device according to claim 24.

28. The at least one processor displaying, together with the output information, at least one of a data source, at least a part of information, a summary, a thumbnail image, an owner, a copyright holder, a creation date, or a usage condition of the one or more reference information on the display device; 27. The information processing device according to claim 24.

29. The at least one processor and displaying, on the display device, information indicating whether or not each of the plurality of pieces of reference information has been selected, as information for selecting one or more pieces of reference information from the plurality of pieces of reference information.

27. The information processing device according to claim 24.

30. The at least one processor displaying, on the display device, information relating to drag and drop as information for specifying reference information other than the plurality of pieces of reference information; 27. The information processing device according to claim 26.

31. at least one memory; at least one processor; The at least one processor Obtaining a first search request for a first item; retrieving a plurality of first reference information based on the first search request; obtaining one or more pieces of first reference information to be used in generating first output information based on a result of the search based on the first search request; generating first input information for a machine learning model based on information about the first item and the one or more first reference information; generating the first output information by inputting the first input information into the machine learning model; obtaining a second search request for a second item; retrieving a plurality of second reference information based on the second search request; obtaining one or more pieces of second reference information to be used in generating second output information based on a result of the search based on the second search request; generating second input information for the machine learning model based on information about a second item and the one or more second reference information; generating the second output information by inputting the second input information into the machine learning model; generating third output information based on the first output information and the second output information; Information processing system.

32. The at least one processor outputting information regarding the results of the search based on the first search request; obtaining the one or more first references based on a user selection; outputting information about the results of the search based on the second search request; obtaining the one or more second reference information based on a selection by the user; 32. The information processing system according to claim 31.

33. The at least one processor generating third input information for the machine learning model based on the first output information and the second output information; generating the third output information by inputting the third input information into the machine learning model; 33. An information processing system according to claim 31 or 32.

34. At least one processor Get information about the output format, Retrieving multiple references based on the search request; obtaining one or more pieces of reference information to be used in generating output information based on the results of the search; generating input information for a machine learning model based on the information about the output format and the one or more reference information; generating the output information by inputting the input information into the machine learning model; An information processing method that performs processing.

35. At least one processor Displaying information for specifying an output format on a display device, displaying the results of searching the plurality of pieces of reference information based on the search request on the display device; displaying information for selecting one or more pieces of reference information from the plurality of pieces of reference information on the display device; displaying, on the display device, output information generated by inputting input information to the machine learning model generated based on information regarding the specified output format and the one or more selected reference information into the machine learning model; An information processing method that performs processing.

36. At least one processor Obtaining a first search request for a first item; retrieving a plurality of first reference information based on the first search request; obtaining one or more pieces of first reference information to be used in generating first output information based on a result of the search based on the first search request; generating first input information for a machine learning model based on information about the first item and the one or more first reference information; generating the first output information by inputting the first input information into the machine learning model; obtaining a second search request for a second item; retrieving a plurality of second reference information based on the second search request; obtaining one or more pieces of second reference information to be used in generating second output information based on a result of the search based on the second search request; generating second input information for the machine learning model based on information about a second item and the one or more second reference information; generating the second output information by inputting the second input information into the machine learning model; generating third output information based on the first output information and the second output information; An information processing method that performs processing.

37. At least one processor Get information about the output format, Retrieving multiple references based on the search request; obtaining one or more pieces of reference information to be used in generating output information based on the results of the search; generating input information for a machine learning model based on the information about the output format and the one or more reference information; generating the output information by inputting the input information into the machine learning model; A program for executing a process.

38. At least one processor Displaying information for specifying an output format on a display device, displaying the results of searching the plurality of pieces of reference information based on the search request on the display device; displaying information for selecting one or more pieces of reference information from the plurality of pieces of reference information on the display device; displaying, on the display device, output information generated by inputting input information to the machine learning model generated based on information regarding the specified output format and the one or more selected reference information into the machine learning model; A program for executing a process.

39. At least one processor Obtaining a first search request for a first item; retrieving a plurality of first reference information based on the first search request; obtaining one or more pieces of first reference information to be used in generating first output information based on a result of the search based on the first search request; generating first input information for a machine learning model based on information about the first item and the one or more first reference information; generating the first output information by inputting the first input information into the machine learning model; obtaining a second search request for a second item; retrieving a plurality of second reference information based on the second search request; obtaining one or more pieces of second reference information to be used in generating second output information based on a result of the search based on the second search request; generating second input information for the machine learning model based on information about a second item and the one or more second reference information; generating the second output information by inputting the second input information into the machine learning model; generating third output information based on the first output information and the second output information; A program for executing a process.

Images