Information processing device, information processing method, and program

Abstract

To provide an information processing device capable of presenting answers to user inquiries with consideration for the organization's operations, an information processing method, and a program.SOLUTION: In an information processing system, an information processing device 2 comprises: an acceptance unit 231 which accepts a question from a user; an identification unit 232 which identifies the user's attributes in an organization; a document acquisition unit 233 which acquires a related document, which is a document containing contents related to the question accepted by the acceptance unit from a document management database; a generation unit 234 which generates a request prompt including a determination request for determining whether the related document acquired by the document acquisition unit is permitted to be disclosed to the user on the basis of the user's attributes and a disclosure-permission attribute included in the related document acquired by the document acquisition unit; a result acquisition unit 235 which acquires the an output results output by a predetermined language model by inputting the request prompt generated by the generation unit to a predetermined language model; and a presentation unit 236 which presents the information based on the output results acquired by the result acquisition unit to the user.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] In recent years, large language models (LLMs) have been increasingly used in companies. Non-Patent Document 1 discloses a technology called Retrieval Augmented Generation (RAG), which combines the language generation capability of a large language model with the ability to search for external information. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, Meng Wang, and Haofen Wang, "Retrieval-Augmented Generation for Large Language Models: A Survey", arXiv:2312.10997, 2023. Summary of the Invention [Problem to be solved by the invention]

[0004] By using the above technology, even if the LLM has not learned information related to a user's question, it can refer to external information and present the user with an answer that includes information related to the question. However, for users who belong to organizations such as companies, presenting answers that include information related to the user's question may not be appropriate for the organization's operations. Therefore, there is a need to present answers to users' questions that take into account the organization's operations.

[0005] The present invention has been made in consideration of these points, and aims to provide answers to user questions that take into consideration the operation of an organization. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention includes: a reception unit that receives questions from users belonging to an organization; an identification unit that identifies attributes of the users in the organization; a document acquisition unit that acquires related documents, which are documents managed by the organization and include information indicating disclosure permission attributes that are attributes that allow the documents to be made public in the organization, from a document management database that stores the documents; a generation unit that generates a request prompt including a determination request that requests a determination of whether the related documents acquired by the document acquisition unit are permitted to be made public to the user, based on the attributes of the user and the disclosure permission attributes included in the related documents acquired by the document acquisition unit; a result acquisition unit that acquires an output result output by the specified language model by inputting the request prompt generated by the generation unit into a specified language model; and a presentation unit that presents information based on the output result acquired by the result acquisition unit to the user.

[0007] The generation unit may generate the request prompt further including an answer request that requests an answer to the question, the answer including the contents of the related document; and the presentation unit may, if the output result corresponding to the judgment request acquired by the result acquisition unit indicates that the related document is permitted to be made public to the user, present the output result corresponding to the answer request acquired by the result acquisition unit to the user as information based on the output result; and, if the output result corresponding to the judgment request acquired by the result acquisition unit indicates that the related document is not permitted to be made public to the user, present to the user as information based on the output result that the related document is not permitted to be made public.

[0008] The generation unit may generate the request prompt further including an answer request that requests an answer to the question including the content of the related document if the related document is permitted to be made public to the user, and that requests an answer stating that the related document is not permitted to be made public if the related document is not permitted to be made public to the user, and the presentation unit may present to the user the output result corresponding to the answer request acquired by the result acquisition unit.

[0009] When the output result acquired by the result acquisition unit indicates that the related document is permitted to be made public to the user, the generation unit may generate a new request prompt including an answer request that requests an answer to the question, the answer including the content of the related document; the result acquisition unit may acquire a new output result output by the specified language model by inputting the new request prompt generated by the generation unit into the specified language model; and when the output result acquired by the result acquisition unit indicates that the related document is permitted to be made public to the user, the presentation unit may present the new output result acquired by the result acquisition unit to the user as information based on the output result.

[0010] The disclosure permission attribute may include an authorized position, which is a position that allows the disclosure of the document among multiple positions established in the organization, and the generation unit may generate the request prompt including the determination request that requests a determination of whether the authorized positions included in the related document acquired by the document acquisition unit include the position held by the user.

[0011] The disclosure permission attribute may include an authorized department, which is the department among multiple departments included in the organization that allows the disclosure of the document, and the identification unit may identify a user department, which is the department to which the user belongs, as an attribute of the user, and the generation unit may generate the request prompt including the determination request requesting a determination of whether the user department is included in the authorized departments included in the related document acquired by the document acquisition unit.

[0012] The identification unit may further identify, as an attribute of the user, a user position which is the position held by the user among a plurality of positions established in the organization, and the generation unit may generate the request prompt when the user department is included in the permitted department, further including an answer request for an answer to the question which requests an answer of different granularity depending on whether the user position is at or above a predetermined rank or not.

[0013] The identification unit may further identify, as an attribute of the user, a user position which is the position held by the user among a plurality of positions established in the organization, and the generation unit may, if the user position is of a predetermined rank or higher, generate the request prompt which further includes an answer request which requests an answer to the question and which includes the contents of the related document, and the presentation unit may, if the user position is of a predetermined rank or higher, present to the user the output result corresponding to the answer request acquired by the result acquisition unit, regardless of whether the output result corresponding to the judgment request acquired by the result acquisition unit indicates that the user department is included in the authorized department.

[0014] The document may further include information indicating the creating department, which is the department that created the document, and the generation unit may generate the request prompt further including an answer request requesting the presentation of the creating department of the related document if the user department is not included in the authorized departments.

[0015] The identification unit may further identify, as an attribute of the user, a user position which is the position held by the user among a plurality of positions established in the organization, the document may further include information indicating a creation department which is the department which created the document, and the generation unit may generate the request prompt which further includes an answer request for the presentation of the creation department of the related document when the user position is of a predetermined rank or higher and the user department is not included in the permitted departments.

[0016] An information processing method according to a second aspect of the present invention is executed by a computer and includes the steps of: accepting a question from a user belonging to an organization; identifying attributes of the user in the organization; retrieving related documents, which are documents managed by the organization and include information indicating a disclosure permission attribute that is an attribute that allows the document to be made public in the organization, from a document management database that stores the documents; generating a request prompt including a determination request for determining whether the user is permitted to make the acquired related documents public, based on the attributes of the user and the disclosure permission attribute included in the acquired related documents; inputting the generated request prompt into a predetermined language model to obtain an output result output by the predetermined language model; and presenting information based on the obtained output result to the user.

[0017] A program according to a third aspect of the present invention causes a computer to function as: a reception unit that receives questions from users belonging to an organization; an identification unit that identifies attributes of the users in the organization; a document acquisition unit that acquires related documents, which are documents managed by the organization and include information indicating disclosure permission attributes that are attributes that allow the documents to be made public in the organization, from a document management database that stores the documents; a generation unit that generates a request prompt including a determination request that requests a determination of whether the related documents acquired by the document acquisition unit are permitted to be made public to the user, based on the attributes of the user and the disclosure permission attributes included in the related documents acquired by the document acquisition unit; a result acquisition unit that acquires an output result output by the specified language model by inputting the request prompt generated by the generation unit into the specified language model; and a presentation unit that presents information based on the output result acquired by the result acquisition unit to the user. [Effects of the Invention]

[0018] According to the present invention, it is possible to provide an answer to a user's question that takes into consideration the operation of an organization. [Brief explanation of the drawings]

[0019] [Figure 1] FIG. 1 is a diagram illustrating an overview of an information processing system. [Figure 2] FIG. 1 is a diagram schematically illustrating an example of a document. [Figure 3] FIG. 1 is a diagram schematically illustrating a functional configuration of an information processing device. [Figure 4] FIG. 2 is a diagram illustrating an example of a configuration of a database stored in a storage unit. [Figure 5] FIG. 10 is a diagram schematically illustrating an example of a provision page. [Figure 6] FIG. 10 is a diagram schematically illustrating an example of a request prompt. [Figure 7] FIG. 2 is a sequence diagram showing a processing flow of the information processing system. DETAILED DESCRIPTION OF THE INVENTION

[0020] [Outline of Information Processing System S] FIG. 1 is a diagram illustrating an overview of an information processing system S. The information processing system S is a system used to provide information processing services to users belonging to an organization. The organization is, for example, a company or an organization, and has multiple departments and multiple positions. Users have predetermined attributes in the organization. The predetermined attributes are, for example, the department to which the user belongs among the multiple departments established in the organization, or the position held by the user among the multiple positions established in the organization. The information processing service is a service that presents answers based on the content of documents related to the user's questions, for example, a service that answers the user's questions in a chat format.

[0021] An information processing system S provides information processing services using RAG-related technology. Specifically, the information processing system S provides information processing services using a language model M and a document management database D. The language model M is a machine learning model, known as an LLM, constructed by deep learning using large amounts of data such as text. The document management database D is a database that stores documents managed by an organization. The documents contain information indicating disclosure permission attributes. The disclosure permission attributes are attributes that permit the disclosure of documents within an organization, in other words, attributes that grant the authority to view documents within an organization, such as the department that permits the disclosure of documents or the position that permits the disclosure of documents.

[0022] Figure 2 is a diagram that shows a schematic example of a document. The document shown in Figure 2 is a document related to the ABC project. The document shown in Figure 2 includes the document title, the creation department that created the document, and the disclosure department that indicates the department that has permission to disclose the document as a disclosure permission attribute. In the document shown in Figure 2, three departments, the development department, the planning department, and the support department, have been granted permission to view the document. The document shown in Figure 2 also consists of multiple items about the project, such as the project's objectives.

[0023] Returning to FIG. 1, the information processing system S includes a user terminal 1 and an information processing device 2. The user terminal 1 is a terminal used by a user, such as a smartphone, a tablet terminal, or a personal computer. The information processing device 2 is a device that manages information processing services, such as a server. The language model M and the document management database D may be managed by the information processing device 2 or by an external device.

[0024] As described above, documents managed by an organization may have attributes that allow disclosure. In such cases, presenting answers that include the contents of a document in response to a question from a user whose attributes do not satisfy the disclosure permission attributes defined for the document may be inappropriate from an organizational perspective. Therefore, when answering a user's question in an information processing service, the organization's operations must be taken into consideration. Therefore, the information processing system S presents answers to the question to the user based on the relationship between the attributes of the user who asked the question and the disclosure permission attributes defined for the document. The following describes the process that the information processing system S executes in response to a user's question related to the document shown in FIG.

[0025] First, when the user performs an operation to access a provision page for providing an information processing service on the user terminal 1, the user terminal 1 displays the provision page. When the user performs an operation to input text or voice as a question on the provision page, such as "Please tell me about the ABC project," the user terminal 1 transmits the question input by the user to the information processing device 2 ((1) in FIG. 1).

[0026] When the information processing device 2 receives a question from a user, it retrieves the document shown in Fig. 2 as a document related to the question from the document management database D ((2) in Fig. 1). The information processing device 2 generates a request prompt based on the attributes of the user in the organization and the disclosure permission attributes included in the retrieved document, and inputs the generated request prompt to the language model M ((3) in Fig. 1).

[0027] The request prompt is a prompt for requesting a predetermined answer from the language model M, and includes a determination request for determining whether or not the user who asked the question is permitted to make the acquired document public. For example, if the user's attribute is α, the information processing device 2 attaches the acquired document and generates a request prompt including the request statement "Please determine whether or not the attached document is permitted to be made public to a user who has α." as the determination request.

[0028] The information processing device 2 inputs the request prompt into the language model M to obtain the output result output by the language model M ((4) in FIG. 1). Then, the information processing device 2 displays information based on the output result obtained from the language model M on the provision page displayed by the user terminal 1 ((5) in FIG. 1).

[0029] In this way, the information processing system S can present answers to user questions that take into consideration the operation of the organization. The configuration of the information processing device 2 will be described below.

[0030] [Configuration of information processing device 2] FIG. 3 is a diagram schematically illustrating the functional configuration of an information processing device 2. The information processing device 2 includes a communication unit 21, a storage unit 22, and a control unit 23. In FIG. 3, arrows indicate main data flows, and there may be data flows not shown in FIG. 3. In FIG. 3, each functional block indicates a configuration in functional units, rather than a configuration in hardware (device) units. Therefore, the functional blocks shown in FIG. 3 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0031] The communication unit 21 is a communication interface for connecting to a network, and includes a communication controller for transmitting and receiving data to and from an external device.

[0032] The storage unit 22 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) of a computer that implements the information processing device 2, a RAM (Random Access Memory) that serves as a work area for the information processing device 2, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores the OS (Operating System), application programs, and various information referenced when the application programs are executed. The storage unit 22 stores programs executed by the control unit 23, which will be described later. The programs stored in the storage unit 22 may be APIs (Application Programming Interfaces) related to RAGs provided by external devices, or programs that use services related to RAGs provided by external devices. The storage unit 22 also stores information related to the organization. The information related to the organization may be, for example, information indicating the hierarchy of departments established in the organization and the hierarchy of positions established in the organization. The storage unit 22 also stores a document management database D and a user management database that manages information related to users.

[0033] FIG. 4 is a diagram showing an example of the configuration of a database stored in the storage unit 22. The document management database D shown in FIG. 4(a) stores document vector data and document information in association with each other. The document vector data is data obtained by converting character strings included in a document into vectors. The document vector data may be data generated by the information processing device 2 using a known technique, or may be data generated using an external service. The document information may be the document itself, or information indicating the location where the document is stored, such as a URI (Uniform Resource Identifier). The document management database D may be stored in an external device.

[0034] The user management database shown in Figure 4(b) stores user IDs and user attributes (user department, user job title) in association with each other. A user department is the department to which a user belongs within an organization. A user job title is the position held by a user within an organization.

[0035] Returning to Figure 3, the control unit 23 is a processor such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit) of the information processing device 2, and functions as a reception unit 231, an identification unit 232, a document acquisition unit 233, a generation unit 234, a result acquisition unit 235, and a presentation unit 236 by executing programs stored in the memory unit 22.

[0036] The receiving unit 231 receives questions from users who belong to the organization. For example, when the user first performs an operation to access a page providing an information processing service on the user terminal 1, the presentation unit 236, which will be described later, displays the page providing the information processing service on the user terminal 1. Then, when the user performs an operation to input a question on the page providing the information processing service, the receiving unit 231 acquires the question from the user terminal 1, thereby receiving the question from the user.

[0037] The reception unit 231 may further acquire user attribute information for identifying the attributes of the user. For example, the reception unit 231 acquires, as the user attribute information, a user ID input by the user to log in to the provided page. The reception unit 231 may acquire, as the user attribute information, information indicating the attributes of the user input by the user on the provided page.

[0038] The identification unit 232 identifies an attribute of a user in an organization. Specifically, the identification unit 232 identifies, as an attribute of a user in an organization, at least one of a user department, which is a department to which the user belongs among a plurality of departments included in the organization, and a user position, which is a position held by the user among a plurality of positions established in the organization.

[0039] For example, when the receiving unit 231 acquires a user ID as user attribute information, the identifying unit 232 identifies the user attributes stored in the user management database in association with the user ID as the attributes of the user in the organization. When the receiving unit 231 acquires information indicating the attributes of the user as the user attribute information, the identifying unit 232 may identify the attributes of the user indicated by the user attribute information as the attributes of the user in the organization.

[0040] The document acquisition unit 233 acquires related documents, which are documents containing content related to the question accepted by the acceptance unit 231, from the document management database D. For example, the document acquisition unit 233 acquires related documents from the document management database D by executing the following three steps.

[0041] As a first step, the document acquisition unit 233 generates question vector data by vectorizing the question received by the reception unit 231. The document acquisition unit 233 generates the question vector data by, for example, performing the same process as the process used to generate the document vector data by converting character strings included in the document.

[0042] For example, if the document vector data is data generated using a known technology, the document acquisition unit 233 generates question vector data by using the known technology to convert into a vector a character string indicating a question received by the reception unit 231. Also, for example, if the document vector data is data generated using an external service, the document acquisition unit 233 generates question vector data by acquiring document vector data generated by the external service in response to sending to the external service a character string indicating a question received by the reception unit 231.

[0043] In a second step, the document acquisition unit 233 identifies document vector data similar to the question vector data from among the multiple document vector data stored in the document management database D. For example, first, the document acquisition unit 233 calculates a similarity (e.g., cosine similarity) indicating the degree of similarity between each document vector data stored in the document management database D and the generated question vector data. The document acquisition unit 233 identifies, from the multiple calculated similarities, a similarity indicating a relatively high degree of similarity between the document stored in the document management database D and the question accepted by the accepting unit 231 (e.g., a similarity indicating the highest degree of similarity), thereby identifying document vector data similar to the question vector data.

[0044] In a third step, the document acquisition unit 233 acquires a related document based on document information stored in association with the identified document vector data in the document management database D. For example, if the document itself is stored in the document management database D, the document acquisition unit 233 acquires, as a related document, the document stored in association with the identified document vector data from the document management database D. Also, for example, if the URI of the document is stored in the document management database D, the document acquisition unit 233 acquires the related document from a storage location indicated by the URI stored in association with the identified document vector data in the document management database D.

[0045] The generation unit 234 generates a request prompt including a determination request for determining whether or not the related document acquired by the document acquisition unit 233 is permitted to be made public to the user, based on the user attribute identified by the identification unit 232 and the disclosure permission attribute included in the related document acquired by the document acquisition unit 233. The generation unit 234 generates a request prompt including, as the determination request, the related document acquired by the document acquisition unit 233 and a request statement requesting determination whether or not the user attribute identified by the identification unit 232 is included in the disclosure permission attribute included in the related document, for example.

[0046] Specifically, the generation unit 234 generates a request prompt including a determination request for determining whether or not the user department is included in the permitted departments included in the related document acquired by the document acquisition unit 233. For example, if the user department is β, the generation unit 234 generates a request prompt including, as a determination request, a request statement such as "Please determine whether or not users belonging to β are permitted to make the attached document public."

[0047] The generation unit 234 may generate a request prompt including a determination request for determining whether or not the position held by the user is included in the permitted positions included in the related document acquired by the document acquisition unit 233. For example, if the user position is γ, the generation unit 234 generates a request prompt including, as a determination request, a request statement such as "Please determine whether or not the attached document is permitted to be made public to users who hold the position γ."

[0048] The generation unit 234 may generate a request prompt including a determination request for two determinations: whether or not the user department is included in the permitted departments included in the related document acquired by the document acquisition unit 233, and whether or not the position held by the user is included in the permitted job titles included in the related document acquired by the document acquisition unit 233. In this case, the information processing device 2 may treat the related document as being permitted to be disclosed to the user when the permitted departments include the user department or when the permitted job titles include the position held by the user, or may treat the related document as being permitted to be disclosed to the user when the permitted departments include the user department and the permitted job titles include the position held by the user.

[0049] The result acquiring unit 235 acquires the output result output by the language model M by inputting the request prompt generated by the generation unit 234 into the language model M. For example, when the language model M is stored in the storage unit 22, the result acquiring unit 235 inputs the request prompt generated by the generation unit 234 into the language model M and acquires the output result corresponding to the request prompt output by the language model M. Furthermore, when the language model M is stored in an external device, the result acquiring unit 235 transmits the request prompt generated by the generation unit 234 to the external device and acquires the output result corresponding to the request prompt transmitted by the external device, thereby acquiring the output result output by the language model M.

[0050] The presentation unit 236 presents to the user information based on the output result acquired by the result acquisition unit 235. The presentation unit 236 presents to the user information based on the output result acquired by the result acquisition unit 235, for example, by displaying the information based on the output result acquired by the result acquisition unit 235 on the provision page displayed on the user terminal 1.

[0051] The presentation unit 236 presents to the user, for example, the output result acquired by the result acquisition unit 235 as information based on the output result. Specifically, the information processing device 2 presents to the user the output result acquired by the result acquisition unit 235 by executing the following two steps.

[0052] As a first step, the generating unit 234 generates a request prompt that further includes an answer request for requesting an answer to a user's question depending on whether the related document is permitted to be disclosed to the user. Specifically, the generating unit 234 generates a request prompt that further includes an answer request for an answer to the question that includes the content of the related document if the related document is permitted to be disclosed to the user, and an answer that indicates that the related document is not permitted to be disclosed to the user if the related document is not permitted to be disclosed to the user.

[0053] For example, if the question received by the reception unit 231 is "Please tell me the details of the ABC project," the generation unit 234 generates a request prompt including the following request sentence as an answer request: "If the permitted department includes the user department, please answer 'Please tell me the details of the ABC project.' If the permitted department does not include the user department, please answer that you cannot answer 'Please tell me the details of the ABC project.'"

[0054] In a second step, the presentation unit 236 presents to the user the output result acquired by the result acquisition unit 235. Specifically, the presentation unit 236 presents to the user the output result corresponding to the answer request acquired by the result acquisition unit 235.

[0055] 5A and 5B are diagrams schematically illustrating an example of a provision page. The provision page shown in Fig. 5A displays a question entered by a user. After the reception unit 231 receives the question shown in Fig. 5A, the presentation unit 236 displays an answer on the provision page.

[0056] In the example shown in Fig. 5(b), the answer when the user department is included in the permitted departments is displayed on the provision page. As shown in Fig. 5(b), the presentation unit 236 displays an output result on the provision page that indicates an answer to the user's question and that includes the contents of the related document as the answer when the user department is included in the permitted departments.

[0057] In the example shown in FIG. 5(c), an answer in the case where the user department is not included in the permitted departments is displayed on the provision page. As shown in FIG. 5(c), the presentation unit 236 displays an output result indicating an answer to the user's question on the provision page as an answer in the case where the user department is included in the permitted departments, that is, an answer to the user's question cannot be answered. In this way, the information processing device 2 can present to the user an answer in which the language model M takes into consideration the operation of the organization. Note that the presentation unit 236 may present to the user an output result corresponding to the determination request acquired by the result acquisition unit 235.

[0058] When the user department is included in the permitted departments, the information processing device 2 may present the user with an output result according to the rank of the user's job title. Specifically, the information processing device 2 performs the following two steps to present the user with an output result according to the rank of the user's job title.

[0059] As a first step, the generation unit 234 generates a request prompt that further includes an answer request for an answer to a question of the user depending on whether the user's job title is at or above a predetermined rank. The predetermined rank is, for example, a job title rank that is preset in the information processing device 2.

[0060] Specifically, the generation unit 234 generates a request prompt that is an answer to a user's question and further includes an answer request that requests an answer with different content (granularity) depending on whether the user's role is a predetermined rank or higher or not. For example, the generation unit 234 generates a request prompt that requests an answer with high granularity to the user's question (e.g., a detailed answer to the user's question) when the user's role is a predetermined rank or higher, and that requests an answer with low granularity to the user's question (e.g., a simple answer to the user's question) when the user's role is not a predetermined rank or higher.

[0061] Fig. 6 is a diagram schematically illustrating an example of a request prompt. The request prompt illustrated in Fig. 6 includes text T1 indicating a determination request and text T2 indicating an answer request. The request prompt illustrated in Fig. 6 also includes text T3 indicating a question received by the reception unit 231, text T4 indicating the user department and user position, and text T5 indicating the hierarchy of the user department. Text T5 is, for example, information created with reference to information about the organization stored in the storage unit 22. Text T5 may also be information created with reference to information about the organization stored in a server (not shown) managed by the organization.

[0062] The generation unit 234 may generate a request prompt depending on whether the user's job title is at or above a predetermined rank. Specifically, when the permitted departments include a user department and the user's job title is at or above a predetermined rank, the generation unit 234 generates a request prompt including a first answer request, which is an answer request requesting a highly granular answer to the question accepted by the acceptance unit 231. For example, when the question accepted by the acceptance unit 231 is "Please tell me the details of the ABC project," the generation unit 234 generates a request prompt including, as the first answer request, a request sentence that reads, "When the permitted departments include a user department, please provide detailed information about 'Please tell me the details of the ABC project.'"

[0063] Furthermore, when the permitted departments include a user department and the user's job title is below a predetermined rank, the generation unit 234 generates a request prompt including a second answer request, which is an answer request requesting a less granular answer to the question received by the reception unit 231. For example, when the question received by the reception unit 231 is "Please tell me the details of the ABC project," the generation unit 234 generates a request prompt including, as the second answer request, a request sentence that reads, "When the permitted departments include a user department, please provide abstract information to the question, 'Please tell me the details of the ABC project.'"

[0064] As a second step, the presentation unit 236 presents to the user the output result acquired by the result acquisition unit 235. For example, when the output result corresponding to the determination request indicates that the user department is included in the permitted departments, the presentation unit 236 presents to the user the output result corresponding to the answer request as the output result acquired by the result acquisition unit 235. In this way, the information processing device 2 can present to the user answers at a granularity according to the user's job title.

[0065] If the user department is not included in the permitted departments, the presentation unit 236 presents to the user an output result indicating that the question cannot be answered. If the user department is not included in the permitted departments, the presentation unit 236 may present to the user an output result indicating information other than that the question cannot be answered.

[0066] For example, when the user's job title is a predetermined rank or higher, the presentation unit 236 presents the user with an output result indicating an answer including the contents of the related document, even if the user's department is not included in the permitted departments. Specifically, first, when the user's job title is a predetermined rank or higher, the generation unit 234 generates a request prompt including an answer request for an answer to a question that includes the contents of the related document. Then, the presentation unit 236 presents the user with an output result corresponding to the answer request acquired by the result acquisition unit 235, regardless of whether the output result corresponding to the determination request acquired by the result acquisition unit 235 indicates that the user's department is included in the permitted departments. In this way, the information processing device 2 can present the user with an answer according to the user's job title.

[0067] The presenting unit 236 may present the creating department, which is the department that created the related document, to the user as information other than the fact that the question cannot be answered. Specifically, first, when the user department is not included in the permitted departments, the generating unit 234 generates a request prompt that further includes an answer request for presenting the creating department of the related document.

[0068] For example, if the question received by the reception unit 231 is "Please tell me the details of the ABC project," the generation unit 234 generates a request prompt including the following request sentence as an answer request: "If the permission department includes the user department, answer 'Please tell me the details of the ABC project.' If the permission department does not include the user department, answer with the department that created the attached document."

[0069] Then, the presenting unit 236 presents to the user the output result corresponding to the answer request acquired by the result acquiring unit 235. In this way, the information processing device 2 can present departments that can answer the user's question even if the user department is not included in the permitted departments. Therefore, even if the user cannot obtain an answer to their question from the information processing service, they can obtain the necessary information by making a separate inquiry to the creating department.

[0070] The presenting unit 236 may present the department that created the related document to the user when the user's job title is at or above a predetermined rank. Specifically, first, when the user's job title is at or above a predetermined rank and the user's job title is not included in the permitted departments, the generating unit 234 generates a request prompt that further includes an answer request for presenting the department that created the related document.

[0071] For example, when the question received by the reception unit 231 is "Please tell me the details of the ABC project." and the user's job title is at or above a predetermined rank, the generation unit 234 generates a request prompt including, as an answer request, a request sentence that reads, "If the permitted departments include the user department, answer 'Please tell me the details of the ABC project.' If the permitted departments do not include the user department, answer the department that created the attached document." On the other hand, when the user's job title is below a predetermined rank, the generation unit 234 generates a request prompt including, as an answer request, a request sentence that reads, "If the permitted departments include the user department, answer 'Please tell me the details of the ABC project.' If the permitted departments include the user department, answer that you cannot answer 'Please tell me the details of the ABC project.'"

[0072] Then, the presenting unit 236 presents to the user the output result corresponding to the answer request acquired by the result acquiring unit 235. In this way, the information processing device 2 can present to the user an answer according to the user's role.

[0073] The presentation unit 236 may present to the user, as information based on the output result, information corresponding to the output result acquired by the result acquisition unit 235. Specifically, the information processing device 2 presents to the user information corresponding to the output result acquired by the result acquisition unit 235 by executing the following two steps.

[0074] As a first step, the generation unit 234 generates a request prompt that further includes an answer request for an answer to the question received by the reception unit 231, the answer including the content of the related document acquired by the document acquisition unit 233. For example, if the question received from the user by the reception unit 231 is "Please tell me the details of the ABC project," the generation unit 234 generates a request prompt that includes the request sentence "Please answer 'Please tell me the details of the ABC project.'" as an answer request.

[0075] As a second step, the presenting unit 236 presents to the user information according to the output result corresponding to the determination request acquired by the result acquiring unit 235. When the output result corresponding to the determination request acquired by the result acquiring unit 235 indicates that the related document is permitted to be disclosed to the user, the presenting unit 236 presents to the user the output result corresponding to the answer request acquired by the result acquiring unit 235 as information based on the output result. On the other hand, when the output result corresponding to the determination request acquired by the result acquiring unit 235 indicates that the related document is not permitted to be disclosed to the user, the presenting unit 236 presents to the user information based on the output result that the related document is not permitted to be disclosed. In this way, the information processing device 2 can present to the user the output result corresponding to the answer request in accordance with the output result corresponding to the determination request.

[0076] In the above, an example has been described in which the information processing device 2 inputs a single request prompt to the language model D, but this is not limiting. For example, the information processing device 2 may input a request prompt to the language model D multiple times.

[0077] Specifically, first, after generating a first request prompt including a determination request, if the first output result acquired by the result acquisition unit 235 indicates that the related document is permitted to be made public to the user, the generation unit 234 generates a second request prompt including an answer request for an answer to a question that includes the content of the related document. The second request prompt is a request prompt different from the first request prompt and is a new request prompt generated after the first request prompt. The first output result is an output result corresponding to the first request prompt.

[0078] The result acquiring unit 235 inputs the second request prompt generated by the generating unit 234 into the language model D, thereby acquiring a second output result output by the language model D. The second output result is an output result corresponding to the second request prompt.

[0079] Then, when the first output result acquired by the result acquisition unit 235 indicates that the related document is permitted to be made public to the user, the presentation unit 236 presents the second output result acquired by the result acquisition unit 235 to the user as information based on the output result. On the other hand, when the first output result acquired by the result acquisition unit 235 indicates that the related document is not permitted to be made public to the user, the presentation unit 236 presents to the user, as information based on the output result, an answer to the effect that the question cannot be answered. In this way, by gradually requesting an answer from the language model D, the information processing device 2 can prevent the language model D from outputting an answer that is not to be presented to the user.

[0080] [Processing of Information Processing System S] Next, we will explain the processing flow of the information processing system S. Fig. 7 is a sequence diagram showing the processing flow of the information processing system S. In the example shown in Fig. 7, the information processing system S may execute process S2 after process S3, or may execute process S2 and process S3 simultaneously.

[0081] This process starts when the user terminal 1 transmits a user question and a user ID to the information processing device 2 (S1). The identification unit 232 identifies the user attributes stored in the user management database in association with the user ID acquired from the user terminal 1 by the reception unit 231 as the attributes of the user in the organization (S2).

[0082] The document acquisition unit 233 generates question vector data by vectorizing the user's question acquired by the reception unit 231 from the user terminal 1 (S3). The document acquisition unit 233 identifies document vector data similar to the question vector data from among the multiple document vector data stored in the document management database D, and acquires related documents, which are documents stored in association with the identified document vector data, from the document management database D (S4).

[0083] Based on the user attributes identified by the identification unit 232 and the disclosure permission attributes included in the related document acquired by the document acquisition unit 233, the generation unit 234 generates a request prompt including a determination request requesting a determination as to whether or not the related document acquired by the document acquisition unit 233 is permitted to be disclosed to the user, and an answer request that requests an answer to the question including the content of the related document if the related document is permitted to be disclosed to the user, and that requests an answer stating that disclosure of the related document is not permitted if the related document is not permitted to be disclosed to the user (S5).

[0084] The result acquiring unit 235 acquires the output result output by the language model M by inputting the request prompt generated by the generation unit 234 into the language model M (S6). Then, the presentation unit 236 transmits the output result corresponding to the answer request acquired by the result acquiring unit 235 to the user terminal 1 as information based on the output result acquired by the result acquiring unit 235 (S7). Thereafter, the user terminal 1 displays the information based on the output result acquired from the information processing device 2.

[0085] [Effects of this embodiment] As described above, the information processing device 2 generates a request prompt including a determination request for determining whether or not the user is permitted to disclose the related document based on the user's attributes and the disclosure permission attributes included in the related document acquired from the document management database D, and inputs the generated request prompt into the language model D to present to the user information based on the output result output by the language model D. In this way, the information processing device 2 can present answers to the user's questions that take into consideration the operation of the organization.

[0086] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is "Build resilient infrastructure, promote inclusive and sustainable industrialization, and promote innovation and resilience."

[0087] The present invention has been described above using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by functionally or physically distributing or integrating any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination also have the effects of the original embodiments. [Explanation of symbols]

[0088] 1. User terminal 2. Information processing equipment 21 Communications Department 22 Memory section 23 Control Unit 231 Reception Department 232 Specific part 233 Document Acquisition Department 234 Generation part 235 Result acquisition part 236 Presentation section D Document Management Database M language model S Information Processing System

Claims

1. a reception unit that receives questions from users belonging to the organization; an identification unit that identifies attributes of the user in the organization; a document acquisition unit that acquires, from a document management database that stores documents managed by the organization and that include information indicating a disclosure permission attribute that is an attribute that allows the organization to disclose the document, a related document that includes content related to the question accepted by the accepting unit; a generating unit that generates a request prompt including a determination request for determining whether the related document acquired by the document acquisition unit is permitted to be made public to the user based on the attribute of the user and the disclosure permission attribute included in the related document acquired by the document acquisition unit; a result acquisition unit that inputs the request prompt generated by the generation unit into a predetermined language model and acquires an output result output by the predetermined language model; a presentation unit that presents information based on the output result acquired by the result acquisition unit to the user; An information processing device having the above.

2. the generating unit generates the request prompt, further including an answer request for an answer to the question, the answer including the content of the related document; When the output result corresponding to the determination request acquired by the result acquisition unit indicates that the related document is permitted to be disclosed to the user, the presentation unit presents the output result corresponding to the answer request acquired by the result acquisition unit to the user as information based on the output result, and when the output result corresponding to the determination request acquired by the result acquisition unit indicates that the related document is not permitted to be disclosed to the user, the presentation unit presents to the user as information based on the output result that the related document is not permitted to be disclosed. The information processing device according to claim 1 .

3. the generating unit generates the request prompt, which further includes an answer request for an answer to the question that includes the content of the related document when the related document is permitted to be made public to the user, and an answer request for an answer that indicates that the related document is not permitted to be made public when the related document is not permitted to be made public to the user; the presentation unit presents to the user the output result corresponding to the answer request acquired by the result acquisition unit. The information processing device according to claim 1 .

4. the generating unit generates a new request prompt including an answer request for an answer to the question, the answer including the content of the related document, when the output result acquired by the result acquiring unit indicates that the related document is permitted to be made public to the user; the result acquisition unit inputs the new request prompt generated by the generation unit into the predetermined language model, thereby acquiring a new output result output by the predetermined language model; When the output result acquired by the result acquisition unit indicates that the related document is permitted to be made public to the user, the presentation unit presents the new output result acquired by the result acquisition unit to the user as information based on the output result. The information processing device according to claim 1 .

5. the disclosure permission attribute includes an authorized position that is the position that is authorized to disclose the document among a plurality of positions established in the organization, the generating unit generates the request prompt including the determination request for determining whether the position held by the user is included in the permitted positions included in the related document acquired by the document acquiring unit. The information processing device according to claim 1 .

6. the disclosure permission attribute includes an authorization department that is a department that permits disclosure of the document among a plurality of departments included in the organization; The identification unit identifies a user department, which is the department to which the user belongs, as an attribute of the user; the generating unit generates the request prompt including the determination request for determining whether the user department is included in the authorized departments included in the related document acquired by the document acquiring unit. The information processing device according to claim 1 .

7. the identification unit further identifies, as an attribute of the user, a user position that is the position held by the user among a plurality of positions established in the organization; When the user department is included in the permitted departments, the generation unit generates the request prompt, which further includes an answer request for an answer to the question, the answer having different granularity depending on whether the user job title is a predetermined rank or higher or not. The information processing device according to claim 6 .

8. the identification unit further identifies, as an attribute of the user, a user position that is the position held by the user among a plurality of positions established in the organization; the generating unit generates the request prompt further including an answer request for an answer to the question, the answer including the content of the related document, when the user position is a predetermined rank or higher; When the user's job title is a predetermined rank or higher, the presentation unit presents to the user the output result corresponding to the response request acquired by the result acquisition unit, regardless of whether the output result corresponding to the determination request acquired by the result acquisition unit indicates that the user department is included in the permitted departments. The information processing device according to claim 6 .

9. The document further includes information indicating a creating department, which is the department that created the document; the generating unit generates the request prompt further including a response request for requesting presentation of the creating department of the related document when the user department is not included in the authorized departments. The information processing device according to claim 6 .

10. the identification unit further identifies, as an attribute of the user, a user position that is the position held by the user among a plurality of positions established in the organization; The document further includes information indicating a creating department, which is the department that created the document; the generating unit generates the request prompt further including an answer request for requesting presentation of the creation department of the related document when the user department is not included in the permitted departments and the user position is a predetermined rank or higher. The information processing device according to claim 6 .

11. The computer executes accepting questions from users belonging to the organization; identifying attributes of the users in the organization; a step of acquiring a related document, which is a document including content related to the received question, from a document management database that stores documents managed by the organization and which include information indicating a disclosure permission attribute that is an attribute that allows the organization to disclose the document; generating a request prompt including a determination request for determining whether the user is permitted to disclose the acquired related document based on the attribute of the user and the disclosure permission attribute included in the acquired related document; inputting the generated request prompt into a predetermined language model to obtain an output result output by the predetermined language model; presenting information based on the acquired output result to the user; An information processing method comprising:

12. Computer, A reception section that accepts questions from users belonging to the organization. an identification unit that identifies attributes of the user in the organization; a document acquisition unit that acquires, from a document management database that stores documents managed by the organization and that include information indicating a disclosure permission attribute that is an attribute that allows the organization to disclose the document, a related document that is the document containing content related to the question accepted by the acceptance unit; a generating unit that generates a request prompt including a determination request for determining whether or not the related document acquired by the document acquisition unit is permitted to be made public to the user, based on an attribute of the user and the disclosure permission attribute included in the related document acquired by the document acquisition unit; a result acquisition unit that inputs the request prompt generated by the generation unit into a predetermined language model and acquires an output result output by the predetermined language model; and a presentation unit that presents information based on the output result acquired by the result acquisition unit to the user; A program to function as a

Images