Information Processing Apparatus, Information Processing Method, and Program

Abstract

Provided are an information processing apparatus, a method, and a program that present an answer considering the operation of an organization to a user's question. 【Solution means】In an information processing system, an information processing apparatus 2 includes a reception unit 231 that receives a question from a user, an identification unit 232 that identifies the attributes of the user in the organization, a document acquisition unit 233 that acquires a relevant document, which is a document including content related to the question received by the reception unit, from a document management database, a generation unit 234 that generates a request prompt including a determination request for determining whether the relevant document acquired by the document acquisition unit is permitted to be disclosed to the user based on the attributes of the user and the public permission attributes included in the relevant document acquired by the document acquisition unit, a result acquisition unit 235 that acquires an output result output by a predetermined language model by inputting the request prompt generated by the generation unit into the predetermined language model, and a presentation unit 236 that presents information based on the output result acquired by the result acquisition unit to the user.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] In recent years, large language models (LLMs) have been increasingly utilized in enterprises. Non-Patent Document 1 discloses a technology called Retrieval Augmented Generation (RAG) that combines the language generation ability in large language models with the search ability for external information.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By using the above technology, even when the LLM has not learned information related to the user's question, it can refer to external information and present an answer containing information related to the question to the user. However, there are cases where it may not be appropriate for the operation of an organization, including enterprises, to present an answer containing information related to the user's question to users belonging to the organization. Therefore, there is a need to present an answer that takes into account the operation of the organization in response to the user's question.

[0005] Therefore, the present invention has been made in view of these points, and an object thereof is to present an answer considering the organization's operation to a user's question.

Means for Solving the Problems

[0006] An information processing apparatus according to a first aspect of the present invention includes a reception unit that receives a question from a user belonging to an organization, an identification unit that identifies an attribute of the user in the organization, and a document management database that stores a document managed by the organization and includes information indicating a public permission attribute that is an attribute for permitting public disclosure of the document in the organization, and a document acquisition unit that acquires a related document that is the document including content related to the question received by the reception unit from the document management database, and a generation unit that generates a request prompt including a determination request for determining whether or not it is permitted to disclose the related document acquired by the document acquisition unit to the user based on the attribute of the user and the public permission attribute included in the related document acquired by the document acquisition unit, and a result acquisition unit that acquires an output result output by the predetermined language model by inputting the request prompt generated by the generation unit into the predetermined language model, and a presentation unit that presents information based on the output result acquired by the result acquisition unit to the user.

[0007] The generation unit may generate the request prompt further including an answer request for an answer to the question and including the content of the related document, and when the output result corresponding to the determination request acquired by the result acquisition unit indicates that it is permitted to disclose the related document to the user, the presentation unit presents the output result corresponding to the answer request acquired by the result acquisition unit to the user as information based on the output result, and when the output result corresponding to the determination request acquired by the result acquisition unit indicates that it is not permitted to disclose the related document to the user, the presentation unit may present to the user that the disclosure of the related document is not permitted as information based on the output result.

[0008] When the generation unit is permitted to disclose the related document to the user, the generation unit may further generate the request prompt including a request for an answer to the question that includes the content of the related document; and when the generation unit is not permitted to disclose the related document to the user, the generation unit may further generate the request prompt including a request for an answer indicating that the disclosure of the related document is not permitted. The presentation unit may present the output result corresponding to the request for answer obtained by the result acquisition unit to the user.

[0009] When the output result obtained by the result acquisition unit indicates that the related document is permitted to be disclosed to the user, the generation unit may generate a new request prompt including a request for an answer to the question that includes the content of the related document. The result acquisition unit may obtain a new output result output by the predetermined language model by inputting the new request prompt generated by the generation unit into the predetermined language model. When the output result obtained by the result acquisition unit indicates that the related document is permitted to be disclosed to the user, the presentation unit may present the new output result obtained by the result acquisition unit to the user as information based on the output result.

[0010] The public permission attribute may include a permission position that is a position among a plurality of positions provided in the organization and that permits the disclosure of the document. The generation unit may generate the request prompt including a determination request for determining whether the position held by the user is included in the permission position included in the related document obtained by the document acquisition unit.

[0011] The public permission attribute may include a permission department that is the department among a plurality of departments included in the organization that permits the disclosure of the document. The specific unit may specify, as the attribute of the user, a user department that is the department to which the user belongs. The generation unit may generate the request prompt including a determination request for requesting a determination as to whether the user department is included in the permission department included in the related document acquired by the document acquisition unit.

[0012] The specific unit may further specify, as the attribute of the user, a user position that is the position held by the user among a plurality of positions provided in the organization. When the user department is included in the permission department, the generation unit may further generate the request prompt including a response request for requesting a response to the question, where the granularity of the response is different depending on whether the user position is at a predetermined rank or higher and whether the user position is not at the predetermined rank or higher.

[0013] The specific unit may further specify, as the attribute of the user, a user position that is the position held by the user among a plurality of positions provided in the organization. When the user position is at a predetermined rank or higher, the generation unit may further generate the request prompt including a response request for requesting a response to the question, where the response includes the content of the related document. When the user position is at a predetermined rank or higher, the presentation unit may present the user with the output result corresponding to the response request acquired by the result acquisition unit regardless of whether the output result corresponding to the determination request acquired by the result acquisition unit indicates that the user department is included in the permission department.

[0014] The document may further include information indicating a creation department that is the department that created the document. When the user department is not included in the permission department, the generation unit may further generate the request prompt including a response request for requesting a presentation of the creation department of the related document.

[0015] The specific part may further specify, as the attribute of the user, the user position which is the position held by the user among a plurality of positions provided in the organization. The document may further include information indicating the creation department which is the department that created the document. When the user department is not included in the permission department, the generation unit may further generate the request prompt including a response request for requesting presentation of the creation department of the related document when the user position is at a predetermined rank or higher.

[0016] The information processing method according to the second aspect of the present invention includes: a step of receiving a question from a user belonging to an organization, which is executed by a computer; a step of specifying the attribute of the user in the organization; a step of acquiring, from a document management database that stores a document managed by the organization and includes information indicating a public permission attribute which is an attribute for permitting public disclosure of the document in the organization, a related document that includes content related to the received question; a step of generating a request prompt including a determination request for determining whether it is permitted to disclose the acquired related document to the user based on the attribute of the user and the public permission attribute included in the acquired related document; a step of acquiring an output result output by the predetermined language model by inputting the generated request prompt into the predetermined language model; and a step of presenting information based on the acquired output result to the user.

[0017] The program according to the third aspect of the present invention causes a computer to function as a reception unit that receives a question from a user belonging to an organization, an identification unit that identifies an attribute of the user in the organization, a document management database that stores a document managed by the organization and includes information indicating a public permission attribute, which is an attribute that permits public disclosure of the document in the organization, a document acquisition unit that acquires a related document, which is the document including content related to the question received by the reception unit, from the document management database, a generation unit that generates a request prompt including a determination request for determining whether it is permitted to disclose the related document acquired by the document acquisition unit to the user based on the attribute of the user and the public permission attribute included in the related document acquired by the document acquisition unit, a result acquisition unit that acquires an output result output by a predetermined language model by inputting the request prompt generated by the generation unit into the predetermined language model, and a presentation unit that presents information based on the output result acquired by the result acquisition unit to the user.

Advantages of the Invention

[0018] According to the present invention, there is an effect that an answer considering the operation of the organization can be presented in response to a user's question.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Mode for Carrying Out the Invention

[0020] [Overview of Information Processing System S] FIG. 1 is a diagram for explaining the overview of the information processing system S. The information processing system S is a system used to provide information processing services to users belonging to an organization. The organization is, for example, a company or an association, etc., and has a plurality of departments and a plurality of positions. A user has a predetermined attribute in the organization. The predetermined attribute is, for example, the department to which the user belongs among the plurality of departments provided in the organization, or the position held by the user among the plurality of positions provided in the organization. The information processing service is a service that presents an answer according to the content of a document related to the user's question, and is, for example, a service that answers the user's question in a chat format.

[0021] The information processing system S provides an information processing service using technologies related to RAG. Specifically, the information processing system S provides an information processing service using the language model M and the document management database D. The language model M is a machine learning model, a so-called LLM, constructed by deep learning using a large amount of data such as text. The document management database D is a database that stores documents managed by the organization. The document contains information indicating a public permission attribute. The public permission attribute is an attribute that permits the public release of a document in the organization, in other words, an attribute that grants the right to view the document in the organization, and is, for example, the department that permits the public release of the document, the position that permits the public release of the document, etc.

[0022] FIG. 2 is a diagram schematically showing an example of a document. The document shown in FIG. 2 is a document related to the ABC project. The document shown in FIG. 2 describes the title of the document, the creating department which is the department that created the document, and the public department which indicates the department that permits the public release of the document as a public permission attribute. In the document shown in FIG. 2, the right to view the document is granted to three departments: the development department, the planning department, and the support department. Also, the document shown in FIG. 2 is composed of a plurality of items such as the purpose of the project regarding the project.

[0023] Returning to FIG. 1, the information processing system S includes a user terminal 1 and an information processing apparatus 2. The user terminal 1 is a terminal used by a user, such as a smartphone, a tablet terminal, a personal computer, etc. The information processing apparatus 2 is an apparatus that manages information processing services, such as a server. The language model M and the document management database D may be managed by the information processing apparatus 2 or may be managed by an external apparatus.

[0024] As described above, in the documents managed by an organization, there may be attributes that permit disclosure defined. In this case, it is considered inappropriate for the operation of the organization to present an answer including the content of the document to a user's question with an attribute that does not satisfy the disclosure permission attribute defined in the document. Therefore, when answering a user's question in an information processing service, it is necessary to consider the operation of the organization. Thus, the information processing system S presents an answer to the question to the user based on the relationship between the attribute of the user who asked the question and the disclosure permission attribute defined in the document. In the following, the processing executed by the information processing system S for a user's question related to the document shown in FIG. 2 will be described.

[0025] First, when the user performs an operation of accessing a provision page for providing an information processing service on the user terminal 1, the user terminal 1 displays the provision page. When the user performs an operation of inputting text or voice input such as "Please tell me the content of the ABC project." as a question on the provision page, the user terminal 1 transmits the question input by the user to the information processing apparatus 2 ((1) in FIG. 1).

[0026] When the information processing apparatus 2 receives a question from a user, it acquires, from the document management database D, the document shown in FIG. 2 as a document related to the question ((2) in FIG. 1). The information processing apparatus 2 generates a request prompt based on the attributes of the user in the organization and the publication permission attributes included in the acquired document, and inputs the generated request prompt into the language model M ((3) in FIG. 1).

[0027] The request prompt is a prompt for requesting a predetermined answer from the language model M, and is a prompt including a determination request for determining whether the user who asked the question is permitted to publish the acquired document. For example, when the attribute of the user is α, the information processing apparatus 2 attaches the acquired document and generates a request prompt including, as a determination request, a request sentence "Please determine whether a user having α is permitted to publish the attached document."

[0028] The information processing apparatus 2 acquires the output result output by the language model M by inputting the request prompt into the language model M ((4) in FIG. 1). Then, the information processing apparatus 2 causes the information based on the output result acquired from the language model M to be displayed on the provided page displayed on the user terminal 1 ((5) in FIG. 1).

[0029] By doing so, the information processing system S can present an answer considering the operation of the organization to the user's question. Hereinafter, the configuration of the information processing apparatus 2 will be described.

[0030] [Configuration of Information Processing Apparatus 2] FIG. 3 is a diagram schematically showing the functional configuration of the information processing apparatus 2. The information processing apparatus 2 includes a communication unit 21, a storage unit 22, and a control unit 23. In FIG. 3, the arrows indicate the main data flow, and there may be a data flow not shown in FIG. 3. In FIG. 3, each functional block shows a configuration in terms of function units, not in terms of hardware (devices). Therefore, the functional blocks shown in FIG. 3 may be implemented in a single device, or may be divided and implemented in a plurality of devices. The exchange of data between functional blocks may be performed via any means such as a data bus, a network, a portable storage medium, etc.

[0031] The communication unit 21 is a communication interface for connecting to a network and has a communication controller for transmitting and receiving data to and from an external device.

[0032] The storage unit 22 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) of the computer that realizes the information processing apparatus 2, a RAM (Random Access Memory) that serves as a work area of the information processing apparatus 2, an OS (Operating System), an application program, and an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores various information referred to during the execution of the application program. The storage unit 22 stores a program executed by the control unit 23 described later. The program stored in the storage unit 22 may be an API (Application Programming Interface) related to the RAG provided by an external device, or a program that uses a service related to the RAG provided by an external device. Further, the storage unit 22 stores information about the organization. The information about the organization is, for example, information indicating the hierarchy of departments established in the organization, the hierarchy of positions established in the organization, etc. Further, the storage unit 22 stores a document management database D and a user management database that manages information about users.

[0033] FIG. 4 is a diagram showing an example of the configuration of the database stored in the storage unit 22. The document management database D shown in FIG. 4(a) stores by associating document vector data and document information. The document vector data is data obtained by converting the character strings included in a document into a vector. The document vector data may be data generated by the information processing apparatus 2 using a known technique, or may be data generated by using an external service. The document information may be the document itself, or may be information indicating the location where the document is stored, such as a URI (Uniform Resource Identifier). Note that the document management database D may be stored in an external device.

[0034] The user management database shown in FIG. 4(b) stores by associating a user ID and user attributes (user department, user position). The user department is the department to which the user belongs in the organization. The user position is the position held by the user in the organization.

[0035] Returning to FIG. 3, the control unit 23 is a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) of the information processing apparatus 2, and functions as a reception unit 231, a specifying unit 232, a document acquisition unit 233, a generation unit 234, a result acquisition unit 235, and a presentation unit 236 by executing the program stored in the storage unit 22.

[0036] The reception unit 231 receives a question from a user belonging to the organization. For example, first, when the user performs an operation of accessing the service provision page on the user terminal 1, the presentation unit 236 described later causes the service provision page to be displayed on the user terminal 1. Then, when the user performs an operation of inputting a question on the service provision page, the reception unit 231 receives the question from the user by acquiring the question from the user terminal 1.

[0037] The reception unit 231 may further obtain user attribute information for identifying the attributes of the user. For example, the reception unit 231 obtains the user ID entered by the user to log in to the provided page as the user attribute information. The reception unit 231 may obtain, as the user attribute information, information indicating the attributes of the user entered by the user on the provided page.

[0038] The identification unit 232 identifies the attributes of the user in the organization. Specifically, the identification unit 232 identifies, as the attributes of the user in the organization, at least one of the user department which is the department to which the user belongs among the plurality of departments included in the organization, and the user position which is the position held by the user among the plurality of positions provided in the organization.

[0039] For example, when the reception unit 231 obtains the user ID as the user attribute information, the identification unit 232 identifies the user attributes stored in the user management database in association with the user ID as the attributes of the user in the organization. When the reception unit 231 obtains information indicating the attributes of the user as the user attribute information, the identification unit 232 may identify the attributes of the user indicated by the user attribute information as the attributes of the user in the organization.

[0040] The document acquisition unit 233 acquires a related document which is a document including content related to the question received by the reception unit 231 from the document management database D. For example, the document acquisition unit 233 acquires the related document from the document management database D by performing the following three steps.

[0041] As the first step, the document acquisition unit 233 generates question vector data obtained by vectorizing the question received by the reception unit 231. For example, the document acquisition unit 233 generates the question vector data by performing the same process as the process of converting the character strings included in the document to generate document vector data.

[0042] For example, when the document vector data is data generated using a known technique, the document acquisition unit 233 generates query vector data by converting the character string indicating the query received by the reception unit 231 into a vector using the known technique. Further, for example, when the document vector data is data generated using an external service, the document acquisition unit 233 generates query vector data by acquiring the document vector data generated by the external service in response to transmitting the character string indicating the query received by the reception unit 231 to the external service.

[0043] As a second step, the document acquisition unit 233 identifies document vector data similar to the query vector data from among the plurality of document vector data stored in the document management database D. For example, first, the document acquisition unit 233 calculates, for each piece of document vector data stored in the document management database D, a similarity (e.g., cosine similarity) indicating the degree to which the document vector data and the generated query vector data are similar. The document acquisition unit 233 identifies, from among the calculated plurality of similarities, a similarity (e.g., a similarity indicating that the degree of similarity between the document stored in the document management database D and the query received by the reception unit 231 is relatively high) indicating that the degree of similarity between the document stored in the document management database D and the query received by the reception unit 231 is relatively high, thereby identifying document vector data similar to the query vector data.

[0044] As a third step, the document acquisition unit 233 acquires a related document based on the document information stored in association with the document vector data identified in the document management database D. For example, when the document itself is stored in the document management database D, the document acquisition unit 233 acquires, from the document management database D, the document stored in association with the identified document vector data as a related document. Further, for example, when the URI of the document is stored in the document management database D, the document acquisition unit 233 acquires the related document from the storage location indicated by the URI stored in association with the document vector data identified in the document management database D.

[0045] The generation unit 234 generates a request prompt including a determination request for determining whether the related document acquired by the document acquisition unit 233 is permitted to be disclosed to the user based on the attributes of the user specified by the specifying unit 232 and the public permission attribute included in the related document acquired by the document acquisition unit 233. For example, the generation unit 234 generates a request prompt including, as the determination request, the related document acquired by the document acquisition unit 233 and a request sentence for determining whether the attributes of the user specified by the specifying unit 232 are included in the public permission attribute included in the related document.

[0046] Specifically, the generation unit 234 generates a request prompt including a determination request for determining whether the user department is included in the permission department included in the related document acquired by the document acquisition unit 233. For example, when the user department is β, the generation unit 234 generates a request prompt including, as the determination request, a request sentence such as "Please determine whether it is permitted to disclose the attached document to the user belonging to β."

[0047] The generation unit 234 may generate a request prompt including a determination request for determining whether the position held by the user is included in the permitted position included in the related document acquired by the document acquisition unit 233. For example, when the user position is γ, the generation unit 234 generates a request prompt including, as the determination request, a request sentence such as "Please determine whether it is permitted to disclose the attached document to the user holding the position of γ."

[0048] The generation unit 234 may generate a request prompt including a determination request for making two determinations: whether the user department is included in the permitted department included in the related document acquired by the document acquisition unit 233, and whether the position held by the user is included in the permitted position included in the related document acquired by the document acquisition unit 233. In this case, the information processing apparatus 2 may handle that the related document is permitted to be disclosed to the user when the user department is included in the permitted department, or when the position held by the user is included in the permitted position. Alternatively, when the user department is included in the permitted department and the position held by the user is included in the permitted position, the information processing apparatus 2 may handle that the related document is permitted to be disclosed to the user.

[0049] The result acquisition unit 235 acquires the output result output by the language model M by inputting the request prompt generated by the generation unit 234 into the language model M. For example, when the language model M is stored in the storage unit 22, the result acquisition unit 235 inputs the request prompt generated by the generation unit 234 into the language model M and acquires the output result corresponding to the request prompt output by the language model M. Also, for example, when the language model M is stored in an external device, the result acquisition unit 235 transmits the request prompt generated by the generation unit 234 to the external device and acquires the output result output by the language model M by acquiring the output result corresponding to the request prompt transmitted by the external device.

[0050] The presentation unit 236 presents information based on the output result acquired by the result acquisition unit 235 to the user. The presentation unit 236 presents information based on the output result to the user, for example, by causing the information based on the output result acquired by the result acquisition unit 235 to be displayed on the provision page displayed by the user terminal 1.

[0051] The presentation unit 236 presents the output result acquired by the result acquisition unit 235 to the user as information based on the output result. Specifically, the information processing apparatus 2 presents the output result acquired by the result acquisition unit 235 to the user by performing the following two steps.

[0052] As a first step, the generation unit 234 generates a request prompt that further includes a response request for requesting a response to the user's question according to whether the user is permitted to disclose the related document. Specifically, when the user is permitted to disclose the related document, the generation unit 234 requests a response that includes the content of the related document as a response to the question, and when the user is not permitted to disclose the related document, the generation unit 234 generates a request prompt that further includes a response request for requesting a response indicating that the disclosure of the related document is not permitted.

[0053] For example, when the question received by the reception unit 231 is "Please tell me the content of the ABC project.", the generation unit 234 generates a request prompt that includes, as a response request, a request sentence "If the user department is included in the permission department, please answer 'Please tell me the content of the ABC project.', and if the user department is not included in the permission department, please answer that you cannot answer 'Please tell me the content of the ABC project.'".

[0054] As a second step, the presentation unit 236 presents the output result obtained by the result acquisition unit 235 to the user. Specifically, the presentation unit 236 presents to the user the output result corresponding to the response request obtained by the result acquisition unit 235.

[0055] FIG. 5 is a diagram schematically showing an example of a provided page. The question input by the user is displayed on the provided page shown in FIG. 5(a). After the reception unit 231 receives the question shown in FIG. 5(a), the presentation unit 236 causes the response to be displayed on the provided page.

[0056] In the example shown in FIG. 5(b), the response in the case where the user department is included in the permission department is displayed on the provided page. As shown in FIG. 5(b), when the user department is included in the permission department, the presentation unit 236 causes the provided page to display, as a response, an output result that is a response to the user's question and includes the content of the related document.

[0057] In the example shown in FIG. 5(c), the response in the case where the user department is not included in the permission department is displayed on the provision page. As shown in FIG. 5(c), the presentation unit 236 causes the provision page to display an output result indicating that the question of the user cannot be answered as a response in the case where the user department is included in the permission department. By doing so, the information processing apparatus 2 can present the user with a response in which the language model M has considered the operation of the organization. Note that the presentation unit 236 may present the user with an output result corresponding to the determination request acquired by the result acquisition unit 235.

[0058] In the case where the user department is included in the permission department, the information processing apparatus 2 may present the user with an output result corresponding to the rank of the user position. Specifically, the information processing apparatus 2 presents the user with an output result corresponding to the rank of the user position by executing the following two steps.

[0059] As a first step, the generation unit 234 generates a request prompt that further includes a response request for requesting a response to the user's question according to whether the user position is equal to or higher than a predetermined rank. The predetermined rank is, for example, the rank of the position preset in the information processing apparatus 2.

[0060] Specifically, the generation unit 234 generates a request prompt that further includes a response request for requesting a response to the user's question, where the content (granularity) of the response is different between the case where the user position is equal to or higher than a predetermined rank and the case where the user position is not equal to or higher than a predetermined rank. For example, when the user position is equal to or higher than a predetermined rank, the generation unit 234 requests a response with a high granularity (for example, a detailed response to the user's question) to the user's question, and when the user position is not equal to or higher than a predetermined rank, the generation unit 234 requests a response with a low granularity (for example, a simplified response to the user's question) to the user's question, and generates a request prompt that further includes the response request.

[0061] FIG. 6 is a diagram schematically showing an example of a request prompt. The request prompt shown in FIG. 6 includes text T1 indicating a determination request and text T2 indicating a response request. Further, the request prompt shown in FIG. 6 includes text T3 indicating the question received by the reception unit 231, text T4 indicating the user department and the user position, and text T5 indicating the hierarchy of the user department. The text T5 is information created by referring to the information about the organization stored in the storage unit 22, for example. The text T5 may be information created by referring to the information about the organization stored in a server (not shown) managed by the organization.

[0062] The generation unit 234 may generate a request prompt according to whether the user position is at a predetermined rank or higher. Specifically, when the user department is included in the permission department, the generation unit 234 generates a request prompt including a first response request, which is a response request for requesting a high-granularity response to the question received by the reception unit 231 when the user position is at a predetermined rank or higher. For example, when the question received by the reception unit 231 is "Please tell me the content of the ABC project.", the generation unit 234 generates a request prompt including, as the first response request, a request sentence "When the user department is included in the permission department, please answer the question 'Please tell me the content of the ABC project.' with detailed information."

[0063] Further, when the user department is included in the permission department, the generation unit 234 generates a request prompt including a second response request, which is a response request for requesting a low-granularity response to the question received by the reception unit 231 when the user position is lower than the predetermined rank. For example, when the question received by the reception unit 231 is "Please tell me the content of the ABC project.", the generation unit 234 generates a request prompt including, as the second response request, a request sentence "When the user department is included in the permission department, please answer the question 'Please tell me the content of the ABC project.' with abstract information."

[0064] As a second step, the presentation unit 236 presents the output result obtained by the result acquisition unit 235 to the user. For example, when the output result corresponding to the determination request indicates that the user department is included in the permission department, the presentation unit 236 presents the output result corresponding to the answer request to the user as the output result obtained by the result acquisition unit 235. By doing so, the information processing apparatus 2 can present an answer to the user at a granularity according to the user's position.

[0065] When the user department is not included in the permission department, the presentation unit 236 presents an output result indicating that the question cannot be answered to the user. When the user department is not included in the permission department, the presentation unit 236 may present an output result indicating information other than that the question cannot be answered to the user.

[0066] For example, when the user's position is at a predetermined rank or higher, even if the user department is not included in the permission department, the presentation unit 236 presents an output result indicating an answer including the content of the relevant document to the user. Specifically, first, when the user's position is at a predetermined rank or higher, the generation unit 234 generates a request prompt including an answer request for requesting an answer to the question and including the content of the relevant document. Then, regardless of whether the output result corresponding to the determination request obtained by the result acquisition unit 235 indicates that the user department is included in the permission department, the presentation unit 236 presents the output result corresponding to the answer request obtained by the result acquisition unit 235 to the user. By doing so, the information processing apparatus 2 can present an answer according to the user's position to the user.

[0067] The presentation unit 236 may present the creating department, which is the department that created the relevant document, to the user as information other than that the question cannot be answered. Specifically, first, when the user department is not included in the permission department, the generation unit 234 generates a request prompt further including an answer request for requesting the presentation of the creating department of the relevant document.

[0068] For example, when the question received by the reception unit 231 is "Please tell me the details of the ABC project.", the generation unit 234 generates a request prompt including, as a response request, a request sentence "If the permission department includes the user department, answer 'Please tell me the details of the ABC project.', and if the permission department does not include the user department, please answer the department that created the attached document."

[0069] Then, the presentation unit 236 presents the user with the output result corresponding to the response request obtained by the result acquisition unit 235. By doing so, even when the permission department does not include the user department, the information processing apparatus 2 can present the department that can answer the user's question. Therefore, even when the user cannot obtain an answer to the question from the information processing service, the user can obtain the necessary information by separately inquiring the creating department.

[0070] Note that the presentation unit 236 may present the user with the creating department of the relevant document when the user's position is at a predetermined rank or higher. Specifically, first, when the permission department does not include the user department, the generation unit 234 generates a request prompt that further includes a response request for requesting the presentation of the creating department of the relevant document when the user's position is at a predetermined rank or higher.

[0071] For example, when the question received by the reception unit 231 is "Please tell me the content of the ABC project.", if the user's position is at or above a predetermined rank, the generation unit 234 will include a request prompt containing, as a response request, a request sentence "If the user department is included in the approval department, please answer 'Please tell me the content of the ABC project.', and if the user department is not included in the approval department, please answer the document creation department of the attached document." When the user's position is below the predetermined rank, the generation unit 234 will include a request prompt containing, as a response request, a request sentence "If the user department is included in the approval department, please answer 'Please tell me the content of the ABC project.', and if the user department is included in the approval department, please answer that you cannot answer 'Please tell me the content of the ABC project.'"

[0072] Then, the presentation unit 236 presents the user with the output result corresponding to the response request obtained by the result acquisition unit 235. By doing so, the information processing device 2 can present the user with a response according to the user's position.

[0073] The presentation unit 236 may present the user with information corresponding to the output result obtained by the result acquisition unit 235 as information based on the output result. Specifically, the information processing device 2 presents the user with information corresponding to the output result obtained by the result acquisition unit 235 by performing the following two steps.

[0074] As the first step, the generation unit 234 generates a request prompt that further includes a response request that is a response to the question received by the reception unit 231 and includes the content of the relevant document obtained by the document acquisition unit 233. For example, when the question received by the reception unit 231 from the user is "Please tell me the content of the ABC project.", the generation unit 234 generates a request prompt that includes, as a response request, a request sentence "Please answer 'Please tell me the content of the ABC project.'"

[0075] As a second step, the presentation unit 236 presents information corresponding to the output result corresponding to the determination request acquired by the result acquisition unit 235 to the user. When the output result corresponding to the determination request acquired by the result acquisition unit 235 indicates that it is permitted to disclose the related document to the user, the presentation unit 236 presents the output result corresponding to the answer request acquired by the result acquisition unit 235 as the information based on the output result to the user. On the other hand, when the output result corresponding to the determination request acquired by the result acquisition unit 235 indicates that it is not permitted to disclose the related document to the user, the presentation unit 236 presents to the user that the disclosure of the related document is not permitted as the information based on the output result. By doing so, the information processing apparatus 2 can present the output result corresponding to the answer request to the user according to the output result corresponding to the determination request.

[0076] In the above, an example in which the information processing apparatus 2 inputs one request prompt to the language model D has been described, but it is not limited to this. For example, the information processing apparatus 2 may input the request prompt to the language model D multiple times.

[0077] Specifically, first, after the generation unit 234 generates the first request prompt including the determination request, when the first output result acquired by the result acquisition unit 235 indicates that it is permitted to disclose the related document to the user, the generation unit 234 generates a second request prompt including an answer request for requesting an answer to the question and including the content of the related document. The second request prompt is a request prompt different from the first request prompt and is a new request prompt generated after the first request prompt. The first output result is the output result corresponding to the first request prompt.

[0078] The result acquisition unit 235 acquires the second output result output by the language model D by inputting the second request prompt generated by the generation unit 234 to the language model D. The second output result is the output result corresponding to the second request prompt.

[0079] Then, when the presentation unit 236 indicates that the first output result obtained by the result acquisition unit 235 is permitted to disclose the related document to the user, the presentation unit 236 presents the second output result obtained by the result acquisition unit 235 to the user as information based on the output result. On the other hand, when the presentation unit 236 indicates that the first output result obtained by the result acquisition unit 235 is not permitted to disclose the related document to the user, the presentation unit 236 presents an answer indicating that it is impossible to answer the question to the user as information based on the output result. In this way, the information processing apparatus 2 can prevent the language model D from outputting an answer that is not presented to the user by sequentially requesting answers from the language model D.

[0080] [Processing of Information Processing System S] Subsequently, the processing flow of the information processing system S will be described. FIG. 7 is a sequence diagram showing the processing flow of the information processing system S. In the example shown in FIG. 7, the information processing system S may execute process S2 after process S3, or may execute process S2 and process S3 simultaneously.

[0081] This process starts when the user terminal 1 transmits the user's question and the user ID to the information processing apparatus 2 (S1). The specifying unit 232 specifies the user attributes stored in the user management database in association with the user ID acquired by the reception unit 231 from the user terminal 1 as the attributes of the user in the organization (S2).

[0082] The document acquisition unit 233 generates question vector data obtained by vectorizing the user's question acquired by the reception unit 231 from the user terminal 1 (S3). The document acquisition unit 233 specifies document vector data similar to the question vector data from among a plurality of document vector data stored in the document management database D, and acquires a related document that is a document stored in association with the specified document vector data from the document management database D (S4).

[0083] The generation unit 234 generates a request prompt including a determination request for determining whether the related documents acquired by the document acquisition unit 233 are permitted to be disclosed to the user based on the attributes of the user specified by the specifying unit 232 and the disclosure permission attributes included in the related documents acquired by the document acquisition unit 233 (S5). The request prompt also includes a response request for requesting a response to the question that includes the content of the related document when the disclosure of the related document to the user is permitted, and a response request for requesting a response indicating that the disclosure of the related document is not permitted when the disclosure of the related document to the user is not permitted.

[0084] The result acquisition unit 235 acquires the output result output by the language model M by inputting the request prompt generated by the generation unit 234 into the language model M (S6). Then, the presentation unit 236 transmits the output result corresponding to the response request acquired by the result acquisition unit 235 to the user terminal 1 as information based on the output result acquired by the result acquisition unit 235 (S7). After that, the user terminal 1 displays the information based on the output result acquired from the information processing device 2.

[0085] [Effects of the present embodiment] As described above, the information processing device 2 generates a request prompt including a determination request for determining whether the related documents are permitted to be disclosed to the user based on the attributes of the user and the disclosure permission attributes included in the related documents acquired from the document management database D, and presents the user with information based on the output result output by the language model D by inputting the generated request prompt into the language model D. By doing so, the information processing device 2 can present a response considering the operation of the organization to the user's question.

[0086] In addition, the present invention can contribute to Goal 9, "Build the infrastructure for industry and technological innovation," of the Sustainable Development Goals (SDGs) led by the United Nations.

[0087] As described above, the present invention has been described using embodiments. However, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist. For example, all or part of the device can be configured by functionally or physically dispersing and integrating it in any unit. Also, new embodiments resulting from any combination of a plurality of embodiments are included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination have the effects of the original embodiments combined.

Explanation of Reference Numerals

[0088] 1 User terminal 2 Information processing device 21 Communication unit 22 Storage unit 23 Control unit 231 Reception unit 232 Identification unit 233 Document acquisition unit 234 Generation unit 235 Result acquisition unit 236 Presentation unit D Document management database M Language model S Information processing system

Claims

1. a reception unit that receives questions from users belonging to an organization; an identification unit that identifies the attributes of the users in the organization; a document acquisition unit that acquires, from a document management database that stores documents managed by the organization and includes information indicating a public permission attribute that is an attribute for permitting public disclosure of the document in the organization, a related document that includes content related to the question received by the reception unit; a generation unit that generates a request prompt including a determination request for determining whether it is permitted to disclose the related document acquired by the document acquisition unit to the user based on the attributes of the user and the public permission attribute included in the related document acquired by the document acquisition unit; a result acquisition unit that acquires an output result output by a predetermined language model by inputting the request prompt generated by the generation unit into the predetermined language model; a presentation unit that presents information based on the output result acquired by the result acquisition unit to the user; An information processing apparatus having the above.

2. The generation unit further generates the request prompt including a response request for requesting a response to the question that includes the content of the related document, The presentation unit presents, as information based on the output result, the output result corresponding to the response request acquired by the result acquisition unit to the user when the output result corresponding to the determination request acquired by the result acquisition unit indicates that it is permitted to disclose the related document to the user, and presents to the user that the public disclosure of the related document is not permitted as information based on the output result when the output result corresponding to the determination request acquired by the result acquisition unit indicates that it is not permitted to disclose the related document to the user. The information processing apparatus according to claim 1.

3. The generation unit further generates the request prompt including a response request for requesting a response to the question that includes the content of the related document when it is permitted to disclose the related document to the user, and a response request for requesting a response indicating that the public disclosure of the related document is not permitted when it is not permitted to disclose the related document to the user, The presentation unit presents the output result corresponding to the response request acquired by the result acquisition unit to the user. The information processing apparatus according to claim 1.

4. When the generation unit indicates that the output result obtained by the result acquisition unit is permitted to be disclosed to the user, the related document, the generation unit generates a new request prompt including a request for an answer to the question, the answer including the content of the related document. The result acquisition unit inputs the new request prompt generated by the generation unit into the predetermined language model, and acquires a new output result output by the predetermined language model. When the presentation unit indicates that the output result obtained by the result acquisition unit is permitted to be disclosed to the user, the related document, the presentation unit presents the new output result obtained by the result acquisition unit to the user as information based on the output result. The information processing apparatus according to claim 1.

5. The public permission attribute includes a permission position that is a position among a plurality of positions provided in the organization that permits the disclosure of the document. The generation unit generates the request prompt including the determination request for determining whether or not the position held by the user is included in the permission position included in the related document acquired by the document acquisition unit. The information processing apparatus according to claim 1.

6. The public permission attribute includes a permission department that is a department among a plurality of departments included in the organization that permits the disclosure of the document. The specifying unit specifies, as an attribute of the user, a user department that is the department to which the user belongs. The generation unit generates the request prompt including the determination request for determining whether or not the user department is included in the permission department included in the related document acquired by the document acquisition unit. The information processing apparatus according to claim 1.

7. The specifying unit further specifies, as an attribute of the user, a user position that is the position held by the user among a plurality of positions provided in the organization. When the user department is included in the permission department, the generation unit further includes, in the request prompt, a request for an answer to the question, the answer having different granularities depending on whether the user position is at a predetermined rank or higher and whether the user position is not at the predetermined rank or higher. The information processing apparatus according to claim 6.

8. The specific part further specifies, as an attribute of the user, a user position that is the position held by the user among a plurality of positions provided in the organization. When the user position is equal to or higher than a predetermined rank, the generation part generates the request prompt that further includes a request for an answer to the question, the answer including the content of the related document. When the user position is equal to or higher than a predetermined rank, the presentation part presents the output result corresponding to the answer request obtained by the result acquisition part to the user, regardless of whether the output result corresponding to the determination request obtained by the result acquisition part indicates that the user department is included in the permission department. The information processing apparatus according to claim 6.

9. The document further includes information indicating a creation department that is the department that created the document. When the user department is not included in the permission department, the generation part generates the request prompt that further includes a request for presenting the creation department of the related document. The information processing apparatus according to claim 6.

10. The specific part further specifies, as an attribute of the user, a user position that is the position held by the user among a plurality of positions provided in the organization. The document further includes information indicating a creation department that is the department that created the document. When the user department is not included in the permission department and the user position is equal to or higher than a predetermined rank, the generation part generates the request prompt that further includes a request for presenting the creation department of the related document. The information processing apparatus according to claim 6.

11. Executed by a computer A step of receiving a question from a user belonging to an organization; A step of specifying an attribute of the user in the organization; A step of obtaining, from a document management database that stores a document managed by the organization and includes information indicating a public permission attribute that is an attribute for permitting public disclosure of the document in the organization, a related document that includes content related to the received question; A step of generating a request prompt that includes a determination request for determining whether it is permitted to disclose the obtained related document to the user based on the attribute of the user and the public permission attribute included in the obtained related document. Obtaining an output result output by the predetermined language model by inputting the generated request prompt into the predetermined language model; Presenting information based on the obtained output result to the user; An information processing method having the above.

12. A computer, A reception unit that receives questions from users belonging to the organization, An identification unit that identifies the attributes of the user in the organization, A document acquisition unit that acquires a relevant document that is a document managed by the organization and includes information indicating a public permission attribute that is an attribute for permitting the public disclosure of the document in the organization, and that includes content related to the question received by the reception unit from a document management database that stores the document, A generation unit that generates a request prompt including a determination request for determining whether or not it is permitted to disclose the relevant document acquired by the document acquisition unit to the user based on the attributes of the user and the public permission attribute included in the relevant document acquired by the document acquisition unit, A result acquisition unit that obtains an output result output by the predetermined language model by inputting the request prompt generated by the generation unit into the predetermined language model, and A presentation unit that presents information based on the output result acquired by the result acquisition unit to the user, A program for causing the computer to function as the above.

Images