Information processing apparatus

Abstract

To improve the answer accuracy of a large-scale language model. An information processing apparatus includes an analysis unit that performs morphological analysis processing on a question input by a user, an acquisition unit that acquires a synonym related to at least one word included in the question based on a result of the morphological analysis processing, and a search unit that searches a database based on the question and the acquired synonym.

Description

Technical Field

[0001] This invention relates to the technical field of an information processing device. Background Technology

[0002] As such a device, for example, the following device has been proposed: generating document-based query data in a language model and using the pairing of documents and query data for learning the search model of a chatbot (see Patent Document 1).

[0003] Patent Document 1: Japanese Patent Application Publication No. 2023-076413 Summary of the Invention

[0004] As a chatbot, a proposed approach utilizes a mechanism called Retrieval-Augmented Generation (RAG) that assigns a unique information source to the Large Language Model (LLM) by combining searches with a specific information source (hereinafter, appropriately referred to as the "knowledge base"). In chatbots using RAG, a unique information source can be assigned to the LLM by inputting a portion of the search results from the knowledge base into the LLM. For example, when searching the knowledge base for the word "turn signal," sometimes data including "direction indicator" is not retrieved. As a result, the responses generated by the LLM sometimes differ from the user's requested response. Furthermore, a Large Language Model refers to a language model constructed using very large datasets and deep learning techniques.

[0005] The present invention was made in view of the above circumstances, and its object is to provide an information processing device that can improve the response accuracy of large-scale language models.

[0006] One aspect of the present invention relates to an information processing apparatus comprising: an analysis unit that performs morphological analysis processing on a query text input by a user; an acquisition unit that acquires synonyms related to at least one word included in the query text based on the result of the morphological analysis processing; and

[0007] The search unit searches the database based on the query text and the obtained synonyms. Attached Figure Description

[0008] Figure 1 This is a diagram showing the structure of the information processing system involved in the implementation method.

[0009] Figure 2 This is a block diagram illustrating an example of the structure of the computing device involved in the implementation. Detailed Implementation

[0010] refer to Figure 1 and Figure 2 The implementation methods related to the information processing device will be described. Figure 1 In this system, information processing system 1 includes information processing device 10, server 20, and knowledge base 30. Information processing device 10, server 20, and knowledge base 30 are configured to communicate with each other via network NW. Server 20 is a server used for applying Large Scale Language Model (LLM). Therefore, server 20 can be called an LLM server. Alternatively, server 20 can be a cloud server.

[0011] Multiple text data entries can be registered in knowledge base 30. Each text data entry can be fragmented data generated by segmenting a document. This fragmented data can be called a "block". Furthermore, specific examples of methods for segmenting a document include methods that segment with a constant length (in other words, fixed length), methods that segment by sentence based on sentence delimiters, and methods that segment based on structures such as Markdown. Each text data entry can be vectorized text data. That is, knowledge base 30 can be a vector database / vector storage.

[0012] (Information processing device 10)

[0013] exist Figure 1 The information processing device 10 includes a computing unit 11, a storage unit 12, a communication unit 13, an input unit 14, and an output unit 15. The computing unit 11, storage unit 12, communication unit 13, input unit 14, and output unit 15 are connected via a data bus 16. Furthermore, the information processing device 10 can be a personal computer, a tablet terminal, or a smartphone.

[0014] The arithmetic unit 11 may have a processor. Furthermore, the arithmetic unit 11 may have a single processor or multiple processors. That is, the arithmetic unit 11 may have more than one processor. Additionally, the processor may be a multi-core processor. In the case where the arithmetic unit 11 has a single processor that functions as a multi-core processor, it can be said that the arithmetic unit 11 logically has multiple processors.

[0015] The processor may be at least one of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Field Programmable Gate Array (FPGA), and a Tensor Processing Unit (TPU).

[0016] Storage device 12 may be at least one of random access memory (RAM), read-only memory (ROM), hard disk drive, magneto-optical disk drive, solid-state drive (SSD), and optical disk array. That is, storage device 12 may be implemented by a single device or by multiple devices.

[0017] The communication device 13 can communicate with external devices (e.g., server 20) of the information processing device 10. Furthermore, the communication device 13 can perform wired communication or wireless communication.

[0018] Input device 14 is a device capable of accepting information input from an external source to information processing device 10. Input device 14 may include user-operable devices (e.g., keyboard, mouse, touch panel, etc.) of information processing device 10. Input device 14 may include, for example, a recording medium reading device capable of reading information recorded on a recording medium removable from information processing device 10, such as a USB (Universal Serial Bus) memory. Furthermore, when information is input to information processing device 10 via communication device 13 (in other words, when information processing device 10 obtains information via communication device 13), communication device 13 may function as an input device.

[0019] Output device 15 is a device capable of outputting information to the outside of information processing device 10. Output device 15 includes a display device 151 capable of outputting visual information such as characters and images. Additionally, output device 15 may include a speaker capable of outputting auditory information such as sound. Output device 15 may include a vibration motor capable of outputting tactile information such as vibration. Output device 15 may include a printer. Output device 15 can output information to recording media removable from information processing device 10, such as a USB memory. Furthermore, when information processing device 10 outputs information via communication device 13, communication device 13 can function as an output device.

[0020] Storage device 12 is capable of storing desired data. The computer program CP executed by the arithmetic unit 11 can be stored in storage device 12. When the arithmetic unit 11 executes the computer program CP, storage device 12 can temporarily store data temporarily used by the arithmetic unit 11.

[0021] Furthermore, the computer program CP can be recorded on a computer-readable and non-temporary recording medium. In this case, the computer program CP can be stored in the storage device 12 by reading the recording medium using a recording medium reading device (not shown) included in the information processing device 10. Additionally, at least one of optical discs, magnetic media, magneto-optical discs, semiconductor memory, and any medium capable of storing other programs can be used as the recording medium. Furthermore, the computer program CP can also be obtained from an external (not shown) device outside the information processing device 10 via the communication device 13. In other words, the computer program CP can be downloaded from an external device to the storage device 12 of the information processing device 10.

[0022] The arithmetic unit 11 (e.g., a processor) can perform the processing to be performed by the information processing unit 10 together with the storage device 12 storing the computer program CP (in other words, together with the storage device 12 and the computer program CP stored in the storage device 12). For example, the arithmetic unit 11 can implement logical function blocks for performing the processing to be performed by the information processing unit 10 within the arithmetic unit 11 (e.g., within the processor) by executing the computer program CP.

[0023] Server 20 and knowledge base 30 provide a chatbot service using RAG. To utilize the chatbot service, the processing unit 11 of the information processing apparatus 10 includes an analysis unit 111, an acquisition unit 112, a search unit 113, and an input unit 114 (see reference). Figure 2 The analysis unit 111, acquisition unit 112, search unit 113, and input unit 114 can be implemented as the aforementioned logic function blocks. Alternatively, at least one of the analysis unit 111, acquisition unit 112, search unit 113, and input unit 114 can be implemented as a physical processing circuit. At least one of the analysis unit 111, acquisition unit 112, search unit 113, and input unit 114 can be implemented in a manner that combines logic function blocks and physical processing circuits.

[0024] For example, user U can utilize the chatbot service via information processing device 10. In this case, the user can input a question via input device 14 of information processing device 10. Here, "question" is not limited to interrogative sentences. For example, "question" can be a sentence containing requests, instructions, commands, etc., such as "Please tell me about ****" or "Please answer about ****". Therefore, "question" is not limited to interrogative sentences, but can include sentences containing requests, instructions, commands, etc. That is, "question" can refer to a sentence requesting an answer from the other party.

[0025] The analysis unit 111 of the information processing apparatus 10 performs morphological element analysis processing on the query text. Furthermore, various existing methods can be applied to morphological element analysis processing. Therefore, a detailed description of morphological element analysis processing is omitted. Based on the result of the morphological element analysis processing, the acquisition unit 112 of the information processing apparatus 10 acquires synonyms related to at least one word contained in the query text. For example, the acquisition unit 112 can use a dictionary tool to acquire the aforementioned synonyms.

[0026] The search unit 113 of the information processing device 10 can search the knowledge base 30 based on the query text and synonyms. At this time, the search unit 113 can extract one or more text data related to the query text from the knowledge base 30. The search unit 113 can output search results including one or more text data.

[0027] The input unit 114 of the information processing device 10 sends a prompt, including the question text and text data as part of the search results, to the server 20 via the communication device 13. As a result, the prompt is input into a large-scale language model.

[0028] Server 20 sends the answers to the questions generated by the large-scale language model to information processing device 10. For example, the computing unit 11 of information processing device 10 can control display device 151 to display the answers generated by the large-scale language model.

[0029] (Technical effect)

[0030] In this embodiment, morphological analysis processing is performed on the user-inputted question text. Based on the results of the morphological analysis processing, synonyms related to at least one word contained in the question text are obtained. Then, the knowledge base 30 is searched based on the question text and the synonyms. Therefore, it is expected that text data related to the user's question text can be extracted from the knowledge base 30. As a result, it is expected that the answer from the large-scale subtraction model for the question text will be the answer requested by the user. Thus, according to the information processing apparatus 10 according to this embodiment, the answer accuracy of the large-scale language model can be improved.

[0031] Hereinafter, various aspects of the invention derived from the embodiments described above will be described.

[0032] One aspect of the invention relates to an information processing apparatus comprising: an analysis unit for performing morphological analysis on a query text input by a user; an acquisition unit for acquiring synonyms related to at least one word contained in the query text based on the result of the morphological analysis; and a search unit for searching a database based on the query text and the acquired synonyms.

[0033] In the above embodiments, "knowledge base 30" is equivalent to "database" in one example, "analysis unit 111" is equivalent to "analysis unit" in another example, "acquisition unit 112" is equivalent to "acquisition unit" in another example, and "search unit 113" is equivalent to "search unit" in another example.

[0034] The information processing apparatus described above may include an input unit that inputs the query text and the search results from the database into a large-scale language model. In the above embodiment, "input unit 114" is an example of an "input unit".

[0035] The present invention is not limited to the embodiments described above, and appropriate modifications can be made without departing from the spirit or concept of the invention as read in its entirety from the claims and description. Information processing apparatuses that accompany such modifications are also included within the technical scope of the present invention.

[0036] Symbol Explanation

[0037] 1-Information processing system, 10-Information processing device, 20-Server, 30-Knowledge base, 111-Analysis department, 112-Acquisition department, 113-Search department, 114-Input department.

Claims

1. An information processing device, characterized in that, have: The analysis unit performs morphological analysis on the query text input by the user; The acquisition unit acquires synonyms related to at least one word included in the question text based on the results of the morphogenetic analysis. and The search unit searches the database based on the query text and the obtained synonyms.

2. The information processing device according to claim 1, characterized in that, have: The input unit inputs the query text and the search results from the database into a large-scale language model.

Images