Method and system for managing information of information provider based on conversation with information provider

Abstract

To provide a method and system for managing, based on a conversation with an information provider, information of the information provider.SOLUTION: An information management method according to an embodiment includes: providing a conversational information management function to an information provider that desires to provide content to a user of a search service; conducting a conversation between large language model (LLM)-based artificial intelligence and the information provider through the conversational information management function; and analyzing the conversation and managing a campaign of the information provider.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The following description relates to a method and system for managing information of an information provider based on conversations with the information provider. [Background technology]

[0002] A large language model (LLM) is a type of artificial intelligence trained on large amounts of text data to respond in human language to natural language input. It is a language model consisting of an artificial neural network with many parameters (usually billions or more). Such LLMs are trained on large amounts of unlabeled text using self-supervised or semi-self-supervised learning. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Korean Patent No. 10-2551531 Summary of the Invention [Problem to be solved by the invention]

[0004] A method and system for managing information of an information provider based on a conversation with the information provider is provided. [Means for solving the problem]

[0005] Provided is an information management method for a computer device including at least one processor, the information management method including: providing, by the at least one processor, a conversational information management function to an information provider who wishes to provide content to users of a search service; using the conversational information management function, conducting a conversation between the information provider and a Large Language Models (LLM)-based artificial intelligence; and analyzing the conversation to manage a campaign of the information provider.

[0006] According to one aspect, providing the conversational information management functionality may be characterized in that the conversational information management functionality provides functionality for registering assets for each campaign of the information provider.

[0007] According to another aspect, advancing the conversation may be characterized by the artificial intelligence generating conversation content to provide to the information provider using at least two or more of the information provider's campaigns, assets of each of the information provider's campaigns, prompts of each of the information provider's campaigns, externally collected information, and the conversation content.

[0008] According to another aspect, the assets may include at least one of a Uniform Resource Locator (URL) associated with the content that the information provider wishes to provide, a title of the content, an identification name of the content, a category of the content, multimedia associated with the content, content of the content, and content of an article associated with the content.

[0009] According to another aspect, the prompt may include at least one of a phrase entered by the information provider to be emphasized in connection with the content to be provided, a keyword entered by the information provider to be emphasized in connection with the content to be provided, a tone of an information message included in the content, and a format of the information message.

[0010] According to yet another aspect, the campaign may be characterized as being generated for each purpose for which the information provider wishes to provide content, and including assets and prompts for dynamically generating the content for the corresponding purpose at the time of search.

[0011] According to yet another aspect, managing the campaign may include creating a new campaign using at least one of assets included in a previously created campaign of the information provider and information collected externally in association with the information provider.

[0012] According to yet another aspect, managing the campaign may include modifying the information provider's prompts registered in the information provider's pre-generated campaign based on content of the conversation.

[0013] According to yet another aspect, managing the campaign may include registering a new prompt to a pre-generated campaign of the information provider based on content of the conversation.

[0014] According to yet another aspect, the content provided to the user through the search service may be dynamically generated at the time of the user's search using assets and prompts of the information provider registered for the corresponding campaign, and included in the search results.

[0015] A computer program is provided for causing a computer device to carry out the method.

[0016] A computer-readable recording medium is provided on which a program for causing a computer device to execute the method is recorded.

[0017] The present invention provides a computer device, comprising at least one processor implemented to execute computer readable instructions, the at least one processor providing a conversational information management function to an information provider who wishes to provide content to users of a search service, and the conversational information management function is used to conduct a conversation between an artificial intelligence based on a Large Language Model (LLM) and the information provider, and to manage a campaign of the information provider by analyzing the conversation. Effect of the Invention

[0018] A method and system for managing information of an information provider based on conversations with the information provider may be provided. [Brief description of the drawings]

[0019] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram illustrating an example of a computing device in accordance with an embodiment of the present invention. [Diagram 3] 1 is a diagram illustrating an example of an information management system according to an embodiment of the present invention. [Figure 4] 1 is a flowchart illustrating an example of an information management method in an embodiment of the present invention. [Diagram 5] FIG. 2 illustrates an example of an interactive information management center in accordance with an embodiment of the present invention. [Figure 6] FIG. 2 illustrates an example of an interactive information management center in accordance with an embodiment of the present invention. [Figure 7]FIG. 2 illustrates an example of an interactive information management center in accordance with an embodiment of the present invention. [Figure 8] FIG. 2 illustrates an example of an interactive information management center in accordance with an embodiment of the present invention. [Figure 9] FIG. 2 illustrates an example of an interactive information management center in accordance with an embodiment of the present invention. [Figure 10] FIG. 2 illustrates an example of an interactive information management center in accordance with an embodiment of the present invention. [Figure 11] FIG. 2 is an illustrative diagram illustrating a process for providing answers to user prompts in accordance with one embodiment of the present invention. [Figure 12] FIG. 10 illustrates an example of providing search results in accordance with an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings.

[0021] The information management system according to the embodiment of the present invention may be realized by at least one computer device. In this case, a computer program according to an embodiment of the present invention may be installed and executed in the computer device realizing the information management system, and the computer device may execute the information management method according to the embodiment according to the control of the executed computer program. The above-mentioned computer program may be recorded in a computer-readable recording medium in combination with the computer device to cause the computer to execute the information management method.

[0022] Fig. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Fig. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Fig. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0023] The electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals realized by computer systems. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook PCs, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. As an example, FIG. 1 shows a smartphone as an example of the electronic device 110, but in the embodiment of the present invention, the electronic device 110 may mean one of various physical computer systems that can communicate with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.

[0024] The communication method is not limited, and may include not only a communication method utilizing a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a phase network, etc.) that the network 170 can include, but also a short-range wireless communication between devices. For example, the network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. Furthermore, the network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, etc.

[0025] Each of the servers 150 and 160 may be realized by one or more computer devices that communicate with the multiple electronic devices 110, 120, 130, and 140 via the network 170 to provide instructions, codes, files, contents, services, and the like. For example, the server 150 may be a system that provides a first service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may be a system that provides a second service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide a service (such as a search service, for example) targeted by an application, which is a computer program installed and executed in the multiple electronic devices 110, 120, 130, and 140, as a first service to the multiple electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and executing the above-mentioned applications to the multiple electronic devices 110, 120, 130, and 140.

[0026] 2 is a block diagram showing an example of a computer device according to an embodiment of the present invention. Each of the electronic devices 110, 120, 130, and 140 and the servers 150 and 160 described above may be realized by a computer device 200 shown in FIG.

[0027] Such a computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input / output interface 240, as shown in FIG. 2. The memory 210 is a computer-readable recording medium and may include a random access memory (RAM), a read only memory (ROM), and a permanent mass storage device such as a disk drive. Here, a permanent mass storage device such as a ROM or a disk drive may be included in the computer device 200 as a separate permanent storage device separate from the memory 210. The memory 210 may also store an operating system and at least one program code. Such software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210. Such separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory 210 through a communication interface 230 that is not a computer-readable recording medium. For example, the software components may be loaded into the memory 210 of the computing device 200 based on a computer program installed by a file received over the network 170 .

[0028] The processor 220 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processor 220 by the memory 210 or the communication interface 230. For example, the processor 220 may be configured to execute instructions received according to program code stored in a storage device such as the memory 210.

[0029] The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (for example, the above-mentioned recording device) via the network 170. For example, requests, instructions, data, files, etc. generated by the processor 220 of the computer device 200 according to program codes recorded in a recording device such as the memory 210 may be transmitted to other devices via the network 170 under the control of the communication interface 230. Conversely, signals, instructions, data, files, etc. from other devices may be received by the computer device 200 via the communication interface 230 of the computer device 200 via the network 170. The signals, instructions, data, etc. received via the communication interface 230 may be transmitted to the processor 220 or the memory 210, and the files, etc. may be recorded on a recording medium (the above-mentioned permanent recording device) that the computer device 200 may further include.

[0030] The input / output interface 240 may be a means for interfacing with the input / output device 250. For example, the input device may include a device such as a microphone, a keyboard, or a mouse, and the output device may include a device such as a display and a speaker. As another example, the input / output interface 240 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 250 may be configured as a single device together with the computer device 200.

[0031] Also, in other embodiments, computing device 200 may include fewer or more components than those of Figure 2. However, most prior art components need not be explicitly illustrated. For example, computing device 200 may be implemented to include at least some of the input / output devices 250 described above, and may further include other components such as a transceiver, a database, etc.

[0032] 3 is a schematic diagram of an information management system according to an embodiment of the present invention, showing an information management system 310, a search system 320, a number of users 330, a number of information providers 340, and an interactive information management center 350.

[0033] The search system 320 may correspond to a server (for example, the server 150) that provides a search service to a plurality of users 330, and may be realized by at least one computer device 200. Here, each of the plurality of users 330 may be a physical device of a user that connects to the search system 320 via the network 170 to receive the search service. Each of the plurality of information providers 340 may be a physical device of an information provider that registers information that the information provider intends to provide in the information management system 310. Here, the physical device may be realized by the above-mentioned computer device 200.

[0034] The information management system 310 according to the present embodiment may be included in the search system 320, or may be realized in a form that links with the search system 320 via the network 170. The embodiment of FIG. 3 illustrates an example in which the information management system 310 is realized in a form that is included in the search system 320. In this case, the information management system 310 may be realized on at least one physical device for realizing the search system 320. Depending on the embodiment, the information management system 310 may be realized in a physical device other than the physical device that realizes the search system 320, and may be realized in a form that communicates with the search system 320 via the network 170.

[0035] The search service provided by the search system 320 to the multiple users 330 may include search results corresponding to the user's input. The search results may be generated basically based on information searchable on the web. The search system 320 may also provide a search service by including information provided by the multiple information providers 340 in the search results. Here, the information provided by the multiple information providers 340 may be advertising information, but is not limited thereto. The search service itself that provides such search results is well known, and therefore a detailed description thereof will be omitted.

[0036] Meanwhile, the search system 320 according to the present embodiment may provide a search service by including an answer based on artificial intelligence such as Large Language Models (LLM) in the search results. For example, assume that the search system 320 receives a natural language-based prompt from a specific user among the multiple users 330. In this case, the search system 320 may input the received prompt into the LLM, generate a first answer suitable for the prompt as an LLM result, and provide the user with a search result including the first answer. At this time, the search result may include at least a part of various existing search results in addition to the first answer. In addition, the search system 320 may provide a search service based on a conversation between an LLM-based artificial intelligence and a user. A search service may be provided to a user by switching between a first mode in which a first answer is provided as an LLM result based on a general search service and a second mode in which the first answer is provided as an LLM result based on a conversation between an LLM-based artificial intelligence and a user. At this time, in each of the first and second modes, an instance for the information provider's content may be further provided as a second answer to at least a part of the first answer.

[0037] In addition, the search results may include a second answer generated by at least a part of the information registered by the multiple information providers 340. For example, assume that the search system 320 dynamically generates an AI-based second answer onto which a message of an information provider selected from the multiple information providers 340 is projected. In this case, the search system 320 can provide the user with search results including not only the first answer generated using the LLM but also the AI-based second answer.

[0038] In this case, the search system 320 may dynamically generate the AI-based second answer using a user's prompt, the first answer generated using the LLM, assets registered by the information provider, and / or a prompt registered by the information provider, instead of providing the information provided by the information provider as is. Here, the assets may include, for example, a uniform resource locator (URL) related to the first information to be provided by the information provider, a title or identification name of the first information, a category of the first information, contents of the first information, contents of articles related to the first information, etc. For example, when the information provider intends to advertise a specific product or service, the assets may include a URL related to the product or service, a product name or service name, a category of the product or service, product information or service information, contents of articles related to the product or service, etc. In addition, the prompt registered by the information provider may include information related to a phrase or keyword that the information provider intends to collaborate with in relation to the first information, and a tone or format of an information message to be provided as the second answer, etc. In this way, the search system 320 can dynamically generate a second answer in response to a user's natural language-based prompt, taking into consideration not only the first answer generated using the LLM, but also the registered assets and prompts of an information provider who wishes to provide their own information, and even the first answer. In addition, according to an embodiment, the search system 320 may generate the second answer by further using information about the user. Here, the information about the user may include the user's demo, interests, purchase information, etc., and may be used to customize the second answer for the user.

[0039] In addition, since there may be multiple information providers 340 who wish to disclose their information, the search system 320 may dynamically determine which of the multiple information providers 340 to use for generating the second answer by using their assets and prompts. As an example, the search system 320 may primarily select an information provider associated with the first answer, i.e., the LLM result, from among the multiple information providers 340 based on the first answer. According to an embodiment, the search system 320 may use at least one of the user's prompt, the LLM result, and the recommendation query generated by the LLM when primarily selecting an information provider. Thereafter, the search system 320 may dynamically hold an auction between the primarily selected information providers and select the first information provider as an information provider for generating the second answer. As the auction method, one of well-known methods may be used. For example, a GSP (Generalized Second Price) auction method may be used.

[0040] In this way, the search system 320 can dynamically generate an answer that is dynamically generated based on the assets and prompts of the information provider, i.e., an AI-based second answer in which the message of the information provider is projected, when providing an answer to a natural language-based prompt from a user. Thus, the search system 320 can provide the user with an answer that is dynamically generated so that the message of the information provider is projected in association with the natural language-based prompt received from the user.

[0041] In this case, the information management system 310 may provide an interactive information management center 350 for managing information for generating contents that each of a plurality of information providers 340 intends to provide to a plurality of users 330 through a search service. As an example, the interactive information management center 350 may be created in the form of a web page provided to the information provider, but is not limited thereto.

[0042] The information management system 310 may manage information for generating content that the information provider intends to provide through the search system 320 while interacting in a conversational manner with the information provider connected to the conversational information management center 350 via the network 170. As an example, the information provider may generate a campaign for each purpose for which the information provider intends to provide content through a conversation with the artificial intelligence provided by the conversational information management center 350, and the above-mentioned assets and prompts may be registered in each campaign. For example, the information provider may generate a campaign for each of various purposes desired by the information provider, such as generating a campaign related to a specific event or generating a campaign related to the download of a specific application, and may register the assets and prompts related to each generated campaign for each campaign. For this purpose, the conversational information management center 350 may provide the information provider with a list of the generated campaigns and a function for the information provider to upload assets for each campaign. Meanwhile, the information provider's prompt may be automatically registered by analyzing the conversation between the information provider and the artificial intelligence provided by the conversational information management center 350.

[0043] For example, the information management system 310 can manage the information provider's campaigns, such as improving existing campaigns or creating new campaigns, while interacting with the information provider in a conversational manner using artificial intelligence in the conversational information management center 350. In this case, the artificial intelligence may include a conversational artificial intelligence based on the LLM. Such a conversational artificial intelligence may access campaigns registered in advance for the information provider, assets and prompts for each campaign, and information that can be collected from outside, such as information on the Internet, and may process a conversation with the information provider based on the accessed information and the content of the conversation exchanged with the information provider in the current conversation session.

[0044] 4 is a flowchart showing an example of an information management method according to an embodiment of the present invention. The information management method according to this embodiment may be executed by a computer device 200 that realizes the above-mentioned information management system 310. In this case, the processor 220 of the computer device 200 may be realized to execute control instructions according to the operating system code and at least one computer program code included in the memory 210. Here, the processor 220 may control the computer device 200 so that the computer device 200 executes steps 410 to 440 included in the method of FIG. 4 according to the control instructions provided by the code recorded in the computer device 200.

[0045] In step 410, the computer device 200 may provide a conversational information management function to an information provider who wishes to provide content to users of the search service. Here, the conversational information management function may correspond to the conversational information management center 350 described with reference to FIG. 3. In this case, the computer device 200 may provide a function for registering assets for each campaign of the information provider through the conversational information management function. Such a function may include a function for the information provider to select a specific campaign and upload related assets of various types to the information management system 310.

[0046] In step 420, the computer device 200 may use a conversational information management function to advance a conversation between an artificial intelligence based on a large language model (LLM) and the information provider. As an example, the computer device 200 may use the artificial intelligence to generate conversation content to be provided to the information provider using at least two or more of the information provider's campaign, assets of each campaign of the information provider, prompts of each campaign of the information provider, information collected from the outside, and conversation content. Here, the campaign may be generated for each purpose for which the information provider intends to provide content, and may include assets and prompts for dynamically generating content for the corresponding purpose at the time of search. In this case, the assets may include at least one of a uniform resource locator (URL) related to the content to be provided by the information provider, a title of the content, an identification name of the content, a content category, multimedia related to the content, content of the content, and content of an article related to the content. Here, the multimedia related to the content may include images and videos related to the content. The prompts may also include at least one of a phrase entered by the information provider to be emphasized in association with the content to be provided, a keyword entered by the information provider to be emphasized in association with the content to be provided, a tone of an informational message included in the content, and a format of the informational message.

[0047] In step 430, the computer device 200 may analyze the conversation to manage the information provider's campaign. As an example, the computer device 200 may generate a new campaign using at least one of the assets included in the information provider's pre-generated campaign and information collected from outside related to the information provider. As another example, the computer device 200 may modify the information provider's prompt registered in the information provider's pre-generated campaign based on the content of the conversation. As yet another example, the computer device 200 may register a new prompt in the information provider's pre-generated campaign based on the content of the conversation.

[0048] The content provided to the user through the search service may be dynamically generated at the time of the user's search using assets and prompts from information providers registered for the corresponding campaign, and may be included in the search results.

[0049] 5 to 10 are diagrams showing examples of an interactive information management center in one embodiment of the present invention.

[0050] FIG. 5 illustrates an example of a function of the conversational information management center 350 in which an information provider registers assets and manages the registered assets. A top folder of assets may correspond to a campaign, and each top folder may include a subfolder. A first dotted frame 510 illustrates a list of folders for registered assets, and a second dotted frame 520 illustrates a list of folders for registered assets and files that are assets. An information provider can use the function illustrated in FIG. 5 to check or delete registered assets, and can also register new assets using an "upload" button or the like. In this case, the function illustrated in FIG. 5 may include a user interface 540 for transmitting a prompt to the artificial intelligence, and a conversation with the artificial intelligence can be carried out through such a user interface 540. The embodiment of FIG. 5 illustrates an example in which an information provider requests the artificial intelligence to organize folders and files. In this way, the information management system 310 can provide various functions for managing information of an information provider, such as organizing folders and files related to the information provider's assets based on a conversation between the artificial intelligence of the conversational information management center 350 and the information provider.

[0051] FIG. 6 shows an example of a function of the conversational information management center 350 in which a URL is input as an asset from an information provider, and a robot crawls and collects content corresponding to the URL. For example, assume that a URL is input by the information provider in the first area 610 of FIG. 6. At this time, when the information provider selects the button 620 for archiving, the robot crawls each of the input URLs to collect information corresponding to the URL. In addition, FIG. 6 shows an example in which information regarding the number of URLs input by the user is displayed on the button 620. URLs and information collected through the URLs may also be managed as assets of the information provider. In the embodiment of FIG. 6, an example is shown in which the information provider requests the artificial intelligence to classify the URLs through the user interface 540. In this way, the information management system 310 can provide various functions for managing the information of the information provider, such as classifying similar URLs among the URLs input by the information provider into folders based on a conversation between the artificial intelligence of the conversational information management center 350 and the information provider.

[0052] FIG. 7 illustrates an example in which the artificial intelligence proactively transmits suggestions to the information provider. That is, the artificial intelligence of the conversational information management center 350 can not only provide answers to the information provider's prompts, but also proactively transmit suggestions related to campaign management to the information provider. Such suggestions may be generated based on the information provider's existing campaigns and the assets and / or prompts registered in the campaigns. The embodiment of FIG. 7 illustrates an example in which the information provider rejects the artificial intelligence's suggestions and requests the generation of a new campaign.

[0053] 8 to 10 are diagrams showing an example of a process in which the artificial intelligence generates a new campaign based on a conversation with an information provider. The information management system 310 can generate the contents of the conversation to be provided to the information provider by utilizing information (search results of the AAA brand SNKRS app) collected from the outside (for example, the Internet) by the artificial intelligence in relation to the information provider's prompt, or by utilizing assets (information collected through assets in the form of URLs, images in a specific asset folder) registered in advance by the information provider. In addition, the information management system 310 can obtain and register the information provider's prompt regarding the wording used when generating phrases or keywords to be emphasized (for example, "AAA brand SNKRS", "community", "style") and / or answers (for example, the information provider's content provided to users through a search service).

[0054] 11 is an exemplary diagram illustrating a process of providing an answer to a user's prompt in an embodiment of the present invention. In the embodiment of FIG. 11, an example is described in which an information provider wishes to publish an advertisement for an advertiser's product or service as content to be provided.

[0055] The search system 320 may receive a user prompt 1101 from a user terminal connected via the network 170. As an example, the prompt may correspond to a natural language-based search term input by the user. The user may input the search term into a user interface of a search service provided through the user's terminal, and the search system 320 may receive the search term input into the user interface as the user prompt 1101.

[0056] At this time, the search system 320 may select a prompt to be actually used by analyzing the user prompt 1101 and extracting and summarizing the user intent in the process of extracting and summarizing the user intent (User Intent Extracting & Summarizing) 1102.

[0057] Meanwhile, the search system 320 may guide the user to provide sufficient information to provide an answer that reflects the marketing message of the advertiser. As an example, the content of the user prompt 1101 may be insufficient to match the marketing message of a particular advertiser. In this case, the search system 320 may generate a question to induce additional information for selecting a particular advertiser and may provide the generated question to the user. Thereafter, when an answer to the question is received from the user, the content of the answer may be used to complete the prompt. The question specification prompt 1103 may include a prompt derived from the user's answer.

[0058] At this time, the search system 320 may select a specified user prompt 1104 as a prompt for providing a marketing message. That is, the specified user prompt 1104 may be specified based on a prompt obtained from extraction and summary 1102 of user intent for the user prompt 1101 and a question specification prompt 1103.

[0059] Prompt Ads Safe Check 1105 may be an example of a process that verifies whether a specified user prompt 1104 is a prompt that is OK for exposing an advertiser's marketing message to a user. As an example, the search system 320 may generate and provide an answer if the specified user prompt 1104 is not a prompt requesting pre-defined illegal information or pre-defined non-advertising information.

[0060] The search system 320 may also input specified user prompts 1104 into the LLM to generate LLM results. Figure 11 shows an example of an Organic LLM Result Memory 1106 that stores such LLM results.

[0061] The search system 320 may initially select an advertiser associated with the LLM result based on the LLM result recorded in the organic LLM result memory 1106. In this case, the advertiser associated with the LLM result may be an advertiser who has registered a marketing message that may be published together with the LLM result. The marketing message that may be published together with the LLM result may be selected based on the relevance between the information registered by the advertiser and the LLM result. In addition, according to an embodiment, the search system 320 may use at least one of the user prompt 1104, the LLM result, and a recommendation query generated by a large-scale language model when initially selecting an advertiser. In this case, the search system 320 may initially select an advertiser based on the relevance between at least one of the user prompt 1104, the LLM result, and the recommendation query and the information registered by the advertiser. In this case, the search system 320 may select a specific advertiser from among the advertisers initially selected by the Ad Prompt Auction 1107.

[0062] Once an advertiser is selected, the search system 320 acquires advertisement assets 1108 registered by the selected advertiser and advertiser prompts 1109 registered by the selected advertiser. Here, the advertisement assets 1108 and the advertiser prompts 1109 may correspond to the assets and prompts registered in the conversational information management center 350 for a particular campaign. In this case, the search system 320 may generate an answer prompt 1110 reflecting the advertiser's marketing message by using at least one of the user prompt 1101 and the LLM results recorded in the organic LLM result memory 1106, and at least one of the advertisement assets 1108 and the advertiser prompts 1109. In some embodiments, the advertiser may want to provide an answer in a specific format according to the characteristics of the user. For this reason, the search system 320 may generate the answer prompt 1110 by further reflecting information about the user. As an example, the information about the user may include at least one of the user's demo, interests, and purchase information. For example, the search system 320 may analyze the advertiser prompt 1109 and determine that the advertiser wants to provide more detailed answers to female users than to male users. In this case, the search system 320 may determine the user's gender from the user's demo and then generate the answer prompt 1110 taking into account the determined user's gender.

[0063] After the answer prompt 1110 is generated, the search system 320 may check whether the generated answer prompt 1110 is generated to suit the tone and / or format identified from the advertiser prompt 1109. If the generated answer prompt 1110 does not match the tone and / or format desired by the advertiser, the answer prompt 1110 may be modified to match the tone and / or format desired by the advertiser. In addition, depending on the embodiment, the search system 320 may additionally check whether the generated answer prompt 1110 is safe to be made public, etc.

[0064] Thereafter, the search system 320 may add the finally generated answer 1112 to the search results and provide it to the user through the search service. In addition, in some embodiments, user information (e.g., gender, age, interests, etc.) recorded in a DMP (Data Management Platform) 1113 may be further used to generate the answer prompt 1110. By utilizing such user information, the search system 320 can generate an answer 1112 optimized for the user.

[0065] Fig. 12 is a diagram showing an example of providing search results in an embodiment of the present invention. Fig. 12 shows an example of a screen of a search page 1200 provided to a user through a search service. The search page 1200 may include a user interface 1210 for inputting a user prompt. Furthermore, the search page 1200 may include a search result area 1220 for displaying search results. In this case, the search result area 1220 may include an LLM result area 1230 for displaying LLM results generated based on the LLM in response to the user prompt.

[0066] The search result area 1220 also shows an example of an answer area 1240 that displays an answer generated by the search system 320 in response to a user's prompt. In this embodiment, an example is shown in which a plurality of answers are displayed in the answer area 1240. In this manner, a plurality of answers can be generated and displayed in response to one prompt. It is also possible to generate and display answers for each of two or more information providers. For this reason, the search system 320 may select two or more information providers.

[0067] On the other hand, the embodiment of FIG. 12 illustrates an example in which answers of information providers selected based on a user's prompt input to the user interface 1210 and / or LLM results displayed in the LLM result area 1230 are displayed in the expansion area 1250. For example, the expansion area 1250 may further display answers of information providers selected based on at least one of the user's prompt, the LLM result, and a recommendation query generated by the large-scale language model. If the information provider is an advertiser, the expansion area 1250 may further display advertisements of the advertisers selected based on at least one of the user's prompt, the LLM result, and a recommendation query generated by the large-scale language model.

[0068] Also, the dotted frame 1260 displays a question for requesting an additional prompt from the user in relation to the answer displayed in the expansion area 1250. When the user selects a particular question, this question may be recognized as the user's additional prompt. When providing a conversational search service, the user's additional prompt may be recognized as the user's next conversation. In this case, the search system 320 may generate LLM results and / or answers by taking into account the entire conversation with the user.

[0069] Thus, according to the embodiment of the present invention, a method and system for managing information of an information provider based on a conversation with the information provider can be provided.

[0070] The above-described systems or devices may be realized by hardware components or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software to access, record, manipulate, process, and generate data. For convenience of understanding, a single processing device may be described as being used, but those skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0071] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device, either independently or collectively. The software and / or data may be embodied in any type of machine, component, physical device, virtual device, computer storage medium, or device to be interpreted based on the processing device or to provide instructions or data to the processing device. The software may be distributed and stored or executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0072] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The medium may be a medium that continuously records a program executable by a computer, or a medium that temporarily records the program for execution or download. The medium may be a variety of recording or storage means in the form of a single or multiple hardware devices combined, and may be a medium directly connected to a certain computer system, or may be distributed on a network. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and media configured to record program instructions such as ROMs, RAMs, flash memories, and the like. Other examples of the medium include recording media and storage media managed by app stores that distribute applications, sites that supply or distribute various other software, and servers. Examples of the program instructions include not only machine language codes such as those generated by compilers, but also high-level language codes executed by a computer using an interpreter, etc.

[0073] Although the embodiments have been described based on the limited embodiments and drawings as above, those skilled in the art will be able to make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from that described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a manner different from that described, or may be counterbalanced or replaced by other components or equivalents, and still achieve suitable results.

[0074] Therefore, different embodiments are within the scope of the appended claims provided that they are equivalent to the claims. [Explanation of symbols]

[0075] 310: Information Management System 320: Search system 330: User 340:Informant 350: Conversational Information Management Center

Claims

1. 1. A method for managing information in a computer device including at least one processor, comprising: providing, by said at least one processor, interactive information management functionality for information providers wishing to provide content to users of the search service; The at least one processor is configured to carry out a conversation between a Large Language Model (LLM)-based artificial intelligence and the information provider through the conversational information management function; and analyzing the conversation to manage the information provider's campaign.

2. Providing the interactive information management function includes:

2. The information management method according to claim 1, further comprising providing a function for registering assets for each campaign of the information provider by said interactive information management function.

3. Advancing said conversation: The information management method of claim 1 or 2, further comprising using the artificial intelligence to generate conversation content to be provided to the information provider using at least two or more of the information provider's campaigns, assets of each of the information provider's campaigns, prompts of each of the information provider's campaigns, information collected from outside, and the conversation content.

4. 4. The information management method according to claim 3, wherein the assets include at least one of a URL (Uniform Resource Locator) associated with the content to be provided by the information provider, a title of the content, an identification name of the content, a category of the content, multimedia associated with the content, content of the content, and content of an article associated with the content.

5. 4. The information management method of claim 3, wherein the prompt includes at least one of a phrase entered by the information provider to be emphasized in connection with the content to be provided, a keyword entered by the information provider to be emphasized in connection with the content to be provided, a tone of an information message included in the content, and a format of the information message.

6. The information management method according to claim 1 or 2, wherein the campaign is generated for each purpose for which the information provider wishes to provide content, and includes assets and prompts for dynamically generating the content for the corresponding purpose at the time of search.

7. Managing the campaign includes: The information management method according to claim 1 or 2, further comprising generating a new campaign using at least one of assets included in a previously generated campaign of the information provider and information collected from outside related to the information provider.

8. Managing the campaign includes:

3. The method of claim 1, further comprising modifying the information provider's prompts registered in the information provider's pre-generated campaigns based on the content of the conversation.

9. Managing the campaign includes:

3. The method of claim 1, further comprising: registering a new prompt in a pre-created campaign of the information provider based on the content of the conversation.

10. The information management method of claim 1 or 2, wherein the content provided to the user through the search service is dynamically generated at the time of the user's search using assets and prompts of the information provider registered for the corresponding campaign, and is included in the search results.

11. A computer program product for causing a computer device to carry out the method according to claim 1 or 2.

12. at least one processor implemented to execute computer readable instructions; by said at least one processor, Providing a conversational information management function for information providers who wish to provide content to users of search services, The conversational information management function allows a conversation between an artificial intelligence based on a Large Language Model (LLM) and the information provider, A computer device that analyzes the conversations and manages the information provider's campaigns.

13. and providing said interactive information management functionality by said at least one processor. The computer device of claim 12 , wherein the interactive information management functionality provides functionality for registering assets for each of the information provider's campaigns.

14. by said at least one processor to advance said conversation; The computer device of claim 12 or 13, wherein the artificial intelligence generates conversation content to be provided to the information provider using at least two or more of the information provider's campaigns, assets of each of the information provider's campaigns, prompts of each of the information provider's campaigns, information collected from outside, and the conversation content.

15. by the at least one processor to manage the campaign; generating a new campaign using at least one of pre-created campaign assets of the information provider and externally collected information related to the information provider; modifying a prompt registered in a pre-created campaign of said information provider based on the content of said conversation; or The computer device according to claim 12 or 13, further comprising: registering a new prompt to the pre-generated campaign based on the content of the conversation.

Images