Apparatus and method for managing content for inclusion in query responses

The content operation device and method address the challenge of inconsistent and incomplete responses by integrating fact and deficiency information management to generate and verify content, ensuring accurate and timely reflection in response systems.

KR103043638B1Active Publication Date: 2026-11-11EN HANCE
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
KR1020260124532
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2026-07-07
Publication Date
2026-11-11
Estimated Expiration
2046-07-07

AI Technical Summary

Technical Problem

Existing response systems often generate responses based on outdated, uncertain, or unofficial information, fail to reflect official information, and struggle to access published content due to access restrictions, leading to inconsistent and incomplete responses, especially during information changes like product launches.

Method used

A content operation device and method that integrates fact and deficiency information management to generate and verify content for reflection in responses, identifying and addressing missing, discrepancy, unofficial, and target confusion fields, and ensuring accessibility and conformity.

Benefits of technology

Enhances the likelihood of reflecting accurate and complete information in responses by generating content tailored to deficiencies and verifying accessibility, reducing persistent non-reflection issues and supporting rapid information updates.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112026082543284-PAT00001_ABST
    Figure 112026082543284-PAT00001_ABST
Patent Text Reader

Abstract

The present invention relates to a content operation device and method for reflecting a question and answer. A content operation device according to one embodiment of the present invention includes: a fact information management unit that stores fact information including a plurality of fields regarding a target; a deficiency information acquisition unit that acquires deficiency information regarding a response concerning the target; and a content generation unit that generates content to be reflected in the response based on the fact information and the deficiency information. The content operation device can verify whether the response system can access the content and verify whether the content is reflected after the content is distributed. Accordingly, the possibility of information regarding the target being reflected in the response can be increased.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a content operation device and method, and more specifically, to a content operation device and method for generating and operating content such that the content is reflected in the response to a query. Background Technology

[0003] Response systems that generate responses to queries or provide summaries and citations of documents are widely used. These response systems are provided in various forms, such as answer-type results from search engines, responses from voice assistants or chatbots, and outputs from summaries or recommendation engines. A representative example is a generative artificial intelligence engine that generates answers to natural language queries or summarizes and cites web documents.

[0004] Response systems select portions from a multitude of documents at the time a query is entered to reflect or cite them in the response. However, response systems sometimes generate responses based on outdated, uncertain, or unofficial information, and there are instances where they fail to reflect official information regarding a specific subject even when it exists. Particularly during periods when information changes frequently, such as before and after a product launch, there is a problem where responses differ from official information because the response system prioritizes pre-change information or information written by third parties.

[0005] Conventional search engine optimization techniques focus on ensuring documents appear in search results by considering both humans and search engines. However, conventional methods often fail to provide information—such as dates, prices, identifying details, benefits, purchase channels, comparison criteria, and official calls to action—in a consistent format that is easy for response systems to cite and summarize. Consequently, there is a limitation in that even if content appears in search results, it may not be reflected in the response system's response.

[0006] Furthermore, even if content is created and published, there are cases where the response system cannot actually access it due to policies restricting crawler access, missing index lists, index exclusion settings, access blocking by content delivery networks or web application firewalls, or regional access restrictions. In such cases, the content cannot be reflected in the response even though it has been created, and even if the content is published in an accessible state, the response system is not necessarily guaranteed to cite it.

[0007] Furthermore, when content creation, verification of content accessibility, and verification of whether the content has been actually reflected in the response are performed separately, it is difficult to identify the reasons why content was not reflected in the response and difficult to incorporate the unreflected information into subsequent content creation. Accordingly, a method is required to link content creation and verification to increase the likelihood of reflection in the response. Prior art literature

[0009] Korean Registered Patent No. 10-2816230 (May 29, 2025), AI-based advertising content automatic generation device and method The problem to be solved

[0010] The objective of the present invention is to provide a content operation device and method for operating content so that the content is reflected in the response to a query.

[0011] Another objective of the present invention is to provide a content operation device and method for generating content to be reflected in a response to a query using factual information regarding a target and deficiency information regarding a response.

[0012] Another objective of the present invention is to provide a content operation device and method that identify information not reflected in the response and feed it back into subsequent content generation to increase the possibility of reflection in the response.

[0013] However, the technical problems that the present invention aims to solve are not limited to those described above, and other unmentioned problems can be clearly understood by those skilled in the art from the description of the invention below. means of solving the problem

[0015] According to one embodiment of the present invention, to achieve the above objective, a content operating device is disclosed, comprising: a fact information management unit that stores fact information including a plurality of fields regarding a target; a deficiency information acquisition unit that acquires deficiency information of a response regarding the target; and a content generation unit that generates content to be reflected in the response based on the fact information and the deficiency information.

[0016] In one embodiment, the deficiency information acquisition unit may extract a plurality of response fields regarding the target from the response, and compare each of the extracted plurality of response fields with at least one of the corresponding field of the fact information and the reference information to generate the deficiency information separated by field.

[0017] In one embodiment, the deficiency information may include at least one of a missing field in which information regarding the target is missing from the response, a discrepancy field in which it is reflected differently from the factual information, an unofficial source field in which it is reflected based on an unofficial source, and a target confusion field in which it is reflected in which the target is confused with another target.

[0018] In one embodiment, the content generation unit determines the content to be generated based on the type of field included in the deficiency information and can generate the determined content.

[0019] In one embodiment, the content operation device may further include a reflection verification unit that obtains a post-distribution response obtained for the query after the content is distributed, and verifies whether the content is reflected in the obtained post-distribution response to identify unreflected fields.

[0020] In one embodiment, the reflection verification unit determines the type of cause for non-reflection regarding the non-reflection field, and the content generation unit may change at least one of the type of content to be regenerated and the method of distributing the content based on the determined type of cause for non-reflection.

[0021] In one embodiment, the type of cause of non-reflection may include at least one of a lack of accessibility in which a response system providing a response after distribution cannot access the content, a lack of conformity in which the content does not correspond to the response after distribution, a lack of source trust in which the content does not take precedence over an unofficial source, and a lack of recency in which the content is not reflected at the time of update.

[0022] In one embodiment, the content generation unit can regenerate content corresponding to the unreflected field by using the unreflected field as new deficiency information.

[0023] In one embodiment, the content operating device may further include an accessibility verification unit that verifies whether the response system providing the response to the content is accessible.

[0024] In one embodiment, the accessibility verification unit may check whether access is allowed for each collector identifier of the response system and at least one of a policy file describing a collection policy for the collector.

[0025] In one embodiment, the fact information may include a field regarding at least one of the name, date, price, identification information, function, benefit, purchase channel, and call-to-action information of the object.

[0026] According to one embodiment of the present invention, to achieve the above objective, a method for operating content to be reflected in a response to a query is disclosed, comprising: a step of storing factual information including a plurality of fields regarding a target; a step of obtaining deficiency information of a response regarding the target; and a step of generating content to be reflected in the response based on the factual information and the deficiency information.

[0027] In one embodiment, the step of obtaining the deficiency information may include: a step of extracting a plurality of response fields relating to the target from the response; and a step of comparing each of the extracted plurality of response fields with at least one of the corresponding field of the fact information and reference information to generate the deficiency information separated by field.

[0028] In one embodiment, the deficiency information may include at least one of a missing field in which information regarding the target is missing from the response, a discrepancy field in which it is reflected differently from the factual information, an unofficial source field in which it is reflected based on an unofficial source, and a target confusion field in which it is reflected in which the target is confused with another target.

[0029] In one embodiment, the step of generating the content may include: a step of determining the content to be generated based on the type of field included in the deficiency information; and a step of generating the determined content.

[0030] In one embodiment, the content operation method may further include the step of obtaining a post-distribution response obtained for the query after the content is distributed; and the step of verifying whether the content is reflected in the obtained post-distribution response to identify unreflected fields.

[0031] In one embodiment, the content operation method may further include: a step of determining the type of cause of non-reflection for the non-reflection field; and a step of changing at least one of the type of content to be regenerated and the method of distributing the content based on the determined type of cause of non-reflection.

[0032] In one embodiment, the type of cause of non-reflection may include at least one of a lack of accessibility in which a response system providing a response after distribution cannot access the content, a lack of conformity in which the content does not correspond to the response after distribution, a lack of source trust in which the content does not take precedence over an unofficial source, and a lack of recency in which the content is not reflected at the time of update.

[0033] In one embodiment, the content operation method may further include the step of regenerating content corresponding to the unreflected field by using the unreflected field as new deficiency information.

[0034] In one embodiment, the content operation method may further include a step of verifying whether the response system providing the response to the content is accessible.

[0035] In one embodiment, the step of verifying the accessibility may include checking at least one of the access permission status for each collector identifier of the response system and a policy file describing a collection policy for the collector.

[0036] In one embodiment, the fact information may include a field regarding at least one of the name, date, price, identification information, function, benefit, purchase channel, and call-to-action information of the object. Effects of the invention

[0038] According to one embodiment of the present invention, by receiving factual information regarding a target and information regarding deficiencies in the response together and generating content to be reflected in the response, content can be automatically generated in a way that fills in information that was not reflected in the response. Conventionally, there were cases where content was exposed in search results but was not reflected in the response; however, according to one embodiment of the present invention, by using the result of diagnosing response deficiencies as input for content generation, the possibility of reflection in the response can be increased. Furthermore, by dividing the response into multiple fields and comparing them with factual information, it is possible to specifically identify, on a field-by-field basis, what information is lacking and in what form.

[0039] According to one embodiment of the present invention, by determining the content to be generated based on the type of field included in the deficiency information, content suitable for the type of deficiency can be selectively generated. Furthermore, according to one embodiment of the present invention, it is possible to verify whether the content is reflected in the response after it has been distributed, determine the type of cause for non-reflection regarding the non-reflected fields, and change the type of content to be regenerated or the distribution method. This prevents the repeated generation of the same content from causing the non-reflection state to persist, and allows for the gradual reduction of non-reflected fields by applying different prescriptions according to the cause of non-reflection.

[0040] According to one embodiment of the present invention, by verifying the accessibility of content from the perspective of a collector of a response system providing a response, it is possible to identify in advance a situation where content has been created but cannot be reflected in the response because the response system cannot access it. Furthermore, according to one embodiment of the present invention, by performing the creation of content, verification of the accessibility of content, and verification of whether the content has been reflected in the response in conjunction, the cause of the failure to reflect the content in the response is identified and fed back into subsequent content creation, thereby supporting the rapid reflection of official information in the response even at times when information changes frequently, such as before and after a product launch.

[0041] However, the effects obtainable through the present invention are not limited to those described above, and other unmentioned technical effects will be clearly understood by those skilled in the art from the description of the invention below. Brief explanation of the drawing

[0043] FIG. 1 is a block diagram showing the configuration of a content operation device related to one embodiment of the present invention. FIG. 2 is a diagram showing the data structure of factual information and deficiency information related to an embodiment of the present invention and the relationship of their generation. FIG. 3 is a diagram showing the correspondence between the type of deficiency information and the target content to be generated in relation to one embodiment of the present invention. FIG. 4 is a flowchart illustrating a content operation method related to an embodiment of the present invention. FIG. 5 is a diagram illustrating the process of generating content from factual information and deficiency information related to an embodiment of the present invention. FIG. 6 is a flowchart illustrating a process for verifying accessibility to content related to an embodiment of the present invention. FIG. 7 is a flowchart illustrating a process for verifying whether the content is reflected after it has been distributed, in relation to an embodiment of the present invention. FIG. 8 is a flowchart illustrating a process of determining an unreflected cause type and regenerating content based on the determined cause type, related to an embodiment of the present invention. FIG. 9 is a diagram showing the hardware configuration of a content operating device related to one embodiment of the present invention. Specific details for implementing the invention

[0044] An embodiment of the present invention will be described in detail below with reference to the attached drawings. Prior to this, terms and words used in this specification and claims should not be interpreted as being limited to their ordinary or dictionary meanings. Instead, based on the principle that the inventor can appropriately define the concept of a term to best describe their invention, they should be interpreted in a meaning and concept consistent with the technical spirit of the present invention. Therefore, the embodiments described in this specification and the configurations illustrated in the drawings are merely partial embodiments of the present invention and do not represent all of the technical spirit of the present invention. It should be understood that various equivalents and modifications capable of replacing them may exist at the time of filing this application.

[0045] Additionally, as used herein, “comprise, include” and / or “comprising, including” specify the presence of the mentioned features, numbers, steps, actions, parts, elements, and / or groups thereof, and do not exclude the presence or addition of one or more other features, numbers, actions, parts, elements, and / or groups.

[0046] Additionally, to aid in understanding the invention, the attached drawings are not drawn to actual scale, and the dimensions of some components may be exaggerated. Furthermore, the same reference numerals may be assigned to identical components in different embodiments.

[0047] The statement that two subjects of comparison are 'identical' means that they are 'substantially identical.' Therefore, substantial identity may include deviations considered low in the industry, for example, deviations within 5%. Additionally, the statement that a parameter is uniform in a given area may mean that it is uniform from an average perspective.

[0048] Although terms such as "first," "second," etc., are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are used merely to distinguish one component from another, and unless specifically stated otherwise, the first component may also be the second component.

[0049] Throughout the specification, unless specifically stated otherwise, each component may be singular or plural.

[0050] The fact that any configuration is placed on the "upper (or lower)" of a component or on the "upper (or lower)" of a component may mean not only that any configuration is placed in contact with the upper (or lower) surface of said component, but also that another configuration may be interposed between said component and any configuration placed on (or below) said component.

[0051] Furthermore, where one component is described as being "on," "connected to," or "coupled to" another component, it should be understood that while the components may be directly connected or coupled to each other, another component may be "interposed" between each component, or that each component may be "connected," "coupled," or "coupled" through another component.

[0052] As used herein, the term “and / or” includes any and all combinations of one or more of the associated listed items. Additionally, when describing embodiments of the invention, the use of “may” relates to “one or more embodiments of the invention.” Expressions such as “one or more” preceding a list of elements modify the entire list of elements and do not modify individual elements of the list.

[0053] Throughout the specification, "A and / or B" means A, B, or A and B unless specifically stated otherwise, and "C to D" means C or more and D or less, unless specifically stated otherwise.

[0054] When syntax such as "at least one of A, B, and C", "at least one of A, B, or C", "at least one selected from the group of A, B, and C", or "at least one selected from A, B, and C" is used to specify a list of elements A, B, and C, the syntax can refer to any suitable combination.

[0055] The term "use" may be considered synonymous with the term "utilize." As used herein, terms such as "substantially," "about," and similar terms are used as terms of approximation rather than degree, and are intended to account for the inherent variation of a measured or calculated value that would be recognized by a person skilled in the art.

[0056] In this specification, terms such as first, second, third, etc. may be used to describe various elements, components, regions, layers, and / or sections, but these elements, components, regions, layers, and / or sections should not be limited by these terms. These terms are used to distinguish one element, component, region, layer, or section from another element, component, region, layer, or section. Accordingly, the first element, component, region, layer, or section discussed below may be named the second element, component, region, layer, or section without departing from the teachings of the exemplary embodiments.

[0057] Spatial relative terms such as "beneath," "below," "lower," "above," and "upper" may be used in the specification for ease of description to explain the relationship between one element or feature and other element(s) or feature(s) as illustrated in the drawings. Spatially relative positions are to be understood as encompassing different orientations of the device in use or operation, in addition to the orientations depicted in the drawings. For example, if the device in the drawings is inverted, the other element is understood as "below" or "below," and the described element is understood as "above" or "upper" of the other element. Thus, the term "below" may encompass both the up and down directions.

[0058] The terms used in this specification are intended to describe embodiments of the invention and are not intended to limit the invention.

[0059] In this specification, "query" refers to an input requesting information, and "response" refers to an output provided by a response system in response to the query. "Response system" refers to a system that generates a response to the query or provides a summary or citation of a document, and may include answer-type results of a search engine, a voice assistant, a chatbot, a summary system, and a recommendation system, and as an embodiment thereof, may include a generative artificial intelligence engine that generates an answer to a natural language query or summarizes or cites a web document.

[0060] In this specification, "object" refers to the subject of information intended to be reflected in the response, and may include products, services, people, organizations, or events. "Factual information" refers to structured data comprising a plurality of fields regarding the object, and each field has a value of a specific item regarding the object. "Deficiency information" refers to information regarding a state in which information regarding the object is not reflected or is reflected inaccurately in the response.

[0061] In this specification, "content" refers to information generated to be reflected in the response and may include official text, question-and-answer content, comparison content, structured data, index list items, collection policies, and content for external distribution. "Reflected" means that fields of the content or factual information are cited or included in the response.

[0062] In this specification, "collector" refers to a means used by the response system to collect the content, and may include crawlers and search bots. As an example of factual information regarding the subject, a fact schema structured with fields regarding at least one of a product name, price, release date, stock keeping unit (SKU), feature, benefit, purchase channel, warranty, and call to action (CTA) may be used.

[0063] FIG. 1 is a block diagram showing the configuration of a content operation device related to one embodiment of the present invention.

[0064] Referring to FIG. 1, the content operating device (100) is a device for operating content to be reflected in a response to a query, and includes a fact information management unit (110), a deficiency information acquisition unit (120), and a content creation unit (130). The content operating device (100) may further include at least one of a distribution unit (140), an accessibility verification unit (150), and a reflection verification unit (160). The content operating device (100) may be connected to communicate with a response system (200).

[0065] In fact, the information management unit (110) stores fact information including multiple fields regarding the target.

[0066] The above fact information may include fields regarding at least one of the name, date, price, identification information, function, benefit, purchase channel, and call-to-action information of the above subject. As an example of the above fact information, the fact information management unit (110) may store a fact schema, and the fact schema may be structured with fields regarding at least one of the product name, price, release date, SKU, function, benefit, purchase channel, warranty, and CTA.

[0067] The deficiency information acquisition unit (120) acquires deficiency information of the response regarding the target.

[0068] The deficiency information acquisition unit (120) receives a response provided by the response system (200), extracts a response field regarding the target from the response, and can generate the deficiency information by comparing the extracted response field with at least one of the corresponding field of the fact information and the reference information. The deficiency information may include at least one of a missing field in which information regarding the target is missing from the response, a discrepancy field in which it is reflected differently from the fact information, an unofficial source field reflected based on an unofficial source, and a target confusion field reflected in which the target is confused with another target. As an example of the deficiency information, the deficiency information acquisition unit (120) may acquire GEO deficiency information including at least one of a brand exposure gap, a citation source gap, a call to action gap, a recency gap, and a product name confusion.

[0069] The content generation unit (130) generates content to be reflected in the response based on the fact information and the deficiency information.

[0070] The content generation unit (130) can determine the content to be generated based on the type of field included in the deficiency information and generate the determined content. In one embodiment, the content generation unit (130) can generate different content according to at least one of language, region, and query intent, and can generate the content to have different levels of publicity according to the certain state of the target. Here, the certain state may include at least one of pre-release teasing, embargo, advance notification, pre-order, official sale, and after-sales service. As an example of the content, the content generation unit (130) can generate at least one of an official product page text, FAQs by question intent, a competitor product comparison table, JSON-LD structured data, a sitemap item, a robots or llm.txt policy, a summary for external distribution, and a media briefing template.

[0071] The distribution unit (140) distributes the content generated by the content creation unit (130) so that the response system (200) can access it.

[0072] The distribution unit (140) can perform at least one of posting the content to a public page, registering an index list item corresponding to the content, and setting a collection policy for the collector.

[0073] The accessibility verification unit (150) verifies whether the response system (200) is accessible to the above content.

[0074] The accessibility verification unit (150) can check whether access is allowed for each collector identifier of the response system (200) and at least one of the policy files describing the collection policy for said collector.

[0075] In one embodiment, the verification result of the accessibility verification unit (150) may be provided to the content creation unit (130) or the distribution unit (140), and if the content is determined to be inaccessible, the content may be regenerated or the collection policy may be changed.

[0076] The reflection verification unit (160) verifies whether the content is reflected in the post-distribution response obtained for the above query after the content is distributed.

[0077] The reflection verification unit (160) can verify whether the content is reflected in the response after distribution and identify the unreflected fields.

[0078] In one embodiment, the reflection verification unit (160) determines the type of cause of non-reflection for the non-reflection field, and the content generation unit (130) may change at least one of the type of content to be regenerated and the method of distributing the content based on the determined type of cause of non-reflection. In one embodiment, the content generation unit (130) may regenerate content corresponding to the non-reflection field by using the non-reflection field as new deficiency information.

[0079] The response system (200) is located outside the content operation device (100) and provides the response to the query. The response system (200) can collect the content distributed by the distribution unit (140) through the collector and can provide the response and the post-distribution response to the deficiency information acquisition unit (120) and the reflection verification unit (160). As described above, the response system (200) may include a generative artificial intelligence engine.

[0080] FIG. 2 is a diagram showing the data structure of factual information and deficiency information related to an embodiment of the present invention and the relationship of their generation.

[0081] Referring to FIG. 2, the fact information management unit (110) stores fact information including a plurality of fields regarding a target, and the deficiency information acquisition unit (120) generates deficiency information from a response received from the response system (200), and the generated deficiency information is provided to the content generation unit (130).

[0082] The above factual information is structured data comprising a plurality of fields regarding the above subject. Each of the plurality of fields has a value of a specific item regarding the above subject and may include a field regarding at least one of the name, date, price, identification information, function, benefit, purchase channel, and call-to-action information of the above subject.

[0083] In one embodiment, the fact information may be implemented as a fact schema, and the fact schema may include fields regarding at least one of a product identifier (product_id), canonical product name, localized product names (localized_product_names), release date, price, SKU (sku), key features (key_features), benefits, purchase channels (purchase_channels), warranty, official call-to-action address (official_cta_url), comparison attributes (comparison_attributes), and embargo or publish schedule (embargo_or_publish_schedule). The value of each field is used as correct information regarding the subject and may be used as a standard in the generation of deficiency information and content described below.

[0084] The deficiency information acquisition unit (120) receives a response provided by the response system (200) and extracts a response field regarding the target from the response. The response field is a field value extracted from information regarding the target reflected in the response, and can be extracted to correspond to the field of the fact information.

[0085] In one embodiment, the deficiency information acquisition unit (120) can extract a response field corresponding to at least one of the name, release date, price, purchase channel, behavioral induction information, and citation source of the target from the response.

[0086] The deficiency information acquisition unit (120) compares the extracted response field with at least one of the corresponding field of the fact information and the reference information to generate the deficiency information separated by field. Here, the corresponding field refers to a field of the fact information corresponding to the response field, and the reference information may include information for determining whether the source of the response field is an official source. In one embodiment, the deficiency information acquisition unit (120) may determine at least one of whether the response field matches the corresponding field, whether a value corresponding to the response field exists in the response, and whether the source of the response field is an official source according to the reference information.

[0087] The above deficiency information includes deficiency records separated by field, and each deficiency record may have an identifier of the corresponding field and type information indicating the type of deficiency. The type of deficiency may include at least one of a missing field in which information regarding the subject is missing from the response, a discrepancy field in which it is reflected differently from the factual information, an unofficial source field in which it is reflected based on an unofficial source, and a subject confusion field in which the subject is confused with another subject. In one embodiment, the missing field is generated when a value corresponding to the response field does not exist in the response, the discrepancy field is generated when the response field is different from the corresponding field, the unofficial source field is generated when the source of the response field is not an official source according to the reference information, and the subject confusion field may be generated when the subject reflected in the response is confused with another subject.

[0088] In one embodiment, the deficiency information may be generated from at least one of the brand mention, product mention, key message, sentiment, call-to-action information, primary citation source, other citation sources, recency, and rumor analysis of the final output. As one embodiment of the deficiency information, the deficiency information acquisition unit (120) may generate GEO deficiency information including at least one of a brand exposure gap, a citation source gap, a call-to-action gap, a recency gap, and product name confusion.

[0089] The content generation unit (130) receives the factual information and the deficiency information and generates content to be reflected in the response. In one embodiment, the content generation unit (130) may determine the content to be generated based on the type and field information of the deficiency record included in the deficiency information, and this will be described later with reference to FIG. 3.

[0090] FIG. 3 is a diagram showing the correspondence between the type of deficiency information and the target content to be generated in relation to one embodiment of the present invention.

[0091] Referring to FIG. 3, the content generation unit (130) can determine the content to be generated based on the type of field included in the deficiency information and can generate the determined content. Here, the type of the field may be determined by the type information of the deficiency record included in the deficiency information, and the type information may represent at least one of a missing field, a discrepancy field, an unofficial source field, and a target confusion field.

[0092] The content generation unit (130) can determine the content by utilizing the correspondence relationship between the type of the deficiency information and the content to be generated. The correspondence relationship can be defined such that one type corresponds to one or more contents, and can be stored in the form of a predetermined rule or a correspondence table.

[0093] In one embodiment, when the deficiency information includes the missing field, the content generation unit (130) may generate at least one of an official text and a question-and-answer content that includes information corresponding to the missing field. Since the missing field corresponds to a case where information regarding the target is not reflected in the response, the content generation unit (130) may enable the information to be reflected in the response by generating content that explicitly includes information regarding the target.

[0094] In one embodiment, when the deficiency information includes the discrepancy field, the content generation unit (130) may generate or update at least one of structured data and a formal text corresponding to the discrepancy field. Since the discrepancy field corresponds to cases where the response reflects a value different from the factual information, the content generation unit (130) may induce the response to reflect a value that matches the factual information by providing structured data having an accurate value.

[0095] In one embodiment, when the deficiency information includes the unofficial source field, the content generation unit (130) may generate at least one of external distribution content and a collection policy. Since the unofficial source field corresponds to cases where the response cites a source other than the official source, the content generation unit (130) may induce the response to cite the official source by generating external distribution content that can be cited from the official source or by generating a collection policy that causes the collector to access the official source.

[0096] In one embodiment, when the deficiency information includes the target confusion field, the content generation unit (130) may generate at least one of comparison content and question-and-answer content. Since the target confusion field corresponds to a case where the response reflects confusion of the target with another target, the content generation unit (130) may induce the response to accurately identify the target by generating comparison content that distinguishes the target from the other target or question-and-answer content that identifies the target.

[0097] The above correspondence relationship is not limited to the examples described above, and two or more contents may correspond to a single deficiency type, and the same content may correspond to different deficiency types. In one embodiment, when the deficiency information includes a plurality of types, the content generation unit (130) may determine content corresponding to each type and generate the determined plurality of contents.

[0098] In one embodiment, the content generation unit (130) may generate the content determined according to the corresponding relationship differently according to at least one of language, region and query intent. As an example of the content, the official text may be an official product page text, the question and answer content may be an FAQ by question intent, the comparison content may be a comparison table of competing products, the structured data may be JSON-LD structured data, the external distribution content may be an external distribution summary or media briefing template, and the collection policy may be a robots or llm.txt policy.

[0099] FIG. 4 is a flowchart illustrating a content operation method related to an embodiment of the present invention.

[0100] Referring to FIG. 4, a content operation method may be performed by a content operation device (100) and may include the steps of creating content, verifying multilingual terms, verifying distribution accessibility, distributing the content, re-inquiring to a response system, verifying whether it is reflected, and finalizing the content. The order of the steps described below is exemplary, and as necessary, the order may be changed, some steps may be omitted, and other steps may be added.

[0101] The content operation device (100) can receive fact information stored in the fact information management unit (110) and deficiency information obtained by the deficiency information acquisition unit (120). The process of storing and acquiring the fact information and the deficiency information may be as described with reference to FIG. 2. In one embodiment, the fact information may be a fact schema, and the deficiency information may be GEO deficiency information.

[0102] The content management device (100) can generate content to be reflected in the response based on the fact information and the deficiency information (S110). In one embodiment, the content management device (100) can determine the content to be generated based on the type of field included in the deficiency information and generate the determined content. As an example of the content, the content management device (100) can generate a content package including a plurality of content, and the content package may include at least one of an official product page text, FAQs by question intent, a competitor product comparison table, JSON-LD structured data, a sitemap item, a robots or llm.txt policy, a summary for external distribution, and a media briefing template.

[0103] The content management device (100) can verify multilingual terms for the generated content (S120). In one embodiment, the content management device (100) can verify the consistency of terms in the content using at least one of a country-specific glossary and a forbidden word rule, and can verify the consistency of terms corresponding to each language or region if the content is generated differently by language or region. Step S120 may be omitted as necessary.

[0104] The content operation device (100) can verify the distribution accessibility of the content (S130). In one embodiment, the content operation device (100) can verify whether the response system (200) for the content is accessible, and this will be described later with reference to FIG. 6.

[0105] The content management device (100) can distribute the content so that the response system (200) can access it (S140). In one embodiment, the content management device (100) can perform at least one of posting the content to a public page, registering an index list item corresponding to the content, and setting a collection policy for the collector.

[0106] The content management device (100) may re-submit a request to the response system (200) after the content has been distributed (S150). In one embodiment, the content management device (100) may re-submit at least one of a reference prompt and a prompt related to the reference prompt to the response system (200) to obtain a post-distribution response corresponding to the query. In one embodiment, the response system (200) may be a generative artificial intelligence engine, and the content management device (100) may re-submit the reference prompt to the generative artificial intelligence engine.

[0107] The content management device (100) can verify whether the content is reflected in the response after distribution (S160). In one embodiment, the content management device (100) can verify whether the content is reflected in the response after distribution and identify the unreflected fields, which will be described later with reference to FIG. 7.

[0108] The content management device (100) can confirm the content when it is determined that the content is reflected in the response after distribution (S170). In one embodiment, the content management device (100) can store the content package as a confirmed content package or maintain the distribution state.

[0109] If the content management device (100) determines that the content is not reflected in the response after distribution, it may return to the step (S110) of generating the content using the unreflected field as new deficiency information. In this case, the content management device (100) may regenerate the content based on the new deficiency information and may perform steps S120 to S160 again on the regenerated content.

[0110] In one embodiment, the content operation device (100) may generate the content having different levels of disclosure depending on a certain state of the target when generating the content. The certain state may include at least one of pre-release teasing, embargo, advance notification, pre-reservation, official sales, and post-sales service, and the content operation device (100) may generate a disclosure text and a document for the response system at different levels of disclosure depending on the certain state.

[0111] FIG. 5 is a diagram illustrating the process of generating content from factual information and deficiency information related to an embodiment of the present invention.

[0112] Referring to FIG. 5, the content generation unit (130) can receive fact information and deficiency information and generate content to be reflected in the response. FIG. 5 illustrates a case where a fact schema is used as an example of the fact information and GEO deficiency information is used as an example of the deficiency information.

[0113] The content generation unit (130) may receive the fact schema as the factual information. In one embodiment, the fact schema may include a field regarding at least one of the name, price, SKU, and release date of the target, and the value of each field may be used as correct information regarding the target. The content generation unit (130) may receive the GEO deficiency information as the deficiency information. In one embodiment, the GEO deficiency information may include at least one of a brand exposure gap, a citation source gap, a call to action gap, and a recency gap.

[0114] The content generation unit (130) can determine the content to be generated based on the fact schema and the GEO deficiency information, according to the type of field included in the deficiency information, and generate the determined content. In one embodiment, the content generation unit (130) can generate the content in a direction that supplements the deficiency indicated by the deficiency information by using the field value of the fact schema, which is the correct answer information regarding the target.

[0115] The content creation unit (130) can create a content package that includes a plurality of contents as the content. In one embodiment, the content package may include at least one of an official product page text, FAQs by question intent, a competitor product comparison table, JSON-LD structured data, a sitemap item, a robots or llm.txt policy, a summary for external distribution, and a media briefing template.

[0116] The above official product page text may be a text intended to provide information regarding the subject on an official page as an example of the above official text. The above FAQ by question intent may be a text intended to provide information regarding the subject on an official page as an example of the above question-and-answer content, and may include standard answers categorized by question intent. The above competitor product comparison table may be a text intended to include comparison information to distinguish the subject from other subjects as an example of the above comparison content. The above JSON-LD structured data may be a text intended to represent factual information regarding the subject in a structured format as an example of the above structured data. The above sitemap item may be a text intended to be an example of the above index list item, and the above robots or llm.txt policy may be a text intended to be an example of the above collection policy. The above summary for external distribution and the above media briefing template may be a text intended to be an example of the above external distribution content, and may be content intended to distribute information regarding the subject to external media.

[0117] In one embodiment, the content generation unit (130) can generate FAQs, competitor product comparison tables, or summaries for external distribution for the same target according to at least one of country, language, and query intent by using at least one of country-specific language, product localization dictionary, correction dictionary, official call-to-action address, and competitor product response table. In one embodiment, the content generation unit (130) can generate content corresponding to the deficiency when the GEO deficiency information is generated from at least one of the brand mention, product mention, key message, sentiment, call-to-action information, primary citation source, other citation source, recency, and rumor analysis of the final output.

[0118] In one embodiment, the content generation unit (130) may generate the content with different levels of disclosure depending on the certain state of the target when generating the content. For example, during the teasing period prior to the release date of the target, some information may not be exposed on the public page, but structured data and sitemap items may be prepared in advance to match the time when disclosure is possible, and after the release date, official product page text and a competitor product comparison table may be generated.

[0119] FIG. 6 is a flowchart illustrating a process for verifying accessibility to content related to an embodiment of the present invention.

[0120] Referring to FIG. 6, the accessibility verification unit (150) can verify whether the response system (200) for the content is accessible. The accessibility verification unit (150) can perform the steps of obtaining the address of the generated content, examining the accessibility verification items for the content, determining the verification result, and determining whether distribution is possible based on the verification result.

[0121] The accessibility verification unit (150) can obtain the address of the generated content (S210). In one embodiment, the address may be an internet address (URL) indicating the location where the content is distributed or will be distributed.

[0122] The accessibility verification unit (150) can check accessibility verification items for the above content (S220).

[0123] In one embodiment, the accessibility verification item may include at least one of the following: the response status code of the content, canonical and hreflang, noindex status, whether access is restricted under the collection policy, whether an index list is included, whether there are errors in the structured data, and whether access to the collector of the response system (200) is possible. In one embodiment, the accessibility verification unit (150) can check the Hypertext Transfer Protocol (HTTP) status code as the response status code, check whether robots.txt is disallowed as the access restriction under the collection policy, check whether a sitemap is included as the index list inclusion, and check for errors in the structured data as the structured data error.

[0124] In one embodiment, the accessibility verification unit (150) may check whether access is allowed for each collector identifier of the response system (200) and at least one of a policy file describing a collection policy for said collector. Here, said collector identifier may include a user-agent identifying said collector, and said policy file may include robots or llm.txt. In one embodiment, the accessibility verification unit (150) may verify accessibility for people or search engines as well as accessibility for said collectors of the response system (200) by checking whether access to said content is allowed for each said collector identifier.

[0125] In one embodiment, the accessibility verification unit (150) may check at least one of the regional address, the language-specific hreflang, and the cache status of the content delivery network (CDN) together when the content is provided at different addresses by region. In one embodiment, the accessibility verification unit (150) may check the accessibility and consistency of at least one of the document provided for the response system (200), the policy file, the index list item, the canonical, and the hreflang as well as the public page.

[0126] The accessibility verification unit (150) can determine the verification result based on the inspection result of the accessibility verification item (S230). In one embodiment, the accessibility verification unit (150) can determine that the content is inaccessible to the response system (200) if at least one of the accessibility verification items does not meet a predetermined standard, and can determine that the content is accessible if the accessibility verification item meets the standard.

[0127] The accessibility verification unit (150) may generate a modification request if the verification result indicates that it is inaccessible (S240). In one embodiment, the modification request may include information indicating an accessibility verification item that does not meet the criteria and may be provided to the content creation unit (130) or the distribution unit (140). In this case, the content creation unit (130) may regenerate the content, and the distribution unit (140) may change the collection policy or update the index list item.

[0128] The accessibility verification unit (150) may determine that the content is distributable if the verification result indicates accessibility (S250). In one embodiment, the content determined to be distributable may be distributed by the distribution unit (140) so that the response system (200) can access it.

[0129] FIG. 7 is a flowchart illustrating a process for verifying whether the content is reflected after it has been distributed, in relation to an embodiment of the present invention.

[0130] Referring to FIG. 7, the reflection verification unit (160) can verify whether the content is reflected after the content has been distributed. The reflection verification unit (160) can perform steps such as a step of completing distribution, a step of re-inquiring a reference prompt, a step of collecting responses, a step of comparing whether the content is reflected, a step of determining whether a key field is reflected, and a step of recording the success of the reflection or identifying the unreflected field based on the result of the determination.

[0131] The reflection verification unit (160) may start reflection verification when the distribution of the content is completed (S310). In one embodiment, the reflection verification unit (160) may start reflection verification when a predetermined time has elapsed after the content has been distributed by the distribution unit (140).

[0132] The reflection verification unit (160) may resubmit a reference prompt to the response system (200) (S320). In one embodiment, the reflection verification unit (160) may resubmit at least one of the reference prompt and a prompt related to the reference prompt to the response system (200). In one embodiment, the response system (200) may be a generative artificial intelligence engine, and the reflection verification unit (160) may resubmit the reference prompt to the generative artificial intelligence engine.

[0133] The reflection verification unit (160) can collect a post-distribution response corresponding to the above re-inquiry (S330). In one embodiment, the post-distribution response may be a response provided by the response system (200) to the above query after the content has been distributed.

[0134] The reflection verification unit (160) can compare whether the content is reflected in the response after distribution (S340). In one embodiment, the reflection verification unit (160) can extract a response field regarding the target from the response after distribution and compare the extracted response field with a corresponding field of fact information to determine whether it is reflected for each field of fact information. In one embodiment, if the fact information is a fact schema, the reflection verification unit (160) can compare whether the content is reflected in the response after distribution for each field of the fact schema.

[0135] The reflection verification unit (160) can determine whether the core field of the fact information is reflected in the response after distribution (S350). In one embodiment, the core field may be a predetermined field among the fields of the fact information and may include at least one of the name, price, release date, benefit, and action induction information of the target.

[0136] The reflection verification unit (160) can record a reflection success when it is determined that the core field is reflected (S360). In one embodiment, the reflection verification unit (160) can record the field reflected in the response after distribution as a reflection success, and can save the content as confirmed content or maintain the distribution state.

[0137] The reflection verification unit (160) can identify the unreflected field if it is determined that the core field is not reflected (S370). In one embodiment, the reflection verification unit (160) can identify the field that is not reflected in the response after distribution as the unreflected field.

[0138] The reflection verification unit (160) may store the above-mentioned unreflected field as new deficiency information (S380). In one embodiment, the reflection verification unit (160) may provide or store the above-mentioned unreflected field to the deficiency information acquisition unit (120) as new deficiency information regarding the target. In one embodiment, the reflection verification unit (160) may verify the accuracy of the above-mentioned unreflected field by connecting the verification result of the post-distribution response with the quality judgment result of the final output or the country-specific response standard verification result.

[0139] Upon request from the reflection verification unit (160), the content generation unit (130) can regenerate content corresponding to the unreflected field based on the new deficiency information (S390). In one embodiment, the regenerated content can be redistributed by the distribution unit (140), and the reflection verification unit (160) can re-verify whether the redistributed content is reflected. In this way, as the unreflected field is fed back as new deficiency information, the reflection verification and regeneration can be repeated until the information regarding the target is reflected in the response after distribution.

[0140] In one embodiment, when regenerating content corresponding to the unreflected field, the reflection verification unit (160) can determine the type of cause of non-reflection for the unreflected field, and the content generation unit (130) can change at least one of the type of content to be regenerated and the method of distributing the content based on the determined type of cause of non-reflection, and this will be described later with reference to FIG. 8.

[0141] FIG. 8 is a flowchart illustrating a process of determining an unreflected cause type and regenerating content based on the determined cause type, related to an embodiment of the present invention.

[0142] Referring to FIG. 8, the reflection verification unit (160) can determine the type of cause of non-reflection for the non-reflection field, and the content creation unit (130) can change at least one of the type of content to be regenerated and the method of distributing the content based on the determined type of cause of non-reflection. This prevents the same content from being repeatedly generated and the non-reflection state from continuing, and by applying different content or distribution methods according to the cause of non-reflection, the possibility of the non-reflection field being reflected in the response after distribution can be increased.

[0143] The reflection verification unit (160) can identify unreflected fields that are not reflected in the response after distribution (S410). The unreflected fields can be identified as described with reference to FIG. 7.

[0144] The reflection verification unit (160) can obtain observation information to determine the type of cause of non-reflection for the non-reflection field (S420). In one embodiment, the observation information may include at least one of the access record of a collector of the response system (200) for the content, the source cited in the response after distribution, the degree of semantic correspondence between the response after distribution and the content, and the time of update of the information reflected in the response after distribution.

[0145] The reflection verification unit (160) can determine whether there is no access record of the collector for the content or whether access is denied (S430). If it is determined that there is no access record or access is denied, the reflection verification unit (160) can determine the type of cause of non-reflection as lack of accessibility, and the content creation unit (130) or the distribution unit (140) can perform at least one of changing the access permission policy for the collector and updating the index (S440). In one embodiment, if it is determined that there is a lack of accessibility, the content creation unit (130) does not regenerate the content, and the distribution unit (140) can change the access permission policy or update the index.

[0146] If it is determined that the access record is not absent and access is not denied, the reflection verification unit (160) can determine whether the semantic consistency between the post-distribution response and the content is less than a threshold value (S450). If it is determined that the semantic consistency is less than the threshold value, the reflection verification unit (160) can determine the type of cause of non-reflection as lack of suitability, and the content creation unit (130) can regenerate the content by changing its format (S460). In one embodiment, the content creation unit (130) can change the descriptive text into question-and-answer content, create additional comparison content, or add structured data that identifies the target.

[0147] If the above semantic consistency is determined to be greater than or equal to the above threshold value, the reflection verification unit (160) can determine whether the response after distribution cited an unofficial source (S470). If the response after distribution is determined to have cited an unofficial source, the reflection verification unit (160) can determine the type of cause of non-reflection as lack of source trust, and the content creation unit (130) can create content for external distribution and switch the distribution target of the content to an external medium (S480). In one embodiment, if it is determined to be lack of source trust, the content creation unit (130) can change the distribution method instead of regenerating the same content.

[0148] If it is determined that the response after distribution does not cite an unofficial source, the reflection verification unit (160) can determine whether the update time of the information reflected in the response after distribution is earlier than the update time of the factual information (S490). If it is determined that the update time of the reflected information is earlier than the update time of the factual information, the reflection verification unit (160) can determine the type of cause of non-reflection as lack of recency, and the content creation unit (130) or the distribution unit (140) can re-perform the index update request or re-verify whether it is reflected after a predetermined waiting time has elapsed (S500).

[0149] The content creation unit (130) or the distribution unit (140) may perform a conversion operation based on the determined type of cause of non-reflection (S510). In one embodiment, the conversion operation may include at least one of changing the type of content regenerated according to the type of cause of non-reflection and changing the method of distribution of the content. In one embodiment, the determination of the type of cause of non-reflection may be performed in the order of accessibility deficiency, suitability deficiency, source trust deficiency, and recency deficiency, thereby first resolving the accessibility deficiency that can be resolved deterministically, followed by the suitability deficiency that can be resolved by changing the format of the content, and the source trust deficiency that can be resolved by converting the distribution target, in sequence.

[0150] The content creation unit (130) or the distribution unit (140) may redistribute the content after the conversion operation is performed, and the reflection verification unit (160) may re-verify whether the redistributed content is reflected (S520). In one embodiment, if the result of the re-verification is that the unreflected field is reflected in the response after distribution, the reflection verification unit (160) may record this as a successful reflection, and if it is not reflected, the unreflected field may be stored again as new deficiency information.

[0151] In one embodiment, the type of cause of non-reflection may include at least one of a lack of accessibility in which the response system (200) cannot access the content, a lack of suitability in which the content does not correspond to the response after distribution, a lack of source trust in which the content does not take precedence over an unofficial source, and a lack of recency in which the content is not reflected at the time of update.

[0152] FIG. 9 is a diagram showing the hardware configuration of a content operating device related to one embodiment of the present invention.

[0153] Referring to FIG. 9, the content operating device (900) may include a processor (910) and a memory (920). The content operating device (900) may correspond to the content operating device (100) of FIG. 1, and FIG. 9 shows an embodiment in which the content operating device (100) is implemented in hardware.

[0154] The processor (910) can be connected to memory (920) and can execute instructions stored in memory (920). In one embodiment, the processor (910) can perform at least one operation of the fact information management unit (110), deficiency information acquisition unit (120), content creation unit (130), distribution unit (140), accessibility verification unit (150), and reflection verification unit (160) of FIG. 1 by executing the instructions. That is, each of the above units can be implemented as a software module executed by the processor (910), can be implemented as a hardware module, or can be implemented as a combination of software and hardware.

[0155] The processor (910) may be composed of one or more. In one embodiment, the processor (910) may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, an application processor, an application-specific integrated circuit (ASIC), and a field programmable gate array (FPGA), but is not limited to the examples described herein.

[0156] The memory (920) can store instructions executed by the processor (910) and can store data necessary for the operation of the content operating device (900). In one embodiment, the memory (920) can store at least one of the fact information, the deficiency information, and the content. In one embodiment, the memory (920) may include at least one of volatile memory and non-volatile memory, and may include at least one of RAM, ROM, flash memory, hard disk drive, and solid-state drive.

[0157] In one embodiment, the content operation device (900) may further include a communication unit. The communication unit may communicate with a response system (200), and the distribution unit (140) may distribute the content, or the deficiency information acquisition unit (120) and the reflection verification unit (160) may perform communication to receive the response and the response after distribution. In one embodiment, the content operation device (900) may be implemented as a single device, or it may be implemented as a distributed system in which a plurality of devices operate in conjunction.

[0158] In one embodiment, instructions for implementing the operation of a content operation device (900) may be stored in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files and data structures, etc., either individually or in combination, and the aforementioned content operation method may be performed when the instructions are executed by a processor (910).

[0159] As described above, according to one embodiment of the present invention, by receiving factual information regarding a target and information regarding deficiencies in the response together and generating content to be reflected in the response, content can be automatically generated in a way that fills in information that was not reflected in the response. Conventionally, there were cases where content was exposed in search results but was not reflected in the response; however, according to one embodiment of the present invention, by using the result of diagnosing response deficiencies as input for content generation, the possibility of reflection in the response can be increased. Furthermore, by dividing the response into multiple fields and comparing them with factual information, it is possible to specifically identify, on a field-by-field basis, what information is lacking and in what form.

[0160] According to one embodiment of the present invention, by determining the content to be generated based on the type of field included in the deficiency information, content suitable for the type of deficiency can be selectively generated. Furthermore, according to one embodiment of the present invention, it is possible to verify whether the content is reflected in the response after it has been distributed, determine the type of cause for non-reflection regarding the non-reflected fields, and change the type of content to be regenerated or the distribution method. This prevents the repeated generation of the same content from causing the non-reflection state to persist, and allows for the gradual reduction of non-reflected fields by applying different prescriptions according to the cause of non-reflection.

[0161] According to one embodiment of the present invention, by verifying the accessibility of content from the perspective of a collector of a response system providing a response, it is possible to identify in advance a situation where content has been created but cannot be reflected in the response because the response system cannot access it. Furthermore, according to one embodiment of the present invention, by performing the creation of content, verification of the accessibility of content, and verification of whether the content has been reflected in the response in conjunction, the cause of the failure to reflect the content in the response is identified and fed back into subsequent content creation, thereby supporting the rapid reflection of official information in the response even at times when information changes frequently, such as before and after a product launch.

[0162] Meanwhile, the method according to the present invention is written as a program executable on a computer and can be implemented on various recording media such as magnetic storage media, optical reading media, and digital storage media.

[0163] Implementations of the various technologies described herein may be implemented in digital electronic circuits, computer hardware, firmware, software, or a combination thereof. Such implementations may be implemented as computer programs stored on a computer-readable storage medium to control the operation of a data processing device. Such implementations may be implemented as computer program products, i.e., information carriers, such as computer programs stored on a machine-readable storage device or a computer-readable non-transient storage medium, for processing by the operation of a data processing device, e.g., a programmable processor, a computer, or a plurality of computers, or for controlling such operation. Computer programs such as the computer program(s) described above may be written in any form of programming language including compiled or interpreted languages, and may be deployed in any form including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. Computer programs may be deployed to be processed on one computer or a plurality of computers at a single site, or distributed across a plurality of sites and interconnected by a communication network.

[0164] Processors suitable for processing computer programs include, for example, both general-purpose and special-purpose microprocessors, and any one or more processors of any type of digital computer. Generally, the processor will receive instructions and data from read-only memory or random access memory, or both. The elements of the computer may include at least one processor that executes instructions and one or more memory devices that store instructions and data. Generally, the computer may include one or more mass storage devices that store data, for example, magnetic, magneto-optical disks, or optical disks, or may be combined to receive data from these, transmit data to these, or both. Information carriers suitable for embodying computer program instructions and data include, for example, semiconductor memory devices, magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs (Compact Disk Read Only Memory) and DVDs (Digital Video Disks); magneto-optical media such as floptical disks; ROMs (Read Only Memory); RAMs (Random Access Memory); flash memory; EPROMs (Erasable Programmable ROM); EEPROMs (Electrically Erasable Programmable ROM); etc. Processors and memory may be supplemented by or included in special-purpose logic circuit organizations.

[0165] Although this specification contains details of a number of specific embodiments, they should not be understood as limiting the scope of any invention or claimables, but rather as descriptions of features that may be characteristic of a specific embodiment of a specific invention. Specific features described in this specification in the context of individual embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments individually or in any appropriate sub-combination. Furthermore, while features may operate in a specific combination and be described as initially claimed, one or more features from the claimed combination may be excluded from the combination in some cases, and the claimed combination may be changed to a sub-combination or a variation of the sub-combination.

[0166] Likewise, although operations are depicted in the drawings in a specific order, this should not be understood as requiring that such operations be performed in that specific or sequential order depicted to obtain a desirable result, or that all depicted operations must be performed. In certain cases, multitasking and parallel processing may be advantageous. Furthermore, the separation of the various device components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and devices can generally be integrated together into a single software product or packaged into multiple software products.

[0167] Meanwhile, the embodiments of the present invention disclosed in this specification and drawings are merely specific examples provided to aid understanding and are not intended to limit the scope of the present invention. It is obvious to those skilled in the art that other variations based on the technical concept of the present invention are possible in addition to the embodiments disclosed herein.

[0168] [Explanation of the symbol]

[0169] 100: Content Management Device

[0170] 110: Fact Information Management Department

[0171] 120: Deficiency Information Acquisition Unit

[0172] 130: Content Creation Section

[0173] 140: Distribution section

[0174] 150: Accessibility Verification Department

[0175] 160: Reflection Verification Department

[0176] 200: Response System

[0177] 900: Content Management Device

[0178] 910: Processor

[0179] 920: Memory

Claims

Claim 1 A content operating device for operating content to be reflected in a response to a query, comprising: a fact information management unit that stores fact information including a plurality of fields regarding a target; a deficiency information acquisition unit that acquires deficiency information of a response regarding the target; and a content generation unit that generates content to be reflected in the response based on the fact information and the deficiency information. Claim 2 A content operation device according to claim 1, wherein the deficiency information acquisition unit extracts a plurality of response fields regarding the target from the response, and compares each of the extracted plurality of response fields with at least one of the corresponding field of the fact information and the reference information to generate the deficiency information separated by field. Claim 3 A content operation device according to paragraph 2, wherein the deficiency information comprises at least one of a missing field in which information regarding the subject is missing in the response, a discrepancy field in which it is reflected differently from the factual information, an unofficial source field in which it is reflected based on an unofficial source, and a subject confusion field in which it is reflected in which the subject is confused with another subject. Claim 4 In paragraph 3, the content generation unit determines the content to be generated based on the type of field included in the deficiency information, and generates the determined content, a content operation device. Claim 5 In claim 1, the content operating device further comprises a reflection verification unit that obtains a post-distribution response obtained in response to the query after the content is distributed, and verifies whether the content is reflected in the obtained post-distribution response to identify non-reflected fields. Claim 6 A content operation device according to claim 5, wherein the reflection verification unit determines the type of cause of non-reflection for the non-reflection field, and the content generation unit changes at least one of the type of content to be regenerated and the method of distributing the content based on the determined type of cause of non-reflection. Claim 7 A content operating device according to claim 6, wherein the above-mentioned type of cause of non-reflection includes at least one of: a lack of accessibility in which a response system providing a response after distribution cannot access the content; a lack of conformity in which the content does not correspond to the response after distribution; a lack of source trust in which the content does not take precedence over an unofficial source; and a lack of recency in which the content is not reflected at the time of update. Claim 8 In paragraph 5, the content generation unit is a content operation device that regenerates content corresponding to the unreflected field by using the unreflected field as new deficiency information. Claim 9 In claim 1, the content operating device further comprises an accessibility verification unit that verifies whether the response system providing the response to the content is accessible. Claim 10 In claim 9, the accessibility verification unit examines at least one of the following: whether access is allowed for each collector identifier of the response system, and a policy file describing a collection policy for the collector. Claim 11 A content operating device according to claim 1, wherein the factual information comprises a field relating to at least one of the name, date, price, identification information, function, benefit, purchase channel, and induction information of the subject. Claim 12 A content operation method comprising a content operation device including a processor and memory, wherein the content operation device stores factual information including a plurality of fields regarding a target; the content operation device obtains deficiency information regarding a response regarding the target; and the content operation device generates content to be reflected in the response based on the factual information and the deficiency information. Claim 13 A content operation method according to claim 12, wherein the step of obtaining the deficiency information comprises: a step of extracting a plurality of response fields relating to the target from the response; and a step of comparing each of the extracted plurality of response fields with at least one of the corresponding field of the fact information and the reference information to generate the deficiency information separated by field. Claim 14 A content operation method according to claim 13, wherein the deficiency information comprises at least one of a missing field in which information regarding the subject is missing in the response, a discrepancy field in which it is reflected differently from the factual information, an unofficial source field in which it is reflected based on an unofficial source, and a subject confusion field in which it is reflected in which the subject is confused with another subject. Claim 15 A content operation method according to claim 14, wherein the step of generating the content comprises: a step of determining the content to be generated based on the type of field included in the deficiency information; and a step of generating the determined content. Claim 16 In claim 12, the content operation method further comprises: a step in which the content operation device obtains a post-distribution response obtained in response to the query after the content is distributed; and a step in which the content operation device verifies whether the content is reflected in the obtained post-distribution response and identifies a non-reflected field. Claim 17 In claim 16, the content operation method further comprises: a step in which the content operation device determines a type of cause of non-reflection for the non-reflection field; and a step in which the content operation device changes at least one of the type of content to be regenerated and the method of distributing the content based on the determined type of cause of non-reflection. Claim 18 A method for managing content according to claim 17, wherein the above-mentioned types of causes of non-reflection include at least one of: a lack of accessibility in which a response system providing a response after distribution cannot access the content; a lack of conformity in which the content does not correspond to the response after distribution; a lack of source trust in which the content does not take precedence over an unofficial source; and a lack of recency in which the content is not reflected at the time of update. Claim 19 In claim 16, the content operation method further comprises the step of the content operation device regenerating content corresponding to the unreflected field by using the unreflected field as new deficiency information. Claim 20 In paragraph 12, the content operation method further comprises the step of the content operation device verifying whether the response system providing the response to the content is accessible. Claim 21 A content operation method according to claim 20, wherein the step of verifying the accessibility includes the step of examining at least one of the collector identifier of the response system and a policy file describing a collection policy for the collector. Claim 22 A content operation method according to claim 12, wherein the factual information comprises a field relating to at least one of the name, date, price, identification information, function, benefit, purchase channel, and call-to-action information of the subject.

Citation Information

Patent Citations

  • Query-based generative language model learning and response providing method and computing device performing the same method

    KR1020250014591A

  • Multi-Stage Verification-Based Error-Blocking Artificial Intelligence Response Generation System and Operating Method Thereof

    KR1020250120232A

  • Method and device for preventing hallucination based on self-evaluation

    KR1020250176871A

  • A system for comparing and contrasting facts and evidence, configured to identify inconsistencies between a client’s statement data and evidentiary data, and to generate inquiries regarding the identified inconsistencies

    KR1020260065482A