System

A system using generative AI to collect, analyze, and package information into products addresses the challenge of information overload, enabling efficient and reliable information provision.

JP2026014992APending Publication Date: 2026-01-29SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024116466
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2026-01-29

AI Technical Summary

Technical Problem

The Internet is overflowing with information, making it difficult for users to efficiently obtain specific information in a coherent and practical form, and existing systems struggle to quickly and accurately collect, analyze, and provide it as useful products.

Method used

A system that includes a means for receiving search keywords, automatically collecting related information using a generative AI model, analyzing and organizing it, packaging it into information products, and selling these products on the market.

Benefits of technology

Enables users to quickly and efficiently obtain reliable information in a comprehensive format, addressing the challenges of information fragmentation and duplication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026014992000001_ABST
    Figure 2026014992000001_ABST
Patent Text Reader

Abstract

A system is provided.SOLUTION: This system is provided with a means for receiving a retrieval keyword inputted by a user, a means for automatically collecting relevant information based on the received retrieval keyword, a means for analyzing and arranging the collected relevant information, a means for packaging the analyzed and arranged information as information merchandise and a means for selling the packaged information merchandise to a market.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's information society, it is important for consumers to quickly and accurately obtain the information they need. However, the Internet is overflowing with information, making it difficult to efficiently extract the necessary information. Furthermore, much of the information is fragmented, requiring a great deal of effort to obtain it in a coherent form. This makes it difficult for users to efficiently obtain information on a specific topic and use it in a practical way. Therefore, there is a need for a system that can automatically collect, analyze, and provide the information users need in a coherent form. [Means for solving the problem]

[0005] The solution of this invention resides in a system that includes a means for receiving search keywords entered by a user, a means for automatically collecting related information based on the received search keywords, a means for analyzing and organizing the collected related information, a means for packaging the analyzed and organized information as information products, and a means for selling the packaged information products on the market. Specifically, the search keywords entered by the user are provided to a generative AI model, which then automatically collects information related to the keywords from the Internet. The server then analyzes the collected information, extracts important items, and systematically organizes the information. This organized information is packaged in an appropriate format and sold on the market as information products. This allows users to quickly and efficiently obtain the information they need and use it in a comprehensive format.

[0006] A "user" is a person who uses the system to enter search keywords and obtain the information they need.

[0007] A "search keyword" is a word or phrase that a user enters to search for specific information.

[0008] The "means for receiving" is a function or process by which the server receives the search keywords entered by the user through the terminal.

[0009] An "automated collection method" is a function or process that uses generative AI models or other automated technologies to extract relevant information from the internet.

[0010] "Means of analysis and organization" is the function or process of scrutinizing collected information, extracting important items, and systematizing them.

[0011] "Packaging means" is the function or process that converts analyzed and organized information into a single, cohesive format (e.g., a PDF document).

[0012] "Marketing means" refers to the function or process of making packaged information products available to users through online platforms and other means, making them available for purchase.

[0013] A "generative AI model" is a model that uses trained artificial intelligence to generate relevant information based on specific inputs. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] System Overview

[0036] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. The system includes users, terminals, and servers, and uses a generative AI model to collect, analyze, and organize information, then sells it in the market.

[0037] Detailed System Operation

[0038] 1. User Input Processing

[0039] The user inputs the desired search keyword (e.g., "How to get clear skin") from the device, and the device sends the input keyword to the server.

[0040] 2. Keyword-based information gathering process

[0041] The server receives the input keywords and provides them to the generative AI model, which then automatically collects relevant information on the Internet based on the input keywords. This collected information is then stored on the server.

[0042] 3. Analysis and organization of information

[0043] The server analyzes the collected information and uses natural language processing techniques to eliminate duplicate and unnecessary information. It then extracts the information, organizes the key items, and categorizes them based on specific themes. For example, information on how to achieve clear skin could be categorized into dietary improvements, skin care product selection, lifestyle adjustments, etc.

[0044] 4. Packaging of information products

[0045] The server then performs a document generation process based on the analyzed and organized information. For example, it generates a detailed beauty guide in PDF format using LaTeX or Markdown. This PDF file is then stored in cloud storage and made accessible.

[0046] 5. Sales processing of information products

[0047] The user sends a request to purchase an information product from their device. The server processes this request and performs payment procedures. If payment is successful, the server provides the user with a download link. The user clicks the download link from their device to download and use the information product.

[0048] Specific examples

[0049] For example, if a user types the keyword "how to get clear skin" into their device, the following process will occur:

[0050] 1. The user enters a keyword into the device's search bar and sends it to the server.

[0051] 2. The server receives the keywords and provides them to the generative AI model.

[0052] 3. The generative AI model automatically collects information related to the keywords on the Internet and sends it back to the server.

[0053] 4. The server analyzes the collected information, eliminates duplicates and unnecessary information, and extracts and organizes the important content.

[0054] 5. The server generates information products in PDF format based on the organized information and stores them in cloud storage.

[0055] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[0056] As described above, the system of the present invention can efficiently collect, analyze, and organize information that users need, and provide it as practical information products.

[0057] The processing flow will be explained below.

[0058] Step 1:

[0059] The user enters a desired keyword (e.g., "how to get clear skin") into the device's search bar.

[0060] Step 2:

[0061] The terminal sends the entered keyword to the server via an HTTP request.

[0062] Step 3:

[0063] The server analyzes the received HTTP request and extracts the keywords sent.

[0064] Step 4:

[0065] The server provides the extracted keywords to the generative AI model.

[0066] Step 5:

[0067] Based on keywords, the generative AI model collects relevant information from various data sources on the Internet (web pages, blogs, research papers, etc.).

[0068] Step 6:

[0069] The server stores the relevant information returned by the generative AI model in a temporary file or database.

[0070] Step 7:

[0071] The server filters the stored information to eliminate duplicate or unnecessary information.

[0072] Step 8:

[0073] The server uses natural language processing (NLP) techniques to extract key items from the relevant information.

[0074] Step 9:

[0075] The server categorizes the extracted important items and organizes them in an easy-to-read format, for example, organizing information by theme, such as beauty tips, product recommendations, and lifestyle improvement methods.

[0076] Step 10:

[0077] The server runs a document generation program based on the organized and structured information, for example, using LaTeX or Markdown to generate a PDF document.

[0078] Step 11:

[0079] The server saves the generated PDF document in cloud storage and makes it accessible to the user.

[0080] Step 12:

[0081] The user sends a request to purchase an information product (e.g., a beauty guide) from their device.

[0082] Step 13:

[0083] The server receives the user's purchase request and initiates the checkout process.

[0084] Step 14:

[0085] Once the payment is successful, the server will generate and provide a download link to the user.

[0086] Step 15:

[0087] The user clicks on the download link provided on the device, downloads the generated information product in PDF document format, and views and uses it.

[0088] Example 1

[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0090] Conventional information provision systems have had difficulty in quickly and efficiently collecting and analyzing the information users need and providing it as practical information products. Furthermore, ensuring the reliability and currency of the collected information has also been problematic. There is also a need to organize and provide the collected information in a format that users can easily use.

[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0092] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords using a generative AI model, means for analyzing and organizing the collected related information using natural language processing technology, means for classifying the analyzed and organized information based on specific themes, means for packaging the analyzed and organized information in document format as information products, means for storing the packaged information products in cloud storage and providing them to users, and means for selling the packaged information products on the market. This enables users to quickly and efficiently obtain reliable information and enjoy it as practical information products.

[0093] A "search keyword" is a word or phrase that a user enters to search for information.

[0094] A "generative AI model" is an artificial intelligence technology that learns from large amounts of data and performs natural language understanding and generation.

[0095] "Natural language processing technology" is a technology for processing and analyzing human language using a computer.

[0096] "Document format" means a format for providing information in document form (e.g., PDF, LaTeX, Markdown).

[0097] "Information products" are products that are sold in packages of analyzed and organized information.

[0098] "Cloud storage" is an online storage service for storing and managing data via the Internet.

[0099] A "server" is a computer system that provides data in response to requests from clients over a network.

[0100] overview

[0101] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. This system includes a user, a terminal, and a server, and uses a generative AI model to collect, analyze, and organize information, which is then sold in the market. The specific configuration and operation are described below.

[0102] Hardware and Software Configuration

[0103] Users use devices connected to the Internet (e.g., PCs, smartphones, tablets).

[0104] The terminal communicates with the server using a web browser or a dedicated application.

[0105] The server runs on a high-performance computer or cloud service (e.g., AWS, Google Cloud Platform), where data processing and the execution of generative AI models take place.

[0106] Generative AI models use large-scale language models to gather relevant information from the internet, such as natural language generation models like GPT-4.

[0107] Natural language processing technologies used include NLTK, spaCy, or dedicated analysis tools.

[0108] Detailed Operation

[0109] 1. User Input Processing

[0110] The user enters a search keyword into the device's search bar, for example, a specific keyword such as "how to get clear skin."

[0111] The terminal transmits the input keyword to the server.

[0112] 2. Keyword-based information gathering process

[0113] The server inputs the keywords received from the device into a generative AI model, which then automatically collects related information from the internet.

[0114] The collected information is stored on a server.

[0115] 3. Analysis and organization of information

[0116] The server analyzes and organizes the collected data using natural language processing technology.

[0117] This process eliminates redundant and unnecessary information and extracts important information.

[0118] The extracted information is categorized based on specific themes, such as "improving your diet," "selecting skin care products," and "adjusting your lifestyle."

[0119] 4. Packaging of information products

[0120] The server generates information products in the form of PDF documents based on the analyzed and organized information, where beautifully formatted documents are created using LaTeX and Markdown.

[0121] The generated PDF file is saved in cloud storage (e.g. Amazon S3), so it can be accessed at any time.

[0122] 5. Sales processing of information products

[0123] The user sends a request to purchase the information product from the terminal to the server.

[0124] The server receives the purchase request and processes the payment, for example using a payment gateway such as Stripe or PayPal.

[0125] Once the payment is successful, the server will provide the user with a download link.

[0126] The user clicks on the download link on their device to download and use the information product.

[0127] Specific examples

[0128] For example, if a user enters the keyword "how to get clear skin," the following prompt sentence may be used:

[0129] "I'd like to gather useful information about 'how to get clear skin'. Please search for information based on this keyword."

[0130] Based on this, the server and generative AI model work together to collect and organize relevant information from the Internet and provide it in a practical form as information products.

[0131] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0132] Step 1:

[0133] User search keyword input and submission

[0134] The user enters a search keyword into the device's search bar, which can be a specific keyword such as "how to get clear skin."

[0135] Input: The search keyword entered by the user.

[0136] The terminal sends the entered keyword to the server as an HTTP POST request.

[0137] Output: The search terms sent to the server.

[0138] Step 2:

[0139] The server receives keywords and inputs them into the AI ​​model

[0140] The server receives the search keywords sent from the terminal.

[0141] Input: The search keyword sent from the device.

[0142] The server inputs the received keywords into a generative AI model (e.g., GPT-4) and uses them as prompts for information gathering.

[0143] Output: The search keywords input into the generative AI model.

[0144] Step 3:

[0145] Information gathering using generative AI models

[0146] The generative AI model automatically collects relevant information on the Internet based on the provided search keywords.

[0147] Input: The search keywords provided to the generative AI model.

[0148] Generative AI models crawl websites and databases to gather relevant information.

[0149] Output: A set of collected relevant information.

[0150] Step 4:

[0151] Server storage of information

[0152] The server receives the information collected from the generative AI model and stores it in a local database.

[0153] Input: Relevant information returned from the generative AI model.

[0154] The server stores the data in a database such as MongoDB or MySQL.

[0155] Output: Collected information stored in a database.

[0156] Step 5:

[0157] Server analysis and organization of information

[0158] The server analyzes the stored information using natural language processing techniques (e.g., NLTK or spaCy).

[0159] Input: Collected information stored in a database.

[0160] The server eliminates duplicate and unnecessary information, extracts important information, and categorizes it by topic, such as "improving your diet," "selecting skin care products," and "adjusting your lifestyle."

[0161] Output: Analyzed and organized information.

[0162] Step 6:

[0163] Packaging of information products into document format by the server

[0164] The server generates information products in document format based on the analyzed and organized information, for example, creating PDF documents using LaTeX or Markdown.

[0165] Input: Analyzed and organized information.

[0166] The server uses a document generation tool to generate beautiful PDF format information materials.

[0167] Output: Information product in PDF format.

[0168] Step 7:

[0169] Saving information products to cloud storage by server

[0170] The server saves the generated PDF information product in cloud storage (e.g., Amazon S3), and generates an accessible URL.

[0171] Input: Information product in PDF format.

[0172] The server uploads the file to cloud storage and gets a public link.

[0173] Output: PDF information product stored in cloud storage and its access link.

[0174] Step 8:

[0175] User requests and provision of information products

[0176] The user sends a request to the server from their device to purchase information products. This request includes the product ID and user ID.

[0177] Input: A purchase request from the user to the server.

[0178] The server receives the purchase request and processes the payment (e.g. Stripe or PayPal). If the payment is successful, the server provides the user with a download link.

[0179] Output: The download link provided to the user.

[0180] Step 9:

[0181] Downloading and use of information products by users

[0182] The user clicks on the download link provided by the server on their device to download the PDF information product.

[0183] Input: The download link provided by the server.

[0184] The user views and uses the downloaded information product.

[0185] Output: The information product acquired by the user.

[0186] Through each of the above steps, this system enables users to quickly and efficiently collect, analyze, and organize the information they need, and then provide it as practical information products.

[0187] (Application example 1)

[0188] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0189] Until now, it has been difficult for users to quickly and efficiently obtain specific information and use it in a practical way. In particular, the process of collecting necessary information from the Internet, organizing it, and providing it as a commercial product was time-consuming and often degraded the user experience. There was also the problem of the collected information being duplicated or inaccurate. There is a need for a system that can solve these problems and efficiently collect and organize the information users need and provide it as a commercial product.

[0190] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0191] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords, means for analyzing and organizing the collected related information, means for packaging the analyzed and organized information as information products, means for selling the packaged information products on the market, means for collecting appropriate information from the Internet using a generative AI model based on the search keywords, and means for saving the collected information in cloud storage so that users can download it. This enables users to efficiently collect, organize, purchase, and use information.

[0192] "Search keywords" are words that users enter to search for specific information on the Internet.

[0193] A "generative AI model" is an algorithm that uses artificial intelligence technology to automatically generate and collect relevant information based on a user's search keywords.

[0194] "Information products" are products that are collected and organized information packaged in the form of documents or the like and sold on the market.

[0195] "Natural language processing technology" is a technology for analyzing and organizing collected information, and is an algorithm that understands and processes human language.

[0196] "Cloud storage" is an online storage service for storing and managing data via the Internet.

[0197] "User downloadable means" refers to the means by which a user can save information products from cloud storage to their device.

[0198] "Packaging" is the process of converting collected information into a cohesive form.

[0199] The present invention provides a system that allows users to quickly obtain necessary information from the Internet using search keywords and provides that information as information products. The system mainly includes a user terminal, a server, and cloud storage. An embodiment of the present invention will be described in detail below.

[0200] 1. System Overview

[0201] A user enters search keywords using a smartphone application. This smartphone application is developed with React Native and provides an interface for receiving user input. The application sends the entered keywords to an API server. The API server is built with Node.js and Express and passes the received keywords to a generative AI model (e.g., OpenAI GPT-4). The generative AI model collects related information from the Internet based on the keywords and sends it back to the server.

[0202] 2. Analyzing and organizing information

[0203] The server analyzes and organizes the collected information using natural language processing techniques (e.g., SpaCy, NLTK), eliminating redundant or unnecessary information and extracting the important content. This information is categorized based on specific themes; for example, information on "how to achieve clear skin" is divided into categories such as "improving your diet," "selecting skincare products," and "adjusting your lifestyle."

[0204] 3. Packaging of information products

[0205] The server then performs a document generation process based on the organized information. It generates information products in PDF format using LaTeX or Markdown and stores them in cloud storage (e.g., Amazon S3), making them easily accessible to users.

[0206] 4. Sale and download of information products

[0207] A user sends a request to purchase an information product through a smartphone application. The server processes the payment and, if successful, provides the user with a download link. The user can click this link to download the information product from cloud storage.

[0208] Specific use cases

[0209] For example, a user enters the keyword "how to achieve clear skin" into a smartphone application. The application sends the entered keyword to a server, which then invokes a generative AI model to collect information from the internet. The collected information is analyzed and organized using natural language processing technology and packaged in PDF format. The user then purchases the completed information product, obtains a download link, saves it on their smartphone, and can view and use it.

[0210] Prompt Sentence Examples

[0211] Find information on the internet about "How to achieve clear skin" and categorize it into the following categories: 1. Improving your diet 2. Choosing the right skincare products 3. Adjusting your lifestyle

[0212] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0213] Step 1:

[0214] The user enters search keywords on the device (smartphone application). The user enters the keywords in the search bar of the application and presses the "Search" button. The entered keywords are sent to the API server. In this step, the input is the search keywords entered by the user, and the output is the keywords sent to the API server.

[0215] Step 2:

[0216] The server passes the received search keywords to a generative AI model to collect related information. The server provides the received keywords to a generative AI model (e.g., OpenAI GPT-4) to collect information related to the keywords from the Internet. In this step, the input is the search keyword, and the output is a list of related information. The server uses the generative AI model to collect information from various sources on the Internet.

[0217] Step 3:

[0218] The server analyzes and organizes the collected information using natural language processing technology. The server analyzes the collected information using natural language processing technology (e.g., SpaCy, NLTK), eliminates duplicate and unnecessary information, and extracts important content. In this step, the collected relevant information is the input, and the analyzed and organized information is obtained as the output. The server performs text analysis and filtering to organize and classify the information.

[0219] Step 4:

[0220] The server packages the analyzed and organized information into an information product through a document generation process. The server uses LaTeX or Markdown to generate the organized information as a PDF document. In this step, the organized information is the input, and the PDF information product is the output. The server automatically generates the document and formats it into an information product.

[0221] Step 5:

[0222] The server saves the packaged information product in cloud storage and generates a download link that users can access. The server saves the generated PDF in cloud storage (e.g., Amazon S3) and generates a download link that users can use. In this step, the input is a PDF document and the output is a download link. The server uploads the data to cloud storage and generates a link.

[0223] Step 6:

[0224] A user purchases an information product on their device (smartphone application) and obtains a download link. The user submits a purchase request for the information product within the application, and after the server processes the payment, the user obtains the download link. In this step, the user's purchase request is received as input, and a download link is provided as output. The user completes the payment procedure and uses the link to download the information product.

[0225] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0226] System Overview

[0227] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. A feature of the present invention is that it incorporates an emotion engine that recognizes the user's emotions, thereby providing information optimized according to the user's emotional state. The system includes a user, a terminal, a server, a generative AI model, and an emotion engine.

[0228] Detailed System Operation

[0229] 1. User Input Processing

[0230] The user inputs the desired search keyword (e.g., "How to get clear skin") from the device, and the device sends the input keyword to the server.

[0231] The device detects user input and records the user's emotional state at the time. For example, it uses a camera and microphone to analyze the user's facial expressions and tone of voice, and provides emotional data to the emotion engine.

[0232] 2. Information collection and processing based on keywords and emotion data

[0233] The server receives the input keywords and emotion data and provides them to the generative AI model, which then automatically collects related information on the Internet based on the input keywords. This collected information is then stored on the server.

[0234] The emotion engine analyzes the user's emotion data and identifies the user's emotional state (e.g., joy, sadness, stress, etc.).

[0235] 3. Analysis and organization of information

[0236] The server filters the collected information based on the emotional state obtained from the emotion engine. For example, if the user is feeling stressed, it will prioritize providing information about relaxation.

[0237] The server analyzes the collected information and uses natural language processing techniques to eliminate duplicate and unnecessary information, then extracts the information and organizes it into key items.

[0238] The organized information is categorized based on specific themes, such as beauty tips, product recommendations, and lifestyle adjustments.

[0239] 4. Packaging of information products

[0240] The server then performs a document generation process based on the analyzed and organized information. Specifically, it generates a detailed beauty guide in PDF format using LaTeX and Markdown. This PDF file is then stored in cloud storage and made accessible.

[0241] 5. Sales processing of information products

[0242] The user sends a request to purchase an information product from their device. The server processes this request and performs payment procedures. If payment is successful, the server provides the user with a download link. The user clicks the download link from their device to download and use the information product.

[0243] Specific examples

[0244] For example, if a user types the keyword "how to get clear skin" into their device and the device recognizes from audio and video recordings that they are feeling stressed, the following process will occur:

[0245] 1. The user enters a keyword into the device's search bar, and the emotion engine analyzes the user's tone of voice and facial expressions to detect stress.

[0246] 2. The device sends the search keywords and emotion data to the server.

[0247] 3. The server provides keywords and emotion data to the generative AI model and emotion engine, and collects related information on the Internet.

[0248] 4. The emotion engine prioritizes and filters out information that will help relieve stress, eliminating duplicate and unnecessary information from the collected information.

[0249] 5. The server uses the organized information to generate a PDF beauty guide that includes specific methods for relaxation and stress management, and stores it in cloud storage.

[0250] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[0251] Through this series of steps, the system of the present invention efficiently provides information optimized according to the user's emotional state, allowing the user to use practical information products.

[0252] The processing flow will be explained below.

[0253] Step 1:

[0254] The user enters a desired keyword (e.g., "how to get clear skin") into the device's search bar.

[0255] Step 2:

[0256] The device sends the input keyword to the server via an HTTP request, and also uses a camera and microphone to record the user's facial expressions and tone of voice to obtain emotional data.

[0257] Step 3:

[0258] The server analyzes the received HTTP request and extracts the keywords sent. The emotion engine analyzes the emotion data and identifies the user's emotional state (e.g., stress level).

[0259] Step 4:

[0260] The server provides the extracted keywords and identified emotional states to the generative AI model, which then collects related information from the internet based on the input keywords.

[0261] Step 5:

[0262] The generative AI model sends the relevant information it has collected back to the server, which stores this information in a temporary file or database.

[0263] Step 6:

[0264] The server filters the stored information to eliminate duplicate or unnecessary information.

[0265] Step 7:

[0266] The server uses natural language processing techniques to extract key items from the relevant information.

[0267] Step 8:

[0268] The emotional engine optimizes the information filtering results based on the user's emotional state. For example, if the user is feeling stressed, information on relaxation methods and stress relief will be prioritized.

[0269] Step 9:

[0270] The server categorizes important items and organizes them in an easy-to-read format, for example, organizing information by theme, such as beauty tips, product recommendations, and lifestyle improvements.

[0271] Step 10:

[0272] The server runs a document generation program based on the organized and structured information, generating a PDF document using LaTeX or Markdown.

[0273] Step 11:

[0274] The server saves the generated PDF document in cloud storage and makes it accessible to the user.

[0275] Step 12:

[0276] The user sends a request to purchase an information product (e.g., a beauty guide) from their device.

[0277] Step 13:

[0278] The server receives the user's purchase request and initiates the payment process. If the payment is successful, the server generates and provides the user with a download link.

[0279] Step 14:

[0280] The user clicks on the download link provided on the device, downloads the generated information product in PDF document format, and views and uses it.

[0281] In this way, the system provides information products optimized based on the user's emotional state, allowing the user to efficiently utilize that information.

[0282] Example 2

[0283] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0284] Conventional information product provision systems collect information based on search keywords entered by users, but it is difficult to provide optimal information taking into account the user's emotional state. Furthermore, the collected information often contains duplicate or unnecessary information, making it difficult to extract the information the user truly needs. This reduces the quality of the user experience and hinders efficient information acquisition.

[0285] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0286] In this invention, the server includes means for receiving search keywords and emotion data entered by the user, means for automatically collecting related information based on the received search keywords and emotion data, and means for analyzing and organizing the collected related information. This allows the server to provide optimal information according to the user's emotional state and eliminates redundant information and unnecessary data, enabling the user to efficiently obtain the information they truly need.

[0287] A "search keyword" is a word or phrase that a user enters to search for specific information.

[0288] "Emotion data" is data that reflects the user's emotional state, and is acquired from facial expressions, tone of voice, and the like.

[0289] "Related information" is data related to information that a user needs, collected based on search keywords and emotion data.

[0290] "Information products" are commercialized information that is collected, analyzed, and organized, packaged, and provided.

[0291] "Automatic collection" is the process of automatically retrieving relevant information from the Internet based on search keywords and emotion data.

[0292] "Analysis and organization" is the process of eliminating duplication and unnecessary data from collected information and providing it to users in the most optimal format.

[0293] "Packaging" is the process of compiling analyzed and organized information into a single product and converting it into an easy-to-use format.

[0294] A "generative AI model" is a model that uses artificial intelligence technology to generate and collect relevant information.

[0295] "Natural language processing technology" is a technology that enables computers to understand and process human language.

[0296] The present invention is a system that automatically collects, analyzes, and organizes related information based on search keywords and emotion data entered by a user, and provides the information as information products. One embodiment of the present invention is specifically described below.

[0297] This system mainly includes a user, a device, a server, an emotion engine, and a generative AI model. The user inputs search keywords from their device, and their emotional state at that time is captured via a camera and microphone. This analyzes the user's facial expressions and tone of voice, and generates emotion data. This emotion data is processed by the emotion engine, which identifies the user's emotional state.

[0298] The device sends emotion data along with search keywords to the server. The server receives this data and provides it as prompts to the generative AI model. The generative AI model automatically collects relevant information from the Internet based on the search keywords and emotion data entered by the user. Specifically, it uses search engines and database access APIs to efficiently extract specific information.

[0299] The collected information is stored on a server, and then natural language processing technology is used to eliminate duplicate information and unnecessary data. This allows only the information that the user truly needs to be extracted, analyzed, and organized. The organized information is packaged as an information product in PDF format using LaTeX or Markdown. The generated PDF file is stored in cloud storage and can be accessed by the user.

[0300] When a user indicates their intention to purchase an information product, the request is sent from the device to the server. The server processes the payment through the payment system, and if the payment is successful, a download link is provided to the user. The user can click this link to download and use the information product.

[0301] Specific examples

[0302] For example, if a user enters the search keyword "how to get clear skin" and the emotion engine detects stress in the user's voice and facial expression, the following process will occur:

[0303] 1. A user types "how to get clear skin" into the search bar on their device and clicks the search button.

[0304] 2. The device sends the search keywords and emotion data to the server.

[0305] 3. The server provides the generative AI model with prompts such as "how to achieve clear skin" and "stress" to collect related information.

[0306] 4. The emotion engine prioritizes and filters out information that will help relieve stress, eliminating duplicate and unnecessary information from the collected information.

[0307] 5. Based on the organized information, the server generates a PDF beauty guide that includes specific methods for relaxation and stress management and stores it in cloud storage.

[0308] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[0309] Prompt Sentence Examples

[0310] Examples of prompts to provide to a generative AI model include:

[0311] The search keyword entered by the user is "how to get clear skin" and the user's emotional state is "stress." Collect related information based on this.

[0312] Collect information about the search term "how to get clear skin" and prioritize information about relaxation, considering that users are stressed.

[0313] By following the specific steps described above, the present system efficiently provides optimal information based on the user's emotional state, enabling the user to use practical information products.

[0314] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0315] Step 1:

[0316] The user enters search keywords

[0317] A user enters a keyword into the device's search bar. The entered keyword is displayed in the text box in real time. For example, "How to get clear skin." Once the user has completed the input, the input data is temporarily stored in the device's internal data store.

[0318] Input: The search term entered by the user

[0319] Output: Search keywords are saved in the device's data store.

[0320] What happens: A user types "how to get clear skin" and the device saves the keyword in its data store.

[0321] Step 2:

[0322] User clicks the search button

[0323] When a user clicks the search button, the device sends the entered search keywords to the server. At the same time, the device starts a process to collect emotion data. This emotion data is acquired using the device's camera and microphone.

[0324] Input: Search keywords, user clicks

[0325] Output: Keywords and sentiment data are sent to the server

[0326] Specific operation: The user clicks the search button, and the device sends the recorded audio and video data of "How to get clear skin" to the server.

[0327] Step 3:

[0328] Acquiring emotion data

[0329] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice. The analyzed data is then processed by an emotion engine to detect specific emotional states. For example, the analysis may reveal that the user is feeling stressed.

[0330] Input: Recorded audio and video data

[0331] Output: Stress detection results are obtained as emotion data.

[0332] Specific operation: The device captures the user's facial expressions and analyzes the tone of voice, and the emotion engine detects "stress."

[0333] Step 4:

[0334] Gathering relevant information

[0335] The server provides the received search keywords and emotion data to the generative AI model, which uses "how to get clear skin" and "stress" as prompts to automatically collect related information from the internet.

[0336] Input: Search keywords, emotion data

[0337] Output: Relevant information collected by the generative AI model

[0338] How it works: The server provides the generated AI model with prompts such as "how to get clear skin" and "stress," and then searches and collects articles and research online.

[0339] Step 5:

[0340] Information Filtering

[0341] The server filters the collected information based on the analysis results of the emotion engine. The emotion engine considers the user's emotional state and selects appropriate information. For example, information related to stress relief is given priority.

[0342] Input: Collected relevant information, analysis results of the emotion engine

[0343] Output: Pertinent filtered information

[0344] What it does: The emotion engine takes "stress" into account and prioritizes filtering articles about relaxation.

[0345] Step 6:

[0346] Analyzing and organizing information

[0347] The server uses natural language processing technology to filter out redundant and unnecessary information and extract the important parts. The organized information is then categorized based on specific themes.

[0348] Input: Filtered information

[0349] Output: Organized and categorized information

[0350] How it works: The server uses Python's NLTK library to parse the information, remove duplicates, and categorize it into "beauty tips," "product recommendations," and "lifestyle adjustments."

[0351] Step 7:

[0352] Creation of information products

[0353] The server uses LaTeX and Markdown to generate detailed information products in PDF format from the analyzed and organized information. This PDF is then stored in cloud storage.

[0354] Input: Organized and categorized information

[0355] Output: Information product in PDF format

[0356] Specific operation: The server executes the LaTeX script to generate a PDF and uploads the generated PDF to cloud storage (e.g. AWS S3).

[0357] Step 8:

[0358] Sales and downloads of information products

[0359] The user sends a request to purchase an information product from their device. The server completes the transaction using the payment system, and if successful, provides the user with a download link. The user clicks the link to download the information product.

[0360] Input: User purchase request, payment information

[0361] Output: Download link, information product provided

[0362] Specific operation: The user clicks the "Purchase" button, the server processes the payment, and after the payment is completed, the user receives a download link via email, and the user downloads the PDF guide to their device.

[0363] Through the above processing steps, the system of the present invention efficiently provides optimal information based on the user's emotional state, allowing the user to use practical information products.

[0364] (Application example 2)

[0365] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0366] Conventional search systems provide information based on search keywords entered by users, but they do not adequately provide personalized information or advertisements based on the user's emotional state. This makes it difficult to effectively provide optimal information and advertisements to users. Furthermore, the lack of filtering and organization of information based on the user's emotional state results in a suboptimal user experience.

[0367] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0368] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords, means for analyzing and organizing the collected related information, means for packaging the analyzed and organized information as information products, means for selling the packaged information products on the market, means for recognizing the emotional state of the user and optimizing information based on the emotional state, means for filtering related information based on the emotional state, and means for generating and providing advertising information based on the keywords and the emotional state. This makes it possible to effectively provide optimal information and advertisements according to the user's emotional state, thereby achieving a higher user experience.

[0369] A "search keyword" is a word or phrase that a user enters to search for specific information.

[0370] "Related information" refers to data or content that is highly relevant to the user's request and is obtained based on the search keywords.

[0371] "Information products" are digital content or information products that are analyzed and organized, packaged, and offered as a product.

[0372] An "emotional state" is an emotional state (e.g., joy, sadness, excitement, stress, etc.) identified by analyzing the user's tone of voice, facial expressions, etc.

[0373] An "emotion engine" is software or a system for recognizing and analyzing a user's emotional state.

[0374] "Generative AI models" are algorithms and systems that use artificial intelligence techniques to generate text or data based on specified input.

[0375] "Natural language processing technology" is a technology that enables computers to understand, analyze, and generate human language.

[0376] "Filtering" is the process of filtering out unnecessary information from relevant information and selecting the most appropriate information based on the user's needs and emotional state.

[0377] "Advertising information" is digital content for promoting a particular product or service.

[0378] The present invention provides a system that allows users to quickly obtain necessary information using search keywords and provides the information as information products, and further provides optimal information and advertisements based on the emotional state of the user.

[0379] System Overview

[0380] This system includes a user, a device, a server, a generative AI model, and an emotion engine. The user can input search keywords through the device and have the emotion engine recognize their emotional state. The server uses the generative AI model to analyze and organize the collected related information, filter the information based on the emotional state, and provide information products and advertising information.

[0381] Hardware and Software Configuration

[0382] 1. On the user's device:

[0383] Camera (e.g. webcam)

[0384] microphone

[0385] Internet connection

[0386] 2. Server:

[0387] High-performance computers

[0388] Internet connection

[0389] Emotion Engine

[0390] Generative AI models (e.g., GPT-3)

[0391] Natural language processing technologies (e.g., the Transformers library)

[0392] Program processing

[0393] 1. User Input Processing:

[0394] The user enters search keywords into the search bar on the device, and at the same time, the camera and microphone are used to analyze the user's facial expressions and tone of voice, allowing the emotion engine to recognize the user's current emotional state. This emotion data is then sent to the server along with the keyword.

[0395] 2. Information collection and generation:

[0396] The server uses a generative AI model to collect relevant information from the internet based on search keywords. The collected information is filtered according to the user's emotional state by inputting emotional data from an emotion engine. For example, if the user is feeling stressed, information about relaxation will be prioritized.

[0397] 3. Packaging information:

[0398] The server uses natural language processing technology to analyze and organize the collected information, eliminating duplicate and unnecessary information. The generated information is packaged as information products and made available to the market. For example, detailed guides in PDF format are generated using LaTeX and Markdown.

[0399] 4. Advertising Serving:

[0400] Based on the emotional data and search keywords, the generative AI model generates optimal advertising information. For example, if a user enters the keyword "new smartphone" and their emotional state is excitement, the model will generate an advertisement containing promotional materials and reviews for the new smartphone.

[0401] Specific examples

[0402] As a concrete example, let's consider a case where a user enters the keyword "new smartphone" and, at the same time, analysis using the camera and microphone detects an excited state. In this case, the server provides the keyword and emotion data to the generative AI model, and collects related smartphone information, release information, and user reviews. Furthermore, filtering using the emotion engine displays attractive advertisements that match the user's state of excitement.

[0403] Example prompt sentence:

[0404] Serve relevant ads: Keyword: new smartphone, Emotional state: excitement. Generate smartphone ads that are most engaging when users are excited.

[0405] As a result, the present invention can efficiently provide information and advertisements optimized according to the user's emotional state, improving the user experience.

[0406] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0407] Step 1:

[0408] The user enters search keywords into the search bar on the device. The user uses the device's camera and microphone to provide facial expressions and tone of voice as input. The entered keywords and emotion data are sent from the device to the server.

[0409] Step 2:

[0410] The server processes the received search keywords and emotion data. The server's emotion engine processes the data and identifies the user's emotional state (e.g., joy, sadness, excitement, etc.). The analysis of the emotion data serves as input for the next processing step.

[0411] Step 3:

[0412] The server uses the generative AI model to automatically collect relevant information from the Internet based on the specified search keywords. In this process, the generative AI model searches for information based on the input prompt sentence and provides relevant data as output.

[0413] Step 4:

[0414] The server inputs the collected related information into the emotion engine and performs filtering. For example, if the user is feeling stressed, information about relaxation will be prioritized. The filtered data will be used in the next step.

[0415] Step 5:

[0416] The server uses natural language processing technology to analyze and organize the collected relevant information. This process eliminates duplicate and unnecessary information and extracts key information items. The organized information becomes the input for the next processing step.

[0417] Step 6:

[0418] The server then packages the information product based on the analyzed information. This involves generating a PDF guide using tools such as LaTeX and Markdown. The generated PDF file is then stored in cloud storage and provided to the user.

[0419] Step 7:

[0420] The server generates advertising information based on the emotion data and search keywords. The server's generative AI model generates and outputs appropriate advertisements based on prompts. For example, if a user enters the keyword "new smartphone" and their emotional state is excited, a promotional advertisement for a new smartphone will be generated.

[0421] Step 8:

[0422] The device displays information products and advertising information optimized for the user. The user can download the necessary information products and view the advertisements from the device, optimizing the user experience.

[0423] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0424] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0425] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0426] [Second embodiment]

[0427] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0428] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0429] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0430] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0431] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0432] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0433] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0434] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0435] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0436] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0437] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0438] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0439] System Overview

[0440] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. The system includes users, terminals, and servers, and uses a generative AI model to collect, analyze, and organize information, then sells it in the market.

[0441] Detailed System Operation

[0442] 1. User Input Processing

[0443] The user inputs the desired search keyword (e.g., "How to get clear skin") from the device, and the device sends the input keyword to the server.

[0444] 2. Keyword-based information gathering process

[0445] The server receives the input keywords and provides them to the generative AI model, which then automatically collects relevant information on the Internet based on the input keywords. This collected information is then stored on the server.

[0446] 3. Analysis and organization of information

[0447] The server analyzes the collected information and uses natural language processing techniques to eliminate duplicate and unnecessary information. It then extracts the information, organizes the key items, and categorizes them based on specific themes. For example, information on how to achieve clear skin could be categorized into dietary improvements, skin care product selection, lifestyle adjustments, etc.

[0448] 4. Packaging of information products

[0449] The server then performs a document generation process based on the analyzed and organized information. For example, it generates a detailed beauty guide in PDF format using LaTeX or Markdown. This PDF file is then stored in cloud storage and made accessible.

[0450] 5. Sales processing of information products

[0451] The user sends a request to purchase an information product from their device. The server processes this request and performs payment procedures. If payment is successful, the server provides the user with a download link. The user clicks the download link from their device to download and use the information product.

[0452] Specific examples

[0453] For example, if a user types the keyword "how to get clear skin" into their device, the following process will occur:

[0454] 1. The user enters a keyword into the device's search bar and sends it to the server.

[0455] 2. The server receives the keywords and provides them to the generative AI model.

[0456] 3. The generative AI model automatically collects information related to the keywords on the Internet and sends it back to the server.

[0457] 4. The server analyzes the collected information, eliminates duplicates and unnecessary information, and extracts and organizes the important content.

[0458] 5. The server generates information products in PDF format based on the organized information and stores them in cloud storage.

[0459] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[0460] As described above, the system of the present invention can efficiently collect, analyze, and organize information that users need, and provide it as practical information products.

[0461] The processing flow will be explained below.

[0462] Step 1:

[0463] The user enters a desired keyword (e.g., "how to get clear skin") into the device's search bar.

[0464] Step 2:

[0465] The terminal sends the entered keyword to the server via an HTTP request.

[0466] Step 3:

[0467] The server analyzes the received HTTP request and extracts the keywords sent.

[0468] Step 4:

[0469] The server provides the extracted keywords to the generative AI model.

[0470] Step 5:

[0471] Based on keywords, the generative AI model collects relevant information from various data sources on the Internet (web pages, blogs, research papers, etc.).

[0472] Step 6:

[0473] The server stores the relevant information returned by the generative AI model in a temporary file or database.

[0474] Step 7:

[0475] The server filters the stored information to eliminate duplicate or unnecessary information.

[0476] Step 8:

[0477] The server uses natural language processing (NLP) techniques to extract key items from the relevant information.

[0478] Step 9:

[0479] The server categorizes the extracted important items and organizes them in an easy-to-read format, for example, organizing information by theme, such as beauty tips, product recommendations, and lifestyle improvement methods.

[0480] Step 10:

[0481] The server runs a document generation program based on the organized and structured information, for example, using LaTeX or Markdown to generate a PDF document.

[0482] Step 11:

[0483] The server saves the generated PDF document in cloud storage and makes it accessible to the user.

[0484] Step 12:

[0485] The user sends a request to purchase an information product (e.g., a beauty guide) from their device.

[0486] Step 13:

[0487] The server receives the user's purchase request and initiates the checkout process.

[0488] Step 14:

[0489] Once the payment is successful, the server will generate and provide a download link to the user.

[0490] Step 15:

[0491] The user clicks on the download link provided on the device, downloads the generated information product in PDF document format, and views and uses it.

[0492] Example 1

[0493] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0494] Conventional information provision systems have had difficulty in quickly and efficiently collecting and analyzing the information users need and providing it as practical information products. Furthermore, ensuring the reliability and currency of the collected information has also been problematic. There is also a need to organize and provide the collected information in a format that users can easily use.

[0495] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0496] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords using a generative AI model, means for analyzing and organizing the collected related information using natural language processing technology, means for classifying the analyzed and organized information based on specific themes, means for packaging the analyzed and organized information in document format as information products, means for storing the packaged information products in cloud storage and providing them to users, and means for selling the packaged information products on the market. This enables users to quickly and efficiently obtain reliable information and enjoy it as practical information products.

[0497] A "search keyword" is a word or phrase that a user enters to search for information.

[0498] A "generative AI model" is an artificial intelligence technology that learns from large amounts of data and performs natural language understanding and generation.

[0499] "Natural language processing technology" is a technology for processing and analyzing human language using a computer.

[0500] "Document format" means a format for providing information in document form (e.g., PDF, LaTeX, Markdown).

[0501] "Information products" are products that are sold in packages of analyzed and organized information.

[0502] "Cloud storage" is an online storage service for storing and managing data via the Internet.

[0503] A "server" is a computer system that provides data in response to requests from clients over a network.

[0504] overview

[0505] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. This system includes a user, a terminal, and a server, and uses a generative AI model to collect, analyze, and organize information, which is then sold in the market. The specific configuration and operation are described below.

[0506] Hardware and Software Configuration

[0507] Users use devices connected to the Internet (e.g., PCs, smartphones, tablets).

[0508] The terminal communicates with the server using a web browser or a dedicated application.

[0509] The server runs on a high-performance computer or cloud service (e.g., AWS, Google Cloud Platform), where data processing and the execution of generative AI models take place.

[0510] Generative AI models use large-scale language models to gather relevant information from the internet, such as natural language generation models like GPT-4.

[0511] Natural language processing technologies used include NLTK, spaCy, or dedicated analysis tools.

[0512] Detailed Operation

[0513] 1. User Input Processing

[0514] The user enters a search keyword into the device's search bar, for example, a specific keyword such as "how to get clear skin."

[0515] The terminal transmits the input keyword to the server.

[0516] 2. Keyword-based information gathering process

[0517] The server inputs the keywords received from the device into a generative AI model, which then automatically collects related information from the internet.

[0518] The collected information is stored on a server.

[0519] 3. Analysis and organization of information

[0520] The server analyzes and organizes the collected data using natural language processing technology.

[0521] This process eliminates redundant and unnecessary information and extracts important information.

[0522] The extracted information is categorized based on specific themes, such as "improving your diet," "selecting skin care products," and "adjusting your lifestyle."

[0523] 4. Packaging of information products

[0524] The server generates information products in the form of PDF documents based on the analyzed and organized information, where beautifully formatted documents are created using LaTeX and Markdown.

[0525] The generated PDF file is saved in cloud storage (e.g. Amazon S3), so it can be accessed at any time.

[0526] 5. Sales processing of information products

[0527] The user sends a request to purchase the information product from the terminal to the server.

[0528] The server receives the purchase request and processes the payment, for example using a payment gateway such as Stripe or PayPal.

[0529] Once the payment is successful, the server will provide the user with a download link.

[0530] The user clicks on the download link on their device to download and use the information product.

[0531] Specific examples

[0532] For example, if a user enters the keyword "how to get clear skin," the following prompt sentence may be used:

[0533] "I'd like to gather useful information about 'how to get clear skin'. Please search for information based on this keyword."

[0534] Based on this, the server and generative AI model work together to collect and organize relevant information from the Internet and provide it in a practical form as information products.

[0535] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0536] Step 1:

[0537] User search keyword input and submission

[0538] The user enters a search keyword into the device's search bar, which can be a specific keyword such as "how to get clear skin."

[0539] Input: The search keyword entered by the user.

[0540] The terminal sends the entered keyword to the server as an HTTP POST request.

[0541] Output: The search terms sent to the server.

[0542] Step 2:

[0543] The server receives keywords and inputs them into the AI ​​model

[0544] The server receives the search keywords sent from the terminal.

[0545] Input: The search keyword sent from the device.

[0546] The server inputs the received keywords into a generative AI model (e.g., GPT-4) and uses them as prompts for information gathering.

[0547] Output: The search keywords input into the generative AI model.

[0548] Step 3:

[0549] Information gathering using generative AI models

[0550] The generative AI model automatically collects relevant information on the Internet based on the provided search keywords.

[0551] Input: The search keywords provided to the generative AI model.

[0552] Generative AI models crawl websites and databases to gather relevant information.

[0553] Output: A set of collected relevant information.

[0554] Step 4:

[0555] Server storage of information

[0556] The server receives the information collected from the generative AI model and stores it in a local database.

[0557] Input: Relevant information returned from the generative AI model.

[0558] The server stores the data in a database such as MongoDB or MySQL.

[0559] Output: Collected information stored in a database.

[0560] Step 5:

[0561] Server analysis and organization of information

[0562] The server analyzes the stored information using natural language processing techniques (e.g., NLTK or spaCy).

[0563] Input: Collected information stored in a database.

[0564] The server eliminates duplicate and unnecessary information, extracts important information, and categorizes it by topic, such as "improving your diet," "selecting skin care products," and "adjusting your lifestyle."

[0565] Output: Analyzed and organized information.

[0566] Step 6:

[0567] Packaging of information products into document format by the server

[0568] The server generates information products in document format based on the analyzed and organized information, for example, creating PDF documents using LaTeX or Markdown.

[0569] Input: Analyzed and organized information.

[0570] The server uses a document generation tool to generate beautiful PDF format information materials.

[0571] Output: Information product in PDF format.

[0572] Step 7:

[0573] Saving information products to cloud storage by server

[0574] The server saves the generated PDF information product in cloud storage (e.g., Amazon S3), and generates an accessible URL.

[0575] Input: Information product in PDF format.

[0576] The server uploads the file to cloud storage and gets a public link.

[0577] Output: PDF information product stored in cloud storage and its access link.

[0578] Step 8:

[0579] User requests and provision of information products

[0580] The user sends a request to the server from their device to purchase information products. This request includes the product ID and user ID.

[0581] Input: A purchase request from the user to the server.

[0582] The server receives the purchase request and processes the payment (e.g. Stripe or PayPal). If the payment is successful, the server provides the user with a download link.

[0583] Output: The download link provided to the user.

[0584] Step 9:

[0585] Downloading and use of information products by users

[0586] The user clicks on the download link provided by the server on their device to download the PDF information product.

[0587] Input: The download link provided by the server.

[0588] The user views and uses the downloaded information product.

[0589] Output: The information product acquired by the user.

[0590] Through each of the above steps, this system enables users to quickly and efficiently collect, analyze, and organize the information they need, and then provide it as practical information products.

[0591] (Application example 1)

[0592] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0593] Until now, it has been difficult for users to quickly and efficiently obtain specific information and use it in a practical way. In particular, the process of collecting necessary information from the Internet, organizing it, and providing it as a commercial product was time-consuming and often degraded the user experience. There was also the problem of the collected information being duplicated or inaccurate. There is a need for a system that can solve these problems and efficiently collect and organize the information users need and provide it as a commercial product.

[0594] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0595] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords, means for analyzing and organizing the collected related information, means for packaging the analyzed and organized information as information products, means for selling the packaged information products on the market, means for collecting appropriate information from the Internet using a generative AI model based on the search keywords, and means for saving the collected information in cloud storage so that users can download it. This enables users to efficiently collect, organize, purchase, and use information.

[0596] "Search keywords" are words that users enter to search for specific information on the Internet.

[0597] A "generative AI model" is an algorithm that uses artificial intelligence technology to automatically generate and collect relevant information based on a user's search keywords.

[0598] "Information products" are products that are collected and organized information packaged in the form of documents or the like and sold on the market.

[0599] "Natural language processing technology" is a technology for analyzing and organizing collected information, and is an algorithm that understands and processes human language.

[0600] "Cloud storage" is an online storage service for storing and managing data via the Internet.

[0601] "User downloadable means" refers to the means by which a user can save information products from cloud storage to their device.

[0602] "Packaging" is the process of converting collected information into a cohesive form.

[0603] The present invention provides a system that allows users to quickly obtain necessary information from the Internet using search keywords and provides that information as information products. The system mainly includes a user terminal, a server, and cloud storage. An embodiment of the present invention will be described in detail below.

[0604] 1. System Overview

[0605] A user enters search keywords using a smartphone application. This smartphone application is developed with React Native and provides an interface for receiving user input. The application sends the entered keywords to an API server. The API server is built with Node.js and Express and passes the received keywords to a generative AI model (e.g., OpenAI GPT-4). The generative AI model collects related information from the Internet based on the keywords and sends it back to the server.

[0606] 2. Analyzing and organizing information

[0607] The server analyzes and organizes the collected information using natural language processing techniques (e.g., SpaCy, NLTK), eliminating redundant or unnecessary information and extracting the important content. This information is categorized based on specific themes; for example, information on "how to achieve clear skin" is divided into categories such as "improving your diet," "selecting skincare products," and "adjusting your lifestyle."

[0608] 3. Packaging of information products

[0609] The server then performs a document generation process based on the organized information. It generates information products in PDF format using LaTeX or Markdown and stores them in cloud storage (e.g., Amazon S3), making them easily accessible to users.

[0610] 4. Sale and download of information products

[0611] A user sends a request to purchase an information product through a smartphone application. The server processes the payment and, if successful, provides the user with a download link. The user can click this link to download the information product from cloud storage.

[0612] Specific use cases

[0613] For example, a user enters the keyword "how to achieve clear skin" into a smartphone application. The application sends the entered keyword to a server, which then invokes a generative AI model to collect information from the internet. The collected information is analyzed and organized using natural language processing technology and packaged in PDF format. The user then purchases the completed information product, obtains a download link, saves it on their smartphone, and can view and use it.

[0614] Prompt Sentence Examples

[0615] Find information on the internet about "How to achieve clear skin" and categorize it into the following categories: 1. Improving your diet 2. Choosing the right skincare products 3. Adjusting your lifestyle

[0616] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0617] Step 1:

[0618] The user enters search keywords on the device (smartphone application). The user enters the keywords in the search bar of the application and presses the "Search" button. The entered keywords are sent to the API server. In this step, the input is the search keywords entered by the user, and the output is the keywords sent to the API server.

[0619] Step 2:

[0620] The server passes the received search keywords to a generative AI model to collect related information. The server provides the received keywords to a generative AI model (e.g., OpenAI GPT-4) to collect information related to the keywords from the Internet. In this step, the input is the search keyword, and the output is a list of related information. The server uses the generative AI model to collect information from various sources on the Internet.

[0621] Step 3:

[0622] The server analyzes and organizes the collected information using natural language processing technology. The server analyzes the collected information using natural language processing technology (e.g., SpaCy, NLTK), eliminates duplicate and unnecessary information, and extracts important content. In this step, the collected relevant information is the input, and the analyzed and organized information is obtained as the output. The server performs text analysis and filtering to organize and classify the information.

[0623] Step 4:

[0624] The server packages the analyzed and organized information into an information product through a document generation process. The server uses LaTeX or Markdown to generate the organized information as a PDF document. In this step, the organized information is the input, and the PDF information product is the output. The server automatically generates the document and formats it into an information product.

[0625] Step 5:

[0626] The server saves the packaged information product in cloud storage and generates a download link that users can access. The server saves the generated PDF in cloud storage (e.g., Amazon S3) and generates a download link that users can use. In this step, the input is a PDF document and the output is a download link. The server uploads the data to cloud storage and generates a link.

[0627] Step 6:

[0628] A user purchases an information product on their device (smartphone application) and obtains a download link. The user submits a purchase request for the information product within the application, and after the server processes the payment, the user obtains the download link. In this step, the user's purchase request is received as input, and a download link is provided as output. The user completes the payment procedure and uses the link to download the information product.

[0629] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0630] System Overview

[0631] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. A feature of the present invention is that it incorporates an emotion engine that recognizes the user's emotions, thereby providing information optimized according to the user's emotional state. The system includes a user, a terminal, a server, a generative AI model, and an emotion engine.

[0632] Detailed System Operation

[0633] 1. User Input Processing

[0634] The user inputs the desired search keyword (e.g., "How to get clear skin") from the device, and the device sends the input keyword to the server.

[0635] The device detects user input and records the user's emotional state at the time. For example, it uses a camera and microphone to analyze the user's facial expressions and tone of voice, and provides emotional data to the emotion engine.

[0636] 2. Information collection and processing based on keywords and emotion data

[0637] The server receives the input keywords and emotion data and provides them to the generative AI model, which then automatically collects related information on the Internet based on the input keywords. This collected information is then stored on the server.

[0638] The emotion engine analyzes the user's emotion data and identifies the user's emotional state (e.g., joy, sadness, stress, etc.).

[0639] 3. Analysis and organization of information

[0640] The server filters the collected information based on the emotional state obtained from the emotion engine. For example, if the user is feeling stressed, it will prioritize providing information about relaxation.

[0641] The server analyzes the collected information and uses natural language processing techniques to eliminate duplicate and unnecessary information, then extracts the information and organizes it into key items.

[0642] The organized information is categorized based on specific themes, such as beauty tips, product recommendations, and lifestyle adjustments.

[0643] 4. Packaging of information products

[0644] The server then performs a document generation process based on the analyzed and organized information. Specifically, it generates a detailed beauty guide in PDF format using LaTeX and Markdown. This PDF file is then stored in cloud storage and made accessible.

[0645] 5. Sales processing of information products

[0646] The user sends a request to purchase an information product from their device. The server processes this request and performs payment procedures. If payment is successful, the server provides the user with a download link. The user clicks the download link from their device to download and use the information product.

[0647] Specific examples

[0648] For example, if a user types the keyword "how to get clear skin" into their device and the device recognizes from audio and video recordings that they are feeling stressed, the following process will occur:

[0649] 1. The user enters a keyword into the device's search bar, and the emotion engine analyzes the user's tone of voice and facial expressions to detect stress.

[0650] 2. The device sends the search keywords and emotion data to the server.

[0651] 3. The server provides keywords and emotion data to the generative AI model and emotion engine, and collects related information on the Internet.

[0652] 4. The emotion engine prioritizes and filters out information that will help relieve stress, eliminating duplicate and unnecessary information from the collected information.

[0653] 5. The server uses the organized information to generate a PDF beauty guide that includes specific methods for relaxation and stress management, and stores it in cloud storage.

[0654] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[0655] Through this series of steps, the system of the present invention efficiently provides information optimized according to the user's emotional state, allowing the user to use practical information products.

[0656] The processing flow will be explained below.

[0657] Step 1:

[0658] The user enters a desired keyword (e.g., "how to get clear skin") into the device's search bar.

[0659] Step 2:

[0660] The device sends the input keyword to the server via an HTTP request, and also uses a camera and microphone to record the user's facial expressions and tone of voice to obtain emotional data.

[0661] Step 3:

[0662] The server analyzes the received HTTP request and extracts the keywords sent. The emotion engine analyzes the emotion data and identifies the user's emotional state (e.g., stress level).

[0663] Step 4:

[0664] The server provides the extracted keywords and identified emotional states to the generative AI model, which then collects related information from the internet based on the input keywords.

[0665] Step 5:

[0666] The generative AI model sends the relevant information it has collected back to the server, which stores this information in a temporary file or database.

[0667] Step 6:

[0668] The server filters the stored information to eliminate duplicate or unnecessary information.

[0669] Step 7:

[0670] The server uses natural language processing techniques to extract key items from the relevant information.

[0671] Step 8:

[0672] The emotional engine optimizes the information filtering results based on the user's emotional state. For example, if the user is feeling stressed, information on relaxation methods and stress relief will be prioritized.

[0673] Step 9:

[0674] The server categorizes important items and organizes them in an easy-to-read format, for example, organizing information by theme, such as beauty tips, product recommendations, and lifestyle improvements.

[0675] Step 10:

[0676] The server runs a document generation program based on the organized and structured information, generating a PDF document using LaTeX or Markdown.

[0677] Step 11:

[0678] The server saves the generated PDF document in cloud storage and makes it accessible to the user.

[0679] Step 12:

[0680] The user sends a request to purchase an information product (e.g., a beauty guide) from their device.

[0681] Step 13:

[0682] The server receives the user's purchase request and initiates the payment process. If the payment is successful, the server generates and provides the user with a download link.

[0683] Step 14:

[0684] The user clicks on the download link provided on the device, downloads the generated information product in PDF document format, and views and uses it.

[0685] In this way, the system provides information products optimized based on the user's emotional state, allowing the user to efficiently utilize that information.

[0686] Example 2

[0687] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0688] Conventional information product provision systems collect information based on search keywords entered by users, but it is difficult to provide optimal information taking into account the user's emotional state. Furthermore, the collected information often contains duplicate or unnecessary information, making it difficult to extract the information the user truly needs. This reduces the quality of the user experience and hinders efficient information acquisition.

[0689] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0690] In this invention, the server includes means for receiving search keywords and emotion data entered by the user, means for automatically collecting related information based on the received search keywords and emotion data, and means for analyzing and organizing the collected related information. This allows the server to provide optimal information according to the user's emotional state and eliminates redundant information and unnecessary data, enabling the user to efficiently obtain the information they truly need.

[0691] A "search keyword" is a word or phrase that a user enters to search for specific information.

[0692] "Emotion data" is data that reflects the user's emotional state, and is acquired from facial expressions, tone of voice, and the like.

[0693] "Related information" is data related to information that a user needs, collected based on search keywords and emotion data.

[0694] "Information products" are commercialized information that is collected, analyzed, and organized, packaged, and provided.

[0695] "Automatic collection" is the process of automatically retrieving relevant information from the Internet based on search keywords and emotion data.

[0696] "Analysis and organization" is the process of eliminating duplication and unnecessary data from collected information and providing it to users in the most optimal format.

[0697] "Packaging" is the process of compiling analyzed and organized information into a single product and converting it into an easy-to-use format.

[0698] A "generative AI model" is a model that uses artificial intelligence technology to generate and collect relevant information.

[0699] "Natural language processing technology" is a technology that enables computers to understand and process human language.

[0700] The present invention is a system that automatically collects, analyzes, and organizes related information based on search keywords and emotion data entered by a user, and provides the information as information products. One embodiment of the present invention is specifically described below.

[0701] This system mainly includes a user, a device, a server, an emotion engine, and a generative AI model. The user inputs search keywords from their device, and their emotional state at that time is captured via a camera and microphone. This analyzes the user's facial expressions and tone of voice, and generates emotion data. This emotion data is processed by the emotion engine, which identifies the user's emotional state.

[0702] The device sends emotion data along with search keywords to the server. The server receives this data and provides it as prompts to the generative AI model. The generative AI model automatically collects relevant information from the Internet based on the search keywords and emotion data entered by the user. Specifically, it uses search engines and database access APIs to efficiently extract specific information.

[0703] The collected information is stored on a server, and then natural language processing technology is used to eliminate duplicate information and unnecessary data. This allows only the information that the user truly needs to be extracted, analyzed, and organized. The organized information is packaged as an information product in PDF format using LaTeX or Markdown. The generated PDF file is stored in cloud storage and can be accessed by the user.

[0704] When a user indicates their intention to purchase an information product, the request is sent from the device to the server. The server processes the payment through the payment system, and if the payment is successful, a download link is provided to the user. The user can click this link to download and use the information product.

[0705] Specific examples

[0706] For example, if a user enters the search keyword "how to get clear skin" and the emotion engine detects stress in the user's voice and facial expression, the following process will occur:

[0707] 1. A user types "how to get clear skin" into the search bar on their device and clicks the search button.

[0708] 2. The device sends the search keywords and emotion data to the server.

[0709] 3. The server provides the generative AI model with prompts such as "how to achieve clear skin" and "stress" to collect related information.

[0710] 4. The emotion engine prioritizes and filters out information that will help relieve stress, eliminating duplicate and unnecessary information from the collected information.

[0711] 5. Based on the organized information, the server generates a PDF beauty guide that includes specific methods for relaxation and stress management and stores it in cloud storage.

[0712] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[0713] Prompt Sentence Examples

[0714] Examples of prompts to provide to a generative AI model include:

[0715] The search keyword entered by the user is "how to get clear skin" and the user's emotional state is "stress." Collect related information based on this.

[0716] Collect information about the search term "how to get clear skin" and prioritize information about relaxation, considering that users are stressed.

[0717] By following the specific steps described above, the present system efficiently provides optimal information based on the user's emotional state, enabling the user to use practical information products.

[0718] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0719] Step 1:

[0720] The user enters search keywords

[0721] A user enters a keyword into the device's search bar. The entered keyword is displayed in the text box in real time. For example, "How to get clear skin." Once the user has completed the input, the input data is temporarily stored in the device's internal data store.

[0722] Input: The search term entered by the user

[0723] Output: Search keywords are saved in the device's data store.

[0724] What happens: A user types "how to get clear skin" and the device saves the keyword in its data store.

[0725] Step 2:

[0726] User clicks the search button

[0727] When a user clicks the search button, the device sends the entered search keywords to the server. At the same time, the device starts a process to collect emotion data. This emotion data is acquired using the device's camera and microphone.

[0728] Input: Search keywords, user clicks

[0729] Output: Keywords and sentiment data are sent to the server

[0730] Specific operation: The user clicks the search button, and the device sends the recorded audio and video data of "How to get clear skin" to the server.

[0731] Step 3:

[0732] Acquiring emotion data

[0733] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice. The analyzed data is then processed by an emotion engine to detect specific emotional states. For example, the analysis may reveal that the user is feeling stressed.

[0734] Input: Recorded audio and video data

[0735] Output: Stress detection results are obtained as emotion data.

[0736] Specific operation: The device captures the user's facial expressions and analyzes the tone of voice, and the emotion engine detects "stress."

[0737] Step 4:

[0738] Gathering relevant information

[0739] The server provides the received search keywords and emotion data to the generative AI model, which uses "how to get clear skin" and "stress" as prompts to automatically collect related information from the internet.

[0740] Input: Search keywords, emotion data

[0741] Output: Relevant information collected by the generative AI model

[0742] How it works: The server provides the generated AI model with prompts such as "how to get clear skin" and "stress," and then searches and collects articles and research online.

[0743] Step 5:

[0744] Information Filtering

[0745] The server filters the collected information based on the analysis results of the emotion engine. The emotion engine considers the user's emotional state and selects appropriate information. For example, information related to stress relief is given priority.

[0746] Input: Collected relevant information, analysis results of the emotion engine

[0747] Output: Pertinent filtered information

[0748] What it does: The emotion engine takes "stress" into account and prioritizes filtering articles about relaxation.

[0749] Step 6:

[0750] Analyzing and organizing information

[0751] The server uses natural language processing technology to filter out redundant and unnecessary information and extract the important parts. The organized information is then categorized based on specific themes.

[0752] Input: Filtered information

[0753] Output: Organized and categorized information

[0754] How it works: The server uses Python's NLTK library to parse the information, remove duplicates, and categorize it into "beauty tips," "product recommendations," and "lifestyle adjustments."

[0755] Step 7:

[0756] Creation of information products

[0757] The server uses LaTeX and Markdown to generate detailed information products in PDF format from the analyzed and organized information. This PDF is then stored in cloud storage.

[0758] Input: Organized and categorized information

[0759] Output: Information product in PDF format

[0760] Specific operation: The server executes the LaTeX script to generate a PDF and uploads the generated PDF to cloud storage (e.g. AWS S3).

[0761] Step 8:

[0762] Sales and downloads of information products

[0763] The user sends a request to purchase an information product from their device. The server completes the transaction using the payment system, and if successful, provides the user with a download link. The user clicks the link to download the information product.

[0764] Input: User purchase request, payment information

[0765] Output: Download link, information product provided

[0766] Specific operation: The user clicks the "Purchase" button, the server processes the payment, and after the payment is completed, the user receives a download link via email, and the user downloads the PDF guide to their device.

[0767] Through the above processing steps, the system of the present invention efficiently provides optimal information based on the user's emotional state, allowing the user to use practical information products.

[0768] (Application example 2)

[0769] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0770] Conventional search systems provide information based on search keywords entered by users, but they do not adequately provide personalized information or advertisements based on the user's emotional state. This makes it difficult to effectively provide optimal information and advertisements to users. Furthermore, the lack of filtering and organization of information based on the user's emotional state results in a suboptimal user experience.

[0771] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0772] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords, means for analyzing and organizing the collected related information, means for packaging the analyzed and organized information as information products, means for selling the packaged information products on the market, means for recognizing the emotional state of the user and optimizing information based on the emotional state, means for filtering related information based on the emotional state, and means for generating and providing advertising information based on the keywords and the emotional state. This makes it possible to effectively provide optimal information and advertisements according to the user's emotional state, thereby achieving a higher user experience.

[0773] A "search keyword" is a word or phrase that a user enters to search for specific information.

[0774] "Related information" refers to data or content that is highly relevant to the user's request and is obtained based on the search keywords.

[0775] "Information products" are digital content or information products that are analyzed and organized, packaged, and offered as a product.

[0776] An "emotional state" is an emotional state (e.g., joy, sadness, excitement, stress, etc.) identified by analyzing the user's tone of voice, facial expressions, etc.

[0777] An "emotion engine" is software or a system for recognizing and analyzing a user's emotional state.

[0778] "Generative AI models" are algorithms and systems that use artificial intelligence techniques to generate text or data based on specified input.

[0779] "Natural language processing technology" is a technology that enables computers to understand, analyze, and generate human language.

[0780] "Filtering" is the process of filtering out unnecessary information from relevant information and selecting the most appropriate information based on the user's needs and emotional state.

[0781] "Advertising information" is digital content for promoting a particular product or service.

[0782] The present invention provides a system that allows users to quickly obtain necessary information using search keywords and provides the information as information products, and further provides optimal information and advertisements based on the emotional state of the user.

[0783] System Overview

[0784] This system includes a user, a device, a server, a generative AI model, and an emotion engine. The user can input search keywords through the device and have the emotion engine recognize their emotional state. The server uses the generative AI model to analyze and organize the collected related information, filter the information based on the emotional state, and provide information products and advertising information.

[0785] Hardware and Software Configuration

[0786] 1. On the user's device:

[0787] Camera (e.g. webcam)

[0788] microphone

[0789] Internet connection

[0790] 2. Server:

[0791] High-performance computers

[0792] Internet connection

[0793] Emotion Engine

[0794] Generative AI models (e.g., GPT-3)

[0795] Natural language processing technologies (e.g., the Transformers library)

[0796] Program processing

[0797] 1. User Input Processing:

[0798] The user enters search keywords into the search bar on the device, and at the same time, the camera and microphone are used to analyze the user's facial expressions and tone of voice, allowing the emotion engine to recognize the user's current emotional state. This emotion data is then sent to the server along with the keyword.

[0799] 2. Information collection and generation:

[0800] The server uses a generative AI model to collect relevant information from the internet based on search keywords. The collected information is filtered according to the user's emotional state by inputting emotional data from an emotion engine. For example, if the user is feeling stressed, information about relaxation will be prioritized.

[0801] 3. Packaging information:

[0802] The server uses natural language processing technology to analyze and organize the collected information, eliminating duplicate and unnecessary information. The generated information is packaged as information products and made available to the market. For example, detailed guides in PDF format are generated using LaTeX and Markdown.

[0803] 4. Advertising Serving:

[0804] Based on the emotional data and search keywords, the generative AI model generates optimal advertising information. For example, if a user enters the keyword "new smartphone" and their emotional state is excitement, the model will generate an advertisement containing promotional materials and reviews for the new smartphone.

[0805] Specific examples

[0806] As a concrete example, let's consider a case where a user enters the keyword "new smartphone" and, at the same time, analysis using the camera and microphone detects an excited state. In this case, the server provides the keyword and emotion data to the generative AI model, and collects related smartphone information, release information, and user reviews. Furthermore, filtering using the emotion engine displays attractive advertisements that match the user's state of excitement.

[0807] Example prompt sentence:

[0808] Serve relevant ads: Keyword: new smartphone, Emotional state: excitement. Generate smartphone ads that are most engaging when users are excited.

[0809] As a result, the present invention can efficiently provide information and advertisements optimized according to the user's emotional state, improving the user experience.

[0810] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0811] Step 1:

[0812] The user enters search keywords into the search bar on the device. The user uses the device's camera and microphone to provide facial expressions and tone of voice as input. The entered keywords and emotion data are sent from the device to the server.

[0813] Step 2:

[0814] The server processes the received search keywords and emotion data. The server's emotion engine processes the data and identifies the user's emotional state (e.g., joy, sadness, excitement, etc.). The analysis of the emotion data serves as input for the next processing step.

[0815] Step 3:

[0816] The server uses the generative AI model to automatically collect relevant information from the Internet based on the specified search keywords. In this process, the generative AI model searches for information based on the input prompt sentence and provides relevant data as output.

[0817] Step 4:

[0818] The server inputs the collected related information into the emotion engine and performs filtering. For example, if the user is feeling stressed, information about relaxation will be prioritized. The filtered data will be used in the next step.

[0819] Step 5:

[0820] The server uses natural language processing technology to analyze and organize the collected relevant information. This process eliminates duplicate and unnecessary information and extracts key information items. The organized information becomes the input for the next processing step.

[0821] Step 6:

[0822] The server then packages the information product based on the analyzed information. This involves generating a PDF guide using tools such as LaTeX and Markdown. The generated PDF file is then stored in cloud storage and provided to the user.

[0823] Step 7:

[0824] The server generates advertising information based on the emotion data and search keywords. The server's generative AI model generates and outputs appropriate advertisements based on prompts. For example, if a user enters the keyword "new smartphone" and their emotional state is excited, a promotional advertisement for a new smartphone will be generated.

[0825] Step 8:

[0826] The device displays information products and advertising information optimized for the user. The user can download the necessary information products and view the advertisements from the device, optimizing the user experience.

[0827] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0828] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0829] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0830] [Third embodiment]

[0831] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0832] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0833] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0834] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0835] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0836] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0837] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0838] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0839] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0840] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0841] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0842] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0843] System Overview

[0844] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. The system includes users, terminals, and servers, and uses a generative AI model to collect, analyze, and organize information, then sells it in the market.

[0845] Detailed System Operation

[0846] 1. User Input Processing

[0847] The user inputs the desired search keyword (e.g., "How to get clear skin") from the device, and the device sends the input keyword to the server.

[0848] 2. Keyword-based information gathering process

[0849] The server receives the input keywords and provides them to the generative AI model, which then automatically collects relevant information on the Internet based on the input keywords. This collected information is then stored on the server.

[0850] 3. Analysis and organization of information

[0851] The server analyzes the collected information and uses natural language processing techniques to eliminate duplicate and unnecessary information. It then extracts the information, organizes the key items, and categorizes them based on specific themes. For example, information on how to achieve clear skin could be categorized into dietary improvements, skin care product selection, lifestyle adjustments, etc.

[0852] 4. Packaging of information products

[0853] The server then performs a document generation process based on the analyzed and organized information. For example, it generates a detailed beauty guide in PDF format using LaTeX or Markdown. This PDF file is then stored in cloud storage and made accessible.

[0854] 5. Sales processing of information products

[0855] The user sends a request to purchase an information product from their device. The server processes this request and performs payment procedures. If payment is successful, the server provides the user with a download link. The user clicks the download link from their device to download and use the information product.

[0856] Specific examples

[0857] For example, if a user types the keyword "how to get clear skin" into their device, the following process will occur:

[0858] 1. The user enters a keyword into the device's search bar and sends it to the server.

[0859] 2. The server receives the keywords and provides them to the generative AI model.

[0860] 3. The generative AI model automatically collects information related to the keywords on the Internet and sends it back to the server.

[0861] 4. The server analyzes the collected information, eliminates duplicates and unnecessary information, and extracts and organizes the important content.

[0862] 5. The server generates information products in PDF format based on the organized information and stores them in cloud storage.

[0863] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[0864] As described above, the system of the present invention can efficiently collect, analyze, and organize information that users need, and provide it as practical information products.

[0865] The processing flow will be explained below.

[0866] Step 1:

[0867] The user enters a desired keyword (e.g., "how to get clear skin") into the device's search bar.

[0868] Step 2:

[0869] The terminal sends the entered keyword to the server via an HTTP request.

[0870] Step 3:

[0871] The server analyzes the received HTTP request and extracts the keywords sent.

[0872] Step 4:

[0873] The server provides the extracted keywords to the generative AI model.

[0874] Step 5:

[0875] Based on keywords, the generative AI model collects relevant information from various data sources on the Internet (web pages, blogs, research papers, etc.).

[0876] Step 6:

[0877] The server stores the relevant information returned by the generative AI model in a temporary file or database.

[0878] Step 7:

[0879] The server filters the stored information to eliminate duplicate or unnecessary information.

[0880] Step 8:

[0881] The server uses natural language processing (NLP) techniques to extract key items from the relevant information.

[0882] Step 9:

[0883] The server categorizes the extracted important items and organizes them in an easy-to-read format, for example, organizing information by theme, such as beauty tips, product recommendations, and lifestyle improvement methods.

[0884] Step 10:

[0885] The server runs a document generation program based on the organized and structured information, for example, using LaTeX or Markdown to generate a PDF document.

[0886] Step 11:

[0887] The server saves the generated PDF document in cloud storage and makes it accessible to the user.

[0888] Step 12:

[0889] The user sends a request to purchase an information product (e.g., a beauty guide) from their device.

[0890] Step 13:

[0891] The server receives the user's purchase request and initiates the checkout process.

[0892] Step 14:

[0893] Once the payment is successful, the server will generate and provide a download link to the user.

[0894] Step 15:

[0895] The user clicks on the download link provided on the device, downloads the generated information product in PDF document format, and views and uses it.

[0896] Example 1

[0897] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0898] Conventional information provision systems have had difficulty in quickly and efficiently collecting and analyzing the information users need and providing it as practical information products. Furthermore, ensuring the reliability and currency of the collected information has also been problematic. There is also a need to organize and provide the collected information in a format that users can easily use.

[0899] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0900] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords using a generative AI model, means for analyzing and organizing the collected related information using natural language processing technology, means for classifying the analyzed and organized information based on specific themes, means for packaging the analyzed and organized information in document format as information products, means for storing the packaged information products in cloud storage and providing them to users, and means for selling the packaged information products on the market. This enables users to quickly and efficiently obtain reliable information and enjoy it as practical information products.

[0901] A "search keyword" is a word or phrase that a user enters to search for information.

[0902] A "generative AI model" is an artificial intelligence technology that learns from large amounts of data and performs natural language understanding and generation.

[0903] "Natural language processing technology" is a technology for processing and analyzing human language using a computer.

[0904] "Document format" means a format for providing information in document form (e.g., PDF, LaTeX, Markdown).

[0905] "Information products" are products that are sold in packages of analyzed and organized information.

[0906] "Cloud storage" is an online storage service for storing and managing data via the Internet.

[0907] A "server" is a computer system that provides data in response to requests from clients over a network.

[0908] overview

[0909] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. This system includes a user, a terminal, and a server, and uses a generative AI model to collect, analyze, and organize information, which is then sold in the market. The specific configuration and operation are described below.

[0910] Hardware and Software Configuration

[0911] Users use devices connected to the Internet (e.g., PCs, smartphones, tablets).

[0912] The terminal communicates with the server using a web browser or a dedicated application.

[0913] The server runs on a high-performance computer or cloud service (e.g., AWS, Google Cloud Platform), where data processing and the execution of generative AI models take place.

[0914] Generative AI models use large-scale language models to gather relevant information from the internet, such as natural language generation models like GPT-4.

[0915] Natural language processing technologies used include NLTK, spaCy, or dedicated analysis tools.

[0916] Detailed Operation

[0917] 1. User Input Processing

[0918] The user enters a search keyword into the device's search bar, for example, a specific keyword such as "how to get clear skin."

[0919] The terminal transmits the input keyword to the server.

[0920] 2. Keyword-based information gathering process

[0921] The server inputs the keywords received from the device into a generative AI model, which then automatically collects related information from the internet.

[0922] The collected information is stored on a server.

[0923] 3. Analysis and organization of information

[0924] The server analyzes and organizes the collected data using natural language processing technology.

[0925] This process eliminates redundant and unnecessary information and extracts important information.

[0926] The extracted information is categorized based on specific themes, such as "improving your diet," "selecting skin care products," and "adjusting your lifestyle."

[0927] 4. Packaging of information products

[0928] The server generates information products in the form of PDF documents based on the analyzed and organized information, where beautifully formatted documents are created using LaTeX and Markdown.

[0929] The generated PDF file is saved in cloud storage (e.g. Amazon S3), so it can be accessed at any time.

[0930] 5. Sales processing of information products

[0931] The user sends a request to purchase the information product from the terminal to the server.

[0932] The server receives the purchase request and processes the payment, for example using a payment gateway such as Stripe or PayPal.

[0933] Once the payment is successful, the server will provide the user with a download link.

[0934] The user clicks on the download link on their device to download and use the information product.

[0935] Specific examples

[0936] For example, if a user enters the keyword "how to get clear skin," the following prompt sentence may be used:

[0937] "I'd like to gather useful information about 'how to get clear skin'. Please search for information based on this keyword."

[0938] Based on this, the server and generative AI model work together to collect and organize relevant information from the Internet and provide it in a practical form as information products.

[0939] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0940] Step 1:

[0941] User search keyword input and submission

[0942] The user enters a search keyword into the device's search bar, which can be a specific keyword such as "how to get clear skin."

[0943] Input: The search keyword entered by the user.

[0944] The terminal sends the entered keyword to the server as an HTTP POST request.

[0945] Output: The search terms sent to the server.

[0946] Step 2:

[0947] The server receives keywords and inputs them into the AI ​​model

[0948] The server receives the search keywords sent from the terminal.

[0949] Input: The search keyword sent from the device.

[0950] The server inputs the received keywords into a generative AI model (e.g., GPT-4) and uses them as prompts for information gathering.

[0951] Output: The search keywords input into the generative AI model.

[0952] Step 3:

[0953] Information gathering using generative AI models

[0954] The generative AI model automatically collects relevant information on the Internet based on the provided search keywords.

[0955] Input: The search keywords provided to the generative AI model.

[0956] Generative AI models crawl websites and databases to gather relevant information.

[0957] Output: A set of collected relevant information.

[0958] Step 4:

[0959] Server storage of information

[0960] The server receives the information collected from the generative AI model and stores it in a local database.

[0961] Input: Relevant information returned from the generative AI model.

[0962] The server stores the data in a database such as MongoDB or MySQL.

[0963] Output: Collected information stored in a database.

[0964] Step 5:

[0965] Server analysis and organization of information

[0966] The server analyzes the stored information using natural language processing techniques (e.g., NLTK or spaCy).

[0967] Input: Collected information stored in a database.

[0968] The server eliminates duplicate and unnecessary information, extracts important information, and categorizes it by topic, such as "improving your diet," "selecting skin care products," and "adjusting your lifestyle."

[0969] Output: Analyzed and organized information.

[0970] Step 6:

[0971] Packaging of information products into document format by the server

[0972] The server generates information products in document format based on the analyzed and organized information, for example, creating PDF documents using LaTeX or Markdown.

[0973] Input: Analyzed and organized information.

[0974] The server uses a document generation tool to generate beautiful PDF format information materials.

[0975] Output: Information product in PDF format.

[0976] Step 7:

[0977] Saving information products to cloud storage by server

[0978] The server saves the generated PDF information product in cloud storage (e.g., Amazon S3), and generates an accessible URL.

[0979] Input: Information product in PDF format.

[0980] The server uploads the file to cloud storage and gets a public link.

[0981] Output: PDF information product stored in cloud storage and its access link.

[0982] Step 8:

[0983] User requests and provision of information products

[0984] The user sends a request to the server from their device to purchase information products. This request includes the product ID and user ID.

[0985] Input: A purchase request from the user to the server.

[0986] The server receives the purchase request and processes the payment (e.g. Stripe or PayPal). If the payment is successful, the server provides the user with a download link.

[0987] Output: The download link provided to the user.

[0988] Step 9:

[0989] Downloading and use of information products by users

[0990] The user clicks on the download link provided by the server on their device to download the PDF information product.

[0991] Input: The download link provided by the server.

[0992] The user views and uses the downloaded information product.

[0993] Output: The information product acquired by the user.

[0994] Through each of the above steps, this system enables users to quickly and efficiently collect, analyze, and organize the information they need, and then provide it as practical information products.

[0995] (Application example 1)

[0996] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0997] Until now, it has been difficult for users to quickly and efficiently obtain specific information and use it in a practical way. In particular, the process of collecting necessary information from the Internet, organizing it, and providing it as a commercial product was time-consuming and often degraded the user experience. There was also the problem of the collected information being duplicated or inaccurate. There is a need for a system that can solve these problems and efficiently collect and organize the information users need and provide it as a commercial product.

[0998] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0999] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords, means for analyzing and organizing the collected related information, means for packaging the analyzed and organized information as information products, means for selling the packaged information products on the market, means for collecting appropriate information from the Internet using a generative AI model based on the search keywords, and means for saving the collected information in cloud storage so that users can download it. This enables users to efficiently collect, organize, purchase, and use information.

[1000] "Search keywords" are words that users enter to search for specific information on the Internet.

[1001] A "generative AI model" is an algorithm that uses artificial intelligence technology to automatically generate and collect relevant information based on a user's search keywords.

[1002] "Information products" are products that are collected and organized information packaged in the form of documents or the like and sold on the market.

[1003] "Natural language processing technology" is a technology for analyzing and organizing collected information, and is an algorithm that understands and processes human language.

[1004] "Cloud storage" is an online storage service for storing and managing data via the Internet.

[1005] "User downloadable means" refers to the means by which a user can save information products from cloud storage to their device.

[1006] "Packaging" is the process of converting collected information into a cohesive form.

[1007] The present invention provides a system that allows users to quickly obtain necessary information from the Internet using search keywords and provides that information as information products. The system mainly includes a user terminal, a server, and cloud storage. An embodiment of the present invention will be described in detail below.

[1008] 1. System Overview

[1009] A user enters search keywords using a smartphone application. This smartphone application is developed with React Native and provides an interface for receiving user input. The application sends the entered keywords to an API server. The API server is built with Node.js and Express and passes the received keywords to a generative AI model (e.g., OpenAI GPT-4). The generative AI model collects related information from the Internet based on the keywords and sends it back to the server.

[1010] 2. Analyzing and organizing information

[1011] The server analyzes and organizes the collected information using natural language processing techniques (e.g., SpaCy, NLTK), eliminating redundant or unnecessary information and extracting the important content. This information is categorized based on specific themes; for example, information on "how to achieve clear skin" is divided into categories such as "improving your diet," "selecting skincare products," and "adjusting your lifestyle."

[1012] 3. Packaging of information products

[1013] The server then performs a document generation process based on the organized information. It generates information products in PDF format using LaTeX or Markdown and stores them in cloud storage (e.g., Amazon S3), making them easily accessible to users.

[1014] 4. Sale and download of information products

[1015] A user sends a request to purchase an information product through a smartphone application. The server processes the payment and, if successful, provides the user with a download link. The user can click this link to download the information product from cloud storage.

[1016] Specific use cases

[1017] For example, a user enters the keyword "how to achieve clear skin" into a smartphone application. The application sends the entered keyword to a server, which then invokes a generative AI model to collect information from the internet. The collected information is analyzed and organized using natural language processing technology and packaged in PDF format. The user then purchases the completed information product, obtains a download link, saves it on their smartphone, and can view and use it.

[1018] Prompt Sentence Examples

[1019] Find information on the internet about "How to achieve clear skin" and categorize it into the following categories: 1. Improving your diet 2. Choosing the right skincare products 3. Adjusting your lifestyle

[1020] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1021] Step 1:

[1022] The user enters search keywords on the device (smartphone application). The user enters the keywords in the search bar of the application and presses the "Search" button. The entered keywords are sent to the API server. In this step, the input is the search keywords entered by the user, and the output is the keywords sent to the API server.

[1023] Step 2:

[1024] The server passes the received search keywords to a generative AI model to collect related information. The server provides the received keywords to a generative AI model (e.g., OpenAI GPT-4) to collect information related to the keywords from the Internet. In this step, the input is the search keyword, and the output is a list of related information. The server uses the generative AI model to collect information from various sources on the Internet.

[1025] Step 3:

[1026] The server analyzes and organizes the collected information using natural language processing technology. The server analyzes the collected information using natural language processing technology (e.g., SpaCy, NLTK), eliminates duplicate and unnecessary information, and extracts important content. In this step, the collected relevant information is the input, and the analyzed and organized information is obtained as the output. The server performs text analysis and filtering to organize and classify the information.

[1027] Step 4:

[1028] The server packages the analyzed and organized information into an information product through a document generation process. The server uses LaTeX or Markdown to generate the organized information as a PDF document. In this step, the organized information is the input, and the PDF information product is the output. The server automatically generates the document and formats it into an information product.

[1029] Step 5:

[1030] The server saves the packaged information product in cloud storage and generates a download link that users can access. The server saves the generated PDF in cloud storage (e.g., Amazon S3) and generates a download link that users can use. In this step, the input is a PDF document and the output is a download link. The server uploads the data to cloud storage and generates a link.

[1031] Step 6:

[1032] A user purchases an information product on their device (smartphone application) and obtains a download link. The user submits a purchase request for the information product within the application, and after the server processes the payment, the user obtains the download link. In this step, the user's purchase request is received as input, and a download link is provided as output. The user completes the payment procedure and uses the link to download the information product.

[1033] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1034] System Overview

[1035] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. A feature of the present invention is that it incorporates an emotion engine that recognizes the user's emotions, thereby providing information optimized according to the user's emotional state. The system includes a user, a terminal, a server, a generative AI model, and an emotion engine.

[1036] Detailed System Operation

[1037] 1. User Input Processing

[1038] The user inputs the desired search keyword (e.g., "How to get clear skin") from the device, and the device sends the input keyword to the server.

[1039] The device detects user input and records the user's emotional state at the time. For example, it uses a camera and microphone to analyze the user's facial expressions and tone of voice, and provides emotional data to the emotion engine.

[1040] 2. Information collection and processing based on keywords and emotion data

[1041] The server receives the input keywords and emotion data and provides them to the generative AI model, which then automatically collects related information on the Internet based on the input keywords. This collected information is then stored on the server.

[1042] The emotion engine analyzes the user's emotion data and identifies the user's emotional state (e.g., joy, sadness, stress, etc.).

[1043] 3. Analysis and organization of information

[1044] The server filters the collected information based on the emotional state obtained from the emotion engine. For example, if the user is feeling stressed, it will prioritize providing information about relaxation.

[1045] The server analyzes the collected information and uses natural language processing techniques to eliminate duplicate and unnecessary information, then extracts the information and organizes it into key items.

[1046] The organized information is categorized based on specific themes, such as beauty tips, product recommendations, and lifestyle adjustments.

[1047] 4. Packaging of information products

[1048] The server then performs a document generation process based on the analyzed and organized information. Specifically, it generates a detailed beauty guide in PDF format using LaTeX and Markdown. This PDF file is then stored in cloud storage and made accessible.

[1049] 5. Sales processing of information products

[1050] The user sends a request to purchase an information product from their device. The server processes this request and performs payment procedures. If payment is successful, the server provides the user with a download link. The user clicks the download link from their device to download and use the information product.

[1051] Specific examples

[1052] For example, if a user types the keyword "how to get clear skin" into their device and the device recognizes from audio and video recordings that they are feeling stressed, the following process will occur:

[1053] 1. The user enters a keyword into the device's search bar, and the emotion engine analyzes the user's tone of voice and facial expressions to detect stress.

[1054] 2. The device sends the search keywords and emotion data to the server.

[1055] 3. The server provides keywords and emotion data to the generative AI model and emotion engine, and collects related information on the Internet.

[1056] 4. The emotion engine prioritizes and filters out information that will help relieve stress, eliminating duplicate and unnecessary information from the collected information.

[1057] 5. The server uses the organized information to generate a PDF beauty guide that includes specific methods for relaxation and stress management, and stores it in cloud storage.

[1058] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[1059] Through this series of steps, the system of the present invention efficiently provides information optimized according to the user's emotional state, allowing the user to use practical information products.

[1060] The processing flow will be explained below.

[1061] Step 1:

[1062] The user enters a desired keyword (e.g., "how to get clear skin") into the device's search bar.

[1063] Step 2:

[1064] The device sends the input keyword to the server via an HTTP request, and also uses a camera and microphone to record the user's facial expressions and tone of voice to obtain emotional data.

[1065] Step 3:

[1066] The server analyzes the received HTTP request and extracts the keywords sent. The emotion engine analyzes the emotion data and identifies the user's emotional state (e.g., stress level).

[1067] Step 4:

[1068] The server provides the extracted keywords and identified emotional states to the generative AI model, which then collects related information from the internet based on the input keywords.

[1069] Step 5:

[1070] The generative AI model sends the relevant information it has collected back to the server, which stores this information in a temporary file or database.

[1071] Step 6:

[1072] The server filters the stored information to eliminate duplicate or unnecessary information.

[1073] Step 7:

[1074] The server uses natural language processing techniques to extract key items from the relevant information.

[1075] Step 8:

[1076] The emotional engine optimizes the information filtering results based on the user's emotional state. For example, if the user is feeling stressed, information on relaxation methods and stress relief will be prioritized.

[1077] Step 9:

[1078] The server categorizes important items and organizes them in an easy-to-read format, for example, organizing information by theme, such as beauty tips, product recommendations, and lifestyle improvements.

[1079] Step 10:

[1080] The server runs a document generation program based on the organized and structured information, generating a PDF document using LaTeX or Markdown.

[1081] Step 11:

[1082] The server saves the generated PDF document in cloud storage and makes it accessible to the user.

[1083] Step 12:

[1084] The user sends a request to purchase an information product (e.g., a beauty guide) from their device.

[1085] Step 13:

[1086] The server receives the user's purchase request and initiates the payment process. If the payment is successful, the server generates and provides the user with a download link.

[1087] Step 14:

[1088] The user clicks on the download link provided on the device, downloads the generated information product in PDF document format, and views and uses it.

[1089] In this way, the system provides information products optimized based on the user's emotional state, allowing the user to efficiently utilize that information.

[1090] Example 2

[1091] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1092] Conventional information product provision systems collect information based on search keywords entered by users, but it is difficult to provide optimal information taking into account the user's emotional state. Furthermore, the collected information often contains duplicate or unnecessary information, making it difficult to extract the information the user truly needs. This reduces the quality of the user experience and hinders efficient information acquisition.

[1093] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1094] In this invention, the server includes means for receiving search keywords and emotion data entered by the user, means for automatically collecting related information based on the received search keywords and emotion data, and means for analyzing and organizing the collected related information. This allows the server to provide optimal information according to the user's emotional state and eliminates redundant information and unnecessary data, enabling the user to efficiently obtain the information they truly need.

[1095] A "search keyword" is a word or phrase that a user enters to search for specific information.

[1096] "Emotion data" is data that reflects the user's emotional state, and is acquired from facial expressions, tone of voice, and the like.

[1097] "Related information" is data related to information that a user needs, collected based on search keywords and emotion data.

[1098] "Information products" are commercialized information that is collected, analyzed, and organized, packaged, and provided.

[1099] "Automatic collection" is the process of automatically retrieving relevant information from the Internet based on search keywords and emotion data.

[1100] "Analysis and organization" is the process of eliminating duplication and unnecessary data from collected information and providing it to users in the most optimal format.

[1101] "Packaging" is the process of compiling analyzed and organized information into a single product and converting it into an easy-to-use format.

[1102] A "generative AI model" is a model that uses artificial intelligence technology to generate and collect relevant information.

[1103] "Natural language processing technology" is a technology that enables computers to understand and process human language.

[1104] The present invention is a system that automatically collects, analyzes, and organizes related information based on search keywords and emotion data entered by a user, and provides the information as information products. One embodiment of the present invention is specifically described below.

[1105] This system mainly includes a user, a device, a server, an emotion engine, and a generative AI model. The user inputs search keywords from their device, and their emotional state at that time is captured via a camera and microphone. This analyzes the user's facial expressions and tone of voice, and generates emotion data. This emotion data is processed by the emotion engine, which identifies the user's emotional state.

[1106] The device sends emotion data along with search keywords to the server. The server receives this data and provides it as prompts to the generative AI model. The generative AI model automatically collects relevant information from the Internet based on the search keywords and emotion data entered by the user. Specifically, it uses search engines and database access APIs to efficiently extract specific information.

[1107] The collected information is stored on a server, and then natural language processing technology is used to eliminate duplicate information and unnecessary data. This allows only the information that the user truly needs to be extracted, analyzed, and organized. The organized information is packaged as an information product in PDF format using LaTeX or Markdown. The generated PDF file is stored in cloud storage and can be accessed by the user.

[1108] When a user indicates their intention to purchase an information product, the request is sent from the device to the server. The server processes the payment through the payment system, and if the payment is successful, a download link is provided to the user. The user can click this link to download and use the information product.

[1109] Specific examples

[1110] For example, if a user enters the search keyword "how to get clear skin" and the emotion engine detects stress in the user's voice and facial expression, the following process will occur:

[1111] 1. A user types "how to get clear skin" into the search bar on their device and clicks the search button.

[1112] 2. The device sends the search keywords and emotion data to the server.

[1113] 3. The server provides the generative AI model with prompts such as "how to achieve clear skin" and "stress" to collect related information.

[1114] 4. The emotion engine prioritizes and filters out information that will help relieve stress, eliminating duplicate and unnecessary information from the collected information.

[1115] 5. Based on the organized information, the server generates a PDF beauty guide that includes specific methods for relaxation and stress management and stores it in cloud storage.

[1116] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[1117] Prompt Sentence Examples

[1118] Examples of prompts to provide to a generative AI model include:

[1119] The search keyword entered by the user is "how to get clear skin" and the user's emotional state is "stress." Collect related information based on this.

[1120] Collect information about the search term "how to get clear skin" and prioritize information about relaxation, considering that users are stressed.

[1121] By following the specific steps described above, the present system efficiently provides optimal information based on the user's emotional state, enabling the user to use practical information products.

[1122] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1123] Step 1:

[1124] The user enters search keywords

[1125] A user enters a keyword into the device's search bar. The entered keyword is displayed in the text box in real time. For example, "How to get clear skin." Once the user has completed the input, the input data is temporarily stored in the device's internal data store.

[1126] Input: The search term entered by the user

[1127] Output: Search keywords are saved in the device's data store.

[1128] What happens: A user types "how to get clear skin" and the device saves the keyword in its data store.

[1129] Step 2:

[1130] User clicks the search button

[1131] When a user clicks the search button, the device sends the entered search keywords to the server. At the same time, the device starts a process to collect emotion data. This emotion data is acquired using the device's camera and microphone.

[1132] Input: Search keywords, user clicks

[1133] Output: Keywords and sentiment data are sent to the server

[1134] Specific operation: The user clicks the search button, and the device sends the recorded audio and video data of "How to get clear skin" to the server.

[1135] Step 3:

[1136] Acquiring emotion data

[1137] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice. The analyzed data is then processed by an emotion engine to detect specific emotional states. For example, the analysis may reveal that the user is feeling stressed.

[1138] Input: Recorded audio and video data

[1139] Output: Stress detection results are obtained as emotion data.

[1140] Specific operation: The device captures the user's facial expressions and analyzes the tone of voice, and the emotion engine detects "stress."

[1141] Step 4:

[1142] Gathering relevant information

[1143] The server provides the received search keywords and emotion data to the generative AI model, which uses "how to get clear skin" and "stress" as prompts to automatically collect related information from the internet.

[1144] Input: Search keywords, emotion data

[1145] Output: Relevant information collected by the generative AI model

[1146] How it works: The server provides the generated AI model with prompts such as "how to get clear skin" and "stress," and then searches and collects articles and research online.

[1147] Step 5:

[1148] Information Filtering

[1149] The server filters the collected information based on the analysis results of the emotion engine. The emotion engine considers the user's emotional state and selects appropriate information. For example, information related to stress relief is given priority.

[1150] Input: Collected relevant information, analysis results of the emotion engine

[1151] Output: Pertinent filtered information

[1152] What it does: The emotion engine takes "stress" into account and prioritizes filtering articles about relaxation.

[1153] Step 6:

[1154] Analyzing and organizing information

[1155] The server uses natural language processing technology to filter out redundant and unnecessary information and extract the important parts. The organized information is then categorized based on specific themes.

[1156] Input: Filtered information

[1157] Output: Organized and categorized information

[1158] How it works: The server uses Python's NLTK library to parse the information, remove duplicates, and categorize it into "beauty tips," "product recommendations," and "lifestyle adjustments."

[1159] Step 7:

[1160] Creation of information products

[1161] The server uses LaTeX and Markdown to generate detailed information products in PDF format from the analyzed and organized information. This PDF is then stored in cloud storage.

[1162] Input: Organized and categorized information

[1163] Output: Information product in PDF format

[1164] Specific operation: The server executes the LaTeX script to generate a PDF and uploads the generated PDF to cloud storage (e.g. AWS S3).

[1165] Step 8:

[1166] Sales and downloads of information products

[1167] The user sends a request to purchase an information product from their device. The server completes the transaction using the payment system, and if successful, provides the user with a download link. The user clicks the link to download the information product.

[1168] Input: User purchase request, payment information

[1169] Output: Download link, information product provided

[1170] Specific operation: The user clicks the "Purchase" button, the server processes the payment, and after the payment is completed, the user receives a download link via email, and the user downloads the PDF guide to their device.

[1171] Through the above processing steps, the system of the present invention efficiently provides optimal information based on the user's emotional state, allowing the user to use practical information products.

[1172] (Application example 2)

[1173] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1174] Conventional search systems provide information based on search keywords entered by users, but they do not adequately provide personalized information or advertisements based on the user's emotional state. This makes it difficult to effectively provide optimal information and advertisements to users. Furthermore, the lack of filtering and organization of information based on the user's emotional state results in a suboptimal user experience.

[1175] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1176] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords, means for analyzing and organizing the collected related information, means for packaging the analyzed and organized information as information products, means for selling the packaged information products on the market, means for recognizing the emotional state of the user and optimizing information based on the emotional state, means for filtering related information based on the emotional state, and means for generating and providing advertising information based on the keywords and the emotional state. This makes it possible to effectively provide optimal information and advertisements according to the user's emotional state, thereby achieving a higher user experience.

[1177] A "search keyword" is a word or phrase that a user enters to search for specific information.

[1178] "Related information" refers to data or content that is highly relevant to the user's request and is obtained based on the search keywords.

[1179] "Information products" are digital content or information products that are analyzed and organized, packaged, and offered as a product.

[1180] An "emotional state" is an emotional state (e.g., joy, sadness, excitement, stress, etc.) identified by analyzing the user's tone of voice, facial expressions, etc.

[1181] An "emotion engine" is software or a system for recognizing and analyzing a user's emotional state.

[1182] "Generative AI models" are algorithms and systems that use artificial intelligence techniques to generate text or data based on specified input.

[1183] "Natural language processing technology" is a technology that enables computers to understand, analyze, and generate human language.

[1184] "Filtering" is the process of filtering out unnecessary information from relevant information and selecting the most appropriate information based on the user's needs and emotional state.

[1185] "Advertising information" is digital content for promoting a particular product or service.

[1186] The present invention provides a system that allows users to quickly obtain necessary information using search keywords and provides the information as information products, and further provides optimal information and advertisements based on the emotional state of the user.

[1187] System Overview

[1188] This system includes a user, a device, a server, a generative AI model, and an emotion engine. The user can input search keywords through the device and have the emotion engine recognize their emotional state. The server uses the generative AI model to analyze and organize the collected related information, filter the information based on the emotional state, and provide information products and advertising information.

[1189] Hardware and Software Configuration

[1190] 1. On the user's device:

[1191] Camera (e.g. webcam)

[1192] microphone

[1193] Internet connection

[1194] 2. Server:

[1195] High-performance computers

[1196] Internet connection

[1197] Emotion Engine

[1198] Generative AI models (e.g., GPT-3)

[1199] Natural language processing technologies (e.g., the Transformers library)

[1200] Program processing

[1201] 1. User Input Processing:

[1202] The user enters search keywords into the search bar on the device, and at the same time, the camera and microphone are used to analyze the user's facial expressions and tone of voice, allowing the emotion engine to recognize the user's current emotional state. This emotion data is then sent to the server along with the keyword.

[1203] 2. Information collection and generation:

[1204] The server uses a generative AI model to collect relevant information from the internet based on search keywords. The collected information is filtered according to the user's emotional state by inputting emotional data from an emotion engine. For example, if the user is feeling stressed, information about relaxation will be prioritized.

[1205] 3. Packaging information:

[1206] The server uses natural language processing technology to analyze and organize the collected information, eliminating duplicate and unnecessary information. The generated information is packaged as information products and made available to the market. For example, detailed guides in PDF format are generated using LaTeX and Markdown.

[1207] 4. Advertising Serving:

[1208] Based on the emotional data and search keywords, the generative AI model generates optimal advertising information. For example, if a user enters the keyword "new smartphone" and their emotional state is excitement, the model will generate an advertisement containing promotional materials and reviews for the new smartphone.

[1209] Specific examples

[1210] As a concrete example, let's consider a case where a user enters the keyword "new smartphone" and, at the same time, analysis using the camera and microphone detects an excited state. In this case, the server provides the keyword and emotion data to the generative AI model, and collects related smartphone information, release information, and user reviews. Furthermore, filtering using the emotion engine displays attractive advertisements that match the user's state of excitement.

[1211] Example prompt sentence:

[1212] Serve relevant ads: Keyword: new smartphone, Emotional state: excitement. Generate smartphone ads that are most engaging when users are excited.

[1213] As a result, the present invention can efficiently provide information and advertisements optimized according to the user's emotional state, improving the user experience.

[1214] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1215] Step 1:

[1216] The user enters search keywords into the search bar on the device. The user uses the device's camera and microphone to provide facial expressions and tone of voice as input. The entered keywords and emotion data are sent from the device to the server.

[1217] Step 2:

[1218] The server processes the received search keywords and emotion data. The server's emotion engine processes the data and identifies the user's emotional state (e.g., joy, sadness, excitement, etc.). The analysis of the emotion data serves as input for the next processing step.

[1219] Step 3:

[1220] The server uses the generative AI model to automatically collect relevant information from the Internet based on the specified search keywords. In this process, the generative AI model searches for information based on the input prompt sentence and provides relevant data as output.

[1221] Step 4:

[1222] The server inputs the collected related information into the emotion engine and performs filtering. For example, if the user is feeling stressed, information about relaxation will be prioritized. The filtered data will be used in the next step.

[1223] Step 5:

[1224] The server uses natural language processing technology to analyze and organize the collected relevant information. This process eliminates duplicate and unnecessary information and extracts key information items. The organized information becomes the input for the next processing step.

[1225] Step 6:

[1226] The server then packages the information product based on the analyzed information. This involves generating a PDF guide using tools such as LaTeX and Markdown. The generated PDF file is then stored in cloud storage and provided to the user.

[1227] Step 7:

[1228] The server generates advertising information based on the emotion data and search keywords. The server's generative AI model generates and outputs appropriate advertisements based on prompts. For example, if a user enters the keyword "new smartphone" and their emotional state is excited, a promotional advertisement for a new smartphone will be generated.

[1229] Step 8:

[1230] The device displays information products and advertising information optimized for the user. The user can download the necessary information products and view the advertisements from the device, optimizing the user experience.

[1231] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1232] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1233] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1234] [Fourth embodiment]

[1235] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1236] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1237] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1238] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1239] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1240] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1241] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1242] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1243] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1244] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1245] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1246] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1247] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1248] System Overview

[1249] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. The system includes users, terminals, and servers, and uses a generative AI model to collect, analyze, and organize information, then sells it in the market.

[1250] Detailed System Operation

[1251] 1. User Input Processing

[1252] The user inputs the desired search keyword (e.g., "How to get clear skin") from the device, and the device sends the input keyword to the server.

[1253] 2. Keyword-based information gathering process

[1254] The server receives the input keywords and provides them to the generative AI model, which then automatically collects relevant information on the Internet based on the input keywords. This collected information is then stored on the server.

[1255] 3. Analysis and organization of information

[1256] The server analyzes the collected information and uses natural language processing techniques to eliminate duplicate and unnecessary information. It then extracts the information, organizes the key items, and categorizes them based on specific themes. For example, information on how to achieve clear skin could be categorized into dietary improvements, skin care product selection, lifestyle adjustments, etc.

[1257] 4. Packaging of information products

[1258] The server then performs a document generation process based on the analyzed and organized information. For example, it generates a detailed beauty guide in PDF format using LaTeX or Markdown. This PDF file is then stored in cloud storage and made accessible.

[1259] 5. Sales processing of information products

[1260] The user sends a request to purchase an information product from their device. The server processes this request and performs payment procedures. If payment is successful, the server provides the user with a download link. The user clicks the download link from their device to download and use the information product.

[1261] Specific examples

[1262] For example, if a user types the keyword "how to get clear skin" into their device, the following process will occur:

[1263] 1. The user enters a keyword into the device's search bar and sends it to the server.

[1264] 2. The server receives the keywords and provides them to the generative AI model.

[1265] 3. The generative AI model automatically collects information related to the keywords on the Internet and sends it back to the server.

[1266] 4. The server analyzes the collected information, eliminates duplicates and unnecessary information, and extracts and organizes the important content.

[1267] 5. The server generates information products in PDF format based on the organized information and stores them in cloud storage.

[1268] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[1269] As described above, the system of the present invention can efficiently collect, analyze, and organize information that users need, and provide it as practical information products.

[1270] The processing flow will be explained below.

[1271] Step 1:

[1272] The user enters a desired keyword (e.g., "how to get clear skin") into the device's search bar.

[1273] Step 2:

[1274] The terminal sends the entered keyword to the server via an HTTP request.

[1275] Step 3:

[1276] The server analyzes the received HTTP request and extracts the keywords sent.

[1277] Step 4:

[1278] The server provides the extracted keywords to the generative AI model.

[1279] Step 5:

[1280] Based on keywords, the generative AI model collects relevant information from various data sources on the Internet (web pages, blogs, research papers, etc.).

[1281] Step 6:

[1282] The server stores the relevant information returned by the generative AI model in a temporary file or database.

[1283] Step 7:

[1284] The server filters the stored information to eliminate duplicate or unnecessary information.

[1285] Step 8:

[1286] The server uses natural language processing (NLP) techniques to extract key items from the relevant information.

[1287] Step 9:

[1288] The server categorizes the extracted important items and organizes them in an easy-to-read format, for example, organizing information by theme, such as beauty tips, product recommendations, and lifestyle improvement methods.

[1289] Step 10:

[1290] The server runs a document generation program based on the organized and structured information, for example, using LaTeX or Markdown to generate a PDF document.

[1291] Step 11:

[1292] The server saves the generated PDF document in cloud storage and makes it accessible to the user.

[1293] Step 12:

[1294] The user sends a request to purchase an information product (e.g., a beauty guide) from their device.

[1295] Step 13:

[1296] The server receives the user's purchase request and initiates the checkout process.

[1297] Step 14:

[1298] Once the payment is successful, the server will generate and provide a download link to the user.

[1299] Step 15:

[1300] The user clicks on the download link provided on the device, downloads the generated information product in PDF document format, and views and uses it.

[1301] Example 1

[1302] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1303] Conventional information provision systems have had difficulty in quickly and efficiently collecting and analyzing the information users need and providing it as practical information products. Furthermore, ensuring the reliability and currency of the collected information has also been problematic. There is also a need to organize and provide the collected information in a format that users can easily use.

[1304] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1305] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords using a generative AI model, means for analyzing and organizing the collected related information using natural language processing technology, means for classifying the analyzed and organized information based on specific themes, means for packaging the analyzed and organized information in document format as information products, means for storing the packaged information products in cloud storage and providing them to users, and means for selling the packaged information products on the market. This enables users to quickly and efficiently obtain reliable information and enjoy it as practical information products.

[1306] A "search keyword" is a word or phrase that a user enters to search for information.

[1307] A "generative AI model" is an artificial intelligence technology that learns from large amounts of data and performs natural language understanding and generation.

[1308] "Natural language processing technology" is a technology for processing and analyzing human language using a computer.

[1309] "Document format" means a format for providing information in document form (e.g., PDF, LaTeX, Markdown).

[1310] "Information products" are products that are sold in packages of analyzed and organized information.

[1311] "Cloud storage" is an online storage service for storing and managing data via the Internet.

[1312] A "server" is a computer system that provides data in response to requests from clients over a network.

[1313] overview

[1314] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. This system includes a user, a terminal, and a server, and uses a generative AI model to collect, analyze, and organize information, which is then sold in the market. The specific configuration and operation are described below.

[1315] Hardware and Software Configuration

[1316] Users use devices connected to the Internet (e.g., PCs, smartphones, tablets).

[1317] The terminal communicates with the server using a web browser or a dedicated application.

[1318] The server runs on a high-performance computer or cloud service (e.g., AWS, Google Cloud Platform), where data processing and the execution of generative AI models take place.

[1319] Generative AI models use large-scale language models to gather relevant information from the internet, such as natural language generation models like GPT-4.

[1320] Natural language processing technologies used include NLTK, spaCy, or dedicated analysis tools.

[1321] Detailed Operation

[1322] 1. User Input Processing

[1323] The user enters a search keyword into the device's search bar, for example, a specific keyword such as "how to get clear skin."

[1324] The terminal transmits the input keyword to the server.

[1325] 2. Keyword-based information gathering process

[1326] The server inputs the keywords received from the device into a generative AI model, which then automatically collects related information from the internet.

[1327] The collected information is stored on a server.

[1328] 3. Analysis and organization of information

[1329] The server analyzes and organizes the collected data using natural language processing technology.

[1330] This process eliminates redundant and unnecessary information and extracts important information.

[1331] The extracted information is categorized based on specific themes, such as "improving your diet," "selecting skin care products," and "adjusting your lifestyle."

[1332] 4. Packaging of information products

[1333] The server generates information products in the form of PDF documents based on the analyzed and organized information, where beautifully formatted documents are created using LaTeX and Markdown.

[1334] The generated PDF file is saved in cloud storage (e.g. Amazon S3), so it can be accessed at any time.

[1335] 5. Sales processing of information products

[1336] The user sends a request to purchase the information product from the terminal to the server.

[1337] The server receives the purchase request and processes the payment, for example using a payment gateway such as Stripe or PayPal.

[1338] Once the payment is successful, the server will provide the user with a download link.

[1339] The user clicks on the download link on their device to download and use the information product.

[1340] Specific examples

[1341] For example, if a user enters the keyword "how to get clear skin," the following prompt sentence may be used:

[1342] "I'd like to gather useful information about 'how to get clear skin'. Please search for information based on this keyword."

[1343] Based on this, the server and generative AI model work together to collect and organize relevant information from the Internet and provide it in a practical form as information products.

[1344] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1345] Step 1:

[1346] User search keyword input and submission

[1347] The user enters a search keyword into the device's search bar, which can be a specific keyword such as "how to get clear skin."

[1348] Input: The search keyword entered by the user.

[1349] The terminal sends the entered keyword to the server as an HTTP POST request.

[1350] Output: The search terms sent to the server.

[1351] Step 2:

[1352] The server receives keywords and inputs them into the AI ​​model

[1353] The server receives the search keywords sent from the terminal.

[1354] Input: The search keyword sent from the device.

[1355] The server inputs the received keywords into a generative AI model (e.g., GPT-4) and uses them as prompts for information gathering.

[1356] Output: The search keywords input into the generative AI model.

[1357] Step 3:

[1358] Information gathering using generative AI models

[1359] The generative AI model automatically collects relevant information on the Internet based on the provided search keywords.

[1360] Input: The search keywords provided to the generative AI model.

[1361] Generative AI models crawl websites and databases to gather relevant information.

[1362] Output: A set of collected relevant information.

[1363] Step 4:

[1364] Server storage of information

[1365] The server receives the information collected from the generative AI model and stores it in a local database.

[1366] Input: Relevant information returned from the generative AI model.

[1367] The server stores the data in a database such as MongoDB or MySQL.

[1368] Output: Collected information stored in a database.

[1369] Step 5:

[1370] Server analysis and organization of information

[1371] The server analyzes the stored information using natural language processing techniques (e.g., NLTK or spaCy).

[1372] Input: Collected information stored in a database.

[1373] The server eliminates duplicate and unnecessary information, extracts important information, and categorizes it by topic, such as "improving your diet," "selecting skin care products," and "adjusting your lifestyle."

[1374] Output: Analyzed and organized information.

[1375] Step 6:

[1376] Packaging of information products into document format by the server

[1377] The server generates information products in document format based on the analyzed and organized information, for example, creating PDF documents using LaTeX or Markdown.

[1378] Input: Analyzed and organized information.

[1379] The server uses a document generation tool to generate beautiful PDF format information materials.

[1380] Output: Information product in PDF format.

[1381] Step 7:

[1382] Saving information products to cloud storage by server

[1383] The server saves the generated PDF information product in cloud storage (e.g., Amazon S3), and generates an accessible URL.

[1384] Input: Information product in PDF format.

[1385] The server uploads the file to cloud storage and gets a public link.

[1386] Output: PDF information product stored in cloud storage and its access link.

[1387] Step 8:

[1388] User requests and provision of information products

[1389] The user sends a request to the server from their device to purchase information products. This request includes the product ID and user ID.

[1390] Input: A purchase request from the user to the server.

[1391] The server receives the purchase request and processes the payment (e.g. Stripe or PayPal). If the payment is successful, the server provides the user with a download link.

[1392] Output: The download link provided to the user.

[1393] Step 9:

[1394] Downloading and use of information products by users

[1395] The user clicks on the download link provided by the server on their device to download the PDF information product.

[1396] Input: The download link provided by the server.

[1397] The user views and uses the downloaded information product.

[1398] Output: The information product acquired by the user.

[1399] Through each of the above steps, this system enables users to quickly and efficiently collect, analyze, and organize the information they need, and then provide it as practical information products.

[1400] (Application example 1)

[1401] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1402] Until now, it has been difficult for users to quickly and efficiently obtain specific information and use it in a practical way. In particular, the process of collecting necessary information from the Internet, organizing it, and providing it as a commercial product was time-consuming and often degraded the user experience. There was also the problem of the collected information being duplicated or inaccurate. There is a need for a system that can solve these problems and efficiently collect and organize the information users need and provide it as a commercial product.

[1403] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1404] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords, means for analyzing and organizing the collected related information, means for packaging the analyzed and organized information as information products, means for selling the packaged information products on the market, means for collecting appropriate information from the Internet using a generative AI model based on the search keywords, and means for saving the collected information in cloud storage so that users can download it. This enables users to efficiently collect, organize, purchase, and use information.

[1405] "Search keywords" are words that users enter to search for specific information on the Internet.

[1406] A "generative AI model" is an algorithm that uses artificial intelligence technology to automatically generate and collect relevant information based on a user's search keywords.

[1407] "Information products" are products that are collected and organized information packaged in the form of documents or the like and sold on the market.

[1408] "Natural language processing technology" is a technology for analyzing and organizing collected information, and is an algorithm that understands and processes human language.

[1409] "Cloud storage" is an online storage service for storing and managing data via the Internet.

[1410] "User downloadable means" refers to the means by which a user can save information products from cloud storage to their device.

[1411] "Packaging" is the process of converting collected information into a cohesive form.

[1412] The present invention provides a system that allows users to quickly obtain necessary information from the Internet using search keywords and provides that information as information products. The system mainly includes a user terminal, a server, and cloud storage. An embodiment of the present invention will be described in detail below.

[1413] 1. System Overview

[1414] A user enters search keywords using a smartphone application. This smartphone application is developed with React Native and provides an interface for receiving user input. The application sends the entered keywords to an API server. The API server is built with Node.js and Express and passes the received keywords to a generative AI model (e.g., OpenAI GPT-4). The generative AI model collects related information from the Internet based on the keywords and sends it back to the server.

[1415] 2. Analyzing and organizing information

[1416] The server analyzes and organizes the collected information using natural language processing techniques (e.g., SpaCy, NLTK), eliminating redundant or unnecessary information and extracting the important content. This information is categorized based on specific themes; for example, information on "how to achieve clear skin" is divided into categories such as "improving your diet," "selecting skincare products," and "adjusting your lifestyle."

[1417] 3. Packaging of information products

[1418] The server then performs a document generation process based on the organized information. It generates information products in PDF format using LaTeX or Markdown and stores them in cloud storage (e.g., Amazon S3), making them easily accessible to users.

[1419] 4. Sale and download of information products

[1420] A user sends a request to purchase an information product through a smartphone application. The server processes the payment and, if successful, provides the user with a download link. The user can click this link to download the information product from cloud storage.

[1421] Specific use cases

[1422] For example, a user enters the keyword "how to achieve clear skin" into a smartphone application. The application sends the entered keyword to a server, which then invokes a generative AI model to collect information from the internet. The collected information is analyzed and organized using natural language processing technology and packaged in PDF format. The user then purchases the completed information product, obtains a download link, saves it on their smartphone, and can view and use it.

[1423] Prompt Sentence Examples

[1424] Find information on the internet about "How to achieve clear skin" and categorize it into the following categories: 1. Improving your diet 2. Choosing the right skincare products 3. Adjusting your lifestyle

[1425] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1426] Step 1:

[1427] The user enters search keywords on the device (smartphone application). The user enters the keywords in the search bar of the application and presses the "Search" button. The entered keywords are sent to the API server. In this step, the input is the search keywords entered by the user, and the output is the keywords sent to the API server.

[1428] Step 2:

[1429] The server passes the received search keywords to a generative AI model to collect related information. The server provides the received keywords to a generative AI model (e.g., OpenAI GPT-4) to collect information related to the keywords from the Internet. In this step, the input is the search keyword, and the output is a list of related information. The server uses the generative AI model to collect information from various sources on the Internet.

[1430] Step 3:

[1431] The server analyzes and organizes the collected information using natural language processing technology. The server analyzes the collected information using natural language processing technology (e.g., SpaCy, NLTK), eliminates duplicate and unnecessary information, and extracts important content. In this step, the collected relevant information is the input, and the analyzed and organized information is obtained as the output. The server performs text analysis and filtering to organize and classify the information.

[1432] Step 4:

[1433] The server packages the analyzed and organized information into an information product through a document generation process. The server uses LaTeX or Markdown to generate the organized information as a PDF document. In this step, the organized information is the input, and the PDF information product is the output. The server automatically generates the document and formats it into an information product.

[1434] Step 5:

[1435] The server saves the packaged information product in cloud storage and generates a download link that users can access. The server saves the generated PDF in cloud storage (e.g., Amazon S3) and generates a download link that users can use. In this step, the input is a PDF document and the output is a download link. The server uploads the data to cloud storage and generates a link.

[1436] Step 6:

[1437] A user purchases an information product on their device (smartphone application) and obtains a download link. The user submits a purchase request for the information product within the application, and after the server processes the payment, the user obtains the download link. In this step, the user's purchase request is received as input, and a download link is provided as output. The user completes the payment procedure and uses the link to download the information product.

[1438] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1439] System Overview

[1440] The present invention is a system that allows users to quickly obtain the information they need using search keywords and provides it as information products. A feature of the present invention is that it incorporates an emotion engine that recognizes the user's emotions, thereby providing information optimized according to the user's emotional state. The system includes a user, a terminal, a server, a generative AI model, and an emotion engine.

[1441] Detailed System Operation

[1442] 1. User Input Processing

[1443] The user inputs the desired search keyword (e.g., "How to get clear skin") from the device, and the device sends the input keyword to the server.

[1444] The device detects user input and records the user's emotional state at the time. For example, it uses a camera and microphone to analyze the user's facial expressions and tone of voice, and provides emotional data to the emotion engine.

[1445] 2. Information collection and processing based on keywords and emotion data

[1446] The server receives the input keywords and emotion data and provides them to the generative AI model, which then automatically collects related information on the Internet based on the input keywords. This collected information is then stored on the server.

[1447] The emotion engine analyzes the user's emotion data and identifies the user's emotional state (e.g., joy, sadness, stress, etc.).

[1448] 3. Analysis and organization of information

[1449] The server filters the collected information based on the emotional state obtained from the emotion engine. For example, if the user is feeling stressed, it will prioritize providing information about relaxation.

[1450] The server analyzes the collected information and uses natural language processing techniques to eliminate duplicate and unnecessary information, then extracts the information and organizes it into key items.

[1451] The organized information is categorized based on specific themes, such as beauty tips, product recommendations, and lifestyle adjustments.

[1452] 4. Packaging of information products

[1453] The server then performs a document generation process based on the analyzed and organized information. Specifically, it generates a detailed beauty guide in PDF format using LaTeX and Markdown. This PDF file is then stored in cloud storage and made accessible.

[1454] 5. Sales processing of information products

[1455] The user sends a request to purchase an information product from their device. The server processes this request and performs payment procedures. If payment is successful, the server provides the user with a download link. The user clicks the download link from their device to download and use the information product.

[1456] Specific examples

[1457] For example, if a user types the keyword "how to get clear skin" into their device and the device recognizes from audio and video recordings that they are feeling stressed, the following process will occur:

[1458] 1. The user enters a keyword into the device's search bar, and the emotion engine analyzes the user's tone of voice and facial expressions to detect stress.

[1459] 2. The device sends the search keywords and emotion data to the server.

[1460] 3. The server provides keywords and emotion data to the generative AI model and emotion engine, and collects related information on the Internet.

[1461] 4. The emotion engine prioritizes and filters out information that will help relieve stress, eliminating duplicate and unnecessary information from the collected information.

[1462] 5. The server uses the organized information to generate a PDF beauty guide that includes specific methods for relaxation and stress management, and stores it in cloud storage.

[1463] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[1464] Through this series of steps, the system of the present invention efficiently provides information optimized according to the user's emotional state, allowing the user to use practical information products.

[1465] The processing flow will be explained below.

[1466] Step 1:

[1467] The user enters a desired keyword (e.g., "how to get clear skin") into the device's search bar.

[1468] Step 2:

[1469] The device sends the input keyword to the server via an HTTP request, and also uses a camera and microphone to record the user's facial expressions and tone of voice to obtain emotional data.

[1470] Step 3:

[1471] The server analyzes the received HTTP request and extracts the keywords sent. The emotion engine analyzes the emotion data and identifies the user's emotional state (e.g., stress level).

[1472] Step 4:

[1473] The server provides the extracted keywords and identified emotional states to the generative AI model, which then collects related information from the internet based on the input keywords.

[1474] Step 5:

[1475] The generative AI model sends the relevant information it has collected back to the server, which stores this information in a temporary file or database.

[1476] Step 6:

[1477] The server filters the stored information to eliminate duplicate or unnecessary information.

[1478] Step 7:

[1479] The server uses natural language processing techniques to extract key items from the relevant information.

[1480] Step 8:

[1481] The emotional engine optimizes the information filtering results based on the user's emotional state. For example, if the user is feeling stressed, information on relaxation methods and stress relief will be prioritized.

[1482] Step 9:

[1483] The server categorizes important items and organizes them in an easy-to-read format, for example, organizing information by theme, such as beauty tips, product recommendations, and lifestyle improvements.

[1484] Step 10:

[1485] The server runs a document generation program based on the organized and structured information, generating a PDF document using LaTeX or Markdown.

[1486] Step 11:

[1487] The server saves the generated PDF document in cloud storage and makes it accessible to the user.

[1488] Step 12:

[1489] The user sends a request to purchase an information product (e.g., a beauty guide) from their device.

[1490] Step 13:

[1491] The server receives the user's purchase request and initiates the payment process. If the payment is successful, the server generates and provides the user with a download link.

[1492] Step 14:

[1493] The user clicks on the download link provided on the device, downloads the generated information product in PDF document format, and views and uses it.

[1494] In this way, the system provides information products optimized based on the user's emotional state, allowing the user to efficiently utilize that information.

[1495] Example 2

[1496] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1497] Conventional information product provision systems collect information based on search keywords entered by users, but it is difficult to provide optimal information taking into account the user's emotional state. Furthermore, the collected information often contains duplicate or unnecessary information, making it difficult to extract the information the user truly needs. This reduces the quality of the user experience and hinders efficient information acquisition.

[1498] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1499] In this invention, the server includes means for receiving search keywords and emotion data entered by the user, means for automatically collecting related information based on the received search keywords and emotion data, and means for analyzing and organizing the collected related information. This allows the server to provide optimal information according to the user's emotional state and eliminates redundant information and unnecessary data, enabling the user to efficiently obtain the information they truly need.

[1500] A "search keyword" is a word or phrase that a user enters to search for specific information.

[1501] "Emotion data" is data that reflects the user's emotional state, and is acquired from facial expressions, tone of voice, and the like.

[1502] "Related information" is data related to information that a user needs, collected based on search keywords and emotion data.

[1503] "Information products" are commercialized information that is collected, analyzed, and organized, packaged, and provided.

[1504] "Automatic collection" is the process of automatically retrieving relevant information from the Internet based on search keywords and emotion data.

[1505] "Analysis and organization" is the process of eliminating duplication and unnecessary data from collected information and providing it to users in the most optimal format.

[1506] "Packaging" is the process of compiling analyzed and organized information into a single product and converting it into an easy-to-use format.

[1507] A "generative AI model" is a model that uses artificial intelligence technology to generate and collect relevant information.

[1508] "Natural language processing technology" is a technology that enables computers to understand and process human language.

[1509] The present invention is a system that automatically collects, analyzes, and organizes related information based on search keywords and emotion data entered by a user, and provides the information as information products. One embodiment of the present invention is specifically described below.

[1510] This system mainly includes a user, a device, a server, an emotion engine, and a generative AI model. The user inputs search keywords from their device, and their emotional state at that time is captured via a camera and microphone. This analyzes the user's facial expressions and tone of voice, and generates emotion data. This emotion data is processed by the emotion engine, which identifies the user's emotional state.

[1511] The device sends emotion data along with search keywords to the server. The server receives this data and provides it as prompts to the generative AI model. The generative AI model automatically collects relevant information from the Internet based on the search keywords and emotion data entered by the user. Specifically, it uses search engines and database access APIs to efficiently extract specific information.

[1512] The collected information is stored on a server, and then natural language processing technology is used to eliminate duplicate information and unnecessary data. This allows only the information that the user truly needs to be extracted, analyzed, and organized. The organized information is packaged as an information product in PDF format using LaTeX or Markdown. The generated PDF file is stored in cloud storage and can be accessed by the user.

[1513] When a user indicates their intention to purchase an information product, the request is sent from the device to the server. The server processes the payment through the payment system, and if the payment is successful, a download link is provided to the user. The user can click this link to download and use the information product.

[1514] Specific examples

[1515] For example, if a user enters the search keyword "how to get clear skin" and the emotion engine detects stress in the user's voice and facial expression, the following process will occur:

[1516] 1. A user types "how to get clear skin" into the search bar on their device and clicks the search button.

[1517] 2. The device sends the search keywords and emotion data to the server.

[1518] 3. The server provides the generative AI model with prompts such as "how to achieve clear skin" and "stress" to collect related information.

[1519] 4. The emotion engine prioritizes and filters out information that will help relieve stress, eliminating duplicate and unnecessary information from the collected information.

[1520] 5. Based on the organized information, the server generates a PDF beauty guide that includes specific methods for relaxation and stress management and stores it in cloud storage.

[1521] 6. The user purchases the information product, obtains a download link, and views and uses it on their device.

[1522] Prompt Sentence Examples

[1523] Examples of prompts to provide to a generative AI model include:

[1524] The search keyword entered by the user is "how to get clear skin" and the user's emotional state is "stress." Collect related information based on this.

[1525] Collect information about the search term "how to get clear skin" and prioritize information about relaxation, considering that users are stressed.

[1526] By following the specific steps described above, the present system efficiently provides optimal information based on the user's emotional state, enabling the user to use practical information products.

[1527] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1528] Step 1:

[1529] The user enters search keywords

[1530] A user enters a keyword into the device's search bar. The entered keyword is displayed in the text box in real time. For example, "How to get clear skin." Once the user has completed the input, the input data is temporarily stored in the device's internal data store.

[1531] Input: The search term entered by the user

[1532] Output: Search keywords are saved in the device's data store.

[1533] What happens: A user types "how to get clear skin" and the device saves the keyword in its data store.

[1534] Step 2:

[1535] User clicks the search button

[1536] When a user clicks the search button, the device sends the entered search keywords to the server. At the same time, the device starts a process to collect emotion data. This emotion data is acquired using the device's camera and microphone.

[1537] Input: Search keywords, user clicks

[1538] Output: Keywords and sentiment data are sent to the server

[1539] Specific operation: The user clicks the search button, and the device sends the recorded audio and video data of "How to get clear skin" to the server.

[1540] Step 3:

[1541] Acquiring emotion data

[1542] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice. The analyzed data is then processed by an emotion engine to detect specific emotional states. For example, the analysis may reveal that the user is feeling stressed.

[1543] Input: Recorded audio and video data

[1544] Output: Stress detection results are obtained as emotion data.

[1545] Specific operation: The device captures the user's facial expressions and analyzes the tone of voice, and the emotion engine detects "stress."

[1546] Step 4:

[1547] Gathering relevant information

[1548] The server provides the received search keywords and emotion data to the generative AI model, which uses "how to get clear skin" and "stress" as prompts to automatically collect related information from the internet.

[1549] Input: Search keywords, emotion data

[1550] Output: Relevant information collected by the generative AI model

[1551] How it works: The server provides the generated AI model with prompts such as "how to get clear skin" and "stress," and then searches and collects articles and research online.

[1552] Step 5:

[1553] Information Filtering

[1554] The server filters the collected information based on the analysis results of the emotion engine. The emotion engine considers the user's emotional state and selects appropriate information. For example, information related to stress relief is given priority.

[1555] Input: Collected relevant information, analysis results of the emotion engine

[1556] Output: Pertinent filtered information

[1557] What it does: The emotion engine takes "stress" into account and prioritizes filtering articles about relaxation.

[1558] Step 6:

[1559] Analyzing and organizing information

[1560] The server uses natural language processing technology to filter out redundant and unnecessary information and extract the important parts. The organized information is then categorized based on specific themes.

[1561] Input: Filtered information

[1562] Output: Organized and categorized information

[1563] How it works: The server uses Python's NLTK library to parse the information, remove duplicates, and categorize it into "beauty tips," "product recommendations," and "lifestyle adjustments."

[1564] Step 7:

[1565] Creation of information products

[1566] The server uses LaTeX and Markdown to generate detailed information products in PDF format from the analyzed and organized information. This PDF is then stored in cloud storage.

[1567] Input: Organized and categorized information

[1568] Output: Information product in PDF format

[1569] Specific operation: The server executes the LaTeX script to generate a PDF and uploads the generated PDF to cloud storage (e.g. AWS S3).

[1570] Step 8:

[1571] Sales and downloads of information products

[1572] The user sends a request to purchase an information product from their device. The server completes the transaction using the payment system, and if successful, provides the user with a download link. The user clicks the link to download the information product.

[1573] Input: User purchase request, payment information

[1574] Output: Download link, information product provided

[1575] Specific operation: The user clicks the "Purchase" button, the server processes the payment, and after the payment is completed, the user receives a download link via email, and the user downloads the PDF guide to their device.

[1576] Through the above processing steps, the system of the present invention efficiently provides optimal information based on the user's emotional state, allowing the user to use practical information products.

[1577] (Application example 2)

[1578] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1579] Conventional search systems provide information based on search keywords entered by users, but they do not adequately provide personalized information or advertisements based on the user's emotional state. This makes it difficult to effectively provide optimal information and advertisements to users. Furthermore, the lack of filtering and organization of information based on the user's emotional state results in a suboptimal user experience.

[1580] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1581] In this invention, the server includes means for receiving search keywords entered by a user, means for automatically collecting related information based on the received search keywords, means for analyzing and organizing the collected related information, means for packaging the analyzed and organized information as information products, means for selling the packaged information products on the market, means for recognizing the emotional state of the user and optimizing information based on the emotional state, means for filtering related information based on the emotional state, and means for generating and providing advertising information based on the keywords and the emotional state. This makes it possible to effectively provide optimal information and advertisements according to the user's emotional state, thereby achieving a higher user experience.

[1582] A "search keyword" is a word or phrase that a user enters to search for specific information.

[1583] "Related information" refers to data or content that is highly relevant to the user's request and is obtained based on the search keywords.

[1584] "Information products" are digital content or information products that are analyzed and organized, packaged, and offered as a product.

[1585] An "emotional state" is an emotional state (e.g., joy, sadness, excitement, stress, etc.) identified by analyzing the user's tone of voice, facial expressions, etc.

[1586] An "emotion engine" is software or a system for recognizing and analyzing a user's emotional state.

[1587] "Generative AI models" are algorithms and systems that use artificial intelligence techniques to generate text or data based on specified input.

[1588] "Natural language processing technology" is a technology that enables computers to understand, analyze, and generate human language.

[1589] "Filtering" is the process of filtering out unnecessary information from relevant information and selecting the most appropriate information based on the user's needs and emotional state.

[1590] "Advertising information" is digital content for promoting a particular product or service.

[1591] The present invention provides a system that allows users to quickly obtain necessary information using search keywords and provides the information as information products, and further provides optimal information and advertisements based on the emotional state of the user.

[1592] System Overview

[1593] This system includes a user, a device, a server, a generative AI model, and an emotion engine. The user can input search keywords through the device and have the emotion engine recognize their emotional state. The server uses the generative AI model to analyze and organize the collected related information, filter the information based on the emotional state, and provide information products and advertising information.

[1594] Hardware and Software Configuration

[1595] 1. On the user's device:

[1596] Camera (e.g. webcam)

[1597] microphone

[1598] Internet connection

[1599] 2. Server:

[1600] High-performance computers

[1601] Internet connection

[1602] Emotion Engine

[1603] Generative AI models (e.g., GPT-3)

[1604] Natural language processing technologies (e.g., the Transformers library)

[1605] Program processing

[1606] 1. User Input Processing:

[1607] The user enters search keywords into the search bar on the device, and at the same time, the camera and microphone are used to analyze the user's facial expressions and tone of voice, allowing the emotion engine to recognize the user's current emotional state. This emotion data is then sent to the server along with the keyword.

[1608] 2. Information collection and generation:

[1609] The server uses a generative AI model to collect relevant information from the internet based on search keywords. The collected information is filtered according to the user's emotional state by inputting emotional data from an emotion engine. For example, if the user is feeling stressed, information about relaxation will be prioritized.

[1610] 3. Packaging information:

[1611] The server uses natural language processing technology to analyze and organize the collected information, eliminating duplicate and unnecessary information. The generated information is packaged as information products and made available to the market. For example, detailed guides in PDF format are generated using LaTeX and Markdown.

[1612] 4. Advertising Serving:

[1613] Based on the emotional data and search keywords, the generative AI model generates optimal advertising information. For example, if a user enters the keyword "new smartphone" and their emotional state is excitement, the model will generate an advertisement containing promotional materials and reviews for the new smartphone.

[1614] Specific examples

[1615] As a concrete example, let's consider a case where a user enters the keyword "new smartphone" and, at the same time, analysis using the camera and microphone detects an excited state. In this case, the server provides the keyword and emotion data to the generative AI model, and collects related smartphone information, release information, and user reviews. Furthermore, filtering using the emotion engine displays attractive advertisements that match the user's state of excitement.

[1616] Example prompt sentence:

[1617] Serve relevant ads: Keyword: new smartphone, Emotional state: excitement. Generate smartphone ads that are most engaging when users are excited.

[1618] As a result, the present invention can efficiently provide information and advertisements optimized according to the user's emotional state, improving the user experience.

[1619] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1620] Step 1:

[1621] The user enters search keywords into the search bar on the device. The user uses the device's camera and microphone to provide facial expressions and tone of voice as input. The entered keywords and emotion data are sent from the device to the server.

[1622] Step 2:

[1623] The server processes the received search keywords and emotion data. The server's emotion engine processes the data and identifies the user's emotional state (e.g., joy, sadness, excitement, etc.). The analysis of the emotion data serves as input for the next processing step.

[1624] Step 3:

[1625] The server uses the generative AI model to automatically collect relevant information from the Internet based on the specified search keywords. In this process, the generative AI model searches for information based on the input prompt sentence and provides relevant data as output.

[1626] Step 4:

[1627] The server inputs the collected related information into the emotion engine and performs filtering. For example, if the user is feeling stressed, information about relaxation will be prioritized. The filtered data will be used in the next step.

[1628] Step 5:

[1629] The server uses natural language processing technology to analyze and organize the collected relevant information. This process eliminates duplicate and unnecessary information and extracts key information items. The organized information becomes the input for the next processing step.

[1630] Step 6:

[1631] The server then packages the information product based on the analyzed information. This involves generating a PDF guide using tools such as LaTeX and Markdown. The generated PDF file is then stored in cloud storage and provided to the user.

[1632] Step 7:

[1633] The server generates advertising information based on the emotion data and search keywords. The server's generative AI model generates and outputs appropriate advertisements based on prompts. For example, if a user enters the keyword "new smartphone" and their emotional state is excited, a promotional advertisement for a new smartphone will be generated.

[1634] Step 8:

[1635] The device displays information products and advertising information optimized for the user. The user can download the necessary information products and view the advertisements from the device, optimizing the user experience.

[1636] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1637] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1638] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1639] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1640] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1641] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1642] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1643] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1644] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1645] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1646] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1647] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1648] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1649] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1650] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1651] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1652] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1653] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1654] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1655] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1656] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1657] The following is further disclosed regarding the above embodiment.

[1658] (Claim 1)

[1659] means for receiving search keywords entered by a user;

[1660] means for automatically collecting relevant information based on the received search keywords;

[1661] A means of analyzing and organizing the collected relevant information;

[1662] A means of packaging analyzed and organized information as information products,

[1663] A system including a means for selling packaged information products to the market.

[1664] (Claim 2)

[1665] 10. The system of claim 1, wherein the analyzed and organized information is organized using natural language processing techniques.

[1666] (Claim 3)

[1667] The system of claim 1 uses a generative AI model to collect relevant information based on search keywords.

[1668] "Example 1"

[1669] (Claim 1)

[1670] means for receiving search keywords entered by a user;

[1671] means for automatically collecting relevant information based on the received search keywords;

[1672] A means of analyzing and organizing the collected related information using natural language processing technology;

[1673] A means to package the analyzed and organized information in document format as information products,

[1674] A means for storing packaged information products in cloud storage and providing them to users;

[1675] A system including a means for selling packaged information products to the market.

[1676] (Claim 2)

[1677] 10. The system of claim 1, wherein the system uses a generative AI model to collect relevant information based on search keywords.

[1678] (Claim 3)

[1679] 10. The system of claim 1, wherein the analyzed and organized information is classified based on specific themes.

[1680] "Application Example 1"

[1681] (Claim 1)

[1682] means for receiving search keywords entered by a user;

[1683] means for automatically collecting relevant information based on the received search keywords;

[1684] A means of analyzing and organizing the collected relevant information;

[1685] A means of packaging analyzed and organized information as information products,

[1686] A means of selling packaged information products to the market,

[1687] A means of gathering relevant information from the internet using generative AI models based on search keywords;

[1688] A system that stores collected information in cloud storage and includes a means for users to download it.

[1689] (Claim 2)

[1690] 10. The system of claim 1, wherein the analyzed and organized information is organized using natural language processing techniques.

[1691] (Claim 3)

[1692] The system according to claim 1, which enables the purchase and download of information products by inputting search keywords using a smartphone.

[1693] "Example 2: Combining Emotion Engines"

[1694] (Claim 1)

[1695] means for receiving search keywords entered by a user;

[1696] means for automatically collecting relevant information based on the received search keywords and emotion data;

[1697] A means of analyzing and organizing the collected relevant information;

[1698] A means of packaging analyzed and organized information as information products,

[1699] A system including a means for selling packaged information products to the market.

[1700] (Claim 2)

[1701] 10. The system of claim 1, wherein the analyzed and organized information is organized using natural language processing techniques.

[1702] (Claim 3)

[1703] 10. The system of claim 1, wherein a generative AI model is used to gather relevant information based on the received search keywords and sentiment data.

[1704] "Application example 2 when combining emotion engines"

[1705] (Claim 1)

[1706] means for receiving search keywords entered by a user;

[1707] means for automatically collecting relevant information based on the received search keywords;

[1708] A means of analyzing and organizing the collected relevant information;

[1709] A means of packaging analyzed and organized information as information products,

[1710] A means of selling packaged information products to the market,

[1711] means for recognizing an emotional state of a user and optimizing information based on the emotional state;

[1712] means for filtering relevant information based on emotional state;

[1713] A system including a means for generating and providing advertising information based on keywords and emotional states.

[1714] (Claim 2)

[1715] 10. The system of claim 1, wherein the analyzed and organized information is organized using natural language processing techniques.

[1716] (Claim 3)

[1717] The system of claim 1 uses a generative AI model to collect relevant information based on search keywords. [Explanation of symbols]

[1718] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for receiving search keywords entered by a user; means for automatically collecting relevant information based on the received search keywords; A means of analyzing and organizing the relevant information collected; A means of packaging the analyzed and organized information as information products, A system including a means for selling packaged information products to the market.

2. The system according to claim 1 , wherein the analyzed and organized information is organized using natural language processing technology.

3. The system of claim 1 , wherein the system uses a generative AI model to collect related information based on search keywords.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A