System

The system addresses the challenges of generating and providing information based on user interests and predicting future interests by using AI to generate relevant content and display targeted advertisements, thereby enhancing user experience and advertising effectiveness.

JP2025051776APending Publication Date: 2025-04-04SOFTBANK GROUP CORP
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2024164621
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-22
Filing Date
2024-09-20
Publication Date
2025-04-04

AI Technical Summary

Technical Problem

Existing information provision systems struggle to efficiently generate and provide information based on user interests, predict future interests, and effectively display advertisements related to user interests.

Method used

A system that allows users to input information of interest, uses AI to generate information that may be of interest in the future, and outputs this information to the user, while also enabling the posting of advertisements related to the generated information.

Benefits of technology

The system effectively generates and provides information tailored to user interests, predicts future interests, and maximizes advertising effectiveness by displaying relevant advertisements to users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025051776000001_ABST
    Figure 2025051776000001_ABST
Patent Text Reader

Abstract

To provide a system.SOLUTION: A system comprises: means for receiving input information having an interest and attention that are input by a user; means for analyzing the input information and creating a prompt sentence instructing generation of new information that has a possibility in which the user has an interest and attention in the future; means for generating the new information using a generative AI model on the basis of the created prompt sentence; and means for outputting the new information to the user.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] If users are only exposed to information that interests them, they may have fewer opportunities to become fond of new things, and it may take longer. In addition, there is no way to obtain information about "things and events" that they may like in the future, even if they are not aware of them. [Means for solving the problem]

[0005] We developed a system that provides a means for users to input information that interests them, an AI means for generating information that the user may be interested in in the future based on the input information, and a means for outputting the generated information to the user. Furthermore, by including a means for placing advertisements in the generated information, we have made it possible to engage in advertising businesses. [Brief description of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Diagram 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. FIG. [Diagram 3] FIG. 11 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Diagram 5] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 13 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a process flow of the data processing system in the first embodiment of the first form example. [Figure 12] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the application example 1 of the first embodiment. [Figure 13] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the second embodiment of the second embodiment. [Figure 14] FIG. 13 is a sequence diagram showing a process flow of the data processing system in application example 2 of embodiment 2. [Figure 15] FIG. 13 is a sequence diagram showing a process flow of a data processing system in a third embodiment of the present invention. [Figure 16]FIG. 13 is a sequence diagram showing a process flow of the data processing system in the third application example of the third embodiment. [Figure 17] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when combined with an emotion engine. [Figure 19] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system according to the embodiment 2 of the second embodiment in the case where an emotion engine is combined. [Figure 20] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when combined with an emotion engine. [Figure 21] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the embodiment 3 of the form example 3 in the case where an emotion engine is combined. [Figure 22] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when combined with an emotion engine. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (e.g., voice and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of main functions of the data processing device 12 and the smart device 14.

[0023] As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32. The specific process program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific process program 56 from the storage 32, and executes the read specific process program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific process program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores a reception output program 60. The reception output program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads out the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] The system of the present invention provides a dedicated input screen as a means for inputting information that the user is interested in. On this input screen, the user can input multiple photos and text that he or she likes. For example, if the user is interested in a particular genre such as music, movies, or travel, the user can input photos and text related to that genre.

[0029] "Example 2"

[0030] Next, an AI means is provided that generates information that the user may be interested in in the future based on the input information. This AI means analyzes the information input by the user and generates new information based on that information. For example, if the user inputs the music genre "rock," the AI ​​can use that information to generate information on new rock bands and artists that the user does not yet know.

[0031] "Example 3"

[0032] A dedicated output screen is provided as a means of outputting the generated information to users. On this output screen, the information generated by AI is displayed, and users can view that information. A means is also provided for placing advertisements on the generated information. This allows advertisers to place advertisements related to information that may be of interest to users, and users can view advertisements that match their own interests and concerns.

[0033] The process flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: The user opens a dedicated input screen, where the user can enter information about their interests using photos and text.

[0036] Step 2: The user enters a photo of their favorite music genre, "rock," along with keywords related to that genre.

[0037] Step 3: The information entered will be stored in the system and used in the next step.

[0038] "Example 2"

[0039] Step 1: The system’s AI means analyzes the information entered by the user.

[0040] Step 2: Based on photos and keywords in the "rock" genre, the AI ​​generates information about new rock bands and artists that the user does not yet know.

[0041] Step 3: The generated information is stored in the system and will be used in the next step.

[0042] "Example 3"

[0043] Step 1: The system provides the user with a dedicated output screen, where the AI-generated information is displayed.

[0044] Step 2: The user opens the output screen and views the information about the new rock band or artist generated by the AI.

[0045] Step 3: At the same time, advertisements provided by advertisers are displayed to the user, which are related to the information that may be of interest to the user.

[0046] Example 1

[0047] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0048] Conventional information provision systems have had difficulty efficiently generating and providing information based on users' interests. It has also been difficult to properly analyze information entered by users and predict what information they may be interested in in the future. Furthermore, there has been a lack of effective means of placing advertisements on the generated information.

[0049] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes a means for inputting information that the user is interested in, a means for saving the input information in a database, a means for analyzing the saved information and generating a prompt sentence, a means for sending the generated prompt sentence to the generation AI model, and a means for receiving a response from the generation AI model and outputting it to the user. This makes it possible to efficiently generate and provide information based on the user's interests. It is also possible to predict and provide information that the user may be interested in in the future. Furthermore, it is also possible to effectively place advertisements in the generated information.

[0050] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[0051] "Information of interest" is data such as photographs and text related to a particular genre or theme in which the user is interested.

[0052] "Means of input" refers to an interface for users to input information of their interest into the system, and specifically includes text boxes and file upload functions.

[0053] A "database" is a system for storing information entered by a user, enabling the management and retrieval of information.

[0054] "Means of analysis" refers to the process of analyzing the information stored in the database and generating prompt sentences based on the user's interests and concerns.

[0055] A "prompt sentence" is a sentence input into a generative AI model, and is an instruction sentence to generate information based on the user's interests and concerns.

[0056] A "generative AI model" is an artificial intelligence model that generates information based on a prompt sentence, for example using natural language processing technology.

[0057] "Means for sending" refers to a communication means for sending the generated prompt sentence to the generative AI model.

[0058] A “means for receiving a response” is a process for receiving generated information from a generative AI model.

[0059] "Means for output" refers to an interface for displaying information received from the generative AI model to the user.

[0060] "Means for displaying advertisements" refers to the process for adding advertisements to the generated information and displaying them to the user.

[0061] This invention is a system that inputs information that a user is interested in and provides related information using a generative AI model based on that information. A specific embodiment of this system will be described below.

[0062] First, the user accesses the system's input screen using a web browser. This input screen is built using HTML, CSS, and JavaScript (registered trademark), and includes text boxes and a file upload function for users to enter information about their interests.

[0063] When a user enters information such as "rock music," "guitar," and "live concert" into the input screen, the server receives this information and stores it in a MySQL® database. The server uses a PHP script to process the data sent by the user and store it in the database.

[0064] Next, the server analyzes the information stored in the database and generates a prompt based on the user's interests. For example, if the user enters information such as "rock music," "guitar," and "live concerts," the server generates a prompt that reads, "The user is interested in rock music. Please provide the latest news and event information related to rock music."

[0065] The generated prompt sentence is sent by the server to a generative AI model (e.g., a model using natural language processing technology). The server uses an API to send the prompt sentence to the generative AI model. The generative AI model generates information related to the user's interests and concerns based on the received prompt sentence. For example, it generates information such as "Latest rock music news: A famous rock band has released a new album. The next live concert will be held next month."

[0066] The server displays the information received from the generative AI model to the user. Specifically, the server uses HTML templates to display the generated information in the user's browser, allowing the user to obtain the latest information based on their own interests.

[0067] The system further includes a means for placing advertisements in the generated information. The server adds advertisements related to the generated information and displays them to the user, thereby earning advertising revenue.

[0068] Examples of prompts include:

[0069] "Your users are interested in movies. Give them the latest movie-related news and reviews."

[0070] In this way, this invention makes it possible to efficiently generate and provide information based on the user's interests. It also makes it possible to predict and provide information that the user may be interested in in the future. Furthermore, it also makes it possible to effectively place advertisements in the generated information.

[0071] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0072] Step 1:

[0073] The user accesses the input screen.

[0074] The user accesses the system's input screen using a web browser. This input screen is built using HTML, CSS, and JavaScript (registered trademark), and includes text boxes and file upload functions for the user to enter information of their interest. By accessing the input screen, the user is ready to enter information.

[0075] Step 2:

[0076] The user enters information about their interests.

[0077] The user inputs information about his / her interests (e.g., music, movies, travel, etc.) using the text boxes and file upload function displayed on the input screen. The user can input multiple photos and text. The input information is sent to the server as data reflecting the user's interests.

[0078] Step 3:

[0079] The server receives the entered information and stores it in a database.

[0080] The server receives the information entered by the user and stores it in a MySQL database. Specifically, the server uses a PHP script to process the data submitted by the user and store it in the database. The input data is stored in the database as information indicating the user's interests.

[0081] Step 4:

[0082] The server parses the stored information and generates a prompt.

[0083] The server analyzes the information stored in the database and generates a prompt based on the user's interests. For example, if the user inputs information such as "rock music," "guitar," and "live concerts," the server generates a prompt that reads, "The user is interested in rock music. Please provide the latest news and event information related to rock music." Analysis and generation of the prompt are performed based on the user's input data.

[0084] Step 5:

[0085] The server sends the generated prompt to the generative AI model.

[0086] The server sends the generated prompt text to the generative AI model. The server uses an API to send the prompt text to the generative AI model. The prompt text serves as an instruction text for the generative AI model to generate information related to the user's interests and concerns.

[0087] Step 6:

[0088] A generative AI model generates information based on the prompt.

[0089] The generative AI model generates information related to the user's interests based on the received prompt sentence. For example, it generates information such as "Latest rock music news: A famous rock band has released a new album. The next live concert will be held next month." The generative AI model takes the prompt sentence as input and outputs related information.

[0090] Step 7:

[0091] The server receives the generated information and displays it to the user.

[0092] The server displays the information received from the generative AI model to the user. Specifically, the server uses an HTML template to display the generated information in the user's browser. This allows the user to obtain the latest information based on their own interests. The generated information is output to the user's browser.

[0093] Step 8:

[0094] The server places advertisements in the generated information.

[0095] The server adds advertisements related to the generated information and displays them to the user. By displaying the advertisements together with the generated information, advertising revenues related to the user's interests can be earned. Advertisements are displayed based on the generated information.

[0096] (Application example 1)

[0097] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0098] Conventional content recommendation systems have had difficulty effectively providing personalized content based on the user's interests. In addition, they lacked the means to generate prompts based on the information entered by the user and to recommend appropriate content using those prompts, which made it difficult to increase user satisfaction.

[0099] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0100] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for generating a prompt sentence based on the information input by the user, and a means for recommending content using the generated prompt sentence, thereby enabling personalized content recommendation based on the user's interests.

[0101] "User" means an individual or organization that uses the System.

[0102] "Information of interest" is information related to a particular genre or theme in which a user has an interest.

[0103] The "means of input" refers to an interface that allows a user to provide information of interest or concern to the system.

[0104] "Artificial intelligence means" means algorithms or models that analyze information entered by a User and generate information that may be of interest to the User in the future.

[0105] The "means for outputting" is an interface for providing the generated information to the user.

[0106] A "prompt sentence" is an instruction sentence for recommending content that is generated based on information entered by the user.

[0107] A "content recommendation means" is an algorithm or system that uses generated prompts to select and provide content appropriate to the user.

[0108] A system for implementing this invention includes a means for inputting information that a user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for generating a prompt sentence based on the information input by the user, and a means for recommending content using the generated prompt sentence.

[0109] Explanation of system program processing

[0110] Hardware and Software

[0111] Hardware: Smartphones, servers

[0112] Software: Python, OpenAI® API

[0113] Data processing and calculation

[0114] 1. Obtaining user input: The user uses his / her smartphone to input information about his / her interests (e.g., travel, beach photos, adventure movies, etc.) The input information is sent to the server.

[0115] 2. Prompt generation: The server generates a prompt based on the information entered by the user. For example, if the user enters "travel", "beach pictures", and "adventure movies", the generated prompt will look like this:

[0116] Recommend content based on your users' interests.

[0117] trip

[0118] Beach Photos

[0119] Adventure movies

[0120] 3. Content recommendation: The server sends the generated prompt to the OpenAI API to recommend appropriate content. OpenAI's generative AI model generates content such as movies, music, and articles that are suitable for the user based on the prompt.

[0121] 4. Output of recommended content: The server sends the generated content to the smartphone and displays it to the user. For example, if the user inputs "travel", "beach photos", and "adventure movies", the recommended content will be as follows:

[0122] Movie: "Into the Wild"

[0123] Music: "The Beach Boys Album"

[0124] Article: "The 10 most beautiful beaches in the world"

[0125] In this way, personalized content recommendations based on the user's interests are possible.

[0126] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0127] Step 1:

[0128] Enter information about the user's interests.

[0129] A user uses a smartphone to input information about his / her interests (e.g., travel, beach photos, adventure movies, etc.) The input information is sent from the smartphone to the server.

[0130] Input: Information entered by the user (e.g. travel, beach photos, adventure movies)

[0131] Output: User input sent to the server

[0132] Step 2:

[0133] The server receives the user's input and generates a prompt.

[0134] The server generates a prompt based on the information the user enters. For example, if the user enters "travel," "beach pictures," and "adventure movies," the generated prompt might look like this:

[0135] Recommend content based on your users' interests.

[0136] trip

[0137] Beach Photos

[0138] Adventure movies

[0139] Input: User input information

[0140] Output: The generated prompt statement

[0141] Step 3:

[0142] The server recommends content using generated prompts.

[0143] The server sends the generated prompt text to the OpenAI API, which then recommends appropriate content. OpenAI's generative AI model generates content such as movies, music, and articles that are suitable for the user based on the prompt text.

[0144] Input: Generated prompt text

[0145] Output: Recommended content

[0146] Step 4:

[0147] The server outputs the recommended content to the user.

[0148] The server sends the generated content to the smartphone and displays it to the user. For example, if the user inputs "travel," "beach photos," and "adventure movies," the recommended content will be as follows:

[0149] Movie: "Into the Wild"

[0150] Music: "The Beach Boys Album"

[0151] Article: "The 10 most beautiful beaches in the world"

[0152] Input: Recommended content

[0153] Output: The content displayed on the user's smartphone

[0154] Example 2

[0155] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0156] Conventional information provision systems have had difficulty effectively generating information that users may be interested in in the future. In addition, when generating new information based on information entered by the user, appropriate analysis and generation were often not performed. As a result, useful information for users was not provided, resulting in a poor user experience.

[0157] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0158] In this invention, the server includes a means for inputting information that the user is interested in, a means for transmitting the input information to the server, a means for the server to analyze the input information, a means for the server to input a prompt sentence to the generative AI model based on the analysis result, a means for the generative AI model to generate new information, a means for transmitting the generated information from the server to the terminal, and a means for outputting the generated information to the user. This makes it possible to effectively generate information that the user may be interested in in the future and provide information that is useful to the user.

[0159] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[0160] "Means of input" refers to the interface or device that allows a user to input information of interest or concern into the system.

[0161] "Means of transmission" refers to the communications protocol and network infrastructure used to transmit the information entered by the user to the server.

[0162] A "server" is a computer system that receives and analyzes information sent by a user and inputs prompt sentences into the generative AI model.

[0163] "Means of analysis" refers to the process by which the server analyzes the information received from the user using natural language processing technology, etc.

[0164] A "generative AI model" is an artificial intelligence model that generates new information based on an input prompt sentence.

[0165] A "prompt" is a textual instruction that is input to a generative AI model.

[0166] The "means of generation" refers to the process by which the generative AI model generates new information based on the prompt sentence.

[0167] The "means for transmitting" refers to the communication protocol and network infrastructure that the server uses to transmit the generated information to the terminal.

[0168] "Output means" refers to an interface or device that allows the terminal to display generated information to the user.

[0169] A "terminal" is a device, such as a computer or smartphone, that a user uses to enter information and receive generated information.

[0170] The present invention relates to a system for generating information that a user may be interested in in the future. A specific embodiment of this system will be described below.

[0171] First, the user uses a terminal to input information about their interests. Terminals include devices such as computers, smartphones, and tablets. The information input by the user is, for example, the music genre "rock."

[0172] The device then transmits the input information to a server using a communications protocol such as an HTTP request. The server has hardware and software to analyze the information it receives. In particular, it uses natural language processing techniques to analyze the input information. Analysis includes text tokenization and semantic analysis.

[0173] The server inputs a prompt sentence into the generative AI model based on the analysis results. For example, OpenAI's GPT-4 (registered trademark) is used as the generative AI model. An example of a prompt sentence is "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet."

[0174] The generative AI model generates new information based on the prompt text. This information includes information about new rock bands and artists that the user does not yet know. The generated information is sent from the server to the device. This transmission also uses a communication protocol such as HTTP response.

[0175] Finally, the device displays the generated information to the user, who can then review the information and learn about new rock bands and artists.

[0176] As a specific example, if a user enters the keyword "rock", the device sends this information to the server via an HTTP request. The server analyzes the received keyword "rock" using natural language processing technology and creates a prompt sentence to be input into the generative AI model. For example, it generates a prompt sentence such as "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet." The generative AI model (GPT-4) generates information about new rock bands and artists based on this prompt sentence. The server sends the generated information to the device via an HTTP response. The device displays the received information to the user, allowing the user to learn about new rock bands and artists.

[0177] In this way, the present invention can effectively generate information that may be of interest to the user in the future and provide the user with useful information.

[0178] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0179] Step 1:

[0180] The user enters information

[0181] A user uses a terminal to input information about his / her interests. For example, if a user is interested in the music genre "rock," the user inputs "rock." The input information is obtained through an input interface of the terminal.

[0182] Step 2:

[0183] The device sends the input information to the server

[0184] The terminal transmits the information input by the user to the server. This transmission uses a communication protocol such as an HTTP request. The input information (e.g., "lock") is transmitted to the server as the payload of the HTTP request.

[0185] Step 3:

[0186] The server parses the input

[0187] The server analyzes the received input information. This analysis uses natural language processing techniques. Specifically, it performs text tokenization and semantic analysis. The input information (e.g. "lock") is analyzed, and related keywords and context are extracted.

[0188] Step 4:

[0189] The server inputs a prompt to the generative AI model.

[0190] The server creates a prompt sentence to be input to the generative AI model based on the analysis results. For example, it generates a prompt sentence such as "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet." The generated prompt sentence is input to the generative AI model.

[0191] Step 5:

[0192] Generative AI models generate new information

[0193] A generative AI model (e.g., GPT-4) generates new information based on the prompt received from the server. This information includes information about new rock bands and artists that the user does not yet know. The generative AI model analyzes the prompt and generates related new information.

[0194] Step 6:

[0195] The server sends the generated information to the terminal.

[0196] The server sends the new information obtained from the generative AI model to the terminal. This transmission also uses a communication protocol such as an HTTP response. The generated information (e.g., information on a new rock band or artist) is sent to the terminal as the payload of the HTTP response.

[0197] Step 7:

[0198] The terminal displays the generated information to the user.

[0199] The terminal displays the new information received from the server to the user. The user can check the displayed information and learn about new rock bands and artists. The generated information is visually presented to the user through the display interface of the terminal.

[0200] (Application example 2)

[0201] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0202] Conventional content recommendation systems have the problem that it is difficult to effectively recommend new content based on information entered by the user. It is also difficult to accurately predict the user's interests and provide information that may be of interest to the user in the future. Furthermore, there is a lack of means to appropriately present the generated information to the user.

[0203] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0204] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for recommending new content based on the information input by the user, and a means for displaying the generated recommendation results. This makes it possible to accurately predict the user's interests, effectively recommend new content that the user may be interested in in the future, and appropriately present the content to the user.

[0205] "Means for users to input information that interests them" refers to an interface that enables users to input information that interests them into the system.

[0206] "AI means for generating information that the user may be interested in in the future based on the input information" refers to artificial intelligence technology that analyzes information input by the user and generates new information that the user may be interested in in the future based on that information.

[0207] "Means for outputting the generated information to the user" refers to an interface for presenting the information generated by the AI ​​means to the user.

[0208] "Means for recommending new content based on information entered by a user" refers to technology for selecting and recommending new content that may be of interest to a user based on information entered by the user.

[0209] The "means for displaying the generated recommendation results" is an interface for visually presenting the recommended new content to the user.

[0210] A system for implementing this invention includes means for inputting information that a user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for outputting the generated information to the user, means for recommending new content based on the information input by the user, and means for displaying the generated recommendation results.

[0211] System Programming

[0212] The program of this system operates as follows.

[0213] 1. Obtaining user input: A user enters information about their interests (e.g., music genre or artist name) through a smartphone application.

[0214] 2. Prompt generation: The server generates a prompt sentence to be passed to the generative AI model based on the information entered by the user.

[0215] 3. Invoke the AI ​​model: The server passes the prompt to a generative AI model (e.g., GPT-3 (registered trademark)) using OpenAI’s API to generate new content recommendations.

[0216] 4. Displaying recommendation results: The server displays the generated recommendation results to the user through the smartphone application.

[0217] Hardware and Software Used

[0218] Hardware: Smartphones, servers

[0219] Software: Python, OpenAI API

[0220] Examples

[0221] When a user uses a smartphone application to input the music genre "rock", the following prompt is generated:

[0222] Examples of prompt statements

[0223] Recommend new music content that may interest users. Genre: Rock

[0224] The server passes this prompt to the OpenAI API and receives recommendations for new rock bands and artists from the generative AI model. For example, recommendations such as "New rock band 'The New Waves'" or "Artist 'Rocky Road'" are generated.

[0225] The generated recommendation results are displayed to users through a smartphone application, allowing users to discover new music content based on their own interests.

[0226] In this way, it is possible to accurately predict a user's interests and effectively recommend new content that may be of interest to the user in the future, and present it appropriately to the user.

[0227] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0228] Step 1:

[0229] A user uses a smartphone application to input information about his or her interests (e.g., music genres and artist names).

[0230] Input: Information entered by the user (e.g. "lock")

[0231] Output: User input information is sent to the server

[0232] Step 2:

[0233] The server receives the information entered by the user and generates a prompt sentence based on that information to pass to the generative AI model.

[0234] Input: User input information (e.g. "lock")

[0235] Data processing: Converting user input information into prompt text

[0236] Output: Prompt (e.g. "Recommend new music content that may interest the user. Genre: Rock")

[0237] Step 3:

[0238] The server passes the generated prompt text to OpenAI's API, which then invokes a generative AI model (e.g., GPT-3) to generate new content recommendations.

[0239] Input: prompt statement

[0240] Data calculation: Using OpenAI's API, we pass the prompt sentence to the generative AI model and generate recommendation results.

[0241] Output: Recommendation results (e.g. "New rock band 'The New Waves'" or "Artist 'Rocky Road'")

[0242] Step 4:

[0243] The server transmits the generated recommendation results to the smartphone application.

[0244] Input: Recommendation results

[0245] Output: Recommendation results are sent to a smartphone application.

[0246] Step 5:

[0247] The smartphone application displays the received recommendation results to the user.

[0248] Input: Recommendation results

[0249] Output: The recommendations are visually displayed to the user.

[0250] In this way, users can discover new music content based on their own interests.

[0251] Example 3

[0252] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0253] Conventional information provision systems have difficulty in providing users with appropriate information that interests them, and they have also been unable to effectively display advertisements based on the user's interests. This has resulted in a poor user experience, and advertisers have also been unable to deliver advertisements effectively.

[0254] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0255] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for placing advertisements in the generated information, and a means for selecting and displaying advertisements based on the user's interests. This allows the user to simultaneously obtain information and advertisements that match his or her interests.

[0256] "User" means an individual or organization that uses the system to input information and view generated information and advertisements.

[0257] "Information of interest" is information about which a user is interested and wants to know more.

[0258] An "input means" is an interface through which a user inputs information into the system, and includes input devices such as a keyboard or a touch screen.

[0259] "Artificial intelligence means" refers to algorithms or models that generate information that may be of interest to a User in the future, based on information input by a User.

[0260] "Generate" means to create new information based on input information.

[0261] The "means for outputting" refers to an interface for displaying the generated information to the user, and includes, for example, a display device such as a display or a web browser.

[0262] "Means for displaying advertisements" refers to a function for displaying advertisements related to the generated information.

[0263] "Means of selecting and displaying" refers to the function of selecting appropriate advertisements based on the user's interests and showing them to the user.

[0264] "Specialized Output Screen" means a screen specifically designed to display generated information and advertising.

[0265] This invention is a system in which a user inputs information that interests them and provides the user with information generated based on that information. Furthermore, by displaying advertisements related to the generated information, it is possible to provide advertisements that match the user's interests.

[0266] The server uses a generative AI model to generate information based on the user's input. The generative AI model uses an advanced natural language processing model such as GPT-4. The server receives the prompt sentence entered by the user and inputs it into the generative AI model. The generative AI model generates relevant information based on the prompt sentence and returns the information to the server.

[0267] The terminal receives the generated information sent from the server and displays it on a dedicated output screen. This output screen is constructed using web technologies such as HTML, CSS, and JavaScript (registered trademark). The terminal provides an interface for visually presenting the generated information to the user.

[0268] The user can access the dedicated output screen through the terminal and view the generated information. For example, if the user inputs the prompt sentence "Tell me about the latest technology trends," the server uses the generative AI model to generate related information and transmits the information to the terminal. The terminal displays the generated information on the dedicated output screen, and the user can view the information.

[0269] In addition, the server selects advertisements based on the user's interests and sends them to the device. The device displays the received advertisements on a dedicated output screen. For example, an advertisement about the latest gadgets might be displayed. This allows the user to simultaneously obtain information and advertisements that match their interests.

[0270] As a specific example, if a user enters the prompt sentence "Tell me about the latest technology trends," the server uses a generative AI model (GPT-4) to generate information such as "The notable technology trend in 2023 is the fusion of AI and IoT." This information is displayed on a dedicated output screen on the device. In addition, related ads for the latest AI devices are displayed.

[0271] Example prompt:

[0272] "Tell me about the latest technology trends."

[0273] "I want to know the latest information on the evolution of AI."

[0274] "What startups should we look out for in 2023?"

[0275] In this way, the user can simultaneously obtain information and advertisements that match his / her interests. The flow of the specification process in the third embodiment will be described with reference to FIG.

[0276] Step 1:

[0277] The user enters a prompt.

[0278] The user inputs a prompt sentence into an input field of the terminal. For example, the user inputs "Tell me about the latest technology trends." The input prompt sentence is temporarily stored in the memory of the terminal.

[0279] Step 2:

[0280] The terminal sends a prompt to the server.

[0281] The terminal sends the prompt text entered by the user to the server as an HTTP POST request. This request includes the prompt text. The terminal uses a network interface to send the prompt text to the server.

[0282] Step 3:

[0283] The server generates information using the generative AI model

[0284] The server inputs the received prompt sentence into a generative AI model (e.g., GPT-4) to generate relevant information. The generative AI model analyzes the prompt sentence and performs data processing and data calculation to generate relevant information. The generated information is stored in the server's memory.

[0285] Step 4:

[0286] The server sends the generated information to the terminal.

[0287] The server transmits the generated information to the terminal as an HTTP response. The response includes the generated information. The server uses a network interface to transmit the generated information to the terminal.

[0288] Step 5:

[0289] The terminal displays the generated information on a dedicated output screen.

[0290] The terminal displays the received information on a dedicated output screen. This output screen is constructed using HTML, CSS, and JavaScript (registered trademark). To visually display the generated information, the terminal dynamically generates HTML elements and adds them to the screen.

[0291] Step 6:

[0292] The server selects advertisements based on the user's interests and sends them to the device.

[0293] The server analyzes the user's prompt text and past browsing history to select highly relevant advertisements. The selected advertisements are sent to the terminal as an HTTP response. The server refers to a database to select advertisements and chooses appropriate advertisements.

[0294] Step 7:

[0295] The device displays the advertisement on a dedicated output screen

[0296] The device displays the received advertisements on a dedicated output screen. The device dynamically generates HTML elements and adds them to the screen to visually display the advertisements. For example, an advertisement banner is displayed on the latest AI devices.

[0297] Step 8:

[0298] View user generated information and advertisements

[0299] The user can view the generated information and advertisements through a dedicated output screen on the device, allowing the user to simultaneously obtain information and advertisements that match their interests.

[0300] (Application example 3)

[0301] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0302] Conventional information provision systems have difficulty in providing users with information that interests them appropriately, and lack the means to effectively display advertisements related to their interests. For these reasons, improving the user experience and maximizing the effectiveness of advertisements have become issues.

[0303] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0304] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, and a means for acquiring and displaying advertisements related to the generated information, thereby making it possible to effectively provide information and advertisements according to the user's interests.

[0305] "User" means an individual or organization that uses the system to input information and view generated information and advertisements.

[0306] "Information of interest" is information that users are interested in and want to know about.

[0307] "Means of input" refers to the interface or device that allows a user to input information of interest or concern into the system.

[0308] "Artificial intelligence means" refers to algorithms or models that generate information that may be of interest to a User in the future, based on information entered by the User.

[0309] "Generated Information" means information generated by artificial intelligence means that may be of future interest to a User.

[0310] "Output means" refers to an interface or device for displaying the generated information to the user.

[0311] "Means for acquiring and displaying advertisements" refers to an algorithm or system for acquiring advertisements related to the generated information and displaying them to users.

[0312] The following system configuration will be described as an embodiment of the present invention.

[0313] System Configuration

[0314] The system consists of a user terminal, a server, and an ad serving system. The user terminal is a device such as a smartphone or PC, and provides an interface for users to input information and view generated information and advertisements. The server uses a generative AI model to generate information that users may be interested in in the future, and is responsible for obtaining related advertisements from the ad serving system and sending them to the user terminal.

[0315] Hardware and software used

[0316] Hardware: Smartphones, PCs, servers

[0317] Software: Python, OpenAI API, Tkinter (GUI library)

[0318] Data processing and calculation

[0319] 1. User terminal: The user inputs information that interests them through the interface on the terminal. For example, they input a prompt such as, "Please tell me about the latest technology trends."

[0320] 2. Server: The server receives the prompt text sent by the user and sends it to the generative AI model (e.g. text-davinci-003) using the OpenAI API. The generative AI model generates information that the user may be interested in in the future based on the prompt text.

[0321] 3. Advertisement provision system: Based on the generated information, relevant advertisements are obtained. For example, if the generated information is about the "latest technology," advertisements for the latest smartphones are obtained.

[0322] 4. Server: The server sends the generated information and related advertisements to the user terminal.

[0323] 5. User terminal: The user terminal displays the received information and advertisements.

[0324] Examples

[0325] When a user inputs the prompt sentence "Tell me about the latest technology trends," the server uses a generative AI model to generate information about the latest technology. Based on the generated information, it retrieves advertisements for the latest smartphones from the advertisement serving system and sends them to the user's terminal. The user's terminal displays the generated information and advertisements.

[0326] Examples of prompt statements

[0327] "Tell me about the latest technology trends."

[0328] "What are the latest research findings on health?"

[0329] "What travel destinations would you recommend?"

[0330] In this way, it becomes possible to effectively provide information and advertisements that match the user's interests.

[0331] The flow of the specific process in the application example 3 will be described with reference to FIG.

[0332] Step 1:

[0333] The user inputs information that interests them through the interface on the terminal. For example, they input a prompt such as, "Tell me about the latest technology trends." The input prompt is sent from the terminal to the server.

[0334] Input: The prompt text entered by the user.

[0335] Output: The prompt sent to the server.

[0336] Step 2:

[0337] The server receives the prompt text sent by the user. Based on the received prompt text, the server sends the prompt text to a generative AI model (e.g., text-davinci-003) using the OpenAI API. The generative AI model generates information that the user may be interested in in the future based on the prompt text.

[0338] Input: The prompt text sent by the user

[0339] Output: The information generated by the generative AI model

[0340] Step 3:

[0341] The server receives the information generated from the generative AI model. Then, based on the generated information, the server sends a request to obtain an advertisement related to the generated information to the advertisement serving system. The advertisement serving system returns the advertisement related to the generated information to the server.

[0342] Input: Information generated by a generative AI model

[0343] Output: Relevant ads retrieved from the ad serving system

[0344] Step 4:

[0345] The server transmits the generated information and associated advertisements to the user terminal, and the user terminal displays the received information and advertisements.

[0346] Input: Generated information and related ads

[0347] Output: Information and advertisements displayed on the user's device

[0348] Step 5:

[0349] The user views the information and advertisements displayed on the device, allowing the user to simultaneously obtain information and advertisements that match their interests.

[0350] Input: Information and advertisements displayed on the user's device

[0351] Output: User consumes information and ads through browsing

[0352] Furthermore, an emotion engine that estimates the emotion of the user may be combined. That is, the identification processing unit 290 may estimate the emotion of the user using the emotion identification model 59, and perform identification processing using the emotion of the user.

[0353] "Example 1"

[0354] As one embodiment of the present invention, a system including an emotion engine that recognizes the emotions of a user is provided. This system includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, and a means for outputting the generated information to the user. Specifically, the user inputs a photo of "rock," which is the user's favorite music genre, and keywords related to that genre. "Example 2"

[0355] The emotion engine recognizes the user's emotional state and generates information that may be of future interest to the user based on that emotional state. For example, if the user is expressing an emotion of joy, the emotion engine generates information related to that emotion of joy. This can provide information on new music genres and artists that the user may find enjoyable.

[0356] "Example 3"

[0357] Further included is a means for placing an advertisement in the generated information. The emotion engine selects an advertisement based on the emotional state of the user and places the advertisement in the generated information. For example, if the user indicates an emotion of joy, the emotion engine selects an advertisement related to the emotion of joy. This makes it possible to provide advertisements for products or services that the user is likely to feel joyful about.

[0358] The process flow of each embodiment will be described below.

[0359] "Example 1"

[0360] Step 1: The user enters information about their interests into the system. For example, they enter a photo of their favorite music genre, "rock," along with keywords related to that genre.

[0361] Step 2: The system analyzes the input information and determines the user's current interests.

[0362] Step 3: The emotion engine recognizes the user's emotional state.

[0363] "Example 2"

[0364] Step 1: The emotion engine generates information that may be of future interest to the user based on their emotional state.

[0365] Step 2: For example, if the user indicates an emotion of happiness, the emotion engine generates information related to the emotion of happiness.

[0366] Step 3: This allows us to provide information about new music genres and artists that users may enjoy.

[0367] "Example 3"

[0368] Step 1: This also includes a means of placing advertisements on the generated information.

[0369] Step 2: The emotion engine selects advertisements based on the user's emotional state and places the advertisements in the generated information.

[0370] Step 3: For example, if the user is expressing an emotion of joy, the emotion engine will select ads related to that emotion of joy, allowing it to serve ads for products and services that the user is likely to find joyful.

[0371] Example 1

[0372] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0373] Conventional information provision systems have difficulty in providing information based on the user's interests and cannot predict information that the user may be interested in in the future. In addition, since information provision does not take into account the user's emotions, it is not possible to increase user satisfaction. This has led to a demand for improving the accuracy of information provision according to the user's interests and concerns.

[0374] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0375] In this invention, the server includes a means for inputting information that the user is interested in, a means for receiving the input information, a means for recognizing the user's emotions based on the input information, a means for using a generative AI model for generating information that the user may be interested in in the future based on the emotion recognition result and the input information, and a means for outputting the generated information to the user. This makes it possible to provide information that the user may be interested in in the future with high accuracy, taking into account the user's emotions.

[0376] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[0377] "Input means" refers to an interface that allows users to input information that interests them into the system. Specifically, this includes web browsers and mobile applications.

[0378] "Means for receiving" refers to a function by which the server receives information input by the user. This includes the process of receiving data via network communication.

[0379] "Emotion recognition means" refers to a function for analyzing and recognizing a user's emotions based on information input by the user. Specifically, this refers to emotion recognition software or algorithms.

[0380] A "generative AI model" is an artificial intelligence model that generates information that a user may be interested in in the future based on user input information and emotion recognition results. Specifically, this applies to natural language processing models and machine learning algorithms.

[0381] "Output means" refers to a function for providing the generated information to the user. This includes a process for displaying the information on the user's terminal.

[0382] The "advertising means" is a function for adding advertisements to the generated information and providing it to users, thereby generating profits for the system.

[0383] This invention is a system that inputs information that a user is interested in, generates information that the user may be interested in in the future based on that information, and provides the information to the user. A specific embodiment of this system will be described below.

[0384] First, the user accesses a dedicated input screen. This input screen is provided through a web browser or a mobile application. The user enters photos and text of their interests into the input screen. For example, if the user is interested in "rock" music, they enter a photo of a rock band and keywords such as "guitar" and "live."

[0385] Next, the server receives the information entered by the user. This information is sent to the server as photo data or text data. The server passes the received information to emotion recognition software (e.g., "EmotionAPI") to analyze the user's emotions. The emotion recognition software recognizes the user's emotional state (e.g., joy, excitement, interest, etc.) from the photo or text.

[0386] The server then uses a generative AI model (such as GPT-4) to generate information that the user may be interested in in the future. The generative AI model processes and calculates data based on the information entered by the user and the emotion recognition results. Specifically, it generates information on new rock bands and live events that the user may be interested in.

[0387] Finally, the server transmits the generated information to the user's terminal, where the user can check the information of new rock bands and live events.

[0388] As a concrete example, consider a case where a user is interested in "rock" music. The user enters a photo of "rock" and keywords such as "guitar" and "live" into the input screen. The server receives this information and stores the photo data and text data. The server then calls the Emotion API to analyze the user's emotions from the photo and text. For example, it recognizes from the photo that the user is excited. The server uses GPT-4 to generate information about new rock bands and live events that the user may be interested in. For example, it generates "new rock band album release information" and "details of live events taking place nearby." The server sends the generated information to the user's device, and the user checks the information in a web browser.

[0389] Example prompt:

[0390] "Generate information about rock bands and live events that may be of interest to the user in the future based on the information entered by the user. The input information is as follows: photo (live photo of rock band), keywords (guitar, live)."

[0391] In this way, users can easily access information based on their interests.

[0392] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0393] Step 1:

[0394] The user accesses the input screen.

[0395] Users access a dedicated input screen through a web browser or mobile application. The input screen provides an interface for users to input information about their interests.

[0396] Step 2:

[0397] The user enters information about their interests.

[0398] The user inputs photos and text of their interests into the input screen. For example, if the user is interested in "rock" music, they input photos of rock bands and keywords such as "guitar" and "live." The input data is sent to the server as photo data and text data.

[0399] Step 3:

[0400] The server receives the input information.

[0401] The server receives the photo data and text data entered by the user and stores the received data in a database within the server.

[0402] Step 4:

[0403] The server recognizes the user's emotion using the emotion recognition means.

[0404] The server passes the received photo and text data to emotion recognition software (e.g., "EmotionAPI") to analyze the user's emotions. The emotion recognition software recognizes the user's emotional state (e.g., joy, excitement, interest, etc.) from the photo and text. The input is photo data and text data, and the output is the emotion recognition result.

[0405] Step 5:

[0406] The server uses a generative AI model to generate information that may be of interest in the future.

[0407] The server generates new information using a generative AI model (e.g., GPT-4) based on the emotion recognition results and the information entered by the user. The generative AI model generates information about rock bands and live events that the user may be interested in in the future. The inputs are the emotion recognition results and the user's input information, and the output is the generated information.

[0408] Step 6:

[0409] The server outputs the generated information to the user.

[0410] The server sends the generated information to the user's terminal. The user can check the information of new rock bands and live events on his / her terminal. The input is the generated information, and the output is the information displayed on the user's terminal.

[0411] As a concrete example, consider a case where a user is interested in "rock" music. The user enters a photo of "rock" and keywords such as "guitar" and "live" into the input screen. The server receives this information and stores the photo data and text data. The server then calls the Emotion API to analyze the user's emotions from the photo and text. For example, it recognizes from the photo that the user is excited. The server uses GPT-4 to generate information about new rock bands and live events that the user may be interested in. For example, it generates "new rock band album release information" and "details of live events taking place nearby." The server sends the generated information to the user's device, and the user checks the information in a web browser.

[0412] (Application example 1)

[0413] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0414] Conventional content delivery services have been insufficient in providing information based on users' interests and concerns, and it has been difficult to provide personalized content that takes users' emotions into account. In addition, it is difficult to predict information that users may be interested in in the future, so there has been a demand for improving the user experience.

[0415] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0416] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, an emotion engine for recognizing the user's emotions, a means for generating a prompt sentence using a generative AI model based on the emotion information recognized by the emotion engine, and a means for generating related content based on the generated prompt sentence. This makes it possible to provide personalized content that takes the user's emotions into consideration, improving the user experience.

[0417] "Means for users to input information that interests them" refers to an interface that allows users to input information that interests them.

[0418] "AI Means" refers to the function of artificial intelligence that generates information that may be of future interest to the user based on input information.

[0419] The "means for outputting the generated information to the user" refers to an interface for providing the generated information to the user.

[0420] An "emotion engine" is a system for recognizing a user's emotions.

[0421] A "generative AI model" is an artificial intelligence model for generating prompt sentences based on user input information and emotional information.

[0422] The "means for generating a prompt sentence" is a function for generating a prompt sentence based on emotion information recognized by the emotion engine.

[0423] The "means for generating relevant content" is a function for generating content relevant to the user based on the generated prompt sentence.

[0424] A system for implementing this invention includes means for inputting information that a user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for outputting the generated information to the user, an emotion engine for recognizing the user's emotions, means for generating a prompt sentence using a generative AI model based on the emotion information recognized by the emotion engine, and means for generating related content based on the generated prompt sentence.

[0425] System Configuration

[0426] 1. How users can enter their interests:

[0427] A user uses a smartphone application to input information about their interests (e.g., music genres or movie titles). The input interface includes text boxes and an image upload function.

[0428] 2. Emotion Engine:

[0429] The emotion engine recognizes emotions from images and text uploaded by users. Specifically, it uses an image processing library (e.g., OpenCV) and an emotion recognition model (e.g., a deep learning model using Keras).

[0430] 3. Generative AI model:

[0431] The generative AI model generates prompts based on the user's input and emotional information. The generative AI model uses a natural language processing library (e.g., Transformers) and utilizes a pre-trained model (e.g., GPT-3).

[0432] 4. How to generate a prompt:

[0433] Based on the emotion information recognized by the emotion engine, a generative AI model is used to generate prompt sentences. For example, if a user is interested in "rock music" and emotion recognition detects the emotion of "joy," the following prompt sentence is generated:

[0434] Your users are interested in rock music and the emotion is joy, so generate relevant content.

[0435] 5. How to generate relevant content:

[0436] Based on the generated prompt sentences, relevant content (e.g., music playlists, movie recommendations, articles, etc.) is generated. The generated content is displayed in the user's smartphone application.

[0437] Examples

[0438] A user opens the smartphone application, uploads a photo of "rock music" that interests them, and inputs related keywords (e.g., "rock, music, concert"). The emotion engine recognizes the emotion of "joy" from the photo, and the generative AI model generates the following prompt sentence:

[0439] Your users are interested in rock music and the emotion is joy, so generate relevant content.

[0440] Based on this prompt, the generative AI model generates rock music-related articles, playlists, concert information, and other information that are appropriate for the user, and displays them on the smartphone application.

[0441] In this way, it becomes possible to provide personalized content that takes into account the user's emotions, improving the user experience.

[0442] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0443] Step 1:

[0444] A user opens a smartphone application and inputs information about their interests. For example, the user uploads a photo of "rock music" and inputs related keywords (e.g. "rock, music, concert"). The input information is sent to the server.

[0445] Step 2:

[0446] The server receives the photo sent by the user and reads the image using an image processing library (e.g. OpenCV). The image is resized to 48x48 pixels and input to an emotion recognition model (e.g. a deep learning model using Keras). The emotion recognition model predicts the user's emotion from the image and outputs an emotion label.

[0447] Step 3:

[0448] The server generates a prompt sentence using a generative AI model (e.g., GPT-3) based on the keywords sent by the user and the emotion labels obtained in step 2. The generative AI model generates a prompt sentence using a natural language processing library (e.g., Transformers) and outputs the prompt sentence as follows:

[0449] Your users are interested in rock music and the emotion is joy, so generate relevant content.

[0450] Step 4:

[0451] The server generates relevant content based on the generated prompt sentence. The generative AI model takes the prompt sentence as input and generates content appropriate for the user (e.g., music playlists, movie recommendations, articles, etc.). The generated content is sent from the server to the user's smartphone application.

[0452] Step 5:

[0453] The user's smartphone application receives the content sent from the server and displays it to the user. The user can browse the displayed content and obtain information based on their interests.

[0454] In this way, it becomes possible to provide personalized content that takes into account the user's emotions, improving the user experience.

[0455] Example 2

[0456] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0457] Conventional information provision systems can provide information based on the user's interests and concerns, but they have the problem that they cannot provide information that takes into account the user's emotional state. This makes it difficult to provide appropriate information according to the user's emotions, and there is a problem that the user experience cannot be sufficiently improved.

[0458] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0459] In this invention, the server includes a means for inputting information that the user is interested in, a generative AI model for generating information that the user may be interested in in the future based on the input information, an emotion engine for recognizing the emotional state of the user and generating information that the user may be interested in in the future based on the emotional state, and a means for outputting the generated information to the user. This makes it possible to provide information that takes into account not only the user's interests but also their emotional state.

[0460] "User" means any individual or entity that utilizes the System to enter information and receive provided information.

[0461] "Information of interest" is information in which a user is interested in a particular field or topic.

[0462] "Means of input" refers to the interface or device that allows a user to input information of interest or concern into the system.

[0463] A "generative AI model" is an artificial intelligence algorithm or program that analyzes information input by a user and generates new information based on that information.

[0464] An "emotion engine" is the part of the system that recognizes a user's emotional state and generates information that may be of future interest to the user based on that emotional state.

[0465] An "emotional state" is an emotional state, such as happiness, sadness, anger, etc., expressed by a user.

[0466] "Output means" refers to an interface or device for providing the generated information to a user.

[0467] "Generating information" means creating new relevant information based on information input by the user and their emotional state.

[0468] A "means for displaying advertisements" is an interface or device for adding advertisements to the generated information and providing it to users.

[0469] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0470] This invention is a system that inputs information that a user is interested in, and generates information that the user may be interested in in the future based on that information. The system uses a generative AI model and an emotion engine to analyze the user's input information and emotional state, and provides appropriate information.

[0471] Hardware and Software Used

[0472] Hardware: Servers, terminals (user devices)

[0473] Software: Generative AI models, emotion engines

[0474] Specific operation of the system

[0475] 1. User enters information:

[0476] The user uses the terminal to input information of interest (for example, the music genre "rock"). Specifically, the user inputs "rock" into the input form of the terminal and presses the send button.

[0477] 2. The server receives the information:

[0478] The server receives the information sent by the user. Specifically, it receives the "lock" data through an HTTP request.

[0479] 3. The server passes the information to the generative AI model:

[0480] The server passes the received information to the generative AI model. Specifically, it sends data called "lock" to the API of the generative AI model.

[0481] 4. Generative AI models analyze the information:

[0482] The generative AI model analyzes the information entered by the user and generates new information based on that information. Specifically, it generates information on new rock bands and artists related to the genre "rock."

[0483] 5. The server passes the information to the emotion engine:

[0484] The server passes the user's input information and the information obtained from the generative AI model to the emotion engine. Specifically, it sends this data to the emotion engine's API.

[0485] 6. Emotion engine recognizes the user's emotional state:

[0486] The emotion engine analyzes the user's input and past behavioral data to recognize the user's emotional state. Specifically, it recognizes the emotion of "joy" from the user's past music playback history and input content.

[0487] 7. Emotion engine generates emotion-based information:

[0488] The emotion engine generates information that may be of future interest to the user based on the user's emotional state. For example, if the user is showing the emotion of "joy," it generates information on new music genres and artists related to that emotion.

[0489] 8. The server consolidates the generated information:

[0490] The server combines the information from the generative AI model and the emotion engine into a single dataset.

[0491] 9. The server provides the aggregated information to the user:

[0492] The server provides the aggregated information to the user, specifically by sending information about new rock bands and artists to the user's device via HTTP responses.

[0493] Examples of concrete examples and prompts

[0494] Examples:

[0495] If a user inputs that they are interested in the music genre "rock," the generative AI model will generate information about new rock bands and artists. At the same time, if the emotion engine recognizes the user's emotional state as "joy," it will also generate information about new music genres and artists related to joy.

[0496] Example prompt:

[0497] "Generate information about new rock bands and artists that the user may be interested in. Also, if the user is expressing the emotion of joy, provide information related to that emotion."

[0498] In this way, the system provides users with information that may be of interest to them in the future based on their interests and emotional state.

[0499] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0500] Step 1:

[0501] The user enters information

[0502] A user uses a terminal to input information of interest (for example, the music genre "rock"). Specifically, the user inputs "rock" into an input form on the terminal and presses the send button. The input information is sent to the server as an HTTP request.

[0503] Step 2:

[0504] The server receives the information

[0505] The server receives information sent by the user. Specifically, it receives data called "locks" through HTTP requests. The received data is temporarily stored to be passed to the generative AI model and emotion engine.

[0506] Step 3:

[0507] The server passes information to the generative AI model

[0508] The server passes the received information to the generative AI model. Specifically, it sends a piece of data called a "lock" to the API of the generative AI model. Based on the input data, the generative AI model starts analyzing it to generate new related information.

[0509] Step 4:

[0510] Generative AI models analyze information

[0511] The generative AI model analyzes the information entered by the user and generates new information based on that information. Specifically, it generates information on new rock bands and artists related to the genre "rock." The generated information is returned to the server.

[0512] Step 5:

[0513] The server passes the information to the emotion engine.

[0514] The server passes the user's input information and the information obtained from the generative AI model to the emotion engine. Specifically, it sends these data to the emotion engine's API. The emotion engine starts analyzing to recognize the user's emotional state.

[0515] Step 6:

[0516] Emotion engine recognizes the user's emotional state

[0517] The emotion engine analyzes the user's input and past behavior data to recognize the user's emotional state. Specifically, it recognizes the emotion of "joy" from the user's past music playback history and input content. The recognized emotional state is returned to the server.

[0518] Step 7:

[0519] Emotion engine generates emotion-based information

[0520] The emotion engine generates information that may be of future interest to the user based on the user's emotional state. For example, if the user is showing the emotion of "joy," it generates information on new music genres and artists related to that emotion. The generated information is returned to the server.

[0521] Step 8:

[0522] The server consolidates the generated information

[0523] The server combines the information from the generative AI model and the emotion engine into a single dataset, which is then prepared for presentation to the user.

[0524] Step 9:

[0525] The server provides the consolidated information to the user.

[0526] The server provides the integrated information to the user. Specifically, it transmits information about new rock bands and artists to the user's terminal through an HTTP response. The user can receive the provided information through the terminal.

[0527] (Application example 2)

[0528] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0529] Conventional information recommendation systems can provide information based on a user's interests, but they do not recommend information that takes into account the user's emotional state. As a result, it is not possible to provide personalized information according to the user's emotions, and improving the user experience has been a challenge.

[0530] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0531] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for recognizing the user's emotional state, an emotion engine for generating information that the user may be interested in in the future based on the emotional state, and a means for outputting the generated information to the user. This makes it possible to provide personalized information according to the user's emotional state.

[0532] "Means for users to input information that interests them" refers to an interface that enables users to input information that interests them into the system.

[0533] "AI means for generating information that the user may be interested in in the future based on the input information" refers to an artificial intelligence function that analyzes the information input by the user and generates new information that the user may be interested in in the future based on that information.

[0534] "Means for recognizing the user's emotional state" refers to technology for analyzing the user's facial expressions, voice, and other biometric signals to recognize the user's current emotional state.

[0535] The "emotion engine that generates information that may be of future interest to the user based on the user's emotional state" is an engine that takes into account the user's emotional state and generates information related to that emotion.

[0536] The "means for outputting the generated information to the user" refers to an interface for providing the generated information to the user visually or audibly.

[0537] The following system configuration will be described as an embodiment of the present invention.

[0538] System Configuration

[0539] This system includes means for inputting information that the user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for recognizing the user's emotional state, an emotion engine for generating information that the user may be interested in in the future based on the emotional state, and means for outputting the generated information to the user.

[0540] Hardware and Software

[0541] Hardware: Smartphones, smart glasses, head-mounted displays

[0542] Software: EmotionRecognizer (emotion recognition engine), MusicRecommender (music recommendation engine)

[0543] Processing flow

[0544] 1. User information input: The user uses a smartphone or smart glasses to input information about their interests. For example, the user may input that they are interested in "rock music."

[0545] 2. Emotion Recognition: Use EmotionRecognizer to recognize the user's emotional state in real time, for example, by analyzing the user's facial expressions through the camera to detect the emotion of happiness.

[0546] 3. Information Generation: Based on the information entered by the user and the recognized emotional state, the AI ​​means and the emotion engine work together to generate information that may be of future interest. For example, if the user is interested in "rock music" and shows an emotion of joy, new songs by upbeat rock bands will be recommended.

[0547] 4. Information output: The generated information is provided to the user visually or audibly through a smartphone or smart glasses. For example, a new song from a recommended rock band is displayed on the smartphone screen.

[0548] Examples

[0549] User Sentiment: Delight

[0550] Recommended music: New songs from upbeat rock bands

[0551] Examples of prompt statements

[0552] Develop an application that recognizes a user's emotional state and recommends music that they may be interested in in the future based on that emotion. For example, if a user is expressing an emotion of joy, recommend upbeat music and songs with positive lyrics.

[0553] In this way, it is possible to provide personalized information according to the user's emotional state.

[0554] The flow of the identification process in the application example 2 will be described with reference to FIG.

[0555] Step 1:

[0556] The user enters information about their interests.

[0557] A user uses a smartphone or smart glasses to input information about his or her interests. For example, the user may input that he or she is interested in "rock music." This input information is stored in the system's database.

[0558] Step 2:

[0559] The terminal recognizes the user's emotional state.

[0560] EmotionRecognizer is used to recognize the user's emotional state in real time. For example, it analyzes the user's facial expressions through the camera to detect the emotion of joy. This emotional data is sent to the system.

[0561] Step 3:

[0562] The server analyzes the input information and emotion data.

[0563] The server analyzes the information entered by the user and the perceived emotional state. For example, if the user is interested in "rock music" and expresses an emotion of joy, the server predicts the user's future interests and concerns based on this data.

[0564] Step 4:

[0565] The server generates information that may be of interest to you in the future.

[0566] The AI ​​tools and emotion engine work together to generate new information based on the user's input and emotion data, for example recommending new songs from an upbeat rock band. This generated information is stored in the system's database.

[0567] Step 5:

[0568] The terminal outputs the generated information to the user.

[0569] The generated information is provided to the user visually or audibly through a smartphone or smart glasses. For example, a new song from a recommended rock band is displayed on the smartphone screen. The user reviews the information and decides whether it is of interest to them.

[0570] Example 3

[0571] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0572] Conventional information provision systems can provide information based on the user's interests, but have the problem of difficulty in effectively displaying advertisements according to the user's emotional state. In addition, there was a lack of a way to maximize the effectiveness of advertisements by simultaneously providing information that the user is interested in and related advertisements.

[0573] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0574] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for analyzing the emotional state of the user, and a means for selecting an advertisement based on the emotional state and placing the advertisement in the generated information. This makes it possible to provide information based on the user's interests and to effectively display advertisements according to the user's emotional state.

[0575] "User" means an individual or organization that uses the system to input information and view generated information and advertisements.

[0576] "Interesting Information" is information about a particular subject or topic about which a User has expressed an interest and would like to know more.

[0577] An "input means" is an interface through which a user provides information to the system, and includes input devices such as a keyboard, mouse, and touch screen.

[0578] "Artificial intelligence means" refers to algorithms or models that generate information that may be of interest to a User in the future, based on information input by a User.

[0579] "Generated Information" means information generated by artificial intelligence means that may be of future interest to a User.

[0580] "Output means" refers to an interface for providing the generated information to a user, and includes a web browser, a mobile application, a display, etc.

[0581] "Means for analyzing emotional state" refers to algorithms or models used to infer a user's current emotional state based on user behavioral data and feedback.

[0582] "Ad selection method" refers to algorithms or models used to select appropriate ads based on a user's emotional state.

[0583] "Means for displaying advertisements" refers to an interface for displaying selected advertisements along with generated information to a user, and includes a web page, an application screen, a display, and the like.

[0584] This invention is a system that inputs information that a user is interested in, generates information that the user may be interested in in the future based on that information, and displays advertisements according to the user's emotional state. A specific embodiment of this system will be described below.

[0585] Hardware and Software Used

[0586] Hardware: Servers, user devices (PCs, smartphones, etc.)

[0587] Software: Generative AI models (e.g., GPT-4), emotion engines, web browsers

[0588] System Configuration

[0589] 1. A user uses a device to input a prompt for the generative AI model. For example, the user might input, "Please generate a review article for the latest smartphone."

[0590] 2. The server uses a generative AI model (e.g., GPT-4) to generate information based on the prompt entered by the user. The generative AI model uses natural language processing techniques to generate appropriate text for the prompt.

[0591] 3. The server displays the generated information on a dedicated output screen that runs on a web browser and makes it accessible to the user, e.g., a generated review article is displayed as a web page.

[0592] 4. The server uses the emotion engine to analyze the user's emotional state. The emotion engine infers the user's emotional state based on the user's past behavior data and real-time feedback, such as the click and scroll speed while the user is reading the review article.

[0593] 5. The server selects an appropriate advertisement based on the user's emotional state. For example, if the user is determined to be in an "excited" emotional state, the server selects an advertisement related to that excitement (e.g., a discount offer for a new smartphone) and places it next to the generated information.

[0594] 6. The user uses the device to view the generated information and the displayed advertisements. The user can simultaneously view information and advertisements that match his / her interests. For example, the user can click on an advertisement that catches his / her interest while reading a review article.

[0595] Examples

[0596] For example, a user inputs a prompt sentence such as "Generate a review article for the latest smartphone." The server uses a generative AI model to generate a detailed review article. The generated review article is displayed as a web page. The server uses an emotion engine to analyze the user's behavior while reading the article and determines that the user is "excited." The server selects an advertisement for a discount campaign for a new smartphone and places it next to the review article. While reading the review article, the user can click on an advertisement that interests them to find out more details.

[0597] In this way, the system can effectively provide the user with advertisements related to the generated information. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0598] Step 1:

[0599] The user uses the terminal to enter a prompt for the generative AI model.

[0600] Input: A prompt that the user enters (e.g. "Generate a review article of the latest smartphone")

[0601] Output: The prompt is sent to the server.

[0602] Specific behavior: The user enters a prompt using a keyboard or touch screen and clicks the submit button.

[0603] Step 2:

[0604] The server uses a generative AI model (e.g., GPT-4) to generate information based on prompts entered by the user.

[0605] Input: prompt statement

[0606] Data processing / computation: A generative AI model analyzes the prompt and performs natural language processing to generate relevant information.

[0607] Output: Generated information (e.g. smartphone review article)

[0608] How it works: The server passes the prompt to the generative AI model, which then runs a text generation algorithm to generate a review article.

[0609] Step 3:

[0610] The server displays the generated information on a dedicated output screen.

[0611] Input: Generated information

[0612] Data processing / calculation: Formatting the generated information into a web page using HTML and CSS

[0613] Output: The generated information displayed in a web browser.

[0614] Specific operation: The server constructs the generated information as a web page and sends it to the user's device.

[0615] Step 4:

[0616] The server uses an emotion engine to analyze the user's emotional state.

[0617] Input: User behavior data (e.g. clicks, scroll speed)

[0618] Data processing / computation: The emotion engine analyzes the behavioral data and runs algorithms to infer the user's emotional state.

[0619] Output: The user's emotional state (e.g., excited, happy)

[0620] Specific operation: The server collects user behavior data and passes it to the emotion engine for analysis.

[0621] Step 5:

[0622] The server selects an appropriate advertisement based on the user's emotional state.

[0623] Input: The user's emotional state

[0624] Data processing / computation: Searching a database for ads relevant to an emotional state and running algorithms to select the best ads

[0625] Output: The selected ads.

[0626] What it does: The server queries the ad database based on the emotional state and selects the most suitable ad.

[0627] Step 6:

[0628] The server places the selected advertisement next to the generated information.

[0629] Input: Generated information, selected ad

[0630] Data processing / calculation: Integrating the generated information with advertising and formatting it into a web page

[0631] Output: A web page with ads

[0632] Specific operations: The server combines the generated information with advertisements and sends them to the user's device.

[0633] Step 7:

[0634] The user uses the device to view the generated information and the displayed advertisements.

[0635] Input: The web page where the ad was placed

[0636] Output: User browsing behavior (e.g. clicks, scrolls)

[0637] What happens: A user uses a web browser to view the generated information and advertisements and clicks on an advertisement that interests them.

[0638] (Application example 3)

[0639] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0640] Conventional ad display systems could display ads based on the user's interests, but could not display ads according to the user's emotional state. As a result, they could not provide ads that matched the user's emotions, limiting the effectiveness of the ads. Furthermore, displaying ads that did not take the user's emotional state into account could be an unpleasant experience for the user. To solve these problems, a system that recognizes the user's emotional state and selects and displays ads based on that is needed.

[0641] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0642] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for recognizing the emotional state of the user, a means for selecting an advertisement based on the recognized emotional state, and a means for displaying the selected advertisement together with the generated information. This makes it possible to provide advertisements according to the emotional state of the user, maximize the effectiveness of the advertisements, and provide a more personalized experience for the user.

[0643] "Means for users to input information of their interests" refers to an interface that allows users to provide the system with information related to their interests.

[0644] "AI means for generating information that the user may be interested in in the future based on the input information" refers to artificial intelligence technology that analyzes information input by the user and generates information that the user may be interested in in the future.

[0645] "Means for outputting the generated information to the user" refers to an interface for displaying to the user the information generated by the AI ​​means.

[0646] "Means for recognizing a user's emotional state" refers to technology for analyzing and recognizing a user's emotional state from their input and actions.

[0647] The "means for selecting an advertisement based on a recognized emotional state" is an algorithm for selecting an optimal advertisement depending on the emotional state of the user.

[0648] "Means for displaying the selected advertisement together with the generated information" means an interface for displaying the selected advertisement to a user together with the information generated by the AI ​​means.

[0649] A system for implementing this invention includes means for inputting information that a user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for outputting the generated information to the user, means for recognizing the user's emotional state, means for selecting an advertisement based on the recognized emotional state, and means for displaying the selected advertisement together with the generated information.

[0650] System Configuration

[0651] 1. A means for users to input information about their interests

[0652] A user uses a device such as a smartphone or computer to input information related to their interests. For example, the user might input, "I'm very happy today!"

[0653] 2. AI means for generating information that may be of interest to the user in the future based on the input information

[0654] The server analyzes the information entered by the user and uses a generative AI model (e.g., GPT-3) to generate information that the user may be interested in in the future. For example, in response to the input "I'm so happy today!", the server generates content such as "5 ways to make you feel even happier."

[0655] 3. A means of outputting the generated information to the user

[0656] The generated information is displayed on the user's terminal, and the user can view the generated content.

[0657] 4. How to Recognize the User's Emotional State

[0658] The server analyzes and recognizes the user's emotional state from their input and actions. For example, if a user enters "I'm so happy today!", it recognizes the emotion of "joy."

[0659] 5. Means of selecting ads based on perceived emotional state

[0660] The server selects the most appropriate advertisements based on the recognized emotional state, for example, selecting travel and entertainment related advertisements for the emotion "joy."

[0661] 6. Means for displaying selected advertisements together with generated information

[0662] The selected advertisement is displayed on the user's device along with the generated information, allowing the user to view the advertisement that matches their emotional state along with the generated content.

[0663] Examples

[0664] If the user types "I'm very happy today!", the following happens:

[0665] User type: "I'm so happy today!"

[0666] Prompt for generative AI model: “What are 5 ways to feel happier?”

[0667] Generated content: "5 ways to feel happier"

[0668] Perceived emotional state: Joy

[0669] Selected ads: Travel packages and concert tickets

[0670] What you see: Generated content and selected ads

[0671] In this way, personalized advertisements can be served according to the user's emotional state.

[0672] The flow of the specific process in the application example 3 will be described with reference to FIG.

[0673] Step 1:

[0674] Enter information about the user's interests

[0675] The user uses the device to input information related to his or her interests. For example, the user inputs "I'm very happy today!" This input information is sent to the server.

[0676] Input: Information related to the user's interests (e.g. "I'm so happy today!")

[0677] Output: User input sent to the server

[0678] Step 2:

[0679] Recognize the user's emotional state

[0680] The server analyzes the user's input information and uses emotion recognition algorithms to recognize the user's emotional state. For example, for the input "I'm very happy today!", the server recognizes the emotion "joy."

[0681] Input: User input (e.g. "I'm so happy today!")

[0682] Output: The perceived emotional state (e.g. "joy")

[0683] Step 3:

[0684] Generate information that may be of future interest to the user based on the input information

[0685] The server uses a generative AI model (e.g. GPT-3) to generate information that the user may be interested in in the future based on the user's input information. For example, in response to the input "I'm very happy today!", the server generates content such as "5 ways to make you feel even happier."

[0686] Input: User input (e.g. "I'm so happy today!")

[0687] Output: The generated information (e.g., "5 ways to feel happier")

[0688] Step 4:

[0689] Selecting ads based on perceived emotional state

[0690] The server selects the most appropriate advertisements based on the recognized emotional state, for example, selecting travel and entertainment related advertisements for the emotion "joy."

[0691] Input: A perceived emotional state (e.g., "joy")

[0692] Output: Selected advertisements (e.g. travel packages or concert tickets)

[0693] Step 5:

[0694] Output the generated information and selected advertisement to the user

[0695] The server displays the generated information and the selected advertisement on the user's terminal, allowing the user to view the advertisement that matches the user's emotional state along with the generated content.

[0696] Input: Generated information (e.g., "5 ways to feel happier"), selected ads (e.g., travel packages or concert tickets)

[0697] Output: Generated information and advertisements displayed on the user's device

[0698] In this way, personalized advertisements can be served according to the user's emotional state.

[0699] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0700] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0701] Another example of generative AI is Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0702] In the above embodiment, an example was given in which the specific process was performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0703] [Second embodiment]

[0704] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0705] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0706] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0707] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0708] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[0709] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0710] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0711] Fig. 4 shows an example of main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0712] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0713] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0714] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0715] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0716] "Example 1"

[0717] The system of the present invention provides a dedicated input screen as a means for inputting information that the user is interested in. On this input screen, the user can input multiple photos and text that he or she likes. For example, if the user is interested in a particular genre such as music, movies, or travel, the user can input photos and text related to that genre.

[0718] "Example 2"

[0719] Next, an AI means is provided that generates information that the user may be interested in in the future based on the input information. This AI means analyzes the information input by the user and generates new information based on that information. For example, if the user inputs the music genre "rock," the AI ​​can use that information to generate information on new rock bands and artists that the user does not yet know.

[0720] "Example 3"

[0721] A dedicated output screen is provided as a means of outputting the generated information to users. On this output screen, the information generated by AI is displayed, and users can view that information. A means is also provided for placing advertisements on the generated information. This allows advertisers to place advertisements related to information that may be of interest to users, and users can view advertisements that match their own interests and concerns.

[0722] The process flow of each embodiment will be described below.

[0723] "Example 1"

[0724] Step 1: The user opens a dedicated input screen, where the user can enter information about their interests using photos and text.

[0725] Step 2: The user enters a photo of their favorite music genre, "rock," along with keywords related to that genre.

[0726] Step 3: The information entered will be stored in the system and used in the next step.

[0727] "Example 2"

[0728] Step 1: The system’s AI means analyzes the information entered by the user.

[0729] Step 2: Based on photos and keywords in the "rock" genre, the AI ​​generates information about new rock bands and artists that the user does not yet know.

[0730] Step 3: The generated information is stored in the system and will be used in the next step.

[0731] "Example 3"

[0732] Step 1: The system provides the user with a dedicated output screen, where the AI-generated information is displayed.

[0733] Step 2: The user opens the output screen and views the information about the new rock band or artist generated by the AI.

[0734] Step 3: At the same time, advertisements provided by advertisers are displayed to the user, which are related to the information that may be of interest to the user.

[0735] Example 1

[0736] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0737] Conventional information provision systems have had difficulty efficiently generating and providing information based on users' interests. It has also been difficult to properly analyze information entered by users and predict what information they may be interested in in the future. Furthermore, there has been a lack of effective means of placing advertisements on the generated information.

[0738] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes a means for inputting information that the user is interested in, a means for saving the input information in a database, a means for analyzing the saved information and generating a prompt sentence, a means for sending the generated prompt sentence to the generation AI model, and a means for receiving a response from the generation AI model and outputting it to the user. This makes it possible to efficiently generate and provide information based on the user's interests. It is also possible to predict and provide information that the user may be interested in in the future. Furthermore, it is also possible to effectively place advertisements in the generated information.

[0739] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[0740] "Information of interest" is data such as photographs and text related to a particular genre or theme in which the user is interested.

[0741] "Means of input" refers to an interface for users to input information of their interest into the system, and specifically includes text boxes and file upload functions.

[0742] A "database" is a system for storing information entered by a user, enabling the management and retrieval of information.

[0743] "Means of analysis" refers to the process of analyzing the information stored in the database and generating prompt sentences based on the user's interests and concerns.

[0744] A "prompt sentence" is a sentence input into a generative AI model, and is an instruction sentence to generate information based on the user's interests and concerns.

[0745] A "generative AI model" is an artificial intelligence model that generates information based on a prompt sentence, for example using natural language processing technology.

[0746] "Means for sending" refers to a communication means for sending the generated prompt sentence to the generative AI model.

[0747] A “means for receiving a response” is a process for receiving generated information from a generative AI model.

[0748] "Means for output" refers to an interface for displaying information received from the generative AI model to the user.

[0749] "Means for displaying advertisements" refers to the process for adding advertisements to the generated information and displaying them to the user.

[0750] This invention is a system that inputs information that a user is interested in and provides related information using a generative AI model based on that information. A specific embodiment of this system will be described below.

[0751] First, the user accesses the system's input screen using a web browser. This input screen is built using HTML, CSS, and JavaScript (registered trademark), and includes text boxes and a file upload function for users to enter information about their interests.

[0752] When a user enters information such as "rock music," "guitar," and "live concert" into the input screen, the server receives the information and stores it in a MySQL database. The server uses a PHP script to process the data submitted by the user and store it in the database.

[0753] Next, the server analyzes the information stored in the database and generates a prompt based on the user's interests. For example, if the user enters information such as "rock music," "guitar," and "live concerts," the server generates a prompt that reads, "The user is interested in rock music. Please provide the latest news and event information related to rock music."

[0754] The generated prompt sentence is sent by the server to a generative AI model (e.g., a model using natural language processing technology). The server uses an API to send the prompt sentence to the generative AI model. The generative AI model generates information related to the user's interests and concerns based on the received prompt sentence. For example, it generates information such as "Latest rock music news: A famous rock band has released a new album. The next live concert will be held next month."

[0755] The server displays the information received from the generative AI model to the user. Specifically, the server uses HTML templates to display the generated information in the user's browser, allowing the user to obtain the latest information based on their own interests.

[0756] The system further includes a means for placing advertisements in the generated information. The server adds advertisements related to the generated information and displays them to the user, thereby earning advertising revenue.

[0757] Examples of prompts include:

[0758] "Your users are interested in movies. Give them the latest movie-related news and reviews."

[0759] In this way, this invention makes it possible to efficiently generate and provide information based on the user's interests. It also makes it possible to predict and provide information that the user may be interested in in the future. Furthermore, it also makes it possible to effectively place advertisements in the generated information.

[0760] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0761] Step 1:

[0762] The user accesses the input screen.

[0763] The user accesses the system's input screen using a web browser. This input screen is built using HTML, CSS, and JavaScript (registered trademark), and includes text boxes and file upload functions for the user to enter information of their interest. By accessing the input screen, the user is ready to enter information.

[0764] Step 2:

[0765] The user enters information about their interests.

[0766] The user inputs information about his / her interests (e.g., music, movies, travel, etc.) using the text boxes and file upload function displayed on the input screen. The user can input multiple photos and text. The input information is sent to the server as data reflecting the user's interests.

[0767] Step 3:

[0768] The server receives the entered information and stores it in a database.

[0769] The server receives the information entered by the user and stores it in a MySQL database. Specifically, the server uses a PHP script to process the data submitted by the user and store it in the database. The input data is stored in the database as information indicating the user's interests.

[0770] Step 4:

[0771] The server parses the stored information and generates a prompt.

[0772] The server analyzes the information stored in the database and generates a prompt based on the user's interests. For example, if the user inputs information such as "rock music," "guitar," and "live concerts," the server generates a prompt that reads, "The user is interested in rock music. Please provide the latest news and event information related to rock music." Analysis and generation of the prompt are performed based on the user's input data.

[0773] Step 5:

[0774] The server sends the generated prompt to the generative AI model.

[0775] The server sends the generated prompt text to the generative AI model. The server uses an API to send the prompt text to the generative AI model. The prompt text serves as an instruction text for the generative AI model to generate information related to the user's interests and concerns.

[0776] Step 6:

[0777] A generative AI model generates information based on the prompt.

[0778] The generative AI model generates information related to the user's interests based on the received prompt sentence. For example, it generates information such as "Latest rock music news: A famous rock band has released a new album. The next live concert will be held next month." The generative AI model takes the prompt sentence as input and outputs related information.

[0779] Step 7:

[0780] The server receives the generated information and displays it to the user.

[0781] The server displays the information received from the generative AI model to the user. Specifically, the server uses an HTML template to display the generated information in the user's browser. This allows the user to obtain the latest information based on their own interests. The generated information is output to the user's browser.

[0782] Step 8:

[0783] The server places advertisements in the generated information.

[0784] The server adds advertisements related to the generated information and displays them to the user. By displaying the advertisements together with the generated information, advertising revenues related to the user's interests can be earned. Advertisements are displayed based on the generated information.

[0785] (Application example 1)

[0786] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0787] Conventional content recommendation systems have had difficulty effectively providing personalized content based on the user's interests. In addition, they lacked the means to generate prompts based on the information entered by the user and to recommend appropriate content using those prompts, which made it difficult to increase user satisfaction.

[0788] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0789] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for generating a prompt sentence based on the information input by the user, and a means for recommending content using the generated prompt sentence, thereby enabling personalized content recommendation based on the user's interests.

[0790] "User" means an individual or organization that uses the System.

[0791] "Information of interest" is information related to a particular genre or theme in which a user has an interest.

[0792] The "means of input" refers to an interface that allows a user to provide information of interest or concern to the system.

[0793] "Artificial intelligence means" means algorithms or models that analyze information entered by a User and generate information that may be of interest to the User in the future.

[0794] The "means for outputting" is an interface for providing the generated information to the user.

[0795] A "prompt sentence" is an instruction sentence for recommending content that is generated based on information entered by the user.

[0796] A "content recommendation means" is an algorithm or system that uses generated prompts to select and provide content appropriate to the user.

[0797] A system for implementing this invention includes a means for inputting information that a user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for generating a prompt sentence based on the information input by the user, and a means for recommending content using the generated prompt sentence.

[0798] Explanation of system program processing

[0799] Hardware and Software

[0800] Hardware: Smartphones, servers

[0801] Software: Python, OpenAI API

[0802] Data processing and calculation

[0803] 1. Obtaining user input: The user uses his / her smartphone to input information about his / her interests (e.g., travel, beach photos, adventure movies, etc.) The input information is sent to the server.

[0804] 2. Prompt generation: The server generates a prompt based on the information entered by the user. For example, if the user enters "travel", "beach pictures", and "adventure movies", the generated prompt will look like this:

[0805] Recommend content based on your users' interests.

[0806] trip

[0807] Beach Photos

[0808] Adventure movies

[0809] 3. Content recommendation: The server sends the generated prompt to the OpenAI API to recommend appropriate content. OpenAI's generative AI model generates content such as movies, music, and articles that are suitable for the user based on the prompt.

[0810] 4. Output of recommended content: The server sends the generated content to the smartphone and displays it to the user. For example, if the user inputs "travel", "beach photos", and "adventure movies", the recommended content will be as follows:

[0811] Movie: "Into the Wild"

[0812] Music: "The Beach Boys Album"

[0813] Article: "The 10 most beautiful beaches in the world"

[0814] In this way, personalized content recommendations based on the user's interests are possible.

[0815] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0816] Step 1:

[0817] Enter information about the user's interests.

[0818] A user uses a smartphone to input information about his / her interests (e.g., travel, beach photos, adventure movies, etc.) The input information is sent from the smartphone to the server.

[0819] Input: Information entered by the user (e.g. travel, beach photos, adventure movies)

[0820] Output: User input sent to the server

[0821] Step 2:

[0822] The server receives the user's input and generates a prompt.

[0823] The server generates a prompt based on the information the user enters. For example, if the user enters "travel," "beach pictures," and "adventure movies," the generated prompt might look like this:

[0824] Recommend content based on your users' interests.

[0825] trip

[0826] Beach Photos

[0827] Adventure movies

[0828] Input: User input information

[0829] Output: The generated prompt statement

[0830] Step 3:

[0831] The server recommends content using generated prompts.

[0832] The server sends the generated prompt text to the OpenAI API, which then recommends appropriate content. OpenAI's generative AI model generates content such as movies, music, and articles that are suitable for the user based on the prompt text.

[0833] Input: Generated prompt text

[0834] Output: Recommended content

[0835] Step 4:

[0836] The server outputs the recommended content to the user.

[0837] The server sends the generated content to the smartphone and displays it to the user. For example, if the user inputs "travel," "beach photos," and "adventure movies," the recommended content will be as follows:

[0838] Movie: "Into the Wild"

[0839] Music: "The Beach Boys Album"

[0840] Article: "The 10 most beautiful beaches in the world"

[0841] Input: Recommended content

[0842] Output: The content displayed on the user's smartphone

[0843] Example 2

[0844] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[0845] Conventional information provision systems have had difficulty effectively generating information that users may be interested in in the future. In addition, when generating new information based on information entered by the user, appropriate analysis and generation were often not performed. As a result, useful information for users was not provided, resulting in a poor user experience.

[0846] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0847] In this invention, the server includes a means for inputting information that the user is interested in, a means for transmitting the input information to the server, a means for the server to analyze the input information, a means for the server to input a prompt sentence to the generative AI model based on the analysis result, a means for the generative AI model to generate new information, a means for transmitting the generated information from the server to the terminal, and a means for outputting the generated information to the user. This makes it possible to effectively generate information that the user may be interested in in the future and provide information that is useful to the user.

[0848] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[0849] "Means of input" refers to the interface or device that allows a user to input information of interest or concern into the system.

[0850] "Means of transmission" refers to the communications protocol and network infrastructure used to transmit the information entered by the user to the server.

[0851] A "server" is a computer system that receives and analyzes information sent by a user and inputs prompt sentences into the generative AI model.

[0852] "Means of analysis" refers to the process by which the server analyzes the information received from the user using natural language processing technology, etc.

[0853] A "generative AI model" is an artificial intelligence model that generates new information based on an input prompt sentence.

[0854] A "prompt" is a textual instruction that is input to a generative AI model.

[0855] The "means of generation" refers to the process by which the generative AI model generates new information based on the prompt sentence.

[0856] The "means for transmitting" refers to the communication protocol and network infrastructure that the server uses to transmit the generated information to the terminal.

[0857] "Output means" refers to an interface or device that allows the terminal to display the generated information to the user.

[0858] A "terminal" is a device, such as a computer or smartphone, that a user uses to input information and receive generated information.

[0859] The present invention relates to a system for generating information that a user may be interested in in the future. A specific embodiment of this system will be described below.

[0860] First, the user uses a terminal to input information about their interests. Terminals include devices such as computers, smartphones, and tablets. The information input by the user is, for example, the music genre "rock."

[0861] The device then transmits the input information to a server using a communications protocol such as an HTTP request. The server has hardware and software to analyze the information it receives. In particular, it uses natural language processing techniques to analyze the input information. Analysis includes text tokenization and semantic analysis.

[0862] The server inputs a prompt sentence into the generative AI model based on the analysis results. For example, OpenAI's GPT-4 is used as the generative AI model. An example of a prompt sentence is "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet."

[0863] The generative AI model generates new information based on the prompt text. This information includes information about new rock bands and artists that the user does not yet know. The generated information is sent from the server to the device. This transmission also uses a communication protocol such as HTTP response.

[0864] Finally, the device displays the generated information to the user, who can then review the information and learn about new rock bands and artists.

[0865] As a specific example, if a user enters the keyword "rock", the device sends this information to the server via an HTTP request. The server analyzes the received keyword "rock" using natural language processing technology and creates a prompt sentence to be input into the generative AI model. For example, it generates a prompt sentence such as "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet." The generative AI model (GPT-4) generates information about new rock bands and artists based on this prompt sentence. The server sends the generated information to the device via an HTTP response. The device displays the received information to the user, allowing the user to learn about new rock bands and artists.

[0866] In this way, the present invention can effectively generate information that may be of interest to the user in the future and provide the user with useful information.

[0867] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0868] Step 1:

[0869] The user enters information

[0870] A user uses a terminal to input information about his / her interests. For example, if a user is interested in the music genre "rock," the user inputs "rock." The input information is obtained through an input interface of the terminal.

[0871] Step 2:

[0872] The device sends the input information to the server

[0873] The terminal transmits the information input by the user to the server. This transmission uses a communication protocol such as an HTTP request. The input information (e.g., "lock") is transmitted to the server as the payload of the HTTP request.

[0874] Step 3:

[0875] The server parses the input

[0876] The server analyzes the received input information. This analysis uses natural language processing techniques. Specifically, it performs text tokenization and semantic analysis. The input information (e.g. "lock") is analyzed, and related keywords and context are extracted.

[0877] Step 4:

[0878] The server inputs a prompt to the generative AI model.

[0879] The server creates a prompt sentence to be input to the generative AI model based on the analysis results. For example, it generates a prompt sentence such as "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet." The generated prompt sentence is input to the generative AI model.

[0880] Step 5:

[0881] Generative AI models generate new information

[0882] A generative AI model (e.g., GPT-4) generates new information based on the prompt received from the server. This information includes information about new rock bands and artists that the user does not yet know. The generative AI model analyzes the prompt and generates related new information.

[0883] Step 6:

[0884] The server sends the generated information to the terminal.

[0885] The server sends the new information obtained from the generative AI model to the terminal. This transmission also uses a communication protocol such as an HTTP response. The generated information (e.g., information on a new rock band or artist) is sent to the terminal as the payload of the HTTP response.

[0886] Step 7:

[0887] The terminal displays the generated information to the user.

[0888] The terminal displays the new information received from the server to the user. The user can check the displayed information and learn about new rock bands and artists. The generated information is visually presented to the user through the display interface of the terminal.

[0889] (Application example 2)

[0890] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[0891] Conventional content recommendation systems have the problem that it is difficult to effectively recommend new content based on information entered by the user. It is also difficult to accurately predict the user's interests and provide information that may be of interest to the user in the future. Furthermore, there is a lack of means to appropriately present the generated information to the user.

[0892] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0893] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for recommending new content based on the information input by the user, and a means for displaying the generated recommendation results. This makes it possible to accurately predict the user's interests, effectively recommend new content that the user may be interested in in the future, and appropriately present the content to the user.

[0894] "Means for users to input information that interests them" refers to an interface that enables users to input information that interests them into the system.

[0895] "AI means for generating information that the user may be interested in in the future based on the input information" refers to artificial intelligence technology that analyzes information input by the user and generates new information that the user may be interested in in the future based on that information.

[0896] "Means for outputting the generated information to the user" refers to an interface for presenting the information generated by the AI ​​means to the user.

[0897] "Means for recommending new content based on information entered by a user" refers to technology for selecting and recommending new content that may be of interest to a user based on information entered by the user.

[0898] The "means for displaying the generated recommendation results" is an interface for visually presenting the recommended new content to the user.

[0899] A system for implementing this invention includes means for inputting information that a user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for outputting the generated information to the user, means for recommending new content based on the information input by the user, and means for displaying the generated recommendation results.

[0900] System Programming

[0901] The program of this system operates as follows.

[0902] 1. Obtaining user input: A user enters information about their interests (e.g., music genre or artist name) through a smartphone application.

[0903] 2. Prompt generation: The server generates a prompt sentence to be passed to the generative AI model based on the information entered by the user.

[0904] 3. Invoke the AI ​​model: The server passes the prompt to a generative AI model (e.g., GPT-3) using OpenAI’s API to generate new content recommendations.

[0905] 4. Displaying recommendation results: The server displays the generated recommendation results to the user through the smartphone application.

[0906] Hardware and Software Used

[0907] Hardware: Smartphones, servers

[0908] Software: Python, OpenAI API

[0909] Examples

[0910] When a user uses a smartphone application to input the music genre "rock", the following prompt is generated:

[0911] Examples of prompt statements

[0912] Recommend new music content that may interest users. Genre: Rock

[0913] The server passes this prompt to the OpenAI API and receives recommendations for new rock bands and artists from the generative AI model. For example, recommendations such as "New rock band 'The New Waves'" or "Artist 'Rocky Road'" are generated.

[0914] The generated recommendation results are displayed to users through a smartphone application, allowing users to discover new music content based on their own interests.

[0915] In this way, it is possible to accurately predict a user's interests and effectively recommend new content that may be of interest to the user in the future, and present it appropriately to the user.

[0916] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0917] Step 1:

[0918] A user uses a smartphone application to input information about his or her interests (e.g., music genres and artist names).

[0919] Input: Information entered by the user (e.g. "lock")

[0920] Output: User input information is sent to the server

[0921] Step 2:

[0922] The server receives the information entered by the user and generates a prompt sentence based on that information to pass to the generative AI model.

[0923] Input: User input information (e.g. "lock")

[0924] Data processing: Converting user input information into prompt text

[0925] Output: Prompt (e.g. "Recommend new music content that may interest the user. Genre: Rock")

[0926] Step 3:

[0927] The server passes the generated prompt text to OpenAI's API, which then invokes a generative AI model (e.g., GPT-3) to generate new content recommendations.

[0928] Input: prompt statement

[0929] Data calculation: Using OpenAI's API, we pass the prompt sentence to the generative AI model and generate recommendation results.

[0930] Output: Recommendation results (e.g. "New rock band 'The New Waves'" or "Artist 'Rocky Road'")

[0931] Step 4:

[0932] The server transmits the generated recommendation results to the smartphone application.

[0933] Input: Recommendation results

[0934] Output: Recommendation results are sent to a smartphone application.

[0935] Step 5:

[0936] The smartphone application displays the received recommendation results to the user.

[0937] Input: Recommendation results

[0938] Output: The recommendations are visually displayed to the user.

[0939] In this way, users can discover new music content based on their own interests.

[0940] Example 3

[0941] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0942] Conventional information provision systems have difficulty in providing users with appropriate information that interests them, and they have also been unable to effectively display advertisements based on the user's interests. This has resulted in a poor user experience, and advertisers have also been unable to deliver advertisements effectively.

[0943] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0944] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for placing advertisements in the generated information, and a means for selecting and displaying advertisements based on the user's interests. This allows the user to simultaneously obtain information and advertisements that match his or her interests.

[0945] "User" means an individual or organization that uses the system to input information and view generated information and advertisements.

[0946] "Information of interest" is information about which a user is interested and wants to know more.

[0947] An "input means" is an interface through which a user inputs information into the system, and includes input devices such as a keyboard or a touch screen.

[0948] "Artificial intelligence means" refers to algorithms or models that generate information that may be of interest to a User in the future, based on information input by a User.

[0949] "Generate" means to create new information based on input information.

[0950] The "means for outputting" refers to an interface for displaying the generated information to the user, and includes, for example, a display device such as a display or a web browser.

[0951] "Means for displaying advertisements" refers to a function for displaying advertisements related to the generated information.

[0952] "Means of selecting and displaying" refers to the function of selecting appropriate advertisements based on the user's interests and showing them to the user.

[0953] "Specialized Output Screen" means a screen specifically designed to display generated information and advertising.

[0954] This invention is a system in which a user inputs information that interests them and provides the user with information generated based on that information. Furthermore, by displaying advertisements related to the generated information, it is possible to provide advertisements that match the user's interests.

[0955] The server uses a generative AI model to generate information based on the user's input. The generative AI model uses an advanced natural language processing model such as GPT-4. The server receives the prompt sentence entered by the user and inputs it into the generative AI model. The generative AI model generates relevant information based on the prompt sentence and returns the information to the server.

[0956] The terminal receives the generated information sent from the server and displays it on a dedicated output screen. This output screen is constructed using web technologies such as HTML, CSS, and JavaScript (registered trademark). The terminal provides an interface for visually presenting the generated information to the user.

[0957] The user can access the dedicated output screen through the terminal and view the generated information. For example, if the user inputs the prompt sentence "Tell me about the latest technology trends," the server uses the generative AI model to generate related information and transmits the information to the terminal. The terminal displays the generated information on the dedicated output screen, and the user can view the information.

[0958] In addition, the server selects advertisements based on the user's interests and sends them to the device. The device displays the received advertisements on a dedicated output screen. For example, an advertisement about the latest gadgets might be displayed. This allows the user to simultaneously obtain information and advertisements that match their interests.

[0959] As a specific example, if a user enters the prompt sentence "Tell me about the latest technology trends," the server uses a generative AI model (GPT-4) to generate information such as "The notable technology trend in 2023 is the fusion of AI and IoT." This information is displayed on a dedicated output screen on the device. In addition, related ads for the latest AI devices are displayed.

[0960] Example prompt:

[0961] "Tell me about the latest technology trends."

[0962] "I want to know the latest information on the evolution of AI."

[0963] "What startups should we look out for in 2023?"

[0964] In this way, the user can simultaneously obtain information and advertisements that match his / her interests. The flow of the specification process in the third embodiment will be described with reference to FIG.

[0965] Step 1:

[0966] The user enters a prompt.

[0967] The user inputs a prompt sentence into an input field of the terminal. For example, the user inputs "Tell me about the latest technology trends." The input prompt sentence is temporarily stored in the memory of the terminal.

[0968] Step 2:

[0969] The terminal sends a prompt to the server.

[0970] The terminal sends the prompt text entered by the user to the server as an HTTP POST request. This request includes the prompt text. The terminal uses a network interface to send the prompt text to the server.

[0971] Step 3:

[0972] The server generates information using the generative AI model

[0973] The server inputs the received prompt sentence into a generative AI model (e.g., GPT-4) to generate relevant information. The generative AI model analyzes the prompt sentence and performs data processing and data calculation to generate relevant information. The generated information is stored in the server's memory.

[0974] Step 4:

[0975] The server sends the generated information to the terminal.

[0976] The server transmits the generated information to the terminal as an HTTP response. The response includes the generated information. The server uses a network interface to transmit the generated information to the terminal.

[0977] Step 5:

[0978] The terminal displays the generated information on a dedicated output screen.

[0979] The terminal displays the received information on a dedicated output screen. This output screen is constructed using HTML, CSS, and JavaScript (registered trademark). To visually display the generated information, the terminal dynamically generates HTML elements and adds them to the screen.

[0980] Step 6:

[0981] The server selects advertisements based on the user's interests and sends them to the device.

[0982] The server analyzes the user's prompt text and past browsing history to select highly relevant advertisements. The selected advertisements are sent to the terminal as an HTTP response. The server refers to a database to select advertisements and chooses appropriate advertisements.

[0983] Step 7:

[0984] The device displays the advertisement on a dedicated output screen

[0985] The device displays the received advertisements on a dedicated output screen. The device dynamically generates HTML elements and adds them to the screen to visually display the advertisements. For example, an advertisement banner is displayed on the latest AI devices.

[0986] Step 8:

[0987] View user generated information and advertisements

[0988] The user can view the generated information and advertisements through a dedicated output screen on the device, allowing the user to simultaneously obtain information and advertisements that match their interests.

[0989] (Application example 3)

[0990] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[0991] Conventional information provision systems have difficulty in providing users with information that interests them appropriately, and lack the means to effectively display advertisements related to their interests. For these reasons, improving the user experience and maximizing the effectiveness of advertisements have become issues.

[0992] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0993] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, and a means for acquiring and displaying advertisements related to the generated information, thereby making it possible to effectively provide information and advertisements according to the user's interests.

[0994] "User" means an individual or organization that uses the system to input information and view generated information and advertisements.

[0995] "Information of interest" is information that users are interested in and want to know about.

[0996] "Means of input" refers to the interface or device that allows a user to input information of interest or concern into the system.

[0997] "Artificial intelligence means" refers to algorithms or models that generate information that may be of interest to a User in the future, based on information entered by the User.

[0998] "Generated Information" means information generated by artificial intelligence means that may be of future interest to a User.

[0999] "Output means" refers to an interface or device for displaying the generated information to the user.

[1000] "Means for acquiring and displaying advertisements" refers to an algorithm or system for acquiring advertisements related to the generated information and displaying them to users.

[1001] The following system configuration will be described as an embodiment of the present invention.

[1002] System Configuration

[1003] The system consists of a user terminal, a server, and an ad serving system. The user terminal is a device such as a smartphone or PC, and provides an interface for users to input information and view generated information and advertisements. The server uses a generative AI model to generate information that users may be interested in in the future, and is responsible for obtaining related advertisements from the ad serving system and sending them to the user terminal.

[1004] Hardware and software used

[1005] Hardware: Smartphones, PCs, servers

[1006] Software: Python, OpenAI API, Tkinter (GUI library)

[1007] Data processing and calculation

[1008] 1. User terminal: The user inputs information that interests them through the interface on the terminal. For example, they input a prompt such as, "Please tell me about the latest technology trends."

[1009] 2. Server: The server receives the prompt text sent by the user and sends it to the generative AI model (e.g. text-davinci-003) using the OpenAI API. The generative AI model generates information that the user may be interested in in the future based on the prompt text.

[1010] 3. Advertisement provision system: Based on the generated information, relevant advertisements are obtained. For example, if the generated information is about the "latest technology," advertisements for the latest smartphones are obtained.

[1011] 4. Server: The server sends the generated information and related advertisements to the user terminal.

[1012] 5. User terminal: The user terminal displays the received information and advertisements.

[1013] Examples

[1014] When a user inputs the prompt sentence "Tell me about the latest technology trends," the server uses a generative AI model to generate information about the latest technology. Based on the generated information, it retrieves advertisements for the latest smartphones from the advertisement serving system and sends them to the user's terminal. The user's terminal displays the generated information and advertisements.

[1015] Examples of prompt statements

[1016] "Tell me about the latest technology trends."

[1017] "What are the latest research findings on health?"

[1018] "What travel destinations would you recommend?"

[1019] In this way, it becomes possible to effectively provide information and advertisements that match the user's interests.

[1020] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1021] Step 1:

[1022] The user inputs information that interests them through the interface on the terminal. For example, they input a prompt such as, "Tell me about the latest technology trends." The input prompt is sent from the terminal to the server.

[1023] Input: The prompt text entered by the user.

[1024] Output: The prompt sent to the server.

[1025] Step 2:

[1026] The server receives the prompt text sent by the user. Based on the received prompt text, the server sends the prompt text to a generative AI model (e.g., text-davinci-003) using the OpenAI API. The generative AI model generates information that the user may be interested in in the future based on the prompt text.

[1027] Input: The prompt text sent by the user

[1028] Output: The information generated by the generative AI model

[1029] Step 3:

[1030] The server receives the information generated from the generative AI model. Then, based on the generated information, the server sends a request to obtain an advertisement related to the generated information to the advertisement serving system. The advertisement serving system returns the advertisement related to the generated information to the server.

[1031] Input: Information generated by a generative AI model

[1032] Output: Relevant ads retrieved from the ad serving system

[1033] Step 4:

[1034] The server transmits the generated information and associated advertisements to the user terminal, and the user terminal displays the received information and advertisements.

[1035] Input: Generated information and related ads

[1036] Output: Information and advertisements displayed on the user's device

[1037] Step 5:

[1038] The user views the information and advertisements displayed on the device, allowing the user to simultaneously obtain information and advertisements that match their interests.

[1039] Input: Information and advertisements displayed on the user's device

[1040] Output: User consumes information and ads through browsing

[1041] In addition, an emotion engine that estimates the emotion of the user may be further combined. That is, the identification processing unit 290 may estimate the emotion of the user using the emotion identification model 59, and perform identification processing using the emotion of the user.

[1042] "Example 1"

[1043] As one embodiment of the present invention, a system including an emotion engine that recognizes the emotions of a user is provided. This system includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, and a means for outputting the generated information to the user. Specifically, the user inputs a photo of "rock," which is the user's favorite music genre, and keywords related to that genre. "Example 2"

[1044] The emotion engine recognizes the user's emotional state and generates information that may be of future interest to the user based on that emotional state. For example, if the user is expressing an emotion of joy, the emotion engine generates information related to that emotion of joy. This can provide information on new music genres and artists that the user may find enjoyable.

[1045] "Example 3"

[1046] Further included is a means for placing an advertisement in the generated information. The emotion engine selects an advertisement based on the emotional state of the user and places the advertisement in the generated information. For example, if the user indicates an emotion of joy, the emotion engine selects an advertisement related to the emotion of joy. This makes it possible to provide advertisements for products or services that the user is likely to feel joyful about.

[1047] The process flow of each embodiment will be described below.

[1048] "Example 1"

[1049] Step 1: The user enters information about their interests into the system. For example, they enter a photo of their favorite music genre, "rock," along with keywords related to that genre.

[1050] Step 2: The system analyzes the input information and determines the user's current interests.

[1051] Step 3: The emotion engine recognizes the user's emotional state.

[1052] "Example 2"

[1053] Step 1: The emotion engine generates information that may be of future interest to the user based on their emotional state.

[1054] Step 2: For example, if the user indicates an emotion of happiness, the emotion engine generates information related to the emotion of happiness.

[1055] Step 3: This allows us to provide information about new music genres and artists that users may enjoy.

[1056] "Example 3"

[1057] Step 1: This also includes a means of placing advertisements on the generated information.

[1058] Step 2: The emotion engine selects advertisements based on the user's emotional state and places the advertisements in the generated information.

[1059] Step 3: For example, if the user is expressing an emotion of joy, the emotion engine will select ads related to that emotion of joy, allowing it to serve ads for products and services that the user is likely to find joyful.

[1060] Example 1

[1061] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1062] Conventional information provision systems have difficulty in providing information based on the user's interests and cannot predict information that the user may be interested in in the future. In addition, since information provision does not take into account the user's emotions, it is not possible to increase user satisfaction. This has led to a demand for improving the accuracy of information provision according to the user's interests and concerns.

[1063] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1064] In this invention, the server includes a means for inputting information that the user is interested in, a means for receiving the input information, a means for recognizing the user's emotions based on the input information, a means for using a generative AI model for generating information that the user may be interested in in the future based on the emotion recognition result and the input information, and a means for outputting the generated information to the user. This makes it possible to provide information that the user may be interested in in the future with high accuracy, taking into account the user's emotions.

[1065] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[1066] "Input means" refers to an interface that allows users to input information that interests them into the system. Specifically, this includes web browsers and mobile applications.

[1067] "Means for receiving" refers to a function by which the server receives information input by the user. This includes the process of receiving data via network communication.

[1068] "Emotion recognition means" refers to a function for analyzing and recognizing a user's emotions based on information input by the user. Specifically, this refers to emotion recognition software or algorithms.

[1069] A "generative AI model" is an artificial intelligence model that generates information that a user may be interested in in the future based on user input information and emotion recognition results. Specifically, this applies to natural language processing models and machine learning algorithms.

[1070] "Output means" refers to a function for providing the generated information to the user. This includes a process for displaying the information on the user's terminal.

[1071] The "advertising means" is a function for adding advertisements to the generated information and providing it to users, thereby generating profits for the system.

[1072] This invention is a system that inputs information that a user is interested in, generates information that the user may be interested in in the future based on that information, and provides the information to the user. A specific embodiment of this system will be described below.

[1073] First, the user accesses a dedicated input screen. This input screen is provided through a web browser or a mobile application. The user enters photos and text of their interests into the input screen. For example, if the user is interested in "rock" music, they enter a photo of a rock band and keywords such as "guitar" and "live."

[1074] Next, the server receives the information entered by the user. This information is sent to the server as photo data or text data. The server passes the received information to emotion recognition software (e.g., "EmotionAPI") to analyze the user's emotions. The emotion recognition software recognizes the user's emotional state (e.g., joy, excitement, interest, etc.) from the photo or text.

[1075] The server then uses a generative AI model (such as GPT-4) to generate information that the user may be interested in in the future. The generative AI model processes and calculates data based on the information entered by the user and the emotion recognition results. Specifically, it generates information on new rock bands and live events that the user may be interested in.

[1076] Finally, the server transmits the generated information to the user's terminal, where the user can check the information of new rock bands and live events.

[1077] As a concrete example, consider a case where a user is interested in "rock" music. The user enters a photo of "rock" and keywords such as "guitar" and "live" into the input screen. The server receives this information and stores the photo data and text data. The server then calls the Emotion API to analyze the user's emotions from the photo and text. For example, it recognizes from the photo that the user is excited. The server uses GPT-4 to generate information about new rock bands and live events that the user may be interested in. For example, it generates "new rock band album release information" and "details of live events taking place nearby." The server sends the generated information to the user's device, and the user checks the information in a web browser.

[1078] Example prompt:

[1079] "Generate information about rock bands and live events that may be of interest to the user in the future based on the information entered by the user. The input information is as follows: photo (live photo of rock band), keywords (guitar, live)."

[1080] In this way, users can easily access information based on their interests.

[1081] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1082] Step 1:

[1083] The user accesses the input screen.

[1084] Users access a dedicated input screen through a web browser or mobile application. The input screen provides an interface for users to input information about their interests.

[1085] Step 2:

[1086] The user enters information about their interests.

[1087] The user inputs photos and text of their interests into the input screen. For example, if the user is interested in "rock" music, they input photos of rock bands and keywords such as "guitar" and "live." The input data is sent to the server as photo data and text data.

[1088] Step 3:

[1089] The server receives the input information.

[1090] The server receives the photo data and text data entered by the user and stores the received data in a database within the server.

[1091] Step 4:

[1092] The server recognizes the user's emotion using the emotion recognition means.

[1093] The server passes the received photo and text data to emotion recognition software (e.g., "EmotionAPI") to analyze the user's emotions. The emotion recognition software recognizes the user's emotional state (e.g., joy, excitement, interest, etc.) from the photo and text. The input is photo data and text data, and the output is the emotion recognition result.

[1094] Step 5:

[1095] The server uses a generative AI model to generate information that may be of interest in the future.

[1096] The server generates new information using a generative AI model (e.g., GPT-4) based on the emotion recognition results and the information entered by the user. The generative AI model generates information about rock bands and live events that the user may be interested in in the future. The inputs are the emotion recognition results and the user's input information, and the output is the generated information.

[1097] Step 6:

[1098] The server outputs the generated information to the user.

[1099] The server sends the generated information to the user's terminal. The user can check the information of new rock bands and live events on his / her terminal. The input is the generated information, and the output is the information displayed on the user's terminal.

[1100] As a concrete example, consider a case where a user is interested in "rock" music. The user enters a photo of "rock" and keywords such as "guitar" and "live" into the input screen. The server receives this information and stores the photo data and text data. The server then calls the Emotion API to analyze the user's emotions from the photo and text. For example, it recognizes from the photo that the user is excited. The server uses GPT-4 to generate information about new rock bands and live events that the user may be interested in. For example, it generates "new rock band album release information" and "details of live events taking place nearby." The server sends the generated information to the user's device, and the user checks the information in a web browser.

[1101] (Application example 1)

[1102] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1103] Conventional content delivery services have been insufficient in providing information based on users' interests and concerns, and it has been difficult to provide personalized content that takes users' emotions into account. In addition, it is difficult to predict information that users may be interested in in the future, so there has been a demand for improving the user experience.

[1104] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1105] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, an emotion engine for recognizing the user's emotions, a means for generating a prompt sentence using a generative AI model based on the emotion information recognized by the emotion engine, and a means for generating related content based on the generated prompt sentence. This makes it possible to provide personalized content that takes the user's emotions into consideration, improving the user experience.

[1106] "Means for users to input information that interests them" refers to an interface that allows users to input information that interests them.

[1107] "AI Means" refers to the function of artificial intelligence that generates information that may be of future interest to the user based on input information.

[1108] The "means for outputting the generated information to the user" refers to an interface for providing the generated information to the user.

[1109] An "emotion engine" is a system for recognizing a user's emotions.

[1110] A "generative AI model" is an artificial intelligence model for generating prompt sentences based on user input information and emotional information.

[1111] The "means for generating a prompt sentence" is a function for generating a prompt sentence based on emotion information recognized by the emotion engine.

[1112] The "means for generating relevant content" is a function for generating content relevant to the user based on the generated prompt sentence.

[1113] A system for implementing this invention includes means for inputting information that a user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for outputting the generated information to the user, an emotion engine for recognizing the user's emotions, means for generating a prompt sentence using a generative AI model based on the emotion information recognized by the emotion engine, and means for generating related content based on the generated prompt sentence.

[1114] System Configuration

[1115] 1. How users can enter their interests:

[1116] A user uses a smartphone application to input information about their interests (e.g., music genres or movie titles). The input interface includes text boxes and an image upload function.

[1117] 2. Emotion Engine:

[1118] The emotion engine recognizes emotions from images and text uploaded by users. Specifically, it uses an image processing library (e.g., OpenCV) and an emotion recognition model (e.g., a deep learning model using Keras).

[1119] 3. Generative AI model:

[1120] The generative AI model generates prompts based on the user's input and emotional information. The generative AI model uses a natural language processing library (e.g., Transformers) and utilizes a pre-trained model (e.g., GPT-3).

[1121] 4. How to generate a prompt:

[1122] Based on the emotion information recognized by the emotion engine, a generative AI model is used to generate prompt sentences. For example, if a user is interested in "rock music" and emotion recognition detects the emotion of "joy," the following prompt sentence is generated:

[1123] Your users are interested in rock music and the emotion is joy, so generate relevant content.

[1124] 5. How to generate relevant content:

[1125] Based on the generated prompt sentences, relevant content (e.g., music playlists, movie recommendations, articles, etc.) is generated. The generated content is displayed in the user's smartphone application.

[1126] Examples

[1127] A user opens the smartphone application, uploads a photo of "rock music" that interests them, and inputs related keywords (e.g., "rock, music, concert"). The emotion engine recognizes the emotion of "joy" from the photo, and the generative AI model generates the following prompt sentence:

[1128] Your users are interested in rock music and the emotion is joy, so generate relevant content.

[1129] Based on this prompt, the generative AI model generates rock music-related articles, playlists, concert information, and other information that are appropriate for the user, and displays them on the smartphone application.

[1130] In this way, it becomes possible to provide personalized content that takes into account the user's emotions, improving the user experience.

[1131] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1132] Step 1:

[1133] A user opens a smartphone application and inputs information about their interests. For example, the user uploads a photo of "rock music" and inputs related keywords (e.g. "rock, music, concert"). The input information is sent to the server.

[1134] Step 2:

[1135] The server receives the photo sent by the user and reads the image using an image processing library (e.g. OpenCV). The image is resized to 48x48 pixels and input to an emotion recognition model (e.g. a deep learning model using Keras). The emotion recognition model predicts the user's emotion from the image and outputs an emotion label.

[1136] Step 3:

[1137] The server generates a prompt sentence using a generative AI model (e.g., GPT-3) based on the keywords sent by the user and the emotion labels obtained in step 2. The generative AI model generates a prompt sentence using a natural language processing library (e.g., Transformers) and outputs the prompt sentence as follows:

[1138] Your users are interested in rock music and the emotion is joy, so generate relevant content.

[1139] Step 4:

[1140] The server generates relevant content based on the generated prompt sentence. The generative AI model takes the prompt sentence as input and generates content appropriate for the user (e.g., music playlists, movie recommendations, articles, etc.). The generated content is sent from the server to the user's smartphone application.

[1141] Step 5:

[1142] The user's smartphone application receives the content sent from the server and displays it to the user. The user can browse the displayed content and obtain information based on their interests.

[1143] In this way, it becomes possible to provide personalized content that takes into account the user's emotions, improving the user experience.

[1144] Example 2

[1145] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[1146] Conventional information provision systems can provide information based on the user's interests and concerns, but they have the problem that they cannot provide information that takes into account the user's emotional state. This makes it difficult to provide appropriate information according to the user's emotions, and there is a problem that the user experience cannot be sufficiently improved.

[1147] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1148] In this invention, the server includes a means for inputting information that the user is interested in, a generative AI model for generating information that the user may be interested in in the future based on the input information, an emotion engine for recognizing the emotional state of the user and generating information that the user may be interested in in the future based on the emotional state, and a means for outputting the generated information to the user. This makes it possible to provide information that takes into account not only the user's interests but also their emotional state.

[1149] "User" means any individual or entity that utilizes the System to enter information and receive provided information.

[1150] "Information of interest" is information in which a user is interested in a particular field or topic.

[1151] "Means of input" refers to the interface or device that allows a user to input information of interest or concern into the system.

[1152] A "generative AI model" is an artificial intelligence algorithm or program that analyzes information input by a user and generates new information based on that information.

[1153] An "emotion engine" is the part of the system that recognizes a user's emotional state and generates information that may be of future interest to the user based on that emotional state.

[1154] An "emotional state" is an emotional state, such as happiness, sadness, anger, etc., expressed by a user.

[1155] "Output means" refers to an interface or device for providing the generated information to a user.

[1156] "Generating information" means creating new relevant information based on information input by the user and their emotional state.

[1157] A "means for displaying advertisements" is an interface or device for adding advertisements to the generated information and providing it to users.

[1158] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1159] This invention is a system that inputs information that a user is interested in, and generates information that the user may be interested in in the future based on that information. The system uses a generative AI model and an emotion engine to analyze the user's input information and emotional state, and provides appropriate information.

[1160] Hardware and Software Used

[1161] Hardware: Servers, terminals (user devices)

[1162] Software: Generative AI models, emotion engines

[1163] Specific operation of the system

[1164] 1. User enters information:

[1165] The user uses the terminal to input information of interest (for example, the music genre "rock"). Specifically, the user inputs "rock" into the input form of the terminal and presses the send button.

[1166] 2. The server receives the information:

[1167] The server receives the information sent by the user. Specifically, it receives the "lock" data through an HTTP request.

[1168] 3. The server passes the information to the generative AI model:

[1169] The server passes the received information to the generative AI model. Specifically, it sends data called "lock" to the API of the generative AI model.

[1170] 4. Generative AI models analyze the information:

[1171] The generative AI model analyzes the information entered by the user and generates new information based on that information. Specifically, it generates information on new rock bands and artists related to the genre "rock."

[1172] 5. The server passes the information to the emotion engine:

[1173] The server passes the user's input information and the information obtained from the generative AI model to the emotion engine. Specifically, it sends this data to the emotion engine's API.

[1174] 6. Emotion engine recognizes the user's emotional state:

[1175] The emotion engine analyzes the user's input and past behavioral data to recognize the user's emotional state. Specifically, it recognizes the emotion of "joy" from the user's past music playback history and input content.

[1176] 7. Emotion engine generates emotion-based information:

[1177] The emotion engine generates information that may be of future interest to the user based on the user's emotional state. For example, if the user is showing the emotion of "joy," it generates information on new music genres and artists related to that emotion.

[1178] 8. The server consolidates the generated information:

[1179] The server combines the information from the generative AI model and the emotion engine into a single dataset.

[1180] 9. The server provides the aggregated information to the user:

[1181] The server provides the aggregated information to the user, specifically by sending information about new rock bands and artists to the user's device via HTTP responses.

[1182] Examples of concrete examples and prompts

[1183] Examples:

[1184] If a user inputs that they are interested in the music genre "rock," the generative AI model will generate information about new rock bands and artists. At the same time, if the emotion engine recognizes the user's emotional state as "joy," it will also generate information about new music genres and artists related to joy.

[1185] Example prompt:

[1186] "Generate information about new rock bands and artists that the user may be interested in. Also, if the user is expressing the emotion of joy, provide information related to that emotion."

[1187] In this way, the system provides users with information that may be of interest to them in the future based on their interests and emotional state.

[1188] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1189] Step 1:

[1190] The user enters information

[1191] A user uses a terminal to input information of interest (for example, the music genre "rock"). Specifically, the user inputs "rock" into an input form on the terminal and presses the send button. The input information is sent to the server as an HTTP request.

[1192] Step 2:

[1193] The server receives the information

[1194] The server receives information sent by the user. Specifically, it receives data called "locks" through HTTP requests. The received data is temporarily stored to be passed to the generative AI model and emotion engine.

[1195] Step 3:

[1196] The server passes information to the generative AI model

[1197] The server passes the received information to the generative AI model. Specifically, it sends a piece of data called a "lock" to the API of the generative AI model. Based on the input data, the generative AI model starts analyzing it to generate new related information.

[1198] Step 4:

[1199] Generative AI models analyze information

[1200] The generative AI model analyzes the information entered by the user and generates new information based on that information. Specifically, it generates information on new rock bands and artists related to the genre "rock." The generated information is returned to the server.

[1201] Step 5:

[1202] The server passes the information to the emotion engine.

[1203] The server passes the user's input information and the information obtained from the generative AI model to the emotion engine. Specifically, it sends these data to the emotion engine's API. The emotion engine starts analyzing to recognize the user's emotional state.

[1204] Step 6:

[1205] Emotion engine recognizes the user's emotional state

[1206] The emotion engine analyzes the user's input and past behavior data to recognize the user's emotional state. Specifically, it recognizes the emotion of "joy" from the user's past music playback history and input content. The recognized emotional state is returned to the server.

[1207] Step 7:

[1208] Emotion engine generates emotion-based information

[1209] The emotion engine generates information that may be of future interest to the user based on the user's emotional state. For example, if the user is showing the emotion of "joy," it generates information on new music genres and artists related to that emotion. The generated information is returned to the server.

[1210] Step 8:

[1211] The server consolidates the generated information

[1212] The server combines the information from the generative AI model and the emotion engine into a single dataset, which is then prepared for presentation to the user.

[1213] Step 9:

[1214] The server provides the consolidated information to the user.

[1215] The server provides the integrated information to the user. Specifically, it transmits information about new rock bands and artists to the user's terminal through an HTTP response. The user can receive the provided information through the terminal.

[1216] (Application example 2)

[1217] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1218] Conventional information recommendation systems can provide information based on a user's interests, but they do not recommend information that takes into account the user's emotional state. As a result, it is not possible to provide personalized information according to the user's emotions, and improving the user experience has been a challenge.

[1219] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1220] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for recognizing the user's emotional state, an emotion engine for generating information that the user may be interested in in the future based on the emotional state, and a means for outputting the generated information to the user. This makes it possible to provide personalized information according to the user's emotional state.

[1221] "Means for users to input information that interests them" refers to an interface that enables users to input information that interests them into the system.

[1222] "AI means for generating information that the user may be interested in in the future based on the input information" refers to an artificial intelligence function that analyzes the information input by the user and generates new information that the user may be interested in in the future based on that information.

[1223] "Means for recognizing the user's emotional state" refers to technology for analyzing the user's facial expressions, voice, and other biometric signals to recognize the user's current emotional state.

[1224] The "emotion engine that generates information that may be of future interest to the user based on the user's emotional state" is an engine that takes into account the user's emotional state and generates information related to that emotion.

[1225] The "means for outputting the generated information to the user" refers to an interface for providing the generated information to the user visually or audibly.

[1226] The following system configuration will be described as an embodiment of the present invention.

[1227] System Configuration

[1228] This system includes means for inputting information that the user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for recognizing the user's emotional state, an emotion engine for generating information that the user may be interested in in the future based on the emotional state, and means for outputting the generated information to the user.

[1229] Hardware and Software

[1230] Hardware: Smartphones, smart glasses, head-mounted displays

[1231] Software: EmotionRecognizer (emotion recognition engine), MusicRecommender (music recommendation engine)

[1232] Processing flow

[1233] 1. User information input: The user uses a smartphone or smart glasses to input information about their interests. For example, the user may input that they are interested in "rock music."

[1234] 2. Emotion Recognition: Use EmotionRecognizer to recognize the user's emotional state in real time, for example, by analyzing the user's facial expressions through the camera to detect the emotion of happiness.

[1235] 3. Information Generation: Based on the information entered by the user and the recognized emotional state, the AI ​​means and the emotion engine work together to generate information that may be of future interest. For example, if the user is interested in "rock music" and shows an emotion of joy, new songs by upbeat rock bands will be recommended.

[1236] 4. Information output: The generated information is provided to the user visually or audibly through a smartphone or smart glasses. For example, a new song from a recommended rock band is displayed on the smartphone screen.

[1237] Examples

[1238] User Sentiment: Delight

[1239] Recommended music: New songs from upbeat rock bands

[1240] Examples of prompt statements

[1241] Develop an application that recognizes a user's emotional state and recommends music that they may be interested in in the future based on that emotion. For example, if a user is expressing an emotion of joy, recommend upbeat music and songs with positive lyrics.

[1242] In this way, it becomes possible to provide personalized information according to the user's emotional state.

[1243] The flow of the identification process in the application example 2 will be described with reference to FIG.

[1244] Step 1:

[1245] The user enters information about their interests.

[1246] A user uses a smartphone or smart glasses to input information about his or her interests. For example, the user may input that he or she is interested in "rock music." This input information is stored in the system's database.

[1247] Step 2:

[1248] The terminal recognizes the user's emotional state.

[1249] EmotionRecognizer is used to recognize the user's emotional state in real time. For example, it analyzes the user's facial expressions through the camera to detect the emotion of joy. This emotional data is sent to the system.

[1250] Step 3:

[1251] The server analyzes the input information and emotion data.

[1252] The server analyzes the information entered by the user and the perceived emotional state. For example, if the user is interested in "rock music" and expresses an emotion of joy, the server predicts the user's future interests and concerns based on this data.

[1253] Step 4:

[1254] The server generates information that may be of interest to you in the future.

[1255] The AI ​​tools and emotion engine work together to generate new information based on the user's input and emotion data, for example recommending new songs from an upbeat rock band. This generated information is stored in the system's database.

[1256] Step 5:

[1257] The terminal outputs the generated information to the user.

[1258] The generated information is provided to the user visually or audibly through a smartphone or smart glasses. For example, a new song from a recommended rock band is displayed on the smartphone screen. The user reviews the information and decides whether it is of interest to them.

[1259] Example 3

[1260] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1261] Conventional information provision systems can provide information based on the user's interests, but have the problem of difficulty in effectively displaying advertisements according to the user's emotional state. In addition, there was a lack of a way to maximize the effectiveness of advertisements by simultaneously providing information that the user is interested in and related advertisements.

[1262] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1263] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for analyzing the emotional state of the user, and a means for selecting an advertisement based on the emotional state and placing the advertisement in the generated information. This makes it possible to provide information based on the user's interests and to effectively display advertisements according to the user's emotional state.

[1264] "User" means an individual or organization that uses the system to input information and view generated information and advertisements.

[1265] "Interesting Information" is information about a particular subject or topic about which a User has expressed an interest and would like to know more.

[1266] An "input means" is an interface through which a user provides information to the system, and includes input devices such as a keyboard, mouse, and touch screen.

[1267] "Artificial intelligence means" refers to algorithms or models that generate information that may be of interest to a User in the future, based on information input by a User.

[1268] "Generated Information" means information generated by artificial intelligence means that may be of future interest to a User.

[1269] "Output means" refers to an interface for providing the generated information to a user, and includes a web browser, a mobile application, a display, etc.

[1270] "Means for analyzing emotional state" refers to algorithms or models used to infer a user's current emotional state based on user behavioral data and feedback.

[1271] "Ad selection method" refers to algorithms or models used to select appropriate ads based on a user's emotional state.

[1272] "Means for displaying advertisements" refers to an interface for displaying selected advertisements along with generated information to a user, and includes a web page, an application screen, a display, and the like.

[1273] This invention is a system that inputs information that a user is interested in, generates information that the user may be interested in in the future based on that information, and displays advertisements according to the user's emotional state. A specific embodiment of this system will be described below.

[1274] Hardware and Software Used

[1275] Hardware: Servers, user devices (PCs, smartphones, etc.)

[1276] Software: Generative AI models (e.g., GPT-4), emotion engines, web browsers

[1277] System Configuration

[1278] 1. A user uses a device to input a prompt for the generative AI model. For example, the user might input, "Please generate a review article for the latest smartphone."

[1279] 2. The server uses a generative AI model (e.g., GPT-4) to generate information based on the prompt entered by the user. The generative AI model uses natural language processing techniques to generate appropriate text for the prompt.

[1280] 3. The server displays the generated information on a dedicated output screen that runs on a web browser and makes it accessible to the user, e.g., a generated review article is displayed as a web page.

[1281] 4. The server uses the emotion engine to analyze the user's emotional state. The emotion engine infers the user's emotional state based on the user's past behavior data and real-time feedback, such as the click and scroll speed while the user is reading the review article.

[1282] 5. The server selects an appropriate advertisement based on the user's emotional state. For example, if the user is determined to be in an "excited" emotional state, the server selects an advertisement related to that excitement (e.g., a discount offer for a new smartphone) and places it next to the generated information.

[1283] 6. The user uses the device to view the generated information and the displayed advertisements. The user can simultaneously view information and advertisements that match his / her interests. For example, the user can click on an advertisement that catches his / her interest while reading a review article.

[1284] Examples

[1285] For example, a user inputs a prompt sentence such as "Generate a review article for the latest smartphone." The server uses a generative AI model to generate a detailed review article. The generated review article is displayed as a web page. The server uses an emotion engine to analyze the user's behavior while reading the article and determines that the user is "excited." The server selects an advertisement for a discount campaign for a new smartphone and places it next to the review article. While reading the review article, the user can click on an advertisement that interests them to find out more details.

[1286] In this way, the system can effectively provide the user with advertisements related to the generated information. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1287] Step 1:

[1288] The user uses the terminal to enter a prompt for the generative AI model.

[1289] Input: A prompt that the user enters (e.g. "Generate a review article of the latest smartphone")

[1290] Output: The prompt is sent to the server.

[1291] Specific behavior: The user enters a prompt using a keyboard or touch screen and clicks the submit button.

[1292] Step 2:

[1293] The server uses a generative AI model (e.g., GPT-4) to generate information based on prompts entered by the user.

[1294] Input: prompt statement

[1295] Data processing / computation: A generative AI model analyzes the prompt and performs natural language processing to generate relevant information.

[1296] Output: Generated information (e.g. smartphone review article)

[1297] How it works: The server passes the prompt to the generative AI model, which then runs a text generation algorithm to generate a review article.

[1298] Step 3:

[1299] The server displays the generated information on a dedicated output screen.

[1300] Input: Generated information

[1301] Data processing / calculation: Formatting the generated information into a web page using HTML and CSS

[1302] Output: The generated information displayed in a web browser.

[1303] Specific operation: The server constructs the generated information as a web page and sends it to the user's device.

[1304] Step 4:

[1305] The server uses an emotion engine to analyze the user's emotional state.

[1306] Input: User behavior data (e.g. clicks, scroll speed)

[1307] Data processing / computation: The emotion engine analyzes the behavioral data and runs algorithms to infer the user's emotional state.

[1308] Output: The user's emotional state (e.g., excited, happy)

[1309] Specific operation: The server collects user behavior data and passes it to the emotion engine for analysis.

[1310] Step 5:

[1311] The server selects an appropriate advertisement based on the user's emotional state.

[1312] Input: The user's emotional state

[1313] Data processing / computation: Searching a database for ads relevant to an emotional state and running algorithms to select the best ads

[1314] Output: The selected ads.

[1315] What it does: The server queries the ad database based on the emotional state and selects the most suitable ad.

[1316] Step 6:

[1317] The server places the selected advertisement next to the generated information.

[1318] Input: Generated information, selected ad

[1319] Data processing / calculation: Integrating the generated information with advertising and formatting it into a web page

[1320] Output: A web page with ads

[1321] Specific operations: The server combines the generated information with advertisements and sends them to the user's device.

[1322] Step 7:

[1323] The user uses the device to view the generated information and the displayed advertisements.

[1324] Input: The web page where the ad was placed

[1325] Output: User browsing behavior (e.g. clicks, scrolls)

[1326] What happens: A user uses a web browser to view the generated information and advertisements and clicks on an advertisement that interests them.

[1327] (Application example 3)

[1328] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1329] Conventional ad display systems could display ads based on the user's interests, but could not display ads according to the user's emotional state. As a result, they could not provide ads that matched the user's emotions, limiting the effectiveness of the ads. Furthermore, displaying ads that did not take the user's emotional state into account could be an unpleasant experience for the user. To solve these problems, a system that recognizes the user's emotional state and selects and displays ads based on that is needed.

[1330] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1331] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for recognizing the emotional state of the user, a means for selecting an advertisement based on the recognized emotional state, and a means for displaying the selected advertisement together with the generated information. This makes it possible to provide advertisements according to the emotional state of the user, maximize the effectiveness of the advertisements, and provide a more personalized experience for the user.

[1332] "Means for users to input information of their interests" refers to an interface that allows users to provide the system with information related to their interests.

[1333] "AI means for generating information that the user may be interested in in the future based on the input information" refers to artificial intelligence technology that analyzes information input by the user and generates information that the user may be interested in in the future.

[1334] "Means for outputting the generated information to the user" refers to an interface for displaying to the user the information generated by the AI ​​means.

[1335] "Means for recognizing a user's emotional state" refers to technology for analyzing and recognizing a user's emotional state from their input and actions.

[1336] The "means for selecting an advertisement based on a recognized emotional state" is an algorithm for selecting an optimal advertisement depending on the emotional state of the user.

[1337] "Means for displaying the selected advertisement together with the generated information" means an interface for displaying the selected advertisement to a user together with the information generated by the AI ​​means.

[1338] A system for implementing this invention includes means for inputting information that a user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for outputting the generated information to the user, means for recognizing the user's emotional state, means for selecting an advertisement based on the recognized emotional state, and means for displaying the selected advertisement together with the generated information.

[1339] System Configuration

[1340] 1. A means for users to input information about their interests

[1341] A user uses a device such as a smartphone or computer to input information related to their interests. For example, the user might input, "I'm very happy today!"

[1342] 2. AI means for generating information that may be of interest to the user in the future based on the input information

[1343] The server analyzes the information entered by the user and uses a generative AI model (e.g., GPT-3) to generate information that the user may be interested in in the future. For example, in response to the input "I'm so happy today!", the server generates content such as "5 ways to make you feel even happier."

[1344] 3. A means of outputting the generated information to the user

[1345] The generated information is displayed on the user's terminal, and the user can view the generated content.

[1346] 4. How to Recognize the User's Emotional State

[1347] The server analyzes and recognizes the user's emotional state from their input and actions. For example, if a user enters "I'm so happy today!", it recognizes the emotion of "joy."

[1348] 5. Means of selecting ads based on perceived emotional state

[1349] The server selects the most appropriate advertisements based on the recognized emotional state, for example, selecting travel and entertainment related advertisements for the emotion "joy."

[1350] 6. Means for displaying selected advertisements together with generated information

[1351] The selected advertisement is displayed on the user's device along with the generated information, allowing the user to view the advertisement that matches their emotional state along with the generated content.

[1352] Examples

[1353] If the user types "I'm very happy today!", the following happens:

[1354] User type: "I'm so happy today!"

[1355] Prompt for generative AI model: “What are 5 ways to feel happier?”

[1356] Generated content: "5 ways to feel happier"

[1357] Perceived emotional state: Joy

[1358] Selected ads: Travel packages and concert tickets

[1359] What you see: Generated content and selected ads

[1360] In this way, personalized advertisements can be served according to the user's emotional state.

[1361] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1362] Step 1:

[1363] Enter information about the user's interests

[1364] The user uses the device to input information related to his or her interests. For example, the user inputs "I'm very happy today!" This input information is sent to the server.

[1365] Input: Information related to the user's interests (e.g. "I'm so happy today!")

[1366] Output: User input sent to the server

[1367] Step 2:

[1368] Recognize the user's emotional state

[1369] The server analyzes the user's input information and uses emotion recognition algorithms to recognize the user's emotional state. For example, for the input "I'm very happy today!", the server recognizes the emotion "joy."

[1370] Input: User input (e.g. "I'm so happy today!")

[1371] Output: The perceived emotional state (e.g. "joy")

[1372] Step 3:

[1373] Generate information that may be of future interest to the user based on the input information

[1374] The server uses a generative AI model (e.g. GPT-3) to generate information that the user may be interested in in the future based on the user's input information. For example, in response to the input "I'm very happy today!", the server generates content such as "5 ways to make you feel even happier."

[1375] Input: User input (e.g. "I'm so happy today!")

[1376] Output: The generated information (e.g., "5 ways to feel happier")

[1377] Step 4:

[1378] Selecting ads based on perceived emotional state

[1379] The server selects the most appropriate advertisements based on the recognized emotional state, for example, selecting travel and entertainment related advertisements for the emotion "joy."

[1380] Input: A perceived emotional state (e.g., "joy")

[1381] Output: Selected advertisements (e.g. travel packages or concert tickets)

[1382] Step 5:

[1383] Output the generated information and selected advertisement to the user

[1384] The server displays the generated information and the selected advertisement on the user's terminal, allowing the user to view the advertisement that matches the user's emotional state along with the generated content.

[1385] Input: Generated information (e.g., "5 ways to feel happier"), selected ads (e.g., travel packages or concert tickets)

[1386] Output: Generated information and advertisements displayed on the user's device

[1387] In this way, personalized advertisements can be served according to the user's emotional state.

[1388] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1389] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1390] Another example of generative AI is Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1391] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1392] [Third embodiment]

[1393] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1394] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1395] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[1396] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1397] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[1398] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[1399] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[1400] Fig. 6 shows an example of main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1401] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1402] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1403] In the headset type terminal 314, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1404] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1405] "Example 1"

[1406] The system of the present invention provides a dedicated input screen as a means for inputting information that the user is interested in. On this input screen, the user can input multiple photos and text that he or she likes. For example, if the user is interested in a particular genre such as music, movies, or travel, the user can input photos and text related to that genre.

[1407] "Example 2"

[1408] Next, an AI means is provided that generates information that the user may be interested in in the future based on the input information. This AI means analyzes the information input by the user and generates new information based on that information. For example, if the user inputs the music genre "rock," the AI ​​can use that information to generate information on new rock bands and artists that the user does not yet know.

[1409] "Example 3"

[1410] A dedicated output screen is provided as a means of outputting the generated information to users. On this output screen, the information generated by AI is displayed, and users can view that information. A means is also provided for placing advertisements on the generated information. This allows advertisers to place advertisements related to information that may be of interest to users, and users can view advertisements that match their own interests and concerns.

[1411] The process flow of each embodiment will be described below.

[1412] "Example 1"

[1413] Step 1: The user opens a dedicated input screen, where the user can enter information about their interests using photos and text.

[1414] Step 2: The user enters a photo of their favorite music genre, "rock," along with keywords related to that genre.

[1415] Step 3: The information entered will be stored in the system and used in the next step.

[1416] "Example 2"

[1417] Step 1: The system’s AI means analyzes the information entered by the user.

[1418] Step 2: Based on photos and keywords in the "rock" genre, the AI ​​generates information about new rock bands and artists that the user does not yet know.

[1419] Step 3: The generated information is stored in the system and will be used in the next step.

[1420] "Example 3"

[1421] Step 1: The system provides the user with a dedicated output screen, where the AI-generated information is displayed.

[1422] Step 2: The user opens the output screen and views the information about the new rock band or artist generated by the AI.

[1423] Step 3: At the same time, advertisements provided by advertisers are displayed to the user, which are related to the information that may be of interest to the user.

[1424] Example 1

[1425] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1426] Conventional information provision systems have had difficulty efficiently generating and providing information based on users' interests. It has also been difficult to properly analyze information entered by users and predict what information they may be interested in in the future. Furthermore, there has been a lack of effective means of placing advertisements on the generated information.

[1427] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes a means for inputting information that the user is interested in, a means for saving the input information in a database, a means for analyzing the saved information and generating a prompt sentence, a means for sending the generated prompt sentence to the generation AI model, and a means for receiving a response from the generation AI model and outputting it to the user. This makes it possible to efficiently generate and provide information based on the user's interests. It is also possible to predict and provide information that the user may be interested in in the future. Furthermore, it is also possible to effectively place advertisements in the generated information.

[1428] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[1429] "Information of interest" is data such as photographs and text related to a particular genre or theme in which the user is interested.

[1430] "Means of input" refers to an interface for users to input information of their interest into the system, and specifically includes text boxes and file upload functions.

[1431] A "database" is a system for storing information entered by a user, enabling the management and retrieval of information.

[1432] "Means of analysis" refers to the process of analyzing the information stored in the database and generating prompt sentences based on the user's interests and concerns.

[1433] A "prompt sentence" is a sentence input into a generative AI model, and is an instruction sentence to generate information based on the user's interests and concerns.

[1434] A "generative AI model" is an artificial intelligence model that generates information based on a prompt sentence, for example using natural language processing technology.

[1435] "Means for sending" refers to a communication means for sending the generated prompt sentence to the generative AI model.

[1436] A “means for receiving a response” is a process for receiving generated information from a generative AI model.

[1437] "Means for output" refers to an interface for displaying information received from the generative AI model to the user.

[1438] "Means for displaying advertisements" refers to the process for adding advertisements to the generated information and displaying them to the user.

[1439] This invention is a system that inputs information that a user is interested in and provides related information using a generative AI model based on that information. A specific embodiment of this system will be described below.

[1440] First, the user accesses the system's input screen using a web browser. This input screen is built using HTML, CSS, and JavaScript (registered trademark), and includes text boxes and a file upload function for users to enter information about their interests.

[1441] When a user enters information such as "rock music," "guitar," and "live concert" into the input screen, the server receives the information and stores it in a MySQL database. The server uses a PHP script to process the data submitted by the user and store it in the database.

[1442] Next, the server analyzes the information stored in the database and generates a prompt based on the user's interests. For example, if the user enters information such as "rock music," "guitar," and "live concerts," the server generates a prompt that reads, "The user is interested in rock music. Please provide the latest news and event information related to rock music."

[1443] The generated prompt sentence is sent by the server to a generative AI model (e.g., a model using natural language processing technology). The server uses an API to send the prompt sentence to the generative AI model. The generative AI model generates information related to the user's interests and concerns based on the received prompt sentence. For example, it generates information such as "Latest rock music news: A famous rock band has released a new album. The next live concert will be held next month."

[1444] The server displays the information received from the generative AI model to the user. Specifically, the server uses HTML templates to display the generated information in the user's browser, allowing the user to obtain the latest information based on their own interests.

[1445] The system further includes a means for placing advertisements in the generated information. The server adds advertisements related to the generated information and displays them to the user, thereby earning advertising revenue.

[1446] Examples of prompts include:

[1447] "Your users are interested in movies. Give them the latest movie-related news and reviews."

[1448] In this way, this invention makes it possible to efficiently generate and provide information based on the user's interests. It also makes it possible to predict and provide information that the user may be interested in in the future. Furthermore, it also makes it possible to effectively place advertisements in the generated information.

[1449] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1450] Step 1:

[1451] The user accesses the input screen.

[1452] The user accesses the system's input screen using a web browser. This input screen is built using HTML, CSS, and JavaScript (registered trademark), and includes text boxes and file upload functions for the user to enter information of their interest. By accessing the input screen, the user is ready to enter information.

[1453] Step 2:

[1454] The user enters information about their interests.

[1455] The user inputs information about his / her interests (e.g., music, movies, travel, etc.) using the text boxes and file upload function displayed on the input screen. The user can input multiple photos and text. The input information is sent to the server as data reflecting the user's interests.

[1456] Step 3:

[1457] The server receives the entered information and stores it in a database.

[1458] The server receives the information entered by the user and stores it in a MySQL database. Specifically, the server uses a PHP script to process the data submitted by the user and store it in the database. The input data is stored in the database as information indicating the user's interests.

[1459] Step 4:

[1460] The server parses the stored information and generates a prompt.

[1461] The server analyzes the information stored in the database and generates a prompt based on the user's interests. For example, if the user inputs information such as "rock music," "guitar," and "live concerts," the server generates a prompt that reads, "The user is interested in rock music. Please provide the latest news and event information related to rock music." Analysis and generation of the prompt are performed based on the user's input data.

[1462] Step 5:

[1463] The server sends the generated prompt to the generative AI model.

[1464] The server sends the generated prompt text to the generative AI model. The server uses an API to send the prompt text to the generative AI model. The prompt text serves as an instruction text for the generative AI model to generate information related to the user's interests and concerns.

[1465] Step 6:

[1466] A generative AI model generates information based on the prompt.

[1467] The generative AI model generates information related to the user's interests based on the received prompt sentence. For example, it generates information such as "Latest rock music news: A famous rock band has released a new album. The next live concert will be held next month." The generative AI model takes the prompt sentence as input and outputs related information.

[1468] Step 7:

[1469] The server receives the generated information and displays it to the user.

[1470] The server displays the information received from the generative AI model to the user. Specifically, the server uses an HTML template to display the generated information in the user's browser. This allows the user to obtain the latest information based on their own interests. The generated information is output to the user's browser.

[1471] Step 8:

[1472] The server places advertisements in the generated information.

[1473] The server adds advertisements related to the generated information and displays them to the user. By displaying the advertisements together with the generated information, advertising revenues related to the user's interests can be earned. Advertisements are displayed based on the generated information.

[1474] (Application example 1)

[1475] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1476] Conventional content recommendation systems have had difficulty effectively providing personalized content based on the user's interests. In addition, they lacked the means to generate prompts based on the information entered by the user and to recommend appropriate content using those prompts, which made it difficult to increase user satisfaction.

[1477] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1478] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for generating a prompt sentence based on the information input by the user, and a means for recommending content using the generated prompt sentence, thereby enabling personalized content recommendation based on the user's interests.

[1479] "User" means an individual or organization that uses the System.

[1480] "Information of interest" is information related to a particular genre or theme in which a user has an interest.

[1481] The "means of input" refers to an interface that allows a user to provide information of interest or concern to the system.

[1482] "Artificial intelligence means" means algorithms or models that analyze information entered by a User and generate information that may be of interest to the User in the future.

[1483] The "means for outputting" is an interface for providing the generated information to the user.

[1484] A "prompt sentence" is an instruction sentence for recommending content that is generated based on information entered by the user.

[1485] A "content recommendation means" is an algorithm or system that uses generated prompts to select and provide content appropriate to the user.

[1486] A system for implementing this invention includes a means for inputting information that a user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for generating a prompt sentence based on the information input by the user, and a means for recommending content using the generated prompt sentence.

[1487] Explanation of system program processing

[1488] Hardware and Software

[1489] Hardware: Smartphones, servers

[1490] Software: Python, OpenAI API

[1491] Data processing and calculation

[1492] 1. Obtaining user input: The user uses his / her smartphone to input information about his / her interests (e.g., travel, beach photos, adventure movies, etc.) The input information is sent to the server.

[1493] 2. Prompt generation: The server generates a prompt based on the information entered by the user. For example, if the user enters "travel", "beach pictures", and "adventure movies", the generated prompt will look like this:

[1494] Recommend content based on your users' interests.

[1495] trip

[1496] Beach Photos

[1497] Adventure movies

[1498] 3. Content recommendation: The server sends the generated prompt to the OpenAI API to recommend appropriate content. OpenAI's generative AI model generates content such as movies, music, and articles that are suitable for the user based on the prompt.

[1499] 4. Output of recommended content: The server sends the generated content to the smartphone and displays it to the user. For example, if the user inputs "travel", "beach photos", and "adventure movies", the recommended content will be as follows:

[1500] Movie: "Into the Wild"

[1501] Music: "The Beach Boys Album"

[1502] Article: "The 10 most beautiful beaches in the world"

[1503] In this way, personalized content recommendations based on the user's interests are possible.

[1504] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1505] Step 1:

[1506] Enter information about the user's interests.

[1507] A user uses a smartphone to input information about his / her interests (e.g., travel, beach photos, adventure movies, etc.) The input information is sent from the smartphone to the server.

[1508] Input: Information entered by the user (e.g. travel, beach photos, adventure movies)

[1509] Output: User input sent to the server

[1510] Step 2:

[1511] The server receives the user's input and generates a prompt.

[1512] The server generates a prompt based on the information the user enters. For example, if the user enters "travel," "beach pictures," and "adventure movies," the generated prompt might look like this:

[1513] Recommend content based on your users' interests.

[1514] trip

[1515] Beach Photos

[1516] Adventure movies

[1517] Input: User input information

[1518] Output: The generated prompt statement

[1519] Step 3:

[1520] The server recommends content using generated prompts.

[1521] The server sends the generated prompt text to the OpenAI API, which then recommends appropriate content. OpenAI's generative AI model generates content such as movies, music, and articles that are suitable for the user based on the prompt text.

[1522] Input: Generated prompt text

[1523] Output: Recommended content

[1524] Step 4:

[1525] The server outputs the recommended content to the user.

[1526] The server sends the generated content to the smartphone and displays it to the user. For example, if the user inputs "travel," "beach photos," and "adventure movies," the recommended content will be as follows:

[1527] Movie: "Into the Wild"

[1528] Music: "The Beach Boys Album"

[1529] Article: "The 10 most beautiful beaches in the world"

[1530] Input: Recommended content

[1531] Output: The content displayed on the user's smartphone

[1532] Example 2

[1533] Next, a second embodiment of the second form will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1534] Conventional information provision systems have had difficulty effectively generating information that users may be interested in in the future. In addition, when generating new information based on information entered by the user, appropriate analysis and generation were often not performed. As a result, useful information for users was not provided, resulting in a poor user experience.

[1535] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1536] In this invention, the server includes a means for inputting information that the user is interested in, a means for transmitting the input information to the server, a means for the server to analyze the input information, a means for the server to input a prompt sentence to the generative AI model based on the analysis result, a means for the generative AI model to generate new information, a means for transmitting the generated information from the server to the terminal, and a means for outputting the generated information to the user. This makes it possible to effectively generate information that the user may be interested in in the future and provide information that is useful to the user.

[1537] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[1538] "Means of input" refers to the interface or device that allows a user to input information of interest or concern into the system.

[1539] "Means of transmission" refers to the communications protocol and network infrastructure used to transmit the information entered by the user to the server.

[1540] A "server" is a computer system that receives and analyzes information sent by a user and inputs prompt sentences into the generative AI model.

[1541] "Means of analysis" refers to the process by which the server analyzes the information received from the user using natural language processing technology, etc.

[1542] A "generative AI model" is an artificial intelligence model that generates new information based on an input prompt sentence.

[1543] A "prompt" is a textual instruction that is input to a generative AI model.

[1544] The "means of generation" refers to the process by which the generative AI model generates new information based on the prompt sentence.

[1545] The "means for transmitting" refers to the communication protocol and network infrastructure that the server uses to transmit the generated information to the terminal.

[1546] "Output means" refers to an interface or device that allows the terminal to display the generated information to the user.

[1547] A "terminal" is a device, such as a computer or smartphone, that a user uses to input information and receive generated information.

[1548] The present invention relates to a system for generating information that a user may be interested in in the future. A specific embodiment of this system will be described below.

[1549] First, the user uses a terminal to input information about their interests. Terminals include devices such as computers, smartphones, and tablets. The information input by the user is, for example, the music genre "rock."

[1550] The device then transmits the input information to a server using a communications protocol such as an HTTP request. The server has hardware and software to analyze the information it receives. In particular, it uses natural language processing techniques to analyze the input information. Analysis includes text tokenization and semantic analysis.

[1551] The server inputs a prompt sentence into the generative AI model based on the analysis results. For example, OpenAI's GPT-4 is used as the generative AI model. An example of a prompt sentence is "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet."

[1552] The generative AI model generates new information based on the prompt text. This information includes information about new rock bands and artists that the user does not yet know. The generated information is sent from the server to the device. This transmission also uses a communication protocol such as HTTP response.

[1553] Finally, the device displays the generated information to the user, who can then review the information and learn about new rock bands and artists.

[1554] As a specific example, if a user enters the keyword "rock", the device sends this information to the server via an HTTP request. The server analyzes the received keyword "rock" using natural language processing technology and creates a prompt sentence to be input into the generative AI model. For example, it generates a prompt sentence such as "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet." The generative AI model (GPT-4) generates information about new rock bands and artists based on this prompt sentence. The server sends the generated information to the device via an HTTP response. The device displays the received information to the user, allowing the user to learn about new rock bands and artists.

[1555] In this way, the present invention can effectively generate information that may be of interest to the user in the future and provide the user with useful information.

[1556] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1557] Step 1:

[1558] The user enters information

[1559] A user uses a terminal to input information about his / her interests. For example, if a user is interested in the music genre "rock," the user inputs "rock." The input information is obtained through an input interface of the terminal.

[1560] Step 2:

[1561] The device sends the input information to the server

[1562] The terminal transmits the information input by the user to the server. This transmission uses a communication protocol such as an HTTP request. The input information (e.g., "lock") is transmitted to the server as the payload of the HTTP request.

[1563] Step 3:

[1564] The server parses the input

[1565] The server analyzes the received input information. This analysis uses natural language processing techniques. Specifically, it performs text tokenization and semantic analysis. The input information (e.g. "lock") is analyzed, and related keywords and context are extracted.

[1566] Step 4:

[1567] The server inputs a prompt to the generative AI model.

[1568] The server creates a prompt sentence to be input to the generative AI model based on the analysis results. For example, it generates a prompt sentence such as "The user is interested in rock music. Please suggest some new rock bands and artists that the user does not know yet." The generated prompt sentence is input to the generative AI model.

[1569] Step 5:

[1570] Generative AI models generate new information

[1571] A generative AI model (e.g., GPT-4) generates new information based on the prompt received from the server. This information includes information about new rock bands and artists that the user does not yet know. The generative AI model analyzes the prompt and generates related new information.

[1572] Step 6:

[1573] The server sends the generated information to the terminal.

[1574] The server sends the new information obtained from the generative AI model to the terminal. This transmission also uses a communication protocol such as an HTTP response. The generated information (e.g., information on a new rock band or artist) is sent to the terminal as the payload of the HTTP response.

[1575] Step 7:

[1576] The terminal displays the generated information to the user.

[1577] The terminal displays the new information received from the server to the user. The user can check the displayed information and learn about new rock bands and artists. The generated information is visually presented to the user through the display interface of the terminal.

[1578] (Application example 2)

[1579] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1580] Conventional content recommendation systems have the problem that it is difficult to effectively recommend new content based on information entered by the user. It is also difficult to accurately predict the user's interests and provide information that may be of interest to the user in the future. Furthermore, there is a lack of means to appropriately present the generated information to the user.

[1581] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1582] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for recommending new content based on the information input by the user, and a means for displaying the generated recommendation results. This makes it possible to accurately predict the user's interests, effectively recommend new content that the user may be interested in in the future, and appropriately present the content to the user.

[1583] "Means for users to input information that interests them" refers to an interface that enables users to input information that interests them into the system.

[1584] "AI means for generating information that the user may be interested in in the future based on the input information" refers to artificial intelligence technology that analyzes information input by the user and generates new information that the user may be interested in in the future based on that information.

[1585] "Means for outputting the generated information to the user" refers to an interface for presenting the information generated by the AI ​​means to the user.

[1586] "Means for recommending new content based on information entered by a user" refers to technology for selecting and recommending new content that may be of interest to a user based on information entered by the user.

[1587] The "means for displaying the generated recommendation results" is an interface for visually presenting the recommended new content to the user.

[1588] A system for implementing this invention includes means for inputting information that a user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for outputting the generated information to the user, means for recommending new content based on the information input by the user, and means for displaying the generated recommendation results.

[1589] System Programming

[1590] The program of this system operates as follows.

[1591] 1. Obtaining user input: A user enters information about their interests (e.g., music genre or artist name) through a smartphone application.

[1592] 2. Prompt generation: The server generates a prompt sentence to be passed to the generative AI model based on the information entered by the user.

[1593] 3. Invoke the AI ​​model: The server passes the prompt to a generative AI model (e.g., GPT-3) using OpenAI’s API to generate new content recommendations.

[1594] 4. Displaying recommendation results: The server displays the generated recommendation results to the user through the smartphone application.

[1595] Hardware and Software Used

[1596] Hardware: Smartphones, servers

[1597] Software: Python, OpenAI API

[1598] Examples

[1599] When a user uses a smartphone application to input the music genre "rock", the following prompt is generated:

[1600] Examples of prompt statements

[1601] Recommend new music content that may interest users. Genre: Rock

[1602] The server passes this prompt to the OpenAI API and receives recommendations for new rock bands and artists from the generative AI model. For example, recommendations such as "New rock band 'The New Waves'" or "Artist 'Rocky Road'" are generated.

[1603] The generated recommendation results are displayed to users through a smartphone application, allowing users to discover new music content based on their own interests.

[1604] In this way, it is possible to accurately predict a user's interests and effectively recommend new content that may be of interest to the user in the future, and present it appropriately to the user.

[1605] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1606] Step 1:

[1607] A user uses a smartphone application to input information about his or her interests (e.g., music genres and artist names).

[1608] Input: Information entered by the user (e.g. "lock")

[1609] Output: User input information is sent to the server

[1610] Step 2:

[1611] The server receives the information entered by the user and generates a prompt sentence based on that information to pass to the generative AI model.

[1612] Input: User input information (e.g. "lock")

[1613] Data processing: Converting user input information into prompt text

[1614] Output: Prompt (e.g. "Recommend new music content that may interest the user. Genre: Rock")

[1615] Step 3:

[1616] The server passes the generated prompt text to OpenAI's API, which then invokes a generative AI model (e.g., GPT-3) to generate new content recommendations.

[1617] Input: prompt statement

[1618] Data calculation: Using OpenAI's API, we pass the prompt sentence to the generative AI model and generate recommendation results.

[1619] Output: Recommendation results (e.g. "New rock band 'The New Waves'" or "Artist 'Rocky Road'")

[1620] Step 4:

[1621] The server transmits the generated recommendation results to the smartphone application.

[1622] Input: Recommendation results

[1623] Output: Recommendation results are sent to a smartphone application.

[1624] Step 5:

[1625] The smartphone application displays the received recommendation results to the user.

[1626] Input: Recommendation results

[1627] Output: The recommendations are visually displayed to the user.

[1628] In this way, users can discover new music content based on their own interests.

[1629] Example 3

[1630] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1631] Conventional information provision systems have difficulty in providing users with appropriate information that interests them, and they have also been unable to effectively display advertisements based on the user's interests. This has resulted in a poor user experience, and advertisers have also been unable to deliver advertisements effectively.

[1632] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1633] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, a means for placing advertisements in the generated information, and a means for selecting and displaying advertisements based on the user's interests. This allows the user to simultaneously obtain information and advertisements that match his or her interests.

[1634] "User" means an individual or organization that uses the system to input information and view generated information and advertisements.

[1635] "Information of interest" is information about which a user is interested and wants to know more.

[1636] An "input means" is an interface through which a user inputs information into the system, and includes input devices such as a keyboard or a touch screen.

[1637] "Artificial intelligence means" refers to algorithms or models that generate information that may be of interest to a User in the future, based on information input by a User.

[1638] "Generate" means to create new information based on input information.

[1639] The "means for outputting" refers to an interface for displaying the generated information to the user, and includes, for example, a display device such as a display or a web browser.

[1640] "Means for displaying advertisements" refers to a function for displaying advertisements related to the generated information.

[1641] "Means of selecting and displaying" refers to the function of selecting appropriate advertisements based on the user's interests and showing them to the user.

[1642] "Specialized Output Screen" means a screen specifically designed to display generated information and advertising.

[1643] This invention is a system in which a user inputs information that interests them and provides the user with information generated based on that information. Furthermore, by displaying advertisements related to the generated information, it is possible to provide advertisements that match the user's interests.

[1644] The server uses a generative AI model to generate information based on the user's input. The generative AI model uses an advanced natural language processing model such as GPT-4. The server receives the prompt sentence entered by the user and inputs it into the generative AI model. The generative AI model generates relevant information based on the prompt sentence and returns the information to the server.

[1645] The terminal receives the generated information sent from the server and displays it on a dedicated output screen. This output screen is constructed using web technologies such as HTML, CSS, and JavaScript (registered trademark). The terminal provides an interface for visually presenting the generated information to the user.

[1646] The user can access the dedicated output screen through the terminal and view the generated information. For example, if the user inputs the prompt sentence "Tell me about the latest technology trends," the server uses the generative AI model to generate related information and transmits the information to the terminal. The terminal displays the generated information on the dedicated output screen, and the user can view the information.

[1647] In addition, the server selects advertisements based on the user's interests and sends them to the device. The device displays the received advertisements on a dedicated output screen. For example, an advertisement about the latest gadgets might be displayed. This allows the user to simultaneously obtain information and advertisements that match their interests.

[1648] As a specific example, if a user enters the prompt sentence "Tell me about the latest technology trends," the server uses a generative AI model (GPT-4) to generate information such as "The notable technology trend in 2023 is the fusion of AI and IoT." This information is displayed on a dedicated output screen on the device. In addition, related ads for the latest AI devices are displayed.

[1649] Example prompt:

[1650] "Tell me about the latest technology trends."

[1651] "I want to know the latest information on the evolution of AI."

[1652] "What startups should we look out for in 2023?"

[1653] In this way, the user can simultaneously obtain information and advertisements that match his / her interests. The flow of the specification process in the third embodiment will be described with reference to FIG.

[1654] Step 1:

[1655] The user enters a prompt.

[1656] The user inputs a prompt sentence into an input field of the terminal. For example, the user inputs "Tell me about the latest technology trends." The input prompt sentence is temporarily stored in the memory of the terminal.

[1657] Step 2:

[1658] The terminal sends a prompt to the server.

[1659] The terminal sends the prompt text entered by the user to the server as an HTTP POST request. This request includes the prompt text. The terminal uses a network interface to send the prompt text to the server.

[1660] Step 3:

[1661] The server generates information using the generative AI model

[1662] The server inputs the received prompt sentence into a generative AI model (e.g., GPT-4) to generate relevant information. The generative AI model analyzes the prompt sentence and performs data processing and data calculation to generate relevant information. The generated information is stored in the server's memory.

[1663] Step 4:

[1664] The server sends the generated information to the terminal.

[1665] The server transmits the generated information to the terminal as an HTTP response. The response includes the generated information. The server uses a network interface to transmit the generated information to the terminal.

[1666] Step 5:

[1667] The terminal displays the generated information on a dedicated output screen.

[1668] The terminal displays the received information on a dedicated output screen. This output screen is constructed using HTML, CSS, and JavaScript (registered trademark). To visually display the generated information, the terminal dynamically generates HTML elements and adds them to the screen.

[1669] Step 6:

[1670] The server selects advertisements based on the user's interests and sends them to the device.

[1671] The server analyzes the user's prompt text and past browsing history to select highly relevant advertisements. The selected advertisements are sent to the terminal as an HTTP response. The server refers to a database to select advertisements and chooses appropriate advertisements.

[1672] Step 7:

[1673] The device displays the advertisement on a dedicated output screen

[1674] The device displays the received advertisements on a dedicated output screen. The device dynamically generates HTML elements and adds them to the screen to visually display the advertisements. For example, an advertisement banner is displayed on the latest AI devices.

[1675] Step 8:

[1676] View user generated information and advertisements

[1677] The user can view the generated information and advertisements through a dedicated output screen on the device, allowing the user to simultaneously obtain information and advertisements that match their interests.

[1678] (Application example 3)

[1679] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1680] Conventional information provision systems have difficulty in providing users with information that interests them appropriately, and lack the means to effectively display advertisements related to their interests. For these reasons, improving the user experience and maximizing the effectiveness of advertisements have become issues.

[1681] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1682] In this invention, the server includes a means for inputting information that the user is interested in, an artificial intelligence means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, and a means for acquiring and displaying advertisements related to the generated information, thereby making it possible to effectively provide information and advertisements according to the user's interests.

[1683] "User" means an individual or organization that uses the system to input information and view generated information and advertisements.

[1684] "Information of interest" is information that users are interested in and want to know about.

[1685] "Means of input" refers to the interface or device that allows a user to input information of interest or concern into the system.

[1686] "Artificial intelligence means" refers to algorithms or models that generate information that may be of interest to a User in the future, based on information entered by the User.

[1687] "Generated Information" means information generated by artificial intelligence means that may be of future interest to a User.

[1688] "Output means" refers to an interface or device for displaying the generated information to the user.

[1689] "Means for acquiring and displaying advertisements" refers to an algorithm or system for acquiring advertisements related to the generated information and displaying them to users.

[1690] The following system configuration will be described as an embodiment of the present invention.

[1691] System Configuration

[1692] The system consists of a user terminal, a server, and an ad serving system. The user terminal is a device such as a smartphone or PC, and provides an interface for users to input information and view generated information and advertisements. The server uses a generative AI model to generate information that users may be interested in in the future, and is responsible for obtaining related advertisements from the ad serving system and sending them to the user terminal.

[1693] Hardware and software used

[1694] Hardware: Smartphones, PCs, servers

[1695] Software: Python, OpenAI API, Tkinter (GUI library)

[1696] Data processing and calculation

[1697] 1. User terminal: The user inputs information that interests them through the interface on the terminal. For example, they input a prompt such as, "Please tell me about the latest technology trends."

[1698] 2. Server: The server receives the prompt text sent by the user and sends it to the generative AI model (e.g. text-davinci-003) using the OpenAI API. The generative AI model generates information that the user may be interested in in the future based on the prompt text.

[1699] 3. Advertisement provision system: Based on the generated information, relevant advertisements are obtained. For example, if the generated information is about the "latest technology," advertisements for the latest smartphones are obtained.

[1700] 4. Server: The server sends the generated information and related advertisements to the user terminal.

[1701] 5. User terminal: The user terminal displays the received information and advertisements.

[1702] Examples

[1703] When a user inputs the prompt sentence "Tell me about the latest technology trends," the server uses a generative AI model to generate information about the latest technology. Based on the generated information, it retrieves advertisements for the latest smartphones from the advertisement serving system and sends them to the user's terminal. The user's terminal displays the generated information and advertisements.

[1704] Examples of prompt statements

[1705] "Tell me about the latest technology trends."

[1706] "What are the latest research findings on health?"

[1707] "What travel destinations would you recommend?"

[1708] In this way, it becomes possible to effectively provide information and advertisements that match the user's interests.

[1709] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1710] Step 1:

[1711] The user inputs information that interests them through the interface on the terminal. For example, they input a prompt such as, "Tell me about the latest technology trends." The input prompt is sent from the terminal to the server.

[1712] Input: The prompt text entered by the user.

[1713] Output: The prompt sent to the server.

[1714] Step 2:

[1715] The server receives the prompt text sent by the user. Based on the received prompt text, the server sends the prompt text to a generative AI model (e.g., text-davinci-003) using the OpenAI API. The generative AI model generates information that the user may be interested in in the future based on the prompt text.

[1716] Input: The prompt text sent by the user

[1717] Output: The information generated by the generative AI model

[1718] Step 3:

[1719] The server receives the information generated from the generative AI model. Then, based on the generated information, the server sends a request to obtain an advertisement related to the generated information to the advertisement serving system. The advertisement serving system returns the advertisement related to the generated information to the server.

[1720] Input: Information generated by a generative AI model

[1721] Output: Relevant ads retrieved from the ad serving system

[1722] Step 4:

[1723] The server transmits the generated information and associated advertisements to the user terminal, and the user terminal displays the received information and advertisements.

[1724] Input: Generated information and related ads

[1725] Output: Information and advertisements displayed on the user's device

[1726] Step 5:

[1727] The user views the information and advertisements displayed on the device, allowing the user to simultaneously obtain information and advertisements that match their interests.

[1728] Input: Information and advertisements displayed on the user's device

[1729] Output: User consumes information and ads through browsing

[1730] In addition, an emotion engine that estimates the emotion of the user may be further combined. That is, the identification processing unit 290 may estimate the emotion of the user using the emotion identification model 59, and perform identification processing using the emotion of the user.

[1731] "Example 1"

[1732] As one embodiment of the present invention, a system including an emotion engine that recognizes the emotions of a user is provided. This system includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, and a means for outputting the generated information to the user. Specifically, the user inputs a photo of "rock," which is the user's favorite music genre, and keywords related to that genre. "Example 2"

[1733] The emotion engine recognizes the user's emotional state and generates information that may be of future interest to the user based on that emotional state. For example, if the user is expressing an emotion of joy, the emotion engine generates information related to that emotion of joy. This can provide information on new music genres and artists that the user may find enjoyable.

[1734] "Example 3"

[1735] Further included is a means for placing an advertisement in the generated information. The emotion engine selects an advertisement based on the emotional state of the user and places the advertisement in the generated information. For example, if the user indicates an emotion of joy, the emotion engine selects an advertisement related to the emotion of joy. This makes it possible to provide advertisements for products or services that the user is likely to feel joyful about.

[1736] The process flow of each embodiment will be described below.

[1737] "Example 1"

[1738] Step 1: The user enters information about their interests into the system. For example, they enter a photo of their favorite music genre, "rock," along with keywords related to that genre.

[1739] Step 2: The system analyzes the input information and determines the user's current interests.

[1740] Step 3: The emotion engine recognizes the user's emotional state.

[1741] "Example 2"

[1742] Step 1: The emotion engine generates information that may be of future interest to the user based on their emotional state.

[1743] Step 2: For example, if the user indicates an emotion of happiness, the emotion engine generates information related to the emotion of happiness.

[1744] Step 3: This allows us to provide information about new music genres and artists that users may enjoy.

[1745] "Example 3"

[1746] Step 1: This also includes a means of placing advertisements on the generated information.

[1747] Step 2: The emotion engine selects advertisements based on the user's emotional state and places the advertisements in the generated information.

[1748] Step 3: For example, if the user is expressing an emotion of joy, the emotion engine will select ads related to that emotion of joy, allowing it to serve ads for products and services that the user is likely to find joyful.

[1749] Example 1

[1750] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1751] Conventional information provision systems have difficulty in providing information based on the user's interests and cannot predict information that the user may be interested in in the future. In addition, since information provision does not take into account the user's emotions, it is not possible to increase user satisfaction. This has led to a demand for improving the accuracy of information provision according to the user's interests and concerns.

[1752] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1753] In this invention, the server includes a means for inputting information that the user is interested in, a means for receiving the input information, a means for recognizing the user's emotions based on the input information, a means for using a generative AI model for generating information that the user may be interested in in the future based on the emotion recognition result and the input information, and a means for outputting the generated information to the user. This makes it possible to provide information that the user may be interested in in the future with high accuracy, taking into account the user's emotions.

[1754] "User" means an individual or entity that utilizes the System to input information and receive generated information.

[1755] "Input means" refers to an interface that allows users to input information that interests them into the system. Specifically, this includes web browsers and mobile applications.

[1756] "Means for receiving" refers to a function by which the server receives information input by the user. This includes the process of receiving data via network communication.

[1757] "Emotion recognition means" refers to a function for analyzing and recognizing a user's emotions based on information input by the user. Specifically, this refers to emotion recognition software or algorithms.

[1758] A "generative AI model" is an artificial intelligence model that generates information that a user may be interested in in the future based on user input information and emotion recognition results. Specifically, this applies to natural language processing models and machine learning algorithms.

[1759] "Output means" refers to a function for providing the generated information to the user. This includes a process for displaying the information on the user's terminal.

[1760] The "advertising means" is a function for adding advertisements to the generated information and providing it to users, thereby generating profits for the system.

[1761] This invention is a system that inputs information that a user is interested in, generates information that the user may be interested in in the future based on that information, and provides the information to the user. A specific embodiment of this system will be described below.

[1762] First, the user accesses a dedicated input screen. This input screen is provided through a web browser or a mobile application. The user enters photos and text of their interests into the input screen. For example, if the user is interested in "rock" music, they enter a photo of a rock band and keywords such as "guitar" and "live."

[1763] Next, the server receives the information entered by the user. This information is sent to the server as photo data or text data. The server passes the received information to emotion recognition software (e.g., "EmotionAPI") to analyze the user's emotions. The emotion recognition software recognizes the user's emotional state (e.g., joy, excitement, interest, etc.) from the photo or text.

[1764] The server then uses a generative AI model (such as GPT-4) to generate information that the user may be interested in in the future. The generative AI model processes and calculates data based on the information entered by the user and the emotion recognition results. Specifically, it generates information on new rock bands and live events that the user may be interested in.

[1765] Finally, the server transmits the generated information to the user's terminal, where the user can check the information of new rock bands and live events.

[1766] As a concrete example, consider a case where a user is interested in "rock" music. The user enters a photo of "rock" and keywords such as "guitar" and "live" into the input screen. The server receives this information and stores the photo data and text data. The server then calls the Emotion API to analyze the user's emotions from the photo and text. For example, it recognizes from the photo that the user is excited. The server uses GPT-4 to generate information about new rock bands and live events that the user may be interested in. For example, it generates "new rock band album release information" and "details of live events taking place nearby." The server sends the generated information to the user's device, and the user checks the information in a web browser.

[1767] Example prompt:

[1768] "Generate information about rock bands and live events that may be of interest to the user in the future based on the information entered by the user. The input information is as follows: photo (live photo of rock band), keywords (guitar, live)."

[1769] In this way, users can easily access information based on their interests.

[1770] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1771] Step 1:

[1772] The user accesses the input screen.

[1773] Users access a dedicated input screen through a web browser or mobile application. The input screen provides an interface for users to input information about their interests.

[1774] Step 2:

[1775] The user enters information about their interests.

[1776] The user inputs photos and text of their interests into the input screen. For example, if the user is interested in "rock" music, they input photos of rock bands and keywords such as "guitar" and "live." The input data is sent to the server as photo data and text data.

[1777] Step 3:

[1778] The server receives the input information.

[1779] The server receives the photo data and text data entered by the user and stores the received data in a database within the server.

[1780] Step 4:

[1781] The server recognizes the user's emotion using the emotion recognition means.

[1782] The server passes the received photo and text data to emotion recognition software (e.g., "EmotionAPI") to analyze the user's emotions. The emotion recognition software recognizes the user's emotional state (e.g., joy, excitement, interest, etc.) from the photo and text. The input is photo data and text data, and the output is the emotion recognition result.

[1783] Step 5:

[1784] The server uses a generative AI model to generate information that may be of interest in the future.

[1785] The server generates new information using a generative AI model (e.g., GPT-4) based on the emotion recognition results and the information entered by the user. The generative AI model generates information about rock bands and live events that the user may be interested in in the future. The inputs are the emotion recognition results and the user's input information, and the output is the generated information.

[1786] Step 6:

[1787] The server outputs the generated information to the user.

[1788] The server sends the generated information to the user's terminal. The user can check the information of new rock bands and live events on his / her terminal. The input is the generated information, and the output is the information displayed on the user's terminal.

[1789] As a concrete example, consider a case where a user is interested in "rock" music. The user enters a photo of "rock" and keywords such as "guitar" and "live" into the input screen. The server receives this information and stores the photo data and text data. The server then calls the Emotion API to analyze the user's emotions from the photo and text. For example, it recognizes from the photo that the user is excited. The server uses GPT-4 to generate information about new rock bands and live events that the user may be interested in. For example, it generates "new rock band album release information" and "details of live events taking place nearby." The server sends the generated information to the user's device, and the user checks the information in a web browser.

[1790] (Application example 1)

[1791] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1792] Conventional content delivery services have been insufficient in providing information based on users' interests and concerns, and it has been difficult to provide personalized content that takes users' emotions into account. In addition, it is difficult to predict information that users may be interested in in the future, so there has been a demand for improving the user experience.

[1793] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1794] In this invention, the server includes a means for inputting information that the user is interested in, an AI means for generating information that the user may be interested in in the future based on the input information, a means for outputting the generated information to the user, an emotion engine for recognizing the user's emotions, a means for generating a prompt sentence using a generative AI model based on the emotion information recognized by the emotion engine, and a means for generating related content based on the generated prompt sentence. This makes it possible to provide personalized content that takes the user's emotions into consideration, improving the user experience.

[1795] "Means for users to input information that interests them" refers to an interface that allows users to input information that interests them.

[1796] "AI Means" refers to the function of artificial intelligence that generates information that may be of future interest to the user based on input information.

[1797] The "means for outputting the generated information to the user" refers to an interface for providing the generated information to the user.

[1798] An "emotion engine" is a system for recognizing a user's emotions.

[1799] A "generative AI model" is an artificial intelligence model for generating prompt sentences based on user input information and emotional information.

[1800] The "means for generating a prompt sentence" is a function for generating a prompt sentence based on emotion information recognized by the emotion engine.

[1801] The "means for generating relevant content" is a function for generating content relevant to the user based on the generated prompt sentence.

[1802] A system for implementing this invention includes means for inputting information that a user is interested in, AI means for generating information that the user may be interested in in the future based on the input information, means for outputting the generated information to the user, an emotion engine for recognizing the user's emotions, means for generating a prompt sentence using a generative AI model based on the emotion information recognized by the emotion engine, and means for generating related content based on the generated prompt sentence.

[1803] System Configuration

[1804] 1. How users can enter their interests:

[1805] A user uses a smartphone application to input information about their interests (e.g., music genres or movie titles). The input interface includes text boxes and an image upload function.

[1806] 2. Emotion Engine:

[1807] The emotion engine recognizes emotions from images and text uploaded by users. Specifically, it uses an image processing library (e.g., OpenCV) and an emotion recognition model (e.g., a deep learning model using Keras).

[1808] 3. Generative AI model:

[1809] The generative AI model generates prompts based on the user's input and emotional information. The generative AI model uses a natural language processing library (e.g., Transformers) and utilizes a pre-trained model (e.g., GPT-3).

[1810] 4. How to generate a prompt:

[1811] Based on the emotion information recognized by the emotion engine, a generative AI model is used to generate prompt sentences. For example, if a user is interested in "rock music" and emotion recognition detects the emotion of "joy," the following prompt sentence is generated:

[1812] Your users are interested in rock music and the emotion is joy, so generate relevant content.

[1813] 5. How to generate relevant content:

[1814] Based on the generated prompt sentences, relevant content (e.g., music playlists, movie recommendations, articles, etc.) is generated. The generated content is displayed in the user's smartphone application.

[1815] Examples

[1816] A user opens the smartphone application, uploads a photo of "rock music" that interests them, and inputs related keywords (e.g., "rock, music, concert"). The emotion engine recognizes the emotion of "joy" from the photo, and the generative AI model generates the following prompt sentence:

[1817] Your users are interested in rock music and the emotion is joy, so generate relevant content.

[1818] Based on this prompt, the generative AI model generates rock music-related articles, playlist...

Claims

1. A means for accepting input information of interests and concerns input by a user; means for analyzing the input information and generating a prompt sentence instructing the generation of new information that may be of interest and concern to the user in the future; means for generating the new information using a generative AI model based on the generated prompt sentence; means for outputting said new information to said user; A system including:

2. means for recognizing an emotion of the user using an emotion engine based on the input information; generating the new information using the generative AI model based on the user's sentiment and the prompt sentence; The system of claim 1 .

3. means for generating an advertisement based on the generated new information; A system according to claim 1 or claim 2.

Citation Information

Patent Citations

  • Deep Deformation Networks for Object Landmark Detection

    JP2019507935A

  • Information processing device and information processing program

    JP2020087224A

  • Method, system, and computer program for personalized recommendation based on topic of interest

    JP2023108590A

  • Commodity recommendation method and system

    JP2023129333A

  • Text generation device and text generation method

    JP7325152B1