system

Abstract

To provide a system.SOLUTION: A system includes: means for collecting data such as posted contents, a purchase history, and a browsing history of a user; means for analyzing the collected data using a natural language processing technique or a machine learning technique, extracting a principle, thought, taste of the user, and learning; means for recognizing feeling from the posted contents and action of the user; means for generating AI capable of interaction close to personality of the user on the basis of a learning result of the principle, thought, taste of the user and a recognition result of the feeling of the user; and means for an automatic message response of SNS and a response corresponding to a relationship using the generative AI.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Current AI can only respond in general ways, making it difficult to create personalized dialogue that reflects each user's principles, thoughts, and hobbies. There is also a demand for more advanced communication, such as automated message responses on social media, relationships-based responses, and AI-based celebrity official accounts. Furthermore, there are hopes for AI to be used as a next-generation communication tool, turning it into an avatar and enabling customization using NFTs and interaction in the metaverse. [Means for solving the problem]

[0005] This invention provides a means for learning an individual's principles, thoughts, hobbies, etc., and a means for generating AI that can interact with that individual's personality based on the learned information. This enables automatic message responses on social media and responses based on relationships. Furthermore, the generated AI can be used to power the official accounts of celebrities. It also provides a means for turning the generated AI into an avatar, enabling customization using NFTs and interaction in the metaverse space. This makes it possible to use it as a next-generation communication tool. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] In one embodiment of the present invention, an AI engine is used to collect and analyze data such as user social media posts, purchase history, and browsing history as a means for AI to learn about an individual's principles, thoughts, hobbies, etc. This AI engine uses natural language processing technology and machine learning technology to extract and learn about the user's principles, thoughts, hobbies, etc.

[0029] "Example 2"

[0030] Next, as a means of generating AI that can interact with users in a manner similar to their personality based on the learned information, an AI engine is used to generate a dialogue script that reflects the user's principles, thoughts, hobbies, etc. This AI engine then uses the generated dialogue script to converse with the user. Specifically, in response to questions from the user, the AI ​​engine generates a response based on the generated dialogue script and sends it back to the user.

[0031] "Example 3"

[0032] Furthermore, as a means of using the generated AI to turn official celebrity accounts into AI, the AI ​​will learn from the celebrity's remarks and behavioral data provided by the operator of the celebrity's official account and generate an AI that mimics the celebrity's personality. Specifically, the AI ​​will analyze the celebrity's remarks and behavioral data and extract their characteristics. Based on the extracted characteristics, it will generate a dialogue script that mimics the celebrity's personality and use it to dialogue with users.

[0033] "Example 4"

[0034] In addition, the generated AI is turned into an avatar, and 3D modeling software linked to the AI ​​engine is used as a means to enable customization using NFTs and interaction in the Metaverse space. Specifically, the avatar's movements and facial expressions are controlled using dialogue scripts generated by the AI ​​engine. It is also possible to customize the avatar's appearance and equipment using NFTs. Furthermore, this avatar can be placed in the Metaverse space, enabling interaction with other users.

[0035] The processing flow of each embodiment will be described below.

[0036] "Example 1"

[0037] Step 1: The AI ​​engine collects data such as the user's social media posts, purchase history, and browsing history.

[0038] Step 2: The AI ​​engine analyzes the collected data and uses natural language processing and machine learning technologies to extract and learn about the user's principles, thoughts, hobbies, etc.

[0039] "Example 2"

[0040] Step 1: Based on the information it has learned, the AI ​​engine generates a dialogue script that reflects the user's beliefs, thoughts, hobbies, etc.

[0041] Step 2: The AI ​​engine uses the generated dialogue script to converse with the user. Specifically, it generates a response to a question from the user based on the generated dialogue script and sends it back to the user.

[0042] "Example 3"

[0043] Step 1: The AI ​​engine learns from the celebrity's statement and behavioral data provided by the operator of the celebrity's official account.

[0044] Step 2: Analyze the learned data and extract its features.

[0045] Step 3: Based on the extracted features, a dialogue script that mimics the celebrity's personality is generated and used to engage in dialogue with the user.

[0046] "Example 4"

[0047] Step 1: Using 3D modeling software linked to an AI engine, the avatar's movements and facial expressions are controlled using the dialogue script generated by the AI ​​engine.

[0048] Step 2: Customize your avatar's appearance and gear with NFTs.

[0049] Step 3: Place this avatar in the Metaverse space and allow it to interact with other users.

[0050] Example 1

[0051] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0052] In modern society, there is a demand for accurate understanding of individuals' principles, thoughts, hobbies, etc., and for the provision of personalized services based on these. However, conventional systems have had difficulty effectively collecting and analyzing diverse user data and responding to individual needs. It has also been difficult to generate AI capable of interacting with users in a way that closely resembles their personality, and to use it for automated message responses on social media or responses based on relationships. This has hindered improvements to the user experience and efficient communication.

[0053] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes: means for collecting data such as user postings, purchase history, and browsing history; means for preprocessing the collected data; means for analyzing the preprocessed data and extracting the user's principles, thoughts, and hobbies; means for saving the extracted information and displaying it to the user; means for generating an AI capable of interacting with the user in a manner that is similar to the user's personality based on the learned information; and means for using the generated AI to automatically respond to messages and respond according to relationships. This makes it possible to effectively collect and analyze a variety of user data and respond according to individual needs. Furthermore, by generating an AI capable of interacting with the user in a manner that is similar to the user's personality and using it for automatic message responses and responses according to relationships on SNS, an improved user experience and more efficient communication can be achieved.

[0054] "User" refers to any individual or entity that uses the System.

[0055] "Posted content" refers to information such as text, images, and videos posted by users on platforms such as social networking services (SNS).

[0056] "Purchase history" refers to historical information about products purchased by a user online or offline.

[0057] "Browsing history" refers to the history information of web pages and search queries that a user has viewed on the Internet.

[0058] "Means of collecting data" refers to methods and technologies for obtaining data such as user postings, purchase history, and browsing history.

[0059] "Data preprocessing means" refers to methods and techniques for converting collected data into a format that is easier to analyze.

[0060] "Means for analyzing data" refers to methods and techniques for extracting useful information from pre-processed data.

[0061] "Ideas, thoughts, and hobbies" refers to the user's personal beliefs, ways of thinking, interests, and concerns.

[0062] "Means for storing information" refers to the methods and techniques for storing extracted information in a storage device such as a database.

[0063] "Means for displaying information" refers to the methods and techniques for visually presenting stored information to a user.

[0064] "Means for generating AI" refers to methods and technologies for creating artificial intelligence based on the user's principles, ideas, and hobbies.

[0065] "Automatic message response" refers to a feature in which AI automatically responds to messages on behalf of the user.

[0066] "Responding based on relationships" refers to a function that takes appropriate action based on the user's relationship with other individuals or organizations.

[0067] This invention is a system that collects and analyzes data such as user postings, purchase history, and browsing history to extract the user's principles, thoughts, and hobbies. Furthermore, based on the extracted information, it generates an AI that can interact with the user in a way that closely resembles their personality, and this AI can be used to automatically respond to messages and take actions based on relationships.

[0068] The server first collects user data. Specifically, it uses the API of a social networking service to obtain the content posted on the social networking site, and the API of an e-commerce platform to obtain the purchase history. It also uses a web analytics tool to collect browsing history. Specific software such as Twitter® API, Facebook® Graph API, Amazon® API, and Google® Analytics is used to collect this data.

[0069] The server then preprocesses the collected data, which includes cleaning the text data, tokenizing it, removing stop words, etc., using the Python libraries spaCy and NLTK.

[0070] The server sends the preprocessed data to the AI ​​engine. The AI ​​engine analyzes the data using natural language processing (NLP) and machine learning technologies. Specifically, it uses NLP libraries such as spaCy and NLTK, and Tensorflow (registered trademark) and PyTorch for machine learning. The AI ​​engine extracts information such as beliefs, thoughts, and hobbies from users' posts, purchase history, and browsing history.

[0071] For example, if a user posts on Twitter, "I've been thinking a lot about environmental protection lately," purchases eco-friendly products on an e-commerce platform, and searches for "activities for environmental protection" on a search engine, the server collects this data and sends it to the AI ​​engine, which analyzes the data and determines that the user has a strong interest in environmental protection.

[0072] The generated AI can respond to messages automatically and according to the user's beliefs, thoughts, and hobbies. For example, if a user receives a question on social media, the AI ​​can automatically generate an appropriate response on the user's behalf.

[0073] Examples of prompts to be input to a generative AI model include:

[0074] Analyze a user's social media posts, purchase history, and browsing history to extract the user's principles, thoughts, and hobbies. For example, if a user frequently posts about "environmental protection," purchases eco-friendly products, and searches for information about environmental protection, determine that the user is interested in environmental protection.

[0075] In this way, the processing of the system program will be explained in detail while clarifying the roles of the server, terminal, and user.

[0076] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0077] Step 1: Data collection

[0078] The server collects data such as user posts, purchase history, and browsing history. Specifically, it uses the API of a social networking service to obtain SNS posts, and the API of an e-commerce platform to obtain purchase history. It also uses a web analytics tool to collect browsing history. The input is various user data sources, and the output is the collected raw data.

[0079] Step 2: Data Preprocessing

[0080] The server preprocesses the collected data. Specifically, it cleans the text data (removes unnecessary characters and symbols), tokenizes it (divides it into words), and removes stop words (removes frequently occurring but meaningless words). For this, it uses the Python libraries spaCy and NLTK. The input is the collected raw data, and the output is the preprocessed, clean data.

[0081] Step 3: Data analysis

[0082] The server sends the preprocessed data to the AI ​​engine, which analyzes the data using natural language processing (NLP) and machine learning technologies. Specifically, it uses NLP libraries such as spaCy and NLTK, and machine learning libraries such as TensorFlow and PyTorch. The input is preprocessed, clean data, and the output is information about the user's principles, thoughts, and hobbies.

[0083] Step 4: Save your information

[0084] The server stores the analysis results obtained from the AI ​​engine in a database. The input is the analysis results, and the output is the information stored in the database.

[0085] Step 5: Viewing information

[0086] Users can check information about their principles, beliefs, and hobbies through their devices. Specifically, the results are displayed through a web application. The input is the information stored in the database, and the output is the information displayed to the user.

[0087] Step 6: Generate AI

[0088] The server generates an AI that can interact with the user based on the learned information. The input is information about the user's principles, thoughts, and hobbies, and the output is the generated AI.

[0089] Step 7: Automated Message Responses

[0090] The generated AI responds to messages automatically on behalf of the user and responds based on the relationship. Specifically, it automatically generates appropriate responses to questions on social media. The input is a message from the user, and the output is an automatic response from the AI.

[0091] (Application example 1)

[0092] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0093] Modern advertising systems face the challenge of being unable to display advertisements that are optimized for a user's individual beliefs, beliefs, and hobbies. Conventional advertising systems display advertisements based on general demographic information and past behavioral history, which does not adequately reflect a user's individual interests. As a result, advertisements that are not appealing to users are often displayed, resulting in reduced advertising effectiveness.

[0094] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0095] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI that can interact with the individual based on the learned information, means for using the generated AI to automatically respond to messages on SNS and take actions according to relationships, means for collecting data such as the content of users' SNS posts, purchase history, and browsing history, and analyzing this data, and means for displaying advertisements optimized for the user's principles, thoughts, and hobbies based on the analysis results. This makes it possible to display advertisements optimized for the individual interests and concerns of the user.

[0096] "Personal principles, ideas, and hobbies" refers to the specific beliefs, ways of thinking, interests, and concerns of the user.

[0097] "Means of learning" refers to methods and technologies for collecting and analyzing user data to understand user characteristics.

[0098] "AI capable of human-like interactions" refers to artificial intelligence that can have natural conversations with users based on their characteristics.

[0099] "Means of generation" refers to methods and techniques for creating artificial intelligence for specific purposes.

[0100] "Automatic message responses on social networking services" refers to a function that automatically responds to messages on behalf of users on social networking services.

[0101] "Responding according to the relationship" refers to taking appropriate action based on the user's relationship with other users.

[0102] "Means of collecting data" refers to the methods and technologies used to collect information such as users' social media posts, purchase history, and browsing history.

[0103] "Means for analyzing data" refers to methods and technologies for analyzing collected data and extracting user characteristics.

[0104] "Means for displaying advertisements" refers to methods and technologies for displaying advertisements optimized for users based on the analysis results.

[0105] The system for implementing the present invention learns the user's personal principles, thoughts, hobbies, etc., and displays advertisements optimized based on the information. A specific embodiment of this system will be described below.

[0106] First, the server collects data such as the user's social media posts, purchase history, and browsing history. This involves using APIs to obtain data from various platforms. For example, the server uses the API of a social media platform to obtain the user's posts, and the API of an e-commerce site to obtain the user's purchase history.

[0107] The server then preprocesses the collected data, which involves using natural language processing techniques to tokenize the text data and remove stop words, reducing noise in the data and improving the accuracy of the analysis.

[0108] The server then analyzes the preprocessed data, which involves using machine learning techniques to extract the user's principles, thoughts, and hobbies. Specifically, it uses TF-IDF vectorization and KMeans clustering to cluster the user's characteristics.

[0109] Based on the analysis results, the server selects advertisements that are optimized for the user's principles, beliefs, and hobbies, including selecting appropriate advertisements from an advertisement database. The selected advertisements are then displayed on the user's device.

[0110] In implementing this system, the following hardware and software are used:

[0111] Hardware: Servers, user devices (smartphones, tablets, PCs, etc.)

[0112] Software: Natural language processing libraries (e.g., nltk), machine learning libraries (e.g., scikit-learn), API client libraries (e.g., requests)

[0113] As a concrete example, the execution result for the user ID "12345" is shown below. The server collects the SNS posting content, purchase history, and browsing history of the user ID "12345," extracts the user's principles, thoughts, and hobbies, and displays the most appropriate advertisement.

[0114] Example prompts to input to the generative AI model:

[0115] Please create a program that collects the social media posts, purchase history, and browsing history of user ID "12345," extracts the user's principles, thoughts, and hobbies, and displays the most appropriate advertisements.

[0116] In this way, a system can be realized that displays optimal advertisements based on individual user data.

[0117] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0118] Step 1:

[0119] The server collects the user's social media posts. Specifically, it uses the social media platform's API to obtain the post data corresponding to the user ID. The input is the user ID, and the output is the user's post data.

[0120] Step 2:

[0121] The server collects the user's purchase history. Specifically, it uses the API of the e-commerce site to obtain purchase history data corresponding to the user ID. The input is the user ID, and the output is the user's purchase history data.

[0122] Step 3:

[0123] The server collects the user's browsing history. Specifically, it uses the browser's API to obtain browsing history data corresponding to the user ID. The input is the user ID, and the output is the user's browsing history data.

[0124] Step 4:

[0125] The server preprocesses the collected data. Specifically, it uses natural language processing technology to tokenize the text data and remove stop words. The input is the collected data on social media posts, purchase history, and browsing history, and the output is the preprocessed text data.

[0126] Step 5:

[0127] The server analyzes the preprocessed data. Specifically, it uses TF-IDF vectorization and KMeans clustering to extract the user's principles, thoughts, and hobbies. The input is the preprocessed text data, and the output is the clustering results of the user's principles, thoughts, and hobbies.

[0128] Step 6:

[0129] The server selects the optimal advertisement based on the analysis results. Specifically, it selects the advertisement that best suits the user's clustering results from the advertisement database. The input is the clustering results, and the output is the optimized advertisement data.

[0130] Step 7:

[0131] The server displays the selected advertisement on the user's device. Specifically, it sends advertisement data to the user's device and displays it. The input is the optimized advertisement data, and the output is the advertisement displayed on the user's device.

[0132] Example 2

[0133] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0134] Conventional conversational AI systems have had difficulty generating responses that fully reflect a user's personality and interests. Furthermore, they lacked the means to effectively utilize information such as the user's principles, thoughts, and hobbies, resulting in a uniform and lacking individuality in their interactions with the user. Furthermore, customization and flexibility were also issues when using the generated AI for official celebrity accounts or virtual interactions.

[0135] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0136] In this invention, the server includes a means for collecting personal principles, thoughts, hobbies, etc., a means for generating a dialogue script using a generative AI model based on the collected information, and a means for generating responses to questions from the user using the generated dialogue script and returning the responses to the user, thereby enabling the generation of responses that reflect the user's personality and interests.

[0137] "Means for collecting personal principles, thoughts, hobbies, etc." refers to a method or device for collecting information such as a user's principles, thoughts, hobbies, etc. from data provided by the user and past interaction history.

[0138] A "generative AI model" is an artificial intelligence model that generates dialogue scripts based on collected information, and is, for example, a model that uses natural language processing technology.

[0139] A "dialogue script" is a script for generating dialogue content that reflects the user's personality and interests, and is created by a generative AI model.

[0140] "Means for generating a response to a question from a user and sending it back to the user" refers to a method or device for generating an appropriate response to a question sent by the user through a terminal based on a generated dialogue script and sending that response to the user.

[0141] "AI-based celebrity official accounts" refers to using generated AI on celebrity official accounts to automatically respond to messages and take action based on relationships.

[0142] "Avatarization" refers to the process of representing the generated AI as a virtual character, making it visually recognizable to users.

[0143] "Digital assets" refer to customizable items, tokens, etc. that can be used in virtual spaces or on digital platforms.

[0144] "Virtual interaction" refers to a user using generated AI to interact with other users and engage in activities within a virtual reality or augmented reality environment.

[0145] The present invention is a system for generating a dialogue script that reflects the user's principles, thoughts, hobbies, etc., and for engaging in a dialogue with the user. A specific embodiment of this system will be described below.

[0146] The server first collects information about the user, such as their beliefs, thoughts, and hobbies. This information is obtained from data provided by the user and from past conversation history. For example, if a user enters "environmentalism," "pacifism," and "movie appreciation" as profile information, that information is stored in the database.

[0147] Next, the server uses the collected information to generate a dialogue script using a generative AI model (for example, a model using natural language processing technology). Prompts containing the user's principles, thoughts, and hobbies are input to the generative AI model, which then generates a dialogue script that reflects the user's personality.

[0148] Specific prompt examples:

[0149] User Information:

[0150] Principle: Environmentalism

[0151] Ideology: Pacifism

[0152] Hobbies: Watching movies, reading

[0153] An example of the generated interactive script:

[0154] "Hello, what movie would you like to watch today? I know you like environmentally themed movies."

[0155] When a user sends a question via a device (such as a smartphone or PC), the server references the stored dialogue script and generates an appropriate response. A generative AI model is used to generate a response to the user's question.

[0156] Specific response generation examples:

[0157] User Question: What recent movies would you recommend?

[0158] Generates an example response:

[0159] "A recent movie I recommend is 'Don't Look Up.' This movie deals with environmental issues, and I think it will resonate with your environmentalism. It also has a humorous story that you can enjoy."

[0160] The server sends the generated response to the user's terminal, which displays the received response. The user can check the displayed response and ask the next question.

[0161] This system generates dialogue scripts that reflect the user's personality and interests, and by engaging in dialogue with the user, it is possible to provide more personalized responses. The generated AI can also be used to power the official accounts of celebrities and for interactions in virtual spaces. This allows users to utilize the generated AI model in a variety of scenarios.

[0162] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0163] Step 1:

[0164] The server collects information such as the user's beliefs, thoughts, and hobbies. It receives data provided by the user through their device and past interaction history as input, and stores this information in a database. Specifically, it provides a form for the user to enter profile information, and stores the input in the database.

[0165] Step 2:

[0166] The server uses a generative AI model to generate a dialogue script based on the collected information. Information such as the user's principles, thoughts, and hobbies stored in a database is used as input. A prompt containing this information is input to the generative AI model, which then outputs a dialogue script that reflects the user's personality. Specifically, the server sends a prompt to the generative AI model and receives the generated dialogue script.

[0167] Step 3:

[0168] The user sends a question through the terminal. The question entered by the user is received as input. Specifically, the user enters a question through the chat interface, and the question is sent to the server.

[0169] Step 4:

[0170] When the server receives a question from a user, it references the saved dialogue script and generates an appropriate response. It uses the user's question and dialogue script as input. It uses a generative AI model to generate a response to the user's question and obtains the response as output. Specifically, it inputs the question and dialogue script into the generative AI model and receives the generated response.

[0171] Step 5:

[0172] The server sends the generated response to the user's terminal, uses the generated response as input, and specifically sends the generated response to the user's terminal and displays it on the user's chat interface.

[0173] Step 6:

[0174] The user can check the response displayed on the terminal and ask the next question. The displayed response is used as input. Specifically, the user reads the displayed response and inputs the next question.

[0175] (Application example 2)

[0176] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0177] Traditional personalized shopping experiences have been unable to fully reflect the individual characteristics of users, such as their beliefs, thoughts, and hobbies, making it difficult to recommend the most suitable products for them. Furthermore, when interacting with users, only generic responses were provided, which prevented users from increasing satisfaction. This made it difficult to stimulate users' purchasing desire.

[0178] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0179] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI that can interact with the user based on the learned information, means for using the generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies, and means for responding to the user's questions based on the generated dialogue script. This makes it possible to provide optimal product suggestions that reflect the individual characteristics of the user and a high level of satisfaction in dialogue with the user.

[0180] "Means of learning about personal beliefs, thoughts, hobbies, etc." refers to a method for collecting users' values ​​and interests and analyzing data based on them.

[0181] "Means for generating AI that can interact with a user in a manner similar to their personality based on learned information" refers to a method for creating artificial intelligence that can interact with a user in a manner similar to their personality based on collected user information.

[0182] "Means of using generated AI to automatically respond to messages on social media and take actions based on the relationship" refers to a method of using generated artificial intelligence to automatically reply to messages on social networking services and take actions based on the relationship with the user.

[0183] "Means for using generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies" refers to a method that uses generated artificial intelligence to suggest individually optimized products based on the user's values ​​and interests.

[0184] The "means for responding to a user's question based on the generated dialogue script" refers to a method for providing an appropriate response to a question from a user using the generated dialogue script.

[0185] As an embodiment of the present invention, the following system can be constructed.

[0186] First, the server is equipped with a means of learning about an individual's principles, thoughts, hobbies, etc. This means collecting the user's values ​​and interests and analyzing the data based on them. Specifically, it uses software to collect and analyze information entered by the user, past purchase history, and comments on social media. For example, data analysis can be performed using programming languages ​​such as Python and R.

[0187] Next, the server is equipped with a means for generating an AI that can interact with the user in a manner similar to the user's personality based on the learned information. This means is a method for creating an AI that can interact with the user in a manner similar to the user's personality based on the collected user information. Specifically, the server uses the OpenAI (registered trademark) API to generate a dialogue script based on the user's profile information.

[0188] Furthermore, the server has a means for using the generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies. This means utilizes the generated artificial intelligence to suggest products that are individually optimized based on the user's values ​​and interests. For example, if a user asks, "What eco-friendly products do you recommend?", the AI ​​will suggest appropriate products by taking into account the user's profile information.

[0189] The server also includes a means for responding to user questions based on the generated dialogue script. This means uses the generated dialogue script to provide appropriate responses to user questions. Specifically, the server generates prompt sentences such as the following and generates responses using OpenAI's API:

[0190] Example prompt sentence:

[0191] "User's principles are eco-friendliness, their philosophy is minimalism, and their hobbies are reading and hiking. User asks: What eco-friendly products do you recommend? Generate a personalized response based on this information."

[0192] In this way, it becomes possible to provide optimal product proposals that reflect the individual characteristics of each user and provide a high level of satisfaction in dialogue with the user.

[0193] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0194] Step 1:

[0195] A user uses a terminal to input information such as personal principles, thoughts, and hobbies.

[0196] Input: Information such as the user's principles, thoughts, hobbies, etc.

[0197] Output: User profile information

[0198] Specific operation: The user enters their values ​​and interests into the input form on the device, such as "eco-friendliness," "minimalism," "reading," and "hiking."

[0199] Step 2:

[0200] The server collects user profile information and stores it in a database.

[0201] Input: User profile information

[0202] Output: User profile information stored in the database

[0203] Specific operation: The server receives the user profile information sent from the terminal and stores it in a database.

[0204] Step 3:

[0205] The server analyzes the user's profile information and generates an AI that can interact with the user in a way that closely resembles their personality.

[0206] Input: User profile information stored in a database

[0207] Output: AI that can interact with users in a way that is close to their personality

[0208] Specific operation: The server retrieves the user's profile information from the database and uses OpenAI's API to generate an interaction script based on the user's information.

[0209] Step 4:

[0210] The user uses the terminal to input a question about the product.

[0211] Input: User question

[0212] Output: User's question

[0213] Specific operation: The user enters a question about a product into an input form on the device. For example, they might enter, "What eco-friendly products do you recommend?"

[0214] Step 5:

[0215] The server receives the user's question and generates a prompt.

[0216] Input: User profile information, user questions

[0217] Output: prompt statement

[0218] Specific behavior: The server generates a prompt sentence like the following based on the user's profile information and the question: "User's principles are eco-friendliness, his philosophy is minimalism, and his hobbies are reading and hiking. User's question: What eco-friendly products do you recommend? Generate a personalized response based on this information."

[0219] Step 6:

[0220] The server uses the generated prompt to call the OpenAI API and generate a response.

[0221] Input: prompt statement

[0222] Output: The generated response

[0223] Specific operation: The server sends the generated prompt text to OpenAI's API and receives the response returned from the API.

[0224] Step 7:

[0225] The server sends the generated response to the user's terminal.

[0226] Input: Generated response

[0227] Output: The response displayed on the user's terminal

[0228] Specific operation: The server sends the generated response to the user's terminal and displays the response on the user's terminal.

[0229] In this way, it is possible to provide optimal product proposals that reflect the individual characteristics of the user and provide a high level of satisfaction in dialogue with the user.

[0230] Example 3

[0231] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0232] Conventional AI systems have had difficulty learning an individual's principles, thoughts, hobbies, etc. and interacting with them in a way that reflects their personality. It has also been difficult to create AI for the official accounts of celebrities or to create three-dimensional models of the generated AI for virtual interaction. Furthermore, customization features using digital assets have been lacking.

[0233] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc.; means for generating a generative AI model capable of interacting with the individual based on the learned information; means for using the generated generative AI model to automatically respond to messages on a communication network or respond according to relationships; means for collecting and analyzing speech data and behavioral data of celebrities; means for generating a dialogue script that imitates the celebrity's personality based on the analyzed data; means for interacting with a user using the generated dialogue script; and means for converting the generated generative AI model into a three-dimensional model, enabling customization using digital assets and interaction in a virtual space. This allows for the generation of an AI that imitates the personality of an individual or a celebrity, enabling automatic responses on a communication network and interaction in a virtual space.

[0234] "Personal principles, ideas, and hobbies" refer to the beliefs, ways of thinking, and interests and concerns of a particular individual.

[0235] "Learning means" refers to the process of collecting and analyzing data to extract specific patterns and features.

[0236] A "generative AI model" refers to an artificial intelligence model that mimics the personality and behavior of a specific person based on collected and analyzed data.

[0237] "Communications network" refers to a system for transmitting and receiving information over the Internet or other digital communications means.

[0238] "Automatic message response" refers to a function that automatically replies to messages from users using pre-set algorithms or AI.

[0239] "Relationship-based response" refers to the ability to provide appropriate responses and actions based on past interactions and relationships with the user.

[0240] "Celebrity statement and behavior data" refers to records of public statements and behavior of celebrities.

[0241] "Means of analysis" refers to the process of analyzing collected data and extracting specific patterns or features.

[0242] A "dialogue script" refers to a conversation script generated based on a specific scenario or context.

[0243] "3D modeling" refers to the process of generating three-dimensional shapes and movements based on two-dimensional data.

[0244] "Digital Asset" refers to assets in digital form whose ownership is proven using blockchain technology.

[0245] "Virtual space" refers to a virtual environment or world generated using computer technology.

[0246] This invention is a system that learns an individual's principles, thoughts, hobbies, etc. and generates a generative AI model that can interact with them in a way that closely resembles their personality based on that information. Furthermore, this generative AI model is used to automatically respond to messages on communication networks and respond according to relationships. By collecting and analyzing data on celebrities' statements and behavior, it is possible to generate dialogue scripts that mimic the celebrity's personality and engage in dialogue with users. Furthermore, the generated generative AI model can be converted into a three-dimensional model, enabling customization using digital assets and interaction in virtual spaces.

[0247] Hardware and software used

[0248] The server performs processes such as data collection, analysis, generation of generative AI models, generation of dialogue scripts, and 3D modeling. Specific hardware required is a server equipped with a high-performance CPU and GPU. The following software is used:

[0249] Data collection: Obtain data from social media via APIs, specifically Twitter API and Instagram API.

[0250] Data analysis: Use a Python NLP library (e.g., spaCy, NLTK) to tokenize text data and perform sentiment analysis and keyword extraction.

[0251] Generative AI models: Generative AI models such as OpenAI's GPT-4® are used to generate dialogue scripts.

[0252] Three-dimensional modeling: Using 3D modeling software such as Blender, the movements and facial expressions of the avatar are controlled based on the generated dialogue script.

[0253] Digital Asset Customization: Use NFT marketplaces (e.g., OpenSea) to customize your avatar's appearance and gear.

[0254] Virtual interaction: Using a virtual reality platform (e.g., Decentraland) to place a customized avatar in a virtual space.

[0255] Specific examples

[0256] For example, if you want to create an AI model for the official account of a famous actor, you can input the following prompt into the generative AI model:

[0257] Example prompt sentence:

[0258] "Hi, I'm [Actor's name]. What would you like to talk about today?"

[0259] Based on this prompt, the generative AI model creates a dialogue script that mimics the actor's tone and speaking style. The dialogue script is then reflected in the avatar's movements and facial expressions using 3D modeling software. Users can then have this avatar interact with other users in a virtual space.

[0260] The above is an embodiment of the present invention. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0261] Step 1: Data collection

[0262] The server collects comment and behavior data provided by the operators of the celebrities' official accounts. Specifically, it obtains data from social media (e.g., Twitter, Instagram) via API.

[0263] Input: Speech data and behavioral data obtained from SNS APIs.

[0264] Output: Collected speech and behavior data is saved in a database.

[0265] Specific operation: The server uses the Twitter API to collect tweets from celebrities and stores them in a MySQL (registered trademark) database.

[0266] Step 2: Data analysis

[0267] The server analyzes the collected data. Specifically, it uses Python NLP libraries (e.g., spaCy, NLTK) to tokenize the text data and perform sentiment analysis and keyword extraction.

[0268] Input: Collected speech and behavior data.

[0269] Output: Parsed data (tokenized text, sentiment analysis results, keywords).

[0270] What it does: The server uses spaCy to tokenize tweets and perform sentiment analysis.

[0271] Step 3: Generate an AI model

[0272] The server generates a dialogue script based on the extracted features, using a generative AI model (e.g., OpenAI's GPT-4).

[0273] Input: Parsed data (tokenized text, sentiment analysis results, keywords).

[0274] Output: The generated dialogue script.

[0275] Specific operation: The server uses GPT-4 to generate a dialogue script based on the prompt sentence, "Hello, I'm [actor's name]. What would you like to talk about today?"

[0276] Step 4: Create and customize your avatar

[0277] The server uses 3D modeling software (e.g., Blender) in conjunction with an AI engine to control the avatar's movements and facial expressions based on the generated dialogue script.

[0278] Input: The generated dialogue script.

[0279] Output: An avatar with controlled movements and facial expressions.

[0280] How it works: The server controls the avatar's facial expressions using Blender, and users customize the avatar's appearance using NFTs purchased from NFT marketplaces (e.g., OpenSea).

[0281] Step 5: Interact in the Metaverse

[0282] The server places the customized avatar in a metaverse space, which uses a virtual reality platform (e.g., Decentraland).

[0283] Enter: your customized avatar.

[0284] Output: Avatar placement and interaction in the metaverse space.

[0285] Specific operation: The server places an avatar on Decentraland, and users control that avatar to interact with other users.

[0286] (Application example 3)

[0287] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0288] Conventional AI systems have had difficulty learning an individual's principles, thoughts, and hobbies and interacting with them in a way that reflects their personality. Even when the generated AI was used as a celebrity's official account or as an avatar to interact in a virtual space, the dialogue with the user often felt unnatural. Furthermore, when used as a shopping assistant in a virtual store, the user experience was not sufficiently improved.

[0289] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0290] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI capable of interacting with the individual based on the learned information, means for using the generated AI to automatically respond to messages on social media and respond according to relationships, means for turning the generated AI into an avatar and enabling customization using NFTs and interaction in the virtual space, means for using the generated AI as an assistant for product selection in a virtual store, means for generating a dialogue script based on user input and controlling the avatar's movements and facial expressions, means for customizing the avatar's appearance and equipment using NFTs, and means for placing the customized avatar in the virtual space. This allows users to select products through natural dialogue, improving the shopping experience in the virtual store.

[0291] "Personal principles, ideas, and tastes" refer to an individual's beliefs, ways of thinking, interests, and preferences.

[0292] "Learning tools" refer to the methods and techniques used to collect, analyze, and train data.

[0293] "Personalized interactions" refer to dialogue and responses that mimic the characteristics and behavioral patterns of a specific individual.

[0294] "AI generation means" refers to methods and techniques for building and training artificial intelligence models.

[0295] "SNS automatic message response" refers to a function that automatically generates and sends messages on social networking services.

[0296] "Relationship-based responses" refers to choosing appropriate responses and actions based on your relationship with the user and past interactions.

[0297] "Avatarization" refers to creating a digital character and giving it specific characteristics and behaviors.

[0298] "Customization using NFTs" refers to changing the appearance or equipment of digital items or characters using non-fungible tokens.

[0299] "Virtual interaction" refers to communication and interaction with other users within a digital environment.

[0300] A "virtual store" is a virtual shopping space that exists on the Internet.

[0301] A "product selection assistant" is a system or feature that acts as an assistant to users in selecting products.

[0302] A "dialogue script" is a scenario or script of responses prepared in advance for dialogue with a user.

[0303] "Means for controlling the movements and facial expressions of an avatar" refers to methods and techniques for programmatically manipulating the movements and facial expressions of a digital character.

[0304] A "customized avatar" is a digital character whose appearance and equipment have been modified to suit the user's preferences.

[0305] "Means for virtual placement" refers to methods and techniques for placing digital characters and objects within a virtual environment.

[0306] The following system configuration and processing procedure will be described as an embodiment of the present invention.

[0307] System Configuration

[0308] This system is configured using the following hardware and software.

[0309] Hardware: Servers, smartphones, head-mounted displays

[0310] Software: OpenAI GPT-3 (registered trademark), 3D modeling software, NFT customization module, Metaverse integration module

[0311] Processing steps

[0312] 1. A means of learning about personal principles, ideas, hobbies, etc.:

[0313] The server collects and analyzes data such as an individual's principles, thoughts, and hobbies, thereby learning the individual's characteristics.

[0314] 2. A method to generate AI that can interact with a person based on learned information:

[0315] The server uses OpenAI GPT-3 to generate an AI that can interact with the person based on the information it has learned.

[0316] 3. Using the generated AI to automatically respond to messages on social media and respond according to relationships:

[0317] The server uses the generated AI to automatically generate and send messages on social media, and responds appropriately based on the user's relationship with the server.

[0318] 4. Turning the generated AI into an avatar, enabling customization and virtual interaction using NFTs:

[0319] The server uses 3D modeling software to create an avatar from the generated AI, and then uses an NFT customization module to customize the avatar's appearance and equipment. The customized avatar is then placed in the virtual space using the metaverse integration module.

[0320] 5. How to use the generated AI as a product selection assistant in a virtual store:

[0321] The server uses the generated AI as an assistant for product selection in a virtual store, allowing users to interact with the avatar via a smartphone or head-mounted display while selecting products.

[0322] 6. A means to generate dialogue scripts based on user input and control avatar movements and facial expressions:

[0323] The server generates dialogue scripts based on user input and controls the avatar's movements and facial expressions using 3D modeling software.

[0324] 7. How to use NFTs to customize your avatar's appearance and gear:

[0325] The server uses the NFT customization module to customize the avatar's appearance and equipment.

[0326] 8. How to place a customized avatar in a virtual space:

[0327] The server uses a metaverse integration module to place the customized avatar in the virtual space.

[0328] Specific examples

[0329] A specific example of a user selecting a product in a virtual store is shown below.

[0330] Example prompt sentence:

[0331] User: Tell me about this product.

[0332] Celebrity AI: Hello! This is the latest smartphone with an excellent camera. The night mode is especially impressive.

[0333] Using this prompt, users can choose products while interacting with celebrity avatars in a virtual store, improving the user experience and enabling product selection through natural dialogue.

[0334] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0335] Step 1:

[0336] The server collects and analyzes data such as an individual's principles, thoughts, and hobbies. As input, it receives data about an individual's principles, thoughts, and hobbies, analyzes it, and extracts characteristics. As output, it generates data that represents the individual's characteristics.

[0337] Step 2:

[0338] The server uses OpenAI GPT-3 to generate an AI that can interact with the individual based on the learned information. It uses the individual's characteristic data obtained in Step 1 as input and trains the AI ​​model based on this. As output, it generates an AI model that mimics the individual's personality.

[0339] Step 3:

[0340] The server uses the generated AI to automatically generate and send messages on the SNS. As input, it receives a message from the user and generates an appropriate response. As output, it sends the generated message to the SNS.

[0341] Step 4:

[0342] The server uses 3D modeling software to create an avatar from the generated AI. As input, it receives the AI ​​model and the basic design of the avatar, and generates the avatar based on this. As output, it generates an avatar based on the AI ​​model.

[0343] Step 5:

[0344] The server uses the NFT customization module to customize the avatar's appearance and equipment. As input, it receives the avatar and NFT data, and changes the avatar's appearance and equipment based on this. As output, it generates a customized avatar.

[0345] Step 6:

[0346] The server uses the metaverse integration module to place the customized avatar in the virtual space, receive the customized avatar as input and place it in the virtual space, and generate the avatar placed in the virtual space as output.

[0347] Step 7:

[0348] Users select products by interacting with an avatar via a smartphone or head-mounted display. The input is the user's questions and requests, and the avatar's responses are displayed. The output is product information and recommendations for the user.

[0349] Step 8:

[0350] The server generates a dialogue script based on the user's input and controls the avatar's movements and facial expressions using 3D modeling software. As input, it receives the user's input data and generates a dialogue script based on this. As output, it generates instructions to control the avatar's movements and facial expressions.

[0351] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0352] "Example 1"

[0353] One embodiment of the present invention is a system incorporating an emotion engine. This system collects data such as user social media postings, purchase history, and browsing history, and uses natural language processing and machine learning technologies to extract and learn the user's principles, thoughts, hobbies, etc. Furthermore, an emotion engine that recognizes the user's emotions is used to grasp the user's emotional state. Specifically, the system recognizes and learns emotions such as joy, anger, sadness, and surprise from the user's postings and behavior. Based on the learned information, the system then generates an AI capable of interacting with the user in a manner that closely resembles their personality, and uses the generated AI to automatically respond to messages on social media and respond according to relationships.

[0354] "Example 2"

[0355] Another embodiment of the present invention is a system that combines AI-based celebrity official accounts with an emotion engine. This system learns from the celebrity's statement and behavior data provided by the administrator of the celebrity's official account and extracts its characteristics. Furthermore, it uses an emotion engine that recognizes the user's emotions to grasp the user's emotional state. Based on the extracted characteristics and the user's emotional state, it then generates a dialogue script that mimics the celebrity's personality and uses this to engage in dialogue with the user.

[0356] "Example 3"

[0357] Another embodiment of the present invention is a system that combines an emotion engine with AI avatar customization using NFTs and interaction in the Metaverse space. This system uses 3D modeling software linked to an AI engine to control the avatar's movements and facial expressions using dialogue scripts generated by the AI ​​engine. Furthermore, an emotion engine that recognizes the user's emotions is used to grasp the user's emotional state and change the avatar's facial expressions and movements accordingly. The avatar's appearance and equipment can then be customized using NFTs, and the avatar can be placed in the Metaverse space, enabling interaction with other users.

[0358] The processing flow of each embodiment will be described below.

[0359] "Example 1"

[0360] Step 1: Collect data such as user social media posts, purchase history, and browsing history.

[0361] Step 2: Analyze the collected data using natural language processing and machine learning technologies to extract and learn about the user's principles, thoughts, hobbies, etc.

[0362] Step 3: Recognize user emotions. Use an emotion engine to understand the user's emotional state.

[0363] Step 4: Generate an AI that can interact with the person based on the learned information and emotional state.

[0364] Step 5: Use the generated AI to automatically respond to messages on social media and take action based on the relationship.

[0365] "Example 2"

[0366] Step 1: Learn from celebrity statement and behavior data provided by the operators of the celebrity's official accounts.

[0367] Step 2: Extract celebrity features from the trained data.

[0368] Step 3: Recognize user emotions. Use an emotion engine to understand the user's emotional state.

[0369] Step 4: Generate a dialogue script that mimics the celebrity's personality based on the extracted features and the user's emotional state.

[0370] Step 5: Interact with the user using the generated interaction script.

[0371] "Example 3"

[0372] Step 1: Using 3D modeling software linked to an AI engine, the avatar's movements and facial expressions are controlled using the dialogue script generated by the AI ​​engine.

[0373] Step 2: Recognize user emotions Using an emotion engine, the user's emotional state is grasped and the avatar's facial expressions and movements are changed accordingly.

[0374] Step 3: Customize your avatar's appearance and gear with NFTs.

[0375] Step 4: Place your customized avatar in the Metaverse space and interact with other users.

[0376] Example 1

[0377] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0378] Conventional systems have difficulty accurately understanding a user's principles, thoughts, and hobbies and providing personalized responses based on those beliefs. Furthermore, they are unable to generate responses that take into account the user's emotional state, which reduces the quality of communication with the user. Furthermore, there is also the issue that the generated AI cannot be used for official celebrity accounts or for interactions in virtual spaces.

[0379] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0380] In this invention, the server includes: means for collecting data such as user posts, purchase history, and browsing history; means for analyzing the collected data using natural language processing and machine learning techniques to extract and learn the user's principles, thoughts, hobbies, etc.; means for recognizing emotions from the user's posts and behavior; means for generating AI capable of interacting with users in a manner that closely resembles their personality based on the learned information and emotion recognition results; and means for using the generated AI to automatically respond to messages on social media and respond according to relationships. This makes it possible to accurately grasp the user's principles, thoughts, and hobbies and generate personalized responses that take into account their emotional state. The generated AI can also be used for interactions on celebrities' official accounts and in virtual spaces.

[0381] "User posts" refers to content such as text, images, and videos posted publicly or privately by users on online platforms such as social networking services and blogs.

[0382] "Purchase history" refers to a record of product purchases made by a user online or offline, and is data that includes information such as the purchase date and time, product name, price, and purchase location.

[0383] "Browsing history" is a record of the web pages and content that a user has viewed on the Internet, and is data that includes information such as the date and time of viewing, URL, and page title.

[0384] "Natural language processing technology" is a technology for processing human language using a computer, and is a technology that performs text analysis, generation, translation, sentiment analysis, etc.

[0385] "Machine learning technology" is a technology that allows computers to learn patterns from data and make predictions and classifications, and is a technology that analyzes data using algorithms and models.

[0386] "Emotion recognition" is a technology that identifies a user's emotional state from their text and behavior, and can recognize emotions such as joy, anger, sadness, and surprise.

[0387] An "AI engine" is software or a system that uses artificial intelligence technology to analyze and learn from data, and utilizes technologies including natural language processing and machine learning.

[0388] "SNS automatic message response" is a function that automatically generates and sends responses to messages and posts from users on social networking services.

[0389] "Relationship-based responses" means providing appropriate responses and actions based on the relationship with the user and past interactions, enabling personalized communication.

[0390] An "official celebrity account" is a social networking service account officially operated by a prominent person or organization, which is used to communicate with fans and followers.

[0391] "Avatarization" refers to the representation of a user's or AI's personality as a virtual character, enabling interaction in the digital space.

[0392] "Digital Asset" means any valuable asset that exists in digital form, including images, videos, music, and virtual currency.

[0393] A "virtual space" is a computer-generated, three-dimensional digital environment in which users can interact with other users and engage in activities through avatars.

[0394] This invention is a system that uses an AI engine to collect and analyze data such as user posts, purchase history, and browsing history. This system uses natural language processing and machine learning technologies to extract and learn the user's principles, thoughts, hobbies, etc. Furthermore, by combining it with an emotion engine, it is possible to grasp the user's emotional state and generate AI that can interact with the user in a way that is close to their personality.

[0395] Hardware and software used

[0396] 1. Server

[0397] It is the central component for data collection, data analysis, emotion recognition, AI generation, and automatic message responses. The server operates by integrating databases, APIs, AI engines, emotion engines, etc.

[0398] 2. Database

[0399] It is used to store data such as user posts, purchase history, browsing history, etc. For example, it uses a relational database such as MySQL or PostgreSQL.

[0400] 3. API

[0401] To collect data, we use APIs from social media platforms (Twitter API, Facebook Graph API, etc.), online shopping sites (Amazon API, Rakuten API, etc.), and web browsers (Google Analytics, etc.).

[0402] 4. AI Engine

[0403] It uses natural language processing technology (BERT, GPT-3, etc.) and machine learning technology (Scikit-learn, TensorFlow, etc.) to extract and learn about users' principles, thoughts, and hobbies.

[0404] 5. Emotion Engine

[0405] It is used to recognize emotions from user posts and behavior, for example, by using Microsoft® Azure® Text Analytics API or IBM Watson® Tone Analyzer.

[0406] Specific examples

[0407] Example 1: When a user posts on Twitter, "I want to go on a trip recently."

[0408] The server collects these posts through the Twitter API and stores them in a database.

[0409] The server sends the saved posts to an AI engine, which uses natural language processing technology to extract the hobby "travel."

[0410] The server sends the same post to the emotion engine and recognizes the emotion "expectation."

[0411] Based on this information, the server invokes an AI model (e.g., GPT-3) to generate automated messages containing travel destination suggestions that match the user's tastes and emotions.

[0412] The server sends the generated message back to the user via the Twitter API.

[0413] Prompt Sentence Examples

[0414] "Create a program that analyzes users' social media posts and extracts their hobbies and emotions. For example, if a user posts, 'I've been wanting to travel recently,' extract the hobby of traveling and the emotion of anticipation, and generate an automatic message based on that, including travel destination suggestions."

[0415] This concludes the description of the present invention. This system accurately identifies a user's principles, thoughts, and hobbies, and generates personalized responses that take into account their emotional state. The generated AI can also be used for official celebrity accounts and virtual interactions.

[0416] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0417] Step 1:

[0418] Data collection

[0419] The server collects data such as user posts, purchase history, and browsing history.

[0420] Input: Data from social media platforms (Twitter API, Facebook Graph API, etc.), online shopping sites (Amazon API, Rakuten API, etc.), and web browsers (Google Analytics, etc.).

[0421] Output: The collected data is stored in a database.

[0422] Specific operation: The server periodically calls an API to get new data and saves it in a database. For example, it uses the Twitter API to get a user's latest tweets and saves them in a database.

[0423] Step 2:

[0424] Data analysis

[0425] The server sends the collected data to an AI engine, which uses natural language processing technology to extract and learn from the user's principles, thoughts, hobbies, etc.

[0426] Input: User posts, purchase history, browsing history, and other data read from a database.

[0427] Output: Extracted information about the user's principles, thoughts, hobbies, etc.

[0428] Specific operation: The server reads data from the database, preprocesses the text data (tokenization, removal of stop words, etc.), and then inputs it into the AI ​​engine. For example, it uses the BERT model to analyze the text data and extract the user's hobbies.

[0429] Step 3:

[0430] emotion recognition

[0431] The server uses an emotion engine to recognize emotions from users' posts and actions.

[0432] Input: User posts and behavior data read from the database.

[0433] Output: Recognized emotion label (e.g., happy, anger, sad, surprise).

[0434] How it works: The server sends text data to the emotion engine and stores the returned emotion labels in a database. For example, it uses Microsoft Azure's Text Analytics API to recognize the emotion "expectation" from user posts.

[0435] Step 4:

[0436] AI generation

[0437] Based on the learned information and emotion recognition results, the server generates an AI that can interact with the user in a way that closely resembles their personality.

[0438] Input: Extracted information such as user principles, thoughts, and hobbies, along with emotion recognition results.

[0439] Output: The generated AI model.

[0440] How it works: The server inputs the user's hobbies and emotions into the AI ​​model as prompts, and stores the generated responses in a database. For example, GPT-3 is used to generate responses based on the user's hobbies and emotions.

[0441] Step 5:

[0442] Automated Message Response

[0443] The server uses the generated AI to automatically respond to messages on social media and take action based on relationships.

[0444] Input: A user's new post or message.

[0445] Output: The automatically generated response message.

[0446] How it works: The server monitors users' new posts, calls the AI ​​model at the appropriate time to generate a response, and automatically replies via the SNS API. For example, if a user posts, "I've been wanting to go on a trip lately," the AI ​​will generate a message with travel destination suggestions and reply.

[0447] (Application example 1)

[0448] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0449] Traditional content distribution services do not adequately recommend personalized content based on users' principles, beliefs, and hobbies. They also do not consider the user's emotional state when recommending content, making it difficult to increase user satisfaction. Furthermore, automated message responses and relationship-based responses on social media platforms do not reflect the user's individual emotions and interests, limiting the user experience.

[0450] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0451] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc.; means for generating an AI that can interact with the individual based on the learned information, means for using the generated AI to automatically respond to messages on social media and respond according to relationships; means for using an emotion engine that grasps the user's emotional state; and means for recommending content that best suits the user's current emotions. This enables personalized content recommendations based on the user's principles, thoughts, and hobbies, and can also realize content recommendations that take the user's emotional state into consideration. This increases user satisfaction and provides a richer user experience.

[0452] "Personal principles, thoughts, and hobbies" refers to the user's beliefs, ways of thinking, interests, and preferences.

[0453] "Means of learning" refers to the technologies and methods used to collect and analyze user data to extract its characteristics.

[0454] "AI capable of human-like interactions" is artificial intelligence that learns the characteristics of a user and responds and behaves in a similar way to that user.

[0455] "SNS automatic message response" is a function that automatically generates and sends messages on social networking services.

[0456] "Relationship-based response" refers to responding and taking appropriate actions based on the relationship with the user and the situation.

[0457] An "emotion engine" is a technology or system for analyzing and recognizing a user's emotional state.

[0458] "Content recommendation means" refers to technologies and methods for selecting and presenting appropriate content based on a user's characteristics and emotional state.

[0459] A "non-fungible token" is a token that uses blockchain technology to prove ownership of digital assets.

[0460] "Virtual space" refers to a digital environment or world generated using computer technology.

[0461] A system for implementing this invention includes a server for collecting and analyzing a user's personal data and a terminal for recommending content based on the analysis results. The server collects data such as the user's social media posts, purchase history, and browsing history, and uses natural language processing and machine learning techniques to extract and learn the user's principles, thoughts, and hobbies. Furthermore, an emotion engine is used to grasp the user's emotional state and recommend content that best suits the user's current emotions.

[0462] Hardware and software used

[0463] Hardware: Smartphones, servers

[0464] Software: Python, TextBlob, scikit-learn, requests

[0465] Data processing and calculation

[0466] The server first collects data such as the user's social media posts, purchase history, and browsing history. This data is then analyzed using natural language processing technology to extract the user's principles, thoughts, and hobbies. Specifically, TF-IDF vectorization and KMeans clustering are used to extract user features. Next, an emotion engine is used to analyze the user's emotional state from the content of the posts. TextBlob is used to analyze the emotions in the posts and understand the user's emotional state.

[0467] Content Recommendation

[0468] The server then recommends content that best suits the user's current emotions based on the analysis results. For example, if the user's emotional state is positive, it will recommend positive music or movie content, and if it is negative, it will recommend comforting reading or cooking content.

[0469] Specific examples

[0470] User A: Recent social media posts have been positive, and their hobbies are music and movies. → Recommend positive music and movie content.

[0471] User B: Recent social media posts have been negative, and her hobbies are reading and cooking. → Recommend comforting reading and cooking content.

[0472] Prompt Sentence Examples

[0473] Collect users' social media posts, purchase history, and browsing history, and use natural language processing and machine learning technologies to extract and learn their principles, thoughts, and hobbies.Furthermore, develop an application that uses an emotion engine to understand the user's emotional state and recommend content that best suits the user's current emotions.

[0474] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0475] Step 1:

[0476] The server collects data such as users' social media posts, purchase history, and browsing history.

[0477] Input: User ID

[0478] Output: User's social media posts, purchase history, and browsing history data

[0479] Specific operation: The server obtains user data from social networking platforms and online shopping sites through APIs. For example, it uses the API of a social networking site to obtain user posts, and the API of an online shopping site to obtain purchase history.

[0480] Step 2:

[0481] The server analyzes the collected data using natural language processing technology to extract the user's principles, thoughts, and hobbies.

[0482] Input: User's social media posts, purchase history, browsing history data

[0483] Output: Feature vector of user's principles, thoughts, and hobbies

[0484] Specific operation: The server quantifies the text data using TF-IDF vectorization and extracts user features using KMeans clustering, which allows the user's principles, thoughts, and hobbies to be expressed as a numerical vector.

[0485] Step 3:

[0486] The server uses an emotion engine to analyze the user's emotional state.

[0487] Input: User's social media posts

[0488] Output: User's emotional state (positive, negative, etc.)

[0489] Specific operation: The server analyzes the sentiment of the user's posts using TextBlob, calculates the sentiment score for each post, and calculates the overall average score to understand the user's emotional state.

[0490] Step 4:

[0491] The server recommends appropriate content based on the user's feature vector and emotional state.

[0492] Input: User feature vector, emotional state

[0493] Output: A list of recommended content

[0494] Specific operation: The server runs a content recommendation algorithm based on the user's feature vector and emotional state. For example, if the user's emotional state is positive, it recommends positive music or movies, and if the user's emotional state is negative, it recommends comforting reading or cooking content.

[0495] Step 5:

[0496] The terminal presents the content recommended by the server to the user.

[0497] Input: A list of recommended content

[0498] Output: The content that is displayed to the user

[0499] Specific operation: The device displays the recommended content received from the server on the user interface, and the user can browse and select the presented content.

[0500] Example 2

[0501] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0502] Conventional dialogue systems have had the challenge of being unable to reflect a user's individual beliefs, thoughts, and hobbies, and are unable to respond to the user's emotional state. Furthermore, even when AI was used on official celebrity accounts, it was not possible to achieve natural dialogue that reflected the user's emotions. This limited the user experience and led to problems such as a decline in the quality of the dialogue.

[0503] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0504] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating a dialogue script that enables interaction that is close to that individual's personality based on the learned information, means for engaging in a dialogue with the user using the generated dialogue script, means for using an emotion engine that recognizes the user's emotional state, means for generating a dialogue script based on the recognized emotional state, and means for engaging in a dialogue that imitates the personality of a celebrity using the generated dialogue script. This enables natural dialogue that reflects the user's individual information and emotional state.

[0505] "Personal principles, ideas, and hobbies" refers to the specific values, beliefs, and interests held by the user.

[0506] "Means of learning" refers to the process of analyzing information provided by users and storing it in a database.

[0507] A "dialogue script" refers to a series of responses generated to interact with a user.

[0508] "Means of generation" refers to the process of creating a dialogue script using an AI engine.

[0509] The "means for interacting with the user" refers to the process of responding to questions from the user using the generated interaction script.

[0510] An "emotion engine" refers to software that recognizes a user's emotional state and analyzes that information.

[0511] "Means of recognition" refers to the process of understanding the user's emotional state using an emotion engine.

[0512] "Dialogue imitating the personality of a celebrity" refers to dialogue conducted using a dialogue script generated based on the celebrity's speech data and behavioral data.

[0513] "Automatic message responses on social media" refers to a function that automatically responds to messages from users on social media.

[0514] "Relationship-based response" refers to the process of providing appropriate responses based on the relationship with the user.

[0515] "Avatarization" refers to the process of representing the generated dialogue script as a virtual character.

[0516] "Digital assets" refers to assets whose ownership is proven in a digital form, such as NFTs.

[0517] "Interaction in virtual space" refers to users interacting with each other and engaging in activities within a virtual environment such as the metaverse.

[0518] This invention is a system that learns the user's principles, thoughts, hobbies, etc., generates a dialogue script based on that information, and then engages in dialogue with the user. Furthermore, it uses an emotion engine to recognize the user's emotional state, and based on that information, it can engage in dialogue that mimics the personality of a celebrity.

[0519] Hardware and software used

[0520] Hardware: Servers, terminals (PCs, smartphones)

[0521] Software: AI engine, emotion engine, database management system

[0522] Program processing

[0523] Collection of User Information

[0524] Users access the system using a terminal and input information such as their principles, thoughts, hobbies, etc. The terminal sends the input information to the server, which then stores it in a database.

[0525] Examples:

[0526] A user types, "My hobby is reading, and I especially like science fiction novels." The device sends this information to the server, which stores it in its database as "Hobbies: Reading, Genre: Science fiction novels."

[0527] Generate conversation scripts

[0528] The server retrieves user information from the database, starts the AI ​​engine, and inputs the retrieved user information. The AI ​​engine generates a dialogue script based on the user information, and the generated dialogue script is saved on the server.

[0529] Examples:

[0530] The server retrieves the information "Hobbies: Reading, Genre: Science fiction novels" from the database. The AI ​​engine generates a dialogue script that "recommends books related to science fiction novels." The server saves this dialogue script.

[0531] User interaction

[0532] The user inputs a question from the terminal, and the terminal sends the question to the server. The server analyzes the received question and generates a response based on the generated dialogue script. The server then sends the generated response to the terminal, and the terminal displays the response to the user.

[0533] Examples:

[0534] The user types, "What recent science fiction novels do you recommend?" The device sends this question to the server. Based on the dialogue script, the server generates a response: "I recommend the recently popular 'Future Seekers.'" The device then displays this response to the user.

[0535] AI-powered official celebrity accounts

[0536] The server receives speech and behavioral data provided by the operator of the celebrity's official account and stores it in a database. The server then activates an emotion engine to recognize the user's emotional state. The server then studies the celebrity's speech and behavioral data and extracts their features. An AI engine generates a dialogue script based on the user's emotional state recognized by the emotion engine and the extracted features. The server then uses the generated dialogue script to engage in a dialogue with the user.

[0537] Examples:

[0538] The server receives celebrity comment data, such as "comments about the latest movie," and stores it in a database. The emotion engine recognizes the user's emotional state as "excited." The AI ​​engine generates a dialogue script that "emphasizes the appeal of the movie to the excited user." The server uses this dialogue script to respond, "I'm also very satisfied with this movie. It was a new challenge for me, especially in terms of acting."

[0539] Prompt Sentence Examples

[0540] User information gathering prompt:

[0541] "Tell me about your hobbies and interests. For example, your favorite books, movies, music, etc."

[0542] AI prompt for celebrity official accounts:

[0543] "What do you think of the latest movie? Tell us what you think."

[0544] In this way, the system generates a dialogue script based on the user's information, realizing natural dialogue with the user.

[0545] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0546] Step 1: Collect user information

[0547] Input: A user accesses the system using a terminal and inputs information about their principles, beliefs, hobbies, etc.

[0548] Specific action: The user types, "My hobby is reading, especially science fiction novels."

[0549] Data processing: The terminal sends the entered information to the server.

[0550] Output: The server stores the received user information in a database.

[0551] Step 2: Generate the interaction script

[0552] Input: The server retrieves user information from the database.

[0553] Specific operation: The server retrieves the information "Hobbies: Reading, Genre: Science fiction novels" from the database.

[0554] Data calculation: The server starts the AI ​​engine and inputs the acquired user information. The AI ​​engine generates a dialogue script based on the user information.

[0555] Output: The generated dialogue script is saved on the server.

[0556] Step 3: User interaction

[0557] Input: The user types a question into the terminal.

[0558] What happens: The user types, "What's the best recent science fiction novel?" The device sends this question to the server.

[0559] Data calculation: The server analyzes the received question and generates a response based on the generated dialogue script.

[0560] Output: The server generates a response and sends it to the terminal, which displays it to the user.

[0561] Step 4: AI-powered official celebrity accounts

[0562] Input: The server receives statement and behavioral data provided by the operator of the celebrity's official account.

[0563] Specific operation: The server receives celebrity comment data, such as "comments about the latest movie," and stores it in a database.

[0564] Data calculation: The server activates the emotion engine and recognizes the user's emotional state. The server learns from celebrity speech and behavior data and extracts their characteristics. The AI ​​engine generates a dialogue script based on the user's emotional state recognized by the emotion engine and the extracted characteristics.

[0565] Output: The server uses the generated dialogue script to interact with the user.

[0566] Specific operation: The emotion engine recognizes the user's emotional state as "excited." The AI ​​engine generates a dialogue script that "emphasizes the appeal of the movie to the excited user." The server uses this dialogue script to respond, "I'm also very satisfied with this movie. I was able to take on new challenges, especially in terms of acting."

[0567] (Application example 2)

[0568] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0569] Conventional conversational AI systems have difficulty in providing a conversation that reflects the user's individual beliefs, thoughts, and hobbies, and also in providing a conversational experience that mimics the personality of a celebrity. Furthermore, they are unable to recognize the user's emotional state and generate appropriate responses, limiting the user experience. This has led to the issue of users being unable to obtain a realistic experience, such as interacting with a celebrity.

[0570] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0571] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI that can interact with the individual based on the learned information, means for using the generated AI to automatically respond to messages on SNS and respond according to relationships, means for learning data on celebrity statements and behavioral data, recognizing the user's emotional state, and generating a dialogue script, means for interacting with the user using the generated dialogue script, and means for providing the user with the experience of interacting with the celebrity through an application installed on a smartphone. This enables dialogue that reflects the user's individual principles, thoughts, and hobbies, and further provides a realistic dialogue experience that imitates the celebrity's personality.

[0572] "Personal principles, ideas, and hobbies" refer to an individual's beliefs, values, interests, and concerns.

[0573] "Learning means" refers to the process of collecting and analyzing data to extract patterns and features.

[0574] "AI capable of human-like interactions" refers to artificial intelligence that can reflect the individual characteristics of the user and engage in natural conversations.

[0575] "SNS automatic message response" refers to a function that automatically generates and replies to messages on social networking services.

[0576] "Responding based on the relationship" refers to taking appropriate responses and actions depending on the relationship with the user and the situation.

[0577] "Celebrity statement and behavior data" refers to records of public statements and behavior of celebrities.

[0578] "User's emotional state" refers to the emotions or moods that the user is currently experiencing.

[0579] A "dialogue script" refers to text data that defines the flow and content of a dialogue.

[0580] "Applications installed on a smartphone" refers to software programs that run on a smartphone.

[0581] A "celebrity interaction experience" refers to an interaction that makes users feel as if they are having a conversation with a celebrity.

[0582] A system for implementing this invention has the following configuration. First, the server has a means for learning an individual's principles, thoughts, hobbies, etc. This means analyzes data collected from the user and extracts the user's characteristics. Next, it has a means for generating an AI that can interact with the user in a way that is close to the user's personality based on the learned information. This AI reflects the user's characteristics and can engage in natural conversations.

[0583] Furthermore, the server has a means to use the generated AI to automatically respond to messages on social media and respond according to relationships, allowing users to enjoy natural conversations on social media. It also has a means to learn celebrity remarks and behavioral data, recognize the user's emotional state, and generate a dialogue script. This means combines celebrity data with the user's emotional state to generate an appropriate dialogue script.

[0584] The server also includes means for interacting with the user using the generated dialogue script. This means interacts with the user based on the generated dialogue script, providing the user with the experience of interacting with the celebrity. The server also includes means for providing the user with the experience of interacting with the celebrity through an application installed on the smartphone. This application provides the user with the experience of interacting with the celebrity through the smartphone.

[0585] As a specific example, consider the case where a user asks their favorite actor, "How are you spending your day?" In this case, the server recognizes the user's emotional state as "joy" and generates a dialogue script based on the celebrity's speech and behavior data. Based on the generated dialogue script, the application provides the user with a response such as, "I'm filming a movie today, so I'm having a great day!"

[0586] An example prompt is:

[0587] User's emotional state: joy

[0588] Celebrity data: Actors' statements and actions

[0589] User Input: How are you spending your day?

[0590] response:

[0591] In this way, users can have a realistic experience of interacting with celebrities. The system is implemented using Python and the OpenAI API. Specifically, it uses OpenAI's Completion.create method to generate responses based on prompts. The hardware used is a smartphone with an internet connection.

[0592] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0593] Step 1:

[0594] The server collects data such as the user's beliefs, thoughts, and hobbies.

[0595] Input: Data about the user's principles, thoughts, and hobbies

[0596] Output: Collected user data

[0597] Specific operation: The server collects data from users' survey responses and social media posts, and stores it in a database.

[0598] Step 2:

[0599] The server analyzes the collected data and extracts user characteristics.

[0600] Input: Collected user data

[0601] Output: User feature data

[0602] Specific operation: The server analyzes the text data using natural language processing technology to identify the user's principles, thoughts, and hobbies.

[0603] Step 3:

[0604] The server generates an AI that can interact with the user based on their characteristic data.

[0605] Input: User feature data

[0606] Output: User-specific AI model

[0607] Specific operation: The server uses the generative AI model to generate a dialogue script that reflects the user's characteristics and builds the AI ​​model.

[0608] Step 4:

[0609] The server uses the generated AI to automatically respond to messages on social media and take action based on relationships.

[0610] Input: Message from user

[0611] Output: AI-generated automated response message

[0612] Specific operation: The server receives a message from the user, uses the generated AI model to generate an appropriate response, and sends it back.

[0613] Step 5:

[0614] The server learns from celebrity speech and behavior data, recognizes the user's emotional state, and generates a dialogue script.

[0615] Input: celebrity statement data, behavioral data, user emotional state

[0616] Output: Interactive script

[0617] Specific operation: The server analyzes the celebrity data, recognizes the user's emotional state using an emotion engine, and generates a dialogue script based on this data.

[0618] Step 6:

[0619] The server uses the generated dialogue script to interact with the user.

[0620] Input: Interactive script, input from user

[0621] Output: Response message to the user

[0622] Specific operation: The server generates a response to the input from the user based on the dialogue script and provides it to the user.

[0623] Step 7:

[0624] The device (smartphone) allows users to interact with celebrities through installed applications.

[0625] Input: Input from the user, response message from the server

[0626] Output: The interactive experience for the user

[0627] Specific operation: The terminal sends input from the user to the server, receives a response message from the server, and displays it to the user.

[0628] Example 3

[0629] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0630] Conventional AI systems have had difficulty learning an individual's principles, thoughts, hobbies, etc. and interacting with them in a way that reflects their personality. Furthermore, there were a lack of means to turn celebrities' official accounts into AI, customize avatars, and enable interactions in virtual spaces. Furthermore, there were no systems that could recognize the user's emotional state and change the avatar's facial expressions and movements accordingly. To solve these issues, a new system is needed.

[0631] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0632] In this invention, the server includes: means for learning an individual's principles, thoughts, hobbies, etc.; means for generating a generative AI model capable of interacting in a manner similar to that individual's personality based on the learned information; means for using the generated generative AI model to provide automatic message responses for communication network services and to respond according to relationships; means for collecting and analyzing the celebrity's speech data and behavioral data; means for generating a dialogue script that imitates the celebrity's personality based on the analysis results; means for controlling the avatar's movements and facial expressions using the generated dialogue script; means for customizing the avatar's appearance and equipment using non-fungible tokens; means for placing the avatar in a virtual space and enabling interaction with other users; and means for recognizing the user's emotional state using an emotion engine and changing the avatar's facial expressions and movements. This enables the generation of AI capable of interacting in a manner similar to that of an individual's personality, the AIization of official celebrity accounts, avatar customization, interaction in virtual spaces, and changes in the avatar's facial expressions and movements according to the user's emotional state.

[0633] "Means for learning about an individual's principles, thoughts, hobbies, etc." refers to technology that collects data on an individual's statements and behavior, and analyzes that data to understand the individual's values ​​and interests.

[0634] A "generative AI model" is an artificial intelligence model that mimics the personality and speech patterns of a specific individual based on collected and analyzed data.

[0635] "Communications Network Services" means messaging and social networking services provided over the Internet or other communications networks.

[0636] "Automatic message response" is a function that automatically generates responses to messages from users using pre-set rules or AI.

[0637] "Relationship-based response" is a function that selects appropriate responses and actions based on the relationship with the user and past interactions.

[0638] "Means for collecting data on celebrity statements and behavior" refers to technology for collecting data on publicly available statements and behavior of celebrities.

[0639] "Means of analysis" refers to techniques for analyzing collected data and extracting specific patterns or features.

[0640] The "means for generating a dialogue script" is a technology for generating a script for conducting natural dialogue based on the analysis results.

[0641] "Means for controlling the avatar's movements and facial expressions" refers to a technology that controls the avatar's movements and facial expressions in real time based on the generated dialogue script.

[0642] A "non-fungible token" is a token that uses blockchain technology to prove ownership of digital assets.

[0643] "Means for customizing avatar appearance and equipment" refers to technology for changing avatar appearance and equipment using non-fungible tokens.

[0644] A "virtual space" is a three-dimensional digital space generated by computer simulation.

[0645] An "emotion engine" is a technology that recognizes the user's emotional state and adjusts the system's behavior accordingly.

[0646] "Means for recognizing the user's emotional state" refers to technology that analyzes emotions from the user's facial expressions, voice, etc., and identifies their current emotional state.

[0647] "Means for changing the facial expressions and movements of an avatar" refers to technology that changes the facial expressions and movements of an avatar in real time according to the user's emotional state.

[0648] This invention is a system that learns an individual's principles, thoughts, hobbies, etc., and generates a generative AI model that can interact with them in a way that closely resembles their personality, automatically responding to messages on communication network services and responding to relationships. It can also collect and analyze celebrity speech and behavioral data to generate dialogue scripts that mimic their personality and control the avatar's movements and facial expressions. Furthermore, non-fungible tokens can be used to customize the avatar's appearance and equipment, enabling interaction in virtual spaces. An emotion engine can also recognize the user's emotional state and change the avatar's facial expressions and movements.

[0649] Hardware and software used

[0650] 1. Server

[0651] Data collection: The server collects celebrity comment and behavior data through APIs and database connections, such as the Twitter API.

[0652] Data analysis: The server analyzes the collected data using a Python NLP library (e.g., spaCy) to extract utterance frequencies and patterns.

[0653] Generative AI model: The server generates a dialogue script using a generative AI model (e.g., GPT-4) based on the analysis results.

[0654] 2. Terminal

[0655] Avatar creation and customization: The device uses 3D modeling software (e.g., Blender) to control the avatar's movements and facial expressions based on the generated dialogue script. Users can also customize the avatar's appearance and equipment using non-fungible tokens through a dedicated UI.

[0656] 3. Users

[0657] Interaction in the Metaverse: Users interact with other users through metaverse platforms (e.g., VRChat, Decentraland). Users access the virtual space using a VR headset or PC.

[0658] Use of emotion engine: To recognize the user's emotional state, an emotion engine (e.g., Affectiva) is used to change the avatar's facial expressions and movements in real time.

[0659] Specific examples

[0660] For example, if you want to create an AI for a celebrity's official account, you can input the following prompt into the generative AI model:

[0661] Prompt Sentence Examples

[0662] "Hi, I'm [celebrity name]. What would you like to talk about today?"

[0663] Based on this prompt, the generative AI model generates a dialogue script that mimics the celebrity's speech patterns. The dialogue script is then used in conjunction with 3D modeling software to control the avatar's movements and facial expressions, allowing it to engage in natural dialogue with other users in the Metaverse.

[0664] This system makes it possible to generate AI capable of interacting with people in a way that closely resembles their personalities, turn celebrities' official accounts into AI, customize avatars, interact in virtual spaces, and change the avatar's facial expressions and movements according to the user's emotional state. The flow of the identification process in Example 3 will be explained with reference to Figure 21.

[0665] Step 1:

[0666] Data collection

[0667] The server collects comment data and behavioral data provided by operators of the celebrities' official accounts. Specifically, the server obtains text data and metadata through APIs and database connections. For example, the server collects tweets from celebrities using the Twitter API.

[0668] Input: Celebrity's official account API key

[0669] Output: Celebrity statements and behavior data

[0670] Step 2:

[0671] Data analysis

[0672] The server uses natural language processing (NLP) techniques to analyze the collected data. Specifically, the server uses a Python NLP library (e.g., spaCy) to tokenize the text data and extract utterance frequencies and patterns.

[0673] Input: Celebrity statements and behavior data

[0674] Output: Analysis of speech frequency and patterns

[0675] Step 3:

[0676] Generating AI models

[0677] The server generates a dialogue script using a generative AI model (e.g., GPT-4) based on the analysis results. Specifically, the server inputs the prompt sentence into the generative AI model and saves the output dialogue script.

[0678] Input: Analysis results of speech frequency and patterns, prompt text

[0679] Output: Interactive script

[0680] Step 4:

[0681] Avatar creation and customization

[0682] The device then connects the generated dialogue script to 3D modeling software (e.g., Blender) to control the avatar's movements and facial expressions. Users can customize their avatar's appearance and equipment using non-fungible tokens. Specifically, the device uses Blender's API to manipulate the avatar's modeling data, and users select and apply NFTs through a dedicated UI.

[0683] Input: Dialogue script, non-fungible token

[0684] Output: A customized avatar

[0685] Step 5:

[0686] Interaction in the Metaverse

[0687] The server places customized avatars in the metaverse space. Users can interact with other users through the metaverse platform (e.g., VRChat, Decentraland). Specifically, the server places avatars using the metaverse platform's API, and users access the metaverse space using a VR headset or PC.

[0688] Input: Your customized avatar

[0689] Output: Interaction in the Metaverse

[0690] Step 6:

[0691] Emotion engine integration

[0692] The server uses an emotion engine to recognize the user's emotional state. Specifically, the server changes the avatar's facial expressions and movements in real time based on the output of the emotion engine. For example, the server obtains the user's emotional data using Affectiva's API and changes the avatar's facial expressions using Blender's API.

[0693] Input: User emotion data

[0694] Output: Avatar's facial expressions and movements change according to emotions

[0695] (Application example 3)

[0696] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0697] Conventional AI systems have difficulty in providing personalized dialogue based on individual beliefs, ideologies, and hobbies, limiting the user experience. Furthermore, they are unable to recognize the user's emotions and change the avatar's facial expressions and movements in virtual spaces, preventing realistic communication. Furthermore, there has been no system available for customizing avatars using NFTs or for integrating virtual space interactions, resulting in low user convenience.

[0698] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0699] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI capable of interacting with the individual based on the learned information, means for using the generated AI to automatically respond to messages on social media and respond according to relationships, means for turning the generated AI into an avatar and enabling customization using NFTs and interaction in a virtual space, means for recognizing a user's emotions and changing the avatar's facial expressions and movements accordingly, means for recognizing the user's emotions using a camera, and means for placing the avatar in a virtual space. This allows users to enjoy personalized interactions and enables realistic communication according to emotions, and further allows for integrated avatar customization using NFTs and interaction in a virtual space.

[0700] "Personal principles, ideas, and hobbies" refers to an individual's beliefs, ways of thinking, and areas of interest and concern.

[0701] "Means of learning" refers to the methods and techniques used to collect and analyze data to acquire knowledge.

[0702] "AI capable of human-like interactions" refers to artificial intelligence that can imitate the personality and behavioral patterns of a specific individual and engage in conversations similar to that individual's.

[0703] "Generative means" refers to methods and techniques for creating new data and models for specific purposes.

[0704] "Automatic message responses on social networking services" refers to a function on social networking services that automatically replies to messages from users.

[0705] "Relationship-based response" refers to taking appropriate responses and actions based on the relationship with the user and the situation.

[0706] "Avatarization" refers to the representation of artificial intelligence or digital characters as virtual people or characters.

[0707] "NFT" stands for Non-Fungible Token and refers to a token that uses blockchain technology to prove ownership of digital assets.

[0708] "Customization" refers to changing specific features or appearance according to the user's preferences and requirements.

[0709] "Virtual space" refers to a digital environment that is different from reality and is created using computer technology.

[0710] "Means of recognizing emotions" refers to technologies and methods for analyzing and understanding a user's emotions from facial expressions, tone of voice, etc.

[0711] "Means for changing facial expressions and movements" refers to techniques and methods for changing an avatar's facial expressions and body movements based on recognized emotions.

[0712] "Means for recognizing a user's emotions using a camera" refers to technologies or methods for capturing a user's facial expressions using a camera and analyzing the data to recognize emotions.

[0713] "Means for placing an avatar in a virtual space" refers to the technology or method for displaying an avatar in a digital virtual environment and allowing it to interact with other users.

[0714] A system for implementing the present invention has the following configuration.

[0715] System Configuration

[0716] 1. Server

[0717] Learning method: The server collects and analyzes data such as an individual's principles, thoughts, and hobbies to learn. Specifically, it uses social media posts and past interaction history.

[0718] Generation method: Based on the learned information, an AI capable of interacting with the individual in a manner that closely resembles their personality is generated. The OpenAI API is used to learn from utterance data and generate a dialogue script.

[0719] Automated Responses: The generated AI is used to generate automated social media message responses and relationship-based responses, allowing users to receive personalized responses in real time.

[0720] Avatarization method: The generated AI is turned into an avatar, allowing customization using NFTs and interaction in virtual spaces. Linking with 3D modeling software controls the avatar's movements and facial expressions.

[0721] Emotion recognition: Recognizes the user's emotions and changes the avatar's facial expressions and movements accordingly. OpenCV and dlib are used to analyze the user's emotions from the camera footage.

[0722] Virtual space placement method: Place avatars in the virtual space and enable interaction with other users. Use MetaverseConnector to place and operate avatars in the virtual space.

[0723] Hardware and Software

[0724] Hardware: Smartphone, head-mounted display, camera

[0725] Software: OpenAI API, OpenCV, dlib, NFTCustomizer, MetaverseConnector

[0726] Processing flow

[0727] The server first collects data such as an individual's principles, thoughts, and hobbies, and analyzes and learns from it. Next, based on the learned information, it generates an AI capable of interacting with the individual's personality. This AI responds automatically to messages on social media and responds according to relationships. The generated AI is then turned into an avatar, allowing for customization using NFTs and interaction in virtual space. It also recognizes the user's emotions and changes the avatar's facial expressions and movements accordingly. Finally, the avatar is placed in virtual space, enabling interaction with other users.

[0728] Specific examples

[0729] When a user accesses the virtual store using their smartphone, an AI avatar of a celebrity appears and asks the user, "Hello! What products are you looking for today?" When the user smiles at the camera, the avatar also smiles and introduces the products in a more friendly manner.

[0730] Prompt Sentence Examples

[0731] Celebrity quote data: "Hello, what product are you looking for today?"

[0732] Generate a dialogue script based on this data.

[0733] In this way, users can enjoy personalized interactions, enabling realistic communication based on their emotions, and even customizing avatars using NFTs and interacting in virtual spaces in an integrated manner.

[0734] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0735] Step 1:

[0736] The server collects data such as individuals' beliefs, thoughts, and hobbies. Specifically, it collects social media posts and past interaction history, and stores this in a database. The input is individual data, and the output is a dataset for analysis.

[0737] Step 2:

[0738] The server analyzes the collected data and learns characteristics such as an individual's principles, thoughts, and hobbies. Specifically, it analyzes text data using natural language processing technology and extracts features. The input is a dataset, and the output is learned feature data.

[0739] Step 3:

[0740] The server generates an AI that can interact with the individual based on the learned feature data. It uses the OpenAI API to learn the utterance data and generate a dialogue script. The input is the feature data, and the output is the dialogue script.

[0741] Step 4:

[0742] The server uses the generated AI to respond to SNS messages automatically and according to the relationship. Specifically, it receives messages from users and generates automatic responses based on the dialogue script. The input is the message from the user, and the output is the automatic response message.

[0743] Step 5:

[0744] The server turns the generated AI into an avatar, allowing for customization using NFTs and interaction in the virtual space. It works in conjunction with 3D modeling software to control the avatar's movements and facial expressions. The input is a dialogue script and NFT data, and the output is a customized avatar.

[0745] Step 6:

[0746] The server recognizes the user's emotions and changes the avatar's facial expressions and movements accordingly. It uses OpenCV and dlib to analyze the user's emotions from the camera footage. The input is the camera footage, and the output is the recognized emotion data.

[0747] Step 7:

[0748] The server controls the avatar's facial expressions and movements based on the recognized emotional data. Specifically, it changes the avatar's facial expressions and movements in real time according to the emotional data. The input is the emotional data, and the output is the changed avatar's facial expressions and movements.

[0749] Step 8:

[0750] The server places avatars in the virtual space and enables interaction with other users. MetaverseConnector is used to place and operate avatars in the virtual space. The input is a customized avatar, and the output is the placement of the avatar in the virtual space.

[0751] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0752] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0753] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[0754] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0755] [Second embodiment]

[0756] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0757] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0758] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0759] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0760] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0761] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0762] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0763] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0764] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0765] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0766] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0767] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0768] "Example 1"

[0769] In one embodiment of the present invention, an AI engine is used to collect and analyze data such as user social media posts, purchase history, and browsing history as a means for AI to learn about an individual's principles, thoughts, hobbies, etc. This AI engine uses natural language processing technology and machine learning technology to extract and learn about the user's principles, thoughts, hobbies, etc.

[0770] "Example 2"

[0771] Next, as a means of generating AI that can interact with users in a manner similar to their personality based on the learned information, an AI engine is used to generate a dialogue script that reflects the user's principles, thoughts, hobbies, etc. This AI engine then uses the generated dialogue script to converse with the user. Specifically, in response to questions from the user, the AI ​​engine generates a response based on the generated dialogue script and sends it back to the user.

[0772] "Example 3"

[0773] Furthermore, as a means of using the generated AI to turn official celebrity accounts into AI, the AI ​​will learn from the celebrity's remarks and behavioral data provided by the operator of the celebrity's official account and generate an AI that mimics the celebrity's personality. Specifically, the AI ​​will analyze the celebrity's remarks and behavioral data and extract their characteristics. Based on the extracted characteristics, it will generate a dialogue script that mimics the celebrity's personality and use it to dialogue with users.

[0774] "Example 4"

[0775] In addition, the generated AI is turned into an avatar, and 3D modeling software linked to the AI ​​engine is used as a means to enable customization using NFTs and interaction in the Metaverse space. Specifically, the avatar's movements and facial expressions are controlled using dialogue scripts generated by the AI ​​engine. It is also possible to customize the avatar's appearance and equipment using NFTs. Furthermore, this avatar can be placed in the Metaverse space, enabling interaction with other users.

[0776] The processing flow of each embodiment will be described below.

[0777] "Example 1"

[0778] Step 1: The AI ​​engine collects data such as the user's social media posts, purchase history, and browsing history.

[0779] Step 2: The AI ​​engine analyzes the collected data and uses natural language processing and machine learning technologies to extract and learn about the user's principles, thoughts, hobbies, etc.

[0780] "Example 2"

[0781] Step 1: Based on the information it has learned, the AI ​​engine generates a dialogue script that reflects the user's beliefs, thoughts, hobbies, etc.

[0782] Step 2: The AI ​​engine uses the generated dialogue script to converse with the user. Specifically, it generates a response to a question from the user based on the generated dialogue script and sends it back to the user.

[0783] "Example 3"

[0784] Step 1: The AI ​​engine learns from the celebrity's statement and behavioral data provided by the operator of the celebrity's official account.

[0785] Step 2: Analyze the learned data and extract its features.

[0786] Step 3: Based on the extracted features, a dialogue script that mimics the celebrity's personality is generated and used to engage in dialogue with the user.

[0787] "Example 4"

[0788] Step 1: Using 3D modeling software linked to an AI engine, the avatar's movements and facial expressions are controlled using the dialogue script generated by the AI ​​engine.

[0789] Step 2: Customize your avatar's appearance and gear with NFTs.

[0790] Step 3: Place this avatar in the Metaverse space and allow it to interact with other users.

[0791] Example 1

[0792] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0793] In modern society, there is a demand for accurate understanding of individuals' principles, thoughts, hobbies, etc., and for the provision of personalized services based on these. However, conventional systems have had difficulty effectively collecting and analyzing diverse user data and responding to individual needs. It has also been difficult to generate AI capable of interacting with users in a way that closely resembles their personality, and to use it for automated message responses on social media or responses based on relationships. This has hindered improvements to the user experience and efficient communication.

[0794] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes: means for collecting data such as user postings, purchase history, and browsing history; means for preprocessing the collected data; means for analyzing the preprocessed data and extracting the user's principles, thoughts, and hobbies; means for saving the extracted information and displaying it to the user; means for generating an AI capable of interacting with the user in a manner that is similar to the user's personality based on the learned information; and means for using the generated AI to automatically respond to messages and respond according to relationships. This makes it possible to effectively collect and analyze a variety of user data and respond according to individual needs. Furthermore, by generating an AI capable of interacting with the user in a manner that is similar to the user's personality and using it for automatic message responses and responses according to relationships on SNS, an improved user experience and more efficient communication can be achieved.

[0795] "User" refers to any individual or entity that uses the System.

[0796] "Posted content" refers to information such as text, images, and videos posted by users on platforms such as social networking services (SNS).

[0797] "Purchase history" refers to historical information about products purchased by a user online or offline.

[0798] "Browsing history" refers to the history information of web pages and search queries that a user has viewed on the Internet.

[0799] "Means of collecting data" refers to methods and technologies for obtaining data such as user postings, purchase history, and browsing history.

[0800] "Data preprocessing means" refers to methods and techniques for converting collected data into a format that is easier to analyze.

[0801] "Means for analyzing data" refers to methods and techniques for extracting useful information from pre-processed data.

[0802] "Ideas, thoughts, and hobbies" refers to the user's personal beliefs, ways of thinking, interests, and concerns.

[0803] "Means for storing information" refers to the methods and techniques for storing extracted information in a storage device such as a database.

[0804] "Means for displaying information" refers to the methods and techniques for visually presenting stored information to a user.

[0805] "Means for generating AI" refers to methods and technologies for creating artificial intelligence based on the user's principles, ideas, and hobbies.

[0806] "Automatic message response" refers to a feature in which AI automatically responds to messages on behalf of the user.

[0807] "Responding based on relationships" refers to a function that takes appropriate action based on the user's relationship with other individuals or organizations.

[0808] This invention is a system that collects and analyzes data such as user postings, purchase history, and browsing history to extract the user's principles, thoughts, and hobbies. Furthermore, based on the extracted information, it generates an AI that can interact with the user in a way that closely resembles their personality, and this AI can be used to automatically respond to messages and take actions based on relationships.

[0809] The server first collects user data. Specifically, it uses the API of a social networking service to obtain social media posts, and the API of an e-commerce platform to obtain purchase history. It also uses a web analytics tool to collect browsing history. Specific software, such as Twitter API, Facebook Graph API, Amazon API, and Google Analytics, is used to collect this data.

[0810] The server then preprocesses the collected data, which includes cleaning the text data, tokenizing it, removing stop words, etc., using the Python libraries spaCy and NLTK.

[0811] The server sends the preprocessed data to the AI ​​engine. The AI ​​engine analyzes the data using natural language processing (NLP) and machine learning technologies. Specifically, it uses NLP libraries such as spaCy and NLTK, and TensorFlow and PyTorch for machine learning. The AI ​​engine extracts information such as beliefs, thoughts, and hobbies from users' posts, purchase history, and browsing history.

[0812] For example, if a user posts on Twitter, "I've been thinking a lot about environmental protection lately," purchases eco-friendly products on an e-commerce platform, and searches for "activities for environmental protection" on a search engine, the server collects this data and sends it to the AI ​​engine, which analyzes the data and determines that the user has a strong interest in environmental protection.

[0813] The generated AI can respond to messages automatically and according to the user's beliefs, thoughts, and hobbies. For example, if a user receives a question on social media, the AI ​​can automatically generate an appropriate response on the user's behalf.

[0814] Examples of prompts to be input to a generative AI model include:

[0815] Analyze a user's social media posts, purchase history, and browsing history to extract the user's principles, thoughts, and hobbies. For example, if a user frequently posts about "environmental protection," purchases eco-friendly products, and searches for information about environmental protection, determine that the user is interested in environmental protection.

[0816] In this way, the processing of the system program will be explained in detail while clarifying the roles of the server, terminal, and user.

[0817] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0818] Step 1: Data collection

[0819] The server collects data such as user posts, purchase history, and browsing history. Specifically, it uses the API of a social networking service to obtain SNS posts, and the API of an e-commerce platform to obtain purchase history. It also uses a web analytics tool to collect browsing history. The input is various user data sources, and the output is the collected raw data.

[0820] Step 2: Data Preprocessing

[0821] The server preprocesses the collected data. Specifically, it cleans the text data (removes unnecessary characters and symbols), tokenizes it (divides it into words), and removes stop words (removes frequently occurring but meaningless words). For this, it uses the Python libraries spaCy and NLTK. The input is the collected raw data, and the output is the preprocessed, clean data.

[0822] Step 3: Data analysis

[0823] The server sends the preprocessed data to the AI ​​engine, which analyzes the data using natural language processing (NLP) and machine learning technologies. Specifically, it uses NLP libraries such as spaCy and NLTK, and machine learning libraries such as TensorFlow and PyTorch. The input is preprocessed, clean data, and the output is information about the user's principles, thoughts, and hobbies.

[0824] Step 4: Save your information

[0825] The server stores the analysis results obtained from the AI ​​engine in a database. The input is the analysis results, and the output is the information stored in the database.

[0826] Step 5: Viewing information

[0827] Users can check information about their principles, beliefs, and hobbies through their devices. Specifically, the results are displayed through a web application. The input is the information stored in the database, and the output is the information displayed to the user.

[0828] Step 6: Generate AI

[0829] The server generates an AI that can interact with the user based on the learned information. The input is information about the user's principles, thoughts, and hobbies, and the output is the generated AI.

[0830] Step 7: Automated Message Responses

[0831] The generated AI responds to messages automatically on behalf of the user and responds based on the relationship. Specifically, it automatically generates appropriate responses to questions on social media. The input is a message from the user, and the output is an automatic response from the AI.

[0832] (Application example 1)

[0833] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0834] Modern advertising systems face the challenge of being unable to display advertisements that are optimized for a user's individual beliefs, beliefs, and hobbies. Conventional advertising systems display advertisements based on general demographic information and past behavioral history, which does not adequately reflect a user's individual interests. As a result, advertisements that are not appealing to users are often displayed, resulting in reduced advertising effectiveness.

[0835] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0836] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI that can interact with the individual based on the learned information, means for using the generated AI to automatically respond to messages on SNS and take actions according to relationships, means for collecting data such as the content of users' SNS posts, purchase history, and browsing history, and analyzing this data, and means for displaying advertisements optimized for the user's principles, thoughts, and hobbies based on the analysis results. This makes it possible to display advertisements optimized for the individual interests and concerns of the user.

[0837] "Personal principles, ideas, and hobbies" refers to the specific beliefs, ways of thinking, interests, and concerns of the user.

[0838] "Means of learning" refers to methods and technologies for collecting and analyzing user data to understand user characteristics.

[0839] "AI capable of human-like interactions" refers to artificial intelligence that can have natural conversations with users based on their characteristics.

[0840] "Means of generation" refers to methods and techniques for creating artificial intelligence for specific purposes.

[0841] "Automatic message responses on social networking services" refers to a function that automatically responds to messages on behalf of users on social networking services.

[0842] "Responding according to the relationship" refers to taking appropriate action based on the user's relationship with other users.

[0843] "Means of collecting data" refers to the methods and technologies used to collect information such as users' social media posts, purchase history, and browsing history.

[0844] "Means for analyzing data" refers to methods and technologies for analyzing collected data and extracting user characteristics.

[0845] "Means for displaying advertisements" refers to methods and technologies for displaying advertisements optimized for users based on the analysis results.

[0846] The system for implementing the present invention learns the user's personal principles, thoughts, hobbies, etc., and displays advertisements optimized based on the information. A specific embodiment of this system will be described below.

[0847] First, the server collects data such as the user's social media posts, purchase history, and browsing history. This involves using APIs to obtain data from various platforms. For example, the server uses the API of a social media platform to obtain the user's posts, and the API of an e-commerce site to obtain the user's purchase history.

[0848] The server then preprocesses the collected data, which involves using natural language processing techniques to tokenize the text data and remove stop words, reducing noise in the data and improving the accuracy of the analysis.

[0849] The server then analyzes the preprocessed data, which involves using machine learning techniques to extract the user's principles, thoughts, and hobbies. Specifically, it uses TF-IDF vectorization and KMeans clustering to cluster the user's characteristics.

[0850] Based on the analysis results, the server selects advertisements that are optimized for the user's principles, beliefs, and hobbies, including selecting appropriate advertisements from an advertisement database. The selected advertisements are then displayed on the user's device.

[0851] In implementing this system, the following hardware and software are used:

[0852] Hardware: Servers, user devices (smartphones, tablets, PCs, etc.)

[0853] Software: Natural language processing libraries (e.g., nltk), machine learning libraries (e.g., scikit-learn), API client libraries (e.g., requests)

[0854] As a concrete example, the execution result for the user ID "12345" is shown below. The server collects the SNS posting content, purchase history, and browsing history of the user ID "12345," extracts the user's principles, thoughts, and hobbies, and displays the most appropriate advertisement.

[0855] Example prompts to input to the generative AI model:

[0856] Please create a program that collects the social media posts, purchase history, and browsing history of user ID "12345," extracts the user's principles, thoughts, and hobbies, and displays the most appropriate advertisements.

[0857] In this way, a system can be realized that displays optimal advertisements based on individual user data.

[0858] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0859] Step 1:

[0860] The server collects the user's social media posts. Specifically, it uses the social media platform's API to obtain the post data corresponding to the user ID. The input is the user ID, and the output is the user's post data.

[0861] Step 2:

[0862] The server collects the user's purchase history. Specifically, it uses the API of the e-commerce site to obtain purchase history data corresponding to the user ID. The input is the user ID, and the output is the user's purchase history data.

[0863] Step 3:

[0864] The server collects the user's browsing history. Specifically, it uses the browser's API to obtain browsing history data corresponding to the user ID. The input is the user ID, and the output is the user's browsing history data.

[0865] Step 4:

[0866] The server preprocesses the collected data. Specifically, it uses natural language processing technology to tokenize the text data and remove stop words. The input is the collected data on social media posts, purchase history, and browsing history, and the output is the preprocessed text data.

[0867] Step 5:

[0868] The server analyzes the preprocessed data. Specifically, it uses TF-IDF vectorization and KMeans clustering to extract the user's principles, thoughts, and hobbies. The input is the preprocessed text data, and the output is the clustering results of the user's principles, thoughts, and hobbies.

[0869] Step 6:

[0870] The server selects the optimal advertisement based on the analysis results. Specifically, it selects the advertisement that best suits the user's clustering results from the advertisement database. The input is the clustering results, and the output is the optimized advertisement data.

[0871] Step 7:

[0872] The server displays the selected advertisement on the user's device. Specifically, it sends advertisement data to the user's device and displays it. The input is the optimized advertisement data, and the output is the advertisement displayed on the user's device.

[0873] Example 2

[0874] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0875] Conventional conversational AI systems have had difficulty generating responses that fully reflect a user's personality and interests. Furthermore, they lacked the means to effectively utilize information such as the user's principles, thoughts, and hobbies, resulting in a uniform and lacking individuality in their interactions with the user. Furthermore, customization and flexibility were also issues when using the generated AI for official celebrity accounts or virtual interactions.

[0876] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0877] In this invention, the server includes a means for collecting personal principles, thoughts, hobbies, etc., a means for generating a dialogue script using a generative AI model based on the collected information, and a means for generating responses to questions from the user using the generated dialogue script and returning the responses to the user, thereby enabling the generation of responses that reflect the user's personality and interests.

[0878] "Means for collecting personal principles, thoughts, hobbies, etc." refers to a method or device for collecting information such as a user's principles, thoughts, hobbies, etc. from data provided by the user and past interaction history.

[0879] A "generative AI model" is an artificial intelligence model that generates dialogue scripts based on collected information, and is, for example, a model that uses natural language processing technology.

[0880] A "dialogue script" is a script for generating dialogue content that reflects the user's personality and interests, and is created by a generative AI model.

[0881] "Means for generating a response to a question from a user and sending it back to the user" refers to a method or device for generating an appropriate response to a question sent by the user through a terminal based on a generated dialogue script and sending that response to the user.

[0882] "AI-based celebrity official accounts" refers to using generated AI on celebrity official accounts to automatically respond to messages and take action based on relationships.

[0883] "Avatarization" refers to the process of representing the generated AI as a virtual character, making it visually recognizable to users.

[0884] "Digital assets" refer to customizable items, tokens, etc. that can be used in virtual spaces or on digital platforms.

[0885] "Virtual interaction" refers to a user using generated AI to interact with other users and engage in activities within a virtual reality or augmented reality environment.

[0886] The present invention is a system for generating a dialogue script that reflects the user's principles, thoughts, hobbies, etc., and for engaging in a dialogue with the user. A specific embodiment of this system will be described below.

[0887] The server first collects information about the user, such as their beliefs, thoughts, and hobbies. This information is obtained from data provided by the user and from past conversation history. For example, if a user enters "environmentalism," "pacifism," and "movie appreciation" as profile information, that information is stored in the database.

[0888] Next, the server uses the collected information to generate a dialogue script using a generative AI model (for example, a model using natural language processing technology). Prompts containing the user's principles, thoughts, and hobbies are input to the generative AI model, which then generates a dialogue script that reflects the user's personality.

[0889] Specific prompt examples:

[0890] User Information:

[0891] Principle: Environmentalism

[0892] Ideology: Pacifism

[0893] Hobbies: Watching movies, reading

[0894] An example of the generated interactive script:

[0895] "Hello, what movie would you like to watch today? I know you like environmentally themed movies."

[0896] When a user sends a question via a device (such as a smartphone or PC), the server references the stored dialogue script and generates an appropriate response. A generative AI model is used to generate a response to the user's question.

[0897] Specific response generation examples:

[0898] User Question: What recent movies would you recommend?

[0899] Generates an example response:

[0900] "A recent movie I recommend is 'Don't Look Up.' This movie deals with environmental issues, and I think it will resonate with your environmentalism. It also has a humorous story that you can enjoy."

[0901] The server sends the generated response to the user's terminal, which displays the received response. The user can check the displayed response and ask the next question.

[0902] This system generates dialogue scripts that reflect the user's personality and interests, and by engaging in dialogue with the user, it is possible to provide more personalized responses. The generated AI can also be used to power the official accounts of celebrities and for interactions in virtual spaces. This allows users to utilize the generated AI model in a variety of scenarios.

[0903] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0904] Step 1:

[0905] The server collects information such as the user's beliefs, thoughts, and hobbies. It receives data provided by the user through their device and past interaction history as input, and stores this information in a database. Specifically, it provides a form for the user to enter profile information, and stores the input in the database.

[0906] Step 2:

[0907] The server uses a generative AI model to generate a dialogue script based on the collected information. Information such as the user's principles, thoughts, and hobbies stored in a database is used as input. A prompt containing this information is input to the generative AI model, which then outputs a dialogue script that reflects the user's personality. Specifically, the server sends a prompt to the generative AI model and receives the generated dialogue script.

[0908] Step 3:

[0909] The user sends a question through the terminal. The question entered by the user is received as input. Specifically, the user enters a question through the chat interface, and the question is sent to the server.

[0910] Step 4:

[0911] When the server receives a question from a user, it references the saved dialogue script and generates an appropriate response. It uses the user's question and dialogue script as input. It uses a generative AI model to generate a response to the user's question and obtains the response as output. Specifically, it inputs the question and dialogue script into the generative AI model and receives the generated response.

[0912] Step 5:

[0913] The server sends the generated response to the user's terminal, uses the generated response as input, and specifically sends the generated response to the user's terminal and displays it on the user's chat interface.

[0914] Step 6:

[0915] The user can check the response displayed on the terminal and ask the next question. The displayed response is used as input. Specifically, the user reads the displayed response and inputs the next question.

[0916] (Application example 2)

[0917] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0918] Traditional personalized shopping experiences have been unable to fully reflect the individual characteristics of users, such as their beliefs, thoughts, and hobbies, making it difficult to recommend the most suitable products for them. Furthermore, when interacting with users, only generic responses were provided, which prevented users from increasing satisfaction. This made it difficult to stimulate users' purchasing desire.

[0919] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0920] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI that can interact with the user based on the learned information, means for using the generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies, and means for responding to the user's questions based on the generated dialogue script. This makes it possible to provide optimal product suggestions that reflect the individual characteristics of the user and a high level of satisfaction in dialogue with the user.

[0921] "Means of learning about personal beliefs, thoughts, hobbies, etc." refers to a method for collecting users' values ​​and interests and analyzing data based on them.

[0922] "Means for generating AI that can interact with a user in a manner similar to their personality based on learned information" refers to a method for creating artificial intelligence that can interact with a user in a manner similar to their personality based on collected user information.

[0923] "Means of using generated AI to automatically respond to messages on social media and take actions based on the relationship" refers to a method of using generated artificial intelligence to automatically reply to messages on social networking services and take actions based on the relationship with the user.

[0924] "Means for using generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies" refers to a method that uses generated artificial intelligence to suggest individually optimized products based on the user's values ​​and interests.

[0925] The "means for responding to a user's question based on the generated dialogue script" refers to a method for providing an appropriate response to a question from a user using the generated dialogue script.

[0926] As an embodiment of the present invention, the following system can be constructed.

[0927] First, the server is equipped with a means of learning about an individual's principles, thoughts, hobbies, etc. This means collecting the user's values ​​and interests and analyzing the data based on them. Specifically, it uses software to collect and analyze information entered by the user, past purchase history, and comments on social media. For example, data analysis can be performed using programming languages ​​such as Python and R.

[0928] Next, the server is equipped with a means for generating an AI that can interact with the user in a manner that is close to the user's personality based on the learned information. This means creating an AI that can interact with the user in a manner that is close to the user's personality based on the collected user information. Specifically, the server uses OpenAI's API to generate a dialogue script based on the user's profile information.

[0929] Furthermore, the server has a means for using the generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies. This means utilizes the generated artificial intelligence to suggest products that are individually optimized based on the user's values ​​and interests. For example, if a user asks, "What eco-friendly products do you recommend?", the AI ​​will suggest appropriate products by taking into account the user's profile information.

[0930] The server also includes a means for responding to user questions based on the generated dialogue script. This means uses the generated dialogue script to provide appropriate responses to user questions. Specifically, the server generates prompt sentences such as the following and generates responses using OpenAI's API:

[0931] Example prompt sentence:

[0932] "User's principles are eco-friendliness, their philosophy is minimalism, and their hobbies are reading and hiking. User asks: What eco-friendly products do you recommend? Generate a personalized response based on this information."

[0933] In this way, it becomes possible to provide optimal product proposals that reflect the individual characteristics of each user and provide a high level of satisfaction in dialogue with the user.

[0934] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0935] Step 1:

[0936] A user uses a terminal to input information such as personal principles, thoughts, and hobbies.

[0937] Input: Information such as the user's principles, thoughts, hobbies, etc.

[0938] Output: User profile information

[0939] Specific operation: The user enters their values ​​and interests into the input form on the device, such as "eco-friendliness," "minimalism," "reading," and "hiking."

[0940] Step 2:

[0941] The server collects user profile information and stores it in a database.

[0942] Input: User profile information

[0943] Output: User profile information stored in the database

[0944] Specific operation: The server receives the user profile information sent from the terminal and stores it in a database.

[0945] Step 3:

[0946] The server analyzes the user's profile information and generates an AI that can interact with the user in a way that closely resembles their personality.

[0947] Input: User profile information stored in a database

[0948] Output: AI that can interact with users in a way that is close to their personality

[0949] Specific operation: The server retrieves the user's profile information from the database and uses OpenAI's API to generate an interaction script based on the user's information.

[0950] Step 4:

[0951] The user uses the terminal to input a question about the product.

[0952] Input: User question

[0953] Output: User's question

[0954] Specific operation: The user enters a question about a product into an input form on the device. For example, they might enter, "What eco-friendly products do you recommend?"

[0955] Step 5:

[0956] The server receives the user's question and generates a prompt.

[0957] Input: User profile information, user questions

[0958] Output: prompt statement

[0959] Specific behavior: The server generates a prompt sentence like the following based on the user's profile information and the question: "User's principles are eco-friendliness, his philosophy is minimalism, and his hobbies are reading and hiking. User's question: What eco-friendly products do you recommend? Generate a personalized response based on this information."

[0960] Step 6:

[0961] The server uses the generated prompt to call the OpenAI API and generate a response.

[0962] Input: prompt statement

[0963] Output: The generated response

[0964] Specific operation: The server sends the generated prompt text to OpenAI's API and receives the response returned from the API.

[0965] Step 7:

[0966] The server sends the generated response to the user's terminal.

[0967] Input: Generated response

[0968] Output: The response displayed on the user's terminal

[0969] Specific operation: The server sends the generated response to the user's terminal and displays the response on the user's terminal.

[0970] In this way, it is possible to provide optimal product proposals that reflect the individual characteristics of the user and provide a high level of satisfaction in dialogue with the user.

[0971] Example 3

[0972] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0973] Conventional AI systems have had difficulty learning an individual's principles, thoughts, hobbies, etc. and interacting with them in a way that reflects their personality. It has also been difficult to create AI for the official accounts of celebrities or to create three-dimensional models of the generated AI for virtual interaction. Furthermore, customization features using digital assets have been lacking.

[0974] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc.; means for generating a generative AI model capable of interacting with the individual based on the learned information; means for using the generated generative AI model to automatically respond to messages on a communication network or respond according to relationships; means for collecting and analyzing speech data and behavioral data of celebrities; means for generating a dialogue script that imitates the celebrity's personality based on the analyzed data; means for interacting with a user using the generated dialogue script; and means for converting the generated generative AI model into a three-dimensional model, enabling customization using digital assets and interaction in a virtual space. This allows for the generation of an AI that imitates the personality of an individual or a celebrity, enabling automatic responses on a communication network and interaction in a virtual space.

[0975] "Personal principles, ideas, and hobbies" refer to the beliefs, ways of thinking, and interests and concerns of a particular individual.

[0976] "Learning means" refers to the process of collecting and analyzing data to extract specific patterns and features.

[0977] A "generative AI model" refers to an artificial intelligence model that mimics the personality and behavior of a specific person based on collected and analyzed data.

[0978] "Communications network" refers to a system for transmitting and receiving information over the Internet or other digital communications means.

[0979] "Automatic message response" refers to a function that automatically replies to messages from users using pre-set algorithms or AI.

[0980] "Relationship-based response" refers to the ability to provide appropriate responses and actions based on past interactions and relationships with the user.

[0981] "Celebrity statement and behavior data" refers to records of public statements and behavior of celebrities.

[0982] "Means of analysis" refers to the process of analyzing collected data and extracting specific patterns or features.

[0983] A "dialogue script" refers to a conversation script generated based on a specific scenario or context.

[0984] "3D modeling" refers to the process of generating three-dimensional shapes and movements based on two-dimensional data.

[0985] "Digital Asset" refers to assets in digital form whose ownership is proven using blockchain technology.

[0986] "Virtual space" refers to a virtual environment or world generated using computer technology.

[0987] This invention is a system that learns an individual's principles, thoughts, hobbies, etc. and generates a generative AI model that can interact with them in a way that closely resembles their personality based on that information. Furthermore, this generative AI model is used to automatically respond to messages on communication networks and respond according to relationships. By collecting and analyzing data on celebrities' statements and behavior, it is possible to generate dialogue scripts that mimic the celebrity's personality and engage in dialogue with users. Furthermore, the generated generative AI model can be converted into a three-dimensional model, enabling customization using digital assets and interaction in virtual spaces.

[0988] Hardware and software used

[0989] The server performs processes such as data collection, analysis, generation of generative AI models, generation of dialogue scripts, and 3D modeling. Specific hardware required is a server equipped with a high-performance CPU and GPU. The following software is used:

[0990] Data collection: Obtain data from social media via APIs, specifically Twitter API and Instagram API.

[0991] Data analysis: Use a Python NLP library (e.g., spaCy, NLTK) to tokenize text data and perform sentiment analysis and keyword extraction.

[0992] Generative AI models: Use generative AI models such as OpenAI's GPT-4 to generate dialogue scripts.

[0993] Three-dimensional modeling: Using 3D modeling software such as Blender, the movements and facial expressions of the avatar are controlled based on the generated dialogue script.

[0994] Digital Asset Customization: Use NFT marketplaces (e.g., OpenSea) to customize your avatar's appearance and gear.

[0995] Virtual interaction: Using a virtual reality platform (e.g., Decentraland) to place a customized avatar in a virtual space.

[0996] Specific examples

[0997] For example, if you want to create an AI model for the official account of a famous actor, you can input the following prompt into the generative AI model:

[0998] Example prompt sentence:

[0999] "Hi, I'm [Actor's name]. What would you like to talk about today?"

[1000] Based on this prompt, the generative AI model creates a dialogue script that mimics the actor's tone and speaking style. The dialogue script is then reflected in the avatar's movements and facial expressions using 3D modeling software. Users can then have this avatar interact with other users in a virtual space.

[1001] The above is an embodiment of the present invention. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1002] Step 1: Data collection

[1003] The server collects comment and behavior data provided by the operators of the celebrities' official accounts. Specifically, it obtains data from social media (e.g., Twitter, Instagram) via API.

[1004] Input: Speech data and behavioral data obtained from SNS APIs.

[1005] Output: Collected speech and behavior data is saved in a database.

[1006] Specific operation: The server uses the Twitter API to collect tweets from celebrities and stores them in a MySQL database.

[1007] Step 2: Data analysis

[1008] The server analyzes the collected data. Specifically, it uses Python NLP libraries (e.g., spaCy, NLTK) to tokenize the text data and perform sentiment analysis and keyword extraction.

[1009] Input: Collected speech and behavior data.

[1010] Output: Parsed data (tokenized text, sentiment analysis results, keywords).

[1011] What it does: The server uses spaCy to tokenize tweets and perform sentiment analysis.

[1012] Step 3: Generate an AI model

[1013] The server generates a dialogue script based on the extracted features, using a generative AI model (e.g., OpenAI's GPT-4).

[1014] Input: Parsed data (tokenized text, sentiment analysis results, keywords).

[1015] Output: The generated dialogue script.

[1016] Specific operation: The server uses GPT-4 to generate a dialogue script based on the prompt sentence, "Hello, I'm [actor's name]. What would you like to talk about today?"

[1017] Step 4: Create and customize your avatar

[1018] The server uses 3D modeling software (e.g., Blender) in conjunction with an AI engine to control the avatar's movements and facial expressions based on the generated dialogue script.

[1019] Input: The generated dialogue script.

[1020] Output: An avatar with controlled movements and facial expressions.

[1021] How it works: The server controls the avatar's facial expressions using Blender, and users customize the avatar's appearance using NFTs purchased from NFT marketplaces (e.g., OpenSea).

[1022] Step 5: Interact in the Metaverse

[1023] The server places the customized avatar in a metaverse space, which uses a virtual reality platform (e.g., Decentraland).

[1024] Enter: your customized avatar.

[1025] Output: Avatar placement and interaction in the metaverse space.

[1026] Specific operation: The server places an avatar on Decentraland, and users control that avatar to interact with other users.

[1027] (Application example 3)

[1028] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1029] Conventional AI systems have had difficulty learning an individual's principles, thoughts, and hobbies and interacting with them in a way that reflects their personality. Even when the generated AI was used as a celebrity's official account or as an avatar to interact in a virtual space, the dialogue with the user often felt unnatural. Furthermore, when used as a shopping assistant in a virtual store, the user experience was not sufficiently improved.

[1030] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1031] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI capable of interacting with the individual based on the learned information, means for using the generated AI to automatically respond to messages on social media and respond according to relationships, means for turning the generated AI into an avatar and enabling customization using NFTs and interaction in the virtual space, means for using the generated AI as an assistant for product selection in a virtual store, means for generating a dialogue script based on user input and controlling the avatar's movements and facial expressions, means for customizing the avatar's appearance and equipment using NFTs, and means for placing the customized avatar in the virtual space. This allows users to select products through natural dialogue, improving the shopping experience in the virtual store.

[1032] "Personal principles, ideas, and tastes" refer to an individual's beliefs, ways of thinking, interests, and preferences.

[1033] "Learning tools" refer to the methods and techniques used to collect, analyze, and train data.

[1034] "Personalized interactions" refer to dialogue and responses that mimic the characteristics and behavioral patterns of a specific individual.

[1035] "AI generation means" refers to methods and techniques for building and training artificial intelligence models.

[1036] "SNS automatic message response" refers to a function that automatically generates and sends messages on social networking services.

[1037] "Relationship-based responses" refers to choosing appropriate responses and actions based on your relationship with the user and past interactions.

[1038] "Avatarization" refers to creating a digital character and giving it specific characteristics and behaviors.

[1039] "Customization using NFTs" refers to changing the appearance or equipment of digital items or characters using non-fungible tokens.

[1040] "Virtual interaction" refers to communication and interaction with other users within a digital environment.

[1041] A "virtual store" is a virtual shopping space that exists on the Internet.

[1042] A "product selection assistant" is a system or feature that acts as an assistant to users in selecting products.

[1043] A "dialogue script" is a scenario or script of responses prepared in advance for dialogue with a user.

[1044] "Means for controlling the movements and facial expressions of an avatar" refers to methods and techniques for programmatically manipulating the movements and facial expressions of a digital character.

[1045] A "customized avatar" is a digital character whose appearance and equipment have been modified to suit the user's preferences.

[1046] "Means for virtual placement" refers to methods and techniques for placing digital characters and objects within a virtual environment.

[1047] The following system configuration and processing procedure will be described as an embodiment of the present invention.

[1048] System Configuration

[1049] This system is configured using the following hardware and software.

[1050] Hardware: Servers, smartphones, head-mounted displays

[1051] Software: OpenAI GPT-3, 3D modeling software, NFT customization module, Metaverse integration module

[1052] Processing steps

[1053] 1. A means of learning about personal principles, ideas, hobbies, etc.:

[1054] The server collects and analyzes data such as an individual's principles, thoughts, and hobbies, thereby learning the individual's characteristics.

[1055] 2. A method to generate AI that can interact with a person based on learned information:

[1056] The server uses OpenAI GPT-3 to generate an AI that can interact with the person based on the information it has learned.

[1057] 3. Using the generated AI to automatically respond to messages on social media and respond according to relationships:

[1058] The server uses the generated AI to automatically generate and send messages on social media, and responds appropriately based on the user's relationship with the server.

[1059] 4. Turning the generated AI into an avatar, enabling customization and virtual interaction using NFTs:

[1060] The server uses 3D modeling software to create an avatar from the generated AI, and then uses an NFT customization module to customize the avatar's appearance and equipment. The customized avatar is then placed in the virtual space using the metaverse integration module.

[1061] 5. How to use the generated AI as a product selection assistant in a virtual store:

[1062] The server uses the generated AI as an assistant for product selection in a virtual store, allowing users to interact with the avatar via a smartphone or head-mounted display while selecting products.

[1063] 6. A means to generate dialogue scripts based on user input and control avatar movements and facial expressions:

[1064] The server generates dialogue scripts based on user input and controls the avatar's movements and facial expressions using 3D modeling software.

[1065] 7. How to use NFTs to customize your avatar's appearance and gear:

[1066] The server uses the NFT customization module to customize the avatar's appearance and equipment.

[1067] 8. How to place a customized avatar in a virtual space:

[1068] The server uses a metaverse integration module to place the customized avatar in the virtual space.

[1069] Specific examples

[1070] A specific example of a user selecting a product in a virtual store is shown below.

[1071] Example prompt sentence:

[1072] User: Tell me about this product.

[1073] Celebrity AI: Hello! This is the latest smartphone with an excellent camera. The night mode is especially impressive.

[1074] Using this prompt, users can choose products while interacting with celebrity avatars in a virtual store, improving the user experience and enabling product selection through natural dialogue.

[1075] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1076] Step 1:

[1077] The server collects and analyzes data such as an individual's principles, thoughts, and hobbies. As input, it receives data about an individual's principles, thoughts, and hobbies, analyzes it, and extracts characteristics. As output, it generates data that represents the individual's characteristics.

[1078] Step 2:

[1079] The server uses OpenAI GPT-3 to generate an AI that can interact with the individual based on the learned information. It uses the individual's characteristic data obtained in Step 1 as input and trains the AI ​​model based on this. As output, it generates an AI model that mimics the individual's personality.

[1080] Step 3:

[1081] The server uses the generated AI to automatically generate and send messages on the SNS. As input, it receives a message from the user and generates an appropriate response. As output, it sends the generated message to the SNS.

[1082] Step 4:

[1083] The server uses 3D modeling software to create an avatar from the generated AI. As input, it receives the AI ​​model and the basic design of the avatar, and generates the avatar based on this. As output, it generates an avatar based on the AI ​​model.

[1084] Step 5:

[1085] The server uses the NFT customization module to customize the avatar's appearance and equipment. As input, it receives the avatar and NFT data, and changes the avatar's appearance and equipment based on this. As output, it generates a customized avatar.

[1086] Step 6:

[1087] The server uses the metaverse integration module to place the customized avatar in the virtual space, receive the customized avatar as input and place it in the virtual space, and generate the avatar placed in the virtual space as output.

[1088] Step 7:

[1089] Users select products by interacting with an avatar via a smartphone or head-mounted display. The input is the user's questions and requests, and the avatar's responses are displayed. The output is product information and recommendations for the user.

[1090] Step 8:

[1091] The server generates a dialogue script based on the user's input and controls the avatar's movements and facial expressions using 3D modeling software. As input, it receives the user's input data and generates a dialogue script based on this. As output, it generates instructions to control the avatar's movements and facial expressions.

[1092] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1093] "Example 1"

[1094] One embodiment of the present invention is a system incorporating an emotion engine. This system collects data such as user social media postings, purchase history, and browsing history, and uses natural language processing and machine learning technologies to extract and learn the user's principles, thoughts, hobbies, etc. Furthermore, an emotion engine that recognizes the user's emotions is used to grasp the user's emotional state. Specifically, the system recognizes and learns emotions such as joy, anger, sadness, and surprise from the user's postings and behavior. Based on the learned information, the system then generates an AI capable of interacting with the user in a manner that closely resembles their personality, and uses the generated AI to automatically respond to messages on social media and respond according to relationships.

[1095] "Example 2"

[1096] Another embodiment of the present invention is a system that combines AI-based celebrity official accounts with an emotion engine. This system learns from the celebrity's statement and behavior data provided by the administrator of the celebrity's official account and extracts its characteristics. Furthermore, it uses an emotion engine that recognizes the user's emotions to grasp the user's emotional state. Based on the extracted characteristics and the user's emotional state, it then generates a dialogue script that mimics the celebrity's personality and uses this to engage in dialogue with the user.

[1097] "Example 3"

[1098] Another embodiment of the present invention is a system that combines an emotion engine with AI avatar customization using NFTs and interaction in the Metaverse space. This system uses 3D modeling software linked to an AI engine to control the avatar's movements and facial expressions using dialogue scripts generated by the AI ​​engine. Furthermore, an emotion engine that recognizes the user's emotions is used to grasp the user's emotional state and change the avatar's facial expressions and movements accordingly. The avatar's appearance and equipment can then be customized using NFTs, and the avatar can be placed in the Metaverse space, enabling interaction with other users.

[1099] The processing flow of each embodiment will be described below.

[1100] "Example 1"

[1101] Step 1: Collect data such as user social media posts, purchase history, and browsing history.

[1102] Step 2: Analyze the collected data using natural language processing and machine learning technologies to extract and learn about the user's principles, thoughts, hobbies, etc.

[1103] Step 3: Recognize user emotions. Use an emotion engine to understand the user's emotional state.

[1104] Step 4: Generate an AI that can interact with the person based on the learned information and emotional state.

[1105] Step 5: Use the generated AI to automatically respond to messages on social media and take action based on the relationship.

[1106] "Example 2"

[1107] Step 1: Learn from celebrity statement and behavior data provided by the operators of the celebrity's official accounts.

[1108] Step 2: Extract celebrity features from the trained data.

[1109] Step 3: Recognize user emotions. Use an emotion engine to understand the user's emotional state.

[1110] Step 4: Generate a dialogue script that mimics the celebrity's personality based on the extracted features and the user's emotional state.

[1111] Step 5: Interact with the user using the generated interaction script.

[1112] "Example 3"

[1113] Step 1: Using 3D modeling software linked to an AI engine, the avatar's movements and facial expressions are controlled using the dialogue script generated by the AI ​​engine.

[1114] Step 2: Recognize user emotions. Use an emotion engine to understand the user's emotional state.

[1115] The user grasps the object and the avatar's facial expression and movements change accordingly.

[1116] Step 3: Customize your avatar's appearance and gear with NFTs.

[1117] Step 4: Place your customized avatar in the Metaverse space and interact with other users.

[1118] Example 1

[1119] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1120] Conventional systems have difficulty accurately understanding a user's principles, thoughts, and hobbies and providing personalized responses based on those beliefs. Furthermore, they are unable to generate responses that take into account the user's emotional state, which reduces the quality of communication with the user. Furthermore, there is also the issue that the generated AI cannot be used for official celebrity accounts or for interactions in virtual spaces.

[1121] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1122] In this invention, the server includes: means for collecting data such as user posts, purchase history, and browsing history; means for analyzing the collected data using natural language processing and machine learning techniques to extract and learn the user's principles, thoughts, hobbies, etc.; means for recognizing emotions from the user's posts and behavior; means for generating AI capable of interacting with users in a manner that closely resembles their personality based on the learned information and emotion recognition results; and means for using the generated AI to automatically respond to messages on social media and respond according to relationships. This makes it possible to accurately grasp the user's principles, thoughts, and hobbies and generate personalized responses that take into account their emotional state. The generated AI can also be used for interactions on celebrities' official accounts and in virtual spaces.

[1123] "User posts" refers to content such as text, images, and videos posted publicly or privately by users on online platforms such as social networking services and blogs.

[1124] "Purchase history" refers to a record of product purchases made by a user online or offline, and is data that includes information such as the purchase date and time, product name, price, and purchase location.

[1125] "Browsing history" is a record of the web pages and content that a user has viewed on the Internet, and is data that includes information such as the date and time of viewing, URL, and page title.

[1126] "Natural language processing technology" is a technology for processing human language using a computer, and is a technology that performs text analysis, generation, translation, sentiment analysis, etc.

[1127] "Machine learning technology" is a technology that allows computers to learn patterns from data and make predictions and classifications, and is a technology that analyzes data using algorithms and models.

[1128] "Emotion recognition" is a technology that identifies a user's emotional state from their text and behavior, and can recognize emotions such as joy, anger, sadness, and surprise.

[1129] An "AI engine" is software or a system that uses artificial intelligence technology to analyze and learn from data, and utilizes technologies including natural language processing and machine learning.

[1130] "SNS automatic message response" is a function that automatically generates and sends responses to messages and posts from users on social networking services.

[1131] "Relationship-based responses" means providing appropriate responses and actions based on the relationship with the user and past interactions, enabling personalized communication.

[1132] An "official celebrity account" is a social networking service account officially operated by a prominent person or organization, which is used to communicate with fans and followers.

[1133] "Avatarization" refers to the representation of a user's or AI's personality as a virtual character, enabling interaction in the digital space.

[1134] "Digital Asset" means any valuable asset that exists in digital form, including images, videos, music, and virtual currency.

[1135] A "virtual space" is a computer-generated, three-dimensional digital environment in which users can interact with other users and engage in activities through avatars.

[1136] This invention is a system that uses an AI engine to collect and analyze data such as user posts, purchase history, and browsing history. This system uses natural language processing and machine learning technologies to extract and learn the user's principles, thoughts, hobbies, etc. Furthermore, by combining it with an emotion engine, it is possible to grasp the user's emotional state and generate AI that can interact with the user in a way that is close to their personality.

[1137] Hardware and software used

[1138] 1. Server

[1139] It is the central component for data collection, data analysis, emotion recognition, AI generation, and automatic message responses. The server operates by integrating databases, APIs, AI engines, emotion engines, etc.

[1140] 2. Database

[1141] It is used to store data such as user posts, purchase history, browsing history, etc. For example, it uses a relational database such as MySQL or PostgreSQL.

[1142] 3. API

[1143] To collect data, we use APIs from social media platforms (Twitter API, Facebook Graph API, etc.), online shopping sites (Amazon API, Rakuten API, etc.), and web browsers (Google Analytics, etc.).

[1144] 4. AI Engine

[1145] It uses natural language processing technology (BERT, GPT-3, etc.) and machine learning technology (Scikit-learn, TensorFlow, etc.) to extract and learn about users' principles, thoughts, and hobbies.

[1146] 5. Emotion Engine

[1147] It is used to recognize emotions from user posts and behavior, for example, by using Microsoft Azure's Text Analytics API or IBM Watson's Tone Analyzer.

[1148] Specific examples

[1149] Example 1: When a user posts on Twitter, "I want to go on a trip recently."

[1150] The server collects these posts through the Twitter API and stores them in a database.

[1151] The server sends the saved posts to an AI engine, which uses natural language processing technology to extract the hobby "travel."

[1152] The server sends the same post to the emotion engine and recognizes the emotion "expectation."

[1153] Based on this information, the server invokes an AI model (e.g., GPT-3) to generate automated messages containing travel destination suggestions that match the user's tastes and emotions.

[1154] The server sends the generated message back to the user via the Twitter API.

[1155] Prompt Sentence Examples

[1156] "Create a program that analyzes users' social media posts and extracts their hobbies and emotions. For example, if a user posts, 'I've been wanting to travel recently,' extract the hobby of traveling and the emotion of anticipation, and generate an automatic message based on that, including travel destination suggestions."

[1157] This concludes the description of the present invention. This system accurately identifies a user's principles, thoughts, and hobbies, and generates personalized responses that take into account their emotional state. The generated AI can also be used for official celebrity accounts and virtual interactions.

[1158] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1159] Step 1:

[1160] Data collection

[1161] The server collects data such as user posts, purchase history, and browsing history.

[1162] Input: Data from social media platforms (Twitter API, Facebook Graph API, etc.), online shopping sites (Amazon API, Rakuten API, etc.), and web browsers (Google Analytics, etc.).

[1163] Output: The collected data is stored in a database.

[1164] Specific operation: The server periodically calls an API to get new data and saves it in a database. For example, it uses the Twitter API to get a user's latest tweets and saves them in a database.

[1165] Step 2:

[1166] Data analysis

[1167] The server sends the collected data to an AI engine, which uses natural language processing technology to extract and learn from the user's principles, thoughts, hobbies, etc.

[1168] Input: User posts, purchase history, browsing history, and other data read from a database.

[1169] Output: Extracted information about the user's principles, thoughts, hobbies, etc.

[1170] Specific operation: The server reads data from the database, preprocesses the text data (tokenization, removal of stop words, etc.), and then inputs it into the AI ​​engine. For example, it uses the BERT model to analyze the text data and extract the user's hobbies.

[1171] Step 3:

[1172] emotion recognition

[1173] The server uses an emotion engine to recognize emotions from users' posts and actions.

[1174] Input: User posts and behavior data read from the database.

[1175] Output: Recognized emotion label (e.g., happy, anger, sad, surprise).

[1176] How it works: The server sends text data to the emotion engine and stores the returned emotion labels in a database. For example, it uses Microsoft Azure's Text Analytics API to recognize the emotion "expectation" from user posts.

[1177] Step 4:

[1178] AI generation

[1179] Based on the learned information and emotion recognition results, the server generates an AI that can interact with the user in a way that closely resembles their personality.

[1180] Input: Extracted information such as user principles, thoughts, and hobbies, along with emotion recognition results.

[1181] Output: The generated AI model.

[1182] How it works: The server inputs the user's hobbies and emotions into the AI ​​model as prompts, and stores the generated responses in a database. For example, GPT-3 is used to generate responses based on the user's hobbies and emotions.

[1183] Step 5:

[1184] Automated Message Response

[1185] The server uses the generated AI to automatically respond to messages on social media and take action based on relationships.

[1186] Input: A user's new post or message.

[1187] Output: The automatically generated response message.

[1188] How it works: The server monitors users' new posts, calls the AI ​​model at the appropriate time to generate a response, and automatically replies via the SNS API. For example, if a user posts, "I've been wanting to go on a trip lately," the AI ​​will generate a message with travel destination suggestions and reply.

[1189] (Application example 1)

[1190] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1191] Traditional content distribution services do not adequately recommend personalized content based on users' principles, beliefs, and hobbies. They also do not consider the user's emotional state when recommending content, making it difficult to increase user satisfaction. Furthermore, automated message responses and relationship-based responses on social media platforms do not reflect the user's individual emotions and interests, limiting the user experience.

[1192] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1193] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc.; means for generating an AI that can interact with the individual based on the learned information, means for using the generated AI to automatically respond to messages on social media and respond according to relationships; means for using an emotion engine that grasps the user's emotional state; and means for recommending content that best suits the user's current emotions. This enables personalized content recommendations based on the user's principles, thoughts, and hobbies, and can also realize content recommendations that take the user's emotional state into consideration. This increases user satisfaction and provides a richer user experience.

[1194] "Personal principles, thoughts, and hobbies" refers to the user's beliefs, ways of thinking, interests, and preferences.

[1195] "Means of learning" refers to the technologies and methods used to collect and analyze user data to extract its characteristics.

[1196] "AI capable of human-like interactions" is artificial intelligence that learns the characteristics of a user and responds and behaves in a similar way to that user.

[1197] "SNS automatic message response" is a function that automatically generates and sends messages on social networking services.

[1198] "Relationship-based response" refers to responding and taking appropriate actions based on the relationship with the user and the situation.

[1199] An "emotion engine" is a technology or system for analyzing and recognizing a user's emotional state.

[1200] "Content recommendation means" refers to technologies and methods for selecting and presenting appropriate content based on a user's characteristics and emotional state.

[1201] A "non-fungible token" is a token that uses blockchain technology to prove ownership of digital assets.

[1202] "Virtual space" refers to a digital environment or world generated using computer technology.

[1203] A system for implementing this invention includes a server for collecting and analyzing a user's personal data and a terminal for recommending content based on the analysis results. The server collects data such as the user's social media posts, purchase history, and browsing history, and uses natural language processing and machine learning techniques to extract and learn the user's principles, thoughts, and hobbies. Furthermore, an emotion engine is used to grasp the user's emotional state and recommend content that best suits the user's current emotions.

[1204] Hardware and software used

[1205] Hardware: Smartphones, servers

[1206] Software: Python, TextBlob, scikit-learn, requests

[1207] Data processing and calculation

[1208] The server first collects data such as the user's social media posts, purchase history, and browsing history. This data is then analyzed using natural language processing technology to extract the user's principles, thoughts, and hobbies. Specifically, TF-IDF vectorization and KMeans clustering are used to extract user features. Next, an emotion engine is used to analyze the user's emotional state from the content of the posts. TextBlob is used to analyze the emotions in the posts and understand the user's emotional state.

[1209] Content Recommendation

[1210] The server then recommends content that best suits the user's current emotions based on the analysis results. For example, if the user's emotional state is positive, it will recommend positive music or movie content, and if it is negative, it will recommend comforting reading or cooking content.

[1211] Specific examples

[1212] User A: Recent social media posts have been positive, and their hobbies are music and movies. → Recommend positive music and movie content.

[1213] User B: Recent social media posts have been negative, and her hobbies are reading and cooking. → Recommend comforting reading and cooking content.

[1214] Prompt Sentence Examples

[1215] Collect users' social media posts, purchase history, and browsing history, and use natural language processing and machine learning technologies to extract and learn their principles, thoughts, and hobbies.Furthermore, develop an application that uses an emotion engine to understand the user's emotional state and recommend content that best suits the user's current emotions.

[1216] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1217] Step 1:

[1218] The server collects data such as users' social media posts, purchase history, and browsing history.

[1219] Input: User ID

[1220] Output: User's social media posts, purchase history, and browsing history data

[1221] Specific operation: The server obtains user data from social networking platforms and online shopping sites through APIs. For example, it uses the API of a social networking site to obtain user posts, and the API of an online shopping site to obtain purchase history.

[1222] Step 2:

[1223] The server analyzes the collected data using natural language processing technology to extract the user's principles, thoughts, and hobbies.

[1224] Input: User's social media posts, purchase history, browsing history data

[1225] Output: Feature vector of user's principles, thoughts, and hobbies

[1226] Specific operation: The server quantifies the text data using TF-IDF vectorization and extracts user features using KMeans clustering, which allows the user's principles, thoughts, and hobbies to be expressed as a numerical vector.

[1227] Step 3:

[1228] The server uses an emotion engine to analyze the user's emotional state.

[1229] Input: User's social media posts

[1230] Output: User's emotional state (positive, negative, etc.)

[1231] Specific operation: The server analyzes the sentiment of the user's posts using TextBlob, calculates the sentiment score for each post, and calculates the overall average score to understand the user's emotional state.

[1232] Step 4:

[1233] The server recommends appropriate content based on the user's feature vector and emotional state.

[1234] Input: User feature vector, emotional state

[1235] Output: A list of recommended content

[1236] Specific operation: The server runs a content recommendation algorithm based on the user's feature vector and emotional state. For example, if the user's emotional state is positive, it recommends positive music or movies, and if the user's emotional state is negative, it recommends comforting reading or cooking content.

[1237] Step 5:

[1238] The terminal presents the content recommended by the server to the user.

[1239] Input: A list of recommended content

[1240] Output: The content that is displayed to the user

[1241] Specific operation: The device displays the recommended content received from the server on the user interface, and the user can browse and select the presented content.

[1242] Example 2

[1243] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1244] Conventional dialogue systems have had the challenge of being unable to reflect a user's individual beliefs, thoughts, and hobbies, and are unable to respond to the user's emotional state. Furthermore, even when AI was used on official celebrity accounts, it was not possible to achieve natural dialogue that reflected the user's emotions. This limited the user experience and led to problems such as a decline in the quality of the dialogue.

[1245] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1246] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating a dialogue script that enables interaction that is close to that individual's personality based on the learned information, means for engaging in a dialogue with the user using the generated dialogue script, means for using an emotion engine that recognizes the user's emotional state, means for generating a dialogue script based on the recognized emotional state, and means for engaging in a dialogue that imitates the personality of a celebrity using the generated dialogue script. This enables natural dialogue that reflects the user's individual information and emotional state.

[1247] "Personal principles, ideas, and hobbies" refers to the specific values, beliefs, and interests held by the user.

[1248] "Means of learning" refers to the process of analyzing information provided by users and storing it in a database.

[1249] A "dialogue script" refers to a series of responses generated to interact with a user.

[1250] "Means of generation" refers to the process of creating a dialogue script using an AI engine.

[1251] The "means for interacting with the user" refers to the process of responding to questions from the user using the generated interaction script.

[1252] An "emotion engine" refers to software that recognizes a user's emotional state and analyzes that information.

[1253] "Means of recognition" refers to the process of understanding the user's emotional state using an emotion engine.

[1254] "Dialogue imitating the personality of a celebrity" refers to dialogue conducted using a dialogue script generated based on the celebrity's speech data and behavioral data.

[1255] "Automatic message responses on social media" refers to a function that automatically responds to messages from users on social media.

[1256] "Relationship-based response" refers to the process of providing appropriate responses based on the relationship with the user.

[1257] "Avatarization" refers to the process of representing the generated dialogue script as a virtual character.

[1258] "Digital assets" refers to assets whose ownership is proven in a digital form, such as NFTs.

[1259] "Interaction in virtual space" refers to users interacting with each other and engaging in activities within a virtual environment such as the metaverse.

[1260] This invention is a system that learns the user's principles, thoughts, hobbies, etc., generates a dialogue script based on that information, and then engages in dialogue with the user. Furthermore, it uses an emotion engine to recognize the user's emotional state, and based on that information, it can engage in dialogue that mimics the personality of a celebrity.

[1261] Hardware and software used

[1262] Hardware: Servers, terminals (PCs, smartphones)

[1263] Software: AI engine, emotion engine, database management system

[1264] Program processing

[1265] Collection of User Information

[1266] Users access the system using a terminal and input information such as their principles, thoughts, hobbies, etc. The terminal sends the input information to the server, which then stores it in a database.

[1267] Examples:

[1268] A user types, "My hobby is reading, and I especially like science fiction novels." The device sends this information to the server, which stores it in its database as "Hobbies: Reading, Genre: Science fiction novels."

[1269] Generate conversation scripts

[1270] The server retrieves user information from the database, starts the AI ​​engine, and inputs the retrieved user information. The AI ​​engine generates a dialogue script based on the user information, and the generated dialogue script is saved on the server.

[1271] Examples:

[1272] The server retrieves the information "Hobbies: Reading, Genre: Science fiction novels" from the database. The AI ​​engine generates a dialogue script that "recommends books related to science fiction novels." The server saves this dialogue script.

[1273] User interaction

[1274] The user inputs a question from the terminal, and the terminal sends the question to the server. The server analyzes the received question and generates a response based on the generated dialogue script. The server then sends the generated response to the terminal, and the terminal displays the response to the user.

[1275] Examples:

[1276] The user types, "What recent science fiction novels do you recommend?" The device sends this question to the server. Based on the dialogue script, the server generates a response: "I recommend the recently popular 'Future Seekers.'" The device then displays this response to the user.

[1277] AI-powered official celebrity accounts

[1278] The server receives speech and behavioral data provided by the operator of the celebrity's official account and stores it in a database. The server then activates an emotion engine to recognize the user's emotional state. The server then studies the celebrity's speech and behavioral data and extracts their features. An AI engine generates a dialogue script based on the user's emotional state recognized by the emotion engine and the extracted features. The server then uses the generated dialogue script to engage in a dialogue with the user.

[1279] Examples:

[1280] The server receives celebrity comment data, such as "comments about the latest movie," and stores it in a database. The emotion engine recognizes the user's emotional state as "excited." The AI ​​engine generates a dialogue script that "emphasizes the appeal of the movie to the excited user." The server uses this dialogue script to respond, "I'm also very satisfied with this movie. It was a new challenge for me, especially in terms of acting."

[1281] Prompt Sentence Examples

[1282] User information gathering prompt:

[1283] "Tell me about your hobbies and interests. For example, your favorite books, movies, music, etc."

[1284] AI prompt for celebrity official accounts:

[1285] "What do you think of the latest movie? Tell us what you think."

[1286] In this way, the system generates a dialogue script based on the user's information, realizing natural dialogue with the user.

[1287] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1288] Step 1: Collect user information

[1289] Input: A user accesses the system using a terminal and inputs information about their principles, beliefs, hobbies, etc.

[1290] Specific action: The user types, "My hobby is reading, especially science fiction novels."

[1291] Data processing: The terminal sends the entered information to the server.

[1292] Output: The server stores the received user information in a database.

[1293] Step 2: Generate the interaction script

[1294] Input: The server retrieves user information from the database.

[1295] Specific operation: The server retrieves the information "Hobbies: Reading, Genre: Science fiction novels" from the database.

[1296] Data calculation: The server starts the AI ​​engine and inputs the acquired user information. The AI ​​engine generates a dialogue script based on the user information.

[1297] Output: The generated dialogue script is saved on the server.

[1298] Step 3: User interaction

[1299] Input: The user types a question into the terminal.

[1300] What happens: The user types, "What's the best recent science fiction novel?" The device sends this question to the server.

[1301] Data calculation: The server analyzes the received question and generates a response based on the generated dialogue script.

[1302] Output: The server generates a response and sends it to the terminal, which displays it to the user.

[1303] Step 4: AI-powered official celebrity accounts

[1304] Input: The server receives statement and behavioral data provided by the operator of the celebrity's official account.

[1305] Specific operation: The server receives celebrity comment data, such as "comments about the latest movie," and stores it in a database.

[1306] Data calculation: The server activates the emotion engine and recognizes the user's emotional state. The server learns from celebrity speech and behavior data and extracts their characteristics. The AI ​​engine generates a dialogue script based on the user's emotional state recognized by the emotion engine and the extracted characteristics.

[1307] Output: The server uses the generated dialogue script to interact with the user.

[1308] Specific operation: The emotion engine recognizes the user's emotional state as "excited." The AI ​​engine generates a dialogue script that "emphasizes the appeal of the movie to the excited user." The server uses this dialogue script to respond, "I'm also very satisfied with this movie. I was able to take on new challenges, especially in terms of acting."

[1309] (Application example 2)

[1310] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1311] Conventional conversational AI systems have difficulty in providing a conversation that reflects the user's individual beliefs, thoughts, and hobbies, and also in providing a conversational experience that mimics the personality of a celebrity. Furthermore, they are unable to recognize the user's emotional state and generate appropriate responses, limiting the user experience. This has led to the issue of users being unable to obtain a realistic experience, such as interacting with a celebrity.

[1312] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1313] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI that can interact with the individual based on the learned information, means for using the generated AI to automatically respond to messages on SNS and respond according to relationships, means for learning data on celebrity statements and behavioral data, recognizing the user's emotional state, and generating a dialogue script, means for interacting with the user using the generated dialogue script, and means for providing the user with the experience of interacting with the celebrity through an application installed on a smartphone. This enables dialogue that reflects the user's individual principles, thoughts, and hobbies, and further provides a realistic dialogue experience that imitates the celebrity's personality.

[1314] "Personal principles, ideas, and hobbies" refer to an individual's beliefs, values, interests, and concerns.

[1315] "Learning means" refers to the process of collecting and analyzing data to extract patterns and features.

[1316] "AI capable of human-like interactions" refers to artificial intelligence that can reflect the individual characteristics of the user and engage in natural conversations.

[1317] "SNS automatic message response" refers to a function that automatically generates and replies to messages on social networking services.

[1318] "Responding based on the relationship" refers to taking appropriate responses and actions depending on the relationship with the user and the situation.

[1319] "Celebrity statement and behavior data" refers to records of public statements and behavior of celebrities.

[1320] "User's emotional state" refers to the emotions or moods that the user is currently experiencing.

[1321] A "dialogue script" refers to text data that defines the flow and content of a dialogue.

[1322] "Applications installed on a smartphone" refers to software programs that run on a smartphone.

[1323] A "celebrity interaction experience" refers to an interaction that makes users feel as if they are having a conversation with a celebrity.

[1324] A system for implementing this invention has the following configuration. First, the server has a means for learning an individual's principles, thoughts, hobbies, etc. This means analyzes data collected from the user and extracts the user's characteristics. Next, it has a means for generating an AI that can interact with the user in a way that is close to the user's personality based on the learned information. This AI reflects the user's characteristics and can engage in natural conversations.

[1325] Furthermore, the server has a means to use the generated AI to automatically respond to messages on social media and respond according to relationships, allowing users to enjoy natural conversations on social media. It also has a means to learn celebrity remarks and behavioral data, recognize the user's emotional state, and generate a dialogue script. This means combines celebrity data with the user's emotional state to generate an appropriate dialogue script.

[1326] The server also includes means for interacting with the user using the generated dialogue script. This means interacts with the user based on the generated dialogue script, providing the user with the experience of interacting with the celebrity. The server also includes means for providing the user with the experience of interacting with the celebrity through an application installed on the smartphone. This application provides the user with the experience of interacting with the celebrity through the smartphone.

[1327] As a specific example, consider the case where a user asks their favorite actor, "How are you spending your day?" In this case, the server recognizes the user's emotional state as "joy" and generates a dialogue script based on the celebrity's speech and behavior data. Based on the generated dialogue script, the application provides the user with a response such as, "I'm filming a movie today, so I'm having a great day!"

[1328] An example prompt is:

[1329] User's emotional state: joy

[1330] Celebrity data: Actors' statements and actions

[1331] User Input: How are you spending your day?

[1332] response:

[1333] In this way, users can have a realistic experience of interacting with celebrities. The system is implemented using Python and the OpenAI API. Specifically, it uses OpenAI's Completion.create method to generate responses based on prompts. The hardware used is a smartphone with an internet connection.

[1334] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1335] Step 1:

[1336] The server collects data such as the user's beliefs, thoughts, and hobbies.

[1337] Input: Data about the user's principles, thoughts, and hobbies

[1338] Output: Collected user data

[1339] Specific operation: The server collects data from users' survey responses and social media posts, and stores it in a database.

[1340] Step 2:

[1341] The server analyzes the collected data and extracts user characteristics.

[1342] Input: Collected user data

[1343] Output: User feature data

[1344] Specific operation: The server analyzes the text data using natural language processing technology to identify the user's principles, thoughts, and hobbies.

[1345] Step 3:

[1346] The server generates an AI that can interact with the user based on their characteristic data.

[1347] Input: User feature data

[1348] Output: User-specific AI model

[1349] Specific operation: The server uses the generative AI model to generate a dialogue script that reflects the user's characteristics and builds the AI ​​model.

[1350] Step 4:

[1351] The server uses the generated AI to automatically respond to messages on social media and take action based on relationships.

[1352] Input: Message from user

[1353] Output: AI-generated automated response message

[1354] Specific operation: The server receives a message from the user, uses the generated AI model to generate an appropriate response, and sends it back.

[1355] Step 5:

[1356] The server learns from celebrity speech and behavior data, recognizes the user's emotional state, and generates a dialogue script.

[1357] Input: celebrity statement data, behavioral data, user emotional state

[1358] Output: Interactive script

[1359] Specific operation: The server analyzes the celebrity data, recognizes the user's emotional state using an emotion engine, and generates a dialogue script based on this data.

[1360] Step 6:

[1361] The server uses the generated dialogue script to interact with the user.

[1362] Input: Interactive script, input from user

[1363] Output: Response message to the user

[1364] Specific operation: The server generates a response to the input from the user based on the dialogue script and provides it to the user.

[1365] Step 7:

[1366] The device (smartphone) allows users to interact with celebrities through installed applications.

[1367] Input: Input from the user, response message from the server

[1368] Output: The interactive experience for the user

[1369] Specific operation: The terminal sends input from the user to the server, receives a response message from the server, and displays it to the user.

[1370] Example 3

[1371] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1372] Conventional AI systems have had difficulty learning an individual's principles, thoughts, hobbies, etc. and interacting with them in a way that reflects their personality. Furthermore, there were a lack of means to turn celebrities' official accounts into AI, customize avatars, and enable interactions in virtual spaces. Furthermore, there were no systems that could recognize the user's emotional state and change the avatar's facial expressions and movements accordingly. To solve these issues, a new system is needed.

[1373] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1374] In this invention, the server includes: means for learning an individual's principles, thoughts, hobbies, etc.; means for generating a generative AI model capable of interacting in a manner similar to that individual's personality based on the learned information; means for using the generated generative AI model to provide automatic message responses for communication network services and to respond according to relationships; means for collecting and analyzing the celebrity's speech data and behavioral data; means for generating a dialogue script that imitates the celebrity's personality based on the analysis results; means for controlling the avatar's movements and facial expressions using the generated dialogue script; means for customizing the avatar's appearance and equipment using non-fungible tokens; means for placing the avatar in a virtual space and enabling interaction with other users; and means for recognizing the user's emotional state using an emotion engine and changing the avatar's facial expressions and movements. This enables the generation of AI capable of interacting in a manner similar to that of an individual's personality, the AIization of official celebrity accounts, avatar customization, interaction in virtual spaces, and changes in the avatar's facial expressions and movements according to the user's emotional state.

[1375] "Means for learning about an individual's principles, thoughts, hobbies, etc." refers to technology that collects data on an individual's statements and behavior, and analyzes that data to understand the individual's values ​​and interests.

[1376] A "generative AI model" is an artificial intelligence model that mimics the personality and speech patterns of a specific individual based on collected and analyzed data.

[1377] "Communications Network Services" means messaging and social networking services provided over the Internet or other communications networks.

[1378] "Automatic message response" is a function that automatically generates responses to messages from users using pre-set rules or AI.

[1379] "Relationship-based response" is a function that selects appropriate responses and actions based on the relationship with the user and past interactions.

[1380] "Means for collecting data on celebrity statements and behavior" refers to technology for collecting data on publicly available statements and behavior of celebrities.

[1381] "Means of analysis" refers to techniques for analyzing collected data and extracting specific patterns or features.

[1382] The "means for generating a dialogue script" is a technology for generating a script for conducting natural dialogue based on the analysis results.

[1383] "Means for controlling the avatar's movements and facial expressions" refers to a technology that controls the avatar's movements and facial expressions in real time based on the generated dialogue script.

[1384] A "non-fungible token" is a token that uses blockchain technology to prove ownership of digital assets.

[1385] "Means for customizing avatar appearance and equipment" refers to technology for changing avatar appearance and equipment using non-fungible tokens.

[1386] A "virtual space" is a three-dimensional digital space generated by computer simulation.

[1387] An "emotion engine" is a technology that recognizes the user's emotional state and adjusts the system's behavior accordingly.

[1388] "Means for recognizing the user's emotional state" refers to technology that analyzes emotions from the user's facial expressions, voice, etc., and identifies their current emotional state.

[1389] "Means for changing the facial expressions and movements of an avatar" refers to technology that changes the facial expressions and movements of an avatar in real time according to the user's emotional state.

[1390] This invention is a system that learns an individual's principles, thoughts, hobbies, etc., and generates a generative AI model that can interact with them in a way that closely resembles their personality, automatically responding to messages on communication network services and responding to relationships. It can also collect and analyze celebrity speech and behavioral data to generate dialogue scripts that mimic their personality and control the avatar's movements and facial expressions. Furthermore, non-fungible tokens can be used to customize the avatar's appearance and equipment, enabling interaction in virtual spaces. An emotion engine can also recognize the user's emotional state and change the avatar's facial expressions and movements.

[1391] Hardware and software used

[1392] 1. Server

[1393] Data collection: The server collects celebrity comment and behavior data through APIs and database connections, such as the Twitter API.

[1394] Data analysis: The server analyzes the collected data using a Python NLP library (e.g., spaCy) to extract utterance frequencies and patterns.

[1395] Generative AI model: The server generates a dialogue script using a generative AI model (e.g., GPT-4) based on the analysis results.

[1396] 2. Terminal

[1397] Avatar creation and customization: The device uses 3D modeling software (e.g., Blender) to control the avatar's movements and facial expressions based on the generated dialogue script. Users can also customize the avatar's appearance and equipment using non-fungible tokens through a dedicated UI.

[1398] 3. Users

[1399] Interaction in the Metaverse: Users interact with other users through metaverse platforms (e.g., VRChat, Decentraland). Users access the virtual space using a VR headset or PC.

[1400] Use of emotion engine: To recognize the user's emotional state, an emotion engine (e.g., Affectiva) is used to change the avatar's facial expressions and movements in real time.

[1401] Specific examples

[1402] For example, if you want to create an AI for a celebrity's official account, you can input the following prompt into the generative AI model:

[1403] Prompt Sentence Examples

[1404] "Hi, I'm [celebrity name]. What would you like to talk about today?"

[1405] Based on this prompt, the generative AI model generates a dialogue script that mimics the celebrity's speech patterns. The dialogue script is then used in conjunction with 3D modeling software to control the avatar's movements and facial expressions, allowing it to engage in natural dialogue with other users in the Metaverse.

[1406] This system makes it possible to generate AI capable of interacting with people in a way that closely resembles their personalities, turn celebrities' official accounts into AI, customize avatars, interact in virtual spaces, and change the avatar's facial expressions and movements according to the user's emotional state. The flow of the identification process in Example 3 will be explained with reference to Figure 21.

[1407] Step 1:

[1408] Data collection

[1409] The server collects comment data and behavioral data provided by operators of the celebrities' official accounts. Specifically, the server obtains text data and metadata through APIs and database connections. For example, the server collects tweets from celebrities using the Twitter API.

[1410] Input: Celebrity's official account API key

[1411] Output: Celebrity statements and behavior data

[1412] Step 2:

[1413] Data analysis

[1414] The server uses natural language processing (NLP) techniques to analyze the collected data. Specifically, the server uses a Python NLP library (e.g., spaCy) to tokenize the text data and extract utterance frequencies and patterns.

[1415] Input: Celebrity statements and behavior data

[1416] Output: Analysis of speech frequency and patterns

[1417] Step 3:

[1418] Generating AI models

[1419] The server generates a dialogue script using a generative AI model (e.g., GPT-4) based on the analysis results. Specifically, the server inputs the prompt sentence into the generative AI model and saves the output dialogue script.

[1420] Input: Analysis results of speech frequency and patterns, prompt text

[1421] Output: Interactive script

[1422] Step 4:

[1423] Avatar creation and customization

[1424] The device then connects the generated dialogue script to 3D modeling software (e.g., Blender) to control the avatar's movements and facial expressions. Users can customize their avatar's appearance and equipment using non-fungible tokens. Specifically, the device uses Blender's API to manipulate the avatar's modeling data, and users select and apply NFTs through a dedicated UI.

[1425] Input: Dialogue script, non-fungible token

[1426] Output: A customized avatar

[1427] Step 5:

[1428] Interaction in the Metaverse

[1429] The server places customized avatars in the metaverse space. Users can interact with other users through the metaverse platform (e.g., VRChat, Decentraland). Specifically, the server places avatars using the metaverse platform's API, and users access the metaverse space using a VR headset or PC.

[1430] Input: Your customized avatar

[1431] Output: Interaction in the Metaverse

[1432] Step 6:

[1433] Emotion engine integration

[1434] The server uses an emotion engine to recognize the user's emotional state. Specifically, the server changes the avatar's facial expressions and movements in real time based on the output of the emotion engine. For example, the server obtains the user's emotional data using Affectiva's API and changes the avatar's facial expressions using Blender's API.

[1435] Input: User emotion data

[1436] Output: Avatar's facial expressions and movements change according to emotions

[1437] (Application example 3)

[1438] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1439] Conventional AI systems have difficulty in providing personalized dialogue based on individual beliefs, ideologies, and hobbies, limiting the user experience. Furthermore, they are unable to recognize the user's emotions and change the avatar's facial expressions and movements in virtual spaces, preventing realistic communication. Furthermore, there has been no system available for customizing avatars using NFTs or for integrating virtual space interactions, resulting in low user convenience.

[1440] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1441] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI capable of interacting with the individual based on the learned information, means for using the generated AI to automatically respond to messages on social media and respond according to relationships, means for turning the generated AI into an avatar and enabling customization using NFTs and interaction in a virtual space, means for recognizing a user's emotions and changing the avatar's facial expressions and movements accordingly, means for recognizing the user's emotions using a camera, and means for placing the avatar in a virtual space. This allows users to enjoy personalized interactions and enables realistic communication according to emotions, and further allows for integrated avatar customization using NFTs and interaction in a virtual space.

[1442] "Personal principles, ideas, and hobbies" refers to an individual's beliefs, ways of thinking, and areas of interest and concern.

[1443] "Means of learning" refers to the methods and techniques used to collect and analyze data to acquire knowledge.

[1444] "AI capable of human-like interactions" refers to artificial intelligence that can imitate the personality and behavioral patterns of a specific individual and engage in conversations similar to that individual's.

[1445] "Generative means" refers to methods and techniques for creating new data and models for specific purposes.

[1446] "Automatic message responses on social networking services" refers to a function on social networking services that automatically replies to messages from users.

[1447] "Relationship-based response" refers to taking appropriate responses and actions based on the relationship with the user and the situation.

[1448] "Avatarization" refers to the representation of artificial intelligence or digital characters as virtual people or characters.

[1449] "NFT" stands for Non-Fungible Token and refers to a token that uses blockchain technology to prove ownership of digital assets.

[1450] "Customization" refers to changing specific features or appearance according to the user's preferences and requirements.

[1451] "Virtual space" refers to a digital environment that is different from reality and is created using computer technology.

[1452] "Means of recognizing emotions" refers to technologies and methods for analyzing and understanding a user's emotions from facial expressions, tone of voice, etc.

[1453] "Means for changing facial expressions and movements" refers to techniques and methods for changing an avatar's facial expressions and body movements based on recognized emotions.

[1454] "Means for recognizing a user's emotions using a camera" refers to technologies or methods for capturing a user's facial expressions using a camera and analyzing the data to recognize emotions.

[1455] "Means for placing an avatar in a virtual space" refers to the technology or method for displaying an avatar in a digital virtual environment and allowing it to interact with other users.

[1456] A system for implementing the present invention has the following configuration.

[1457] System Configuration

[1458] 1. Server

[1459] Learning method: The server collects and analyzes data such as an individual's principles, thoughts, and hobbies to learn. Specifically, it uses social media posts and past interaction history.

[1460] Generation method: Based on the learned information, an AI capable of interacting with the individual in a manner that closely resembles their personality is generated. The OpenAI API is used to learn from utterance data and generate a dialogue script.

[1461] Automated Responses: The generated AI is used to generate automated social media message responses and relationship-based responses, allowing users to receive personalized responses in real time.

[1462] Avatarization method: The generated AI is turned into an avatar, allowing customization using NFTs and interaction in virtual spaces. Linking with 3D modeling software controls the avatar's movements and facial expressions.

[1463] Emotion recognition: Recognizes the user's emotions and changes the avatar's facial expressions and movements accordingly. OpenCV and dlib are used to analyze the user's emotions from the camera footage.

[1464] Virtual space placement method: Place avatars in the virtual space and enable interaction with other users. Use MetaverseConnector to place and operate avatars in the virtual space.

[1465] Hardware and Software

[1466] Hardware: Smartphone, head-mounted display, camera

[1467] Software: OpenAI API, OpenCV, dlib, NFTCustomizer, MetaverseConnector

[1468] Processing flow

[1469] The server first collects data such as an individual's principles, thoughts, and hobbies, and analyzes and learns from it. Next, based on the learned information, it generates an AI capable of interacting with the individual's personality. This AI responds automatically to messages on social media and responds according to relationships. The generated AI is then turned into an avatar, allowing for customization using NFTs and interaction in virtual space. It also recognizes the user's emotions and changes the avatar's facial expressions and movements accordingly. Finally, the avatar is placed in virtual space, enabling interaction with other users.

[1470] Specific examples

[1471] When a user accesses the virtual store using their smartphone, an AI avatar of a celebrity appears and asks the user, "Hello! What products are you looking for today?" When the user smiles at the camera, the avatar also smiles and introduces the products in a more friendly manner.

[1472] Prompt Sentence Examples

[1473] Celebrity quote data: "Hello, what product are you looking for today?"

[1474] Generate a dialogue script based on this data.

[1475] In this way, users can enjoy personalized interactions, enabling realistic communication based on their emotions, and even customizing avatars using NFTs and interacting in virtual spaces in an integrated manner.

[1476] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1477] Step 1:

[1478] The server collects data such as individuals' beliefs, thoughts, and hobbies. Specifically, it collects social media posts and past interaction history, and stores this in a database. The input is individual data, and the output is a dataset for analysis.

[1479] Step 2:

[1480] The server analyzes the collected data and learns characteristics such as an individual's principles, thoughts, and hobbies. Specifically, it analyzes text data using natural language processing technology and extracts features. The input is a dataset, and the output is learned feature data.

[1481] Step 3:

[1482] The server generates an AI that can interact with the individual based on the learned feature data. It uses the OpenAI API to learn the utterance data and generate a dialogue script. The input is the feature data, and the output is the dialogue script.

[1483] Step 4:

[1484] The server uses the generated AI to respond to SNS messages automatically and according to the relationship. Specifically, it receives messages from users and generates automatic responses based on the dialogue script. The input is the message from the user, and the output is the automatic response message.

[1485] Step 5:

[1486] The server turns the generated AI into an avatar, allowing for customization using NFTs and interaction in the virtual space. It works in conjunction with 3D modeling software to control the avatar's movements and facial expressions. The input is a dialogue script and NFT data, and the output is a customized avatar.

[1487] Step 6:

[1488] The server recognizes the user's emotions and changes the avatar's facial expressions and movements accordingly. It uses OpenCV and dlib to analyze the user's emotions from the camera footage. The input is the camera footage, and the output is the recognized emotion data.

[1489] Step 7:

[1490] The server controls the avatar's facial expressions and movements based on the recognized emotional data. Specifically, it changes the avatar's facial expressions and movements in real time according to the emotional data. The input is the emotional data, and the output is the changed avatar's facial expressions and movements.

[1491] Step 8:

[1492] The server places avatars in the virtual space and enables interaction with other users. MetaverseConnector is used to place and operate avatars in the virtual space. The input is a customized avatar, and the output is the placement of the avatar in the virtual space.

[1493] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1494] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1495] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[1496] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1497] [Third embodiment]

[1498] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1499] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1500] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1501] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1502] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1503] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1504] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1505] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1506] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1507] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1508] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1509] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1510] "Example 1"

[1511] In one embodiment of the present invention, an AI engine is used to collect and analyze data such as user social media posts, purchase history, and browsing history as a means for AI to learn about an individual's principles, thoughts, hobbies, etc. This AI engine uses natural language processing technology and machine learning technology to extract and learn about the user's principles, thoughts, hobbies, etc.

[1512] "Example 2"

[1513] Next, as a means of generating AI that can interact with users in a manner similar to their personality based on the learned information, an AI engine is used to generate a dialogue script that reflects the user's principles, thoughts, hobbies, etc. This AI engine then uses the generated dialogue script to converse with the user. Specifically, in response to questions from the user, the AI ​​engine generates a response based on the generated dialogue script and sends it back to the user.

[1514] "Example 3"

[1515] Furthermore, as a means of using the generated AI to turn official celebrity accounts into AI, the AI ​​will learn from the celebrity's remarks and behavioral data provided by the operator of the celebrity's official account and generate an AI that mimics the celebrity's personality. Specifically, the AI ​​will analyze the celebrity's remarks and behavioral data and extract their characteristics. Based on the extracted characteristics, it will generate a dialogue script that mimics the celebrity's personality and use it to dialogue with users.

[1516] "Example 4"

[1517] In addition, the generated AI is turned into an avatar, and 3D modeling software linked to the AI ​​engine is used as a means to enable customization using NFTs and interaction in the Metaverse space. Specifically, the avatar's movements and facial expressions are controlled using dialogue scripts generated by the AI ​​engine. It is also possible to customize the avatar's appearance and equipment using NFTs. Furthermore, this avatar can be placed in the Metaverse space, enabling interaction with other users.

[1518] The processing flow of each embodiment will be described below.

[1519] "Example 1"

[1520] Step 1: The AI ​​engine collects data such as the user's social media posts, purchase history, and browsing history.

[1521] Step 2: The AI ​​engine analyzes the collected data and uses natural language processing and machine learning technologies to extract and learn about the user's principles, thoughts, hobbies, etc.

[1522] "Example 2"

[1523] Step 1: Based on the information it has learned, the AI ​​engine generates a dialogue script that reflects the user's beliefs, thoughts, hobbies, etc.

[1524] Step 2: The AI ​​engine uses the generated dialogue script to converse with the user. Specifically, it generates a response to a question from the user based on the generated dialogue script and sends it back to the user.

[1525] "Example 3"

[1526] Step 1: The AI ​​engine learns from the celebrity's statement and behavioral data provided by the operator of the celebrity's official account.

[1527] Step 2: Analyze the learned data and extract its features.

[1528] Step 3: Based on the extracted features, a dialogue script that mimics the celebrity's personality is generated and used to engage in dialogue with the user.

[1529] "Example 4"

[1530] Step 1: Using 3D modeling software linked to an AI engine, the avatar's movements and facial expressions are controlled using the dialogue script generated by the AI ​​engine.

[1531] Step 2: Customize your avatar's appearance and gear with NFTs.

[1532] Step 3: Place this avatar in the Metaverse space and allow it to interact with other users.

[1533] Example 1

[1534] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1535] In modern society, there is a demand for accurate understanding of individuals' principles, thoughts, hobbies, etc., and for the provision of personalized services based on these. However, conventional systems have had difficulty effectively collecting and analyzing diverse user data and responding to individual needs. It has also been difficult to generate AI capable of interacting with users in a way that closely resembles their personality, and to use it for automated message responses on social media or responses based on relationships. This has hindered improvements to the user experience and efficient communication.

[1536] The identification process by the identification processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means. In this invention, the server includes: means for collecting data such as user postings, purchase history, and browsing history; means for preprocessing the collected data; means for analyzing the preprocessed data and extracting the user's principles, thoughts, and hobbies; means for saving the extracted information and displaying it to the user; means for generating an AI capable of interacting with the user in a manner that is similar to the user's personality based on the learned information; and means for using the generated AI to automatically respond to messages and respond according to relationships. This makes it possible to effectively collect and analyze a variety of user data and respond according to individual needs. Furthermore, by generating an AI capable of interacting with the user in a manner that is similar to the user's personality and using it for automatic message responses and responses according to relationships on SNS, an improved user experience and more efficient communication can be achieved.

[1537] "User" refers to any individual or entity that uses the System.

[1538] "Posted content" refers to information such as text, images, and videos posted by users on platforms such as social networking services (SNS).

[1539] "Purchase history" refers to historical information about products purchased by a user online or offline.

[1540] "Browsing history" refers to the history information of web pages and search queries that a user has viewed on the Internet.

[1541] "Means of collecting data" refers to methods and technologies for obtaining data such as user postings, purchase history, and browsing history.

[1542] "Data preprocessing means" refers to methods and techniques for converting collected data into a format that is easier to analyze.

[1543] "Means for analyzing data" refers to methods and techniques for extracting useful information from pre-processed data.

[1544] "Ideas, thoughts, and hobbies" refers to the user's personal beliefs, ways of thinking, interests, and concerns.

[1545] "Means for storing information" refers to the methods and techniques for storing extracted information in a storage device such as a database.

[1546] "Means for displaying information" refers to the methods and techniques for visually presenting stored information to a user.

[1547] "Means for generating AI" refers to methods and technologies for creating artificial intelligence based on the user's principles, ideas, and hobbies.

[1548] "Automatic message response" refers to a feature in which AI automatically responds to messages on behalf of the user.

[1549] "Responding based on relationships" refers to a function that takes appropriate action based on the user's relationship with other individuals or organizations.

[1550] This invention is a system that collects and analyzes data such as user postings, purchase history, and browsing history to extract the user's principles, thoughts, and hobbies. Furthermore, based on the extracted information, it generates an AI that can interact with the user in a way that closely resembles their personality, and this AI can be used to automatically respond to messages and take actions based on relationships.

[1551] The server first collects user data. Specifically, it uses the API of a social networking service to obtain social media posts, and the API of an e-commerce platform to obtain purchase history. It also uses a web analytics tool to collect browsing history. Specific software, such as Twitter API, Facebook Graph API, Amazon API, and Google Analytics, is used to collect this data.

[1552] The server then preprocesses the collected data, which includes cleaning the text data, tokenizing it, removing stop words, etc., using the Python libraries spaCy and NLTK.

[1553] The server sends the preprocessed data to the AI ​​engine. The AI ​​engine analyzes the data using natural language processing (NLP) and machine learning technologies. Specifically, it uses NLP libraries such as spaCy and NLTK, and TensorFlow and PyTorch for machine learning. The AI ​​engine extracts information such as beliefs, thoughts, and hobbies from users' posts, purchase history, and browsing history.

[1554] For example, if a user posts on Twitter, "I've been thinking a lot about environmental protection lately," purchases eco-friendly products on an e-commerce platform, and searches for "activities for environmental protection" on a search engine, the server collects this data and sends it to the AI ​​engine, which analyzes the data and determines that the user has a strong interest in environmental protection.

[1555] The generated AI can respond to messages automatically and according to the user's beliefs, thoughts, and hobbies. For example, if a user receives a question on social media, the AI ​​can automatically generate an appropriate response on the user's behalf.

[1556] Examples of prompts to be input to a generative AI model include:

[1557] Analyze a user's social media posts, purchase history, and browsing history to extract the user's principles, thoughts, and hobbies. For example, if a user frequently posts about "environmental protection," purchases eco-friendly products, and searches for information about environmental protection, determine that the user is interested in environmental protection.

[1558] In this way, the processing of the system program will be explained in detail while clarifying the roles of the server, terminal, and user.

[1559] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1560] Step 1: Data collection

[1561] The server collects data such as user posts, purchase history, and browsing history. Specifically, it uses the API of a social networking service to obtain SNS posts, and the API of an e-commerce platform to obtain purchase history. It also uses a web analytics tool to collect browsing history. The input is various user data sources, and the output is the collected raw data.

[1562] Step 2: Data Preprocessing

[1563] The server preprocesses the collected data. Specifically, it cleans the text data (removes unnecessary characters and symbols), tokenizes it (divides it into words), and removes stop words (removes frequently occurring but meaningless words). For this, it uses the Python libraries spaCy and NLTK. The input is the collected raw data, and the output is the preprocessed, clean data.

[1564] Step 3: Data analysis

[1565] The server sends the preprocessed data to the AI ​​engine, which analyzes the data using natural language processing (NLP) and machine learning technologies. Specifically, it uses NLP libraries such as spaCy and NLTK, and machine learning libraries such as TensorFlow and PyTorch. The input is preprocessed, clean data, and the output is information about the user's principles, thoughts, and hobbies.

[1566] Step 4: Save your information

[1567] The server stores the analysis results obtained from the AI ​​engine in a database. The input is the analysis results, and the output is the information stored in the database.

[1568] Step 5: Viewing information

[1569] Users can check information about their principles, beliefs, and hobbies through their devices. Specifically, the results are displayed through a web application. The input is the information stored in the database, and the output is the information displayed to the user.

[1570] Step 6: Generate AI

[1571] The server generates an AI that can interact with the user based on the learned information. The input is information about the user's principles, thoughts, and hobbies, and the output is the generated AI.

[1572] Step 7: Automated Message Responses

[1573] The generated AI responds to messages automatically on behalf of the user and responds based on the relationship. Specifically, it automatically generates appropriate responses to questions on social media. The input is a message from the user, and the output is an automatic response from the AI.

[1574] (Application example 1)

[1575] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1576] Modern advertising systems face the challenge of being unable to display advertisements that are optimized for a user's individual beliefs, beliefs, and hobbies. Conventional advertising systems display advertisements based on general demographic information and past behavioral history, which does not adequately reflect a user's individual interests. As a result, advertisements that are not appealing to users are often displayed, resulting in reduced advertising effectiveness.

[1577] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1578] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI that can interact with the individual based on the learned information, means for using the generated AI to automatically respond to messages on SNS and take actions according to relationships, means for collecting data such as the content of users' SNS posts, purchase history, and browsing history, and analyzing this data, and means for displaying advertisements optimized for the user's principles, thoughts, and hobbies based on the analysis results. This makes it possible to display advertisements optimized for the individual interests and concerns of the user.

[1579] "Personal principles, ideas, and hobbies" refers to the specific beliefs, ways of thinking, interests, and concerns of the user.

[1580] "Means of learning" refers to methods and technologies for collecting and analyzing user data to understand user characteristics.

[1581] "AI capable of human-like interactions" refers to artificial intelligence that can have natural conversations with users based on their characteristics.

[1582] "Means of generation" refers to methods and techniques for creating artificial intelligence for specific purposes.

[1583] "Automatic message responses on social networking services" refers to a function that automatically responds to messages on behalf of users on social networking services.

[1584] "Responding according to the relationship" refers to taking appropriate action based on the user's relationship with other users.

[1585] "Means of collecting data" refers to the methods and technologies used to collect information such as users' social media posts, purchase history, and browsing history.

[1586] "Means for analyzing data" refers to methods and technologies for analyzing collected data and extracting user characteristics.

[1587] "Means for displaying advertisements" refers to methods and technologies for displaying advertisements optimized for users based on the analysis results.

[1588] The system for implementing the present invention learns the user's personal principles, thoughts, hobbies, etc., and displays advertisements optimized based on the information. A specific embodiment of this system will be described below.

[1589] First, the server collects data such as the user's social media posts, purchase history, and browsing history. This involves using APIs to obtain data from various platforms. For example, the server uses the API of a social media platform to obtain the user's posts, and the API of an e-commerce site to obtain the user's purchase history.

[1590] The server then preprocesses the collected data, which involves using natural language processing techniques to tokenize the text data and remove stop words, reducing noise in the data and improving the accuracy of the analysis.

[1591] The server then analyzes the preprocessed data, which involves using machine learning techniques to extract the user's principles, thoughts, and hobbies. Specifically, it uses TF-IDF vectorization and KMeans clustering to cluster the user's characteristics.

[1592] Based on the analysis results, the server selects advertisements that are optimized for the user's principles, beliefs, and hobbies, including selecting appropriate advertisements from an advertisement database. The selected advertisements are then displayed on the user's device.

[1593] In implementing this system, the following hardware and software are used:

[1594] Hardware: Servers, user devices (smartphones, tablets, PCs, etc.)

[1595] Software: Natural language processing libraries (e.g., nltk), machine learning libraries (e.g., scikit-learn), API client libraries (e.g., requests)

[1596] As a concrete example, the execution result for the user ID "12345" is shown below. The server collects the SNS posting content, purchase history, and browsing history of the user ID "12345," extracts the user's principles, thoughts, and hobbies, and displays the most appropriate advertisement.

[1597] Example prompts to input to the generative AI model:

[1598] Please create a program that collects the social media posts, purchase history, and browsing history of user ID "12345," extracts the user's principles, thoughts, and hobbies, and displays the most appropriate advertisements.

[1599] In this way, a system can be realized that displays optimal advertisements based on individual user data.

[1600] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1601] Step 1:

[1602] The server collects the user's social media posts. Specifically, it uses the social media platform's API to obtain the post data corresponding to the user ID. The input is the user ID, and the output is the user's post data.

[1603] Step 2:

[1604] The server collects the user's purchase history. Specifically, it uses the API of the e-commerce site to obtain purchase history data corresponding to the user ID. The input is the user ID, and the output is the user's purchase history data.

[1605] Step 3:

[1606] The server collects the user's browsing history. Specifically, it uses the browser's API to obtain browsing history data corresponding to the user ID. The input is the user ID, and the output is the user's browsing history data.

[1607] Step 4:

[1608] The server preprocesses the collected data. Specifically, it uses natural language processing technology to tokenize the text data and remove stop words. The input is the collected data on social media posts, purchase history, and browsing history, and the output is the preprocessed text data.

[1609] Step 5:

[1610] The server analyzes the preprocessed data. Specifically, it uses TF-IDF vectorization and KMeans clustering to extract the user's principles, thoughts, and hobbies. The input is the preprocessed text data, and the output is the clustering results of the user's principles, thoughts, and hobbies.

[1611] Step 6:

[1612] The server selects the optimal advertisement based on the analysis results. Specifically, it selects the advertisement that best suits the user's clustering results from the advertisement database. The input is the clustering results, and the output is the optimized advertisement data.

[1613] Step 7:

[1614] The server displays the selected advertisement on the user's device. Specifically, it sends advertisement data to the user's device and displays it. The input is the optimized advertisement data, and the output is the advertisement displayed on the user's device.

[1615] Example 2

[1616] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1617] Conventional conversational AI systems have had difficulty generating responses that fully reflect a user's personality and interests. Furthermore, they lacked the means to effectively utilize information such as the user's principles, thoughts, and hobbies, resulting in a uniform and lacking individuality in their interactions with the user. Furthermore, customization and flexibility were also issues when using the generated AI for official celebrity accounts or virtual interactions.

[1618] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1619] In this invention, the server includes a means for collecting personal principles, thoughts, hobbies, etc., a means for generating a dialogue script using a generative AI model based on the collected information, and a means for generating responses to questions from the user using the generated dialogue script and returning the responses to the user, thereby enabling the generation of responses that reflect the user's personality and interests.

[1620] "Means for collecting personal principles, thoughts, hobbies, etc." refers to a method or device for collecting information such as a user's principles, thoughts, hobbies, etc. from data provided by the user and past interaction history.

[1621] A "generative AI model" is an artificial intelligence model that generates dialogue scripts based on collected information, and is, for example, a model that uses natural language processing technology.

[1622] A "dialogue script" is a script for generating dialogue content that reflects the user's personality and interests, and is created by a generative AI model.

[1623] "Means for generating a response to a question from a user and sending it back to the user" refers to a method or device for generating an appropriate response to a question sent by the user through a terminal based on a generated dialogue script and sending that response to the user.

[1624] "AI-based celebrity official accounts" refers to using generated AI on celebrity official accounts to automatically respond to messages and take action based on relationships.

[1625] "Avatarization" refers to the process of representing the generated AI as a virtual character, making it visually recognizable to users.

[1626] "Digital assets" refer to customizable items, tokens, etc. that can be used in virtual spaces or on digital platforms.

[1627] "Virtual interaction" refers to a user using generated AI to interact with other users and engage in activities within a virtual reality or augmented reality environment.

[1628] The present invention is a system for generating a dialogue script that reflects the user's principles, thoughts, hobbies, etc., and for engaging in a dialogue with the user. A specific embodiment of this system will be described below.

[1629] The server first collects information about the user, such as their beliefs, thoughts, and hobbies. This information is obtained from data provided by the user and from past conversation history. For example, if a user enters "environmentalism," "pacifism," and "movie appreciation" as profile information, that information is stored in the database.

[1630] Next, the server uses the collected information to generate a dialogue script using a generative AI model (for example, a model using natural language processing technology). Prompts containing the user's principles, thoughts, and hobbies are input to the generative AI model, which then generates a dialogue script that reflects the user's personality.

[1631] Specific prompt examples:

[1632] User Information:

[1633] Principle: Environmentalism

[1634] Ideology: Pacifism

[1635] Hobbies: Watching movies, reading

[1636] An example of the generated interactive script:

[1637] "Hello, what movie would you like to watch today? I know you like environmentally themed movies."

[1638] When a user sends a question via a device (such as a smartphone or PC), the server references the stored dialogue script and generates an appropriate response. A generative AI model is used to generate a response to the user's question.

[1639] Specific response generation examples:

[1640] User Question: What recent movies would you recommend?

[1641] Generates an example response:

[1642] "A recent movie I recommend is 'Don't Look Up.' This movie deals with environmental issues, and I think it will resonate with your environmentalism. It also has a humorous story that you can enjoy."

[1643] The server sends the generated response to the user's terminal, which displays the received response. The user can check the displayed response and ask the next question.

[1644] This system generates dialogue scripts that reflect the user's personality and interests, and by engaging in dialogue with the user, it is possible to provide more personalized responses. The generated AI can also be used to power the official accounts of celebrities and for interactions in virtual spaces. This allows users to utilize the generated AI model in a variety of scenarios.

[1645] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1646] Step 1:

[1647] The server collects information such as the user's beliefs, thoughts, and hobbies. It receives data provided by the user through their device and past interaction history as input, and stores this information in a database. Specifically, it provides a form for the user to enter profile information, and stores the input in the database.

[1648] Step 2:

[1649] The server uses a generative AI model to generate a dialogue script based on the collected information. Information such as the user's principles, thoughts, and hobbies stored in a database is used as input. A prompt containing this information is input to the generative AI model, which then outputs a dialogue script that reflects the user's personality. Specifically, the server sends a prompt to the generative AI model and receives the generated dialogue script.

[1650] Step 3:

[1651] The user sends a question through the terminal. The question entered by the user is received as input. Specifically, the user enters a question through the chat interface, and the question is sent to the server.

[1652] Step 4:

[1653] When the server receives a question from a user, it references the saved dialogue script and generates an appropriate response. It uses the user's question and dialogue script as input. It uses a generative AI model to generate a response to the user's question and obtains the response as output. Specifically, it inputs the question and dialogue script into the generative AI model and receives the generated response.

[1654] Step 5:

[1655] The server sends the generated response to the user's terminal, uses the generated response as input, and specifically sends the generated response to the user's terminal and displays it on the user's chat interface.

[1656] Step 6:

[1657] The user can check the response displayed on the terminal and ask the next question. The displayed response is used as input. Specifically, the user reads the displayed response and inputs the next question.

[1658] (Application example 2)

[1659] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1660] Traditional personalized shopping experiences have been unable to fully reflect the individual characteristics of users, such as their beliefs, thoughts, and hobbies, making it difficult to recommend the most suitable products for them. Furthermore, when interacting with users, only generic responses were provided, which prevented users from increasing satisfaction. This made it difficult to stimulate users' purchasing desire.

[1661] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1662] In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc., means for generating an AI that can interact with the user based on the learned information, means for using the generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies, and means for responding to the user's questions based on the generated dialogue script. This makes it possible to provide optimal product suggestions that reflect the individual characteristics of the user and a high level of satisfaction in dialogue with the user.

[1663] "Means of learning about personal beliefs, thoughts, hobbies, etc." refers to a method for collecting users' values ​​and interests and analyzing data based on them.

[1664] "Means for generating AI that can interact with a user in a manner similar to their personality based on learned information" refers to a method for creating artificial intelligence that can interact with a user in a manner similar to their personality based on collected user information.

[1665] "Means of using generated AI to automatically respond to messages on social media and take actions based on the relationship" refers to a method of using generated artificial intelligence to automatically reply to messages on social networking services and take actions based on the relationship with the user.

[1666] "Means for using generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies" refers to a method that uses generated artificial intelligence to suggest individually optimized products based on the user's values ​​and interests.

[1667] The "means for responding to a user's question based on the generated dialogue script" refers to a method for providing an appropriate response to a question from a user using the generated dialogue script.

[1668] As an embodiment of the present invention, the following system can be constructed.

[1669] First, the server is equipped with a means of learning about an individual's principles, thoughts, hobbies, etc. This means collecting the user's values ​​and interests and analyzing the data based on them. Specifically, it uses software to collect and analyze information entered by the user, past purchase history, and comments on social media. For example, data analysis can be performed using programming languages ​​such as Python and R.

[1670] Next, the server is equipped with a means for generating an AI that can interact with the user in a manner that is close to the user's personality based on the learned information. This means creating an AI that can interact with the user in a manner that is close to the user's personality based on the collected user information. Specifically, the server uses OpenAI's API to generate a dialogue script based on the user's profile information.

[1671] Furthermore, the server has a means for using the generated AI to make personalized product suggestions based on the user's principles, thoughts, and hobbies. This means utilizes the generated artificial intelligence to suggest products that are individually optimized based on the user's values ​​and interests. For example, if a user asks, "What eco-friendly products do you recommend?", the AI ​​will suggest appropriate products by taking into account the user's profile information.

[1672] The server also includes a means for responding to user questions based on the generated dialogue script. This means uses the generated dialogue script to provide appropriate responses to user questions. Specifically, the server generates prompt sentences such as the following and generates responses using OpenAI's API:

[1673] Example prompt sentence:

[1674] "User's principles are eco-friendliness, their philosophy is minimalism, and their hobbies are reading and hiking. User asks: What eco-friendly products do you recommend? Generate a personalized response based on this information."

[1675] In this way, it becomes possible to provide optimal product proposals that reflect the individual characteristics of each user and provide a high level of satisfaction in dialogue with the user.

[1676] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1677] Step 1:

[1678] A user uses a terminal to input information such as personal principles, thoughts, and hobbies.

[1679] Input: Information such as the user's principles, thoughts, hobbies, etc.

[1680] Output: User profile information

[1681] Specific operation: The user enters their values ​​and interests into the input form on the device, such as "eco-friendliness," "minimalism," "reading," and "hiking."

[1682] Step 2:

[1683] The server collects user profile information and stores it in a database.

[1684] Input: User profile information

[1685] Output: User profile information stored in the database

[1686] Specific operation: The server receives the user profile information sent from the terminal and stores it in a database.

[1687] Step 3:

[1688] The server analyzes the user's profile information and generates an AI that can interact with the user in a way that closely resembles their personality.

[1689] Input: User profile information stored in a database

[1690] Output: AI that can interact with users in a way that is close to their personality

[1691] Specific operation: The server retrieves the user's profile information from the database and uses OpenAI's API to generate an interaction script based on the user's information.

[1692] Step 4:

[1693] The user uses the terminal to input a question about the product.

[1694] Input: User question

[1695] Output: User's question

[1696] Specific operation: The user enters a question about a product into an input form on the device. For example, they might enter, "What eco-friendly products do you recommend?"

[1697] Step 5:

[1698] The server receives the user's question and generates a prompt.

[1699] Input: User profile information, user questions

[1700] Output: prompt statement

[1701] Specific behavior: The server generates a prompt sentence like the following based on the user's profile information and the question: "User's principles are eco-friendliness, his philosophy is minimalism, and his hobbies are reading and hiking. User's question: What eco-friendly products do you recommend? Generate a personalized response based on this information."

[1702] Step 6:

[1703] The server uses the generated prompt to call the OpenAI API and generate a response.

[1704] Input: prompt statement

[1705] Output: The generated response

[1706] Specific operation: The server sends the generated prompt text to OpenAI's API and receives the response returned from the API.

[1707] Step 7:

[1708] The server sends the generated response to the user's terminal.

[1709] Input: Generated response

[1710] Output: The response displayed on the user's terminal

[1711] Specific operation: The server sends the generated response to the user's terminal and displays the response on the user's terminal.

[1712] In this way, it is possible to provide optimal product proposals that reflect the individual characteristics of the user and provide a high level of satisfaction in dialogue with the user.

[1713] Example 3

[1714] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1715] Conventional AI systems have had difficulty learning an individual's principles, thoughts, hobbies, etc. and interacting with them in a way that reflects their personality. It has also been difficult to create AI for the official accounts of celebrities or to create three-dimensional models of the generated AI for virtual interaction. Furthermore, customization features using digital assets have been lacking.

[1716] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes means for learning an individual's principles, thoughts, hobbies, etc.; means for generating a generative AI model capable of interacting with the individual based on the learned information; means for using the generated generative AI model to automatically respond to messages on a communication network or respond according to relationships; means...

Claims

1. A means of collecting data such as user posts, purchase history, and browsing history, A means for analyzing the collected data using natural language processing technology or machine learning technology to extract and learn the principles, thoughts, and hobbies of the user; A means for recognizing emotions from the user's posts and actions; A means for generating an AI capable of interacting with the user in a manner similar to the user's personality, based on the results of learning the user's principles, thoughts, and hobbies and the results of recognizing the user's emotions; Using the generated AI, we will be able to automatically respond to messages on social media and respond according to relationships. A system including:

2. The system of claim 1, further comprising a means for utilizing the generated AI to turn a celebrity's official account into an AI.

3. The system according to claim 1, further comprising means for turning the generated AI into an avatar and enabling customization using digital assets or interaction in a virtual space.

Images