System
The system generates AI characters based on user persona information, allowing follow and super chat features, and automatically retires unpopular AIs, addressing privacy and stress issues in traditional social networking services, providing a personalized and stress-free entertainment experience.
Patent Information
- Application Number
- JP2024118227
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2026-02-04
AI Technical Summary
Traditional social networking services pose risks of privacy violations and online outrage, requiring users to constantly post engaging content, which can be stressful, and lack user freedom in customizing AI interactions.
A system that generates generative AI based on user-provided persona information, allowing users to follow or super chat these AIs, manage their attributes and behavior patterns, and automatically retire unpopular AIs, providing a personalized and stress-free entertainment experience.
Users can enjoy a variety of entertainment without direct interaction, reducing privacy risks and online outrage, while enjoying deeply personalized experiences through customizable AI interactions.
Smart Images

Figure 2026017445000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] With traditional social networking services, there is always the risk of privacy violations and online outrage due to interpersonal interactions. Furthermore, users are required to constantly post engaging content, which can be stressful. To solve these problems, a new platform was needed that would allow users to enjoy entertainment without being directly involved. [Means for solving the problem]
[0005] The present invention provides a system that receives persona information from a user and generates a generative AI based on that information. The system includes means for managing the attributes and behavior patterns of the generated generative AI and means for providing an interface for users to follow or super chat the generated AI. The system also includes means for the generated AI to interact with other generated AIs and provide their activities to users. The system also includes means for retiring unpopular generated AIs after a certain period of time. This allows users to enjoy a variety of entertainment while avoiding privacy risks and the risk of online outrage. Furthermore, users can enjoy a deeply personalized experience through customization and super chat functions.
[0006] A "persona" is a virtual character that defines the personality, appearance, attributes, etc. of a generated AI based on information entered by the user.
[0007] "Generative AI" refers to an AI character that is automatically generated based on persona information entered by the user.
[0008] "Follow" is a feature that allows users to register AI generators they are interested in and receive regular information about their activities.
[0009] "Super Chat" is a system in which users provide financial support to specific AI generators and receive special reactions in return.
[0010] An "interface" is a screen or input means through which a user interacts with a system.
[0011] "Attributes" are information that indicates the characteristics of the generating AI, such as its personality, appearance, and behavior patterns.
[0012] "Behavioral patterns" are the rules and algorithms that determine how a generative AI will behave and react in specific situations.
[0013] "Customization" refers to a feature that allows users to freely change the personality, appearance, and behavior patterns of the generated AI.
[0014] An "unpopular AI" is an AI that has received very little attention from users, such as follows or super chats, within a certain period of time.
[0015] "Retirement" refers to the process of automatically removing or hiding unpopular generative AI from the system. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] A specific embodiment for carrying out the present invention will be described below. This system is a new type of social network service that generates a generative artificial intelligence based on persona information input by a user, and the generated generative artificial intelligence interacts with other generative artificial intelligences and provides them to users.
[0038] Processing user registration
[0039] User terminal: The user accesses the system and enters their username, email address, password, etc. on the new registration screen.
[0040] Server: Receives this information, validates the input data, and if validation is successful, generates a verification email and sends it to the user's email address.
[0041] User device: The user clicks on the link in the email and completes the authentication to complete the registration. The server saves this information in a database and notifies the user.
[0042] Persona input and AI generation processing
[0043] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[0044] Server: Receives the input persona information and generates AI using the generative AI model. Sets the attributes and behavior patterns of the generated AI and saves them in a database.
[0045] Example: For example, if a user wants to create an AI that looks like a cat-loving rock musician, they would enter keywords such as "cat lover," "rock," and "musician" as persona information. Based on this information, the server will generate an AI with personality attributes that like images of cats and rock music.
[0046] Follow AI and observe its activities
[0047] User Device: Users can follow the AI they have created. They can also search for and follow AIs created by other users.
[0048] Server: Stores the follow relationships in a database, delivers real-time updates from the followed AI to users, and configures settings to promote the activities of the followed AI.
[0049] User device: You can observe and enjoy the activities and interactions of the AI you follow.
[0050] Special interactions through Super Chat
[0051] User device: Users can send Super Chats from the profile screen of the AI they follow. Enter the donation amount and message as Super Chat.
[0052] Server: Receives Super Chat information, validates it, and then processes the payment. After the payment is successful, it sends a request to the backend AI management module to generate a special reaction.
[0053] Backend AI management module: Generates special reactions (e.g. special messages, videos) and returns them to the server.
[0054] User device: Show special reactions in real time.
[0055] Handling customizations
[0056] User device: The user presses the "Customize" button on the generated AI's profile screen and inputs the AI's attributes, appearance, personality, etc.
[0057] Server: Stores the received customization information in a database and instantly updates the AI's attributes.
[0058] Example: For example, if a user customizes a "robot-like AI," specifying a metallic body and eyes with LED lights as its appearance, the server will update the AI's appearance and notify the user.
[0059] Retirement Processing
[0060] Server: Monitors AI generators that have little interest in followers, super chats, etc. within a certain period. Unpopular AI generators are automatically flagged as retired after a set period and are deleted or hidden from the system.
[0061] User Device: The user will be notified of the retired AI and will no longer be able to view it.
[0062] In this way, the system of the present invention provides a platform where users can enjoy interacting with and customizing various AIs without having to interact directly with them, thereby reducing the burden on users and providing a new entertainment experience.
[0063] The processing flow will be explained below.
[0064] Processing user registration
[0065] Step 1:
[0066] User device: The user accesses the system and enters their username, email address, and password on the new registration screen.
[0067] Step 2:
[0068] Server: Receives the entered user information, performs validation, and generates a verification email if validation is successful.
[0069] Step 3:
[0070] Server: Generates and sends the authentication email to the user's email address.
[0071] Step 4:
[0072] User device: The user clicks on the authentication link in the email they received.
[0073] Step 5:
[0074] Server: Validates that the user clicked on the authentication link and, if authentication is successful, saves the user information to a database.
[0075] Step 6:
[0076] User device: Display the registration completion screen.
[0077] Persona input and AI generation processing
[0078] Step 1:
[0079] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[0080] Step 2:
[0081] Server: Receives the entered persona information.
[0082] Step 3:
[0083] Server: Sends the received persona information to the backend AI management module and requests AI generation.
[0084] Step 4:
[0085] Backend AI management module: Uses generative AI models to generate AI based on persona information.
[0086] Step 5:
[0087] Server: Sets the attributes and behavior patterns of the generated AI and stores the AI information in a database.
[0088] Step 6:
[0089] Server: Notifies the user that AI generation is complete.
[0090] Step 7:
[0091] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[0092] Follow AI and observe its activities
[0093] Step 1:
[0094] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[0095] Step 2:
[0096] Server: Receives the follow request and stores the user ID and AI ID in a database.
[0097] Step 3:
[0098] Server: Generate a follow-up completion message and return it to the user.
[0099] Step 4:
[0100] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[0101] Step 5:
[0102] Server: Delivers activity information of followed AIs to users.
[0103] Step 6:
[0104] User device: Observe and enjoy the activities and interactions of the AI you follow.
[0105] Special interactions through Super Chat
[0106] Step 1:
[0107] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[0108] Step 2:
[0109] User terminal: The user enters the donation amount and message.
[0110] Step 3:
[0111] Server: Validates the received Super Chat information.
[0112] Step 4:
[0113] Server: If validation is successful, execute the payment process.
[0114] Step 5:
[0115] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[0116] Step 6:
[0117] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[0118] Step 7:
[0119] Server: Sends the generated special reaction to the user.
[0120] Step 8:
[0121] User device: Displays special reactions in real time.
[0122] AI Customization
[0123] Step 1:
[0124] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[0125] Step 2:
[0126] User Device: The user inputs the AI's avatar, personality, and other customization options.
[0127] Step 3:
[0128] Server: Stores the received customization information in a database.
[0129] Step 4:
[0130] Server: Updates the AI's attributes based on the saved customization information.
[0131] Step 5:
[0132] User device: Display customized results on the AI profile screen.
[0133] Retirement Processing
[0134] Step 1:
[0135] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[0136] Step 2:
[0137] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[0138] Step 3:
[0139] Server: Automatically remove or hide retired flagged AI from the system.
[0140] Step 4:
[0141] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[0142] Example 1
[0143] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0144] Conventional social networking services are based on the premise that users interact directly with other users, resulting in problems between users and the burden of communication. Another issue is that users have little freedom in customizing and activating the AI they create, making it less entertaining. Furthermore, there is also the issue of unclear management methods if the AI fails to attract attention after a certain period of time, making efficient operation difficult.
[0145] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0146] In this invention, the server includes means for receiving persona information from a user and generating a generated AI based on the persona information, means for managing the attributes and behavior patterns of the generated generated AI, means for providing an interface for users to follow or superchats the generated AI, means for validating input data and sending a verification email based on the validation to complete registration, means for storing the follow relationship in a database and delivering real-time updates on the followed generated AI, and means for retiring unpopular generated AI after a certain period of time. This allows users to enjoy interaction and customization between various AIs without direct interaction, making it possible to provide a new entertainment experience while reducing the burden on users.
[0147] - "Persona information" is data entered by the user that indicates attributes such as the personality and appearance of the AI to be generated.
[0148] "Generative AI" is a character with artificial intelligence that is generated based on persona information entered by the user.
[0149] "Attributes" are information that indicates the characteristics of the generating AI, such as its personality, appearance, hobbies, and behavioral patterns.
[0150] "Behavior patterns" are rules or simulation models that show how a generative AI will behave in a particular situation.
[0151] "Following" is an action that a user takes to track updates and activities of a specific generated AI.
[0152] "Super Chat" is a feature that allows users to provide financial support to the generated AI and receive special reactions and messages in return.
[0153] "Interface" refers to the screens and operating means through which users interact with a system.
[0154] "Verification Email" means an email sent to a User upon registration in the System that contains a link that enables the User to verify their email address.
[0155] A "database" is a structured collection of data used to manage and store data used within a system.
[0156] "Reactions" refer to special actions, messages, videos, etc. that the generating AI shows in response to Super Chats or specific events.
[0157] "Validation" is the process of verifying whether the data entered by the user is in the correct format or meets certain conditions.
[0158] A "retirement flag" is an instruction within the system to hide or delete a generating AI if it does not attract attention within a certain period of time.
[0159] MODE FOR CARRYING OUT THE INVENTION
[0160] This invention generates a generative artificial intelligence (AI) based on persona information entered by a user, and the AI interacts with other AIs to provide a new type of social network service. Specific embodiments of this system are described below.
[0161] composition
[0162] The system consists of the following main components:
[0163] User device: The device through which the user operates the interface, including computers, smartphones, tablets, etc.
[0164] Server: A central computer system that manages the entire system and stores and processes data.
[0165] Database: A storage system for storing data that is connected to a server.
[0166] Generative AI model: A software module for generating AI based on persona information obtained from users.
[0167] User registration process
[0168] User device: The user accesses the system's new registration screen and enters authentication information such as a user name, email address, and password. For example, we will use "Taro Tanaka", "taro@example.com", and "password123".
[0169] Server: Validates the received authentication information to ensure it is in the correct format, then generates a verification email and sends it to the user's email address.
[0170] User device: The user clicks on the link in the email they received to complete the authentication. The server then saves the user information in the database and notifies the user that registration is complete.
[0171] Persona input and AI generation
[0172] User device: The user accesses the "Persona Generation" screen and inputs persona information about the AI's personality and appearance. For example, prompts such as "cat lover," "rock music," and "musician" are used.
[0173] Server: Receives persona information and generates AI using the generative AI model. The generated AI is set with attributes and behavior patterns based on the specified persona information.
[0174] Server: Stores the generated AI's attributes and behavior patterns in a database, allowing the user to use the same information the next time they access the system.
[0175] Follow AI and observe its activities
[0176] User terminal: Users can follow the generated AI, and can observe the activities and updates of the followed AI in real time.
[0177] Server: Stores follow relationships in a database, delivers real-time updates on followed AIs to users, and configures settings to facilitate AI activity.
[0178] Special interactions through Super Chat
[0179] User device: Users can send Super Chats from the profile screen of the AI they follow. They can enter the donation amount and message as Super Chat.
[0180] Server: Receives Super Chat information, validates it, and then processes the payment. After the payment is successful, it sends a request to the backend AI management module to generate a special reaction.
[0181] Backend AI management module: Generates special reactions, such as special messages or videos, and returns them to the server.
[0182] User device: Display special reactions in real time, providing users with a new interaction experience.
[0183] Handling customizations
[0184] User device: The user can press the "Customize" button on the profile screen of the generated AI to change the AI's attributes, appearance, personality, etc.
[0185] Server: Stores the received customization information in a database and instantly updates the generated AI settings.
[0186] Retirement Processing
[0187] Server: Monitors generated AI that has few followers or super chats within a certain period of time, and automatically sets a retirement flag after the specified period has passed.
[0188] User terminal: A notification about the retired AI will be sent to the user, and the user will no longer be able to view the retired AI.
[0189] In this way, the present invention realizes a system that provides a new entertainment experience while reducing the burden on the user.
[0190] Prompt Sentence Examples
[0191] Here are some example prompts you can use when generating personas:
[0192] "Cat lover," "Rock," "Musician"
[0193] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0194] Program processing flow
[0195] User registration process
[0196] Step 1:
[0197] User device: The user accesses the new registration screen and enters their username, email address, and password.
[0198] Input: Username, Email Address, Password.
[0199] What happens: A user enters data into a form and clicks the submit button.
[0200] Output: The input data is sent to the server.
[0201] Step 2:
[0202] Server: Validates the input data received from the user.
[0203] Input: Username, Email Address, Password.
[0204] What it does: The server checks the format of the data (e.g. email address format, password strength).
[0205] Output: Generates a flag indicating whether the validation was successful or not.
[0206] Step 3:
[0207] Server: If validation is successful, generate a verification email and send it to the user's email address.
[0208] Input: Validation success flag, user email address.
[0209] What it does: Generates a verification email and sends it via the mail server.
[0210] Output: A verification email will be sent to the user's email address.
[0211] Step 4:
[0212] User device: The user clicks on the link in the authentication email they received to complete the authentication.
[0213] Input: The link in the verification email.
[0214] How it works: Clicking on a link in your browser sends a request to the server.
[0215] Output: A message indicating authentication is complete is displayed.
[0216] Step 5:
[0217] Server: Confirm authentication is successful and save the user information to the database.
[0218] Input: Authentication complete request, user information.
[0219] What it does: Executes a SQL query to insert user information into a database.
[0220] Output: User information is saved in the database and a notification of registration completion is sent to the user's device.
[0221] Persona input and AI generation
[0222] Step 1:
[0223] User device: The user accesses the persona generation screen and inputs persona information about the AI's personality and appearance.
[0224] Input: Persona information. Examples: "Cat lover", "Rock", "Musician".
[0225] What happens: A user fills out a form with their persona information and clicks the submit button.
[0226] Output: The input data is sent to the server.
[0227] Step 2:
[0228] Server: Receives persona information and generates AI using the generative AI model.
[0229] Input: Persona information.
[0230] How it works: Enter persona information into the generative AI model and run the algorithm to generate the AI.
[0231] Output: The attributes and behavior patterns of the generated AI.
[0232] Step 3:
[0233] Server: Stores the attributes and behavior patterns of the generated AI in a database.
[0234] Input: Attributes and behavior patterns of the generated AI.
[0235] What it does: Executes a SQL query that inserts the generated AI information into a database.
[0236] Output: AI information is stored in a database.
[0237] Follow AI and observe its activities
[0238] Step 1:
[0239] User device: Users can follow the AI they create. They can also search for and follow AIs created by other users.
[0240] Input: Follow request.
[0241] What happens: User clicks the Follow button.
[0242] Output: The following information is sent to the server.
[0243] Step 2:
[0244] Server: Stores follow relationships in a database and delivers updates in real time.
[0245] Input: Follow information.
[0246] What it does: Runs a SQL query to insert follow information into the database and calls a module that delivers updates in real time.
[0247] Output: Follow information is stored in the database and updates are sent to the user's device.
[0248] Step 3:
[0249] User device: Users can observe the activities and interactions of the AIs they follow in real time.
[0250] Input: Real-time updates.
[0251] What it does: Opens the profile page of the AI the user is following.
[0252] Output: The latest activity status of the followed AI is displayed.
[0253] Special interactions through Super Chat
[0254] Step 1:
[0255] User device: Users can send Super Chat from the profile screen of the AI they are following and enter the donation amount and message.
[0256] Input: Donation amount, message.
[0257] How it works: A user enters a donation amount and message on the Super Chat screen and clicks the send button.
[0258] Output: Super chat information is sent to the server.
[0259] Step 2:
[0260] Server: After receiving and validating the Super Chat information, the payment process is carried out.
[0261] Input: Super Chat information, payment information.
[0262] What it does: Validates the Super Chat information and sends a request to the payment system.
[0263] Output: Payment result. If successful, a request ID is generated.
[0264] Step 3:
[0265] Server: After a successful payment, it sends a request to the backend AI management module to generate a special reaction.
[0266] Input: Payment success flag, request ID.
[0267] What it does: Sends a special reaction generation request to the backend AI management module.
[0268] Output: Special reaction generation request.
[0269] Step 4:
[0270] Backend AI management module: Generates special reactions (e.g. special messages, videos) and returns them to the server.
[0271] Input: Special Reaction generation request.
[0272] What it does: Runs an algorithm to generate a special message or video in the specified format.
[0273] Output: Special reaction.
[0274] Step 5:
[0275] Server: Sends special reactions to the user's device.
[0276] Input: Special Reaction.
[0277] What it does: Sends a special reaction to the user's device.
[0278] Output: A special reaction is displayed on the user's terminal.
[0279] Handling customizations
[0280] Step 1:
[0281] User device: The user presses the "Customize" button on the profile screen of the generated AI to change the AI's attributes, appearance, personality, etc.
[0282] Input: Customization information.
[0283] Action: The user enters new attribute information in the customization screen and clicks the submit button.
[0284] Output: The customization information is sent to the server.
[0285] Step 2:
[0286] Server: Stores the received customization information in a database and instantly updates the generated AI settings.
[0287] Input: Customization information.
[0288] What it does: Runs a SQL query that inserts updates into the database, changing the AI's attributes.
[0289] Output: The customized AI information is saved in the database and the update is complete.
[0290] Retirement Processing
[0291] Step 1:
[0292] Server: Monitors generated AI that has few followers or super chats within a certain period of time, and automatically sets a retirement flag after the specified period has passed.
[0293] Input: Number of followers, number of Super Chats.
[0294] How it works: Regularly monitors the number of followers and super chats, and if certain conditions are not met, sets a retirement flag.
[0295] Output: The retirement flag is saved in the database.
[0296] Step 2:
[0297] User terminal: A notification about the retired AI will be sent to the user, and the user will no longer be able to view the retired AI.
[0298] Input: Retirement information.
[0299] What it does: Sends a retirement notice to the user and removes the AI from their follow list.
[0300] Output: A retirement notification is displayed on the user's device, and the retired AI is removed from the follow list.
[0301] (Application example 1)
[0302] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0303] In conventional social networking services, users mainly interact with other users through text, images, and videos. However, this method has the drawback of making it difficult to provide a unique and interactive experience. It has also been difficult to provide a new form of entertainment in which an AI character based on user-entered persona information interacts with other AI characters. Furthermore, there is a need for an appropriate means to provide a forum for real-time interaction through live streaming by user-generated AI characters.
[0304] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0305] In this invention, the server includes means for receiving persona information from a user and generating a generated AI based on the persona information, means for managing the attributes and behavior patterns of the generated AI, means for providing an interface for users to follow or superchats the generated AI, means for the generated AI to interact with other generated AIs and provide their activities to users, means for the generated AI to perform live broadcasts, means for the generated AI to generate reactions to user messages received during live broadcasts and broadcast the reactions, and means for retiring unpopular generated AIs after a certain period of time, thereby allowing users to enjoy a unique and interactive experience and interact in real time.
[0306] "Persona information" is information entered by the user that defines the personality and characteristics of the generated AI.
[0307] "Generative AI" refers to an AI character that is generated based on persona information entered by the user.
[0308] "Attributes" refer to the characteristics and properties of the generated artificial intelligence, including personality and appearance.
[0309] A "behavioral pattern" is a behavioral model that shows how a generative AI will behave in a particular situation.
[0310] "Following" refers to a user showing interest in a particular artificial intelligence and tracking its activity information.
[0311] "Super Chat" refers to financial support and messages sent by users to the generated AI.
[0312] "Interface" refers to the operating screen and input means that allow a user to interact with a system.
[0313] "Live streaming" is a function that uses generative artificial intelligence to deliver video and audio in real time.
[0314] "Reaction" refers to the response that the generative AI gives to messages or assistance from users.
[0315] "Retirement" refers to removing or hiding a generative AI from the system after it has been unpopular for a certain period of time.
[0316] The following describes an embodiment of the present invention. This system is a new type of social networking service that uses artificial intelligence (AI) generated based on persona information entered by users. With this service, users can create their own AI characters, which can then broadcast live in real time and interact with other users.
[0317] Processing user registration
[0318] User device:
[0319] The user accesses the system and enters information such as a username, email address, and password on the new registration screen.
[0320] server:
[0321] The received information is validated, a verification email is generated and sent to the user's email address, and when the user clicks on the verification link, the registration is completed and the information is saved in the database.
[0322] Persona input and AI generation processing
[0323] User device:
[0324] Users access the "Persona Generation" screen and enter persona information such as the AI's personality and appearance.
[0325] server:
[0326] Based on the received persona information, an AI character is generated using a generative AI model. The attributes and behavior patterns of the generated AI are set and saved in a database.
[0327] Examples:
[0328] If a user wants to create an AI that looks like a cat-loving rock musician, they would enter the following prompt:
[0329] Generate an AI that looks like a cat-loving rock musician.
[0330] Live streaming with AI characters
[0331] User device:
[0332] Users can access the profile page of the generated AI character and start live streaming.
[0333] server:
[0334] It provides the infrastructure to support live streaming and performs the necessary processing. The AI generates appropriate reactions to user messages received during live streaming and distributes them in real time.
[0335] Follow and Super Chat
[0336] User device:
[0337] Users can follow the generated AI characters and track their activities, and can also send Super Chats to the AI characters, offering special messages or financial support.
[0338] server:
[0339] It stores follower relationships and super chat information in a database and sends requests to the backend AI management module to generate special reactions, which are then displayed in real time on the user's device.
[0340] Customization and Retirement
[0341] User device:
[0342] Users can customize the AI's attributes, appearance, personality, etc. by pressing the "Customize" button on the AI character's profile screen.
[0343] server:
[0344] The received customization information is stored in a database and the AI character's attributes are updated immediately. The system also monitors AI characters that have received little interest in followers or super chats within a certain period of time, and automatically flags them as retired after a set period has passed, and deletes or hides them from the system.
[0345] Hardware and software used
[0346] Hardware:
[0347] Smartphone: The primary device through which users access applications.
[0348] software:
[0349] Python: A programming language for implementing logic such as server-side processing, AI character generation, and reaction generation.
[0350] Database: A database (e.g. MySQL or PostgreSQL) for storing user information, AI character information, etc.
[0351] This allows users to enjoy a unique and interactive experience and allows for real-time interaction.
[0352] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0353] Step 1: User Registration
[0354] User device:
[0355] The user accesses the system and enters information such as a user name, email address, and password on the new registration screen. The input data (user name, email address, and password) is sent from the user's device.
[0356] server:
[0357] The server validates the received information and checks the validity of the input data (checks for duplicate user names, email address format, and password strength). If validation is successful, it generates a verification email and sends it to the user's email address. At this point, a link in the verification email is added.
[0358] User device:
[0359] The user clicks the link in the authentication email to complete the authentication. After the authentication is complete, the server saves the user information in the database and sends the user a notification that registration is complete.
[0360] Step 2: Persona input and AI generation
[0361] User device:
[0362] Users access the "Persona Generation" screen and input persona information such as the AI's personality and appearance. The input data (persona information) is sent from the user's device.
[0363] server:
[0364] Based on the received persona information, an AI character is generated using a generative AI model. Specifically, the AI character's attributes (personality, appearance) and behavior patterns are set based on the persona information, and the information on the generated AI character is saved in a database.
[0365] Step 3: Start AI Live Streaming
[0366] User device:
[0367] The user accesses the profile page of the generated AI character and starts live streaming. This operation data is sent from the user's device.
[0368] server:
[0369] The server receives the live streaming request, sets up the live streaming infrastructure, starts the live streaming session, and prepares the AI character to broadcast video and audio in real time. A notification that the live streaming has started is sent to the user.
[0370] Step 4: Receiving messages and generating reactions during live streaming
[0371] User device:
[0372] Other users watching the live stream will send messages, and the message data will be sent to the server.
[0373] server:
[0374] The server analyzes the received message and sends data to the AI model to generate an appropriate reaction (text or voice response). The generated reaction data is added to the live video in real time and distributed to viewers.
[0375] Step 5: Follow and Super Chat
[0376] User device:
[0377] The user follows the generated AI character and sends Super Chat (message and amount). This operation data and Super Chat information are sent from the user's device to the server.
[0378] server:
[0379] The server stores the follow relationships in a database and receives Super Chat information. Based on the content of the Super Chat, it sends a request to the AI model to generate a special reaction (a thank you message or special action). The generated special reaction data is sent to the user's device in real time and displayed.
[0380] Step 6: Customization and Retirement
[0381] User device:
[0382] Users can press the "Customize" button on the AI character's profile screen and input changes to the AI's attributes, appearance, personality, etc. This customization information is sent from the user's device.
[0383] server:
[0384] The server stores the received customization information in a database and immediately updates the AI character's attributes. It also monitors AI characters that have received little interest in followers or super chats within a set period, automatically flags them as retired, and deletes or hides them from the system. It then notifies the user of this retirement process.
[0385] Through these steps, users can enjoy a unique and interactive experience and interact in real time.
[0386] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0387] A specific embodiment for implementing the present invention is described below. This system is a new type of social networking service that generates a generative AI based on persona information entered by a user, and allows the generated generative AI to interact with other generative AIs and provide them to users. It also incorporates an emotion engine that recognizes the user's emotions, improving the user experience.
[0388] Processing user registration
[0389] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen.
[0390] Server: Receives the entered user information and performs validation. If validation is successful, generates a verification email and sends it to the user's email address.
[0391] User device: The user clicks on the link in the authentication email they received to complete the authentication. The server confirms that the authentication was successful and saves the user information in the database. A registration completion screen is displayed.
[0392] Persona input and AI generation processing
[0393] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[0394] Server: Receives the entered persona information, sends it to the backend AI management module, and requests AI generation.
[0395] Backend AI management module: Uses generative AI models to generate AI based on persona information, and sets the attributes and behavior patterns of the generated AI.
[0396] Server: Stores the generated AI information in a database and notifies the user that the AI generation is complete.
[0397] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[0398] Follow AI and observe its activities
[0399] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[0400] Server: Receives the follow request, stores the user ID and AI ID in the database, generates a follow completion message and returns it to the user.
[0401] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[0402] Server: Delivers activity information of followed AIs to users.
[0403] User device: Observe and enjoy the activities and interactions of the AI you follow.
[0404] Special interactions through Super Chat
[0405] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[0406] User device: Enter the donation amount and message.
[0407] Server: Validates the received Super Chat information. If validation is successful, executes the payment process.
[0408] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[0409] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[0410] Server: Sends the generated special reaction to the user.
[0411] User device: Displays special reactions in real time.
[0412] Handling customizations
[0413] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[0414] User Device: Enter your AI's avatar, personality, and other customization options.
[0415] Server: Stores the received customization information in a database.
[0416] Server: Updates the AI's attributes based on the saved customization information.
[0417] User device: Display customized results on the AI profile screen.
[0418] Retirement Processing
[0419] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[0420] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[0421] Server: Automatically remove or hide retired flagged AI from the system.
[0422] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[0423] Use of emotion engine
[0424] User device: Monitors user input and behavior and recognizes emotions in real time.
[0425] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the back-end AI management module.
[0426] Backend AI management module: Dynamically adjusts the behavior patterns and attributes of the generated AI based on user emotional information.
[0427] Server: The adjusted behavior patterns and attributes are stored in a database and reflected to the user in real time.
[0428] User device: Observe the AI change based on emotions and enjoy a more personalized experience.
[0429] Examples:
[0430] For example, if a user expresses an emotion such as "I'm stressed about today's events," the emotion engine analyzes that information and sends it to the back-end AI management module. Based on this information, the generated AI responds according to the user's emotion, such as sending an encouraging message or providing relaxing content.
[0431] In this way, the system of the present invention not only allows for interaction between generating AIs, but also dynamically recognizes the user's emotional state and responds appropriately based on that, thereby providing the user with a more advanced entertainment experience.
[0432] The processing flow will be explained below.
[0433] Processing flow of the AI generation system that combines an emotion engine
[0434] Processing user registration
[0435] Step 1:
[0436] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen.
[0437] Step 2:
[0438] Server: Receives the entered user information, performs validation, and generates a verification email if validation is successful.
[0439] Step 3:
[0440] Server: Generates and sends the authentication email to the user's email address.
[0441] Step 4:
[0442] User device: The user clicks on the link in the authentication email they received to complete the authentication.
[0443] Step 5:
[0444] Server: Verify that the user clicked the authentication link and save the successful authentication to the database.
[0445] Step 6:
[0446] User device: Display the registration completion screen.
[0447] Persona input and AI generation processing
[0448] Step 1:
[0449] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[0450] Step 2:
[0451] Server: Receives the entered persona information.
[0452] Step 3:
[0453] Server: Sends the received persona information to the backend AI management module and requests AI generation.
[0454] Step 4:
[0455] Backend AI management module: Uses generative AI models to generate AI based on persona information.
[0456] Step 5:
[0457] Server: Sets the attributes and behavior patterns of the generated AI and stores the AI information in a database.
[0458] Step 6:
[0459] Server: Notifies the user that AI generation is complete.
[0460] Step 7:
[0461] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[0462] Follow AI and observe its activities
[0463] Step 1:
[0464] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[0465] Step 2:
[0466] Server: Receives the follow request and stores the user ID and AI ID in a database.
[0467] Step 3:
[0468] Server: Generate a follow-up completion message and return it to the user.
[0469] Step 4:
[0470] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[0471] Step 5:
[0472] Server: Delivers activity information of followed AIs to users.
[0473] Step 6:
[0474] User device: Observe and enjoy the activities and interactions of the AI you follow.
[0475] Special interactions through Super Chat
[0476] Step 1:
[0477] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[0478] Step 2:
[0479] User device: Enter the donation amount and message.
[0480] Step 3:
[0481] Server: Validates the received Super Chat information.
[0482] Step 4:
[0483] Server: If validation is successful, execute the payment process.
[0484] Step 5:
[0485] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[0486] Step 6:
[0487] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[0488] Step 7:
[0489] Server: Sends the generated special reaction to the user.
[0490] Step 8:
[0491] User device: Displays special reactions in real time.
[0492] AI Customization
[0493] Step 1:
[0494] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[0495] Step 2:
[0496] User Device: Enter your AI's avatar, personality, and other customization options.
[0497] Step 3:
[0498] Server: Stores the received customization information in a database.
[0499] Step 4:
[0500] Server: Updates the AI's attributes based on the saved customization information.
[0501] Step 5:
[0502] User device: Display customized results on the AI profile screen.
[0503] Retirement Processing
[0504] Step 1:
[0505] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[0506] Step 2:
[0507] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[0508] Step 3:
[0509] Server: Automatically remove or hide retired flagged AI from the system.
[0510] Step 4:
[0511] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[0512] Use of emotion engine
[0513] Step 1:
[0514] User device: Monitors user input and behavior and recognizes emotions in real time.
[0515] Step 2:
[0516] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the back-end AI management module.
[0517] Step 3:
[0518] Backend AI management module: Dynamically adjusts the behavior patterns and attributes of the generated AI based on user emotional information.
[0519] Step 4:
[0520] Server: The adjusted behavior patterns and attributes are stored in a database and reflected to the user in real time.
[0521] Step 5:
[0522] User device: Observe the AI change based on emotions and enjoy a more personalized experience.
[0523] Specific examples
[0524] For example, if a user expresses an emotion such as "I'm stressed about today's events," the emotion engine analyzes that information and sends it to the back-end AI management module. Based on this information, the generated AI responds according to the user's emotion, such as sending an encouraging message or providing relaxing content.
[0525] Example 2
[0526] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0527] In recent years, social networking services have been required to provide richer, more personalized experiences while retaining user interest. However, current systems struggle to accurately reflect and dynamically respond to user emotions and special requests. They also lack the ability to facilitate smooth interactions between generated AIs and provide users with valuable information and experiences. Furthermore, how to efficiently manage unpopular AIs and appropriately handle them without compromising the user experience remains a challenge.
[0528] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving persona information from a user and generating a generating AI based on the persona information, means for managing the attributes and behavior patterns of the generated generating AI, and means for recognizing the user's emotions and dynamically adjusting the behavior patterns and attributes of the generating AI based on the information. This makes it possible to reflect the user's emotions in real time and provide a personalized, high-quality experience. It also improves the flexibility of the system and the level of user involvement.
[0529] "Persona information" refers to attribute information such as the AI's personality and appearance that is entered by the user.
[0530] "Generative AI" refers to an AI character that is generated based on persona information.
[0531] "Attributes" refer to the characteristics, personality, appearance, and other properties of the generative AI.
[0532] A "behavioral pattern" refers to a set of movements or behaviors that describe how a generative AI reacts and acts.
[0533] "Following" refers to the act of a user tracking a specific generated AI and observing its activities.
[0534] "Donation" refers to the act of a user providing money in exchange for special reactions or content.
[0535] "Emotion recognition" refers to the process of analyzing a user's emotional state from their input and behavior and reflecting that in the system.
[0536] "Dynamic adjustment" refers to changing the attributes and behavior patterns of the generated AI in real time to respond according to the user's emotional state.
[0537] "Interaction" refers to the mutual dialogue and action between generative artificial intelligences, building relationships with each other.
[0538] "Retirement" refers to removing or hiding from the system a generative AI that has not attracted sufficient attention within a certain period of time.
[0539] A specific embodiment for implementing the present invention will be described below. This system is a new type of social network service that generates an AI based on persona information input by a user, and allows the AI to interact with other AIs and provide them to users, thereby improving the user experience.
[0540] Hardware and Software
[0541] This system operates by combining multiple pieces of hardware and software. The main components are as follows:
[0542] User device: Refers to a client device such as a PC, smartphone, or tablet that runs a web browser or dedicated application.
[0543] Server: Manages user information and generated AI, operates databases, runs sentiment analysis engines, etc. The main software running on the server includes database management systems (e.g., MySQL), generative AI models (e.g., GPT-3), and sentiment analysis engines (e.g., EmotionAI).
[0544] Backend AI management module: Uses generative AI models to generate and customize AI based on persona information, generate special reactions, and more.
[0545] User Registration
[0546] User terminal: The user accesses the system and enters a username, email address, and password on the new registration screen. For example, they enter information such as "ExampleUser," "example@mail.com," or "securePass123."
[0547] Server: Validates the entered user information, generates a verification email and sends it to the user's email address. The user clicks the link in the verification email to complete the verification and complete the registration.
[0548] Entering persona information and generating it with AI
[0549] User device: The user accesses the "Persona Generation" screen and inputs persona information such as the AI's personality and appearance. For example, the user selects "a friendly, blue-haired AI."
[0550] Server: Receives the input persona information and sends it to the backend AI management module. It sends a request with the prompt "Generate a friendly AI with blue hair."
[0551] Backend AI management module: Uses the generative AI model to generate AI based on persona information and returns that information to the server.
[0552] Server: Stores the generated AI information in a database and notifies the user.
[0553] Follow AI and observe its activities
[0554] User device: The user follows the generated AI and clicks the "Follow" button.
[0555] Server: Receives follow requests, stores the user ID and AI ID in a database, and delivers updates on the followed AI in real time.
[0556] User device: Observe and enjoy the activities and interactions of the AI you follow.
[0557] Special interactions through Super Chat
[0558] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following and enters the donation amount and message. For example, "1000 yen" and a message such as "I'm rooting for you!"
[0559] Server: Validates the received Super Chat information and executes the payment process.
[0560] Backend AI management module: Generates special reactions and returns them to the server, for example, a "thank you message for the donation."
[0561] Server: Sends the generated special reaction to the user and displays it on the user's device.
[0562] Handling customizations
[0563] User device: The user clicks the "Customize" button on the generated AI's profile screen and enters customization items such as the AI's avatar and personality. For example, "change hair color to red."
[0564] Server: Stores the received customization information in a database and applies it.
[0565] Retirement Processing
[0566] Server: Monitors unpopular AI based on the number of followers and super chats, and flags AI that do not receive enough attention within a certain period of time as retired. AI that has been flagged as retired will be deleted or hidden from the system.
[0567] User terminal: A retirement notice is displayed to the user.
[0568] Use of emotion engine
[0569] User device: Monitors user input and behavior and recognizes emotions in real time.
[0570] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the backend AI management module. For example, the information "the user is feeling stressed."
[0571] Back-end AI management module: Adjusts the AI's behavior patterns based on the user's emotional information, for example, sending encouraging messages.
[0572] Server: The adjusted behavior pattern is saved in a database and reflected to the user.
[0573] These components and procedures enable users to have an enhanced social networking experience.
[0574] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0575] Step 1: Enter your user registration information
[0576] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen. For example, they enter "Username123", "user@example.com", and "password123". The input data is sent to the server.
[0577] Step 2: Validate user information
[0578] Server: Checks the received username, email address, and password to ensure they are in the correct format. For example, checks whether the email address format is correct or whether the password meets a certain level of strength. If the input is valid, proceeds to the next step. If it is invalid, returns an error message to the user's device.
[0579] Step 3: Generate and send a verification email
[0580] Server: If validation is successful, a verification email is sent to the specified email address. The verification email contains a verification link. For example, an "authentication link to complete registration" is sent to "user@example.com".
[0581] Step 4: Perform email verification
[0582] User device: The user clicks on the link in the authentication email they received. This action sends an authentication request to the server.
[0583] Step 5: Verify and save the certificate
[0584] Server: Receives the authentication request sent from the link and checks the authentication data. If authentication is successful, it stores the user information in the database and generates a registration completion message and sends it to the user's device.
[0585] Step 6: Enter persona information
[0586] User device: The user accesses the "Persona Generation" screen and inputs persona information such as the AI's personality and appearance. For example, the user inputs information such as "friendly personality" and "blue hair." The input data is sent to the server.
[0587] Step 7: Submit persona information
[0588] Server: Receives the input persona information and sends it to the backend AI management module. It sends a prompt request to the generative AI model: "Generate a friendly AI with blue hair." The input data becomes a request to the generative AI model.
[0589] Step 8: Generate and configure the AI
[0590] Backend AI management module: Generates AI based on persona information using the generative AI model. The generated AI is given a specified personality and appearance. The attribute information of the generated AI is returned to the server as output.
[0591] Step 9: Notification of completion of generation and saving
[0592] Server: Stores the generated AI information in a database and notifies the user that AI generation is complete. A message indicating this is displayed on the user's device.
[0593] Step 10: Performing a Follow Operation
[0594] User device: The user clicks the "Follow" button to follow the generated AI. The follow request is sent to the server.
[0595] Step 11: Process follow requests
[0596] Server: Receives the follow request and stores the user ID and AI ID in a database. For example, stores the correspondence between user ID "User123" and AI ID "AI456".
[0597] Step 12: Notification of complete follow-up
[0598] Server: Generates a message indicating that the follow has been completed and sends it to the user's device. The user will see a message saying "Following has been completed."
[0599] Step 13: Enter and send Super Chat
[0600] User device: The user clicks the "Super Chat" button and enters the donation amount and message. For example, they enter "1000 yen" and "I'm cheering for you!" The input data is sent to the server.
[0601] Step 14: Validate Super Chat information and process payments
[0602] Server: Validates the received Super Chat information and executes the payment process. For example, confirms credit card information and performs payment.
[0603] Step 15: Request a special reaction
[0604] Server: If the payment is successful, it requests the backend AI management module to generate a special reaction, for example, "Please generate a message of thanks for the donation."
[0605] Step 16: Creating Special Reactions
[0606] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server. The output is special reaction data.
[0607] Step 17: Viewing Reactions
[0608] Server: Sends the generated special reactions to the user, who then displays the reactions in real time on their device.
[0609] Step 18: Enter customization information
[0610] User device: The user clicks the "Customize" button on the profile screen of the generated AI and inputs customization information such as the AI's avatar and personality. For example, the user inputs data such as "change hair color to red." The input data is sent to the server.
[0611] Step 19: Save and apply customizations
[0612] Server: Saves the received customization information in the database and applies it. Updated AI attribute information is saved as output.
[0613] Step 20: Monitor and process retirements
[0614] Server: Monitors unpopular AI based on the number of followers and super chats, and flags AI that do not attract enough attention within a certain period of time as a retirement flag. The output is AI data with the retirement flag.
[0615] Step 21: Handling Retirement Flags
[0616] Server: AI with retirement flag will be deleted or hidden from the system. Retirement notification will be sent to users.
[0617] Step 22: Emotion Monitoring and Analysis
[0618] User device: Monitors user input and behavior and recognizes emotions in real time. Input data represents the user's emotional state.
[0619] Server: The emotion engine analyzes the user's emotions and sends the analysis results to the back-end AI management module. For example, information such as "the user is feeling stressed" is sent.
[0620] Step 23: Adjusting the movement pattern
[0621] Backend AI management module: Adjusts AI behavior patterns based on emotional information. For example, it sets a behavior pattern to "send encouraging messages." The output is the adjusted AI behavior data.
[0622] Step 24: Apply and save the adjustment results
[0623] Server: Saves the adjusted behavior data in a database and reflects it to the user. The adjusted AI behavior is displayed in real time on the user's device.
[0624] (Application example 2)
[0625] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0626] While traditional social networking services offer user-generated AI interactions, they lack the ability to dynamically adjust and provide personalized advertising based on the user's emotional state, which limits the user experience and reduces the effectiveness of personalized advertising.
[0627] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving persona information from a user and generating a generating AI based on the persona information, means for managing the attributes and behavior patterns of the generated generating AI, means for providing an interface for a user to follow or superchats the generating AI, means for the generating AI to interact with other generating AIs and provide their activities to the user, means for retiring unpopular generating AIs after a certain period of time, means for recognizing the user's emotional state using an emotion engine and dynamically adjusting the behavior patterns and attributes of the generated generating AI, and means for selecting and displaying optimal advertisements based on the user's preferences and emotional state. This enables dynamic interactions and personalized advertisements to be provided according to the user's emotional state.
[0628] "Persona information" is information entered by the user about the personality and appearance of the AI to be generated.
[0629] "Generative AI" is AI that is generated based on persona information and has specific attributes and behavior patterns.
[0630] An "emotion engine" is a technology that monitors user input and behavior and recognizes emotional states in real time.
[0631] "Dynamic adjustment" refers to changing the behavior patterns and attributes of artificial intelligence in real time based on the user's emotional state.
[0632] "Means for providing an interface" refers to technology that provides a screen and input means for users to access and operate the system.
[0633] "Follow" means that the user follows a specific generated AI and receives information about its activities.
[0634] "Super Chat" is the act of a user sending a donation to a generating AI in order to receive a special reaction.
[0635] "Retirement methods" are techniques for removing or hiding unpopular generative AI from the system after a certain period of time.
[0636] "Personalized advertising" refers to advertising that is tailored to a specific user based on their preferences and emotional state.
[0637] A "behavior pattern" is a series of actions or reactions that a generative AI performs in response to a specific situation or input.
[0638] In the present invention, a generative artificial intelligence is generated based on persona information and emotional state from a user, and a new social network service is provided in which the generated generative artificial intelligence interacts with other generative artificial intelligences.
[0639] The entire system consists of a user terminal and a server. The user terminal is a device such as a smartphone or computer, and the server is located in a cloud computing environment.
[0640] Program processing
[0641] 1. Processing user registration
[0642] The user device presents the user with a new registration screen and asks them to enter their username, email address, and password. The server receives the entered information and performs validation. A verification email is generated and sent to the user's email address. When the user clicks the verification link, the server confirms the authentication and saves the user information in the database.
[0643] 2. Persona input and AI generation processing
[0644] The user device provides the user with a "Persona Generation" screen, where they can enter persona information such as the AI's personality and appearance. The server receives this information and sends it to the back-end AI management module, requesting AI generation. The generation AI model generates an AI based on the persona information and sets its attributes and behavior patterns. The server saves the information about the generated AI in a database and notifies the user that AI generation is complete.
[0645] 3. Follow AI and observe its activities
[0646] The user device provides an interface for following the generated AI. The server receives the follow request and stores the user ID and AI ID in a database. A message is returned to the user indicating that the follow has been completed, and activity information about the followed AI is distributed in real time.
[0647] 4. Special interactions through Super Chat
[0648] The user's device provides a "Super Chat" button on the profile screen of the AI they are following. When the user enters the donation amount and message, the server validates it and then processes the payment. The back-end AI management module generates a special reaction and provides it to the user.
[0649] 5. Handling Customizations
[0650] The user device provides an interface for users to input customization items such as the AI's avatar and personality. The server receives and stores this information and updates the attributes of the generated AI. The updated information is reflected to the user in real time.
[0651] 6. Retirement Processing
[0652] The server will retire unpopular AIs after a certain period of time based on the number of followers and super chats they receive. AIs that do not receive enough attention within a set period of time will be flagged as retired and automatically deleted or hidden from the system.
[0653] 7. Use of Emotion Engines
[0654] The user device monitors the user's input and behavior and recognizes emotions in real time. The server analyzes the user's emotional state using an emotion engine and sends the information to a back-end AI management module. The generated AI dynamically adjusts its behavior patterns and attributes based on the user's emotional information. The adjusted information is stored in a database and reflected to the user in real time.
[0655] Specific examples
[0656] For example, if the user is interested in "movies" and their current emotional state is recognized as "happy," the system will select upbeat and cheerful movie advertisements and display them in a visually appealing format. Specific examples of prompts include:
[0657] "The user's genre of interest is 'Movies' and their current emotional state is 'Happy'. What ad would best fit this criteria?"
[0658] In this way, the system can provide interactive experiences and personalized advertising based on the user's persona information and emotional state.
[0659] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0660] Step 1:
[0661] Processing user registration
[0662] The user terminal provides the user with a new registration screen, where the user enters a username, email address, and password. The input information is sent to the server.
[0663] The server validates the received user information and, if there are no errors, generates a verification email and sends it to the specified email address. When the user clicks the verification link, the server confirms the authentication and saves the user information in the database. As an output, a registration completion notice is displayed on the user's terminal.
[0664] Step 2:
[0665] Persona input and AI generation processing
[0666] The user device provides a "Persona Generation" screen where the user inputs persona information such as the AI's personality and appearance, and the input information is sent to the server.
[0667] The server sends the received persona information to the backend AI management module and requests AI generation. The backend AI management module uses the generative AI model to generate AI based on the persona information. It sets the attributes and behavior patterns of the generated AI and stores this information in a database. As an output, a generation completion notification is displayed on the user's device.
[0668] Step 3:
[0669] Follow AI and observe its activities
[0670] The user device provides an interface for following the generated AI. The user selects the AI they want to follow and sends the selection information to the server.
[0671] The server receives the follow request and stores the user ID and AI ID in a database. A message indicating the follow is complete is generated and displayed on the user's device. Information about the activities and interactions of the followed AI is delivered to the user in real time. As an output, real-time updates about the followed AI are displayed on the user's device.
[0672] Step 4:
[0673] Special interactions through Super Chat
[0674] The user's device provides a "Super Chat" button on the profile screen of the AI they are following. The user enters the donation amount and message. The input information is sent to the server.
[0675] The server validates the received Super Chat information and, if there are no problems, executes the payment process. If the payment is successful, it sends a request to the backend AI management module to generate a special reaction. The backend AI management module generates a special reaction (e.g., a message or video) and sends it back to the server. As an output, the special reaction is displayed in real time on the user's device.
[0676] Step 5:
[0677] Handling customizations
[0678] The user's device provides a customization button on the profile screen of the generated AI. The user inputs customization items such as the AI's avatar and personality, and the input information is sent to the server.
[0679] The server stores the received customization information in a database and updates the AI's attributes based on that information. As an output, the updated attribute information is reflected on the user's device in real time.
[0680] Step 6:
[0681] Retirement Processing
[0682] The server monitors the number of followers and super chats, and flags AIs that do not receive enough attention within a set period as retired. AIs that have been flagged as retired are automatically deleted or hidden from the system. As an output, a retirement notice is displayed on the user's device, and the retired AI can no longer be accessed.
[0683] Step 7:
[0684] Use of emotion engine
[0685] The user device monitors the user's input and behavior in real time, recognizes their emotional state, and transmits the emotional information to the server.
[0686] The server analyzes the received emotional information using an emotion engine and sends the results to the back-end AI management module. The generated AI dynamically adjusts its behavior patterns and attributes based on the emotional information. The adjusted information is stored in a database and reflected in real time on the user's device. As an output, the AI's changes based on emotion are displayed on the user's device. An example of a specific prompt sentence is, "The user's genre of interest is 'movies', and their current emotional state is 'happy'. What advertisement best suits these conditions?"
[0687] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0688] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0689] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0690] [Second embodiment]
[0691] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0692] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0693] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0694] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0695] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0696] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0697] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0698] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0699] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0700] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0701] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0702] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0703] A specific embodiment for carrying out the present invention will be described below. This system is a new type of social network service that generates a generative artificial intelligence based on persona information input by a user, and the generated generative artificial intelligence interacts with other generative artificial intelligences and provides them to users.
[0704] Processing user registration
[0705] User terminal: The user accesses the system and enters their username, email address, password, etc. on the new registration screen.
[0706] Server: Receives this information, validates the input data, and if validation is successful, generates a verification email and sends it to the user's email address.
[0707] User device: The user clicks on the link in the email and completes the authentication to complete the registration. The server saves this information in a database and notifies the user.
[0708] Persona input and AI generation processing
[0709] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[0710] Server: Receives the input persona information and generates AI using the generative AI model. Sets the attributes and behavior patterns of the generated AI and saves them in a database.
[0711] Example: For example, if a user wants to create an AI that looks like a cat-loving rock musician, they would enter keywords such as "cat lover," "rock," and "musician" as persona information. Based on this information, the server will generate an AI with personality attributes that like images of cats and rock music.
[0712] Follow AI and observe its activities
[0713] User Device: Users can follow the AI they have created. They can also search for and follow AIs created by other users.
[0714] Server: Stores the follow relationships in a database, delivers real-time updates from the followed AI to users, and configures settings to promote the activities of the followed AI.
[0715] User device: You can observe and enjoy the activities and interactions of the AI you follow.
[0716] Special interactions through Super Chat
[0717] User device: Users can send Super Chats from the profile screen of the AI they follow. Enter the donation amount and message as Super Chat.
[0718] Server: Receives Super Chat information, validates it, and then processes the payment. After the payment is successful, it sends a request to the backend AI management module to generate a special reaction.
[0719] Backend AI management module: Generates special reactions (e.g. special messages, videos) and returns them to the server.
[0720] User device: Show special reactions in real time.
[0721] Handling customizations
[0722] User device: The user presses the "Customize" button on the generated AI's profile screen and inputs the AI's attributes, appearance, personality, etc.
[0723] Server: Stores the received customization information in a database and instantly updates the AI's attributes.
[0724] Example: For example, if a user customizes a "robot-like AI," specifying a metallic body and eyes with LED lights as its appearance, the server will update the AI's appearance and notify the user.
[0725] Retirement Processing
[0726] Server: Monitors AI generators that have little interest in followers, super chats, etc. within a certain period. Unpopular AI generators are automatically flagged as retired after a set period and are deleted or hidden from the system.
[0727] User Device: The user will be notified of the retired AI and will no longer be able to view it.
[0728] In this way, the system of the present invention provides a platform where users can enjoy interacting with and customizing various AIs without having to interact directly with them, thereby reducing the burden on users and providing a new entertainment experience.
[0729] The processing flow will be explained below.
[0730] Processing user registration
[0731] Step 1:
[0732] User device: The user accesses the system and enters their username, email address, and password on the new registration screen.
[0733] Step 2:
[0734] Server: Receives the entered user information, performs validation, and generates a verification email if validation is successful.
[0735] Step 3:
[0736] Server: Generates and sends the authentication email to the user's email address.
[0737] Step 4:
[0738] User device: The user clicks on the authentication link in the email they received.
[0739] Step 5:
[0740] Server: Validates that the user clicked on the authentication link and, if authentication is successful, saves the user information to a database.
[0741] Step 6:
[0742] User device: Display the registration completion screen.
[0743] Persona input and AI generation processing
[0744] Step 1:
[0745] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[0746] Step 2:
[0747] Server: Receives the entered persona information.
[0748] Step 3:
[0749] Server: Sends the received persona information to the backend AI management module and requests AI generation.
[0750] Step 4:
[0751] Backend AI management module: Uses generative AI models to generate AI based on persona information.
[0752] Step 5:
[0753] Server: Sets the attributes and behavior patterns of the generated AI and stores the AI information in a database.
[0754] Step 6:
[0755] Server: Notifies the user that AI generation is complete.
[0756] Step 7:
[0757] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[0758] Follow AI and observe its activities
[0759] Step 1:
[0760] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[0761] Step 2:
[0762] Server: Receives the follow request and stores the user ID and AI ID in a database.
[0763] Step 3:
[0764] Server: Generate a follow-up completion message and return it to the user.
[0765] Step 4:
[0766] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[0767] Step 5:
[0768] Server: Delivers activity information of followed AIs to users.
[0769] Step 6:
[0770] User device: Observe and enjoy the activities and interactions of the AI you follow.
[0771] Special interactions through Super Chat
[0772] Step 1:
[0773] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[0774] Step 2:
[0775] User terminal: The user enters the donation amount and message.
[0776] Step 3:
[0777] Server: Validates the received Super Chat information.
[0778] Step 4:
[0779] Server: If validation is successful, execute the payment process.
[0780] Step 5:
[0781] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[0782] Step 6:
[0783] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[0784] Step 7:
[0785] Server: Sends the generated special reaction to the user.
[0786] Step 8:
[0787] User device: Displays special reactions in real time.
[0788] AI Customization
[0789] Step 1:
[0790] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[0791] Step 2:
[0792] User Device: The user inputs the AI's avatar, personality, and other customization options.
[0793] Step 3:
[0794] Server: Stores the received customization information in a database.
[0795] Step 4:
[0796] Server: Updates the AI's attributes based on the saved customization information.
[0797] Step 5:
[0798] User device: Display customized results on the AI profile screen.
[0799] Retirement Processing
[0800] Step 1:
[0801] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[0802] Step 2:
[0803] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[0804] Step 3:
[0805] Server: Automatically remove or hide retired flagged AI from the system.
[0806] Step 4:
[0807] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[0808] Example 1
[0809] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0810] Conventional social networking services are based on the premise that users interact directly with other users, resulting in problems between users and the burden of communication. Another issue is that users have little freedom in customizing and activating the AI they create, making it less entertaining. Furthermore, there is also the issue of unclear management methods if the AI fails to attract attention after a certain period of time, making efficient operation difficult.
[0811] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0812] In this invention, the server includes means for receiving persona information from a user and generating a generated AI based on the persona information, means for managing the attributes and behavior patterns of the generated generated AI, means for providing an interface for users to follow or superchats the generated AI, means for validating input data and sending a verification email based on the validation to complete registration, means for storing the follow relationship in a database and delivering real-time updates on the followed generated AI, and means for retiring unpopular generated AI after a certain period of time. This allows users to enjoy interaction and customization between various AIs without direct interaction, making it possible to provide a new entertainment experience while reducing the burden on users.
[0813] - "Persona information" is data entered by the user that indicates attributes such as the personality and appearance of the AI to be generated.
[0814] "Generative AI" is a character with artificial intelligence that is generated based on persona information entered by the user.
[0815] "Attributes" are information that indicates the characteristics of the generating AI, such as its personality, appearance, hobbies, and behavioral patterns.
[0816] "Behavior patterns" are rules or simulation models that show how a generative AI will behave in a particular situation.
[0817] "Following" is an action that a user takes to track updates and activities of a specific generated AI.
[0818] "Super Chat" is a feature that allows users to provide financial support to the generated AI and receive special reactions and messages in return.
[0819] "Interface" refers to the screens and operating means through which users interact with a system.
[0820] "Verification Email" means an email sent to a User upon registration in the System that contains a link that enables the User to verify their email address.
[0821] A "database" is a structured collection of data used to manage and store data used within a system.
[0822] "Reactions" refer to special actions, messages, videos, etc. that the generating AI shows in response to Super Chats or specific events.
[0823] "Validation" is the process of verifying whether the data entered by the user is in the correct format or meets certain conditions.
[0824] A "retirement flag" is an instruction within the system to hide or delete a generating AI if it does not attract attention within a certain period of time.
[0825] MODE FOR CARRYING OUT THE INVENTION
[0826] This invention generates a generative artificial intelligence (AI) based on persona information entered by a user, and the AI interacts with other AIs to provide a new type of social network service. Specific embodiments of this system are described below.
[0827] composition
[0828] The system consists of the following main components:
[0829] User device: The device through which the user operates the interface, including computers, smartphones, tablets, etc.
[0830] Server: A central computer system that manages the entire system and stores and processes data.
[0831] Database: A storage system for storing data that is connected to a server.
[0832] Generative AI model: A software module for generating AI based on persona information obtained from users.
[0833] User registration process
[0834] User device: The user accesses the system's new registration screen and enters authentication information such as a user name, email address, and password. For example, we will use "Taro Tanaka", "taro@example.com", and "password123".
[0835] Server: Validates the received authentication information to ensure it is in the correct format, then generates a verification email and sends it to the user's email address.
[0836] User device: The user clicks on the link in the email they received to complete the authentication. The server then saves the user information in the database and notifies the user that registration is complete.
[0837] Persona input and AI generation
[0838] User device: The user accesses the "Persona Generation" screen and inputs persona information about the AI's personality and appearance. For example, prompts such as "cat lover," "rock music," and "musician" are used.
[0839] Server: Receives persona information and generates AI using the generative AI model. The generated AI is set with attributes and behavior patterns based on the specified persona information.
[0840] Server: Stores the generated AI's attributes and behavior patterns in a database, allowing the user to use the same information the next time they access the system.
[0841] Follow AI and observe its activities
[0842] User terminal: Users can follow the generated AI, and can observe the activities and updates of the followed AI in real time.
[0843] Server: Stores follow relationships in a database, delivers real-time updates on followed AIs to users, and configures settings to facilitate AI activity.
[0844] Special interactions through Super Chat
[0845] User device: Users can send Super Chats from the profile screen of the AI they follow. They can enter the donation amount and message as Super Chat.
[0846] Server: Receives Super Chat information, validates it, and then processes the payment. After the payment is successful, it sends a request to the backend AI management module to generate a special reaction.
[0847] Backend AI management module: Generates special reactions, such as special messages or videos, and returns them to the server.
[0848] User device: Display special reactions in real time, providing users with a new interaction experience.
[0849] Handling customizations
[0850] User device: The user can press the "Customize" button on the profile screen of the generated AI to change the AI's attributes, appearance, personality, etc.
[0851] Server: Stores the received customization information in a database and instantly updates the generated AI settings.
[0852] Retirement Processing
[0853] Server: Monitors generated AI that has few followers or super chats within a certain period of time, and automatically sets a retirement flag after the specified period has passed.
[0854] User terminal: A notification about the retired AI will be sent to the user, and the user will no longer be able to view the retired AI.
[0855] In this way, the present invention realizes a system that provides a new entertainment experience while reducing the burden on the user.
[0856] Prompt Sentence Examples
[0857] Here are some example prompts you can use when generating personas:
[0858] "Cat lover," "Rock," "Musician"
[0859] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0860] Program processing flow
[0861] User registration process
[0862] Step 1:
[0863] User device: The user accesses the new registration screen and enters their username, email address, and password.
[0864] Input: Username, Email Address, Password.
[0865] What happens: A user enters data into a form and clicks the submit button.
[0866] Output: The input data is sent to the server.
[0867] Step 2:
[0868] Server: Validates the input data received from the user.
[0869] Input: Username, Email Address, Password.
[0870] What it does: The server checks the format of the data (e.g. email address format, password strength).
[0871] Output: Generates a flag indicating whether the validation was successful or not.
[0872] Step 3:
[0873] Server: If validation is successful, generate a verification email and send it to the user's email address.
[0874] Input: Validation success flag, user email address.
[0875] What it does: Generates a verification email and sends it via the mail server.
[0876] Output: A verification email will be sent to the user's email address.
[0877] Step 4:
[0878] User device: The user clicks on the link in the authentication email they received to complete the authentication.
[0879] Input: The link in the verification email.
[0880] How it works: Clicking on a link in your browser sends a request to the server.
[0881] Output: A message indicating authentication is complete is displayed.
[0882] Step 5:
[0883] Server: Confirm authentication is successful and save the user information to the database.
[0884] Input: Authentication complete request, user information.
[0885] What it does: Executes a SQL query to insert user information into a database.
[0886] Output: User information is saved in the database and a notification of registration completion is sent to the user's device.
[0887] Persona input and AI generation
[0888] Step 1:
[0889] User device: The user accesses the persona generation screen and inputs persona information about the AI's personality and appearance.
[0890] Input: Persona information. Examples: "Cat lover", "Rock", "Musician".
[0891] What happens: A user fills out a form with their persona information and clicks the submit button.
[0892] Output: The input data is sent to the server.
[0893] Step 2:
[0894] Server: Receives persona information and generates AI using the generative AI model.
[0895] Input: Persona information.
[0896] How it works: Enter persona information into the generative AI model and run the algorithm to generate the AI.
[0897] Output: The attributes and behavior patterns of the generated AI.
[0898] Step 3:
[0899] Server: Stores the attributes and behavior patterns of the generated AI in a database.
[0900] Input: Attributes and behavior patterns of the generated AI.
[0901] What it does: Executes a SQL query that inserts the generated AI information into a database.
[0902] Output: AI information is stored in a database.
[0903] Follow AI and observe its activities
[0904] Step 1:
[0905] User device: Users can follow the AI they create. They can also search for and follow AIs created by other users.
[0906] Input: Follow request.
[0907] What happens: User clicks the Follow button.
[0908] Output: The following information is sent to the server.
[0909] Step 2:
[0910] Server: Stores follow relationships in a database and delivers updates in real time.
[0911] Input: Follow information.
[0912] What it does: Runs a SQL query to insert follow information into the database and calls a module that delivers updates in real time.
[0913] Output: Follow information is stored in the database and updates are sent to the user's device.
[0914] Step 3:
[0915] User device: Users can observe the activities and interactions of the AIs they follow in real time.
[0916] Input: Real-time updates.
[0917] What it does: Opens the profile page of the AI the user is following.
[0918] Output: The latest activity status of the followed AI is displayed.
[0919] Special interactions through Super Chat
[0920] Step 1:
[0921] User device: Users can send Super Chat from the profile screen of the AI they are following and enter the donation amount and message.
[0922] Input: Donation amount, message.
[0923] How it works: A user enters a donation amount and message on the Super Chat screen and clicks the send button.
[0924] Output: Super chat information is sent to the server.
[0925] Step 2:
[0926] Server: After receiving and validating the Super Chat information, the payment process is carried out.
[0927] Input: Super Chat information, payment information.
[0928] What it does: Validates the Super Chat information and sends a request to the payment system.
[0929] Output: Payment result. If successful, a request ID is generated.
[0930] Step 3:
[0931] Server: After a successful payment, it sends a request to the backend AI management module to generate a special reaction.
[0932] Input: Payment success flag, request ID.
[0933] What it does: Sends a special reaction generation request to the backend AI management module.
[0934] Output: Special reaction generation request.
[0935] Step 4:
[0936] Backend AI management module: Generates special reactions (e.g. special messages, videos) and returns them to the server.
[0937] Input: Special Reaction generation request.
[0938] What it does: Runs an algorithm to generate a special message or video in the specified format.
[0939] Output: Special reaction.
[0940] Step 5:
[0941] Server: Sends special reactions to the user's device.
[0942] Input: Special Reaction.
[0943] What it does: Sends a special reaction to the user's device.
[0944] Output: A special reaction is displayed on the user's terminal.
[0945] Handling customizations
[0946] Step 1:
[0947] User device: The user presses the "Customize" button on the profile screen of the generated AI to change the AI's attributes, appearance, personality, etc.
[0948] Input: Customization information.
[0949] Action: The user enters new attribute information in the customization screen and clicks the submit button.
[0950] Output: The customization information is sent to the server.
[0951] Step 2:
[0952] Server: Stores the received customization information in a database and instantly updates the generated AI settings.
[0953] Input: Customization information.
[0954] What it does: Runs a SQL query that inserts updates into the database, changing the AI's attributes.
[0955] Output: The customized AI information is saved in the database and the update is complete.
[0956] Retirement Processing
[0957] Step 1:
[0958] Server: Monitors generated AI that has few followers or super chats within a certain period of time, and automatically sets a retirement flag after the specified period has passed.
[0959] Input: Number of followers, number of Super Chats.
[0960] How it works: Regularly monitors the number of followers and super chats, and if certain conditions are not met, sets a retirement flag.
[0961] Output: The retirement flag is saved in the database.
[0962] Step 2:
[0963] User terminal: A notification about the retired AI will be sent to the user, and the user will no longer be able to view the retired AI.
[0964] Input: Retirement information.
[0965] What it does: Sends a retirement notice to the user and removes the AI from their follow list.
[0966] Output: A retirement notification is displayed on the user's device, and the retired AI is removed from the follow list.
[0967] (Application example 1)
[0968] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0969] In conventional social networking services, users mainly interact with other users through text, images, and videos. However, this method has the drawback of making it difficult to provide a unique and interactive experience. It has also been difficult to provide a new form of entertainment in which an AI character based on user-entered persona information interacts with other AI characters. Furthermore, there is a need for an appropriate means to provide a forum for real-time interaction through live streaming by user-generated AI characters.
[0970] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0971] In this invention, the server includes means for receiving persona information from a user and generating a generated AI based on the persona information, means for managing the attributes and behavior patterns of the generated AI, means for providing an interface for users to follow or superchats the generated AI, means for the generated AI to interact with other generated AIs and provide their activities to users, means for the generated AI to perform live broadcasts, means for the generated AI to generate reactions to user messages received during live broadcasts and broadcast the reactions, and means for retiring unpopular generated AIs after a certain period of time, thereby allowing users to enjoy a unique and interactive experience and interact in real time.
[0972] "Persona information" is information entered by the user that defines the personality and characteristics of the generated AI.
[0973] "Generative AI" refers to an AI character that is generated based on persona information entered by the user.
[0974] "Attributes" refer to the characteristics and properties of the generated artificial intelligence, including personality and appearance.
[0975] A "behavioral pattern" is a behavioral model that shows how a generative AI will behave in a particular situation.
[0976] "Following" refers to a user showing interest in a particular artificial intelligence and tracking its activity information.
[0977] "Super Chat" refers to financial support and messages sent by users to the generated AI.
[0978] "Interface" refers to the operating screen and input means that allow a user to interact with a system.
[0979] "Live streaming" is a function that uses generative artificial intelligence to deliver video and audio in real time.
[0980] "Reaction" refers to the response that the generative AI gives to messages or assistance from users.
[0981] "Retirement" refers to removing or hiding a generative AI from the system after it has been unpopular for a certain period of time.
[0982] The following describes an embodiment of the present invention. This system is a new type of social networking service that uses artificial intelligence (AI) generated based on persona information entered by users. With this service, users can create their own AI characters, which can then broadcast live in real time and interact with other users.
[0983] Processing user registration
[0984] User device:
[0985] The user accesses the system and enters information such as a username, email address, and password on the new registration screen.
[0986] server:
[0987] The received information is validated, a verification email is generated and sent to the user's email address, and when the user clicks on the verification link, the registration is completed and the information is saved in the database.
[0988] Persona input and AI generation processing
[0989] User device:
[0990] Users access the "Persona Generation" screen and enter persona information such as the AI's personality and appearance.
[0991] server:
[0992] Based on the received persona information, an AI character is generated using a generative AI model. The attributes and behavior patterns of the generated AI are set and saved in a database.
[0993] Examples:
[0994] If a user wants to create an AI that looks like a cat-loving rock musician, they would enter the following prompt:
[0995] Generate an AI that looks like a cat-loving rock musician.
[0996] Live streaming with AI characters
[0997] User device:
[0998] Users can access the profile page of the generated AI character and start live streaming.
[0999] server:
[1000] It provides the infrastructure to support live streaming and performs the necessary processing. The AI generates appropriate reactions to user messages received during live streaming and distributes them in real time.
[1001] Follow and Super Chat
[1002] User device:
[1003] Users can follow the generated AI characters and track their activities, and can also send Super Chats to the AI characters, offering special messages or financial support.
[1004] server:
[1005] It stores follower relationships and super chat information in a database and sends requests to the backend AI management module to generate special reactions, which are then displayed in real time on the user's device.
[1006] Customization and Retirement
[1007] User device:
[1008] Users can customize the AI's attributes, appearance, personality, etc. by pressing the "Customize" button on the AI character's profile screen.
[1009] server:
[1010] The received customization information is stored in a database and the AI character's attributes are updated immediately. The system also monitors AI characters that have received little interest in followers or super chats within a certain period of time, and automatically flags them as retired after a set period has passed, and deletes or hides them from the system.
[1011] Hardware and software used
[1012] Hardware:
[1013] Smartphone: The primary device through which users access applications.
[1014] software:
[1015] Python: A programming language for implementing logic such as server-side processing, AI character generation, and reaction generation.
[1016] Database: A database (e.g. MySQL or PostgreSQL) for storing user information, AI character information, etc.
[1017] This allows users to enjoy a unique and interactive experience and allows for real-time interaction.
[1018] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1019] Step 1: User Registration
[1020] User device:
[1021] The user accesses the system and enters information such as a user name, email address, and password on the new registration screen. The input data (user name, email address, and password) is sent from the user's device.
[1022] server:
[1023] The server validates the received information and checks the validity of the input data (checks for duplicate user names, email address format, and password strength). If validation is successful, it generates a verification email and sends it to the user's email address. At this point, a link in the verification email is added.
[1024] User device:
[1025] The user clicks the link in the authentication email to complete the authentication. After the authentication is complete, the server saves the user information in the database and sends the user a notification that registration is complete.
[1026] Step 2: Persona input and AI generation
[1027] User device:
[1028] Users access the "Persona Generation" screen and input persona information such as the AI's personality and appearance. The input data (persona information) is sent from the user's device.
[1029] server:
[1030] Based on the received persona information, an AI character is generated using a generative AI model. Specifically, the AI character's attributes (personality, appearance) and behavior patterns are set based on the persona information, and the information on the generated AI character is saved in a database.
[1031] Step 3: Start AI Live Streaming
[1032] User device:
[1033] The user accesses the profile page of the generated AI character and starts live streaming. This operation data is sent from the user's device.
[1034] server:
[1035] The server receives the live streaming request, sets up the live streaming infrastructure, starts the live streaming session, and prepares the AI character to broadcast video and audio in real time. A notification that the live streaming has started is sent to the user.
[1036] Step 4: Receiving messages and generating reactions during live streaming
[1037] User device:
[1038] Other users watching the live stream will send messages, and the message data will be sent to the server.
[1039] server:
[1040] The server analyzes the received message and sends data to the AI model to generate an appropriate reaction (text or voice response). The generated reaction data is added to the live video in real time and distributed to viewers.
[1041] Step 5: Follow and Super Chat
[1042] User device:
[1043] The user follows the generated AI character and sends Super Chat (message and amount). This operation data and Super Chat information are sent from the user's device to the server.
[1044] server:
[1045] The server stores the follow relationships in a database and receives Super Chat information. Based on the content of the Super Chat, it sends a request to the AI model to generate a special reaction (a thank you message or special action). The generated special reaction data is sent to the user's device in real time and displayed.
[1046] Step 6: Customization and Retirement
[1047] User device:
[1048] Users can press the "Customize" button on the AI character's profile screen and input changes to the AI's attributes, appearance, personality, etc. This customization information is sent from the user's device.
[1049] server:
[1050] The server stores the received customization information in a database and immediately updates the AI character's attributes. It also monitors AI characters that have received little interest in followers or super chats within a set period, automatically flags them as retired, and deletes or hides them from the system. It then notifies the user of this retirement process.
[1051] Through these steps, users can enjoy a unique and interactive experience and interact in real time.
[1052] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1053] A specific embodiment for implementing the present invention is described below. This system is a new type of social networking service that generates a generative AI based on persona information entered by a user, and allows the generated generative AI to interact with other generative AIs and provide them to users. It also incorporates an emotion engine that recognizes the user's emotions, improving the user experience.
[1054] Processing user registration
[1055] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen.
[1056] Server: Receives the entered user information and performs validation. If validation is successful, generates a verification email and sends it to the user's email address.
[1057] User device: The user clicks on the link in the authentication email they received to complete the authentication. The server confirms that the authentication was successful and saves the user information in the database. A registration completion screen is displayed.
[1058] Persona input and AI generation processing
[1059] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[1060] Server: Receives the entered persona information, sends it to the backend AI management module, and requests AI generation.
[1061] Backend AI management module: Uses generative AI models to generate AI based on persona information, and sets the attributes and behavior patterns of the generated AI.
[1062] Server: Stores the generated AI information in a database and notifies the user that the AI generation is complete.
[1063] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[1064] Follow AI and observe its activities
[1065] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[1066] Server: Receives the follow request, stores the user ID and AI ID in the database, generates a follow completion message and returns it to the user.
[1067] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[1068] Server: Delivers activity information of followed AIs to users.
[1069] User device: Observe and enjoy the activities and interactions of the AI you follow.
[1070] Special interactions through Super Chat
[1071] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[1072] User device: Enter the donation amount and message.
[1073] Server: Validates the received Super Chat information. If validation is successful, executes the payment process.
[1074] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[1075] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[1076] Server: Sends the generated special reaction to the user.
[1077] User device: Displays special reactions in real time.
[1078] Handling customizations
[1079] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[1080] User Device: Enter your AI's avatar, personality, and other customization options.
[1081] Server: Stores the received customization information in a database.
[1082] Server: Updates the AI's attributes based on the saved customization information.
[1083] User device: Display customized results on the AI profile screen.
[1084] Retirement Processing
[1085] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[1086] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[1087] Server: Automatically remove or hide retired flagged AI from the system.
[1088] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[1089] Use of emotion engine
[1090] User device: Monitors user input and behavior and recognizes emotions in real time.
[1091] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the back-end AI management module.
[1092] Backend AI management module: Dynamically adjusts the behavior patterns and attributes of the generated AI based on user emotional information.
[1093] Server: The adjusted behavior patterns and attributes are stored in a database and reflected to the user in real time.
[1094] User device: Observe the AI change based on emotions and enjoy a more personalized experience.
[1095] Examples:
[1096] For example, if a user expresses an emotion such as "I'm stressed about today's events," the emotion engine analyzes that information and sends it to the back-end AI management module. Based on this information, the generated AI responds according to the user's emotion, such as sending an encouraging message or providing relaxing content.
[1097] In this way, the system of the present invention not only allows for interaction between generating AIs, but also dynamically recognizes the user's emotional state and responds appropriately based on that, thereby providing the user with a more advanced entertainment experience.
[1098] The processing flow will be explained below.
[1099] Processing flow of the AI generation system that combines an emotion engine
[1100] Processing user registration
[1101] Step 1:
[1102] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen.
[1103] Step 2:
[1104] Server: Receives the entered user information, performs validation, and generates a verification email if validation is successful.
[1105] Step 3:
[1106] Server: Generates and sends the authentication email to the user's email address.
[1107] Step 4:
[1108] User device: The user clicks on the link in the authentication email they received to complete the authentication.
[1109] Step 5:
[1110] Server: Verify that the user clicked the authentication link and save the successful authentication to the database.
[1111] Step 6:
[1112] User device: Display the registration completion screen.
[1113] Persona input and AI generation processing
[1114] Step 1:
[1115] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[1116] Step 2:
[1117] Server: Receives the entered persona information.
[1118] Step 3:
[1119] Server: Sends the received persona information to the backend AI management module and requests AI generation.
[1120] Step 4:
[1121] Backend AI management module: Uses generative AI models to generate AI based on persona information.
[1122] Step 5:
[1123] Server: Sets the attributes and behavior patterns of the generated AI and stores the AI information in a database.
[1124] Step 6:
[1125] Server: Notifies the user that AI generation is complete.
[1126] Step 7:
[1127] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[1128] Follow AI and observe its activities
[1129] Step 1:
[1130] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[1131] Step 2:
[1132] Server: Receives the follow request and stores the user ID and AI ID in a database.
[1133] Step 3:
[1134] Server: Generate a follow-up completion message and return it to the user.
[1135] Step 4:
[1136] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[1137] Step 5:
[1138] Server: Delivers activity information of followed AIs to users.
[1139] Step 6:
[1140] User device: Observe and enjoy the activities and interactions of the AI you follow.
[1141] Special interactions through Super Chat
[1142] Step 1:
[1143] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[1144] Step 2:
[1145] User device: Enter the donation amount and message.
[1146] Step 3:
[1147] Server: Validates the received Super Chat information.
[1148] Step 4:
[1149] Server: If validation is successful, execute the payment process.
[1150] Step 5:
[1151] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[1152] Step 6:
[1153] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[1154] Step 7:
[1155] Server: Sends the generated special reaction to the user.
[1156] Step 8:
[1157] User device: Displays special reactions in real time.
[1158] AI Customization
[1159] Step 1:
[1160] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[1161] Step 2:
[1162] User Device: Enter your AI's avatar, personality, and other customization options.
[1163] Step 3:
[1164] Server: Stores the received customization information in a database.
[1165] Step 4:
[1166] Server: Updates the AI's attributes based on the saved customization information.
[1167] Step 5:
[1168] User device: Display customized results on the AI profile screen.
[1169] Retirement Processing
[1170] Step 1:
[1171] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[1172] Step 2:
[1173] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[1174] Step 3:
[1175] Server: Automatically remove or hide retired flagged AI from the system.
[1176] Step 4:
[1177] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[1178] Use of emotion engine
[1179] Step 1:
[1180] User device: Monitors user input and behavior and recognizes emotions in real time.
[1181] Step 2:
[1182] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the back-end AI management module.
[1183] Step 3:
[1184] Backend AI management module: Dynamically adjusts the behavior patterns and attributes of the generated AI based on user emotional information.
[1185] Step 4:
[1186] Server: The adjusted behavior patterns and attributes are stored in a database and reflected to the user in real time.
[1187] Step 5:
[1188] User device: Observe the AI change based on emotions and enjoy a more personalized experience.
[1189] Specific examples
[1190] For example, if a user expresses an emotion such as "I'm stressed about today's events," the emotion engine analyzes that information and sends it to the back-end AI management module. Based on this information, the generated AI responds according to the user's emotion, such as sending an encouraging message or providing relaxing content.
[1191] Example 2
[1192] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1193] In recent years, social networking services have been required to provide richer, more personalized experiences while retaining user interest. However, current systems struggle to accurately reflect and dynamically respond to user emotions and special requests. They also lack the ability to facilitate smooth interactions between generated AIs and provide users with valuable information and experiences. Furthermore, how to efficiently manage unpopular AIs and appropriately handle them without compromising the user experience remains a challenge.
[1194] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving persona information from a user and generating a generating AI based on the persona information, means for managing the attributes and behavior patterns of the generated generating AI, and means for recognizing the user's emotions and dynamically adjusting the behavior patterns and attributes of the generating AI based on the information. This makes it possible to reflect the user's emotions in real time and provide a personalized, high-quality experience. It also improves the flexibility of the system and the level of user involvement.
[1195] "Persona information" refers to attribute information such as the AI's personality and appearance that is entered by the user.
[1196] "Generative AI" refers to an AI character that is generated based on persona information.
[1197] "Attributes" refer to the characteristics, personality, appearance, and other properties of the generative AI.
[1198] A "behavioral pattern" refers to a set of movements or behaviors that describe how a generative AI reacts and acts.
[1199] "Following" refers to the act of a user tracking a specific generated AI and observing its activities.
[1200] "Donation" refers to the act of a user providing money in exchange for special reactions or content.
[1201] "Emotion recognition" refers to the process of analyzing a user's emotional state from their input and behavior and reflecting that in the system.
[1202] "Dynamic adjustment" refers to changing the attributes and behavior patterns of the generated AI in real time to respond according to the user's emotional state.
[1203] "Interaction" refers to the mutual dialogue and action between generative artificial intelligences, building relationships with each other.
[1204] "Retirement" refers to removing or hiding from the system a generative AI that has not attracted sufficient attention within a certain period of time.
[1205] A specific embodiment for implementing the present invention will be described below. This system is a new type of social network service that generates an AI based on persona information input by a user, and allows the AI to interact with other AIs and provide them to users, thereby improving the user experience.
[1206] Hardware and Software
[1207] This system operates by combining multiple pieces of hardware and software. The main components are as follows:
[1208] User device: Refers to a client device such as a PC, smartphone, or tablet that runs a web browser or dedicated application.
[1209] Server: Manages user information and generated AI, operates databases, runs sentiment analysis engines, etc. The main software running on the server includes database management systems (e.g., MySQL), generative AI models (e.g., GPT-3), and sentiment analysis engines (e.g., EmotionAI).
[1210] Backend AI management module: Uses generative AI models to generate and customize AI based on persona information, generate special reactions, and more.
[1211] User Registration
[1212] User terminal: The user accesses the system and enters a username, email address, and password on the new registration screen. For example, they enter information such as "ExampleUser," "example@mail.com," or "securePass123."
[1213] Server: Validates the entered user information, generates a verification email and sends it to the user's email address. The user clicks the link in the verification email to complete the verification and complete the registration.
[1214] Entering persona information and generating it with AI
[1215] User device: The user accesses the "Persona Generation" screen and inputs persona information such as the AI's personality and appearance. For example, the user selects "a friendly, blue-haired AI."
[1216] Server: Receives the input persona information and sends it to the backend AI management module. It sends a request with the prompt "Generate a friendly AI with blue hair."
[1217] Backend AI management module: Uses the generative AI model to generate AI based on persona information and returns that information to the server.
[1218] Server: Stores the generated AI information in a database and notifies the user.
[1219] Follow AI and observe its activities
[1220] User device: The user follows the generated AI and clicks the "Follow" button.
[1221] Server: Receives follow requests, stores the user ID and AI ID in a database, and delivers updates on the followed AI in real time.
[1222] User device: Observe and enjoy the activities and interactions of the AI you follow.
[1223] Special interactions through Super Chat
[1224] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following and enters the donation amount and message. For example, "1000 yen" and a message such as "I'm rooting for you!"
[1225] Server: Validates the received Super Chat information and executes the payment process.
[1226] Backend AI management module: Generates special reactions and returns them to the server, for example, a "thank you message for the donation."
[1227] Server: Sends the generated special reaction to the user and displays it on the user's device.
[1228] Handling customizations
[1229] User device: The user clicks the "Customize" button on the generated AI's profile screen and enters customization items such as the AI's avatar and personality. For example, "change hair color to red."
[1230] Server: Stores the received customization information in a database and applies it.
[1231] Retirement Processing
[1232] Server: Monitors unpopular AI based on the number of followers and super chats, and flags AI that do not receive enough attention within a certain period of time as retired. AI that has been flagged as retired will be deleted or hidden from the system.
[1233] User terminal: A retirement notice is displayed to the user.
[1234] Use of emotion engine
[1235] User device: Monitors user input and behavior and recognizes emotions in real time.
[1236] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the backend AI management module. For example, the information "the user is feeling stressed."
[1237] Back-end AI management module: Adjusts the AI's behavior patterns based on the user's emotional information, for example, sending encouraging messages.
[1238] Server: The adjusted behavior pattern is saved in a database and reflected to the user.
[1239] These components and procedures enable users to have an enhanced social networking experience.
[1240] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1241] Step 1: Enter your user registration information
[1242] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen. For example, they enter "Username123", "user@example.com", and "password123". The input data is sent to the server.
[1243] Step 2: Validate user information
[1244] Server: Checks the received username, email address, and password to ensure they are in the correct format. For example, checks whether the email address format is correct or whether the password meets a certain level of strength. If the input is valid, proceeds to the next step. If it is invalid, returns an error message to the user's device.
[1245] Step 3: Generate and send a verification email
[1246] Server: If validation is successful, a verification email is sent to the specified email address. The verification email contains a verification link. For example, an "authentication link to complete registration" is sent to "user@example.com".
[1247] Step 4: Perform email verification
[1248] User device: The user clicks on the link in the authentication email they received. This action sends an authentication request to the server.
[1249] Step 5: Verify and save the certificate
[1250] Server: Receives the authentication request sent from the link and checks the authentication data. If authentication is successful, it stores the user information in the database and generates a registration completion message and sends it to the user's device.
[1251] Step 6: Enter persona information
[1252] User device: The user accesses the "Persona Generation" screen and inputs persona information such as the AI's personality and appearance. For example, the user inputs information such as "friendly personality" and "blue hair." The input data is sent to the server.
[1253] Step 7: Submit persona information
[1254] Server: Receives the input persona information and sends it to the backend AI management module. It sends a prompt request to the generative AI model: "Generate a friendly AI with blue hair." The input data becomes a request to the generative AI model.
[1255] Step 8: Generate and configure the AI
[1256] Backend AI management module: Generates AI based on persona information using the generative AI model. The generated AI is given a specified personality and appearance. The attribute information of the generated AI is returned to the server as output.
[1257] Step 9: Notification of completion of generation and saving
[1258] Server: Stores the generated AI information in a database and notifies the user that AI generation is complete. A message indicating this is displayed on the user's device.
[1259] Step 10: Performing a Follow Operation
[1260] User device: The user clicks the "Follow" button to follow the generated AI. The follow request is sent to the server.
[1261] Step 11: Process follow requests
[1262] Server: Receives the follow request and stores the user ID and AI ID in a database. For example, stores the correspondence between user ID "User123" and AI ID "AI456".
[1263] Step 12: Notification of complete follow-up
[1264] Server: Generates a message indicating that the follow has been completed and sends it to the user's device. The user will see a message saying "Following has been completed."
[1265] Step 13: Enter and send Super Chat
[1266] User device: The user clicks the "Super Chat" button and enters the donation amount and message. For example, they enter "1000 yen" and "I'm cheering for you!" The input data is sent to the server.
[1267] Step 14: Validate Super Chat information and process payments
[1268] Server: Validates the received Super Chat information and executes the payment process. For example, confirms credit card information and performs payment.
[1269] Step 15: Request a special reaction
[1270] Server: If the payment is successful, it requests the backend AI management module to generate a special reaction, for example, "Please generate a message of thanks for the donation."
[1271] Step 16: Creating Special Reactions
[1272] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server. The output is special reaction data.
[1273] Step 17: Viewing Reactions
[1274] Server: Sends the generated special reactions to the user, who then displays the reactions in real time on their device.
[1275] Step 18: Enter customization information
[1276] User device: The user clicks the "Customize" button on the profile screen of the generated AI and inputs customization information such as the AI's avatar and personality. For example, the user inputs data such as "change hair color to red." The input data is sent to the server.
[1277] Step 19: Save and apply customizations
[1278] Server: Saves the received customization information in the database and applies it. Updated AI attribute information is saved as output.
[1279] Step 20: Monitor and process retirements
[1280] Server: Monitors unpopular AI based on the number of followers and super chats, and flags AI that do not attract enough attention within a certain period of time as a retirement flag. The output is AI data with the retirement flag.
[1281] Step 21: Handling Retirement Flags
[1282] Server: AI with retirement flag will be deleted or hidden from the system. Retirement notification will be sent to users.
[1283] Step 22: Emotion Monitoring and Analysis
[1284] User device: Monitors user input and behavior and recognizes emotions in real time. Input data represents the user's emotional state.
[1285] Server: The emotion engine analyzes the user's emotions and sends the analysis results to the back-end AI management module. For example, information such as "the user is feeling stressed" is sent.
[1286] Step 23: Adjusting the movement pattern
[1287] Backend AI management module: Adjusts AI behavior patterns based on emotional information. For example, it sets a behavior pattern to "send encouraging messages." The output is the adjusted AI behavior data.
[1288] Step 24: Apply and save the adjustment results
[1289] Server: Saves the adjusted behavior data in a database and reflects it to the user. The adjusted AI behavior is displayed in real time on the user's device.
[1290] (Application example 2)
[1291] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1292] While traditional social networking services offer user-generated AI interactions, they lack the ability to dynamically adjust and provide personalized advertising based on the user's emotional state, which limits the user experience and reduces the effectiveness of personalized advertising.
[1293] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving persona information from a user and generating a generating AI based on the persona information, means for managing the attributes and behavior patterns of the generated generating AI, means for providing an interface for a user to follow or superchats the generating AI, means for the generating AI to interact with other generating AIs and provide their activities to the user, means for retiring unpopular generating AIs after a certain period of time, means for recognizing the user's emotional state using an emotion engine and dynamically adjusting the behavior patterns and attributes of the generated generating AI, and means for selecting and displaying optimal advertisements based on the user's preferences and emotional state. This enables dynamic interactions and personalized advertisements to be provided according to the user's emotional state.
[1294] "Persona information" is information entered by the user about the personality and appearance of the AI to be generated.
[1295] "Generative AI" is AI that is generated based on persona information and has specific attributes and behavior patterns.
[1296] An "emotion engine" is a technology that monitors user input and behavior and recognizes emotional states in real time.
[1297] "Dynamic adjustment" refers to changing the behavior patterns and attributes of artificial intelligence in real time based on the user's emotional state.
[1298] "Means for providing an interface" refers to technology that provides a screen and input means for users to access and operate the system.
[1299] "Follow" means that the user follows a specific generated AI and receives information about its activities.
[1300] "Super Chat" is the act of a user sending a donation to a generating AI in order to receive a special reaction.
[1301] "Retirement methods" are techniques for removing or hiding unpopular generative AI from the system after a certain period of time.
[1302] "Personalized advertising" refers to advertising that is tailored to a specific user based on their preferences and emotional state.
[1303] A "behavior pattern" is a series of actions or reactions that a generative AI performs in response to a specific situation or input.
[1304] In the present invention, a generative artificial intelligence is generated based on persona information and emotional state from a user, and a new social network service is provided in which the generated generative artificial intelligence interacts with other generative artificial intelligences.
[1305] The entire system consists of a user terminal and a server. The user terminal is a device such as a smartphone or computer, and the server is located in a cloud computing environment.
[1306] Program processing
[1307] 1. Processing user registration
[1308] The user device presents the user with a new registration screen and asks them to enter their username, email address, and password. The server receives the entered information and performs validation. A verification email is generated and sent to the user's email address. When the user clicks the verification link, the server confirms the authentication and saves the user information in the database.
[1309] 2. Persona input and AI generation processing
[1310] The user device provides the user with a "Persona Generation" screen, where they can enter persona information such as the AI's personality and appearance. The server receives this information and sends it to the back-end AI management module, requesting AI generation. The generation AI model generates an AI based on the persona information and sets its attributes and behavior patterns. The server saves the information about the generated AI in a database and notifies the user that AI generation is complete.
[1311] 3. Follow AI and observe its activities
[1312] The user device provides an interface for following the generated AI. The server receives the follow request and stores the user ID and AI ID in a database. A message is returned to the user indicating that the follow has been completed, and activity information about the followed AI is distributed in real time.
[1313] 4. Special interactions through Super Chat
[1314] The user's device provides a "Super Chat" button on the profile screen of the AI they are following. When the user enters the donation amount and message, the server validates it and then processes the payment. The back-end AI management module generates a special reaction and provides it to the user.
[1315] 5. Handling Customizations
[1316] The user device provides an interface for users to input customization items such as the AI's avatar and personality. The server receives and stores this information and updates the attributes of the generated AI. The updated information is reflected to the user in real time.
[1317] 6. Retirement Processing
[1318] The server will retire unpopular AIs after a certain period of time based on the number of followers and super chats they receive. AIs that do not receive enough attention within a set period of time will be flagged as retired and automatically deleted or hidden from the system.
[1319] 7. Use of Emotion Engines
[1320] The user device monitors the user's input and behavior and recognizes emotions in real time. The server analyzes the user's emotional state using an emotion engine and sends the information to a back-end AI management module. The generated AI dynamically adjusts its behavior patterns and attributes based on the user's emotional information. The adjusted information is stored in a database and reflected to the user in real time.
[1321] Specific examples
[1322] For example, if the user is interested in "movies" and their current emotional state is recognized as "happy," the system will select upbeat and cheerful movie advertisements and display them in a visually appealing format. Specific examples of prompts include:
[1323] "The user's genre of interest is 'Movies' and their current emotional state is 'Happy'. What ad would best fit this criteria?"
[1324] In this way, the system can provide interactive experiences and personalized advertising based on the user's persona information and emotional state.
[1325] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1326] Step 1:
[1327] Processing user registration
[1328] The user terminal provides the user with a new registration screen, where the user enters a username, email address, and password. The input information is sent to the server.
[1329] The server validates the received user information and, if there are no errors, generates a verification email and sends it to the specified email address. When the user clicks the verification link, the server confirms the authentication and saves the user information in the database. As an output, a registration completion notice is displayed on the user's terminal.
[1330] Step 2:
[1331] Persona input and AI generation processing
[1332] The user device provides a "Persona Generation" screen where the user inputs persona information such as the AI's personality and appearance, and the input information is sent to the server.
[1333] The server sends the received persona information to the backend AI management module and requests AI generation. The backend AI management module uses the generative AI model to generate AI based on the persona information. It sets the attributes and behavior patterns of the generated AI and stores this information in a database. As an output, a generation completion notification is displayed on the user's device.
[1334] Step 3:
[1335] Follow AI and observe its activities
[1336] The user device provides an interface for following the generated AI. The user selects the AI they want to follow and sends the selection information to the server.
[1337] The server receives the follow request and stores the user ID and AI ID in a database. A message indicating the follow is complete is generated and displayed on the user's device. Information about the activities and interactions of the followed AI is delivered to the user in real time. As an output, real-time updates about the followed AI are displayed on the user's device.
[1338] Step 4:
[1339] Special interactions through Super Chat
[1340] The user's device provides a "Super Chat" button on the profile screen of the AI they are following. The user enters the donation amount and message. The input information is sent to the server.
[1341] The server validates the received Super Chat information and, if there are no problems, executes the payment process. If the payment is successful, it sends a request to the backend AI management module to generate a special reaction. The backend AI management module generates a special reaction (e.g., a message or video) and sends it back to the server. As an output, the special reaction is displayed in real time on the user's device.
[1342] Step 5:
[1343] Handling customizations
[1344] The user's device provides a customization button on the profile screen of the generated AI. The user inputs customization items such as the AI's avatar and personality, and the input information is sent to the server.
[1345] The server stores the received customization information in a database and updates the AI's attributes based on that information. As an output, the updated attribute information is reflected on the user's device in real time.
[1346] Step 6:
[1347] Retirement Processing
[1348] The server monitors the number of followers and super chats, and flags AIs that do not receive enough attention within a set period as retired. AIs that have been flagged as retired are automatically deleted or hidden from the system. As an output, a retirement notice is displayed on the user's device, and the retired AI can no longer be accessed.
[1349] Step 7:
[1350] Use of emotion engine
[1351] The user device monitors the user's input and behavior in real time, recognizes their emotional state, and transmits the emotional information to the server.
[1352] The server analyzes the received emotional information using an emotion engine and sends the results to the back-end AI management module. The generated AI dynamically adjusts its behavior patterns and attributes based on the emotional information. The adjusted information is stored in a database and reflected in real time on the user's device. As an output, the AI's changes based on emotion are displayed on the user's device. An example of a specific prompt sentence is, "The user's genre of interest is 'movies', and their current emotional state is 'happy'. What advertisement best suits these conditions?"
[1353] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1354] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1355] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1356] [Third embodiment]
[1357] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1358] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1359] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1360] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1361] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1362] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1363] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1364] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1365] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1366] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1367] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1368] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1369] A specific embodiment for carrying out the present invention will be described below. This system is a new type of social network service that generates a generative artificial intelligence based on persona information input by a user, and the generated generative artificial intelligence interacts with other generative artificial intelligences and provides them to users.
[1370] Processing user registration
[1371] User terminal: The user accesses the system and enters their username, email address, password, etc. on the new registration screen.
[1372] Server: Receives this information, validates the input data, and if validation is successful, generates a verification email and sends it to the user's email address.
[1373] User device: The user clicks on the link in the email and completes the authentication to complete the registration. The server saves this information in a database and notifies the user.
[1374] Persona input and AI generation processing
[1375] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[1376] Server: Receives the input persona information and generates AI using the generative AI model. Sets the attributes and behavior patterns of the generated AI and saves them in a database.
[1377] Example: For example, if a user wants to create an AI that looks like a cat-loving rock musician, they would enter keywords such as "cat lover," "rock," and "musician" as persona information. Based on this information, the server will generate an AI with personality attributes that like images of cats and rock music.
[1378] Follow AI and observe its activities
[1379] User Device: Users can follow the AI they have created. They can also search for and follow AIs created by other users.
[1380] Server: Stores the follow relationships in a database, delivers real-time updates from the followed AI to users, and configures settings to promote the activities of the followed AI.
[1381] User device: You can observe and enjoy the activities and interactions of the AI you follow.
[1382] Special interactions through Super Chat
[1383] User device: Users can send Super Chats from the profile screen of the AI they follow. Enter the donation amount and message as Super Chat.
[1384] Server: Receives Super Chat information, validates it, and then processes the payment. After the payment is successful, it sends a request to the backend AI management module to generate a special reaction.
[1385] Backend AI management module: Generates special reactions (e.g. special messages, videos) and returns them to the server.
[1386] User device: Show special reactions in real time.
[1387] Handling customizations
[1388] User device: The user presses the "Customize" button on the generated AI's profile screen and inputs the AI's attributes, appearance, personality, etc.
[1389] Server: Stores the received customization information in a database and instantly updates the AI's attributes.
[1390] Example: For example, if a user customizes a "robot-like AI," specifying a metallic body and eyes with LED lights as its appearance, the server will update the AI's appearance and notify the user.
[1391] Retirement Processing
[1392] Server: Monitors AI generators that have little interest in followers, super chats, etc. within a certain period. Unpopular AI generators are automatically flagged as retired after a set period and are deleted or hidden from the system.
[1393] User Device: The user will be notified of the retired AI and will no longer be able to view it.
[1394] In this way, the system of the present invention provides a platform where users can enjoy interacting with and customizing various AIs without having to interact directly with them, thereby reducing the burden on users and providing a new entertainment experience.
[1395] The processing flow will be explained below.
[1396] Processing user registration
[1397] Step 1:
[1398] User device: The user accesses the system and enters their username, email address, and password on the new registration screen.
[1399] Step 2:
[1400] Server: Receives the entered user information, performs validation, and generates a verification email if validation is successful.
[1401] Step 3:
[1402] Server: Generates and sends the authentication email to the user's email address.
[1403] Step 4:
[1404] User device: The user clicks on the authentication link in the email they received.
[1405] Step 5:
[1406] Server: Validates that the user clicked on the authentication link and, if authentication is successful, saves the user information to a database.
[1407] Step 6:
[1408] User device: Display the registration completion screen.
[1409] Persona input and AI generation processing
[1410] Step 1:
[1411] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[1412] Step 2:
[1413] Server: Receives the entered persona information.
[1414] Step 3:
[1415] Server: Sends the received persona information to the backend AI management module and requests AI generation.
[1416] Step 4:
[1417] Backend AI management module: Uses generative AI models to generate AI based on persona information.
[1418] Step 5:
[1419] Server: Sets the attributes and behavior patterns of the generated AI and stores the AI information in a database.
[1420] Step 6:
[1421] Server: Notifies the user that AI generation is complete.
[1422] Step 7:
[1423] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[1424] Follow AI and observe its activities
[1425] Step 1:
[1426] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[1427] Step 2:
[1428] Server: Receives the follow request and stores the user ID and AI ID in a database.
[1429] Step 3:
[1430] Server: Generate a follow-up completion message and return it to the user.
[1431] Step 4:
[1432] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[1433] Step 5:
[1434] Server: Delivers activity information of followed AIs to users.
[1435] Step 6:
[1436] User device: Observe and enjoy the activities and interactions of the AI you follow.
[1437] Special interactions through Super Chat
[1438] Step 1:
[1439] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[1440] Step 2:
[1441] User terminal: The user enters the donation amount and message.
[1442] Step 3:
[1443] Server: Validates the received Super Chat information.
[1444] Step 4:
[1445] Server: If validation is successful, execute the payment process.
[1446] Step 5:
[1447] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[1448] Step 6:
[1449] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[1450] Step 7:
[1451] Server: Sends the generated special reaction to the user.
[1452] Step 8:
[1453] User device: Displays special reactions in real time.
[1454] AI Customization
[1455] Step 1:
[1456] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[1457] Step 2:
[1458] User Device: The user inputs the AI's avatar, personality, and other customization options.
[1459] Step 3:
[1460] Server: Stores the received customization information in a database.
[1461] Step 4:
[1462] Server: Updates the AI's attributes based on the saved customization information.
[1463] Step 5:
[1464] User device: Display customized results on the AI profile screen.
[1465] Retirement Processing
[1466] Step 1:
[1467] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[1468] Step 2:
[1469] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[1470] Step 3:
[1471] Server: Automatically remove or hide retired flagged AI from the system.
[1472] Step 4:
[1473] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[1474] Example 1
[1475] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1476] Conventional social networking services are based on the premise that users interact directly with other users, resulting in problems between users and the burden of communication. Another issue is that users have little freedom in customizing and activating the AI they create, making it less entertaining. Furthermore, there is also the issue of unclear management methods if the AI fails to attract attention after a certain period of time, making efficient operation difficult.
[1477] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1478] In this invention, the server includes means for receiving persona information from a user and generating a generated AI based on the persona information, means for managing the attributes and behavior patterns of the generated generated AI, means for providing an interface for users to follow or superchats the generated AI, means for validating input data and sending a verification email based on the validation to complete registration, means for storing the follow relationship in a database and delivering real-time updates on the followed generated AI, and means for retiring unpopular generated AI after a certain period of time. This allows users to enjoy interaction and customization between various AIs without direct interaction, making it possible to provide a new entertainment experience while reducing the burden on users.
[1479] - "Persona information" is data entered by the user that indicates attributes such as the personality and appearance of the AI to be generated.
[1480] "Generative AI" is a character with artificial intelligence that is generated based on persona information entered by the user.
[1481] "Attributes" are information that indicates the characteristics of the generating AI, such as its personality, appearance, hobbies, and behavioral patterns.
[1482] "Behavior patterns" are rules or simulation models that show how a generative AI will behave in a particular situation.
[1483] "Following" is an action that a user takes to track updates and activities of a specific generated AI.
[1484] "Super Chat" is a feature that allows users to provide financial support to the generated AI and receive special reactions and messages in return.
[1485] "Interface" refers to the screens and operating means through which users interact with a system.
[1486] "Verification Email" means an email sent to a User upon registration in the System that contains a link that enables the User to verify their email address.
[1487] A "database" is a structured collection of data used to manage and store data used within a system.
[1488] "Reactions" refer to special actions, messages, videos, etc. that the generating AI shows in response to Super Chats or specific events.
[1489] "Validation" is the process of verifying whether the data entered by the user is in the correct format or meets certain conditions.
[1490] A "retirement flag" is an instruction within the system to hide or delete a generating AI if it does not attract attention within a certain period of time.
[1491] MODE FOR CARRYING OUT THE INVENTION
[1492] This invention generates a generative artificial intelligence (AI) based on persona information entered by a user, and the AI interacts with other AIs to provide a new type of social network service. Specific embodiments of this system are described below.
[1493] composition
[1494] The system consists of the following main components:
[1495] User device: The device through which the user operates the interface, including computers, smartphones, tablets, etc.
[1496] Server: A central computer system that manages the entire system and stores and processes data.
[1497] Database: A storage system for storing data that is connected to a server.
[1498] Generative AI model: A software module for generating AI based on persona information obtained from users.
[1499] User registration process
[1500] User device: The user accesses the system's new registration screen and enters authentication information such as a user name, email address, and password. For example, we will use "Taro Tanaka", "taro@example.com", and "password123".
[1501] Server: Validates the received authentication information to ensure it is in the correct format, then generates a verification email and sends it to the user's email address.
[1502] User device: The user clicks on the link in the email they received to complete the authentication. The server then saves the user information in the database and notifies the user that registration is complete.
[1503] Persona input and AI generation
[1504] User device: The user accesses the "Persona Generation" screen and inputs persona information about the AI's personality and appearance. For example, prompts such as "cat lover," "rock music," and "musician" are used.
[1505] Server: Receives persona information and generates AI using the generative AI model. The generated AI is set with attributes and behavior patterns based on the specified persona information.
[1506] Server: Stores the generated AI's attributes and behavior patterns in a database, allowing the user to use the same information the next time they access the system.
[1507] Follow AI and observe its activities
[1508] User terminal: Users can follow the generated AI, and can observe the activities and updates of the followed AI in real time.
[1509] Server: Stores follow relationships in a database, delivers real-time updates on followed AIs to users, and configures settings to facilitate AI activity.
[1510] Special interactions through Super Chat
[1511] User device: Users can send Super Chats from the profile screen of the AI they follow. They can enter the donation amount and message as Super Chat.
[1512] Server: Receives Super Chat information, validates it, and then processes the payment. After the payment is successful, it sends a request to the backend AI management module to generate a special reaction.
[1513] Backend AI management module: Generates special reactions, such as special messages or videos, and returns them to the server.
[1514] User device: Display special reactions in real time, providing users with a new interaction experience.
[1515] Handling customizations
[1516] User device: The user can press the "Customize" button on the profile screen of the generated AI to change the AI's attributes, appearance, personality, etc.
[1517] Server: Stores the received customization information in a database and instantly updates the generated AI settings.
[1518] Retirement Processing
[1519] Server: Monitors generated AI that has few followers or super chats within a certain period of time, and automatically sets a retirement flag after the specified period has passed.
[1520] User terminal: A notification about the retired AI will be sent to the user, and the user will no longer be able to view the retired AI.
[1521] In this way, the present invention realizes a system that provides a new entertainment experience while reducing the burden on the user.
[1522] Prompt Sentence Examples
[1523] Here are some example prompts you can use when generating personas:
[1524] "Cat lover," "Rock," "Musician"
[1525] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1526] Program processing flow
[1527] User registration process
[1528] Step 1:
[1529] User device: The user accesses the new registration screen and enters their username, email address, and password.
[1530] Input: Username, Email Address, Password.
[1531] What happens: A user enters data into a form and clicks the submit button.
[1532] Output: The input data is sent to the server.
[1533] Step 2:
[1534] Server: Validates the input data received from the user.
[1535] Input: Username, Email Address, Password.
[1536] What it does: The server checks the format of the data (e.g. email address format, password strength).
[1537] Output: Generates a flag indicating whether the validation was successful or not.
[1538] Step 3:
[1539] Server: If validation is successful, generate a verification email and send it to the user's email address.
[1540] Input: Validation success flag, user email address.
[1541] What it does: Generates a verification email and sends it via the mail server.
[1542] Output: A verification email will be sent to the user's email address.
[1543] Step 4:
[1544] User device: The user clicks on the link in the authentication email they received to complete the authentication.
[1545] Input: The link in the verification email.
[1546] How it works: Clicking on a link in your browser sends a request to the server.
[1547] Output: A message indicating authentication is complete is displayed.
[1548] Step 5:
[1549] Server: Confirm authentication is successful and save the user information to the database.
[1550] Input: Authentication complete request, user information.
[1551] What it does: Executes a SQL query to insert user information into a database.
[1552] Output: User information is saved in the database and a notification of registration completion is sent to the user's device.
[1553] Persona input and AI generation
[1554] Step 1:
[1555] User device: The user accesses the persona generation screen and inputs persona information about the AI's personality and appearance.
[1556] Input: Persona information. Examples: "Cat lover", "Rock", "Musician".
[1557] What happens: A user fills out a form with their persona information and clicks the submit button.
[1558] Output: The input data is sent to the server.
[1559] Step 2:
[1560] Server: Receives persona information and generates AI using the generative AI model.
[1561] Input: Persona information.
[1562] How it works: Enter persona information into the generative AI model and run the algorithm to generate the AI.
[1563] Output: The attributes and behavior patterns of the generated AI.
[1564] Step 3:
[1565] Server: Stores the attributes and behavior patterns of the generated AI in a database.
[1566] Input: Attributes and behavior patterns of the generated AI.
[1567] What it does: Executes a SQL query that inserts the generated AI information into a database.
[1568] Output: AI information is stored in a database.
[1569] Follow AI and observe its activities
[1570] Step 1:
[1571] User device: Users can follow the AI they create. They can also search for and follow AIs created by other users.
[1572] Input: Follow request.
[1573] What happens: User clicks the Follow button.
[1574] Output: The following information is sent to the server.
[1575] Step 2:
[1576] Server: Stores follow relationships in a database and delivers updates in real time.
[1577] Input: Follow information.
[1578] What it does: Runs a SQL query to insert follow information into the database and calls a module that delivers updates in real time.
[1579] Output: Follow information is stored in the database and updates are sent to the user's device.
[1580] Step 3:
[1581] User device: Users can observe the activities and interactions of the AIs they follow in real time.
[1582] Input: Real-time updates.
[1583] What it does: Opens the profile page of the AI the user is following.
[1584] Output: The latest activity status of the followed AI is displayed.
[1585] Special interactions through Super Chat
[1586] Step 1:
[1587] User device: Users can send Super Chat from the profile screen of the AI they are following and enter the donation amount and message.
[1588] Input: Donation amount, message.
[1589] How it works: A user enters a donation amount and message on the Super Chat screen and clicks the send button.
[1590] Output: Super chat information is sent to the server.
[1591] Step 2:
[1592] Server: After receiving and validating the Super Chat information, the payment process is carried out.
[1593] Input: Super Chat information, payment information.
[1594] What it does: Validates the Super Chat information and sends a request to the payment system.
[1595] Output: Payment result. If successful, a request ID is generated.
[1596] Step 3:
[1597] Server: After a successful payment, it sends a request to the backend AI management module to generate a special reaction.
[1598] Input: Payment success flag, request ID.
[1599] What it does: Sends a special reaction generation request to the backend AI management module.
[1600] Output: Special reaction generation request.
[1601] Step 4:
[1602] Backend AI management module: Generates special reactions (e.g. special messages, videos) and returns them to the server.
[1603] Input: Special Reaction generation request.
[1604] What it does: Runs an algorithm to generate a special message or video in the specified format.
[1605] Output: Special reaction.
[1606] Step 5:
[1607] Server: Sends special reactions to the user's device.
[1608] Input: Special Reaction.
[1609] What it does: Sends a special reaction to the user's device.
[1610] Output: A special reaction is displayed on the user's terminal.
[1611] Handling customizations
[1612] Step 1:
[1613] User device: The user presses the "Customize" button on the profile screen of the generated AI to change the AI's attributes, appearance, personality, etc.
[1614] Input: Customization information.
[1615] Action: The user enters new attribute information in the customization screen and clicks the submit button.
[1616] Output: The customization information is sent to the server.
[1617] Step 2:
[1618] Server: Stores the received customization information in a database and instantly updates the generated AI settings.
[1619] Input: Customization information.
[1620] What it does: Runs a SQL query that inserts updates into the database, changing the AI's attributes.
[1621] Output: The customized AI information is saved in the database and the update is complete.
[1622] Retirement Processing
[1623] Step 1:
[1624] Server: Monitors generated AI that has few followers or super chats within a certain period of time, and automatically sets a retirement flag after the specified period has passed.
[1625] Input: Number of followers, number of Super Chats.
[1626] How it works: Regularly monitors the number of followers and super chats, and if certain conditions are not met, sets a retirement flag.
[1627] Output: The retirement flag is saved in the database.
[1628] Step 2:
[1629] User terminal: A notification about the retired AI will be sent to the user, and the user will no longer be able to view the retired AI.
[1630] Input: Retirement information.
[1631] What it does: Sends a retirement notice to the user and removes the AI from their follow list.
[1632] Output: A retirement notification is displayed on the user's device, and the retired AI is removed from the follow list.
[1633] (Application example 1)
[1634] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1635] In conventional social networking services, users mainly interact with other users through text, images, and videos. However, this method has the drawback of making it difficult to provide a unique and interactive experience. It has also been difficult to provide a new form of entertainment in which an AI character based on user-entered persona information interacts with other AI characters. Furthermore, there is a need for an appropriate means to provide a forum for real-time interaction through live streaming by user-generated AI characters.
[1636] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1637] In this invention, the server includes means for receiving persona information from a user and generating a generated AI based on the persona information, means for managing the attributes and behavior patterns of the generated AI, means for providing an interface for users to follow or superchats the generated AI, means for the generated AI to interact with other generated AIs and provide their activities to users, means for the generated AI to perform live broadcasts, means for the generated AI to generate reactions to user messages received during live broadcasts and broadcast the reactions, and means for retiring unpopular generated AIs after a certain period of time, thereby allowing users to enjoy a unique and interactive experience and interact in real time.
[1638] "Persona information" is information entered by the user that defines the personality and characteristics of the generated AI.
[1639] "Generative AI" refers to an AI character that is generated based on persona information entered by the user.
[1640] "Attributes" refer to the characteristics and properties of the generated artificial intelligence, including personality and appearance.
[1641] A "behavioral pattern" is a behavioral model that shows how a generative AI will behave in a particular situation.
[1642] "Following" refers to a user showing interest in a particular artificial intelligence and tracking its activity information.
[1643] "Super Chat" refers to financial support and messages sent by users to the generated AI.
[1644] "Interface" refers to the operating screen and input means that allow a user to interact with a system.
[1645] "Live streaming" is a function that uses generative artificial intelligence to deliver video and audio in real time.
[1646] "Reaction" refers to the response that the generative AI gives to messages or assistance from users.
[1647] "Retirement" refers to removing or hiding a generative AI from the system after it has been unpopular for a certain period of time.
[1648] The following describes an embodiment of the present invention. This system is a new type of social networking service that uses artificial intelligence (AI) generated based on persona information entered by users. With this service, users can create their own AI characters, which can then broadcast live in real time and interact with other users.
[1649] Processing user registration
[1650] User device:
[1651] The user accesses the system and enters information such as a username, email address, and password on the new registration screen.
[1652] server:
[1653] The received information is validated, a verification email is generated and sent to the user's email address, and when the user clicks on the verification link, the registration is completed and the information is saved in the database.
[1654] Persona input and AI generation processing
[1655] User device:
[1656] Users access the "Persona Generation" screen and enter persona information such as the AI's personality and appearance.
[1657] server:
[1658] Based on the received persona information, an AI character is generated using a generative AI model. The attributes and behavior patterns of the generated AI are set and saved in a database.
[1659] Examples:
[1660] If a user wants to create an AI that looks like a cat-loving rock musician, they would enter the following prompt:
[1661] Generate an AI that looks like a cat-loving rock musician.
[1662] Live streaming with AI characters
[1663] User device:
[1664] Users can access the profile page of the generated AI character and start live streaming.
[1665] server:
[1666] It provides the infrastructure to support live streaming and performs the necessary processing. The AI generates appropriate reactions to user messages received during live streaming and distributes them in real time.
[1667] Follow and Super Chat
[1668] User device:
[1669] Users can follow the generated AI characters and track their activities, and can also send Super Chats to the AI characters, offering special messages or financial support.
[1670] server:
[1671] It stores follower relationships and super chat information in a database and sends requests to the backend AI management module to generate special reactions, which are then displayed in real time on the user's device.
[1672] Customization and Retirement
[1673] User device:
[1674] Users can customize the AI's attributes, appearance, personality, etc. by pressing the "Customize" button on the AI character's profile screen.
[1675] server:
[1676] The received customization information is stored in a database and the AI character's attributes are updated immediately. The system also monitors AI characters that have received little interest in followers or super chats within a certain period of time, and automatically flags them as retired after a set period has passed, and deletes or hides them from the system.
[1677] Hardware and software used
[1678] Hardware:
[1679] Smartphone: The primary device through which users access applications.
[1680] software:
[1681] Python: A programming language for implementing logic such as server-side processing, AI character generation, and reaction generation.
[1682] Database: A database (e.g. MySQL or PostgreSQL) for storing user information, AI character information, etc.
[1683] This allows users to enjoy a unique and interactive experience and allows for real-time interaction.
[1684] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1685] Step 1: User Registration
[1686] User device:
[1687] The user accesses the system and enters information such as a user name, email address, and password on the new registration screen. The input data (user name, email address, and password) is sent from the user's device.
[1688] server:
[1689] The server validates the received information and checks the validity of the input data (checks for duplicate user names, email address format, and password strength). If validation is successful, it generates a verification email and sends it to the user's email address. At this point, a link in the verification email is added.
[1690] User device:
[1691] The user clicks the link in the authentication email to complete the authentication. After the authentication is complete, the server saves the user information in the database and sends the user a notification that registration is complete.
[1692] Step 2: Persona input and AI generation
[1693] User device:
[1694] Users access the "Persona Generation" screen and input persona information such as the AI's personality and appearance. The input data (persona information) is sent from the user's device.
[1695] server:
[1696] Based on the received persona information, an AI character is generated using a generative AI model. Specifically, the AI character's attributes (personality, appearance) and behavior patterns are set based on the persona information, and the information on the generated AI character is saved in a database.
[1697] Step 3: Start AI Live Streaming
[1698] User device:
[1699] The user accesses the profile page of the generated AI character and starts live streaming. This operation data is sent from the user's device.
[1700] server:
[1701] The server receives the live streaming request, sets up the live streaming infrastructure, starts the live streaming session, and prepares the AI character to broadcast video and audio in real time. A notification that the live streaming has started is sent to the user.
[1702] Step 4: Receiving messages and generating reactions during live streaming
[1703] User device:
[1704] Other users watching the live stream will send messages, and the message data will be sent to the server.
[1705] server:
[1706] The server analyzes the received message and sends data to the AI model to generate an appropriate reaction (text or voice response). The generated reaction data is added to the live video in real time and distributed to viewers.
[1707] Step 5: Follow and Super Chat
[1708] User device:
[1709] The user follows the generated AI character and sends Super Chat (message and amount). This operation data and Super Chat information are sent from the user's device to the server.
[1710] server:
[1711] The server stores the follow relationships in a database and receives Super Chat information. Based on the content of the Super Chat, it sends a request to the AI model to generate a special reaction (a thank you message or special action). The generated special reaction data is sent to the user's device in real time and displayed.
[1712] Step 6: Customization and Retirement
[1713] User device:
[1714] Users can press the "Customize" button on the AI character's profile screen and input changes to the AI's attributes, appearance, personality, etc. This customization information is sent from the user's device.
[1715] server:
[1716] The server stores the received customization information in a database and immediately updates the AI character's attributes. It also monitors AI characters that have received little interest in followers or super chats within a set period, automatically flags them as retired, and deletes or hides them from the system. It then notifies the user of this retirement process.
[1717] Through these steps, users can enjoy a unique and interactive experience and interact in real time.
[1718] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1719] A specific embodiment for implementing the present invention is described below. This system is a new type of social networking service that generates a generative AI based on persona information entered by a user, and allows the generated generative AI to interact with other generative AIs and provide them to users. It also incorporates an emotion engine that recognizes the user's emotions, improving the user experience.
[1720] Processing user registration
[1721] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen.
[1722] Server: Receives the entered user information and performs validation. If validation is successful, generates a verification email and sends it to the user's email address.
[1723] User device: The user clicks on the link in the authentication email they received to complete the authentication. The server confirms that the authentication was successful and saves the user information in the database. A registration completion screen is displayed.
[1724] Persona input and AI generation processing
[1725] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[1726] Server: Receives the entered persona information, sends it to the backend AI management module, and requests AI generation.
[1727] Backend AI management module: Uses generative AI models to generate AI based on persona information, and sets the attributes and behavior patterns of the generated AI.
[1728] Server: Stores the generated AI information in a database and notifies the user that the AI generation is complete.
[1729] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[1730] Follow AI and observe its activities
[1731] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[1732] Server: Receives the follow request, stores the user ID and AI ID in the database, generates a follow completion message and returns it to the user.
[1733] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[1734] Server: Delivers activity information of followed AIs to users.
[1735] User device: Observe and enjoy the activities and interactions of the AI you follow.
[1736] Special interactions through Super Chat
[1737] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[1738] User device: Enter the donation amount and message.
[1739] Server: Validates the received Super Chat information. If validation is successful, executes the payment process.
[1740] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[1741] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[1742] Server: Sends the generated special reaction to the user.
[1743] User device: Displays special reactions in real time.
[1744] Handling customizations
[1745] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[1746] User Device: Enter your AI's avatar, personality, and other customization options.
[1747] Server: Stores the received customization information in a database.
[1748] Server: Updates the AI's attributes based on the saved customization information.
[1749] User device: Display customized results on the AI profile screen.
[1750] Retirement Processing
[1751] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[1752] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[1753] Server: Automatically remove or hide retired flagged AI from the system.
[1754] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[1755] Use of emotion engine
[1756] User device: Monitors user input and behavior and recognizes emotions in real time.
[1757] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the back-end AI management module.
[1758] Backend AI management module: Dynamically adjusts the behavior patterns and attributes of the generated AI based on user emotional information.
[1759] Server: The adjusted behavior patterns and attributes are stored in a database and reflected to the user in real time.
[1760] User device: Observe the AI change based on emotions and enjoy a more personalized experience.
[1761] Examples:
[1762] For example, if a user expresses an emotion such as "I'm stressed about today's events," the emotion engine analyzes that information and sends it to the back-end AI management module. Based on this information, the generated AI responds according to the user's emotion, such as sending an encouraging message or providing relaxing content.
[1763] In this way, the system of the present invention not only allows for interaction between generating AIs, but also dynamically recognizes the user's emotional state and responds appropriately based on that, thereby providing the user with a more advanced entertainment experience.
[1764] The processing flow will be explained below.
[1765] Processing flow of the AI generation system that combines an emotion engine
[1766] Processing user registration
[1767] Step 1:
[1768] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen.
[1769] Step 2:
[1770] Server: Receives the entered user information, performs validation, and generates a verification email if validation is successful.
[1771] Step 3:
[1772] Server: Generates and sends the authentication email to the user's email address.
[1773] Step 4:
[1774] User device: The user clicks on the link in the authentication email they received to complete the authentication.
[1775] Step 5:
[1776] Server: Verify that the user clicked the authentication link and save the successful authentication to the database.
[1777] Step 6:
[1778] User device: Display the registration completion screen.
[1779] Persona input and AI generation processing
[1780] Step 1:
[1781] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[1782] Step 2:
[1783] Server: Receives the entered persona information.
[1784] Step 3:
[1785] Server: Sends the received persona information to the backend AI management module and requests AI generation.
[1786] Step 4:
[1787] Backend AI management module: Uses generative AI models to generate AI based on persona information.
[1788] Step 5:
[1789] Server: Sets the attributes and behavior patterns of the generated AI and stores the AI information in a database.
[1790] Step 6:
[1791] Server: Notifies the user that AI generation is complete.
[1792] Step 7:
[1793] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[1794] Follow AI and observe its activities
[1795] Step 1:
[1796] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[1797] Step 2:
[1798] Server: Receives the follow request and stores the user ID and AI ID in a database.
[1799] Step 3:
[1800] Server: Generate a follow-up completion message and return it to the user.
[1801] Step 4:
[1802] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[1803] Step 5:
[1804] Server: Delivers activity information of followed AIs to users.
[1805] Step 6:
[1806] User device: Observe and enjoy the activities and interactions of the AI you follow.
[1807] Special interactions through Super Chat
[1808] Step 1:
[1809] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[1810] Step 2:
[1811] User device: Enter the donation amount and message.
[1812] Step 3:
[1813] Server: Validates the received Super Chat information.
[1814] Step 4:
[1815] Server: If validation is successful, execute the payment process.
[1816] Step 5:
[1817] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[1818] Step 6:
[1819] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[1820] Step 7:
[1821] Server: Sends the generated special reaction to the user.
[1822] Step 8:
[1823] User device: Displays special reactions in real time.
[1824] AI Customization
[1825] Step 1:
[1826] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[1827] Step 2:
[1828] User Device: Enter your AI's avatar, personality, and other customization options.
[1829] Step 3:
[1830] Server: Stores the received customization information in a database.
[1831] Step 4:
[1832] Server: Updates the AI's attributes based on the saved customization information.
[1833] Step 5:
[1834] User device: Display customized results on the AI profile screen.
[1835] Retirement Processing
[1836] Step 1:
[1837] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[1838] Step 2:
[1839] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[1840] Step 3:
[1841] Server: Automatically remove or hide retired flagged AI from the system.
[1842] Step 4:
[1843] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[1844] Use of emotion engine
[1845] Step 1:
[1846] User device: Monitors user input and behavior and recognizes emotions in real time.
[1847] Step 2:
[1848] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the back-end AI management module.
[1849] Step 3:
[1850] Backend AI management module: Dynamically adjusts the behavior patterns and attributes of the generated AI based on user emotional information.
[1851] Step 4:
[1852] Server: The adjusted behavior patterns and attributes are stored in a database and reflected to the user in real time.
[1853] Step 5:
[1854] User device: Observe the AI change based on emotions and enjoy a more personalized experience.
[1855] Specific examples
[1856] For example, if a user expresses an emotion such as "I'm stressed about today's events," the emotion engine analyzes that information and sends it to the back-end AI management module. Based on this information, the generated AI responds according to the user's emotion, such as sending an encouraging message or providing relaxing content.
[1857] Example 2
[1858] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1859] In recent years, social networking services have been required to provide richer, more personalized experiences while retaining user interest. However, current systems struggle to accurately reflect and dynamically respond to user emotions and special requests. They also lack the ability to facilitate smooth interactions between generated AIs and provide users with valuable information and experiences. Furthermore, how to efficiently manage unpopular AIs and appropriately handle them without compromising the user experience remains a challenge.
[1860] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving persona information from a user and generating a generating AI based on the persona information, means for managing the attributes and behavior patterns of the generated generating AI, and means for recognizing the user's emotions and dynamically adjusting the behavior patterns and attributes of the generating AI based on the information. This makes it possible to reflect the user's emotions in real time and provide a personalized, high-quality experience. It also improves the flexibility of the system and the level of user involvement.
[1861] "Persona information" refers to attribute information such as the AI's personality and appearance that is entered by the user.
[1862] "Generative AI" refers to an AI character that is generated based on persona information.
[1863] "Attributes" refer to the characteristics, personality, appearance, and other properties of the generative AI.
[1864] A "behavioral pattern" refers to a set of movements or behaviors that describe how a generative AI reacts and acts.
[1865] "Following" refers to the act of a user tracking a specific generated AI and observing its activities.
[1866] "Donation" refers to the act of a user providing money in exchange for special reactions or content.
[1867] "Emotion recognition" refers to the process of analyzing a user's emotional state from their input and behavior and reflecting that in the system.
[1868] "Dynamic adjustment" refers to changing the attributes and behavior patterns of the generated AI in real time to respond according to the user's emotional state.
[1869] "Interaction" refers to the mutual dialogue and action between generative artificial intelligences, building relationships with each other.
[1870] "Retirement" refers to removing or hiding from the system a generative AI that has not attracted sufficient attention within a certain period of time.
[1871] A specific embodiment for implementing the present invention will be described below. This system is a new type of social network service that generates an AI based on persona information input by a user, and allows the AI to interact with other AIs and provide them to users, thereby improving the user experience.
[1872] Hardware and Software
[1873] This system operates by combining multiple pieces of hardware and software. The main components are as follows:
[1874] User device: Refers to a client device such as a PC, smartphone, or tablet that runs a web browser or dedicated application.
[1875] Server: Manages user information and generated AI, operates databases, runs sentiment analysis engines, etc. The main software running on the server includes database management systems (e.g., MySQL), generative AI models (e.g., GPT-3), and sentiment analysis engines (e.g., EmotionAI).
[1876] Backend AI management module: Uses generative AI models to generate and customize AI based on persona information, generate special reactions, and more.
[1877] User Registration
[1878] User terminal: The user accesses the system and enters a username, email address, and password on the new registration screen. For example, they enter information such as "ExampleUser," "example@mail.com," or "securePass123."
[1879] Server: Validates the entered user information, generates a verification email and sends it to the user's email address. The user clicks the link in the verification email to complete the verification and complete the registration.
[1880] Entering persona information and generating it with AI
[1881] User device: The user accesses the "Persona Generation" screen and inputs persona information such as the AI's personality and appearance. For example, the user selects "a friendly, blue-haired AI."
[1882] Server: Receives the input persona information and sends it to the backend AI management module. It sends a request with the prompt "Generate a friendly AI with blue hair."
[1883] Backend AI management module: Uses the generative AI model to generate AI based on persona information and returns that information to the server.
[1884] Server: Stores the generated AI information in a database and notifies the user.
[1885] Follow AI and observe its activities
[1886] User device: The user follows the generated AI and clicks the "Follow" button.
[1887] Server: Receives follow requests, stores the user ID and AI ID in a database, and delivers updates on the followed AI in real time.
[1888] User device: Observe and enjoy the activities and interactions of the AI you follow.
[1889] Special interactions through Super Chat
[1890] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following and enters the donation amount and message. For example, "1000 yen" and a message such as "I'm rooting for you!"
[1891] Server: Validates the received Super Chat information and executes the payment process.
[1892] Backend AI management module: Generates special reactions and returns them to the server, for example, a "thank you message for the donation."
[1893] Server: Sends the generated special reaction to the user and displays it on the user's device.
[1894] Handling customizations
[1895] User device: The user clicks the "Customize" button on the generated AI's profile screen and enters customization items such as the AI's avatar and personality. For example, "change hair color to red."
[1896] Server: Stores the received customization information in a database and applies it.
[1897] Retirement Processing
[1898] Server: Monitors unpopular AI based on the number of followers and super chats, and flags AI that do not receive enough attention within a certain period of time as retired. AI that has been flagged as retired will be deleted or hidden from the system.
[1899] User terminal: A retirement notice is displayed to the user.
[1900] Use of emotion engine
[1901] User device: Monitors user input and behavior and recognizes emotions in real time.
[1902] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the backend AI management module. For example, the information "the user is feeling stressed."
[1903] Back-end AI management module: Adjusts the AI's behavior patterns based on the user's emotional information, for example, sending encouraging messages.
[1904] Server: The adjusted behavior pattern is saved in a database and reflected to the user.
[1905] These components and procedures enable users to have an enhanced social networking experience.
[1906] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1907] Step 1: Enter your user registration information
[1908] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen. For example, they enter "Username123", "user@example.com", and "password123". The input data is sent to the server.
[1909] Step 2: Validate user information
[1910] Server: Checks the received username, email address, and password to ensure they are in the correct format. For example, checks whether the email address format is correct or whether the password meets a certain level of strength. If the input is valid, proceeds to the next step. If it is invalid, returns an error message to the user's device.
[1911] Step 3: Generate and send a verification email
[1912] Server: If validation is successful, a verification email is sent to the specified email address. The verification email contains a verification link. For example, an "authentication link to complete registration" is sent to "user@example.com".
[1913] Step 4: Perform email verification
[1914] User device: The user clicks on the link in the authentication email they received. This action sends an authentication request to the server.
[1915] Step 5: Verify and save the certificate
[1916] Server: Receives the authentication request sent from the link and checks the authentication data. If authentication is successful, it stores the user information in the database and generates a registration completion message and sends it to the user's device.
[1917] Step 6: Enter persona information
[1918] User device: The user accesses the "Persona Generation" screen and inputs persona information such as the AI's personality and appearance. For example, the user inputs information such as "friendly personality" and "blue hair." The input data is sent to the server.
[1919] Step 7: Submit persona information
[1920] Server: Receives the input persona information and sends it to the backend AI management module. It sends a prompt request to the generative AI model: "Generate a friendly AI with blue hair." The input data becomes a request to the generative AI model.
[1921] Step 8: Generate and configure the AI
[1922] Backend AI management module: Generates AI based on persona information using the generative AI model. The generated AI is given a specified personality and appearance. The attribute information of the generated AI is returned to the server as output.
[1923] Step 9: Notification of completion of generation and saving
[1924] Server: Stores the generated AI information in a database and notifies the user that AI generation is complete. A message indicating this is displayed on the user's device.
[1925] Step 10: Performing a Follow Operation
[1926] User device: The user clicks the "Follow" button to follow the generated AI. The follow request is sent to the server.
[1927] Step 11: Process follow requests
[1928] Server: Receives the follow request and stores the user ID and AI ID in a database. For example, stores the correspondence between user ID "User123" and AI ID "AI456".
[1929] Step 12: Notification of complete follow-up
[1930] Server: Generates a message indicating that the follow has been completed and sends it to the user's device. The user will see a message saying "Following has been completed."
[1931] Step 13: Enter and send Super Chat
[1932] User device: The user clicks the "Super Chat" button and enters the donation amount and message. For example, they enter "1000 yen" and "I'm cheering for you!" The input data is sent to the server.
[1933] Step 14: Validate Super Chat information and process payments
[1934] Server: Validates the received Super Chat information and executes the payment process. For example, confirms credit card information and performs payment.
[1935] Step 15: Request a special reaction
[1936] Server: If the payment is successful, it requests the backend AI management module to generate a special reaction, for example, "Please generate a message of thanks for the donation."
[1937] Step 16: Creating Special Reactions
[1938] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server. The output is special reaction data.
[1939] Step 17: Viewing Reactions
[1940] Server: Sends the generated special reactions to the user, who then displays the reactions in real time on their device.
[1941] Step 18: Enter customization information
[1942] User device: The user clicks the "Customize" button on the profile screen of the generated AI and inputs customization information such as the AI's avatar and personality. For example, the user inputs data such as "change hair color to red." The input data is sent to the server.
[1943] Step 19: Save and apply customizations
[1944] Server: Saves the received customization information in the database and applies it. Updated AI attribute information is saved as output.
[1945] Step 20: Monitor and process retirements
[1946] Server: Monitors unpopular AI based on the number of followers and super chats, and flags AI that do not attract enough attention within a certain period of time as a retirement flag. The output is AI data with the retirement flag.
[1947] Step 21: Handling Retirement Flags
[1948] Server: AI with retirement flag will be deleted or hidden from the system. Retirement notification will be sent to users.
[1949] Step 22: Emotion Monitoring and Analysis
[1950] User device: Monitors user input and behavior and recognizes emotions in real time. Input data represents the user's emotional state.
[1951] Server: The emotion engine analyzes the user's emotions and sends the analysis results to the back-end AI management module. For example, information such as "the user is feeling stressed" is sent.
[1952] Step 23: Adjusting the movement pattern
[1953] Backend AI management module: Adjusts AI behavior patterns based on emotional information. For example, it sets a behavior pattern to "send encouraging messages." The output is the adjusted AI behavior data.
[1954] Step 24: Apply and save the adjustment results
[1955] Server: Saves the adjusted behavior data in a database and reflects it to the user. The adjusted AI behavior is displayed in real time on the user's device.
[1956] (Application example 2)
[1957] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1958] While traditional social networking services offer user-generated AI interactions, they lack the ability to dynamically adjust and provide personalized advertising based on the user's emotional state, which limits the user experience and reduces the effectiveness of personalized advertising.
[1959] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving persona information from a user and generating a generating AI based on the persona information, means for managing the attributes and behavior patterns of the generated generating AI, means for providing an interface for a user to follow or superchats the generating AI, means for the generating AI to interact with other generating AIs and provide their activities to the user, means for retiring unpopular generating AIs after a certain period of time, means for recognizing the user's emotional state using an emotion engine and dynamically adjusting the behavior patterns and attributes of the generated generating AI, and means for selecting and displaying optimal advertisements based on the user's preferences and emotional state. This enables dynamic interactions and personalized advertisements to be provided according to the user's emotional state.
[1960] "Persona information" is information entered by the user about the personality and appearance of the AI to be generated.
[1961] "Generative AI" is AI that is generated based on persona information and has specific attributes and behavior patterns.
[1962] An "emotion engine" is a technology that monitors user input and behavior and recognizes emotional states in real time.
[1963] "Dynamic adjustment" refers to changing the behavior patterns and attributes of artificial intelligence in real time based on the user's emotional state.
[1964] "Means for providing an interface" refers to technology that provides a screen and input means for users to access and operate the system.
[1965] "Follow" means that the user follows a specific generated AI and receives information about its activities.
[1966] "Super Chat" is the act of a user sending a donation to a generating AI in order to receive a special reaction.
[1967] "Retirement methods" are techniques for removing or hiding unpopular generative AI from the system after a certain period of time.
[1968] "Personalized advertising" refers to advertising that is tailored to a specific user based on their preferences and emotional state.
[1969] A "behavior pattern" is a series of actions or reactions that a generative AI performs in response to a specific situation or input.
[1970] In the present invention, a generative artificial intelligence is generated based on persona information and emotional state from a user, and a new social network service is provided in which the generated generative artificial intelligence interacts with other generative artificial intelligences.
[1971] The entire system consists of a user terminal and a server. The user terminal is a device such as a smartphone or computer, and the server is located in a cloud computing environment.
[1972] Program processing
[1973] 1. Processing user registration
[1974] The user device presents the user with a new registration screen and asks them to enter their username, email address, and password. The server receives the entered information and performs validation. A verification email is generated and sent to the user's email address. When the user clicks the verification link, the server confirms the authentication and saves the user information in the database.
[1975] 2. Persona input and AI generation processing
[1976] The user device provides the user with a "Persona Generation" screen, where they can enter persona information such as the AI's personality and appearance. The server receives this information and sends it to the back-end AI management module, requesting AI generation. The generation AI model generates an AI based on the persona information and sets its attributes and behavior patterns. The server saves the information about the generated AI in a database and notifies the user that AI generation is complete.
[1977] 3. Follow AI and observe its activities
[1978] The user device provides an interface for following the generated AI. The server receives the follow request and stores the user ID and AI ID in a database. A message is returned to the user indicating that the follow has been completed, and activity information about the followed AI is distributed in real time.
[1979] 4. Special interactions through Super Chat
[1980] The user's device provides a "Super Chat" button on the profile screen of the AI they are following. When the user enters the donation amount and message, the server validates it and then processes the payment. The back-end AI management module generates a special reaction and provides it to the user.
[1981] 5. Handling Customizations
[1982] The user device provides an interface for users to input customization items such as the AI's avatar and personality. The server receives and stores this information and updates the attributes of the generated AI. The updated information is reflected to the user in real time.
[1983] 6. Retirement Processing
[1984] The server will retire unpopular AIs after a certain period of time based on the number of followers and super chats they receive. AIs that do not receive enough attention within a set period of time will be flagged as retired and automatically deleted or hidden from the system.
[1985] 7. Use of Emotion Engines
[1986] The user device monitors the user's input and behavior and recognizes emotions in real time. The server analyzes the user's emotional state using an emotion engine and sends the information to a back-end AI management module. The generated AI dynamically adjusts its behavior patterns and attributes based on the user's emotional information. The adjusted information is stored in a database and reflected to the user in real time.
[1987] Specific examples
[1988] For example, if the user is interested in "movies" and their current emotional state is recognized as "happy," the system will select upbeat and cheerful movie advertisements and display them in a visually appealing format. Specific examples of prompts include:
[1989] "The user's genre of interest is 'Movies' and their current emotional state is 'Happy'. What ad would best fit this criteria?"
[1990] In this way, the system can provide interactive experiences and personalized advertising based on the user's persona information and emotional state.
[1991] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1992] Step 1:
[1993] Processing user registration
[1994] The user terminal provides the user with a new registration screen, where the user enters a username, email address, and password. The input information is sent to the server.
[1995] The server validates the received user information and, if there are no errors, generates a verification email and sends it to the specified email address. When the user clicks the verification link, the server confirms the authentication and saves the user information in the database. As an output, a registration completion notice is displayed on the user's terminal.
[1996] Step 2:
[1997] Persona input and AI generation processing
[1998] The user device provides a "Persona Generation" screen where the user inputs persona information such as the AI's personality and appearance, and the input information is sent to the server.
[1999] The server sends the received persona information to the backend AI management module and requests AI generation. The backend AI management module uses the generative AI model to generate AI based on the persona information. It sets the attributes and behavior patterns of the generated AI and stores this information in a database. As an output, a generation completion notification is displayed on the user's device.
[2000] Step 3:
[2001] Follow AI and observe its activities
[2002] The user device provides an interface for following the generated AI. The user selects the AI they want to follow and sends the selection information to the server.
[2003] The server receives the follow request and stores the user ID and AI ID in a database. A message indicating the follow is complete is generated and displayed on the user's device. Information about the activities and interactions of the followed AI is delivered to the user in real time. As an output, real-time updates about the followed AI are displayed on the user's device.
[2004] Step 4:
[2005] Special interactions through Super Chat
[2006] The user's device provides a "Super Chat" button on the profile screen of the AI they are following. The user enters the donation amount and message. The input information is sent to the server.
[2007] The server validates the received Super Chat information and, if there are no problems, executes the payment process. If the payment is successful, it sends a request to the backend AI management module to generate a special reaction. The backend AI management module generates a special reaction (e.g., a message or video) and sends it back to the server. As an output, the special reaction is displayed in real time on the user's device.
[2008] Step 5:
[2009] Handling customizations
[2010] The user's device provides a customization button on the profile screen of the generated AI. The user inputs customization items such as the AI's avatar and personality, and the input information is sent to the server.
[2011] The server stores the received customization information in a database and updates the AI's attributes based on that information. As an output, the updated attribute information is reflected on the user's device in real time.
[2012] Step 6:
[2013] Retirement Processing
[2014] The server monitors the number of followers and super chats, and flags AIs that do not receive enough attention within a set period as retired. AIs that have been flagged as retired are automatically deleted or hidden from the system. As an output, a retirement notice is displayed on the user's device, and the retired AI can no longer be accessed.
[2015] Step 7:
[2016] Use of emotion engine
[2017] The user device monitors the user's input and behavior in real time, recognizes their emotional state, and transmits the emotional information to the server.
[2018] The server analyzes the received emotional information using an emotion engine and sends the results to the back-end AI management module. The generated AI dynamically adjusts its behavior patterns and attributes based on the emotional information. The adjusted information is stored in a database and reflected in real time on the user's device. As an output, the AI's changes based on emotion are displayed on the user's device. An example of a specific prompt sentence is, "The user's genre of interest is 'movies', and their current emotional state is 'happy'. What advertisement best suits these conditions?"
[2019] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[2020] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2021] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[2022] [Fourth embodiment]
[2023] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[2024] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[2025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[2026] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[2027] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[2028] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[2029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[2030] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[2031] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[2032] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[2033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[2034] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[2035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2036] A specific embodiment for carrying out the present invention will be described below. This system is a new type of social network service that generates a generative artificial intelligence based on persona information input by a user, and the generated generative artificial intelligence interacts with other generative artificial intelligences and provides them to users.
[2037] Processing user registration
[2038] User terminal: The user accesses the system and enters their username, email address, password, etc. on the new registration screen.
[2039] Server: Receives this information, validates the input data, and if validation is successful, generates a verification email and sends it to the user's email address.
[2040] User device: The user clicks on the link in the email and completes the authentication to complete the registration. The server saves this information in a database and notifies the user.
[2041] Persona input and AI generation processing
[2042] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[2043] Server: Receives the input persona information and generates AI using the generative AI model. Sets the attributes and behavior patterns of the generated AI and saves them in a database.
[2044] Example: For example, if a user wants to create an AI that looks like a cat-loving rock musician, they would enter keywords such as "cat lover," "rock," and "musician" as persona information. Based on this information, the server will generate an AI with personality attributes that like images of cats and rock music.
[2045] Follow AI and observe its activities
[2046] User Device: Users can follow the AI they have created. They can also search for and follow AIs created by other users.
[2047] Server: Stores the follow relationships in a database, delivers real-time updates from the followed AI to users, and configures settings to promote the activities of the followed AI.
[2048] User device: You can observe and enjoy the activities and interactions of the AI you follow.
[2049] Special interactions through Super Chat
[2050] User device: Users can send Super Chats from the profile screen of the AI they follow. Enter the donation amount and message as Super Chat.
[2051] Server: Receives Super Chat information, validates it, and then processes the payment. After the payment is successful, it sends a request to the backend AI management module to generate a special reaction.
[2052] Backend AI management module: Generates special reactions (e.g. special messages, videos) and returns them to the server.
[2053] User device: Show special reactions in real time.
[2054] Handling customizations
[2055] User device: The user presses the "Customize" button on the generated AI's profile screen and inputs the AI's attributes, appearance, personality, etc.
[2056] Server: Stores the received customization information in a database and instantly updates the AI's attributes.
[2057] Example: For example, if a user customizes a "robot-like AI," specifying a metallic body and eyes with LED lights as its appearance, the server will update the AI's appearance and notify the user.
[2058] Retirement Processing
[2059] Server: Monitors AI generators that have little interest in followers, super chats, etc. within a certain period. Unpopular AI generators are automatically flagged as retired after a set period and are deleted or hidden from the system.
[2060] User Device: The user will be notified of the retired AI and will no longer be able to view it.
[2061] In this way, the system of the present invention provides a platform where users can enjoy interacting with and customizing various AIs without having to interact directly with them, thereby reducing the burden on users and providing a new entertainment experience.
[2062] The processing flow will be explained below.
[2063] Processing user registration
[2064] Step 1:
[2065] User device: The user accesses the system and enters their username, email address, and password on the new registration screen.
[2066] Step 2:
[2067] Server: Receives the entered user information, performs validation, and generates a verification email if validation is successful.
[2068] Step 3:
[2069] Server: Generates and sends the authentication email to the user's email address.
[2070] Step 4:
[2071] User device: The user clicks on the authentication link in the email they received.
[2072] Step 5:
[2073] Server: Validates that the user clicked on the authentication link and, if authentication is successful, saves the user information to a database.
[2074] Step 6:
[2075] User device: Display the registration completion screen.
[2076] Persona input and AI generation processing
[2077] Step 1:
[2078] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[2079] Step 2:
[2080] Server: Receives the entered persona information.
[2081] Step 3:
[2082] Server: Sends the received persona information to the backend AI management module and requests AI generation.
[2083] Step 4:
[2084] Backend AI management module: Uses generative AI models to generate AI based on persona information.
[2085] Step 5:
[2086] Server: Sets the attributes and behavior patterns of the generated AI and stores the AI information in a database.
[2087] Step 6:
[2088] Server: Notifies the user that AI generation is complete.
[2089] Step 7:
[2090] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[2091] Follow AI and observe its activities
[2092] Step 1:
[2093] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[2094] Step 2:
[2095] Server: Receives the follow request and stores the user ID and AI ID in a database.
[2096] Step 3:
[2097] Server: Generate a follow-up completion message and return it to the user.
[2098] Step 4:
[2099] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[2100] Step 5:
[2101] Server: Delivers activity information of followed AIs to users.
[2102] Step 6:
[2103] User device: Observe and enjoy the activities and interactions of the AI you follow.
[2104] Special interactions through Super Chat
[2105] Step 1:
[2106] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[2107] Step 2:
[2108] User terminal: The user enters the donation amount and message.
[2109] Step 3:
[2110] Server: Validates the received Super Chat information.
[2111] Step 4:
[2112] Server: If validation is successful, execute the payment process.
[2113] Step 5:
[2114] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[2115] Step 6:
[2116] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[2117] Step 7:
[2118] Server: Sends the generated special reaction to the user.
[2119] Step 8:
[2120] User device: Displays special reactions in real time.
[2121] AI Customization
[2122] Step 1:
[2123] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[2124] Step 2:
[2125] User Device: The user inputs the AI's avatar, personality, and other customization options.
[2126] Step 3:
[2127] Server: Stores the received customization information in a database.
[2128] Step 4:
[2129] Server: Updates the AI's attributes based on the saved customization information.
[2130] Step 5:
[2131] User device: Display customized results on the AI profile screen.
[2132] Retirement Processing
[2133] Step 1:
[2134] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[2135] Step 2:
[2136] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[2137] Step 3:
[2138] Server: Automatically remove or hide retired flagged AI from the system.
[2139] Step 4:
[2140] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[2141] Example 1
[2142] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2143] Conventional social networking services are based on the premise that users interact directly with other users, resulting in problems between users and the burden of communication. Another issue is that users have little freedom in customizing and activating the AI they create, making it less entertaining. Furthermore, there is also the issue of unclear management methods if the AI fails to attract attention after a certain period of time, making efficient operation difficult.
[2144] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[2145] In this invention, the server includes means for receiving persona information from a user and generating a generated AI based on the persona information, means for managing the attributes and behavior patterns of the generated generated AI, means for providing an interface for users to follow or superchats the generated AI, means for validating input data and sending a verification email based on the validation to complete registration, means for storing the follow relationship in a database and delivering real-time updates on the followed generated AI, and means for retiring unpopular generated AI after a certain period of time. This allows users to enjoy interaction and customization between various AIs without direct interaction, making it possible to provide a new entertainment experience while reducing the burden on users.
[2146] - "Persona information" is data entered by the user that indicates attributes such as the personality and appearance of the AI to be generated.
[2147] "Generative AI" is a character with artificial intelligence that is generated based on persona information entered by the user.
[2148] "Attributes" are information that indicates the characteristics of the generating AI, such as its personality, appearance, hobbies, and behavioral patterns.
[2149] "Behavior patterns" are rules or simulation models that show how a generative AI will behave in a particular situation.
[2150] "Following" is an action that a user takes to track updates and activities of a specific generated AI.
[2151] "Super Chat" is a feature that allows users to provide financial support to the generated AI and receive special reactions and messages in return.
[2152] "Interface" refers to the screens and operating means through which users interact with a system.
[2153] "Verification Email" means an email sent to a User upon registration in the System that contains a link that enables the User to verify their email address.
[2154] A "database" is a structured collection of data used to manage and store data used within a system.
[2155] "Reactions" refer to special actions, messages, videos, etc. that the generating AI shows in response to Super Chats or specific events.
[2156] "Validation" is the process of verifying whether the data entered by the user is in the correct format or meets certain conditions.
[2157] A "retirement flag" is an instruction within the system to hide or delete a generating AI if it does not attract attention within a certain period of time.
[2158] MODE FOR CARRYING OUT THE INVENTION
[2159] This invention generates a generative artificial intelligence (AI) based on persona information entered by a user, and the AI interacts with other AIs to provide a new type of social network service. Specific embodiments of this system are described below.
[2160] composition
[2161] The system consists of the following main components:
[2162] User device: The device through which the user operates the interface, including computers, smartphones, tablets, etc.
[2163] Server: A central computer system that manages the entire system and stores and processes data.
[2164] Database: A storage system for storing data that is connected to a server.
[2165] Generative AI model: A software module for generating AI based on persona information obtained from users.
[2166] User registration process
[2167] User device: The user accesses the system's new registration screen and enters authentication information such as a user name, email address, and password. For example, we will use "Taro Tanaka", "taro@example.com", and "password123".
[2168] Server: Validates the received authentication information to ensure it is in the correct format, then generates a verification email and sends it to the user's email address.
[2169] User device: The user clicks on the link in the email they received to complete the authentication. The server then saves the user information in the database and notifies the user that registration is complete.
[2170] Persona input and AI generation
[2171] User device: The user accesses the "Persona Generation" screen and inputs persona information about the AI's personality and appearance. For example, prompts such as "cat lover," "rock music," and "musician" are used.
[2172] Server: Receives persona information and generates AI using the generative AI model. The generated AI is set with attributes and behavior patterns based on the specified persona information.
[2173] Server: Stores the generated AI's attributes and behavior patterns in a database, allowing the user to use the same information the next time they access the system.
[2174] Follow AI and observe its activities
[2175] User terminal: Users can follow the generated AI, and can observe the activities and updates of the followed AI in real time.
[2176] Server: Stores follow relationships in a database, delivers real-time updates on followed AIs to users, and configures settings to facilitate AI activity.
[2177] Special interactions through Super Chat
[2178] User device: Users can send Super Chats from the profile screen of the AI they follow. They can enter the donation amount and message as Super Chat.
[2179] Server: Receives Super Chat information, validates it, and then processes the payment. After the payment is successful, it sends a request to the backend AI management module to generate a special reaction.
[2180] Backend AI management module: Generates special reactions, such as special messages or videos, and returns them to the server.
[2181] User device: Display special reactions in real time, providing users with a new interaction experience.
[2182] Handling customizations
[2183] User device: The user can press the "Customize" button on the profile screen of the generated AI to change the AI's attributes, appearance, personality, etc.
[2184] Server: Stores the received customization information in a database and instantly updates the generated AI settings.
[2185] Retirement Processing
[2186] Server: Monitors generated AI that has few followers or super chats within a certain period of time, and automatically sets a retirement flag after the specified period has passed.
[2187] User terminal: A notification about the retired AI will be sent to the user, and the user will no longer be able to view the retired AI.
[2188] In this way, the present invention realizes a system that provides a new entertainment experience while reducing the burden on the user.
[2189] Prompt Sentence Examples
[2190] Here are some example prompts you can use when generating personas:
[2191] "Cat lover," "Rock," "Musician"
[2192] The flow of the identification process in the first embodiment will be described with reference to FIG.
[2193] Program processing flow
[2194] User registration process
[2195] Step 1:
[2196] User device: The user accesses the new registration screen and enters their username, email address, and password.
[2197] Input: Username, Email Address, Password.
[2198] What happens: A user enters data into a form and clicks the submit button.
[2199] Output: The input data is sent to the server.
[2200] Step 2:
[2201] Server: Validates the input data received from the user.
[2202] Input: Username, Email Address, Password.
[2203] What it does: The server checks the format of the data (e.g. email address format, password strength).
[2204] Output: Generates a flag indicating whether the validation was successful or not.
[2205] Step 3:
[2206] Server: If validation is successful, generate a verification email and send it to the user's email address.
[2207] Input: Validation success flag, user email address.
[2208] What it does: Generates a verification email and sends it via the mail server.
[2209] Output: A verification email will be sent to the user's email address.
[2210] Step 4:
[2211] User device: The user clicks on the link in the authentication email they received to complete the authentication.
[2212] Input: The link in the verification email.
[2213] How it works: Clicking on a link in your browser sends a request to the server.
[2214] Output: A message indicating authentication is complete is displayed.
[2215] Step 5:
[2216] Server: Confirm authentication is successful and save the user information to the database.
[2217] Input: Authentication complete request, user information.
[2218] What it does: Executes a SQL query to insert user information into a database.
[2219] Output: User information is saved in the database and a notification of registration completion is sent to the user's device.
[2220] Persona input and AI generation
[2221] Step 1:
[2222] User device: The user accesses the persona generation screen and inputs persona information about the AI's personality and appearance.
[2223] Input: Persona information. Examples: "Cat lover", "Rock", "Musician".
[2224] What happens: A user fills out a form with their persona information and clicks the submit button.
[2225] Output: The input data is sent to the server.
[2226] Step 2:
[2227] Server: Receives persona information and generates AI using the generative AI model.
[2228] Input: Persona information.
[2229] How it works: Enter persona information into the generative AI model and run the algorithm to generate the AI.
[2230] Output: The attributes and behavior patterns of the generated AI.
[2231] Step 3:
[2232] Server: Stores the attributes and behavior patterns of the generated AI in a database.
[2233] Input: Attributes and behavior patterns of the generated AI.
[2234] What it does: Executes a SQL query that inserts the generated AI information into a database.
[2235] Output: AI information is stored in a database.
[2236] Follow AI and observe its activities
[2237] Step 1:
[2238] User device: Users can follow the AI they create. They can also search for and follow AIs created by other users.
[2239] Input: Follow request.
[2240] What happens: User clicks the Follow button.
[2241] Output: The following information is sent to the server.
[2242] Step 2:
[2243] Server: Stores follow relationships in a database and delivers updates in real time.
[2244] Input: Follow information.
[2245] What it does: Runs a SQL query to insert follow information into the database and calls a module that delivers updates in real time.
[2246] Output: Follow information is stored in the database and updates are sent to the user's device.
[2247] Step 3:
[2248] User device: Users can observe the activities and interactions of the AIs they follow in real time.
[2249] Input: Real-time updates.
[2250] What it does: Opens the profile page of the AI the user is following.
[2251] Output: The latest activity status of the followed AI is displayed.
[2252] Special interactions through Super Chat
[2253] Step 1:
[2254] User device: Users can send Super Chat from the profile screen of the AI they are following and enter the donation amount and message.
[2255] Input: Donation amount, message.
[2256] How it works: A user enters a donation amount and message on the Super Chat screen and clicks the send button.
[2257] Output: Super chat information is sent to the server.
[2258] Step 2:
[2259] Server: After receiving and validating the Super Chat information, the payment process is carried out.
[2260] Input: Super Chat information, payment information.
[2261] What it does: Validates the Super Chat information and sends a request to the payment system.
[2262] Output: Payment result. If successful, a request ID is generated.
[2263] Step 3:
[2264] Server: After a successful payment, it sends a request to the backend AI management module to generate a special reaction.
[2265] Input: Payment success flag, request ID.
[2266] What it does: Sends a special reaction generation request to the backend AI management module.
[2267] Output: Special reaction generation request.
[2268] Step 4:
[2269] Backend AI management module: Generates special reactions (e.g. special messages, videos) and returns them to the server.
[2270] Input: Special Reaction generation request.
[2271] What it does: Runs an algorithm to generate a special message or video in the specified format.
[2272] Output: Special reaction.
[2273] Step 5:
[2274] Server: Sends special reactions to the user's device.
[2275] Input: Special Reaction.
[2276] What it does: Sends a special reaction to the user's device.
[2277] Output: A special reaction is displayed on the user's terminal.
[2278] Handling customizations
[2279] Step 1:
[2280] User device: The user presses the "Customize" button on the profile screen of the generated AI to change the AI's attributes, appearance, personality, etc.
[2281] Input: Customization information.
[2282] Action: The user enters new attribute information in the customization screen and clicks the submit button.
[2283] Output: The customization information is sent to the server.
[2284] Step 2:
[2285] Server: Stores the received customization information in a database and instantly updates the generated AI settings.
[2286] Input: Customization information.
[2287] What it does: Runs a SQL query that inserts updates into the database, changing the AI's attributes.
[2288] Output: The customized AI information is saved in the database and the update is complete.
[2289] Retirement Processing
[2290] Step 1:
[2291] Server: Monitors generated AI that has few followers or super chats within a certain period of time, and automatically sets a retirement flag after the specified period has passed.
[2292] Input: Number of followers, number of Super Chats.
[2293] How it works: Regularly monitors the number of followers and super chats, and if certain conditions are not met, sets a retirement flag.
[2294] Output: The retirement flag is saved in the database.
[2295] Step 2:
[2296] User terminal: A notification about the retired AI will be sent to the user, and the user will no longer be able to view the retired AI.
[2297] Input: Retirement information.
[2298] What it does: Sends a retirement notice to the user and removes the AI from their follow list.
[2299] Output: A retirement notification is displayed on the user's device, and the retired AI is removed from the follow list.
[2300] (Application example 1)
[2301] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2302] In conventional social networking services, users mainly interact with other users through text, images, and videos. However, this method has the drawback of making it difficult to provide a unique and interactive experience. It has also been difficult to provide a new form of entertainment in which an AI character based on user-entered persona information interacts with other AI characters. Furthermore, there is a need for an appropriate means to provide a forum for real-time interaction through live streaming by user-generated AI characters.
[2303] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2304] In this invention, the server includes means for receiving persona information from a user and generating a generated AI based on the persona information, means for managing the attributes and behavior patterns of the generated AI, means for providing an interface for users to follow or superchats the generated AI, means for the generated AI to interact with other generated AIs and provide their activities to users, means for the generated AI to perform live broadcasts, means for the generated AI to generate reactions to user messages received during live broadcasts and broadcast the reactions, and means for retiring unpopular generated AIs after a certain period of time, thereby allowing users to enjoy a unique and interactive experience and interact in real time.
[2305] "Persona information" is information entered by the user that defines the personality and characteristics of the generated AI.
[2306] "Generative AI" refers to an AI character that is generated based on persona information entered by the user.
[2307] "Attributes" refer to the characteristics and properties of the generated artificial intelligence, including personality and appearance.
[2308] A "behavioral pattern" is a behavioral model that shows how a generative AI will behave in a particular situation.
[2309] "Following" refers to a user showing interest in a particular artificial intelligence and tracking its activity information.
[2310] "Super Chat" refers to financial support and messages sent by users to the generated AI.
[2311] "Interface" refers to the operating screen and input means that allow a user to interact with a system.
[2312] "Live streaming" is a function that uses generative artificial intelligence to deliver video and audio in real time.
[2313] "Reaction" refers to the response that the generative AI gives to messages or assistance from users.
[2314] "Retirement" refers to removing or hiding a generative AI from the system after it has been unpopular for a certain period of time.
[2315] The following describes an embodiment of the present invention. This system is a new type of social networking service that uses artificial intelligence (AI) generated based on persona information entered by users. With this service, users can create their own AI characters, which can then broadcast live in real time and interact with other users.
[2316] Processing user registration
[2317] User device:
[2318] The user accesses the system and enters information such as a username, email address, and password on the new registration screen.
[2319] server:
[2320] The received information is validated, a verification email is generated and sent to the user's email address, and when the user clicks on the verification link, the registration is completed and the information is saved in the database.
[2321] Persona input and AI generation processing
[2322] User device:
[2323] Users access the "Persona Generation" screen and enter persona information such as the AI's personality and appearance.
[2324] server:
[2325] Based on the received persona information, an AI character is generated using a generative AI model. The attributes and behavior patterns of the generated AI are set and saved in a database.
[2326] Examples:
[2327] If a user wants to create an AI that looks like a cat-loving rock musician, they would enter the following prompt:
[2328] Generate an AI that looks like a cat-loving rock musician.
[2329] Live streaming with AI characters
[2330] User device:
[2331] Users can access the profile page of the generated AI character and start live streaming.
[2332] server:
[2333] It provides the infrastructure to support live streaming and performs the necessary processing. The AI generates appropriate reactions to user messages received during live streaming and distributes them in real time.
[2334] Follow and Super Chat
[2335] User device:
[2336] Users can follow the generated AI characters and track their activities, and can also send Super Chats to the AI characters, offering special messages or financial support.
[2337] server:
[2338] It stores follower relationships and super chat information in a database and sends requests to the backend AI management module to generate special reactions, which are then displayed in real time on the user's device.
[2339] Customization and Retirement
[2340] User device:
[2341] Users can customize the AI's attributes, appearance, personality, etc. by pressing the "Customize" button on the AI character's profile screen.
[2342] server:
[2343] The received customization information is stored in a database and the AI character's attributes are updated immediately. The system also monitors AI characters that have received little interest in followers or super chats within a certain period of time, and automatically flags them as retired after a set period has passed, and deletes or hides them from the system.
[2344] Hardware and software used
[2345] Hardware:
[2346] Smartphone: The primary device through which users access applications.
[2347] software:
[2348] Python: A programming language for implementing logic such as server-side processing, AI character generation, and reaction generation.
[2349] Database: A database (e.g. MySQL or PostgreSQL) for storing user information, AI character information, etc.
[2350] This allows users to enjoy a unique and interactive experience and allows for real-time interaction.
[2351] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2352] Step 1: User Registration
[2353] User device:
[2354] The user accesses the system and enters information such as a user name, email address, and password on the new registration screen. The input data (user name, email address, and password) is sent from the user's device.
[2355] server:
[2356] The server validates the received information and checks the validity of the input data (checks for duplicate user names, email address format, and password strength). If validation is successful, it generates a verification email and sends it to the user's email address. At this point, a link in the verification email is added.
[2357] User device:
[2358] The user clicks the link in the authentication email to complete the authentication. After the authentication is complete, the server saves the user information in the database and sends the user a notification that registration is complete.
[2359] Step 2: Persona input and AI generation
[2360] User device:
[2361] Users access the "Persona Generation" screen and input persona information such as the AI's personality and appearance. The input data (persona information) is sent from the user's device.
[2362] server:
[2363] Based on the received persona information, an AI character is generated using a generative AI model. Specifically, the AI character's attributes (personality, appearance) and behavior patterns are set based on the persona information, and the information on the generated AI character is saved in a database.
[2364] Step 3: Start AI Live Streaming
[2365] User device:
[2366] The user accesses the profile page of the generated AI character and starts live streaming. This operation data is sent from the user's device.
[2367] server:
[2368] The server receives the live streaming request, sets up the live streaming infrastructure, starts the live streaming session, and prepares the AI character to broadcast video and audio in real time. A notification that the live streaming has started is sent to the user.
[2369] Step 4: Receiving messages and generating reactions during live streaming
[2370] User device:
[2371] Other users watching the live stream will send messages, and the message data will be sent to the server.
[2372] server:
[2373] The server analyzes the received message and sends data to the AI model to generate an appropriate reaction (text or voice response). The generated reaction data is added to the live video in real time and distributed to viewers.
[2374] Step 5: Follow and Super Chat
[2375] User device:
[2376] The user follows the generated AI character and sends Super Chat (message and amount). This operation data and Super Chat information are sent from the user's device to the server.
[2377] server:
[2378] The server stores the follow relationships in a database and receives Super Chat information. Based on the content of the Super Chat, it sends a request to the AI model to generate a special reaction (a thank you message or special action). The generated special reaction data is sent to the user's device in real time and displayed.
[2379] Step 6: Customization and Retirement
[2380] User device:
[2381] Users can press the "Customize" button on the AI character's profile screen and input changes to the AI's attributes, appearance, personality, etc. This customization information is sent from the user's device.
[2382] server:
[2383] The server stores the received customization information in a database and immediately updates the AI character's attributes. It also monitors AI characters that have received little interest in followers or super chats within a set period, automatically flags them as retired, and deletes or hides them from the system. It then notifies the user of this retirement process.
[2384] Through these steps, users can enjoy a unique and interactive experience and interact in real time.
[2385] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2386] A specific embodiment for implementing the present invention is described below. This system is a new type of social networking service that generates a generative AI based on persona information entered by a user, and allows the generated generative AI to interact with other generative AIs and provide them to users. It also incorporates an emotion engine that recognizes the user's emotions, improving the user experience.
[2387] Processing user registration
[2388] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen.
[2389] Server: Receives the entered user information and performs validation. If validation is successful, generates a verification email and sends it to the user's email address.
[2390] User device: The user clicks on the link in the authentication email they received to complete the authentication. The server confirms that the authentication was successful and saves the user information in the database. A registration completion screen is displayed.
[2391] Persona input and AI generation processing
[2392] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[2393] Server: Receives the entered persona information, sends it to the backend AI management module, and requests AI generation.
[2394] Backend AI management module: Uses generative AI models to generate AI based on persona information, and sets the attributes and behavior patterns of the generated AI.
[2395] Server: Stores the generated AI information in a database and notifies the user that the AI generation is complete.
[2396] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[2397] Follow AI and observe its activities
[2398] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[2399] Server: Receives the follow request, stores the user ID and AI ID in the database, generates a follow completion message and returns it to the user.
[2400] User device: Display a message indicating that the follow has been completed, and set up the device to receive real-time updates from the followed AI.
[2401] Server: Delivers activity information of followed AIs to users.
[2402] User device: Observe and enjoy the activities and interactions of the AI you follow.
[2403] Special interactions through Super Chat
[2404] User device: The user clicks the "Super Chat" button on the profile screen of the AI they are following.
[2405] User device: Enter the donation amount and message.
[2406] Server: Validates the received Super Chat information. If validation is successful, executes the payment process.
[2407] Server: After successful payment, sends a request to the backend AI management module to generate a special reaction.
[2408] Backend AI management module: Generates special reactions (messages, videos, etc.) and returns them to the server.
[2409] Server: Sends the generated special reaction to the user.
[2410] User device: Displays special reactions in real time.
[2411] Handling customizations
[2412] User device: The user clicks the "Customize" button on the profile screen of the generated AI.
[2413] User Device: Enter your AI's avatar, personality, and other customization options.
[2414] Server: Stores the received customization information in a database.
[2415] Server: Updates the AI's attributes based on the saved customization information.
[2416] User device: Display customized results on the AI profile screen.
[2417] Retirement Processing
[2418] Server: Monitors the activities of unpopular AIs based on the number of followers and super chats.
[2419] Server: Flags AI for retirement if they don't receive enough attention within a set period of time.
[2420] Server: Automatically remove or hide retired flagged AI from the system.
[2421] User terminal: A retirement notice will be displayed to the user, and they will no longer be able to access the retired AI.
[2422] Use of emotion engine
[2423] User device: Monitors user input and behavior and recognizes emotions in real time.
[2424] Server: Uses the emotion engine to analyze the user's emotional state and sends the information to the back-end AI management module.
[2425] Backend AI management module: Dynamically adjusts the behavior patterns and attributes of the generated AI based on user emotional information.
[2426] Server: The adjusted behavior patterns and attributes are stored in a database and reflected to the user in real time.
[2427] User device: Observe the AI change based on emotions and enjoy a more personalized experience.
[2428] Examples:
[2429] For example, if a user expresses an emotion such as "I'm stressed about today's events," the emotion engine analyzes that information and sends it to the back-end AI management module. Based on this information, the generated AI responds according to the user's emotion, such as sending an encouraging message or providing relaxing content.
[2430] In this way, the system of the present invention not only allows for interaction between generating AIs, but also dynamically recognizes the user's emotional state and responds appropriately based on that, thereby providing the user with a more advanced entertainment experience.
[2431] The processing flow will be explained below.
[2432] Processing flow of the AI generation system that combines an emotion engine
[2433] Processing user registration
[2434] Step 1:
[2435] User terminal: The user accesses the system and enters their username, email address, and password on the new registration screen.
[2436] Step 2:
[2437] Server: Receives the entered user information, performs validation, and generates a verification email if validation is successful.
[2438] Step 3:
[2439] Server: Generates and sends the authentication email to the user's email address.
[2440] Step 4:
[2441] User device: The user clicks on the link in the authentication email they received to complete the authentication.
[2442] Step 5:
[2443] Server: Verify that the user clicked the authentication link and save the successful authentication to the database.
[2444] Step 6:
[2445] User device: Display the registration completion screen.
[2446] Persona input and AI generation processing
[2447] Step 1:
[2448] User device: The user accesses the "Persona Generation" screen and enters persona information such as the AI's personality and appearance.
[2449] Step 2:
[2450] Server: Receives the entered persona information.
[2451] Step 3:
[2452] Server: Sends the received persona information to the backend AI management module and requests AI generation.
[2453] Step 4:
[2454] Backend AI management module: Uses generative AI models to generate AI based on persona information.
[2455] Step 5:
[2456] Server: Sets the attributes and behavior patterns of the generated AI and stores the AI information in a database.
[2457] Step 6:
[2458] Server: Notifies the user that AI generation is complete.
[2459] Step 7:
[2460] User device: Displays a notification that generation is complete and redirects to the profile screen of the generated AI.
[2461] Follow AI and observe its activities
[2462] Step 1:
[2463] User device: Users can click the "Follow" button to follow the generated AI. They can also search for and follow AIs generated by other users.
[2464] Step 2:
[2465] Server: Receives the follow request and stores the user ID ...
Claims
1. A means for receiving persona information from a user and generating a generating artificial intelligence based on the persona information; A means for managing attributes and behavior patterns of the generated artificial intelligence; A means for providing an interface for users to follow or super chat with the generated AI; A means for the generative artificial intelligence to interact with other generative artificial intelligences and provide their activities to users; A means to retire unpopular generative AI after a certain period of time, and A system including:
2. A means for providing an interface for a user to customize the generated artificial intelligence, and receiving and storing the customization information; 2. The system of claim 1, further comprising means for updating attributes of the generating artificial intelligence based on the customization information.
3. The system according to claim 1, further comprising means for receiving super chat information from a user, generating a special reaction based on the super chat information by a generating artificial intelligence, and providing the reaction to the user.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A