system

Abstract

Provide a system. A means for registering artist information in a database; means for receiving a search query from a user; means for extracting artist information based on the search query; The system includes a means for presenting the extracted artist information to a user.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's world, there is a lack of effective platforms to promote interactive communication between artists and fans. Traditional methods make it difficult for fans to access the latest information about artists and communicate directly with them, while artists have limited means to effectively deliver promotional information to fans. To solve these problems, a comprehensive system is needed that enables two-way communication between fans and artists and supports artists' promotional activities. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means. First, it provides a means for registering artist information in a database, and when a user inputs a search query, it provides related information based on that artist information. It also includes a means for receiving messages from users and, based on those messages, generating and sending reply messages that are in line with the artist's personality, so that users can interact directly with the artist. It also includes a means for artists to input new promotional information, store it in the database, and notify related users of that information. In this way, it provides a comprehensive system that promotes interactive exchanges between fans and artists and supports artists' promotional activities.

[0006] "Artist Information" means unique data related to an artist, including their name, photo, concert dates, merchandise information, and other details of interest to fans.

[0007] A "user" is an individual who uses the system to search for artist information and interact with artists.

[0008] A "search query" is a question or keyword that a user enters to obtain specific information about an artist.

[0009] "Database" means a storage device or system for efficiently storing, managing, and retrieving artist and promotional information.

[0010] A "message" is a textual communication sent by a user to an artist.

[0011] A "reply message" is a response to a message from a user, and is a text-format communication content generated based on the artist's character.

[0012] "Promotion information" refers to marketing-related information such as concerts, events, and merchandise sales that an artist wants to promote to their fans.

[0013] "Notifications" are messages sent to inform users of new promotions or important announcements. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The present invention is a system for promoting interaction between artists and fans and for effectively promoting artists. This system links a server and terminals to realize two-way communication between users and artists.

[0036] System Configuration

[0037] The system has five main functions: user registration, artist registration, searching for artist information, interacting with favorite artists, and promotion management.

[0038] 1. User Registration

[0039] The user enters basic information into an account creation form, which the device then sends to the server.

[0040] The server analyzes the received user information, generates a unique user_id, and stores it in the database.

[0041] 2. Artist registration

[0042] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the terminal sends this to the server.

[0043] The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[0044] 3. Search for artist information

[0045] When a user searches for information about an artist, the device sends a search query (e.g., "upcoming concerts") to the server.

[0046] The server retrieves artist information from a database and uses an AI model based on the search query to extract relevant information.

[0047] The extracted information is sent to the terminal and presented to the user.

[0048] Examples:

[0049] If a user wants to know about upcoming concerts by "Jane Smith," they enter the search query "upcoming concerts."

[0050] The device sends this query and the artist ID to the server, which retrieves information about "Jane Smith" from its database, searches for concert information using an AI model, and sends it back to the device.

[0051] The terminal displays the results to the user.

[0052] 4. Conversation with your idol

[0053] When a user sends a message to an artist, the device sends the message and the artist ID to the server.

[0054] The server receives the message and generates a reply message using an AI model based on the artist information.

[0055] The generated reply message is sent to the terminal and displayed to the user.

[0056] Examples:

[0057] If the user wants to send a message to "Jane Smith" saying "I love your latest album!", the device sends this to the server.

[0058] The server retrieves information about "Jane Smith" from the database and uses an AI model to generate a response: "Thank you for your message! I'm glad you liked it!"

[0059] The server sends the generated response to the terminal for display to the user.

[0060] 5. Promotion Management

[0061] The artist enters promotional information (such as new concert or new product information), and the device sends this to the server.

[0062] The server stores the received promotional information in a database and sends notifications to relevant fans.

[0063] The terminal that receives the notification displays the promotion information to the user.

[0064] Examples:

[0065] Artists register new concert information on the platform.

[0066] The device sends this to the server, which stores the information in a database.

[0067] The server sends notifications to relevant users, and the terminals display new concert information to the users.

[0068] In this way, the present invention provides a system that allows interactive exchange between fans and artists and enables artists to efficiently carry out promotional activities.

[0069] The processing flow will be explained below.

[0070] User registration process steps

[0071] Step 1:

[0072] A user fills out an account creation form with required information, such as name, email address, and password.

[0073] Step 2:

[0074] The terminal packages the input information and sends it to the server via an HTTP request.

[0075] Step 3:

[0076] The server analyzes the received user information and generates a unique user_id.

[0077] The server saves the user information in the user_database and generates a successful registration message.

[0078] Step 4:

[0079] The server sends the generated registration success message to the terminal as an HTTP response.

[0080] The terminal receives the registration success message and displays it to the user.

[0081] Artist registration process steps

[0082] Step 1:

[0083] Artists enter necessary information such as their name, concert dates, and merchandise information into the account creation form.

[0084] Step 2:

[0085] The device packages the entered artist information and sends it to the server via an HTTP request.

[0086] Step 3:

[0087] The server parses the received artist information and generates a unique artist_id.

[0088] The server saves the artist information in the artist_database and generates a message confirming successful registration.

[0089] Step 4:

[0090] The server sends the generated registration success message to the terminal as an HTTP response.

[0091] The device receives a registration success message and displays it to the artist.

[0092] Artist information search processing steps

[0093] Step 1:

[0094] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[0095] Step 2:

[0096] The device packages the search query and the artist ID and sends it to the server via an HTTP request.

[0097] Step 3:

[0098] The server receives the search query and the artist ID and extracts the corresponding artist data from the artist database.

[0099] Step 4:

[0100] The server passes the extracted artist information to an AI model to generate relevant information for the search query.

[0101] The server transmits the generated related information to the terminal as an HTTP response.

[0102] Step 5:

[0103] The terminal receives the relevant information and displays it to the user.

[0104] Steps for processing conversations with your favorite idol

[0105] Step 1:

[0106] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[0107] Step 2:

[0108] The device packages the input message and the artist ID and sends it to the server via an HTTP request.

[0109] Step 3:

[0110] The server receives the message and the artist ID and extracts the artist's data from the artist database.

[0111] Step 4:

[0112] The server passes the extracted artist information to an AI model, which generates a reply message based on the artist's character.

[0113] The server sends the generated reply message to the terminal as an HTTP response.

[0114] Step 5:

[0115] The terminal receives the reply message and displays it to the user.

[0116] Promotion Management Process Steps

[0117] Step 1:

[0118] Artists enter promotional information (new concerts, merchandise information, etc.).

[0119] Step 2:

[0120] The terminal packages the entered promotion information and sends it to the server via an HTTP request.

[0121] Step 3:

[0122] The server receives the promotional information and stores it in an artist database.

[0123] Step 4:

[0124] The server matches the stored promotional information with the associated fan's user profile and generates the notification.

[0125] Step 5:

[0126] The server sends the generated notification to the device as an HTTP response.

[0127] Step 6:

[0128] The terminal receives the notification and displays the promotion information to the user.

[0129] Through these processing steps, LuvChat efficiently enables interactive communication between fans and artists and supports artists' promotional activities.

[0130] Example 1

[0131] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0132] In recent years, two-way communication between artists and fans has become increasingly important, but existing systems often make it difficult to achieve this. In particular, there is a lack of mechanisms for fans to send messages directly to artists or efficiently receive promotional information from artists. Furthermore, technology for effectively searching and extracting information registered in databases is also immature. A system that solves these problems and facilitates smooth interaction between artists and fans is needed.

[0133] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0134] In this invention, the server includes means for registering user information in a database, means for receiving user information input from a computer terminal, means for generating a unique identifier from the received user information, means for saving the identifier in a database, means for registering artist information in a database, means for receiving a search query from a user, means for using a generative AI model to extract related artist information based on the search query, means for presenting the extracted artist information to the user, means for receiving a message from the user, means for using a generative AI model to generate a reply message based on the artist's character based on the received message, means for sending the generated reply message to the user, means for the artist to input promotional information, means for saving the promotional information in a database, and means for notifying related users of the saved promotional information. This facilitates two-way communication between artists and fans and enables effective promotional activities.

[0135] The "user information registration means" is a function for storing basic information about a user in a database.

[0136] The "means for receiving information from a computer terminal" is a function for transmitting information entered by a user or artist to a server.

[0137] The "identifier generating means" is a function for generating a unique identification number from received user and artist information.

[0138] The "database storage means" is a function for storing the generated identifier and related information in a database.

[0139] The "artist information registration means" is a function for storing information provided by artists in a database.

[0140] The "search query receiving means" is a function that enables the server to receive a search request from a user.

[0141] "Means for extracting information using a generative AI model" is a function for processing and extracting relevant information using an AI model based on a search query.

[0142] The "information presentation means" is a function for displaying the extracted information to the user.

[0143] The "message receiving means" is a function that allows the server to receive messages sent by users.

[0144] "Means for generating replies using an AI model" is a function for generating reply messages using an AI model based on artist information.

[0145] The "reply sending means" is a function for sending the generated reply message to the user.

[0146] The "promotion information input means" is a function that allows artists to input new promotion information.

[0147] The "promotion information storage means" is a function for storing input promotion information in a database.

[0148] The "promotion information notification means" is a function for notifying related users of the saved promotion information.

[0149] This invention provides a system for promoting interaction between artists and fans and for efficiently promoting artists. The system links a server and terminals to realize two-way communication between users and artists. The system configuration and operation method of this invention will be specifically described below.

[0150] Comprehensive System Configuration

[0151] The system's hardware consists mainly of a server and a terminal. The server is a computer system containing a database and a generative AI model, while the terminal is a personal computer or smartphone used by users and artists. The software used includes a database management system (e.g., MySQL (registered trademark), MongoDB), an AI model (e.g., GPT-3 (registered trademark)), and a web server (e.g., Apache (registered trademark), Nginx).

[0152] User Registration

[0153] 1. Enter and submit user information

[0154] The user enters basic information such as name, email address, and password, which is then sent from the device to the server.

[0155] Example: "Name: Yamada Taro", "Email address: taro@example.com", "Password: password123"

[0156] 2. Information analysis and data storage

[0157] The server analyzes the received user information, generates a unique identifier (user_id), and then stores the generated identifier and user information in a database.

[0158] Artist Registration

[0159] 1. Enter and submit the required information

[0160] The artist enters the necessary information, such as their name, concert dates, and merchandise information, and sends it from their terminal to the server.

[0161] Example: "Name: Artist A", "Concert date: 2023-12-01", "Merchandise information: New album"

[0162] 2. Information analysis and data storage

[0163] The server analyzes the received artist information, generates a unique identifier (artist_id), and then stores the generated identifier and artist information in a database.

[0164] Search for artist information

[0165] 1. Enter and submit a search query

[0166] A user inputs a query to search for information about an artist and sends it from the terminal to the server.

[0167] Example: "upcoming concerts"

[0168] 2. Information extraction and result display

[0169] The server retrieves relevant artist information from the database and uses a generative AI model to extract information based on the search query, which is then sent to the device and presented to the user.

[0170] Conversation with your favorite idol

[0171] 1. Enter and send a message

[0172] The user inputs a message to be sent to the artist and sends it from the terminal to the server.

[0173] Specific example: “I love your latest album!”

[0174] 2. Reply generation and result display

[0175] The server uses a generative AI model (e.g., GPT-3) based on the received message to generate a reply message based on the artist's character. The generated reply message is sent to the device and displayed to the user.

[0176] Promotion Management

[0177] 1. Enter and submit promotional information

[0178] Artists input promotional information such as new concert and new product information and send it from their terminals to the server.

[0179] Example: "New concert information"

[0180] 2. Information storage and notification

[0181] The server stores the received promotion information in a database and then sends a notification to the relevant fans, who then receive the notification and display the promotion information to the user.

[0182] Prompt Sentence Examples

[0183] Below are some example prompts to input to a generative AI model:

[0184] "Show me the next concert"

[0185] "Generate a reply to this message"

[0186] This system will facilitate two-way communication between artists and fans, enabling artists to carry out promotional activities more effectively.

[0187] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0188] User Registration

[0189] Step 1:

[0190] A user fills out an account creation form with basic information such as name, email address, and password.

[0191] Specific actions: Enter the required information into the form on your browser and click the "Register" button.

[0192] Input: Name, email address, and password entered by the user

[0193] Output: JSON format user information sent by the device to the server

[0194] Step 2:

[0195] The terminal transmits the input information to the server.

[0196] Specific operation: When the form is submitted, a JavaScript (registered trademark) AJAX request is used to send user information in JSON format to the server.

[0197] Input: User information entered into the terminal

[0198] Output: User information received by the server in JSON format

[0199] Step 3:

[0200] The server analyzes the received user information and generates a unique identifier (user_id).

[0201] Specific operation: Using a program such as Python or Java (registered trademark), the received data is parsed and a unique ID is generated using a hash function, etc.

[0202] Input: User information in JSON format

[0203] Output: Generated user_id

[0204] Step 4:

[0205] The server stores the generated identifier and the user information in a database.

[0206] Specific operation: Uses SQL INSERT queries to write data to MySQL, MongoDB, etc.

[0207] Input: Generated user_id and user information

[0208] Output: User information stored in the database

[0209] Artist Registration

[0210] Step 1:

[0211] The artist enters the necessary information, such as name, concert dates, and merchandise information, into the artist registration form.

[0212] Specific actions: Fill out the required information in the dedicated form and click the "Register" button.

[0213] Input: Artist name, concert dates, merchandise information

[0214] Output: Artist information in JSON format sent by the device to the server

[0215] Step 2:

[0216] The terminal transmits the input information to the server.

[0217] Specific behavior: When the form is submitted, an AJAX request is used to send the artist information in JSON format to the server.

[0218] Input: Artist information entered on the device

[0219] Output: Artist information in JSON format as received by the server

[0220] Step 3:

[0221] The server analyzes the received artist information and generates a unique identifier (artist_id).

[0222] Specific behavior: Parse the received data and generate a unique ID.

[0223] Input: Artist information in JSON format

[0224] Output: Generated artist_id

[0225] Step 4:

[0226] The server stores the generated identifier and the artist information in a database.

[0227] Specific operation: Writes data to the database using an SQL INSERT query.

[0228] Input: Generated artist_id and artist information

[0229] Output: Artist information stored in the database

[0230] Search for artist information

[0231] Step 1:

[0232] A user enters a query to search for information about an artist.

[0233] Specific actions: Enter a keyword (e.g., "upcoming concerts") in the search bar and click the "Search" button.

[0234] Input: Search query

[0235] Output: The search query sent by the device to the server

[0236] Step 2:

[0237] The terminal transmits the input search query to the server.

[0238] What it does: Sends a search query to the server using an AJAX request.

[0239] Input: Search query entered into the device

[0240] Output: The search query received by the server

[0241] Step 3:

[0242] The server retrieves the relevant artist information from the database.

[0243] Specific behavior: Retrieves data using an SQL query.

[0244] Input: Search query

[0245] Output: Artist information retrieved from the database

[0246] Step 4:

[0247] The server uses a generative AI model to extract relevant information based on the acquired artist information.

[0248] Specific operation: Enter a prompt sentence into an AI model (e.g., GPT-3) built using Python or other language to extract information.

[0249] Input: Retrieved artist information

[0250] Output: Relevant information extracted by the AI ​​model

[0251] Step 5:

[0252] The server transmits the extracted information to the terminal and presents it to the user.

[0253] Specific operation: Sends JSON format data to the device and displays the information in HTML.

[0254] Input: Relevant information extracted by the AI ​​model

[0255] Output: Information displayed on the terminal

[0256] Conversation with your favorite idol

[0257] Step 1:

[0258] The user enters a message to send to the artist.

[0259] Specific behavior: Enter text in the message input field and click the "Send" button.

[0260] Input: Message text (e.g. "I love your latest album!")

[0261] Output: Message text that the terminal sends to the server

[0262] Step 2:

[0263] The device sends the message and the artist ID to the server.

[0264] Specific behavior: Sends a message to the server via an AJAX request.

[0265] Input: Message text and artist ID entered on the device

[0266] Output: Message text and artist ID received by the server

[0267] Step 3:

[0268] The server receives the message and generates a reply message using a generative AI model based on the artist information.

[0269] Specific operation: The message "Generate a reply to this message" is input as a prompt to an AI model (e.g., GPT-3), and a reply is generated.

[0270] Input: Message text and artist information

[0271] Output: The generated reply message

[0272] Step 4:

[0273] The server sends the generated reply message to the terminal and displays it to the user.

[0274] Specific operation: A reply message in JSON format is sent to the device and displayed on the chat screen.

[0275] Input: The generated reply message

[0276] Output: Reply message displayed on the terminal

[0277] Promotion Management

[0278] Step 1:

[0279] Artists enter promotional information such as new concerts and new product information.

[0280] Specific actions: Enter information into the promotion information input form and click the "Submit" button.

[0281] Input: Promotion information (e.g. new concert information)

[0282] Output: Promotion information sent by the device to the server

[0283] Step 2:

[0284] The terminal transmits the promotion information to the server.

[0285] Specific behavior: Sends information to the server via AJAX request.

[0286] Input: Promotion information entered into the device

[0287] Output: Promotion information received by the server

[0288] Step 3:

[0289] The server stores the received promotion information in a database.

[0290] Specific behavior: Saves to the database using an SQL INSERT query.

[0291] Input: Promotion information

[0292] Output: Promotion information stored in the database

[0293] Step 4:

[0294] The server sends a notification to the relevant user.

[0295] Specific behavior: Sends a push notification using the notification subscription information.

[0296] Input: Saved Promotion Information

[0297] Output: Notification displayed on the user's device

[0298] Step 5:

[0299] The user receives the notification and checks the promotion information.

[0300] What it does: Displays promotional information in the device's notification area and provides a link to learn more.

[0301] Input: Notification from the server

[0302] Output: A link to the promotion details that will be displayed on the device

[0303] (Application example 1)

[0304] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0305] In today's world, there is a need for direct interaction between artists and fans, and for artists to effectively promote themselves by utilizing physical stores. However, traditional methods have not fully realized the provision of artist information, real-time interaction with fans, or notifications of promotional activities. For this reason, a system is needed to deepen the relationship between artists and fans and maximize the effectiveness of promotions in physical stores.

[0306] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0307] In this invention, the server includes means for registering artist information in a database, means for receiving a search query from a user, means for extracting artist information based on the search query, means for presenting the extracted artist information to the user, means for searching for artist information in a physical store, means for sending a message to an artist through a display installed in the physical store, and means for notifying promotional information through a display in the physical store. This not only enables interaction between artists and fans in the physical store, but also enables effective promotional activities for artists.

[0308] "Artist information" is data including basic information about the artist, activity information, event schedules, promotional information, and the like.

[0309] "Database" means a digital data management system for storing artist information, user information, and message and promotional information.

[0310] A "search query" is a search string or keyword that a user enters to obtain artist information.

[0311] "Extraction" is the act of retrieving relevant information from a database based on a specific search query.

[0312] A "brick and mortar store" is a physical location where fans can find information about and interact with artists.

[0313] A "display" is a display device installed in a physical store to display artist information and promotional information.

[0314] A "Message" is a text or other form of communication sent by a User to an Artist.

[0315] "Promotional information" refers to information advertising new products, events, services, etc. that artists provide to their fans.

[0316] "Server" means a computer system for processing and managing artist information, user information, messages, and promotional information.

[0317] The "search query receiving means" is a function that enables the server to receive a search query from a user.

[0318] The "means for presenting artist information" is a means for displaying the extracted artist information to the user.

[0319] A "means for sending messages" is a means for sending user-generated text or other forms of communication to a server.

[0320] The "means for notifying promotion information" is a means for notifying related users of the stored promotion information.

[0321] This invention is a system for promoting interaction between artists and fans and effectively promoting artists in physical stores. The system has five main functions: registering artist information, receiving search queries from users, extracting and presenting artist information, interacting with fans in physical stores, and managing promotions.

[0322] 1. Registering artist information

[0323] The server has a means for registering artist information in a database. Information entered by the artist (such as name, event schedule, and promotion information) is sent from the terminal to the server, and the server stores it in the database. For example, if an artist enters "new concert information," the information is stored in the database and used to notify related users.

[0324] 2. Receiving a search query from a user

[0325] The server has a means for receiving a search query from a user. For example, when a user inputs a query to search for "concert information this weekend," the search query is sent from the terminal to the server. The server extracts related artist information from the database based on the search query.

[0326] 3. Extracting and presenting artist information

[0327] The server has a means for extracting artist information based on the search query and a means for presenting the extracted artist information to the user. For example, if a user searches for "pop singer's next concert information," the server extracts relevant information from the database and presents it to the user via the terminal. This allows the user to quickly obtain the artist information they are looking for.

[0328] 4. Interacting with fans in physical stores

[0329] The server has a means for sending messages to artists through displays installed in physical stores. Users visiting the physical stores can use the displays to send messages to artists. The received messages are processed by the server, and a generative AI model is used to generate a reply message based on the artist's character and send it to the user. For example, if a user sends a message saying, "I love your new song!", the server generates a reply such as, "Thank you! Please continue to support us!" and displays it to the user.

[0330] 5. Promotion Management

[0331] The server stores promotional information in a database and notifies relevant users. When an artist enters information about a new product, the information is stored in the database and notified to users. For example, when an artist registers a "new album release," the server sends a notification to relevant fans and displays the information on displays in stores and on users' terminals.

[0332] Examples of concrete examples and prompts

[0333] User Registration

[0334] Example: A user enters a username and email address to create their account.

[0335] Example prompt: Username: Fantaro, Email address: fan@example.com

[0336] Artist Registration

[0337] Example: A store manager registers artists for an in-store event.

[0338] Example prompt: Artist name: Pop singer, Information: Popular pop artist

[0339] Search for artist information

[0340] Example: Searching for event information for a specific artist within the app.

[0341] Example prompt: Search query: Upcoming concert information

[0342] Conversation with your favorite idol

[0343] Example: Users can send messages of support to artists through displays in stores.

[0344] Example prompt: Message: I love your new album!

[0345] Promotion Management

[0346] Example: Notifying fans of your store about new merchandise.

[0347] Example prompt: Promotion: Our new album is now on sale!

[0348] The above system will enable interactive interaction between artists and fans, and will enable effective promotional activities in physical stores.

[0349] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0350] Step 1:

[0351] User Registration

[0352] The device receives basic information entered by the user, such as a username and email address, and sends it to a server, which analyzes the information and generates a unique user ID, which is then stored in a database.

[0353] Input: Username, Email Address

[0354] Output: Unique user ID

[0355] What happens: A user enters information into an account creation form and presses the submit button. The device packages this information into a packet and sends it to the server as an HTTP request. The server analyzes the information, generates a new user ID, and stores it in a database.

[0356] Step 2:

[0357] Artist information registration

[0358] The server receives information entered by the artist (such as name, event schedule, and promotional information) from the device and stores it in a database. A unique artist ID is assigned to the artist information.

[0359] Input: Artist name, event schedule, promotion information

[0360] Output: Unique artist ID

[0361] Specific operation: The artist fills out the information form through the device and presses the submit button. The device sends the information to the server as an HTTP request. The server analyzes the information, generates a new artist ID, and saves it in the database.

[0362] Step 3:

[0363] Search for artist information

[0364] A user inputs a search query into a terminal and sends it to the server, which extracts relevant artist information from a database based on the received search query.

[0365] Input: Search query (e.g. "Upcoming concert information")

[0366] Output: Artist information as search results

[0367] Specific operation: The user enters a search query on the device and presses the search button. The device sends the search query to the server. The server uses a search algorithm to extract relevant artist information from the database.

[0368] Step 4:

[0369] View artist information

[0370] The server transmits the extracted artist information to the terminal and displays it to the user, who can then view the artist information as a search result on the terminal.

[0371] Input: Extracted artist information

[0372] Output: Artist information displayed on the user's device

[0373] Specific operation: The server sends the extracted artist information to the device as an HTTP response. The device analyzes this information and displays it in a user-friendly format.

[0374] Step 5:

[0375] Conversation with your favorite idol

[0376] The user inputs the message content into the device and sends it to the server, which uses the generative AI model based on the received message to generate a reply message based on the artist's character.

[0377] Input: User's message

[0378] Output: The generated reply message

[0379] How it works: A user types a message into their device and presses the send button. The device then sends the message to the server, which uses a generative AI model (e.g., GPT-3) to generate an artistic reply.

[0380] Step 6:

[0381] Displaying reply messages

[0382] The server sends the generated reply message to the terminal and displays it to the user, who can then view the reply message from the artist on the terminal.

[0383] Input: The generated reply message

[0384] Output: Reply message displayed on the user's terminal

[0385] Specific operation: The server generates a reply message and sends it to the terminal as an HTTP response. The terminal analyzes this message and displays it to the user.

[0386] Step 7:

[0387] Entering and notifying promotional information

[0388] The artist inputs new promotion information into the terminal and sends it to the server, which stores the received promotion information in a database and notifies the relevant users.

[0389] Input: New promotion information

[0390] Output: Notifications sent to relevant users

[0391] Specific operation: The artist enters new promotion information and presses the send button. The device sends the information to the server. The server saves the promotion information in the database and sends notifications to relevant users.

[0392] Step 8:

[0393] View promotion information

[0394] The server transmits the notified promotion information to the terminal and displays it to the user, who can then view the new promotion information on the terminal.

[0395] Input: Promotion information notified

[0396] Output: Promotion information displayed on the user's device

[0397] Specific operation: The server sends the promotion information to the terminal as an HTTP response. The terminal analyzes this information and displays it to the user.

[0398] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0399] This invention is a system for promoting interaction between artists and fans and for effectively promoting artists, and is characterized by the incorporation of an emotion engine that recognizes the emotions of users. This system links a server and terminals to realize two-way communication between users and artists.

[0400] System Configuration

[0401] The system has six main functions: user registration, artist registration, artist information search, interaction with favorite artists, promotion management, and emotion recognition.

[0402] 1. User Registration

[0403] The user enters basic information into an account creation form, which the device then sends to the server.

[0404] The server analyzes the received user information, generates a unique user_id, and stores it in the database.

[0405] 2. Artist registration

[0406] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the terminal sends this to the server.

[0407] The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[0408] 3. Search for artist information

[0409] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[0410] The device sends the search query and artist ID to the server.

[0411] The server retrieves artist information from a database and uses an AI model based on the search query to extract relevant information.

[0412] The extracted information is sent to the terminal and presented to the user.

[0413] Examples:

[0414] If a user wants to know about upcoming concerts by "Jane Smith," they enter the search query "upcoming concerts."

[0415] The device sends this query and the artist ID to the server, which retrieves information about "Jane Smith" from its database, searches for concert information using an AI model, and sends it back to the device.

[0416] The terminal displays the results to the user.

[0417] 4. Conversation with your idol

[0418] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[0419] The device sends the entered message and artist ID to the server.

[0420] The server receives the message and generates a reply message using an AI model based on the artist information.

[0421] The generated reply message is sent to the terminal and displayed to the user.

[0422] Examples:

[0423] If the user wants to send a message to "Jane Smith" saying "I love your latest album!", the device sends this to the server.

[0424] The server retrieves information about "Jane Smith" from the database and uses an AI model to generate a response: "Thank you for your message! I'm glad you liked it!"

[0425] The server sends the generated response to the terminal for display to the user.

[0426] 5. Promotion Management

[0427] The artist enters promotional information (such as new concert and merchandise information), and the device sends this to the server.

[0428] The server stores the received promotional information in a database and sends notifications to relevant fans.

[0429] The terminal that receives the notification displays the promotion information to the user.

[0430] Examples:

[0431] Artists register new concert information on the platform.

[0432] The device sends this to the server, which stores the information in a database.

[0433] The server sends notifications to relevant users, and the terminals display new concert information to the users.

[0434] 6. Emotion recognition

[0435] The emotion engine analyzes messages and search queries sent by users to recognize their emotions.

[0436] The server generates an appropriate reply message that is in line with the artist's character based on the recognized user's emotion.

[0437] The server customizes search results and promotional notifications based on the perceived sentiment.

[0438] Examples:

[0439] If a user sends a message saying "I am feeling down because I missed your last concert...", the terminal sends this to the server.

[0440] The server analyzes the message using an emotion engine and recognizes that the user's emotion is "sadness."

[0441] Based on the recognized emotion, the server generates a friendly reply message that is in keeping with the artist's character (e.g., "I'm sorry to hear that. I'll be performing again soon, and I hope to see you there!").

[0442] The server sends the generated reply message to the terminal and displays it to the user.

[0443] Through these processing steps, LuvChat efficiently facilitates interactive communication between fans and artists, supports artists' promotional activities, and provides more personalized communication through the use of an emotion engine.

[0444] The processing flow will be explained below.

[0445] User registration process steps

[0446] Step 1:

[0447] A user fills out an account creation form with required information, such as name, email address, and password.

[0448] Step 2:

[0449] The terminal packages the input information and sends it to the server via an HTTP request.

[0450] Step 3:

[0451] The server analyzes the received user information and generates a unique user_id.

[0452] The server saves the user information in the user_database and generates a successful registration message.

[0453] Step 4:

[0454] The server sends the generated registration success message to the terminal as an HTTP response.

[0455] The terminal receives the registration success message and displays it to the user.

[0456] Artist registration process steps

[0457] Step 1:

[0458] Artists enter necessary information such as their name, concert dates, and merchandise information into the account creation form.

[0459] Step 2:

[0460] The device packages the entered artist information and sends it to the server via an HTTP request.

[0461] Step 3:

[0462] The server parses the received artist information and generates a unique artist_id.

[0463] The server saves the artist information in the artist_database and generates a message confirming successful registration.

[0464] Step 4:

[0465] The server sends the generated registration success message to the terminal as an HTTP response.

[0466] The device receives a registration success message and displays it to the artist.

[0467] Artist information search processing steps

[0468] Step 1:

[0469] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[0470] Step 2:

[0471] The device packages the search query and the artist ID and sends it to the server via an HTTP request.

[0472] Step 3:

[0473] The server receives the search query and the artist ID and extracts the corresponding artist data from the artist database.

[0474] Step 4:

[0475] The server passes the extracted artist information to an AI model to generate relevant information for the search query.

[0476] The server transmits the generated related information to the terminal as an HTTP response.

[0477] Step 5:

[0478] The terminal receives the relevant information and displays it to the user.

[0479] Steps for processing conversations with your favorite idol

[0480] Step 1:

[0481] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[0482] Step 2:

[0483] The device packages the input message and the artist ID and sends it to the server via an HTTP request.

[0484] Step 3:

[0485] The server receives the message and the artist ID and extracts the artist's data from the artist database.

[0486] Step 4:

[0487] The server passes the extracted artist information to the emotion engine, which analyzes the user's emotions.

[0488] Step 5:

[0489] Based on the analysis results, the server generates a reply message that is in line with the artist's character.

[0490] The server sends the generated reply message to the terminal as an HTTP response.

[0491] Step 6:

[0492] The terminal receives the reply message and displays it to the user.

[0493] Promotion Management Process Steps

[0494] Step 1:

[0495] Artists enter promotional information (new concerts, merchandise information, etc.).

[0496] Step 2:

[0497] The terminal packages the entered promotion information and sends it to the server via an HTTP request.

[0498] Step 3:

[0499] The server receives the promotional information and stores it in an artist database.

[0500] Step 4:

[0501] The server matches the stored promotional information with the associated fan's user profile and generates the notification.

[0502] Step 5:

[0503] The server sends the generated notification to the device as an HTTP response.

[0504] Step 6:

[0505] The terminal receives the notification and displays the promotion information to the user.

[0506] Processing steps for emotion recognition

[0507] Step 1:

[0508] The user enters a message or search query and presses the send button.

[0509] Step 2:

[0510] The device packages the entered message or search query and sends it to the server via an HTTP request.

[0511] Step 3:

[0512] The server receives messages and search queries and passes them to the emotion engine.

[0513] The server obtains the analysis results from the emotion engine and recognizes the user's emotions.

[0514] Step 4:

[0515] The server generates appropriate reply messages and search results that are in line with the artist's character based on the recognized user's emotions.

[0516] The server sends the generated result to the terminal as an HTTP response.

[0517] Step 5:

[0518] The terminal receives the results and displays them to the user.

[0519] Through these processing steps, LuvChat efficiently facilitates interactive communication between fans and artists, supports artists' promotional activities, and provides more personalized communication through the use of an emotion engine.

[0520] Example 2

[0521] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0522] Conventional artist-fan interaction systems lacked personalized communication that took into account user emotions, and artist promotional activities were ineffective, resulting in low fan engagement with artists and limited promotional impact.

[0523] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0524] In this invention, the server includes means for registering artist information in a database, means for receiving search queries from users, means for extracting artist information based on the search queries, means for presenting the extracted artist information to users, means including an emotion recognition engine for analyzing user messages and search queries and recognizing emotions, and means for providing content based on the recognized emotions, thereby enabling personalized communication according to user emotions and effective promotional activities.

[0525] "Artist information" refers to information necessary for interacting with fans and promotional activities, such as the artist's name, concert dates, and merchandise information.

[0526] A "user search query" is a character string or keyword that a user enters when searching for artist information.

[0527] An "emotion recognition engine" is a technology that analyzes users' messages and search queries and determines their emotional state (e.g., joy, sadness, excitement, etc.) from their content.

[0528] A "unique ID" is a unique identifier that uniquely identifies each artist or user in the database.

[0529] "Content" refers to all information and messages provided to users, and specifically includes reply messages from artists, concert information, promotional information, and the like.

[0530] "Promotion information" refers to information about promotional activities that artists undertake to their fans, such as information about new concerts and merchandise.

[0531] A "user message" is a textual communication sent by a user to an artist.

[0532] A "reply message" is a response message generated by an artist or the system in response to a user's message.

[0533] The "means for receiving a search query" is a function that allows the system to obtain a search query entered by a user.

[0534] A "database" is an information system that systematically stores and manages data such as artist information and promotional information.

[0535] "Content provided based on emotions" refers to information and messages that are adapted to the user's emotional state as determined by an emotion recognition engine.

[0536] "Notification" refers to the means by which the system communicates information to users, and primarily refers to the communication of promotional information and updated information.

[0537] These definitions will provide a better understanding of the system's functions and components.

[0538] This invention is a system for promoting interaction between artists and fans and for effectively promoting artists. This system links a server and terminals to realize two-way communication between users and artists.

[0539] System Configuration

[0540] This system has the following six main functions:

[0541] 1. User Registration

[0542] 2. Artist registration

[0543] 3. Search for artist information

[0544] 4. Conversation with your idol

[0545] 5. Promotion Management

[0546] 6. Emotion recognition

[0547] 1. User Registration

[0548] The user enters basic information into the account creation form, and the device sends it to the server, which analyzes the received user information, generates a unique user_id, and stores it in the database.

[0549] 2. Artist registration

[0550] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the device sends this to the server. The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[0551] 3. Search for artist information

[0552] The user enters a search query (e.g., "upcoming concerts") on the artist information search screen. The device sends the search query and artist ID to the server. The server retrieves the artist information from the database and uses an AI model to extract relevant information. The extracted information is sent to the device and presented to the user.

[0553] For example, if a user wants to know about the next concert by "Artist A," they enter the search query "upcoming concerts." The device sends this query and the artist ID to the server, which retrieves information about "Artist A" from the database and returns the results of searching for concert information using an AI model. The device then displays the results to the user.

[0554] 4. Conversation with your idol

[0555] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!"). The device sends this to the server. The server receives the message and uses an AI model based on the artist information to generate a reply message. The generated reply message is sent to the device and displayed to the user.

[0556] As a concrete example, if a user wants to send a message to "Artist A" saying "I love your latest album!", the device sends this to the server. The server retrieves information about "Artist A" from the database and uses an AI model to generate a reply saying "Thank you for your message! I'm glad you liked it!" The server then sends the generated reply to the device and displays it to the user.

[0557] 5. Promotion Management

[0558] The artist enters promotional information (e.g., new concert or merchandise information). The device sends this to the server. The server stores the received promotional information in a database and sends notifications to relevant fans. The device receives the notifications and displays the promotional information to the user.

[0559] For example, an artist registers new concert information on the platform, the device sends it to the server, the server stores the information in a database, the server sends notifications to relevant users, and the device displays the new concert information to users.

[0560] 6. Emotion recognition

[0561] The emotion recognition engine analyzes messages and search queries sent by users to recognize their emotions. The server generates appropriate reply messages that are in line with the artist's character based on the recognized user emotions. The server also customizes search results and promotional notifications based on the recognized emotions.

[0562] As a concrete example, if a user sends a message such as "I am feeling down because I missed your last concert...", the device will send this to the server. The server will analyze the message using an emotion recognition engine and determine that the user's emotion is "sadness". Based on this recognition, the server will generate a kind reply message that is in line with the artist's character (e.g., "I'm sorry to hear that. I'll be performing again soon, and I hope to see you there!"). The server will then send the generated reply message to the device and display it to the user.

[0563] This system will enable efficient interactive exchange between fans and artists, supporting artists' promotional activities, and by using an emotion recognition engine, it will be possible to provide more personalized communication.

[0564] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0565] Step 1:

[0566] User fills out the account creation form with basic information.

[0567] The input information includes name, email address, password, etc. The device sends this information to the server. The server analyzes the received data and generates a unique user_id. The generated user_id and other information are stored in a database. This process registers the user information in the system.

[0568] Step 2:

[0569] The artist enters the required information (name, concert dates, merchandise information, etc.). The device sends this information to the server. The server analyzes the received artist information and generates a unique artist_id. The generated artist_id and other information are saved in the database. This process registers the artist information in the system.

[0570] Step 3:

[0571] The user enters a search query (e.g., "upcoming concerts") on the artist information search screen. The device sends the search query and artist ID to the server. The server analyzes the received query and retrieves the relevant artist information from the database. The server uses an AI model to extract relevant information. In doing so, it filters the information in the database based on the search query and extracts the relevant data. The extracted information is sent to the device and presented to the user. This process allows the user to confirm the artist information they are looking for.

[0572] Step 4:

[0573] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!"). The device sends this message and the artist ID to the server. The server analyzes the received message and obtains related artist information. The server uses an AI model to generate a reply message. The generated reply message is sent to the device and displayed to the user. This process allows the user to receive a reply from the artist.

[0574] Step 5:

[0575] The artist enters promotional information (such as new concert or merchandise information). The device sends this information to the server. The server stores the received promotional information in a database. The server sends notifications to relevant fans. The device receives the notifications and displays the promotional information to the user. This process allows fans to receive the latest promotional information.

[0576] Step 6:

[0577] Messages and search queries sent by users are analyzed using an emotion recognition engine. The device then sends this to the server. The server then analyzes the received data using the emotion recognition engine to recognize the user's emotions. The server then generates an appropriate reply message that is in line with the artist's character based on the recognized emotions. The generated message is then sent to the device and displayed to the user. This process allows the user to receive a reaction that is in line with their own emotions.

[0578] Through these processing steps, the system enables interactive exchange between users and artists, enabling more personalized communication. It also enables efficient promotional activities, maximizing the effectiveness of artists' promotions.

[0579] (Application example 2)

[0580] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0581] Traditional communication systems between artists and fans lacked a personalized experience, making it difficult to respond flexibly and interactively based on fans' emotions. Furthermore, promotional activities lacked the ability to provide specialized information tailored to individual fans' interests and emotions. This limited the effectiveness of artists' promotions and fan engagement.

[0582] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering artist information in a database, means for receiving a search query from a user, means for extracting artist information based on the search query, means for presenting the extracted artist information to the user, an emotion recognition engine for analyzing the user's emotions, means for personalizing communication between the user and the artist, and means for customizing and displaying artist information and promotions based on the user's emotions. This promotes interactive exchanges between artists and fans and enables personalized messages and promotional activities that reflect the fans' emotions.

[0583] "Artist information" refers to basic data about an artist, including their name, profile, concert dates, merchandise information, and more.

[0584] A "search query" is a text or character string that a user enters when searching for information.

[0585] An "emotion recognition engine" is a technology for analyzing and classifying a user's emotions from received text data and voice data.

[0586] "Personalization" means customizing services and information according to the characteristics, behavior, and emotions of individual users.

[0587] A "database" is a system for organizing and storing information, providing a means for retrieving, manipulating, and managing data based on specific criteria.

[0588] "Communication means" refers to the interfaces and protocols for sending and receiving data, and primarily refers to communication technology via the Internet.

[0589] A "prompt" is input text that gives specific instructions or conditions to an AI model.

[0590] A "generative AI model" is an artificial intelligence algorithm trained for natural language processing and data generation, such as an advanced language generation model such as GPT-4 (registered trademark).

[0591] A "server" is a central computer that processes, stores, and manages data, and is responsible for providing information in response to requests from user terminals.

[0592] A "user" is an individual who uses this system to interact with artists and search for information.

[0593] A "message" is text data that a user sends to an artist.

[0594] The present invention is a system for promoting interaction between artists and fans, and in particular, realizes personalized interactive communication using an emotion recognition engine. Specific embodiments for carrying out the present invention are described below.

[0595] System Configuration

[0596] This system is mainly composed of a server, user terminal, database, emotion recognition engine, and generative AI model.

[0597] Hardware / Software used:

[0598] Smartphone or Head-Mounted Display (HMD): Oculus Quest 2

[0599] Server: Google(R) Cloud Platform (GCP)

[0600] Emotion recognition engine: Amazon Comprehend by AWS (registered trademark)

[0601] Generative AI model: GPT-4 by OpenAI®

[0602] Program processing flow

[0603] 1. User Registration:

[0604] The user enters basic information, which the terminal sends to the server.

[0605] The server analyzes the received information, generates a unique user ID, and stores it in a database.

[0606] 2. Artist Registration:

[0607] The artist enters the necessary information (name, concert dates, product information, etc.), and the terminal sends this to the server.

[0608] The server analyzes the received information, generates a unique artist ID, and stores it in a database.

[0609] 3. Search for artist information:

[0610] The user enters a search query, which the device sends to the server.

[0611] The server retrieves artist information from a database and uses AI models to extract relevant information.

[0612] The extracted information is presented to the user.

[0613] Examples:

[0614] When a user enters a search query such as "When is the next concert?", the device sends this to the server, which retrieves the next concert information for the corresponding artist from the database and displays the search results to the user.

[0615] 4. Emotion-aware dialogue:

[0616] The user types a message, which the terminal sends to the server.

[0617] The server uses an emotion recognition engine to analyze the emotion of the message.

[0618] A reply message is generated using a generative AI model (GPT-4) based on the analysis results.

[0619] The generated reply message is sent to the user.

[0620] Examples:

[0621] If a user sends a message saying, "I've been feeling sad lately...", the server will use its emotion recognition engine to analyze the emotion as "sad", and then use GPT-4 to generate a reply message such as, "I'm sorry to hear you're feeling down. I'll be releasing some new music soon, and I hope it cheers you up a little," and send it to the user.

[0622] Example prompt sentence:

[0623] "A user sends a message saying, 'I've been feeling sad lately...' Generate a response to this message that takes into account the user's sadness."

[0624] 5. Promotion Management:

[0625] The artist enters new promotional information, which the terminal then transmits to the server.

[0626] The server stores the received information in a database.

[0627] The stored promotion information is customized based on the user's emotions and past behavior data, and notified to relevant users.

[0628] Examples:

[0629] When an artist registers a new music video release, the server stores this information and sends customized notifications based on fans' recent interests and sentiment.

[0630] In this way, the system of the present invention realizes personalized interactive exchanges between artists and fans, and effectively supports promotional activities.

[0631] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0632] Step 1:

[0633] User Registration

[0634] The device sends the basic information entered by the user (name, email address, etc.) to the server.

[0635] The server analyzes the received basic information, generates a unique user ID, and stores it in a database. The input data is the user's basic information, and the output is the generated user ID.

[0636] Step 2:

[0637] Artist Registration

[0638] The terminal sends the information entered by the artist (such as name, concert dates, and product information) to the server.

[0639] The server analyzes the received artist information, generates a unique artist ID, and stores it in a database. The input data is basic information about the artist, and the output is the generated artist ID.

[0640] Step 3:

[0641] Search for artist information

[0642] The user enters a search query, which the device sends to the server.

[0643] The server extracts artist information from a database based on the entered search query.

[0644] The server uses an AI model to extract relevant information and sends the extracted artist information to the device for presentation. The input data is the search query, and the output is the artist information presented to the user.

[0645] Step 4:

[0646] Emotion-aware dialogue

[0647] The user types a message and sends it to the terminal.

[0648] The terminal sends the received message to the server.

[0649] The server analyzes the emotion of the message using an emotion recognition engine.

[0650] The server generates and inputs prompt sentences into the generative AI model based on the emotion analysis results, and obtains an appropriate reply.

[0651] The server sends the generated reply message to the terminal. The input data is the user's message, and the output is the reply message sent to the user.

[0652] Step 5:

[0653] Promotion Management

[0654] The artist enters new promotional information into the device and submits it.

[0655] The terminal transmits the received promotion information to the server.

[0656] The server stores the received promotion information in a database.

[0657] The server customizes the promotion information based on the user's past behavioral data and emotional data, and notifies the relevant users.

[0658] The terminal presents the stored promotion information to the user, with the promotion information being input data and the customized promotion information being reported as output.

[0659] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0660] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0661] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0662] [Second embodiment]

[0663] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0664] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0665] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0666] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0667] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0668] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0669] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0670] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0671] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0672] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0673] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0674] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0675] The present invention is a system for promoting interaction between artists and fans and for effectively promoting artists. This system links a server and terminals to realize two-way communication between users and artists.

[0676] System Configuration

[0677] The system has five main functions: user registration, artist registration, searching for artist information, interacting with favorite artists, and promotion management.

[0678] 1. User Registration

[0679] The user enters basic information into an account creation form, which the device then sends to the server.

[0680] The server analyzes the received user information, generates a unique user_id, and stores it in the database.

[0681] 2. Artist registration

[0682] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the terminal sends this to the server.

[0683] The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[0684] 3. Search for artist information

[0685] When a user searches for information about an artist, the device sends a search query (e.g., "upcoming concerts") to the server.

[0686] The server retrieves artist information from a database and uses an AI model based on the search query to extract relevant information.

[0687] The extracted information is sent to the terminal and presented to the user.

[0688] Examples:

[0689] If a user wants to know about upcoming concerts by "Jane Smith," they enter the search query "upcoming concerts."

[0690] The device sends this query and the artist ID to the server, which retrieves information about "Jane Smith" from its database, searches for concert information using an AI model, and sends it back to the device.

[0691] The terminal displays the results to the user.

[0692] 4. Conversation with your idol

[0693] When a user sends a message to an artist, the device sends the message and the artist ID to the server.

[0694] The server receives the message and generates a reply message using an AI model based on the artist information.

[0695] The generated reply message is sent to the terminal and displayed to the user.

[0696] Examples:

[0697] If the user wants to send a message to "Jane Smith" saying "I love your latest album!", the device sends this to the server.

[0698] The server retrieves information about "Jane Smith" from the database and uses an AI model to generate a response: "Thank you for your message! I'm glad you liked it!"

[0699] The server sends the generated response to the terminal for display to the user.

[0700] 5. Promotion Management

[0701] The artist enters promotional information (such as new concert or new product information), and the device sends this to the server.

[0702] The server stores the received promotional information in a database and sends notifications to relevant fans.

[0703] The terminal that receives the notification displays the promotion information to the user.

[0704] Examples:

[0705] Artists register new concert information on the platform.

[0706] The device sends this to the server, which stores the information in a database.

[0707] The server sends notifications to relevant users, and the terminals display new concert information to the users.

[0708] In this way, the present invention provides a system that allows interactive exchange between fans and artists and enables artists to efficiently carry out promotional activities.

[0709] The processing flow will be explained below.

[0710] User registration process steps

[0711] Step 1:

[0712] A user fills out an account creation form with required information, such as name, email address, and password.

[0713] Step 2:

[0714] The terminal packages the input information and sends it to the server via an HTTP request.

[0715] Step 3:

[0716] The server analyzes the received user information and generates a unique user_id.

[0717] The server saves the user information in the user_database and generates a successful registration message.

[0718] Step 4:

[0719] The server sends the generated registration success message to the terminal as an HTTP response.

[0720] The terminal receives the registration success message and displays it to the user.

[0721] Artist registration process steps

[0722] Step 1:

[0723] Artists enter necessary information such as their name, concert dates, and merchandise information into the account creation form.

[0724] Step 2:

[0725] The device packages the entered artist information and sends it to the server via an HTTP request.

[0726] Step 3:

[0727] The server parses the received artist information and generates a unique artist_id.

[0728] The server saves the artist information in the artist_database and generates a message confirming successful registration.

[0729] Step 4:

[0730] The server sends the generated registration success message to the terminal as an HTTP response.

[0731] The device receives a registration success message and displays it to the artist.

[0732] Artist information search processing steps

[0733] Step 1:

[0734] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[0735] Step 2:

[0736] The device packages the search query and the artist ID and sends it to the server via an HTTP request.

[0737] Step 3:

[0738] The server receives the search query and the artist ID and extracts the corresponding artist data from the artist database.

[0739] Step 4:

[0740] The server passes the extracted artist information to an AI model to generate relevant information for the search query.

[0741] The server transmits the generated related information to the terminal as an HTTP response.

[0742] Step 5:

[0743] The terminal receives the relevant information and displays it to the user.

[0744] Steps for processing conversations with your favorite idol

[0745] Step 1:

[0746] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[0747] Step 2:

[0748] The device packages the input message and the artist ID and sends it to the server via an HTTP request.

[0749] Step 3:

[0750] The server receives the message and the artist ID and extracts the artist's data from the artist database.

[0751] Step 4:

[0752] The server passes the extracted artist information to an AI model, which generates a reply message based on the artist's character.

[0753] The server sends the generated reply message to the terminal as an HTTP response.

[0754] Step 5:

[0755] The terminal receives the reply message and displays it to the user.

[0756] Promotion Management Process Steps

[0757] Step 1:

[0758] Artists enter promotional information (new concerts, merchandise information, etc.).

[0759] Step 2:

[0760] The terminal packages the entered promotion information and sends it to the server via an HTTP request.

[0761] Step 3:

[0762] The server receives the promotional information and stores it in an artist database.

[0763] Step 4:

[0764] The server matches the stored promotional information with the associated fan's user profile and generates the notification.

[0765] Step 5:

[0766] The server sends the generated notification to the device as an HTTP response.

[0767] Step 6:

[0768] The terminal receives the notification and displays the promotion information to the user.

[0769] Through these processing steps, LuvChat efficiently enables interactive communication between fans and artists and supports artists' promotional activities.

[0770] Example 1

[0771] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0772] In recent years, two-way communication between artists and fans has become increasingly important, but existing systems often make it difficult to achieve this. In particular, there is a lack of mechanisms for fans to send messages directly to artists or efficiently receive promotional information from artists. Furthermore, technology for effectively searching and extracting information registered in databases is also immature. A system that solves these problems and facilitates smooth interaction between artists and fans is needed.

[0773] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0774] In this invention, the server includes means for registering user information in a database, means for receiving user information input from a computer terminal, means for generating a unique identifier from the received user information, means for saving the identifier in a database, means for registering artist information in a database, means for receiving a search query from a user, means for using a generative AI model to extract related artist information based on the search query, means for presenting the extracted artist information to the user, means for receiving a message from the user, means for using a generative AI model to generate a reply message based on the artist's character based on the received message, means for sending the generated reply message to the user, means for the artist to input promotional information, means for saving the promotional information in a database, and means for notifying related users of the saved promotional information. This facilitates two-way communication between artists and fans and enables effective promotional activities.

[0775] The "user information registration means" is a function for storing basic information about a user in a database.

[0776] The "means for receiving information from a computer terminal" is a function for transmitting information entered by a user or artist to a server.

[0777] The "identifier generating means" is a function for generating a unique identification number from received user and artist information.

[0778] The "database storage means" is a function for storing the generated identifier and related information in a database.

[0779] The "artist information registration means" is a function for storing information provided by artists in a database.

[0780] The "search query receiving means" is a function that enables the server to receive a search request from a user.

[0781] "Means for extracting information using a generative AI model" is a function for processing and extracting relevant information using an AI model based on a search query.

[0782] The "information presentation means" is a function for displaying the extracted information to the user.

[0783] The "message receiving means" is a function that allows the server to receive messages sent by users.

[0784] "Means for generating replies using an AI model" is a function for generating reply messages using an AI model based on artist information.

[0785] The "reply sending means" is a function for sending the generated reply message to the user.

[0786] The "promotion information input means" is a function that allows artists to input new promotion information.

[0787] The "promotion information storage means" is a function for storing input promotion information in a database.

[0788] The "promotion information notification means" is a function for notifying related users of the saved promotion information.

[0789] This invention provides a system for promoting interaction between artists and fans and for efficiently promoting artists. The system links a server and terminals to realize two-way communication between users and artists. The system configuration and operation method of this invention will be specifically described below.

[0790] Comprehensive System Configuration

[0791] The system's hardware consists mainly of a server and a terminal. The server is a computer system containing a database and generative AI models, while the terminals are personal computers or smartphones used by users and artists. The software used includes database management systems (e.g., MySQL, MongoDB), AI models (e.g., GPT-3), and web servers (e.g., Apache, Nginx).

[0792] User Registration

[0793] 1. Enter and submit user information

[0794] The user enters basic information such as name, email address, and password, which is then sent from the device to the server.

[0795] Example: "Name: Yamada Taro", "Email address: taro@example.com", "Password: password123"

[0796] 2. Information analysis and data storage

[0797] The server analyzes the received user information, generates a unique identifier (user_id), and then stores the generated identifier and user information in a database.

[0798] Artist Registration

[0799] 1. Enter and submit the required information

[0800] The artist enters the necessary information, such as their name, concert dates, and merchandise information, and sends it from their terminal to the server.

[0801] Example: "Name: Artist A", "Concert date: 2023-12-01", "Merchandise information: New album"

[0802] 2. Information analysis and data storage

[0803] The server analyzes the received artist information, generates a unique identifier (artist_id), and then stores the generated identifier and artist information in a database.

[0804] Search for artist information

[0805] 1. Enter and submit a search query

[0806] A user inputs a query to search for information about an artist and sends it from the terminal to the server.

[0807] Example: "upcoming concerts"

[0808] 2. Information extraction and result display

[0809] The server retrieves relevant artist information from the database and uses a generative AI model to extract information based on the search query, which is then sent to the device and presented to the user.

[0810] Conversation with your favorite idol

[0811] 1. Enter and send a message

[0812] The user inputs a message to be sent to the artist and sends it from the terminal to the server.

[0813] Specific example: “I love your latest album!”

[0814] 2. Reply generation and result display

[0815] The server uses a generative AI model (e.g., GPT-3) based on the received message to generate a reply message based on the artist's character. The generated reply message is sent to the device and displayed to the user.

[0816] Promotion Management

[0817] 1. Enter and submit promotional information

[0818] Artists input promotional information such as new concert and new product information and send it from their terminals to the server.

[0819] Example: "New concert information"

[0820] 2. Information storage and notification

[0821] The server stores the received promotion information in a database and then sends a notification to the relevant fans, who then receive the notification and display the promotion information to the user.

[0822] Prompt Sentence Examples

[0823] Below are some example prompts to input to a generative AI model:

[0824] "Show me the next concert"

[0825] "Generate a reply to this message"

[0826] This system will facilitate two-way communication between artists and fans, enabling artists to carry out promotional activities more effectively.

[0827] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0828] User Registration

[0829] Step 1:

[0830] A user fills out an account creation form with basic information such as name, email address, and password.

[0831] Specific actions: Enter the required information into the form on your browser and click the "Register" button.

[0832] Input: Name, email address, and password entered by the user

[0833] Output: JSON format user information sent by the device to the server

[0834] Step 2:

[0835] The terminal transmits the input information to the server.

[0836] Specific operation: When the form is submitted, a JavaScript AJAX request is used to send user information in JSON format to the server.

[0837] Input: User information entered into the terminal

[0838] Output: User information received by the server in JSON format

[0839] Step 3:

[0840] The server analyzes the received user information and generates a unique identifier (user_id).

[0841] Specific operation: Using a program such as Python or Java, parse the received data and generate a unique ID using a hash function.

[0842] Input: User information in JSON format

[0843] Output: Generated user_id

[0844] Step 4:

[0845] The server stores the generated identifier and the user information in a database.

[0846] Specific operation: Uses SQL INSERT queries to write data to MySQL, MongoDB, etc.

[0847] Input: Generated user_id and user information

[0848] Output: User information stored in the database

[0849] Artist Registration

[0850] Step 1:

[0851] The artist enters the necessary information, such as name, concert dates, and merchandise information, into the artist registration form.

[0852] Specific actions: Fill out the required information in the dedicated form and click the "Register" button.

[0853] Input: Artist name, concert dates, merchandise information

[0854] Output: Artist information in JSON format sent by the device to the server

[0855] Step 2:

[0856] The terminal transmits the input information to the server.

[0857] Specific behavior: When the form is submitted, an AJAX request is used to send the artist information in JSON format to the server.

[0858] Input: Artist information entered on the device

[0859] Output: Artist information in JSON format as received by the server

[0860] Step 3:

[0861] The server analyzes the received artist information and generates a unique identifier (artist_id).

[0862] Specific behavior: Parse the received data and generate a unique ID.

[0863] Input: Artist information in JSON format

[0864] Output: Generated artist_id

[0865] Step 4:

[0866] The server stores the generated identifier and the artist information in a database.

[0867] Specific operation: Writes data to the database using an SQL INSERT query.

[0868] Input: Generated artist_id and artist information

[0869] Output: Artist information stored in the database

[0870] Search for artist information

[0871] Step 1:

[0872] A user enters a query to search for information about an artist.

[0873] Specific actions: Enter a keyword (e.g., "upcoming concerts") in the search bar and click the "Search" button.

[0874] Input: Search query

[0875] Output: The search query sent by the device to the server

[0876] Step 2:

[0877] The terminal transmits the input search query to the server.

[0878] What it does: Sends a search query to the server using an AJAX request.

[0879] Input: Search query entered into the device

[0880] Output: The search query received by the server

[0881] Step 3:

[0882] The server retrieves the relevant artist information from the database.

[0883] Specific behavior: Retrieves data using an SQL query.

[0884] Input: Search query

[0885] Output: Artist information retrieved from the database

[0886] Step 4:

[0887] The server uses a generative AI model to extract relevant information based on the acquired artist information.

[0888] Specific operation: Enter a prompt sentence into an AI model (e.g., GPT-3) built using Python or other language to extract information.

[0889] Input: Retrieved artist information

[0890] Output: Relevant information extracted by the AI ​​model

[0891] Step 5:

[0892] The server transmits the extracted information to the terminal and presents it to the user.

[0893] Specific operation: Sends JSON format data to the device and displays the information in HTML.

[0894] Input: Relevant information extracted by the AI ​​model

[0895] Output: Information displayed on the terminal

[0896] Conversation with your favorite idol

[0897] Step 1:

[0898] The user enters a message to send to the artist.

[0899] Specific behavior: Enter text in the message input field and click the "Send" button.

[0900] Input: Message text (e.g. "I love your latest album!")

[0901] Output: Message text that the terminal sends to the server

[0902] Step 2:

[0903] The device sends the message and the artist ID to the server.

[0904] Specific behavior: Sends a message to the server via an AJAX request.

[0905] Input: Message text and artist ID entered on the device

[0906] Output: Message text and artist ID received by the server

[0907] Step 3:

[0908] The server receives the message and generates a reply message using a generative AI model based on the artist information.

[0909] Specific operation: The message "Generate a reply to this message" is input as a prompt to an AI model (e.g., GPT-3), and a reply is generated.

[0910] Input: Message text and artist information

[0911] Output: The generated reply message

[0912] Step 4:

[0913] The server sends the generated reply message to the terminal and displays it to the user.

[0914] Specific operation: A reply message in JSON format is sent to the device and displayed on the chat screen.

[0915] Input: The generated reply message

[0916] Output: Reply message displayed on the terminal

[0917] Promotion Management

[0918] Step 1:

[0919] Artists enter promotional information such as new concerts and new product information.

[0920] Specific actions: Enter information into the promotion information input form and click the "Submit" button.

[0921] Input: Promotion information (e.g. new concert information)

[0922] Output: Promotion information sent by the device to the server

[0923] Step 2:

[0924] The terminal transmits the promotion information to the server.

[0925] Specific behavior: Sends information to the server via AJAX request.

[0926] Input: Promotion information entered into the device

[0927] Output: Promotion information received by the server

[0928] Step 3:

[0929] The server stores the received promotion information in a database.

[0930] Specific behavior: Saves to the database using an SQL INSERT query.

[0931] Input: Promotion information

[0932] Output: Promotion information stored in the database

[0933] Step 4:

[0934] The server sends a notification to the relevant user.

[0935] Specific behavior: Sends a push notification using the notification subscription information.

[0936] Input: Saved Promotion Information

[0937] Output: Notification displayed on the user's device

[0938] Step 5:

[0939] The user receives the notification and checks the promotion information.

[0940] What it does: Displays promotional information in the device's notification area and provides a link to learn more.

[0941] Input: Notification from the server

[0942] Output: A link to the promotion details that will be displayed on the device

[0943] (Application example 1)

[0944] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0945] In today's world, there is a need for direct interaction between artists and fans, and for artists to effectively promote themselves by utilizing physical stores. However, traditional methods have not fully realized the provision of artist information, real-time interaction with fans, or notifications of promotional activities. For this reason, a system is needed to deepen the relationship between artists and fans and maximize the effectiveness of promotions in physical stores.

[0946] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0947] In this invention, the server includes means for registering artist information in a database, means for receiving a search query from a user, means for extracting artist information based on the search query, means for presenting the extracted artist information to the user, means for searching for artist information in a physical store, means for sending a message to an artist through a display installed in the physical store, and means for notifying promotional information through a display in the physical store. This not only enables interaction between artists and fans in the physical store, but also enables effective promotional activities for artists.

[0948] "Artist information" is data including basic information about the artist, activity information, event schedules, promotional information, and the like.

[0949] "Database" means a digital data management system for storing artist information, user information, and message and promotional information.

[0950] A "search query" is a search string or keyword that a user enters to obtain artist information.

[0951] "Extraction" is the act of retrieving relevant information from a database based on a specific search query.

[0952] A "brick and mortar store" is a physical location where fans can find information about and interact with artists.

[0953] A "display" is a display device installed in a physical store to display artist information and promotional information.

[0954] A "Message" is a text or other form of communication sent by a User to an Artist.

[0955] "Promotional information" refers to information advertising new products, events, services, etc. that artists provide to their fans.

[0956] "Server" means a computer system for processing and managing artist information, user information, messages, and promotional information.

[0957] The "search query receiving means" is a function that enables the server to receive a search query from a user.

[0958] The "means for presenting artist information" is a means for displaying the extracted artist information to the user.

[0959] A "means for sending messages" is a means for sending user-generated text or other forms of communication to a server.

[0960] The "means for notifying promotion information" is a means for notifying related users of the stored promotion information.

[0961] This invention is a system for promoting interaction between artists and fans and effectively promoting artists in physical stores. The system has five main functions: registering artist information, receiving search queries from users, extracting and presenting artist information, interacting with fans in physical stores, and managing promotions.

[0962] 1. Registering artist information

[0963] The server has a means for registering artist information in a database. Information entered by the artist (such as name, event schedule, and promotion information) is sent from the terminal to the server, and the server stores it in the database. For example, if an artist enters "new concert information," the information is stored in the database and used to notify related users.

[0964] 2. Receiving a search query from a user

[0965] The server has a means for receiving a search query from a user. For example, when a user inputs a query to search for "concert information this weekend," the search query is sent from the terminal to the server. The server extracts related artist information from the database based on the search query.

[0966] 3. Extracting and presenting artist information

[0967] The server has a means for extracting artist information based on the search query and a means for presenting the extracted artist information to the user. For example, if a user searches for "pop singer's next concert information," the server extracts relevant information from the database and presents it to the user via the terminal. This allows the user to quickly obtain the artist information they are looking for.

[0968] 4. Interacting with fans in physical stores

[0969] The server has a means for sending messages to artists through displays installed in physical stores. Users visiting the physical stores can use the displays to send messages to artists. The received messages are processed by the server, and a generative AI model is used to generate a reply message based on the artist's character and send it to the user. For example, if a user sends a message saying, "I love your new song!", the server generates a reply such as, "Thank you! Please continue to support us!" and displays it to the user.

[0970] 5. Promotion Management

[0971] The server stores promotional information in a database and notifies relevant users. When an artist enters information about a new product, the information is stored in the database and notified to users. For example, when an artist registers a "new album release," the server sends a notification to relevant fans and displays the information on displays in stores and on users' terminals.

[0972] Examples of concrete examples and prompts

[0973] User Registration

[0974] Example: A user enters a username and email address to create their account.

[0975] Example prompt: Username: Fantaro, Email address: fan@example.com

[0976] Artist Registration

[0977] Example: A store manager registers artists for an in-store event.

[0978] Example prompt: Artist name: Pop singer, Information: Popular pop artist

[0979] Search for artist information

[0980] Example: Searching for event information for a specific artist within the app.

[0981] Example prompt: Search query: Upcoming concert information

[0982] Conversation with your favorite idol

[0983] Example: Users can send messages of support to artists through displays in stores.

[0984] Example prompt: Message: I love your new album!

[0985] Promotion Management

[0986] Example: Notifying fans of your store about new merchandise.

[0987] Example prompt: Promotion: Our new album is now on sale!

[0988] The above system will enable interactive interaction between artists and fans, and will enable effective promotional activities in physical stores.

[0989] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0990] Step 1:

[0991] User Registration

[0992] The device receives basic information entered by the user, such as a username and email address, and sends it to a server, which analyzes the information and generates a unique user ID, which is then stored in a database.

[0993] Input: Username, Email Address

[0994] Output: Unique user ID

[0995] What happens: A user enters information into an account creation form and presses the submit button. The device packages this information into a packet and sends it to the server as an HTTP request. The server analyzes the information, generates a new user ID, and stores it in a database.

[0996] Step 2:

[0997] Artist information registration

[0998] The server receives information entered by the artist (such as name, event schedule, and promotional information) from the device and stores it in a database. A unique artist ID is assigned to the artist information.

[0999] Input: Artist name, event schedule, promotion information

[1000] Output: Unique artist ID

[1001] Specific operation: The artist fills out the information form through the device and presses the submit button. The device sends the information to the server as an HTTP request. The server analyzes the information, generates a new artist ID, and saves it in the database.

[1002] Step 3:

[1003] Search for artist information

[1004] A user inputs a search query into a terminal and sends it to the server, which extracts relevant artist information from a database based on the received search query.

[1005] Input: Search query (e.g. "Upcoming concert information")

[1006] Output: Artist information as search results

[1007] Specific operation: The user enters a search query on the device and presses the search button. The device sends the search query to the server. The server uses a search algorithm to extract relevant artist information from the database.

[1008] Step 4:

[1009] View artist information

[1010] The server transmits the extracted artist information to the terminal and displays it to the user, who can then view the artist information as a search result on the terminal.

[1011] Input: Extracted artist information

[1012] Output: Artist information displayed on the user's device

[1013] Specific operation: The server sends the extracted artist information to the device as an HTTP response. The device analyzes this information and displays it in a user-friendly format.

[1014] Step 5:

[1015] Conversation with your favorite idol

[1016] The user inputs the message content into the device and sends it to the server, which uses the generative AI model based on the received message to generate a reply message based on the artist's character.

[1017] Input: User's message

[1018] Output: The generated reply message

[1019] How it works: A user types a message into their device and presses the send button. The device then sends the message to the server, which uses a generative AI model (e.g., GPT-3) to generate an artistic reply.

[1020] Step 6:

[1021] Displaying reply messages

[1022] The server sends the generated reply message to the terminal and displays it to the user, who can then view the reply message from the artist on the terminal.

[1023] Input: The generated reply message

[1024] Output: Reply message displayed on the user's terminal

[1025] Specific operation: The server generates a reply message and sends it to the terminal as an HTTP response. The terminal analyzes this message and displays it to the user.

[1026] Step 7:

[1027] Entering and notifying promotional information

[1028] The artist inputs new promotion information into the terminal and sends it to the server, which stores the received promotion information in a database and notifies the relevant users.

[1029] Input: New promotion information

[1030] Output: Notifications sent to relevant users

[1031] Specific operation: The artist enters new promotion information and presses the send button. The device sends the information to the server. The server saves the promotion information in the database and sends notifications to relevant users.

[1032] Step 8:

[1033] View promotion information

[1034] The server transmits the notified promotion information to the terminal and displays it to the user, who can then view the new promotion information on the terminal.

[1035] Input: Promotion information notified

[1036] Output: Promotion information displayed on the user's device

[1037] Specific operation: The server sends the promotion information to the terminal as an HTTP response. The terminal analyzes this information and displays it to the user.

[1038] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1039] This invention is a system for promoting interaction between artists and fans and for effectively promoting artists, and is characterized by the incorporation of an emotion engine that recognizes the emotions of users. This system links a server and terminals to realize two-way communication between users and artists.

[1040] System Configuration

[1041] The system has six main functions: user registration, artist registration, artist information search, interaction with favorite artists, promotion management, and emotion recognition.

[1042] 1. User Registration

[1043] The user enters basic information into an account creation form, which the device then sends to the server.

[1044] The server analyzes the received user information, generates a unique user_id, and stores it in the database.

[1045] 2. Artist registration

[1046] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the terminal sends this to the server.

[1047] The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[1048] 3. Search for artist information

[1049] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[1050] The device sends the search query and artist ID to the server.

[1051] The server retrieves artist information from a database and uses an AI model based on the search query to extract relevant information.

[1052] The extracted information is sent to the terminal and presented to the user.

[1053] Examples:

[1054] If a user wants to know about upcoming concerts by "Jane Smith," they enter the search query "upcoming concerts."

[1055] The device sends this query and the artist ID to the server, which retrieves information about "Jane Smith" from its database, searches for concert information using an AI model, and sends it back to the device.

[1056] The terminal displays the results to the user.

[1057] 4. Conversation with your idol

[1058] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[1059] The device sends the entered message and artist ID to the server.

[1060] The server receives the message and generates a reply message using an AI model based on the artist information.

[1061] The generated reply message is sent to the terminal and displayed to the user.

[1062] Examples:

[1063] If the user wants to send a message to "Jane Smith" saying "I love your latest album!", the device sends this to the server.

[1064] The server retrieves information about "Jane Smith" from the database and uses an AI model to generate a response: "Thank you for your message! I'm glad you liked it!"

[1065] The server sends the generated response to the terminal for display to the user.

[1066] 5. Promotion Management

[1067] The artist enters promotional information (such as new concert and merchandise information), and the device sends this to the server.

[1068] The server stores the received promotional information in a database and sends notifications to relevant fans.

[1069] The terminal that receives the notification displays the promotion information to the user.

[1070] Examples:

[1071] Artists register new concert information on the platform.

[1072] The device sends this to the server, which stores the information in a database.

[1073] The server sends notifications to relevant users, and the terminals display new concert information to the users.

[1074] 6. Emotion recognition

[1075] The emotion engine analyzes messages and search queries sent by users to recognize their emotions.

[1076] The server generates an appropriate reply message that is in line with the artist's character based on the recognized user's emotion.

[1077] The server customizes search results and promotional notifications based on the perceived sentiment.

[1078] Examples:

[1079] If a user sends a message saying "I am feeling down because I missed your last concert...", the terminal sends this to the server.

[1080] The server analyzes the message using an emotion engine and recognizes that the user's emotion is "sadness."

[1081] Based on the recognized emotion, the server generates a friendly reply message that is in keeping with the artist's character (e.g., "I'm sorry to hear that. I'll be performing again soon, and I hope to see you there!").

[1082] The server sends the generated reply message to the terminal and displays it to the user.

[1083] Through these processing steps, LuvChat efficiently facilitates interactive communication between fans and artists, supports artists' promotional activities, and provides more personalized communication through the use of an emotion engine.

[1084] The processing flow will be explained below.

[1085] User registration process steps

[1086] Step 1:

[1087] A user fills out an account creation form with required information, such as name, email address, and password.

[1088] Step 2:

[1089] The terminal packages the input information and sends it to the server via an HTTP request.

[1090] Step 3:

[1091] The server analyzes the received user information and generates a unique user_id.

[1092] The server saves the user information in the user_database and generates a successful registration message.

[1093] Step 4:

[1094] The server sends the generated registration success message to the terminal as an HTTP response.

[1095] The terminal receives the registration success message and displays it to the user.

[1096] Artist registration process steps

[1097] Step 1:

[1098] Artists enter necessary information such as their name, concert dates, and merchandise information into the account creation form.

[1099] Step 2:

[1100] The device packages the entered artist information and sends it to the server via an HTTP request.

[1101] Step 3:

[1102] The server parses the received artist information and generates a unique artist_id.

[1103] The server saves the artist information in the artist_database and generates a message confirming successful registration.

[1104] Step 4:

[1105] The server sends the generated registration success message to the terminal as an HTTP response.

[1106] The device receives a registration success message and displays it to the artist.

[1107] Artist information search processing steps

[1108] Step 1:

[1109] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[1110] Step 2:

[1111] The device packages the search query and the artist ID and sends it to the server via an HTTP request.

[1112] Step 3:

[1113] The server receives the search query and the artist ID and extracts the corresponding artist data from the artist database.

[1114] Step 4:

[1115] The server passes the extracted artist information to an AI model to generate relevant information for the search query.

[1116] The server transmits the generated related information to the terminal as an HTTP response.

[1117] Step 5:

[1118] The terminal receives the relevant information and displays it to the user.

[1119] Steps for processing conversations with your favorite idol

[1120] Step 1:

[1121] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[1122] Step 2:

[1123] The device packages the input message and the artist ID and sends it to the server via an HTTP request.

[1124] Step 3:

[1125] The server receives the message and the artist ID and extracts the artist's data from the artist database.

[1126] Step 4:

[1127] The server passes the extracted artist information to the emotion engine, which analyzes the user's emotions.

[1128] Step 5:

[1129] Based on the analysis results, the server generates a reply message that is in line with the artist's character.

[1130] The server sends the generated reply message to the terminal as an HTTP response.

[1131] Step 6:

[1132] The terminal receives the reply message and displays it to the user.

[1133] Promotion Management Process Steps

[1134] Step 1:

[1135] Artists enter promotional information (new concerts, merchandise information, etc.).

[1136] Step 2:

[1137] The terminal packages the entered promotion information and sends it to the server via an HTTP request.

[1138] Step 3:

[1139] The server receives the promotional information and stores it in an artist database.

[1140] Step 4:

[1141] The server matches the stored promotional information with the associated fan's user profile and generates the notification.

[1142] Step 5:

[1143] The server sends the generated notification to the device as an HTTP response.

[1144] Step 6:

[1145] The terminal receives the notification and displays the promotion information to the user.

[1146] Processing steps for emotion recognition

[1147] Step 1:

[1148] The user enters a message or search query and presses the send button.

[1149] Step 2:

[1150] The device packages the entered message or search query and sends it to the server via an HTTP request.

[1151] Step 3:

[1152] The server receives messages and search queries and passes them to the emotion engine.

[1153] The server obtains the analysis results from the emotion engine and recognizes the user's emotions.

[1154] Step 4:

[1155] The server generates appropriate reply messages and search results that are in line with the artist's character based on the recognized user's emotions.

[1156] The server sends the generated result to the terminal as an HTTP response.

[1157] Step 5:

[1158] The terminal receives the results and displays them to the user.

[1159] Through these processing steps, LuvChat efficiently facilitates interactive communication between fans and artists, supports artists' promotional activities, and provides more personalized communication through the use of an emotion engine.

[1160] Example 2

[1161] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1162] Conventional artist-fan interaction systems lacked personalized communication that took into account user emotions, and artist promotional activities were ineffective, resulting in low fan engagement with artists and limited promotional impact.

[1163] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1164] In this invention, the server includes means for registering artist information in a database, means for receiving search queries from users, means for extracting artist information based on the search queries, means for presenting the extracted artist information to users, means including an emotion recognition engine for analyzing user messages and search queries and recognizing emotions, and means for providing content based on the recognized emotions, thereby enabling personalized communication according to user emotions and effective promotional activities.

[1165] "Artist information" refers to information necessary for interacting with fans and promotional activities, such as the artist's name, concert dates, and merchandise information.

[1166] A "user search query" is a character string or keyword that a user enters when searching for artist information.

[1167] An "emotion recognition engine" is a technology that analyzes users' messages and search queries and determines their emotional state (e.g., joy, sadness, excitement, etc.) from their content.

[1168] A "unique ID" is a unique identifier that uniquely identifies each artist or user in the database.

[1169] "Content" refers to all information and messages provided to users, and specifically includes reply messages from artists, concert information, promotional information, and the like.

[1170] "Promotion information" refers to information about promotional activities that artists undertake to their fans, such as information about new concerts and merchandise.

[1171] A "user message" is a textual communication sent by a user to an artist.

[1172] A "reply message" is a response message generated by an artist or the system in response to a user's message.

[1173] The "means for receiving a search query" is a function that allows the system to obtain a search query entered by a user.

[1174] A "database" is an information system that systematically stores and manages data such as artist information and promotional information.

[1175] "Content provided based on emotions" refers to information and messages that are adapted to the user's emotional state as determined by an emotion recognition engine.

[1176] "Notification" refers to the means by which the system communicates information to users, and primarily refers to the communication of promotional information and updated information.

[1177] These definitions will provide a better understanding of the system's functions and components.

[1178] This invention is a system for promoting interaction between artists and fans and for effectively promoting artists. This system links a server and terminals to realize two-way communication between users and artists.

[1179] System Configuration

[1180] This system has the following six main functions:

[1181] 1. User Registration

[1182] 2. Artist registration

[1183] 3. Search for artist information

[1184] 4. Conversation with your idol

[1185] 5. Promotion Management

[1186] 6. Emotion recognition

[1187] 1. User Registration

[1188] The user enters basic information into the account creation form, and the device sends it to the server, which analyzes the received user information, generates a unique user_id, and stores it in the database.

[1189] 2. Artist registration

[1190] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the device sends this to the server. The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[1191] 3. Search for artist information

[1192] The user enters a search query (e.g., "upcoming concerts") on the artist information search screen. The device sends the search query and artist ID to the server. The server retrieves the artist information from the database and uses an AI model to extract relevant information. The extracted information is sent to the device and presented to the user.

[1193] For example, if a user wants to know about the next concert by "Artist A," they enter the search query "upcoming concerts." The device sends this query and the artist ID to the server, which retrieves information about "Artist A" from the database and returns the results of searching for concert information using an AI model. The device then displays the results to the user.

[1194] 4. Conversation with your idol

[1195] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!"). The device sends this to the server. The server receives the message and uses an AI model based on the artist information to generate a reply message. The generated reply message is sent to the device and displayed to the user.

[1196] As a concrete example, if a user wants to send a message to "Artist A" saying "I love your latest album!", the device sends this to the server. The server retrieves information about "Artist A" from the database and uses an AI model to generate a reply saying "Thank you for your message! I'm glad you liked it!" The server then sends the generated reply to the device and displays it to the user.

[1197] 5. Promotion Management

[1198] The artist enters promotional information (e.g., new concert or merchandise information). The device sends this to the server. The server stores the received promotional information in a database and sends notifications to relevant fans. The device receives the notifications and displays the promotional information to the user.

[1199] For example, an artist registers new concert information on the platform, the device sends it to the server, the server stores the information in a database, the server sends notifications to relevant users, and the device displays the new concert information to users.

[1200] 6. Emotion recognition

[1201] The emotion recognition engine analyzes messages and search queries sent by users to recognize their emotions. The server generates appropriate reply messages that are in line with the artist's character based on the recognized user emotions. The server also customizes search results and promotional notifications based on the recognized emotions.

[1202] As a concrete example, if a user sends a message such as "I am feeling down because I missed your last concert...", the device will send this to the server. The server will analyze the message using an emotion recognition engine and determine that the user's emotion is "sadness". Based on this recognition, the server will generate a kind reply message that is in line with the artist's character (e.g., "I'm sorry to hear that. I'll be performing again soon, and I hope to see you there!"). The server will then send the generated reply message to the device and display it to the user.

[1203] This system will enable efficient interactive exchange between fans and artists, supporting artists' promotional activities, and by using an emotion recognition engine, it will be possible to provide more personalized communication.

[1204] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1205] Step 1:

[1206] User fills out the account creation form with basic information.

[1207] The input information includes name, email address, password, etc. The device sends this information to the server. The server analyzes the received data and generates a unique user_id. The generated user_id and other information are stored in a database. This process registers the user information in the system.

[1208] Step 2:

[1209] The artist enters the required information (name, concert dates, merchandise information, etc.). The device sends this information to the server. The server analyzes the received artist information and generates a unique artist_id. The generated artist_id and other information are saved in the database. This process registers the artist information in the system.

[1210] Step 3:

[1211] The user enters a search query (e.g., "upcoming concerts") on the artist information search screen. The device sends the search query and artist ID to the server. The server analyzes the received query and retrieves the relevant artist information from the database. The server uses an AI model to extract relevant information. In doing so, it filters the information in the database based on the search query and extracts the relevant data. The extracted information is sent to the device and presented to the user. This process allows the user to confirm the artist information they are looking for.

[1212] Step 4:

[1213] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!"). The device sends this message and the artist ID to the server. The server analyzes the received message and obtains related artist information. The server uses an AI model to generate a reply message. The generated reply message is sent to the device and displayed to the user. This process allows the user to receive a reply from the artist.

[1214] Step 5:

[1215] The artist enters promotional information (such as new concert or merchandise information). The device sends this information to the server. The server stores the received promotional information in a database. The server sends notifications to relevant fans. The device receives the notifications and displays the promotional information to the user. This process allows fans to receive the latest promotional information.

[1216] Step 6:

[1217] Messages and search queries sent by users are analyzed using an emotion recognition engine. The device then sends this to the server. The server then analyzes the received data using the emotion recognition engine to recognize the user's emotions. The server then generates an appropriate reply message that is in line with the artist's character based on the recognized emotions. The generated message is then sent to the device and displayed to the user. This process allows the user to receive a reaction that is in line with their own emotions.

[1218] Through these processing steps, the system enables interactive exchange between users and artists, enabling more personalized communication. It also enables efficient promotional activities, maximizing the effectiveness of artists' promotions.

[1219] (Application example 2)

[1220] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1221] Traditional communication systems between artists and fans lacked a personalized experience, making it difficult to respond flexibly and interactively based on fans' emotions. Furthermore, promotional activities lacked the ability to provide specialized information tailored to individual fans' interests and emotions. This limited the effectiveness of artists' promotions and fan engagement.

[1222] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering artist information in a database, means for receiving a search query from a user, means for extracting artist information based on the search query, means for presenting the extracted artist information to the user, an emotion recognition engine for analyzing the user's emotions, means for personalizing communication between the user and the artist, and means for customizing and displaying artist information and promotions based on the user's emotions. This promotes interactive exchanges between artists and fans and enables personalized messages and promotional activities that reflect the fans' emotions.

[1223] "Artist information" refers to basic data about an artist, including their name, profile, concert dates, merchandise information, and more.

[1224] A "search query" is a text or character string that a user enters when searching for information.

[1225] An "emotion recognition engine" is a technology for analyzing and classifying a user's emotions from received text data and voice data.

[1226] "Personalization" means customizing services and information according to the characteristics, behavior, and emotions of individual users.

[1227] A "database" is a system for organizing and storing information, providing a means for retrieving, manipulating, and managing data based on specific criteria.

[1228] "Communication means" refers to the interfaces and protocols for sending and receiving data, and primarily refers to communication technology via the Internet.

[1229] A "prompt" is input text that gives specific instructions or conditions to an AI model.

[1230] A "generative AI model" is an artificial intelligence algorithm trained for natural language processing and data generation, such as an advanced language generation model such as GPT-4.

[1231] A "server" is a central computer that processes, stores, and manages data, and is responsible for providing information in response to requests from user terminals.

[1232] A "user" is an individual who uses this system to interact with artists and search for information.

[1233] A "message" is text data that a user sends to an artist.

[1234] The present invention is a system for promoting interaction between artists and fans, and in particular, realizes personalized interactive communication using an emotion recognition engine. Specific embodiments for carrying out the present invention are described below.

[1235] System Configuration

[1236] This system is mainly composed of a server, user terminal, database, emotion recognition engine, and generative AI model.

[1237] Hardware / Software used:

[1238] Smartphone or Head-Mounted Display (HMD): Oculus Quest 2

[1239] Server: Google Cloud Platform (GCP)

[1240] Emotion recognition engine: Amazon Comprehend from AWS

[1241] Generative AI model: OpenAI's GPT-4

[1242] Program processing flow

[1243] 1. User Registration:

[1244] The user enters basic information, which the terminal sends to the server.

[1245] The server analyzes the received information, generates a unique user ID, and stores it in a database.

[1246] 2. Artist Registration:

[1247] The artist enters the necessary information (name, concert dates, product information, etc.), and the terminal sends this to the server.

[1248] The server analyzes the received information, generates a unique artist ID, and stores it in a database.

[1249] 3. Search for artist information:

[1250] The user enters a search query, which the device sends to the server.

[1251] The server retrieves artist information from a database and uses AI models to extract relevant information.

[1252] The extracted information is presented to the user.

[1253] Examples:

[1254] When a user enters a search query such as "When is the next concert?", the device sends this to the server, which retrieves the next concert information for the corresponding artist from the database and displays the search results to the user.

[1255] 4. Emotion-aware dialogue:

[1256] The user types a message, which the terminal sends to the server.

[1257] The server uses an emotion recognition engine to analyze the emotion of the message.

[1258] A reply message is generated using a generative AI model (GPT-4) based on the analysis results.

[1259] The generated reply message is sent to the user.

[1260] Examples:

[1261] If a user sends a message saying, "I've been feeling sad lately...", the server will use its emotion recognition engine to analyze the emotion as "sad", and then use GPT-4 to generate a reply message such as, "I'm sorry to hear you're feeling down. I'll be releasing some new music soon, and I hope it cheers you up a little," and send it to the user.

[1262] Example prompt sentence:

[1263] "A user sends a message saying, 'I've been feeling sad lately...' Generate a response to this message that takes into account the user's sadness."

[1264] 5. Promotion Management:

[1265] The artist enters new promotional information, which the terminal then transmits to the server.

[1266] The server stores the received information in a database.

[1267] The stored promotion information is customized based on the user's emotions and past behavior data, and notified to relevant users.

[1268] Examples:

[1269] When an artist registers a new music video release, the server stores this information and sends customized notifications based on fans' recent interests and sentiment.

[1270] In this way, the system of the present invention realizes personalized interactive exchanges between artists and fans, and effectively supports promotional activities.

[1271] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1272] Step 1:

[1273] User Registration

[1274] The device sends the basic information entered by the user (name, email address, etc.) to the server.

[1275] The server analyzes the received basic information, generates a unique user ID, and stores it in a database. The input data is the user's basic information, and the output is the generated user ID.

[1276] Step 2:

[1277] Artist Registration

[1278] The terminal sends the information entered by the artist (such as name, concert dates, and product information) to the server.

[1279] The server analyzes the received artist information, generates a unique artist ID, and stores it in a database. The input data is basic information about the artist, and the output is the generated artist ID.

[1280] Step 3:

[1281] Search for artist information

[1282] The user enters a search query, which the device sends to the server.

[1283] The server extracts artist information from a database based on the entered search query.

[1284] The server uses an AI model to extract relevant information and sends the extracted artist information to the device for presentation. The input data is the search query, and the output is the artist information presented to the user.

[1285] Step 4:

[1286] Emotion-aware dialogue

[1287] The user types a message and sends it to the terminal.

[1288] The terminal sends the received message to the server.

[1289] The server analyzes the emotion of the message using an emotion recognition engine.

[1290] The server generates and inputs prompt sentences into the generative AI model based on the emotion analysis results, and obtains an appropriate reply.

[1291] The server sends the generated reply message to the terminal. The input data is the user's message, and the output is the reply message sent to the user.

[1292] Step 5:

[1293] Promotion Management

[1294] The artist enters new promotional information into the device and submits it.

[1295] The terminal transmits the received promotion information to the server.

[1296] The server stores the received promotion information in a database.

[1297] The server customizes the promotion information based on the user's past behavioral data and emotional data, and notifies the relevant users.

[1298] The terminal presents the stored promotion information to the user, with the promotion information being input data and the customized promotion information being reported as output.

[1299] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1300] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1301] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1302] [Third embodiment]

[1303] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1304] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1305] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1306] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1307] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1308] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1309] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1310] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1311] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1312] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1313] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1314] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1315] The present invention is a system for promoting interaction between artists and fans and for effectively promoting artists. This system links a server and terminals to realize two-way communication between users and artists.

[1316] System Configuration

[1317] The system has five main functions: user registration, artist registration, searching for artist information, interacting with favorite artists, and promotion management.

[1318] 1. User Registration

[1319] The user enters basic information into an account creation form, which the device then sends to the server.

[1320] The server analyzes the received user information, generates a unique user_id, and stores it in the database.

[1321] 2. Artist registration

[1322] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the terminal sends this to the server.

[1323] The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[1324] 3. Search for artist information

[1325] When a user searches for information about an artist, the device sends a search query (e.g., "upcoming concerts") to the server.

[1326] The server retrieves artist information from a database and uses an AI model based on the search query to extract relevant information.

[1327] The extracted information is sent to the terminal and presented to the user.

[1328] Examples:

[1329] If a user wants to know about upcoming concerts by "Jane Smith," they enter the search query "upcoming concerts."

[1330] The device sends this query and the artist ID to the server, which retrieves information about "Jane Smith" from its database, searches for concert information using an AI model, and sends it back to the device.

[1331] The terminal displays the results to the user.

[1332] 4. Conversation with your idol

[1333] When a user sends a message to an artist, the device sends the message and the artist ID to the server.

[1334] The server receives the message and generates a reply message using an AI model based on the artist information.

[1335] The generated reply message is sent to the terminal and displayed to the user.

[1336] Examples:

[1337] If the user wants to send a message to "Jane Smith" saying "I love your latest album!", the device sends this to the server.

[1338] The server retrieves information about "Jane Smith" from the database and uses an AI model to generate a response: "Thank you for your message! I'm glad you liked it!"

[1339] The server sends the generated response to the terminal for display to the user.

[1340] 5. Promotion Management

[1341] The artist enters promotional information (such as new concert or new product information), and the device sends this to the server.

[1342] The server stores the received promotional information in a database and sends notifications to relevant fans.

[1343] The terminal that receives the notification displays the promotion information to the user.

[1344] Examples:

[1345] Artists register new concert information on the platform.

[1346] The device sends this to the server, which stores the information in a database.

[1347] The server sends notifications to relevant users, and the terminals display new concert information to the users.

[1348] In this way, the present invention provides a system that allows interactive exchange between fans and artists and enables artists to efficiently carry out promotional activities.

[1349] The processing flow will be explained below.

[1350] User registration process steps

[1351] Step 1:

[1352] A user fills out an account creation form with required information, such as name, email address, and password.

[1353] Step 2:

[1354] The terminal packages the input information and sends it to the server via an HTTP request.

[1355] Step 3:

[1356] The server analyzes the received user information and generates a unique user_id.

[1357] The server saves the user information in the user_database and generates a successful registration message.

[1358] Step 4:

[1359] The server sends the generated registration success message to the terminal as an HTTP response.

[1360] The terminal receives the registration success message and displays it to the user.

[1361] Artist registration process steps

[1362] Step 1:

[1363] Artists enter necessary information such as their name, concert dates, and merchandise information into the account creation form.

[1364] Step 2:

[1365] The device packages the entered artist information and sends it to the server via an HTTP request.

[1366] Step 3:

[1367] The server parses the received artist information and generates a unique artist_id.

[1368] The server saves the artist information in the artist_database and generates a message confirming successful registration.

[1369] Step 4:

[1370] The server sends the generated registration success message to the terminal as an HTTP response.

[1371] The device receives a registration success message and displays it to the artist.

[1372] Artist information search processing steps

[1373] Step 1:

[1374] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[1375] Step 2:

[1376] The device packages the search query and the artist ID and sends it to the server via an HTTP request.

[1377] Step 3:

[1378] The server receives the search query and the artist ID and extracts the corresponding artist data from the artist database.

[1379] Step 4:

[1380] The server passes the extracted artist information to an AI model to generate relevant information for the search query.

[1381] The server transmits the generated related information to the terminal as an HTTP response.

[1382] Step 5:

[1383] The terminal receives the relevant information and displays it to the user.

[1384] Steps for processing conversations with your favorite idol

[1385] Step 1:

[1386] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[1387] Step 2:

[1388] The device packages the input message and the artist ID and sends it to the server via an HTTP request.

[1389] Step 3:

[1390] The server receives the message and the artist ID and extracts the artist's data from the artist database.

[1391] Step 4:

[1392] The server passes the extracted artist information to an AI model, which generates a reply message based on the artist's character.

[1393] The server sends the generated reply message to the terminal as an HTTP response.

[1394] Step 5:

[1395] The terminal receives the reply message and displays it to the user.

[1396] Promotion Management Process Steps

[1397] Step 1:

[1398] Artists enter promotional information (new concerts, merchandise information, etc.).

[1399] Step 2:

[1400] The terminal packages the entered promotion information and sends it to the server via an HTTP request.

[1401] Step 3:

[1402] The server receives the promotional information and stores it in an artist database.

[1403] Step 4:

[1404] The server matches the stored promotional information with the associated fan's user profile and generates the notification.

[1405] Step 5:

[1406] The server sends the generated notification to the device as an HTTP response.

[1407] Step 6:

[1408] The terminal receives the notification and displays the promotion information to the user.

[1409] Through these processing steps, LuvChat efficiently enables interactive communication between fans and artists and supports artists' promotional activities.

[1410] Example 1

[1411] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1412] In recent years, two-way communication between artists and fans has become increasingly important, but existing systems often make it difficult to achieve this. In particular, there is a lack of mechanisms for fans to send messages directly to artists or efficiently receive promotional information from artists. Furthermore, technology for effectively searching and extracting information registered in databases is also immature. A system that solves these problems and facilitates smooth interaction between artists and fans is needed.

[1413] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1414] In this invention, the server includes means for registering user information in a database, means for receiving user information input from a computer terminal, means for generating a unique identifier from the received user information, means for saving the identifier in a database, means for registering artist information in a database, means for receiving a search query from a user, means for using a generative AI model to extract related artist information based on the search query, means for presenting the extracted artist information to the user, means for receiving a message from the user, means for using a generative AI model to generate a reply message based on the artist's character based on the received message, means for sending the generated reply message to the user, means for the artist to input promotional information, means for saving the promotional information in a database, and means for notifying related users of the saved promotional information. This facilitates two-way communication between artists and fans and enables effective promotional activities.

[1415] The "user information registration means" is a function for storing basic information about a user in a database.

[1416] The "means for receiving information from a computer terminal" is a function for transmitting information entered by a user or artist to a server.

[1417] The "identifier generating means" is a function for generating a unique identification number from received user and artist information.

[1418] The "database storage means" is a function for storing the generated identifier and related information in a database.

[1419] The "artist information registration means" is a function for storing information provided by artists in a database.

[1420] The "search query receiving means" is a function that enables the server to receive a search request from a user.

[1421] "Means for extracting information using a generative AI model" is a function for processing and extracting relevant information using an AI model based on a search query.

[1422] The "information presentation means" is a function for displaying the extracted information to the user.

[1423] The "message receiving means" is a function that allows the server to receive messages sent by users.

[1424] "Means for generating replies using an AI model" is a function for generating reply messages using an AI model based on artist information.

[1425] The "reply sending means" is a function for sending the generated reply message to the user.

[1426] The "promotion information input means" is a function that allows artists to input new promotion information.

[1427] The "promotion information storage means" is a function for storing input promotion information in a database.

[1428] The "promotion information notification means" is a function for notifying related users of the saved promotion information.

[1429] This invention provides a system for promoting interaction between artists and fans and for efficiently promoting artists. The system links a server and terminals to realize two-way communication between users and artists. The system configuration and operation method of this invention will be specifically described below.

[1430] Comprehensive System Configuration

[1431] The system's hardware consists mainly of a server and a terminal. The server is a computer system containing a database and generative AI models, while the terminals are personal computers or smartphones used by users and artists. The software used includes database management systems (e.g., MySQL, MongoDB), AI models (e.g., GPT-3), and web servers (e.g., Apache, Nginx).

[1432] User Registration

[1433] 1. Enter and submit user information

[1434] The user enters basic information such as name, email address, and password, which is then sent from the device to the server.

[1435] Example: "Name: Yamada Taro", "Email address: taro@example.com", "Password: password123"

[1436] 2. Information analysis and data storage

[1437] The server analyzes the received user information, generates a unique identifier (user_id), and then stores the generated identifier and user information in a database.

[1438] Artist Registration

[1439] 1. Enter and submit the required information

[1440] The artist enters the necessary information, such as their name, concert dates, and merchandise information, and sends it from their terminal to the server.

[1441] Example: "Name: Artist A", "Concert date: 2023-12-01", "Merchandise information: New album"

[1442] 2. Information analysis and data storage

[1443] The server analyzes the received artist information, generates a unique identifier (artist_id), and then stores the generated identifier and artist information in a database.

[1444] Search for artist information

[1445] 1. Enter and submit a search query

[1446] A user inputs a query to search for information about an artist and sends it from the terminal to the server.

[1447] Example: "upcoming concerts"

[1448] 2. Information extraction and result display

[1449] The server retrieves relevant artist information from the database and uses a generative AI model to extract information based on the search query, which is then sent to the device and presented to the user.

[1450] Conversation with your favorite idol

[1451] 1. Enter and send a message

[1452] The user inputs a message to be sent to the artist and sends it from the terminal to the server.

[1453] Specific example: “I love your latest album!”

[1454] 2. Reply generation and result display

[1455] The server uses a generative AI model (e.g., GPT-3) based on the received message to generate a reply message based on the artist's character. The generated reply message is sent to the device and displayed to the user.

[1456] Promotion Management

[1457] 1. Enter and submit promotional information

[1458] Artists input promotional information such as new concert and new product information and send it from their terminals to the server.

[1459] Example: "New concert information"

[1460] 2. Information storage and notification

[1461] The server stores the received promotion information in a database and then sends a notification to the relevant fans, who then receive the notification and display the promotion information to the user.

[1462] Prompt Sentence Examples

[1463] Below are some example prompts to input to a generative AI model:

[1464] "Show me the next concert"

[1465] "Generate a reply to this message"

[1466] This system will facilitate two-way communication between artists and fans, enabling artists to carry out promotional activities more effectively.

[1467] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1468] User Registration

[1469] Step 1:

[1470] A user fills out an account creation form with basic information such as name, email address, and password.

[1471] Specific actions: Enter the required information into the form on your browser and click the "Register" button.

[1472] Input: Name, email address, and password entered by the user

[1473] Output: JSON format user information sent by the device to the server

[1474] Step 2:

[1475] The terminal transmits the input information to the server.

[1476] Specific operation: When the form is submitted, a JavaScript AJAX request is used to send user information in JSON format to the server.

[1477] Input: User information entered into the terminal

[1478] Output: User information received by the server in JSON format

[1479] Step 3:

[1480] The server analyzes the received user information and generates a unique identifier (user_id).

[1481] Specific operation: Using a program such as Python or Java, parse the received data and generate a unique ID using a hash function.

[1482] Input: User information in JSON format

[1483] Output: Generated user_id

[1484] Step 4:

[1485] The server stores the generated identifier and the user information in a database.

[1486] Specific operation: Uses SQL INSERT queries to write data to MySQL, MongoDB, etc.

[1487] Input: Generated user_id and user information

[1488] Output: User information stored in the database

[1489] Artist Registration

[1490] Step 1:

[1491] The artist enters the necessary information, such as name, concert dates, and merchandise information, into the artist registration form.

[1492] Specific actions: Fill out the required information in the dedicated form and click the "Register" button.

[1493] Input: Artist name, concert dates, merchandise information

[1494] Output: Artist information in JSON format sent by the device to the server

[1495] Step 2:

[1496] The terminal transmits the input information to the server.

[1497] Specific behavior: When the form is submitted, an AJAX request is used to send the artist information in JSON format to the server.

[1498] Input: Artist information entered on the device

[1499] Output: Artist information in JSON format as received by the server

[1500] Step 3:

[1501] The server analyzes the received artist information and generates a unique identifier (artist_id).

[1502] Specific behavior: Parse the received data and generate a unique ID.

[1503] Input: Artist information in JSON format

[1504] Output: Generated artist_id

[1505] Step 4:

[1506] The server stores the generated identifier and the artist information in a database.

[1507] Specific operation: Writes data to the database using an SQL INSERT query.

[1508] Input: Generated artist_id and artist information

[1509] Output: Artist information stored in the database

[1510] Search for artist information

[1511] Step 1:

[1512] A user enters a query to search for information about an artist.

[1513] Specific actions: Enter a keyword (e.g., "upcoming concerts") in the search bar and click the "Search" button.

[1514] Input: Search query

[1515] Output: The search query sent by the device to the server

[1516] Step 2:

[1517] The terminal transmits the input search query to the server.

[1518] What it does: Sends a search query to the server using an AJAX request.

[1519] Input: Search query entered into the device

[1520] Output: The search query received by the server

[1521] Step 3:

[1522] The server retrieves the relevant artist information from the database.

[1523] Specific behavior: Retrieves data using an SQL query.

[1524] Input: Search query

[1525] Output: Artist information retrieved from the database

[1526] Step 4:

[1527] The server uses a generative AI model to extract relevant information based on the acquired artist information.

[1528] Specific operation: Enter a prompt sentence into an AI model (e.g., GPT-3) built using Python or other language to extract information.

[1529] Input: Retrieved artist information

[1530] Output: Relevant information extracted by the AI ​​model

[1531] Step 5:

[1532] The server transmits the extracted information to the terminal and presents it to the user.

[1533] Specific operation: Sends JSON format data to the device and displays the information in HTML.

[1534] Input: Relevant information extracted by the AI ​​model

[1535] Output: Information displayed on the terminal

[1536] Conversation with your favorite idol

[1537] Step 1:

[1538] The user enters a message to send to the artist.

[1539] Specific behavior: Enter text in the message input field and click the "Send" button.

[1540] Input: Message text (e.g. "I love your latest album!")

[1541] Output: Message text that the terminal sends to the server

[1542] Step 2:

[1543] The device sends the message and the artist ID to the server.

[1544] Specific behavior: Sends a message to the server via an AJAX request.

[1545] Input: Message text and artist ID entered on the device

[1546] Output: Message text and artist ID received by the server

[1547] Step 3:

[1548] The server receives the message and generates a reply message using a generative AI model based on the artist information.

[1549] Specific operation: The message "Generate a reply to this message" is input as a prompt to an AI model (e.g., GPT-3), and a reply is generated.

[1550] Input: Message text and artist information

[1551] Output: The generated reply message

[1552] Step 4:

[1553] The server sends the generated reply message to the terminal and displays it to the user.

[1554] Specific operation: A reply message in JSON format is sent to the device and displayed on the chat screen.

[1555] Input: The generated reply message

[1556] Output: Reply message displayed on the terminal

[1557] Promotion Management

[1558] Step 1:

[1559] Artists enter promotional information such as new concerts and new product information.

[1560] Specific actions: Enter information into the promotion information input form and click the "Submit" button.

[1561] Input: Promotion information (e.g. new concert information)

[1562] Output: Promotion information sent by the device to the server

[1563] Step 2:

[1564] The terminal transmits the promotion information to the server.

[1565] Specific behavior: Sends information to the server via AJAX request.

[1566] Input: Promotion information entered into the device

[1567] Output: Promotion information received by the server

[1568] Step 3:

[1569] The server stores the received promotion information in a database.

[1570] Specific behavior: Saves to the database using an SQL INSERT query.

[1571] Input: Promotion information

[1572] Output: Promotion information stored in the database

[1573] Step 4:

[1574] The server sends a notification to the relevant user.

[1575] Specific behavior: Sends a push notification using the notification subscription information.

[1576] Input: Saved Promotion Information

[1577] Output: Notification displayed on the user's device

[1578] Step 5:

[1579] The user receives the notification and checks the promotion information.

[1580] What it does: Displays promotional information in the device's notification area and provides a link to learn more.

[1581] Input: Notification from the server

[1582] Output: A link to the promotion details that will be displayed on the device

[1583] (Application example 1)

[1584] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1585] In today's world, there is a need for direct interaction between artists and fans, and for artists to effectively promote themselves by utilizing physical stores. However, traditional methods have not fully realized the provision of artist information, real-time interaction with fans, or notifications of promotional activities. For this reason, a system is needed to deepen the relationship between artists and fans and maximize the effectiveness of promotions in physical stores.

[1586] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1587] In this invention, the server includes means for registering artist information in a database, means for receiving a search query from a user, means for extracting artist information based on the search query, means for presenting the extracted artist information to the user, means for searching for artist information in a physical store, means for sending a message to an artist through a display installed in the physical store, and means for notifying promotional information through a display in the physical store. This not only enables interaction between artists and fans in the physical store, but also enables effective promotional activities for artists.

[1588] "Artist information" is data including basic information about the artist, activity information, event schedules, promotional information, and the like.

[1589] "Database" means a digital data management system for storing artist information, user information, and message and promotional information.

[1590] A "search query" is a search string or keyword that a user enters to obtain artist information.

[1591] "Extraction" is the act of retrieving relevant information from a database based on a specific search query.

[1592] A "brick and mortar store" is a physical location where fans can find information about and interact with artists.

[1593] A "display" is a display device installed in a physical store to display artist information and promotional information.

[1594] A "Message" is a text or other form of communication sent by a User to an Artist.

[1595] "Promotional information" refers to information advertising new products, events, services, etc. that artists provide to their fans.

[1596] "Server" means a computer system for processing and managing artist information, user information, messages, and promotional information.

[1597] The "search query receiving means" is a function that enables the server to receive a search query from a user.

[1598] The "means for presenting artist information" is a means for displaying the extracted artist information to the user.

[1599] A "means for sending messages" is a means for sending user-generated text or other forms of communication to a server.

[1600] The "means for notifying promotion information" is a means for notifying related users of the stored promotion information.

[1601] This invention is a system for promoting interaction between artists and fans and effectively promoting artists in physical stores. The system has five main functions: registering artist information, receiving search queries from users, extracting and presenting artist information, interacting with fans in physical stores, and managing promotions.

[1602] 1. Registering artist information

[1603] The server has a means for registering artist information in a database. Information entered by the artist (such as name, event schedule, and promotion information) is sent from the terminal to the server, and the server stores it in the database. For example, if an artist enters "new concert information," the information is stored in the database and used to notify related users.

[1604] 2. Receiving a search query from a user

[1605] The server has a means for receiving a search query from a user. For example, when a user inputs a query to search for "concert information this weekend," the search query is sent from the terminal to the server. The server extracts related artist information from the database based on the search query.

[1606] 3. Extracting and presenting artist information

[1607] The server has a means for extracting artist information based on the search query and a means for presenting the extracted artist information to the user. For example, if a user searches for "pop singer's next concert information," the server extracts relevant information from the database and presents it to the user via the terminal. This allows the user to quickly obtain the artist information they are looking for.

[1608] 4. Interacting with fans in physical stores

[1609] The server has a means for sending messages to artists through displays installed in physical stores. Users visiting the physical stores can use the displays to send messages to artists. The received messages are processed by the server, and a generative AI model is used to generate a reply message based on the artist's character and send it to the user. For example, if a user sends a message saying, "I love your new song!", the server generates a reply such as, "Thank you! Please continue to support us!" and displays it to the user.

[1610] 5. Promotion Management

[1611] The server stores promotional information in a database and notifies relevant users. When an artist enters information about a new product, the information is stored in the database and notified to users. For example, when an artist registers a "new album release," the server sends a notification to relevant fans and displays the information on displays in stores and on users' terminals.

[1612] Examples of concrete examples and prompts

[1613] User Registration

[1614] Example: A user enters a username and email address to create their account.

[1615] Example prompt: Username: Fantaro, Email address: fan@example.com

[1616] Artist Registration

[1617] Example: A store manager registers artists for an in-store event.

[1618] Example prompt: Artist name: Pop singer, Information: Popular pop artist

[1619] Search for artist information

[1620] Example: Searching for event information for a specific artist within the app.

[1621] Example prompt: Search query: Upcoming concert information

[1622] Conversation with your favorite idol

[1623] Example: Users can send messages of support to artists through displays in stores.

[1624] Example prompt: Message: I love your new album!

[1625] Promotion Management

[1626] Example: Notifying fans of your store about new merchandise.

[1627] Example prompt: Promotion: Our new album is now on sale!

[1628] The above system will enable interactive interaction between artists and fans, and will enable effective promotional activities in physical stores.

[1629] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1630] Step 1:

[1631] User Registration

[1632] The device receives basic information entered by the user, such as a username and email address, and sends it to a server, which analyzes the information and generates a unique user ID, which is then stored in a database.

[1633] Input: Username, Email Address

[1634] Output: Unique user ID

[1635] What happens: A user enters information into an account creation form and presses the submit button. The device packages this information into a packet and sends it to the server as an HTTP request. The server analyzes the information, generates a new user ID, and stores it in a database.

[1636] Step 2:

[1637] Artist information registration

[1638] The server receives information entered by the artist (such as name, event schedule, and promotional information) from the device and stores it in a database. A unique artist ID is assigned to the artist information.

[1639] Input: Artist name, event schedule, promotion information

[1640] Output: Unique artist ID

[1641] Specific operation: The artist fills out the information form through the device and presses the submit button. The device sends the information to the server as an HTTP request. The server analyzes the information, generates a new artist ID, and saves it in the database.

[1642] Step 3:

[1643] Search for artist information

[1644] A user inputs a search query into a terminal and sends it to the server, which extracts relevant artist information from a database based on the received search query.

[1645] Input: Search query (e.g. "Upcoming concert information")

[1646] Output: Artist information as search results

[1647] Specific operation: The user enters a search query on the device and presses the search button. The device sends the search query to the server. The server uses a search algorithm to extract relevant artist information from the database.

[1648] Step 4:

[1649] View artist information

[1650] The server transmits the extracted artist information to the terminal and displays it to the user, who can then view the artist information as a search result on the terminal.

[1651] Input: Extracted artist information

[1652] Output: Artist information displayed on the user's device

[1653] Specific operation: The server sends the extracted artist information to the device as an HTTP response. The device analyzes this information and displays it in a user-friendly format.

[1654] Step 5:

[1655] Conversation with your favorite idol

[1656] The user inputs the message content into the device and sends it to the server, which uses the generative AI model based on the received message to generate a reply message based on the artist's character.

[1657] Input: User's message

[1658] Output: The generated reply message

[1659] How it works: A user types a message into their device and presses the send button. The device then sends the message to the server, which uses a generative AI model (e.g., GPT-3) to generate an artistic reply.

[1660] Step 6:

[1661] Displaying reply messages

[1662] The server sends the generated reply message to the terminal and displays it to the user, who can then view the reply message from the artist on the terminal.

[1663] Input: The generated reply message

[1664] Output: Reply message displayed on the user's terminal

[1665] Specific operation: The server generates a reply message and sends it to the terminal as an HTTP response. The terminal analyzes this message and displays it to the user.

[1666] Step 7:

[1667] Entering and notifying promotional information

[1668] The artist inputs new promotion information into the terminal and sends it to the server, which stores the received promotion information in a database and notifies the relevant users.

[1669] Input: New promotion information

[1670] Output: Notifications sent to relevant users

[1671] Specific operation: The artist enters new promotion information and presses the send button. The device sends the information to the server. The server saves the promotion information in the database and sends notifications to relevant users.

[1672] Step 8:

[1673] View promotion information

[1674] The server transmits the notified promotion information to the terminal and displays it to the user, who can then view the new promotion information on the terminal.

[1675] Input: Promotion information notified

[1676] Output: Promotion information displayed on the user's device

[1677] Specific operation: The server sends the promotion information to the terminal as an HTTP response. The terminal analyzes this information and displays it to the user.

[1678] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1679] This invention is a system for promoting interaction between artists and fans and for effectively promoting artists, and is characterized by the incorporation of an emotion engine that recognizes the emotions of users. This system links a server and terminals to realize two-way communication between users and artists.

[1680] System Configuration

[1681] The system has six main functions: user registration, artist registration, artist information search, interaction with favorite artists, promotion management, and emotion recognition.

[1682] 1. User Registration

[1683] The user enters basic information into an account creation form, which the device then sends to the server.

[1684] The server analyzes the received user information, generates a unique user_id, and stores it in the database.

[1685] 2. Artist registration

[1686] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the terminal sends this to the server.

[1687] The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[1688] 3. Search for artist information

[1689] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[1690] The device sends the search query and artist ID to the server.

[1691] The server retrieves artist information from a database and uses an AI model based on the search query to extract relevant information.

[1692] The extracted information is sent to the terminal and presented to the user.

[1693] Examples:

[1694] If a user wants to know about upcoming concerts by "Jane Smith," they enter the search query "upcoming concerts."

[1695] The device sends this query and the artist ID to the server, which retrieves information about "Jane Smith" from its database, searches for concert information using an AI model, and sends it back to the device.

[1696] The terminal displays the results to the user.

[1697] 4. Conversation with your idol

[1698] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[1699] The device sends the entered message and artist ID to the server.

[1700] The server receives the message and generates a reply message using an AI model based on the artist information.

[1701] The generated reply message is sent to the terminal and displayed to the user.

[1702] Examples:

[1703] If the user wants to send a message to "Jane Smith" saying "I love your latest album!", the device sends this to the server.

[1704] The server retrieves information about "Jane Smith" from the database and uses an AI model to generate a response: "Thank you for your message! I'm glad you liked it!"

[1705] The server sends the generated response to the terminal for display to the user.

[1706] 5. Promotion Management

[1707] The artist enters promotional information (such as new concert and merchandise information), and the device sends this to the server.

[1708] The server stores the received promotional information in a database and sends notifications to relevant fans.

[1709] The terminal that receives the notification displays the promotion information to the user.

[1710] Examples:

[1711] Artists register new concert information on the platform.

[1712] The device sends this to the server, which stores the information in a database.

[1713] The server sends notifications to relevant users, and the terminals display new concert information to the users.

[1714] 6. Emotion recognition

[1715] The emotion engine analyzes messages and search queries sent by users to recognize their emotions.

[1716] The server generates an appropriate reply message that is in line with the artist's character based on the recognized user's emotion.

[1717] The server customizes search results and promotional notifications based on the perceived sentiment.

[1718] Examples:

[1719] If a user sends a message saying "I am feeling down because I missed your last concert...", the terminal sends this to the server.

[1720] The server analyzes the message using an emotion engine and recognizes that the user's emotion is "sadness."

[1721] Based on the recognized emotion, the server generates a friendly reply message that is in keeping with the artist's character (e.g., "I'm sorry to hear that. I'll be performing again soon, and I hope to see you there!").

[1722] The server sends the generated reply message to the terminal and displays it to the user.

[1723] Through these processing steps, LuvChat efficiently facilitates interactive communication between fans and artists, supports artists' promotional activities, and provides more personalized communication through the use of an emotion engine.

[1724] The processing flow will be explained below.

[1725] User registration process steps

[1726] Step 1:

[1727] A user fills out an account creation form with required information, such as name, email address, and password.

[1728] Step 2:

[1729] The terminal packages the input information and sends it to the server via an HTTP request.

[1730] Step 3:

[1731] The server analyzes the received user information and generates a unique user_id.

[1732] The server saves the user information in the user_database and generates a successful registration message.

[1733] Step 4:

[1734] The server sends the generated registration success message to the terminal as an HTTP response.

[1735] The terminal receives the registration success message and displays it to the user.

[1736] Artist registration process steps

[1737] Step 1:

[1738] Artists enter necessary information such as their name, concert dates, and merchandise information into the account creation form.

[1739] Step 2:

[1740] The device packages the entered artist information and sends it to the server via an HTTP request.

[1741] Step 3:

[1742] The server parses the received artist information and generates a unique artist_id.

[1743] The server saves the artist information in the artist_database and generates a message confirming successful registration.

[1744] Step 4:

[1745] The server sends the generated registration success message to the terminal as an HTTP response.

[1746] The device receives a registration success message and displays it to the artist.

[1747] Artist information search processing steps

[1748] Step 1:

[1749] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[1750] Step 2:

[1751] The device packages the search query and the artist ID and sends it to the server via an HTTP request.

[1752] Step 3:

[1753] The server receives the search query and the artist ID and extracts the corresponding artist data from the artist database.

[1754] Step 4:

[1755] The server passes the extracted artist information to an AI model to generate relevant information for the search query.

[1756] The server transmits the generated related information to the terminal as an HTTP response.

[1757] Step 5:

[1758] The terminal receives the relevant information and displays it to the user.

[1759] Steps for processing conversations with your favorite idol

[1760] Step 1:

[1761] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[1762] Step 2:

[1763] The device packages the input message and the artist ID and sends it to the server via an HTTP request.

[1764] Step 3:

[1765] The server receives the message and the artist ID and extracts the artist's data from the artist database.

[1766] Step 4:

[1767] The server passes the extracted artist information to the emotion engine, which analyzes the user's emotions.

[1768] Step 5:

[1769] Based on the analysis results, the server generates a reply message that is in line with the artist's character.

[1770] The server sends the generated reply message to the terminal as an HTTP response.

[1771] Step 6:

[1772] The terminal receives the reply message and displays it to the user.

[1773] Promotion Management Process Steps

[1774] Step 1:

[1775] Artists enter promotional information (new concerts, merchandise information, etc.).

[1776] Step 2:

[1777] The terminal packages the entered promotion information and sends it to the server via an HTTP request.

[1778] Step 3:

[1779] The server receives the promotional information and stores it in an artist database.

[1780] Step 4:

[1781] The server matches the stored promotional information with the associated fan's user profile and generates the notification.

[1782] Step 5:

[1783] The server sends the generated notification to the device as an HTTP response.

[1784] Step 6:

[1785] The terminal receives the notification and displays the promotion information to the user.

[1786] Processing steps for emotion recognition

[1787] Step 1:

[1788] The user enters a message or search query and presses the send button.

[1789] Step 2:

[1790] The device packages the entered message or search query and sends it to the server via an HTTP request.

[1791] Step 3:

[1792] The server receives messages and search queries and passes them to the emotion engine.

[1793] The server obtains the analysis results from the emotion engine and recognizes the user's emotions.

[1794] Step 4:

[1795] The server generates appropriate reply messages and search results that are in line with the artist's character based on the recognized user's emotions.

[1796] The server sends the generated result to the terminal as an HTTP response.

[1797] Step 5:

[1798] The terminal receives the results and displays them to the user.

[1799] Through these processing steps, LuvChat efficiently facilitates interactive communication between fans and artists, supports artists' promotional activities, and provides more personalized communication through the use of an emotion engine.

[1800] Example 2

[1801] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1802] Conventional artist-fan interaction systems lacked personalized communication that took into account user emotions, and artist promotional activities were ineffective, resulting in low fan engagement with artists and limited promotional impact.

[1803] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1804] In this invention, the server includes means for registering artist information in a database, means for receiving search queries from users, means for extracting artist information based on the search queries, means for presenting the extracted artist information to users, means including an emotion recognition engine for analyzing user messages and search queries and recognizing emotions, and means for providing content based on the recognized emotions, thereby enabling personalized communication according to user emotions and effective promotional activities.

[1805] "Artist information" refers to information necessary for interacting with fans and promotional activities, such as the artist's name, concert dates, and merchandise information.

[1806] A "user search query" is a character string or keyword that a user enters when searching for artist information.

[1807] An "emotion recognition engine" is a technology that analyzes users' messages and search queries and determines their emotional state (e.g., joy, sadness, excitement, etc.) from their content.

[1808] A "unique ID" is a unique identifier that uniquely identifies each artist or user in the database.

[1809] "Content" refers to all information and messages provided to users, and specifically includes reply messages from artists, concert information, promotional information, and the like.

[1810] "Promotion information" refers to information about promotional activities that artists undertake to their fans, such as information about new concerts and merchandise.

[1811] A "user message" is a textual communication sent by a user to an artist.

[1812] A "reply message" is a response message generated by an artist or the system in response to a user's message.

[1813] The "means for receiving a search query" is a function that allows the system to obtain a search query entered by a user.

[1814] A "database" is an information system that systematically stores and manages data such as artist information and promotional information.

[1815] "Content provided based on emotions" refers to information and messages that are adapted to the user's emotional state as determined by an emotion recognition engine.

[1816] "Notification" refers to the means by which the system communicates information to users, and primarily refers to the communication of promotional information and updated information.

[1817] These definitions will provide a better understanding of the system's functions and components.

[1818] This invention is a system for promoting interaction between artists and fans and for effectively promoting artists. This system links a server and terminals to realize two-way communication between users and artists.

[1819] System Configuration

[1820] This system has the following six main functions:

[1821] 1. User Registration

[1822] 2. Artist registration

[1823] 3. Search for artist information

[1824] 4. Conversation with your idol

[1825] 5. Promotion Management

[1826] 6. Emotion recognition

[1827] 1. User Registration

[1828] The user enters basic information into the account creation form, and the device sends it to the server, which analyzes the received user information, generates a unique user_id, and stores it in the database.

[1829] 2. Artist registration

[1830] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the device sends this to the server. The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[1831] 3. Search for artist information

[1832] The user enters a search query (e.g., "upcoming concerts") on the artist information search screen. The device sends the search query and artist ID to the server. The server retrieves the artist information from the database and uses an AI model to extract relevant information. The extracted information is sent to the device and presented to the user.

[1833] For example, if a user wants to know about the next concert by "Artist A," they enter the search query "upcoming concerts." The device sends this query and the artist ID to the server, which retrieves information about "Artist A" from the database and returns the results of searching for concert information using an AI model. The device then displays the results to the user.

[1834] 4. Conversation with your idol

[1835] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!"). The device sends this to the server. The server receives the message and uses an AI model based on the artist information to generate a reply message. The generated reply message is sent to the device and displayed to the user.

[1836] As a concrete example, if a user wants to send a message to "Artist A" saying "I love your latest album!", the device sends this to the server. The server retrieves information about "Artist A" from the database and uses an AI model to generate a reply saying "Thank you for your message! I'm glad you liked it!" The server then sends the generated reply to the device and displays it to the user.

[1837] 5. Promotion Management

[1838] The artist enters promotional information (e.g., new concert or merchandise information). The device sends this to the server. The server stores the received promotional information in a database and sends notifications to relevant fans. The device receives the notifications and displays the promotional information to the user.

[1839] For example, an artist registers new concert information on the platform, the device sends it to the server, the server stores the information in a database, the server sends notifications to relevant users, and the device displays the new concert information to users.

[1840] 6. Emotion recognition

[1841] The emotion recognition engine analyzes messages and search queries sent by users to recognize their emotions. The server generates appropriate reply messages that are in line with the artist's character based on the recognized user emotions. The server also customizes search results and promotional notifications based on the recognized emotions.

[1842] As a concrete example, if a user sends a message such as "I am feeling down because I missed your last concert...", the device will send this to the server. The server will analyze the message using an emotion recognition engine and determine that the user's emotion is "sadness". Based on this recognition, the server will generate a kind reply message that is in line with the artist's character (e.g., "I'm sorry to hear that. I'll be performing again soon, and I hope to see you there!"). The server will then send the generated reply message to the device and display it to the user.

[1843] This system will enable efficient interactive exchange between fans and artists, supporting artists' promotional activities, and by using an emotion recognition engine, it will be possible to provide more personalized communication.

[1844] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1845] Step 1:

[1846] User fills out the account creation form with basic information.

[1847] The input information includes name, email address, password, etc. The device sends this information to the server. The server analyzes the received data and generates a unique user_id. The generated user_id and other information are stored in a database. This process registers the user information in the system.

[1848] Step 2:

[1849] The artist enters the required information (name, concert dates, merchandise information, etc.). The device sends this information to the server. The server analyzes the received artist information and generates a unique artist_id. The generated artist_id and other information are saved in the database. This process registers the artist information in the system.

[1850] Step 3:

[1851] The user enters a search query (e.g., "upcoming concerts") on the artist information search screen. The device sends the search query and artist ID to the server. The server analyzes the received query and retrieves the relevant artist information from the database. The server uses an AI model to extract relevant information. In doing so, it filters the information in the database based on the search query and extracts the relevant data. The extracted information is sent to the device and presented to the user. This process allows the user to confirm the artist information they are looking for.

[1852] Step 4:

[1853] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!"). The device sends this message and the artist ID to the server. The server analyzes the received message and obtains related artist information. The server uses an AI model to generate a reply message. The generated reply message is sent to the device and displayed to the user. This process allows the user to receive a reply from the artist.

[1854] Step 5:

[1855] The artist enters promotional information (such as new concert or merchandise information). The device sends this information to the server. The server stores the received promotional information in a database. The server sends notifications to relevant fans. The device receives the notifications and displays the promotional information to the user. This process allows fans to receive the latest promotional information.

[1856] Step 6:

[1857] Messages and search queries sent by users are analyzed using an emotion recognition engine. The device then sends this to the server. The server then analyzes the received data using the emotion recognition engine to recognize the user's emotions. The server then generates an appropriate reply message that is in line with the artist's character based on the recognized emotions. The generated message is then sent to the device and displayed to the user. This process allows the user to receive a reaction that is in line with their own emotions.

[1858] Through these processing steps, the system enables interactive exchange between users and artists, enabling more personalized communication. It also enables efficient promotional activities, maximizing the effectiveness of artists' promotions.

[1859] (Application example 2)

[1860] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1861] Traditional communication systems between artists and fans lacked a personalized experience, making it difficult to respond flexibly and interactively based on fans' emotions. Furthermore, promotional activities lacked the ability to provide specialized information tailored to individual fans' interests and emotions. This limited the effectiveness of artists' promotions and fan engagement.

[1862] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering artist information in a database, means for receiving a search query from a user, means for extracting artist information based on the search query, means for presenting the extracted artist information to the user, an emotion recognition engine for analyzing the user's emotions, means for personalizing communication between the user and the artist, and means for customizing and displaying artist information and promotions based on the user's emotions. This promotes interactive exchanges between artists and fans and enables personalized messages and promotional activities that reflect the fans' emotions.

[1863] "Artist information" refers to basic data about an artist, including their name, profile, concert dates, merchandise information, and more.

[1864] A "search query" is a text or character string that a user enters when searching for information.

[1865] An "emotion recognition engine" is a technology for analyzing and classifying a user's emotions from received text data and voice data.

[1866] "Personalization" means customizing services and information according to the characteristics, behavior, and emotions of individual users.

[1867] A "database" is a system for organizing and storing information, providing a means for retrieving, manipulating, and managing data based on specific criteria.

[1868] "Communication means" refers to the interfaces and protocols for sending and receiving data, and primarily refers to communication technology via the Internet.

[1869] A "prompt" is input text that gives specific instructions or conditions to an AI model.

[1870] A "generative AI model" is an artificial intelligence algorithm trained for natural language processing and data generation, such as an advanced language generation model such as GPT-4.

[1871] A "server" is a central computer that processes, stores, and manages data, and is responsible for providing information in response to requests from user terminals.

[1872] A "user" is an individual who uses this system to interact with artists and search for information.

[1873] A "message" is text data that a user sends to an artist.

[1874] The present invention is a system for promoting interaction between artists and fans, and in particular, realizes personalized interactive communication using an emotion recognition engine. Specific embodiments for carrying out the present invention are described below.

[1875] System Configuration

[1876] This system is mainly composed of a server, user terminal, database, emotion recognition engine, and generative AI model.

[1877] Hardware / Software used:

[1878] Smartphone or Head-Mounted Display (HMD): Oculus Quest 2

[1879] Server: Google Cloud Platform (GCP)

[1880] Emotion recognition engine: Amazon Comprehend from AWS

[1881] Generative AI model: OpenAI's GPT-4

[1882] Program processing flow

[1883] 1. User Registration:

[1884] The user enters basic information, which the terminal sends to the server.

[1885] The server analyzes the received information, generates a unique user ID, and stores it in a database.

[1886] 2. Artist Registration:

[1887] The artist enters the necessary information (name, concert dates, product information, etc.), and the terminal sends this to the server.

[1888] The server analyzes the received information, generates a unique artist ID, and stores it in a database.

[1889] 3. Search for artist information:

[1890] The user enters a search query, which the device sends to the server.

[1891] The server retrieves artist information from a database and uses AI models to extract relevant information.

[1892] The extracted information is presented to the user.

[1893] Examples:

[1894] When a user enters a search query such as "When is the next concert?", the device sends this to the server, which retrieves the next concert information for the corresponding artist from the database and displays the search results to the user.

[1895] 4. Emotion-aware dialogue:

[1896] The user types a message, which the terminal sends to the server.

[1897] The server uses an emotion recognition engine to analyze the emotion of the message.

[1898] A reply message is generated using a generative AI model (GPT-4) based on the analysis results.

[1899] The generated reply message is sent to the user.

[1900] Examples:

[1901] If a user sends a message saying, "I've been feeling sad lately...", the server will use its emotion recognition engine to analyze the emotion as "sad", and then use GPT-4 to generate a reply message such as, "I'm sorry to hear you're feeling down. I'll be releasing some new music soon, and I hope it cheers you up a little," and send it to the user.

[1902] Example prompt sentence:

[1903] "A user sends a message saying, 'I've been feeling sad lately...' Generate a response to this message that takes into account the user's sadness."

[1904] 5. Promotion Management:

[1905] The artist enters new promotional information, which the terminal then transmits to the server.

[1906] The server stores the received information in a database.

[1907] The stored promotion information is customized based on the user's emotions and past behavior data, and notified to relevant users.

[1908] Examples:

[1909] When an artist registers a new music video release, the server stores this information and sends customized notifications based on fans' recent interests and sentiment.

[1910] In this way, the system of the present invention realizes personalized interactive exchanges between artists and fans, and effectively supports promotional activities.

[1911] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1912] Step 1:

[1913] User Registration

[1914] The device sends the basic information entered by the user (name, email address, etc.) to the server.

[1915] The server analyzes the received basic information, generates a unique user ID, and stores it in a database. The input data is the user's basic information, and the output is the generated user ID.

[1916] Step 2:

[1917] Artist Registration

[1918] The terminal sends the information entered by the artist (such as name, concert dates, and product information) to the server.

[1919] The server analyzes the received artist information, generates a unique artist ID, and stores it in a database. The input data is basic information about the artist, and the output is the generated artist ID.

[1920] Step 3:

[1921] Search for artist information

[1922] The user enters a search query, which the device sends to the server.

[1923] The server extracts artist information from a database based on the entered search query.

[1924] The server uses an AI model to extract relevant information and sends the extracted artist information to the device for presentation. The input data is the search query, and the output is the artist information presented to the user.

[1925] Step 4:

[1926] Emotion-aware dialogue

[1927] The user types a message and sends it to the terminal.

[1928] The terminal sends the received message to the server.

[1929] The server analyzes the emotion of the message using an emotion recognition engine.

[1930] The server generates and inputs prompt sentences into the generative AI model based on the emotion analysis results, and obtains an appropriate reply.

[1931] The server sends the generated reply message to the terminal. The input data is the user's message, and the output is the reply message sent to the user.

[1932] Step 5:

[1933] Promotion Management

[1934] The artist enters new promotional information into the device and submits it.

[1935] The terminal transmits the received promotion information to the server.

[1936] The server stores the received promotion information in a database.

[1937] The server customizes the promotion information based on the user's past behavioral data and emotional data, and notifies the relevant users.

[1938] The terminal presents the stored promotion information to the user, with the promotion information being input data and the customized promotion information being reported as output.

[1939] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1940] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1941] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1942] [Fourth embodiment]

[1943] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1944] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1945] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1946] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1947] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1948] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1949] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1950] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1951] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1952] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1953] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1954] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1955] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1956] The present invention is a system for promoting interaction between artists and fans and for effectively promoting artists. This system links a server and terminals to realize two-way communication between users and artists.

[1957] System Configuration

[1958] The system has five main functions: user registration, artist registration, searching for artist information, interacting with favorite artists, and promotion management.

[1959] 1. User Registration

[1960] The user enters basic information into an account creation form, which the device then sends to the server.

[1961] The server analyzes the received user information, generates a unique user_id, and stores it in the database.

[1962] 2. Artist registration

[1963] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the terminal sends this to the server.

[1964] The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[1965] 3. Search for artist information

[1966] When a user searches for information about an artist, the device sends a search query (e.g., "upcoming concerts") to the server.

[1967] The server retrieves artist information from a database and uses an AI model based on the search query to extract relevant information.

[1968] The extracted information is sent to the terminal and presented to the user.

[1969] Examples:

[1970] If a user wants to know about upcoming concerts by "Jane Smith," they enter the search query "upcoming concerts."

[1971] The device sends this query and the artist ID to the server, which retrieves information about "Jane Smith" from its database, searches for concert information using an AI model, and sends it back to the device.

[1972] The terminal displays the results to the user.

[1973] 4. Conversation with your idol

[1974] When a user sends a message to an artist, the device sends the message and the artist ID to the server.

[1975] The server receives the message and generates a reply message using an AI model based on the artist information.

[1976] The generated reply message is sent to the terminal and displayed to the user.

[1977] Examples:

[1978] If the user wants to send a message to "Jane Smith" saying "I love your latest album!", the device sends this to the server.

[1979] The server retrieves information about "Jane Smith" from the database and uses an AI model to generate a response: "Thank you for your message! I'm glad you liked it!"

[1980] The server sends the generated response to the terminal for display to the user.

[1981] 5. Promotion Management

[1982] The artist enters promotional information (such as new concert or new product information), and the device sends this to the server.

[1983] The server stores the received promotional information in a database and sends notifications to relevant fans.

[1984] The terminal that receives the notification displays the promotion information to the user.

[1985] Examples:

[1986] Artists register new concert information on the platform.

[1987] The device sends this to the server, which stores the information in a database.

[1988] The server sends notifications to relevant users, and the terminals display new concert information to the users.

[1989] In this way, the present invention provides a system that allows interactive exchange between fans and artists and enables artists to efficiently carry out promotional activities.

[1990] The processing flow will be explained below.

[1991] User registration process steps

[1992] Step 1:

[1993] A user fills out an account creation form with required information, such as name, email address, and password.

[1994] Step 2:

[1995] The terminal packages the input information and sends it to the server via an HTTP request.

[1996] Step 3:

[1997] The server analyzes the received user information and generates a unique user_id.

[1998] The server saves the user information in the user_database and generates a successful registration message.

[1999] Step 4:

[2000] The server sends the generated registration success message to the terminal as an HTTP response.

[2001] The terminal receives the registration success message and displays it to the user.

[2002] Artist registration process steps

[2003] Step 1:

[2004] Artists enter necessary information such as their name, concert dates, and merchandise information into the account creation form.

[2005] Step 2:

[2006] The device packages the entered artist information and sends it to the server via an HTTP request.

[2007] Step 3:

[2008] The server parses the received artist information and generates a unique artist_id.

[2009] The server saves the artist information in the artist_database and generates a message confirming successful registration.

[2010] Step 4:

[2011] The server sends the generated registration success message to the terminal as an HTTP response.

[2012] The device receives a registration success message and displays it to the artist.

[2013] Artist information search processing steps

[2014] Step 1:

[2015] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[2016] Step 2:

[2017] The device packages the search query and the artist ID and sends it to the server via an HTTP request.

[2018] Step 3:

[2019] The server receives the search query and the artist ID and extracts the corresponding artist data from the artist database.

[2020] Step 4:

[2021] The server passes the extracted artist information to an AI model to generate relevant information for the search query.

[2022] The server transmits the generated related information to the terminal as an HTTP response.

[2023] Step 5:

[2024] The terminal receives the relevant information and displays it to the user.

[2025] Steps for processing conversations with your favorite idol

[2026] Step 1:

[2027] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[2028] Step 2:

[2029] The device packages the input message and the artist ID and sends it to the server via an HTTP request.

[2030] Step 3:

[2031] The server receives the message and the artist ID and extracts the artist's data from the artist database.

[2032] Step 4:

[2033] The server passes the extracted artist information to an AI model, which generates a reply message based on the artist's character.

[2034] The server sends the generated reply message to the terminal as an HTTP response.

[2035] Step 5:

[2036] The terminal receives the reply message and displays it to the user.

[2037] Promotion Management Process Steps

[2038] Step 1:

[2039] Artists enter promotional information (new concerts, merchandise information, etc.).

[2040] Step 2:

[2041] The terminal packages the entered promotion information and sends it to the server via an HTTP request.

[2042] Step 3:

[2043] The server receives the promotional information and stores it in an artist database.

[2044] Step 4:

[2045] The server matches the stored promotional information with the associated fan's user profile and generates the notification.

[2046] Step 5:

[2047] The server sends the generated notification to the device as an HTTP response.

[2048] Step 6:

[2049] The terminal receives the notification and displays the promotion information to the user.

[2050] Through these processing steps, LuvChat efficiently enables interactive communication between fans and artists and supports artists' promotional activities.

[2051] Example 1

[2052] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2053] In recent years, two-way communication between artists and fans has become increasingly important, but existing systems often make it difficult to achieve this. In particular, there is a lack of mechanisms for fans to send messages directly to artists or efficiently receive promotional information from artists. Furthermore, technology for effectively searching and extracting information registered in databases is also immature. A system that solves these problems and facilitates smooth interaction between artists and fans is needed.

[2054] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2055] In this invention, the server includes means for registering user information in a database, means for receiving user information input from a computer terminal, means for generating a unique identifier from the received user information, means for saving the identifier in a database, means for registering artist information in a database, means for receiving a search query from a user, means for using a generative AI model to extract related artist information based on the search query, means for presenting the extracted artist information to the user, means for receiving a message from the user, means for using a generative AI model to generate a reply message based on the artist's character based on the received message, means for sending the generated reply message to the user, means for the artist to input promotional information, means for saving the promotional information in a database, and means for notifying related users of the saved promotional information. This facilitates two-way communication between artists and fans and enables effective promotional activities.

[2056] The "user information registration means" is a function for storing basic information about a user in a database.

[2057] The "means for receiving information from a computer terminal" is a function for transmitting information entered by a user or artist to a server.

[2058] The "identifier generating means" is a function for generating a unique identification number from received user and artist information.

[2059] The "database storage means" is a function for storing the generated identifier and related information in a database.

[2060] The "artist information registration means" is a function for storing information provided by artists in a database.

[2061] The "search query receiving means" is a function that enables the server to receive a search request from a user.

[2062] "Means for extracting information using a generative AI model" is a function for processing and extracting relevant information using an AI model based on a search query.

[2063] The "information presentation means" is a function for displaying the extracted information to the user.

[2064] The "message receiving means" is a function that allows the server to receive messages sent by users.

[2065] "Means for generating replies using an AI model" is a function for generating reply messages using an AI model based on artist information.

[2066] The "reply sending means" is a function for sending the generated reply message to the user.

[2067] The "promotion information input means" is a function that allows artists to input new promotion information.

[2068] The "promotion information storage means" is a function for storing input promotion information in a database.

[2069] The "promotion information notification means" is a function for notifying related users of the saved promotion information.

[2070] This invention provides a system for promoting interaction between artists and fans and for efficiently promoting artists. The system links a server and terminals to realize two-way communication between users and artists. The system configuration and operation method of this invention will be specifically described below.

[2071] Comprehensive System Configuration

[2072] The system's hardware consists mainly of a server and a terminal. The server is a computer system containing a database and generative AI models, while the terminals are personal computers or smartphones used by users and artists. The software used includes database management systems (e.g., MySQL, MongoDB), AI models (e.g., GPT-3), and web servers (e.g., Apache, Nginx).

[2073] User Registration

[2074] 1. Enter and submit user information

[2075] The user enters basic information such as name, email address, and password, which is then sent from the device to the server.

[2076] Example: "Name: Yamada Taro", "Email address: taro@example.com", "Password: password123"

[2077] 2. Information analysis and data storage

[2078] The server analyzes the received user information, generates a unique identifier (user_id), and then stores the generated identifier and user information in a database.

[2079] Artist Registration

[2080] 1. Enter and submit the required information

[2081] The artist enters the necessary information, such as their name, concert dates, and merchandise information, and sends it from their terminal to the server.

[2082] Example: "Name: Artist A", "Concert date: 2023-12-01", "Merchandise information: New album"

[2083] 2. Information analysis and data storage

[2084] The server analyzes the received artist information, generates a unique identifier (artist_id), and then stores the generated identifier and artist information in a database.

[2085] Search for artist information

[2086] 1. Enter and submit a search query

[2087] A user inputs a query to search for information about an artist and sends it from the terminal to the server.

[2088] Example: "upcoming concerts"

[2089] 2. Information extraction and result display

[2090] The server retrieves relevant artist information from the database and uses a generative AI model to extract information based on the search query, which is then sent to the device and presented to the user.

[2091] Conversation with your favorite idol

[2092] 1. Enter and send a message

[2093] The user inputs a message to be sent to the artist and sends it from the terminal to the server.

[2094] Specific example: “I love your latest album!”

[2095] 2. Reply generation and result display

[2096] The server uses a generative AI model (e.g., GPT-3) based on the received message to generate a reply message based on the artist's character. The generated reply message is sent to the device and displayed to the user.

[2097] Promotion Management

[2098] 1. Enter and submit promotional information

[2099] Artists input promotional information such as new concert and new product information and send it from their terminals to the server.

[2100] Example: "New concert information"

[2101] 2. Information storage and notification

[2102] The server stores the received promotion information in a database and then sends a notification to the relevant fans, who then receive the notification and display the promotion information to the user.

[2103] Prompt Sentence Examples

[2104] Below are some example prompts to input to a generative AI model:

[2105] "Show me the next concert"

[2106] "Generate a reply to this message"

[2107] This system will facilitate two-way communication between artists and fans, enabling artists to carry out promotional activities more effectively.

[2108] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2109] User Registration

[2110] Step 1:

[2111] A user fills out an account creation form with basic information such as name, email address, and password.

[2112] Specific actions: Enter the required information into the form on your browser and click the "Register" button.

[2113] Input: Name, email address, and password entered by the user

[2114] Output: JSON format user information sent by the device to the server

[2115] Step 2:

[2116] The terminal transmits the input information to the server.

[2117] Specific operation: When the form is submitted, a JavaScript AJAX request is used to send user information in JSON format to the server.

[2118] Input: User information entered into the terminal

[2119] Output: User information received by the server in JSON format

[2120] Step 3:

[2121] The server analyzes the received user information and generates a unique identifier (user_id).

[2122] Specific operation: Using a program such as Python or Java, parse the received data and generate a unique ID using a hash function.

[2123] Input: User information in JSON format

[2124] Output: Generated user_id

[2125] Step 4:

[2126] The server stores the generated identifier and the user information in a database.

[2127] Specific operation: Uses SQL INSERT queries to write data to MySQL, MongoDB, etc.

[2128] Input: Generated user_id and user information

[2129] Output: User information stored in the database

[2130] Artist Registration

[2131] Step 1:

[2132] The artist enters the necessary information, such as name, concert dates, and merchandise information, into the artist registration form.

[2133] Specific actions: Fill out the required information in the dedicated form and click the "Register" button.

[2134] Input: Artist name, concert dates, merchandise information

[2135] Output: Artist information in JSON format sent by the device to the server

[2136] Step 2:

[2137] The terminal transmits the input information to the server.

[2138] Specific behavior: When the form is submitted, an AJAX request is used to send the artist information in JSON format to the server.

[2139] Input: Artist information entered on the device

[2140] Output: Artist information in JSON format as received by the server

[2141] Step 3:

[2142] The server analyzes the received artist information and generates a unique identifier (artist_id).

[2143] Specific behavior: Parse the received data and generate a unique ID.

[2144] Input: Artist information in JSON format

[2145] Output: Generated artist_id

[2146] Step 4:

[2147] The server stores the generated identifier and the artist information in a database.

[2148] Specific operation: Writes data to the database using an SQL INSERT query.

[2149] Input: Generated artist_id and artist information

[2150] Output: Artist information stored in the database

[2151] Search for artist information

[2152] Step 1:

[2153] A user enters a query to search for information about an artist.

[2154] Specific actions: Enter a keyword (e.g., "upcoming concerts") in the search bar and click the "Search" button.

[2155] Input: Search query

[2156] Output: The search query sent by the device to the server

[2157] Step 2:

[2158] The terminal transmits the input search query to the server.

[2159] What it does: Sends a search query to the server using an AJAX request.

[2160] Input: Search query entered into the device

[2161] Output: The search query received by the server

[2162] Step 3:

[2163] The server retrieves the relevant artist information from the database.

[2164] Specific behavior: Retrieves data using an SQL query.

[2165] Input: Search query

[2166] Output: Artist information retrieved from the database

[2167] Step 4:

[2168] The server uses a generative AI model to extract relevant information based on the acquired artist information.

[2169] Specific operation: Enter a prompt sentence into an AI model (e.g., GPT-3) built using Python or other language to extract information.

[2170] Input: Retrieved artist information

[2171] Output: Relevant information extracted by the AI ​​model

[2172] Step 5:

[2173] The server transmits the extracted information to the terminal and presents it to the user.

[2174] Specific operation: Sends JSON format data to the device and displays the information in HTML.

[2175] Input: Relevant information extracted by the AI ​​model

[2176] Output: Information displayed on the terminal

[2177] Conversation with your favorite idol

[2178] Step 1:

[2179] The user enters a message to send to the artist.

[2180] Specific behavior: Enter text in the message input field and click the "Send" button.

[2181] Input: Message text (e.g. "I love your latest album!")

[2182] Output: Message text that the terminal sends to the server

[2183] Step 2:

[2184] The device sends the message and the artist ID to the server.

[2185] Specific behavior: Sends a message to the server via an AJAX request.

[2186] Input: Message text and artist ID entered on the device

[2187] Output: Message text and artist ID received by the server

[2188] Step 3:

[2189] The server receives the message and generates a reply message using a generative AI model based on the artist information.

[2190] Specific operation: The message "Generate a reply to this message" is input as a prompt to an AI model (e.g., GPT-3), and a reply is generated.

[2191] Input: Message text and artist information

[2192] Output: The generated reply message

[2193] Step 4:

[2194] The server sends the generated reply message to the terminal and displays it to the user.

[2195] Specific operation: A reply message in JSON format is sent to the device and displayed on the chat screen.

[2196] Input: The generated reply message

[2197] Output: Reply message displayed on the terminal

[2198] Promotion Management

[2199] Step 1:

[2200] Artists enter promotional information such as new concerts and new product information.

[2201] Specific actions: Enter information into the promotion information input form and click the "Submit" button.

[2202] Input: Promotion information (e.g. new concert information)

[2203] Output: Promotion information sent by the device to the server

[2204] Step 2:

[2205] The terminal transmits the promotion information to the server.

[2206] Specific behavior: Sends information to the server via AJAX request.

[2207] Input: Promotion information entered into the device

[2208] Output: Promotion information received by the server

[2209] Step 3:

[2210] The server stores the received promotion information in a database.

[2211] Specific behavior: Saves to the database using an SQL INSERT query.

[2212] Input: Promotion information

[2213] Output: Promotion information stored in the database

[2214] Step 4:

[2215] The server sends a notification to the relevant user.

[2216] Specific behavior: Sends a push notification using the notification subscription information.

[2217] Input: Saved Promotion Information

[2218] Output: Notification displayed on the user's device

[2219] Step 5:

[2220] The user receives the notification and checks the promotion information.

[2221] What it does: Displays promotional information in the device's notification area and provides a link to learn more.

[2222] Input: Notification from the server

[2223] Output: A link to the promotion details that will be displayed on the device

[2224] (Application example 1)

[2225] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2226] In today's world, there is a need for direct interaction between artists and fans, and for artists to effectively promote themselves by utilizing physical stores. However, traditional methods have not fully realized the provision of artist information, real-time interaction with fans, or notifications of promotional activities. For this reason, a system is needed to deepen the relationship between artists and fans and maximize the effectiveness of promotions in physical stores.

[2227] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2228] In this invention, the server includes means for registering artist information in a database, means for receiving a search query from a user, means for extracting artist information based on the search query, means for presenting the extracted artist information to the user, means for searching for artist information in a physical store, means for sending a message to an artist through a display installed in the physical store, and means for notifying promotional information through a display in the physical store. This not only enables interaction between artists and fans in the physical store, but also enables effective promotional activities for artists.

[2229] "Artist information" is data including basic information about the artist, activity information, event schedules, promotional information, and the like.

[2230] "Database" means a digital data management system for storing artist information, user information, and message and promotional information.

[2231] A "search query" is a search string or keyword that a user enters to obtain artist information.

[2232] "Extraction" is the act of retrieving relevant information from a database based on a specific search query.

[2233] A "brick and mortar store" is a physical location where fans can find information about and interact with artists.

[2234] A "display" is a display device installed in a physical store to display artist information and promotional information.

[2235] A "Message" is a text or other form of communication sent by a User to an Artist.

[2236] "Promotional information" refers to information advertising new products, events, services, etc. that artists provide to their fans.

[2237] "Server" means a computer system for processing and managing artist information, user information, messages, and promotional information.

[2238] The "search query receiving means" is a function that enables the server to receive a search query from a user.

[2239] The "means for presenting artist information" is a means for displaying the extracted artist information to the user.

[2240] A "means for sending messages" is a means for sending user-generated text or other forms of communication to a server.

[2241] The "means for notifying promotion information" is a means for notifying related users of the stored promotion information.

[2242] This invention is a system for promoting interaction between artists and fans and effectively promoting artists in physical stores. The system has five main functions: registering artist information, receiving search queries from users, extracting and presenting artist information, interacting with fans in physical stores, and managing promotions.

[2243] 1. Registering artist information

[2244] The server has a means for registering artist information in a database. Information entered by the artist (such as name, event schedule, and promotion information) is sent from the terminal to the server, and the server stores it in the database. For example, if an artist enters "new concert information," the information is stored in the database and used to notify related users.

[2245] 2. Receiving a search query from a user

[2246] The server has a means for receiving a search query from a user. For example, when a user inputs a query to search for "concert information this weekend," the search query is sent from the terminal to the server. The server extracts related artist information from the database based on the search query.

[2247] 3. Extracting and presenting artist information

[2248] The server has a means for extracting artist information based on the search query and a means for presenting the extracted artist information to the user. For example, if a user searches for "pop singer's next concert information," the server extracts relevant information from the database and presents it to the user via the terminal. This allows the user to quickly obtain the artist information they are looking for.

[2249] 4. Interacting with fans in physical stores

[2250] The server has a means for sending messages to artists through displays installed in physical stores. Users visiting the physical stores can use the displays to send messages to artists. The received messages are processed by the server, and a generative AI model is used to generate a reply message based on the artist's character and send it to the user. For example, if a user sends a message saying, "I love your new song!", the server generates a reply such as, "Thank you! Please continue to support us!" and displays it to the user.

[2251] 5. Promotion Management

[2252] The server stores promotional information in a database and notifies relevant users. When an artist enters information about a new product, the information is stored in the database and notified to users. For example, when an artist registers a "new album release," the server sends a notification to relevant fans and displays the information on displays in stores and on users' terminals.

[2253] Examples of concrete examples and prompts

[2254] User Registration

[2255] Example: A user enters a username and email address to create their account.

[2256] Example prompt: Username: Fantaro, Email address: fan@example.com

[2257] Artist Registration

[2258] Example: A store manager registers artists for an in-store event.

[2259] Example prompt: Artist name: Pop singer, Information: Popular pop artist

[2260] Search for artist information

[2261] Example: Searching for event information for a specific artist within the app.

[2262] Example prompt: Search query: Upcoming concert information

[2263] Conversation with your favorite idol

[2264] Example: Users can send messages of support to artists through displays in stores.

[2265] Example prompt: Message: I love your new album!

[2266] Promotion Management

[2267] Example: Notifying fans of your store about new merchandise.

[2268] Example prompt: Promotion: Our new album is now on sale!

[2269] The above system will enable interactive interaction between artists and fans, and will enable effective promotional activities in physical stores.

[2270] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2271] Step 1:

[2272] User Registration

[2273] The device receives basic information entered by the user, such as a username and email address, and sends it to a server, which analyzes the information and generates a unique user ID, which is then stored in a database.

[2274] Input: Username, Email Address

[2275] Output: Unique user ID

[2276] What happens: A user enters information into an account creation form and presses the submit button. The device packages this information into a packet and sends it to the server as an HTTP request. The server analyzes the information, generates a new user ID, and stores it in a database.

[2277] Step 2:

[2278] Artist information registration

[2279] The server receives information entered by the artist (such as name, event schedule, and promotional information) from the device and stores it in a database. A unique artist ID is assigned to the artist information.

[2280] Input: Artist name, event schedule, promotion information

[2281] Output: Unique artist ID

[2282] Specific operation: The artist fills out the information form through the device and presses the submit button. The device sends the information to the server as an HTTP request. The server analyzes the information, generates a new artist ID, and saves it in the database.

[2283] Step 3:

[2284] Search for artist information

[2285] A user inputs a search query into a terminal and sends it to the server, which extracts relevant artist information from a database based on the received search query.

[2286] Input: Search query (e.g. "Upcoming concert information")

[2287] Output: Artist information as search results

[2288] Specific operation: The user enters a search query on the device and presses the search button. The device sends the search query to the server. The server uses a search algorithm to extract relevant artist information from the database.

[2289] Step 4:

[2290] View artist information

[2291] The server transmits the extracted artist information to the terminal and displays it to the user, who can then view the artist information as a search result on the terminal.

[2292] Input: Extracted artist information

[2293] Output: Artist information displayed on the user's device

[2294] Specific operation: The server sends the extracted artist information to the device as an HTTP response. The device analyzes this information and displays it in a user-friendly format.

[2295] Step 5:

[2296] Conversation with your favorite idol

[2297] The user inputs the message content into the device and sends it to the server, which uses the generative AI model based on the received message to generate a reply message based on the artist's character.

[2298] Input: User's message

[2299] Output: The generated reply message

[2300] How it works: A user types a message into their device and presses the send button. The device then sends the message to the server, which uses a generative AI model (e.g., GPT-3) to generate an artistic reply.

[2301] Step 6:

[2302] Displaying reply messages

[2303] The server sends the generated reply message to the terminal and displays it to the user, who can then view the reply message from the artist on the terminal.

[2304] Input: The generated reply message

[2305] Output: Reply message displayed on the user's terminal

[2306] Specific operation: The server generates a reply message and sends it to the terminal as an HTTP response. The terminal analyzes this message and displays it to the user.

[2307] Step 7:

[2308] Entering and notifying promotional information

[2309] The artist inputs new promotion information into the terminal and sends it to the server, which stores the received promotion information in a database and notifies the relevant users.

[2310] Input: New promotion information

[2311] Output: Notifications sent to relevant users

[2312] Specific operation: The artist enters new promotion information and presses the send button. The device sends the information to the server. The server saves the promotion information in the database and sends notifications to relevant users.

[2313] Step 8:

[2314] View promotion information

[2315] The server transmits the notified promotion information to the terminal and displays it to the user, who can then view the new promotion information on the terminal.

[2316] Input: Promotion information notified

[2317] Output: Promotion information displayed on the user's device

[2318] Specific operation: The server sends the promotion information to the terminal as an HTTP response. The terminal analyzes this information and displays it to the user.

[2319] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2320] This invention is a system for promoting interaction between artists and fans and for effectively promoting artists, and is characterized by the incorporation of an emotion engine that recognizes the emotions of users. This system links a server and terminals to realize two-way communication between users and artists.

[2321] System Configuration

[2322] The system has six main functions: user registration, artist registration, artist information search, interaction with favorite artists, promotion management, and emotion recognition.

[2323] 1. User Registration

[2324] The user enters basic information into an account creation form, which the device then sends to the server.

[2325] The server analyzes the received user information, generates a unique user_id, and stores it in the database.

[2326] 2. Artist registration

[2327] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the terminal sends this to the server.

[2328] The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[2329] 3. Search for artist information

[2330] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[2331] The device sends the search query and artist ID to the server.

[2332] The server retrieves artist information from a database and uses an AI model based on the search query to extract relevant information.

[2333] The extracted information is sent to the terminal and presented to the user.

[2334] Examples:

[2335] If a user wants to know about upcoming concerts by "Jane Smith," they enter the search query "upcoming concerts."

[2336] The device sends this query and the artist ID to the server, which retrieves information about "Jane Smith" from its database, searches for concert information using an AI model, and sends it back to the device.

[2337] The terminal displays the results to the user.

[2338] 4. Conversation with your idol

[2339] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[2340] The device sends the entered message and artist ID to the server.

[2341] The server receives the message and generates a reply message using an AI model based on the artist information.

[2342] The generated reply message is sent to the terminal and displayed to the user.

[2343] Examples:

[2344] If the user wants to send a message to "Jane Smith" saying "I love your latest album!", the device sends this to the server.

[2345] The server retrieves information about "Jane Smith" from the database and uses an AI model to generate a response: "Thank you for your message! I'm glad you liked it!"

[2346] The server sends the generated response to the terminal for display to the user.

[2347] 5. Promotion Management

[2348] The artist enters promotional information (such as new concert and merchandise information), and the device sends this to the server.

[2349] The server stores the received promotional information in a database and sends notifications to relevant fans.

[2350] The terminal that receives the notification displays the promotion information to the user.

[2351] Examples:

[2352] Artists register new concert information on the platform.

[2353] The device sends this to the server, which stores the information in a database.

[2354] The server sends notifications to relevant users, and the terminals display new concert information to the users.

[2355] 6. Emotion recognition

[2356] The emotion engine analyzes messages and search queries sent by users to recognize their emotions.

[2357] The server generates an appropriate reply message that is in line with the artist's character based on the recognized user's emotion.

[2358] The server customizes search results and promotional notifications based on the perceived sentiment.

[2359] Examples:

[2360] If a user sends a message saying "I am feeling down because I missed your last concert...", the terminal sends this to the server.

[2361] The server analyzes the message using an emotion engine and recognizes that the user's emotion is "sadness."

[2362] Based on the recognized emotion, the server generates a friendly reply message that is in keeping with the artist's character (e.g., "I'm sorry to hear that. I'll be performing again soon, and I hope to see you there!").

[2363] The server sends the generated reply message to the terminal and displays it to the user.

[2364] Through these processing steps, LuvChat efficiently facilitates interactive communication between fans and artists, supports artists' promotional activities, and provides more personalized communication through the use of an emotion engine.

[2365] The processing flow will be explained below.

[2366] User registration process steps

[2367] Step 1:

[2368] A user fills out an account creation form with required information, such as name, email address, and password.

[2369] Step 2:

[2370] The terminal packages the input information and sends it to the server via an HTTP request.

[2371] Step 3:

[2372] The server analyzes the received user information and generates a unique user_id.

[2373] The server saves the user information in the user_database and generates a successful registration message.

[2374] Step 4:

[2375] The server sends the generated registration success message to the terminal as an HTTP response.

[2376] The terminal receives the registration success message and displays it to the user.

[2377] Artist registration process steps

[2378] Step 1:

[2379] Artists enter necessary information such as their name, concert dates, and merchandise information into the account creation form.

[2380] Step 2:

[2381] The device packages the entered artist information and sends it to the server via an HTTP request.

[2382] Step 3:

[2383] The server parses the received artist information and generates a unique artist_id.

[2384] The server saves the artist information in the artist_database and generates a message confirming successful registration.

[2385] Step 4:

[2386] The server sends the generated registration success message to the terminal as an HTTP response.

[2387] The device receives a registration success message and displays it to the artist.

[2388] Artist information search processing steps

[2389] Step 1:

[2390] A user enters a search query (e.g., "upcoming concerts") on the artist information search screen.

[2391] Step 2:

[2392] The device packages the search query and the artist ID and sends it to the server via an HTTP request.

[2393] Step 3:

[2394] The server receives the search query and the artist ID and extracts the corresponding artist data from the artist database.

[2395] Step 4:

[2396] The server passes the extracted artist information to an AI model to generate relevant information for the search query.

[2397] The server transmits the generated related information to the terminal as an HTTP response.

[2398] Step 5:

[2399] The terminal receives the relevant information and displays it to the user.

[2400] Steps for processing conversations with your favorite idol

[2401] Step 1:

[2402] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!").

[2403] Step 2:

[2404] The device packages the input message and the artist ID and sends it to the server via an HTTP request.

[2405] Step 3:

[2406] The server receives the message and the artist ID and extracts the artist's data from the artist database.

[2407] Step 4:

[2408] The server passes the extracted artist information to the emotion engine, which analyzes the user's emotions.

[2409] Step 5:

[2410] Based on the analysis results, the server generates a reply message that is in line with the artist's character.

[2411] The server sends the generated reply message to the terminal as an HTTP response.

[2412] Step 6:

[2413] The terminal receives the reply message and displays it to the user.

[2414] Promotion Management Process Steps

[2415] Step 1:

[2416] Artists enter promotional information (new concerts, merchandise information, etc.).

[2417] Step 2:

[2418] The terminal packages the entered promotion information and sends it to the server via an HTTP request.

[2419] Step 3:

[2420] The server receives the promotional information and stores it in an artist database.

[2421] Step 4:

[2422] The server matches the stored promotional information with the associated fan's user profile and generates the notification.

[2423] Step 5:

[2424] The server sends the generated notification to the device as an HTTP response.

[2425] Step 6:

[2426] The terminal receives the notification and displays the promotion information to the user.

[2427] Processing steps for emotion recognition

[2428] Step 1:

[2429] The user enters a message or search query and presses the send button.

[2430] Step 2:

[2431] The device packages the entered message or search query and sends it to the server via an HTTP request.

[2432] Step 3:

[2433] The server receives messages and search queries and passes them to the emotion engine.

[2434] The server obtains the analysis results from the emotion engine and recognizes the user's emotions.

[2435] Step 4:

[2436] The server generates appropriate reply messages and search results that are in line with the artist's character based on the recognized user's emotions.

[2437] The server sends the generated result to the terminal as an HTTP response.

[2438] Step 5:

[2439] The terminal receives the results and displays them to the user.

[2440] Through these processing steps, LuvChat efficiently facilitates interactive communication between fans and artists, supports artists' promotional activities, and provides more personalized communication through the use of an emotion engine.

[2441] Example 2

[2442] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2443] Conventional artist-fan interaction systems lacked personalized communication that took into account user emotions, and artist promotional activities were ineffective, resulting in low fan engagement with artists and limited promotional impact.

[2444] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2445] In this invention, the server includes means for registering artist information in a database, means for receiving search queries from users, means for extracting artist information based on the search queries, means for presenting the extracted artist information to users, means including an emotion recognition engine for analyzing user messages and search queries and recognizing emotions, and means for providing content based on the recognized emotions, thereby enabling personalized communication according to user emotions and effective promotional activities.

[2446] "Artist information" refers to information necessary for interacting with fans and promotional activities, such as the artist's name, concert dates, and merchandise information.

[2447] A "user search query" is a character string or keyword that a user enters when searching for artist information.

[2448] An "emotion recognition engine" is a technology that analyzes users' messages and search queries and determines their emotional state (e.g., joy, sadness, excitement, etc.) from their content.

[2449] A "unique ID" is a unique identifier that uniquely identifies each artist or user in the database.

[2450] "Content" refers to all information and messages provided to users, and specifically includes reply messages from artists, concert information, promotional information, and the like.

[2451] "Promotion information" refers to information about promotional activities that artists undertake to their fans, such as information about new concerts and merchandise.

[2452] A "user message" is a textual communication sent by a user to an artist.

[2453] A "reply message" is a response message generated by an artist or the system in response to a user's message.

[2454] The "means for receiving a search query" is a function that allows the system to obtain a search query entered by a user.

[2455] A "database" is an information system that systematically stores and manages data such as artist information and promotional information.

[2456] "Content provided based on emotions" refers to information and messages that are adapted to the user's emotional state as determined by an emotion recognition engine.

[2457] "Notification" refers to the means by which the system communicates information to users, and primarily refers to the communication of promotional information and updated information.

[2458] These definitions will provide a better understanding of the system's functions and components.

[2459] This invention is a system for promoting interaction between artists and fans and for effectively promoting artists. This system links a server and terminals to realize two-way communication between users and artists.

[2460] System Configuration

[2461] This system has the following six main functions:

[2462] 1. User Registration

[2463] 2. Artist registration

[2464] 3. Search for artist information

[2465] 4. Conversation with your idol

[2466] 5. Promotion Management

[2467] 6. Emotion recognition

[2468] 1. User Registration

[2469] The user enters basic information into the account creation form, and the device sends it to the server, which analyzes the received user information, generates a unique user_id, and stores it in the database.

[2470] 2. Artist registration

[2471] The artist enters the necessary information (name, concert dates, merchandise information, etc.), and the device sends this to the server. The server analyzes the received artist information, generates a unique artist_id, and stores it in the database.

[2472] 3. Search for artist information

[2473] The user enters a search query (e.g., "upcoming concerts") on the artist information search screen. The device sends the search query and artist ID to the server. The server retrieves the artist information from the database and uses an AI model to extract relevant information. The extracted information is sent to the device and presented to the user.

[2474] For example, if a user wants to know about the next concert by "Artist A," they enter the search query "upcoming concerts." The device sends this query and the artist ID to the server, which retrieves information about "Artist A" from the database and returns the results of searching for concert information using an AI model. The device then displays the results to the user.

[2475] 4. Conversation with your idol

[2476] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!"). The device sends this to the server. The server receives the message and uses an AI model based on the artist information to generate a reply message. The generated reply message is sent to the device and displayed to the user.

[2477] As a concrete example, if a user wants to send a message to "Artist A" saying "I love your latest album!", the device sends this to the server. The server retrieves information about "Artist A" from the database and uses an AI model to generate a reply saying "Thank you for your message! I'm glad you liked it!" The server then sends the generated reply to the device and displays it to the user.

[2478] 5. Promotion Management

[2479] The artist enters promotional information (e.g., new concert or merchandise information). The device sends this to the server. The server stores the received promotional information in a database and sends notifications to relevant fans. The device receives the notifications and displays the promotional information to the user.

[2480] For example, an artist registers new concert information on the platform, the device sends it to the server, the server stores the information in a database, the server sends notifications to relevant users, and the device displays the new concert information to users.

[2481] 6. Emotion recognition

[2482] The emotion recognition engine analyzes messages and search queries sent by users to recognize their emotions. The server generates appropriate reply messages that are in line with the artist's character based on the recognized user emotions. The server also customizes search results and promotional notifications based on the recognized emotions.

[2483] As a concrete example, if a user sends a message such as "I am feeling down because I missed your last concert...", the device will send this to the server. The server will analyze the message using an emotion recognition engine and determine that the user's emotion is "sadness". Based on this recognition, the server will generate a kind reply message that is in line with the artist's character (e.g., "I'm sorry to hear that. I'll be performing again soon, and I hope to see you there!"). The server will then send the generated reply message to the device and display it to the user.

[2484] This system will enable efficient interactive exchange between fans and artists, supporting artists' promotional activities, and by using an emotion recognition engine, it will be possible to provide more personalized communication.

[2485] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2486] Step 1:

[2487] User fills out the account creation form with basic information.

[2488] The input information includes name, email address, password, etc. The device sends this information to the server. The server analyzes the received data and generates a unique user_id. The generated user_id and other information are stored in a database. This process registers the user information in the system.

[2489] Step 2:

[2490] The artist enters the required information (name, concert dates, merchandise information, etc.). The device sends this information to the server. The server analyzes the received artist information and generates a unique artist_id. The generated artist_id and other information are saved in the database. This process registers the artist information in the system.

[2491] Step 3:

[2492] The user enters a search query (e.g., "upcoming concerts") on the artist information search screen. The device sends the search query and artist ID to the server. The server analyzes the received query and retrieves the relevant artist information from the database. The server uses an AI model to extract relevant information. In doing so, it filters the information in the database based on the search query and extracts the relevant data. The extracted information is sent to the device and presented to the user. This process allows the user to confirm the artist information they are looking for.

[2493] Step 4:

[2494] The user enters a message to send to the artist on the interactive screen (e.g., "I love your latest album!"). The device sends this message and the artist ID to the server. The server analyzes the received message and obtains related artist information. The server uses an AI model to generate a reply message. The generated reply message is sent to the device and displayed to the user. This process allows the user to receive a reply from the artist.

[2495] Step 5:

[2496] The artist enters promotional information (such as new concert or merchandise information). The device sends this information to the server. The server stores the received promotional information in a database. The server sends notifications to relevant fans. The device receives the notifications and displays the promotional information to the user. This process allows fans to receive the latest promotional information.

[2497] Step 6:

[2498] Messages and search queries sent by users are analyzed using an emotion recognition engine. The device then sends this to the server. The server then analyzes the received data using the emotion recognition engine to recognize the user's emotions. The server then generates an appropriate reply message that is in line with the artist's character based on the recognized emotions. The generated message is then sent to the device and displayed to the user. This process allows the user to receive a reaction that is in line with their own emotions.

[2499] Through these processing steps, the system enables interactive exchange between users and artists, enabling more personalized communication. It also enables efficient promotional activities, maximizing the effectiveness of artists' promotions.

[2500] (Application example 2)

[2501] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2502] Traditional communication systems between artists and fans lacked a personalized experience, making it difficult to respond flexibly and interactively based on fans' emotions. Furthermore, promotional activities lacked the ability to provide specialized information tailored to individual fans' interests and emotions. This limited the effectiveness of artists' promotions and fan engagement.

[2503] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering artist information in a database, means for receiving a search query from a user, means for extracting artist information based on the search query, means for presenting the extracted artist information to the user, an emotion recognition engine for analyzing the user's emotions, means for personalizing communication between the user and the artist, and means for customizing and displaying artist information and promotions based on the user's emotions. This promotes interactive exchanges between artists and fans and enables personalized messages and promotional activities that reflect the fans' emotions.

[2504] "Artist information" refers to basic data about an artist, including their name, profile, concert dates, merchandise information, and more.

[2505] A "search query" is a text or character string that a user enters when searching for information.

[2506] An "emotion recognition engine" is a technology for analyzing and classifying a user's emotions from received text data and voice data.

[2507] "Personalization" means customizing services and information according to the characteristics, behavior, and emotions of individual users.

[2508] A "database" is a system for organizing and storing information, providing a means for retrieving, manipulating, and managing data based on specific criteria.

[2509] "Communication means" refers to the interfaces and protocols for sending and receiving data, and primarily refers to communication technology via the Internet.

[2510] A "prompt" is input text that gives specific instructions or conditions to an AI model.

[2511] A "generative AI model" is an artificial intelligence algorithm trained for natural language processing and data generation, such as an advanced language generation model such as GPT-4.

[2512] A "server" is a central computer that processes, stores, and manages data, and is responsible for providing information in response to requests from user terminals.

[2513] A "user" is an individual who uses this system to interact with artists and search for information.

[2514] A "message" is text data that a user sends to an artist.

[2515] The present invention is a system for promoting interaction between artists and fans, and in particular, realizes personalized interactive communication using an emotion recognition engine. Specific embodiments for carrying out the present invention are described below.

[2516] System Configuration

[2517] This system is mainly composed of a server, user terminal, database, emotion recognition engine, and generative AI model.

[2518] Hardware / Software used:

[2519] Smartphone or Head-Mounted Display (HMD): Oculus Quest 2

[2520] Server: Google Cloud Platform (GCP)

[2521] Emotion recognition engine: Amazon Comprehend from AWS

[2522] Generative AI model: OpenAI's GPT-4

[2523] Program processing flow

[2524] 1. User Registration:

[2525] The user enters basic information, which the terminal sends to the server.

[2526] The server analyzes the received information, generates a unique user ID, and stores it in a database.

[2527] 2. Artist Registration:

[2528] The artist enters the necessary information (name, concert dates, product information, etc.), and the terminal sends this to the server.

[2529] The server analyzes the received information, generates a unique artist ID, and stores it in a database.

[2530] 3. Search for artist information:

[2531] The user enters a search query, which the device sends to the server.

[2532] The server retrieves artist information from a database and uses AI models to extract relevant information.

[2533] The extracted information is presented to the user.

[2534] Examples:

[2535] When a user enters a search query such as "When is the next concert?", the device sends this to the server, which retrieves the next concert information for the corresponding artist from the database and displays the search results to the user.

[2536] 4. Emotion-aware dialogue:

[2537] The user types a message, which the terminal sends to the server.

[2538] The server uses an emotion recognition engine to analyze the ...

Claims

1. A means of registering artist information in the database; means for receiving a search query from a user; means for extracting artist information based on the search query; The system includes a means for presenting the extracted artist information to a user.

2. means for receiving a message from a user; means for generating a reply message based on the artist's character based on the received message; a means for sending the generated reply message to the user; The system of claim 1 further comprising:

3. a means for artists to enter promotional information; means for storing said promotion information in a database; Means for notifying relevant users of stored promotional information The system of claim 1 further comprising:

Images