system

Abstract

We provide the system. [Solution] Means for receiving user input information, A means of generating relevant information based on user preferences using generative artificial intelligence, Means for providing the generated information to the user, A means of centrally managing information relating to a designated organization, A means of providing real-time communication with other users who share similar hobbies, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There are problems that it is difficult for fans who support an idol to centrally manage related information and it is difficult to find friends with common hobbies. Also, due to the dispersion of information, users cannot efficiently collect and share information. Means for solving such problems are demanded.

Means for Solving the Problems

[0005] The present invention is a system that includes the following means: means for receiving user input information; means for generating relevant information based on the user's preferences using generative artificial intelligence; means for providing the generated information to the user; means for centrally managing information relating to a predetermined organization; and means for providing real-time communication with other users who have similar interests. Furthermore, when a user starts watching predetermined media content, the system also includes matching the user with other viewers and providing real-time communication, and the generative artificial intelligence analyzing the user's input information and recommending new relevant information. This allows users to efficiently collect idol-related information and find friends who share their interests.

[0006] "User input information" refers to data entered by users of the application, such as the name of an idol, song title, blog information, and media content being viewed.

[0007] "Generative artificial intelligence" refers to algorithms and systems that analyze information entered by a user and automatically generate and recommend relevant information of interest based on that analysis.

[0008] "Related information" refers to information generated based on the user's input, such as the idol's blog, photos, TV appearances, and other information about idols and songs that are likely to be of interest to the user.

[0009] "Means of providing" refers to interfaces and functions that display generated information and recommendation results to users and make that information viewable.

[0010] A "designated organization" refers to any group or organization associated with a specific idol group or entertainer that the user follows or is interested in.

[0011] "A means of centralized management" refers to a function that aggregates idol-related information obtained from multiple sources into one place and organizes and displays it so that users can easily access it.

[0012] "Real-time communication" is a communication function that allows users to instantly exchange messages with other users who share similar interests.

[0013] "Matching" means automatically finding other users with common interests based on the media content a user is watching and the information they enter, and enabling them to communicate and interact with each other. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Mode for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention provides a dedicated application system for users who support idols to efficiently collect and manage information and find friends with similar interests. The system receives user input, generates relevant information using generative artificial intelligence based on that input, and provides it to users. It also has the function of centrally managing information related to a given group and providing real-time communication with other users who share similar interests.

[0036] Program processing

[0037] Centralized information management

[0038] The server collects idol-related information from multiple sources based on user input. This includes official idol blogs, social media accounts, and television appearance information. The collected information is stored and organized in a database.

[0039] The terminal centrally manages and displays information retrieved from the database to the user. This eliminates the need for users to visit different websites.

[0040] For example, if a user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the user's device.

[0041] Real-time chat

[0042] When a user starts watching a program featuring a specific idol, the device sends that information to the server.

[0043] The server matches users watching the same program and creates chat rooms in real time. This allows users with similar interests to communicate with each other in real time.

[0044] As a concrete example, when a user starts watching a live show by "Idol B," the server searches for and matches them with other viewers, providing a common chat room. In that chat room, the user can discuss the show with other fans in real time.

[0045] Recommendations for your favorite idols and songs

[0046] Users register their favorite idols and songs in the application. This information is sent to the server via the device.

[0047] The server uses generative artificial intelligence to analyze registration information and learn user preferences. This makes it possible to recommend other different idol groups and songs.

[0048] The terminal notifies the user of recommendation results sent from the server, providing them with opportunities to discover new idols and songs.

[0049] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar idols, "Idol E," and songs, "Song F." This allows users to discover new interests and broaden their hobbies.

[0050] Overall System Overview

[0051] This system enables close collaboration between servers, terminals, and users to manage idol-related information, facilitate real-time communication, and provide recommendations using generative AI. Through this app, users can efficiently gather idol information, interact with like-minded individuals, and enjoy new discoveries.

[0052] The following describes the processing flow.

[0053] Centralized information management

[0054] Step 1:

[0055] The user launches the application and opens the login screen.

[0056] Step 2:

[0057] The user enters their login information (username, password) and presses the login button.

[0058] Step 3:

[0059] The terminal sends the entered login information to the server.

[0060] Step 4:

[0061] The server refers to the database to authenticate the login information it received.

[0062] Step 5:

[0063] The server sends the authentication result back to the terminal. If successful, it also includes user data.

[0064] Step 6:

[0065] The device receives the authentication result and displays the user's dashboard.

[0066] Step 7:

[0067] Select the idols the user is following on the dashboard.

[0068] Step 8:

[0069] The terminal sends an information request for the selected idle to the server.

[0070] Step 9:

[0071] Based on the requests received by the server, information on idols' blogs, photos, and TV appearances is collected via multiple APIs.

[0072] Step 10:

[0073] The server stores the collected information in a database.

[0074] Step 11:

[0075] The terminal retrieves information from the database and displays it on a centralized management screen.

[0076] Real-time chat

[0077] Step 1:

[0078] The user starts watching a program featuring a specific idol from within the app.

[0079] Step 2:

[0080] The device sends information about the program it is currently watching (such as the program ID and viewing time) to the server.

[0081] Step 3:

[0082] The server searches the database for other users who are watching the same program.

[0083] Step 4:

[0084] The server creates a list of matched users.

[0085] Step 5:

[0086] The server creates a chat room among the matched users.

[0087] Step 6:

[0088] The server sends chat room information (room ID, participant list, etc.) to the device.

[0089] Step 7:

[0090] The device displays the chat room UI to the user, enabling them to input and send messages.

[0091] Step 8:

[0092] The user types a message in the chat room and presses the send button.

[0093] Step 9:

[0094] The terminal sends the entered message to the server.

[0095] Step 10:

[0096] The server broadcasts the received message to all other participants' devices.

[0097] Step 11:

[0098] The device displays new messages in the chat screen in real time.

[0099] Recommendations for your favorite idols and songs

[0100] Step 1:

[0101] Users enter information about their favorite idol or song into the application and press the registration button.

[0102] Step 2:

[0103] The device sends registration information (idol name, song title, etc.) to the server.

[0104] Step 3:

[0105] The server saves the information it receives to the database.

[0106] Step 4:

[0107] The server uses generative artificial intelligence to analyze the user's registration information.

[0108] Step 5:

[0109] Based on the analysis results, the server generates other idols and songs that match the user's preferences.

[0110] Step 6:

[0111] The server sends the generated results to the terminal.

[0112] Step 7:

[0113] The device displays information about recommended idols and songs to the user.

[0114] Step 8:

[0115] Users can review recommended information and check out new idols and songs.

[0116] The above outlines the system's processing steps. This allows users to efficiently collect idle-related information, interact in real time, and enjoy new discoveries.

[0117] (Example 1)

[0118] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0119] There is a lack of efficient means to collect and centrally manage information in specific fields. Furthermore, there is a lack of effective methods for users with similar interests to communicate in real time. In addition, the current system is insufficient in generating and recommending relevant information based on user preferences. Therefore, it is necessary to provide means for users to gather information, interact, and discover new interests.

[0120] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0121] In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for collecting and centrally managing information on a specific field from information sources, and means for providing real-time communication with other users who have similar interests. As a result, the user can efficiently collect relevant information, utilize the centrally managed information, interact in real time with other users who have the same interests, and receive recommendations for new relevant information using generative artificial intelligence.

[0122] "Means for receiving user input information" refers to technical means for receiving data input from a user and transmitting that information to a system.

[0123] "Means for generating relevant information based on user preferences using generative artificial intelligence" refers to artificial intelligence technology that analyzes user input data and automatically generates appropriate information based on the results.

[0124] "Means for providing the generated information to the user" refers to a system or method for notifying the user of the generated information in an appropriate format.

[0125] "A means of collecting and centrally managing information on a specific field from various information sources" refers to a system for collecting necessary data from specific information sources and managing it in one place.

[0126] "Means of providing real-time communication with other users who share similar interests" refers to technologies and functions that enable users with the same interests to communicate with each other in real time.

[0127] "Digital content" refers to a collection of information that is stored and displayed electronically, and includes music, videos, text, and other similar materials.

[0128] "Recommendation methods" refer to technologies for presenting new information to users based on analysis results.

[0129] A "matching algorithm" is an algorithm or procedure used to compare multiple users or entities and find combinations that meet certain criteria.

[0130] Modes for carrying out the invention

[0131] This invention is a system for users with specific hobbies or interests to efficiently collect relevant information and communicate in real time with other users who share the same hobbies. The system aims to generate and provide relevant information based on the user's preferences using generative artificial intelligence.

[0132] Means for receiving user input information

[0133] Users input information about their areas of interest or specific digital content through the application. This information is sent to the server via their device (typically an iOS or Android device). Input information may include, for example, the names of their favorite idols or the names of programs they are currently watching.

[0134] A means of generating relevant information based on user preferences using generative artificial intelligence.

[0135] The server receives input from the user and generates relevant information using generative artificial intelligence (e.g., OpenAI GPT-3). This generative AI model receives prompt text as input and generates information based on the user's preferences.

[0136] Example of a prompt:

[0137] "The user has registered 'Idol A' as an area of ​​interest. Based on this information, please generate information about other idols and related topics that the user might be interested in."

[0138] Means for providing the generated information to the user

[0139] The server transmits relevant information obtained by generative artificial intelligence to the terminal. The terminal displays this information on its user interface and provides it to the user. This allows the user to easily obtain new information.

[0140] A means of collecting and centrally managing information on a specific field from various sources.

[0141] The server collects information on a specific area entered by the user from multiple sources (e.g., official websites, social media platforms, news sites, etc.). This process efficiently collects data using Python scripts and web scraping tools (e.g., Scrapy).

[0142] The collected information is stored in databases such as MySQL or MongoDB and organized using tags and categories. This allows for centralized management of information in specific fields, making it easy for users to retrieve the information they need.

[0143] A means of providing real-time communication with other users who share similar interests.

[0144] The device notifies the server when a user begins viewing specific digital content. Based on this information, the server searches its database for other users viewing the same content and uses a matching algorithm to perform the matching.

[0145] The server generates a real-time chat room for matched users using Socket.IO or WebSockets technology and sends this information to the terminal. The terminal updates its user interface based on this chat room information, providing an environment where users can communicate with each other in real time.

[0146] As a concrete example, when a user starts watching a live performance by "Artist X," they can chat in real time with other users who are watching the same performance. This feature allows users to easily interact with other users who share the same interests.

[0147] Through the means described above, this system can efficiently collect user information and communicate with them.

[0148] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0149] Step 1: Enter user information

[0150] The user opens the application and enters a specific area or content that interests them (e.g., idol name, song title, etc.).

[0151] Input: User-entered interest information (e.g., "Idol A")

[0152] Output: Request data sent from the terminal to the server.

[0153] Step 2: Receiving information

[0154] The server receives user input information sent from the terminal.

[0155] Input: Request data sent from the terminal

[0156] Output: Data object containing user interest information

[0157] Step 3: Information Gathering

[0158] The server collects relevant information from sources such as official blogs, social media, and news sites, based on the user's interests. This process uses web scraping tools (e.g., Scrapy).

[0159] Input: Data object containing user interest information

[0160] Output: Collected relevant information (e.g., idol's social media posts, news articles, etc.)

[0161] Step 4: Information storage and organization

[0162] The server stores the collected relevant information in a database (e.g., MySQL, MongoDB) and organizes the information using tags and categories.

[0163] Input: Collected related information

[0164] Output: Organized information stored in the database

[0165] Step 5: Using Generative AI

[0166] The server passes user interest information and related information stored in the database as input to generative artificial intelligence (e.g., OpenAI GPT-3). Prompt messages instruct the system to generate recommendation information.

[0167] Input: User interest information and organized information, prompt text

[0168] Output: Recommendation information generated by the AI ​​(e.g., other similar idols or songs)

[0169] Example prompt: "The user has shown interest in 'Idol A'. Based on this information, please recommend other idols and related content that the user might be interested in."

[0170] Step 6: Provide recommendation information

[0171] The server sends the recommendation information generated by the AI ​​to the terminal.

[0172] Input: Recommendation information generated by the AI.

[0173] Output: Recommendation information sent to the terminal

[0174] Step 7: Displaying Information

[0175] The device receives recommendation information sent from the server and displays it to the user. User interfaces are typically built using React Native or Flutter.

[0176] Input: Recommendation information sent from the server

[0177] Output: Recommended information displayed to the user

[0178] Step 8: Notification of program viewing

[0179] When a user starts watching specific digital content (e.g., an idol's live show), the device sends that information to the server.

[0180] Input: Information about the content the user started watching.

[0181] Output: Request data including viewing information

[0182] Step 9: Matching Viewers

[0183] The server receives viewing information, searches its database for other users who are watching the same content, and uses a matching algorithm to find matches.

[0184] Input: Viewing information

[0185] Output: Matched user list

[0186] Step 10: Create a chat room

[0187] The server creates a real-time chat room for the matched users and sends the chat room information to the terminal.

[0188] Input: Matched user list

[0189] Output: Generated chat room information

[0190] Step 11: Providing real-time chat

[0191] The device displays a real-time chat interface based on chat room information, allowing users to communicate with other fans in real time.

[0192] Input: Chat room information

[0193] Output: Displayed real-time chat interface

[0194] This allows users to efficiently gather relevant information and interact with other users in real time.

[0195] (Application Example 1)

[0196] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0197] In recent years, many people have developed a passion for entertainment and a growing tendency to support specific entertainers and content. However, users must gather information from a wide variety of sources, a process that is time-consuming and laborious. Furthermore, opportunities for real-time interaction with other users who share the same entertainment interests are limited. In addition, recommendation systems for users to discover new interests are not functioning adequately. Therefore, there is a need for a system that efficiently collects and centrally manages entertainment-related information and allows real-time interaction with other users who share similar tastes.

[0198] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0199] In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for centrally managing information related to entertainment, means for providing real-time communication with other users with similar interests, means for matching the user with other viewers and providing real-time communication when the user starts watching a predetermined media content, and means for the generative artificial intelligence to analyze the user's input information and recommend new relevant information. This enables efficient collection and centralized management of information related to entertainment, saving the user the trouble of visiting different information sources. Smooth real-time communication with other users with similar interests becomes possible, making it easier for the user to find friends with common interests. Furthermore, the recommendation of new entertainers and content based on the user's preferences increases opportunities to discover new interests.

[0200] "User input information" refers to data that users provide through the application, indicating their personal preferences and interests.

[0201] "Generative artificial intelligence" refers to algorithms and systems that analyze user input information and generate new related information based on that analysis.

[0202] "Generated information" refers to information generated by generative artificial intelligence based on the user's interests and preferences.

[0203] "Information related to entertainment" refers to various types of data, such as blogs, social media posts, and television appearance information related to specific forms of entertainment.

[0204] "Centralized management" refers to integrating, organizing, and managing information collected from multiple sources using a database or similar system.

[0205] "Real-time communication" refers to a form of communication in which messages and information are exchanged with other users in real time.

[0206] "Specified media content" refers to specific videos, programs, live events, or other content that the user watches or is interested in.

[0207] "Matching" is the process of finding other users with similar interests and providing them with opportunities to interact with each other.

[0208] A "chat room" is an online space where multiple users can communicate in real time.

[0209] "Favorite entertainment" refers to the entertainment that a user particularly supports and is interested in.

[0210] "New relevant information" refers to new and interesting information or content generated based on existing data and interests for the user.

[0211] "Recommendation" refers to the act of generative artificial intelligence analyzing a user's preferences and then presenting new entertainers and content based on those preferences.

[0212] The present invention includes a system for efficiently collecting and centrally managing entertainment information, a system for providing real-time communication with other users who have similar tastes based on that information, and a system for recommending new relevant information based on user preferences using generative artificial intelligence.

[0213] server

[0214] The server collects entertainment-related information from multiple sources, stores it in a database, and manages it centrally. For example, it automatically retrieves information from official entertainment blogs, social media accounts, and television appearances via APIs. The server uses generative artificial intelligence to analyze user input and generate information to recommend new entertainment and content.

[0215] As a concrete example, a server collects and organizes information about "Entertainment A," and stores blogs, social media posts, and TV appearance information related to "Entertainment A" in a database. Based on this information, the server generates other entertainment information that the user might be interested in.

[0216] terminal

[0217] The user's device centrally manages and provides information obtained from the server. When a user starts watching a specific type of entertainment, the device sends that information to the server. The server matches the user with other users watching the same entertainment, creates a chat room, and provides real-time communication.

[0218] As a concrete example, when a user starts watching a live event for "Entertainment B," their device sends that information to the server. The server searches for other viewers, and the device creates a shared chat room. The user can then interact with other fans in real time within the chat room.

[0219] User

[0220] Users access the system via their devices and register their favorite entertainment and content. This information is analyzed by the server, and generative artificial intelligence recommends new entertainment and content.

[0221] For example, when a user registers "Entertainment C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar "Entertainment E" and "Song F." This allows users to discover new interests and broaden their horizons.

[0222] Overall system flow

[0223] This entire system, through the close collaboration of servers, terminals, and users, enables efficient collection and centralized management of entertainment information, real-time communication, and recommendations using generative AI. Through this system, users can efficiently gather various entertainment information, interact with like-minded individuals, and enjoy new discoveries.

[0224] Example of a prompt

[0225] Please collect and centrally manage the latest information on "Entertainment A." Additionally, please activate a real-time chat function and provide a matching feature for fans watching simultaneously. Furthermore, please use generative artificial intelligence to recommend other entertainment and content based on my favorite entertainment and content preferences.

[0226] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0227] Step 1:

[0228] The server receives the input information.

[0229] Users input their favorite entertainment and content through their devices, and the server receives this information. The received information is then stored in a database.

[0230] Input: Data on favorite entertainment and content entered by the user via their device.

[0231] Output: Input information stored in the database.

[0232] Step 2:

[0233] The server collects and centrally manages information.

[0234] The server collects entertainment-related data from multiple sources. It uses APIs to retrieve official blogs, social media accounts, and television appearance information, and stores it in a database.

[0235] Input: Various entertainment-related data obtained via API.

[0236] Output: Information organized and stored in the database.

[0237] Specific operation: The server periodically sends requests to each information source to obtain the latest information, compare it with existing data, and update it.

[0238] Step 3:

[0239] The server analyzes the user's input information.

[0240] Generative artificial intelligence is used to analyze user input information and understand user preferences and tastes. The generative AI model analyzes the input data and extracts specific trends and patterns.

[0241] Input: User input information, entertainment-related information stored in the database.

[0242] Output: Analysis results (user preference patterns).

[0243] Specific operation: The generative AI model learns from the user's input information and outputs it as data that visualizes relevant characteristics and trends.

[0244] Step 4:

[0245] The server generates new related information.

[0246] Based on the previously obtained analysis results, generative artificial intelligence generates new relevant information and recommends it to the user.

[0247] Input: Analysis results (user preference patterns).

[0248] Output: Newly generated related information (recommended content).

[0249] Specific operation: The generative AI model combines information from the database to generate entertainment and content that is highly relevant to the user.

[0250] Step 5:

[0251] The device notifies the user of the generated information.

[0252] Newly generated relevant information and recommended content are provided to the user through the device.

[0253] Input: Newly generated related information (recommended content).

[0254] Output: Information notified to the user.

[0255] Specific operation: The device displays the generated relevant information to the user via push notifications or in-app messages.

[0256] Step 6:

[0257] Users view content.

[0258] When a user watches their favorite entertainment or recommended content, that information is sent to the server via their device.

[0259] Input: Information about the content the user started watching.

[0260] Output: Viewing information sent to the server.

[0261] Specific operation: The device automatically sends information to the server when the user starts watching.

[0262] Step 7:

[0263] The server performs real-time matching.

[0264] The server matches other viewers based on viewing information and creates a real-time chat room.

[0265] Input: Information about the content being viewed.

[0266] Output: The generated real-time chat room.

[0267] Specific operation: The server searches the database to find other viewers and sets up a common chat room.

[0268] Step 8:

[0269] The terminal provides real-time communication.

[0270] The device provides real-time communication to users through the generated real-time chat room. Users can enjoy entertainment while exchanging messages with each other.

[0271] Input: Generated real-time chat room, messages from other users.

[0272] Output: Real-time message exchange.

[0273] Specific operation: The device sends and receives messages in real time and displays them on the user interface.

[0274] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0275] This invention combines an emotion engine with a dedicated application system designed to allow users who support idols to efficiently collect and manage information and find friends with similar interests. This enables more accurate information provision and communication tailored to the user's emotional state.

[0276] Program processing

[0277] Centralized information management

[0278] The server collects idol-related information from multiple sources based on user input. This information collection includes official idol blogs and social media accounts, as well as television appearance information. The collected information is stored and organized in a database.

[0279] The terminal centrally manages and displays information retrieved from the database to the user. This eliminates the need for users to visit different websites.

[0280] For example, if a user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the user's device.

[0281] Real-time chat

[0282] When a user starts watching a program featuring a specific idol, their device sends that information to the server.

[0283] The server matches users watching the same program and creates chat rooms in real time. This allows users with similar interests to communicate with each other in real time.

[0284] As a specific example, when a user starts watching a live show of "Idol B", the server searches for other viewers for matching and provides a common chat room. The user can discuss the program in real time with other fans in that chat room.

[0285] Recommendation of favorite idols and songs

[0286] The user registers their favorite idols and songs in the application. This information is sent to the server through the terminal.

[0287] The server analyzes the registration information using generative artificial intelligence and learns the user's preferences. This enables the recommendation of other different idol groups and songs.

[0288] The terminal notifies the user of the recommendation results sent from the server and provides encounters with new idols and songs.

[0289] As a specific example, when the user registers "Idol C" and their song "Song D", the generative artificial intelligence of the server performs analysis and recommends similar idols "Idol E" and songs "Song F". The user can discover new interests and broaden the scope of their hobbies.

[0290] Combination of emotion engines

[0291] In this system, by further combining emotion engines, a function to recognize the user's emotional state is added.

[0292] The terminal uses an emotion engine to recognize the user's emotional state together with the user's input information. This information is also sent to the server.

[0293] Based on the recognized emotional state, the server improves the accuracy of the related information generated by generative artificial intelligence. This enables the provision of personalized information tailored to the user's emotions.

[0294] As a specific example, when a user is searching for information about "Idol G", if the emotion engine recognizes that the user's emotion is in an "excited" state, the generative artificial intelligence preferentially provides information that is highly relevant and suitable for excited users.

[0295] Also, by using the emotion engine, it is possible to analyze the emotions of users in real-time chat and promote appropriate communication according to the emotions.

[0296] In this way, by combining the emotion engine, the present invention can provide a more personalized experience for users and make it possible to enjoy and efficiently carry out idol support activities more.

[0297] The following describes the processing flow.

[0298] Unified management of information

[0299] Step 1:

[0300] The user launches the application and opens the login screen.

[0301] Step 2:

[0302] The user enters login information (username, password) and presses the login button.

[0303] Step 3:

[0304] The terminal sends the entered login information to the server.

[0305] Step 4:

[0306] The server refers to the database to authenticate the received login information.

[0307] Step 5:

[0308] The server sends the authentication result back to the terminal. If successful, it also includes user data.

[0309] Step 6:

[0310] The device receives the authentication result and displays the user's dashboard.

[0311] Step 7:

[0312] Select the idols the user is following on the dashboard.

[0313] Step 8:

[0314] The terminal sends an information request for the selected idle to the server.

[0315] Step 9:

[0316] Based on the requests received by the server, information on idols' blogs, photos, and TV appearances is collected via multiple APIs.

[0317] Step 10:

[0318] The server stores the collected information in a database.

[0319] Step 11:

[0320] The terminal retrieves information from the database and displays it on a centralized management screen.

[0321] Real-time chat

[0322] Step 1:

[0323] The user starts watching a program featuring a specific idol from within the app.

[0324] Step 2:

[0325] The device sends information about the program it is currently watching (such as the program ID and viewing time) to the server.

[0326] Step 3:

[0327] The server searches the database for other users who are watching the same program.

[0328] Step 4:

[0329] The server creates a list of matched users.

[0330] Step 5:

[0331] The server creates a chat room among the matched users.

[0332] Step 6:

[0333] The server sends chat room information (room ID, participant list, etc.) to the device.

[0334] Step 7:

[0335] The device displays the chat room UI to the user, enabling them to input and send messages.

[0336] Step 8:

[0337] The user types a message in the chat room and presses the send button.

[0338] Step 9:

[0339] The terminal sends the entered message to the server.

[0340] Step 10:

[0341] The server broadcasts the received message to all other participants' devices.

[0342] Step 11:

[0343] The device displays new messages in the chat screen in real time.

[0344] Recommendations for your favorite idols and songs

[0345] Step 1:

[0346] Users enter information about their favorite idol or song into the application and press the registration button.

[0347] Step 2:

[0348] The device sends registration information (idol name, song title, etc.) to the server.

[0349] Step 3:

[0350] The server saves the information it receives to the database.

[0351] Step 4:

[0352] The server uses generative artificial intelligence to analyze the user's registration information.

[0353] Step 5:

[0354] Based on the analysis results, the server generates other idols and songs that match the user's preferences.

[0355] Step 6:

[0356] The server sends the generated results to the terminal.

[0357] Step 7:

[0358] The device displays information about recommended idols and songs to the user.

[0359] Step 8:

[0360] Users can review recommended information and check out new idols and songs.

[0361] Combination of emotional engines

[0362] Step 1:

[0363] The user logs in to the application and presses the "Start Using" button.

[0364] Step 2:

[0365] The device activates sensor devices such as cameras and microphones to recognize the user's emotions in real time.

[0366] Step 3:

[0367] The device uses an emotion engine to analyze the user's emotional state from their facial expressions and voice.

[0368] Step 4:

[0369] The device sends user input information, including the emotional state it has analyzed, to the server.

[0370] Step 5:

[0371] The server saves the received emotional state and input information to a database.

[0372] Step 6:

[0373] The server uses generative artificial intelligence to generate highly accurate relevant information that reflects emotional states.

[0374] Step 7:

[0375] The server sends the relevant information it generates to the terminal.

[0376] Step 8:

[0377] The device displays personalized information tailored to the user's emotional state.

[0378] For example, when a user is searching for information on "Idol H," if the emotion engine recognizes the user's "excited" state, the server will prioritize providing information that is highly relevant to eliciting excitement. Conversely, if the user is in a "relaxed" state, it will provide content containing calmer topics.

[0379] Thus, by combining an emotion engine, the present invention provides a highly accurate information provision and communication platform that responds to the user's real-time emotions.

[0380] (Example 2)

[0381] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0382] Users who support idols need to efficiently collect and manage information from many sources, and it is difficult for them to find friends who share the same hobby. Furthermore, there is a lack of personalized information that is tailored to the user's emotional state.

[0383] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0384] In this invention, the server includes means for receiving user input information and collecting relevant information from multiple information sources based on said input information; means for storing and organizing the collected information in a database; means for recognizing the user's emotional state using an emotion engine; means for generating relevant information based on the user's preferences and emotional state using generative artificial intelligence; means for providing the generated information to the user; means for centrally managing information relating to a predetermined object; and means for providing real-time communication with other users who have similar hobbies. As a result, users can efficiently collect and manage information and receive personalized information according to their emotional state. It also makes it easier for them to find friends who share the same hobbies.

[0385] "Means for receiving user input information and collecting relevant information from multiple sources based on said input information" refers to means for obtaining relevant data from multiple internet sources such as official blogs, social media, and television appearance information based on the idol name and keywords entered by the user into the application.

[0386] "Means of storing and organizing collected information in a database" refers to methods of managing collected idol-related information by storing it in a database and organizing it by date and type of information (blogs, social media, television appearances, etc.).

[0387] "Means of recognizing a user's emotional state using an emotion engine" refers to a method of using an emotion analysis engine to analyze text and voice information entered by the user and recognize their emotional state (e.g., excitement, joy, sadness, etc.).

[0388] "Means for generating relevant information based on user preferences and emotional states using generative artificial intelligence" refers to means for generating optimal relevant information using a generative AI model (e.g., GPT-4) while considering the user's preferences and emotional states.

[0389] "Means for providing the generated information to the user" refers to means for notifying the user's terminal of the generated related information and displaying it in an appropriate format.

[0390] "Means for centrally managing information related to a specified subject" refers to a means of consolidating various pieces of information about a particular idol into a single database and managing them uniformly.

[0391] "Means of providing real-time communication with other users who share similar interests" refers to providing a function that allows users who support the same idol to communicate with each other in real time.

[0392] This invention combines an emotion engine with a dedicated application system designed to allow users who support idols to efficiently collect and manage information and find friends with similar interests. The main hardware of the system consists of a server and user terminals, while the main software includes web scraping tools, database management systems (e.g., MySQL, PostgreSQL), generative artificial intelligence (e.g., GPT-4), and an emotion engine (e.g., Emotion AI).

[0393] Centralized information management

[0394] The server retrieves the idol's name and related keywords entered by the user, and uses web scraping techniques and APIs to collect relevant information from multiple sources such as official blogs, social media, and television appearances. The collected information is stored in a database management system and organized by date and type of information.

[0395] The terminal retrieves comprehensively organized information from the database and displays it to the user. For example, if the user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the terminal in a tile-like format.

[0396] Recommendations for your favorite idols and songs

[0397] When a user registers their favorite idol or song in the application, the device sends this information to the server. The server uses generative artificial intelligence to analyze the registered information and learn the user's preferences, then lists other similar idol groups and songs.

[0398] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the data and recommends similar idols, "Idol E," and songs, "Song F." The device then notifies the user, providing them with opportunities to discover new idols and songs.

[0399] Real-time chat

[0400] When a user starts watching a program featuring a specific idol, their device sends that viewing information to a server. The server then detects other users watching the same program in real time and matches them based on their viewing information.

[0401] For example, when a user starts watching a live show by "Idol B," the server matches them with other viewers and creates a real-time chat room. Users can then talk to other viewers in real time through their device.

[0402] Combination of emotional engines

[0403] The device acquires text and voice information entered by the user and uses an emotion engine to recognize the user's emotional state. This recognized emotional information is sent to the server. Based on the emotional state, the server uses generative artificial intelligence to improve the accuracy of related information.

[0404] For example, when a user is searching for information about "Idol G," if the emotion engine recognizes the user's emotion as "excitement," the generative artificial intelligence will prioritize generating relevant information appropriate to the user's state of excitement and display it on the device.

[0405] By combining these functions, this system provides users with a personalized experience, making idol fan activities more enjoyable and efficient.

[0406] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0407] Program processing steps

[0408] Centralized information management

[0409] Step 1:

[0410] The user logs into the application and enters the name of their favorite idol and related keywords.

[0411] Input: The user enters the name of the idol or keywords.

[0412] Output: Search queries containing idol names or keywords

[0413] Step 2:

[0414] Based on the received idol name and keywords, the server starts the process of collecting relevant information from multiple sources (e.g., official blog, social media, appearance information) using web scraping techniques and APIs.

[0415] Input: Search query

[0416] Output: Data collected from each information source.

[0417] Step 3:

[0418] The server stores the collected data in a database management system, organizing it by date and type of information.

[0419] Input: Collected data

[0420] Output: Organized database entries

[0421] Step 4:

[0422] The terminal requests and receives organized information from the database.

[0423] Input: Data request to the server

[0424] Output: Integrated information data

[0425] Step 5:

[0426] The terminal displays received information centrally through a user-friendly interface.

[0427] Input: Integrated Information Data

[0428] Output: List display on the user interface

[0429] Recommendations for your favorite idols and songs

[0430] Step 1:

[0431] Users register their favorite idols and songs in the application.

[0432] Input: Registration information for your favorite idol or song

[0433] Output: Data packet containing registration information

[0434] Step 2:

[0435] The device sends this registration information to the server.

[0436] Input: Data packet

[0437] Output: Upload to server

[0438] Step 3:

[0439] The server uses generative artificial intelligence to analyze registration information and learn user preferences.

[0440] Input: Registration Information

[0441] Output: Analysis results and list of recommended candidates

[0442] Step 4:

[0443] The server generates recommendation candidates based on the analysis results and sends them to the terminal.

[0444] Input: Analysis results and list of recommended candidates

[0445] Output: Recommendation List

[0446] Step 5:

[0447] The device notifies the user of the recommendation results, providing them with opportunities to discover new idols and songs.

[0448] Input: Recommendation list

[0449] Output: User notification

[0450] Real-time chat

[0451] Step 1:

[0452] The user starts watching a program featuring a specific idol.

[0453] Input: Program viewing operation

[0454] Output: Viewing start information

[0455] Step 2:

[0456] The device sends viewing information to the server.

[0457] Input: Viewing start information

[0458] Output: Upload to server

[0459] Step 3:

[0460] The server detects other users watching the same program in real time and matches them based on their viewing information.

[0461] Input: Viewing information

[0462] Output: Matching list

[0463] Step 4:

[0464] The server generates a real-time chat room for the matched users.

[0465] Input: Matching list

[0466] Output: Chat room link

[0467] Step 5:

[0468] The device provides the user with a link to the chat room and encourages them to access it.

[0469] Input: Chat room link

[0470] Output: Chat room notification

[0471] Combination of emotional engines

[0472] Step 1:

[0473] The device acquires text and voice information entered by the user.

[0474] Input: User's text or voice information

[0475] Output: Sentiment analysis data

[0476] Step 2:

[0477] The device uses an emotion engine to recognize the user's emotional state.

[0478] Input: Sentiment analysis data

[0479] Output: Emotional state data

[0480] Step 3:

[0481] The device sends the recognized emotional state to the server.

[0482] Input: Emotional state data

[0483] Output: Upload to server

[0484] Step 4:

[0485] The server uses generative artificial intelligence to improve the accuracy of relevant information based on emotional states.

[0486] Input: Emotional state data

[0487] Output: Personalized information

[0488] Step 5:

[0489] The device displays personalized information to the user.

[0490] Input: Personalized information

[0491] Output: Display on the user interface

[0492] (Application Example 2)

[0493] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0494] This invention relates to a system for users who support idols to efficiently collect and manage necessary information and communicate in real time with other users who share the same hobby. However, conventional systems do not take into account the user's emotional state, so the information provided and the communication experience are not sufficiently personalized, which may lead to low user satisfaction. Furthermore, it is difficult to match and communicate in real time with other like-minded people in physical stores.

[0495] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for centrally managing information relating to a predetermined group, means for providing real-time communication with other users who have similar hobbies, means for recognizing the user's emotional state using an emotion engine and providing information based on the recognized emotional state, and means for matching the user with like-minded people in the vicinity in a predetermined social setting and providing real-time communication. This enables information provision that takes the user's emotional state into consideration and real-time matching in physical stores.

[0496] "Means for receiving user input information" refers to a mechanism for receiving various data (text, audio, images, etc.) that a user inputs into the system and sending it to the server.

[0497] "Means for generating relevant information based on user preferences using generative artificial intelligence" refers to a mechanism that utilizes generative artificial intelligence technology to learn user preferences from user input information and past data, and automatically generates relevant information based on those preferences.

[0498] "Means for providing the generated information to the user" refers to a mechanism for displaying information generated by generative artificial intelligence on the user's device and making it accessible to the user.

[0499] "A means of centrally managing information related to a designated organization" refers to a mechanism for collecting and integrating various types of information (official blogs, social media posts, performance information, etc.) related to a specific organization or group and managing them in a single database.

[0500] "Means of providing real-time communication with other users who share similar hobbies" refers to a mechanism for sending messages and voice chatting in real time with other users who share the same hobbies on the system.

[0501] "A means of recognizing a user's emotional state using an emotion engine and providing information based on that recognized emotional state" refers to a mechanism that uses emotion recognition technology to infer a user's emotional state from their statements and actions, and then provides the user with appropriate information based on the inference results.

[0502] "A means of matching users with like-minded people in their vicinity in a given social setting and providing real-time communication" refers to a mechanism for matching and communicating in real time with other people who share the same interests in a specific physical location or social environment (e.g., a physical store, an event venue).

[0503] This invention relates to a system for users who support idols to efficiently collect and manage information and communicate in real time with other users who share the same hobby. The following describes specific embodiments of this invention.

[0504] The system related to this invention mainly consists of a server, a terminal, and a user. The server includes software such as an emotion engine, generative artificial intelligence, and a real-time chat module. This system runs on a terminal such as a smartphone and provides the following functions to the user.

[0505] 1. Centralized information management:

[0506] The server receives user input and uses generative artificial intelligence to generate information based on the user's preferences. For example, if a user wants to gather the latest information on "Idol A," this information is automatically collected and organized from official blogs, social media, TV appearances, etc., and displayed centrally on the device.

[0507] 2. Utilizing the Emotional Engine:

[0508] The device uses an emotion engine to analyze user input and recognize the user's current emotional state. Based on this recognized emotional state, the server provides relevant information using generative artificial intelligence. For example, if the user is in an "excited" state, it will prioritize providing information suitable for an excited user, such as the latest live event information or newly released merchandise.

[0509] 3. Provision of real-time chat:

[0510] When a user begins watching a particular media content, the server matches them with other viewers and creates a real-time chat room. This allows users to discuss the show in real time with other fans who share the same interests.

[0511] 4. Recommend your favorite idol or song:

[0512] When a user registers their favorite idol or song, the server's generative artificial intelligence analyzes that information and recommends other idols or songs that match the user's preferences. This allows users to discover new interests and broaden their range of hobbies.

[0513] 5. Matching with nearby users at physical stores:

[0514] This feature allows users to connect with like-minded individuals in designated social settings, such as physical locations (e.g., cafes or event venues), and communicate with them in real time. This functionality enables users to connect with people who share their interests even in physical spaces.

[0515] As a concrete example, if a user opens the "Idol Support Center" app on their smartphone while watching a live video of "Idol A" at a physical cafe, the latest information will be displayed in a list. Furthermore, if the user is in an excited state, the emotion engine recognizes this and prioritizes providing the latest live performance information and newly released merchandise. Simultaneously, the user can use the real-time chat function to discuss the live performance with other fans nearby.

[0516] Examples of input prompts for a generative AI model:

[0517] "Please provide a sample Python program that recommends content tailored to the user's interests, such as live videos or newly released items, when the user is in an excited emotional state."

[0518] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0519] Step 1:

[0520] The device receives user input information, including text, audio, and images. This input information is then sent to the emotion engine to analyze the user's current emotional state. To achieve this, the device uses the emotion engine's API to send the input information as an analysis request.

[0521] Step 2:

[0522] The server activates generative artificial intelligence based on the emotion analysis results received from the emotion engine, generating relevant information based on the user's preferences. The input includes data such as the user's emotional state and past activity history. The generative AI analyzes this data to generate the most relevant information for the user (e.g., the latest live event information, related articles, recommended idols).

[0523] Step 3:

[0524] The server saves the generated related information to a database and notifies the terminal. The terminal receives this notification and displays the related information to the user. Specifically, it retrieves the related information using an API call and displays it in the user interface.

[0525] Step 4:

[0526] When a user begins watching specific media content (e.g., live video), their device sends that viewing information to a server. The server uses this information to match other users watching the same content and creates a real-time chat room. This enables real-time communication.

[0527] Step 5:

[0528] The server manages information to match users with like-minded people nearby in specific social settings (e.g., physical stores or event venues). When a user is in a physical store, their device sends its location information to the server, which then detects other like-minded people in the same location. Based on this information, a real-time chat room is created, and users can join that chat room to communicate.

[0529] Through the above processing steps, users can efficiently collect idol-related information and receive personalized information based on their emotional state. Furthermore, real-time communication allows them to interact with other fans who share the same interests.

[0530] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0531] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0532] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0533] [Second Embodiment]

[0534] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0535] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0536] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0537] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0538] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0539] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0540] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0541] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0542] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0543] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0544] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0545] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0546] This invention provides a dedicated application system for users who support idols to efficiently collect and manage information and find friends with similar interests. The system receives user input, generates relevant information using generative artificial intelligence based on that input, and provides it to users. It also has the function of centrally managing information related to a given group and providing real-time communication with other users who share similar interests.

[0547] Program processing

[0548] Centralized information management

[0549] The server collects idol-related information from multiple sources based on user input. This includes official idol blogs, social media accounts, and television appearance information. The collected information is stored and organized in a database.

[0550] The terminal centrally manages and displays information retrieved from the database to the user. This eliminates the need for users to visit different websites.

[0551] For example, if a user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the user's device.

[0552] Real-time chat

[0553] When a user starts watching a program featuring a specific idol, the device sends that information to the server.

[0554] The server matches users watching the same program and creates chat rooms in real time. This allows users with similar interests to communicate with each other in real time.

[0555] As a concrete example, when a user starts watching a live show by "Idol B," the server searches for and matches them with other viewers, providing a common chat room. In that chat room, the user can discuss the show with other fans in real time.

[0556] Recommendations for your favorite idols and songs

[0557] Users register their favorite idols and songs in the application. This information is sent to the server via the device.

[0558] The server uses generative artificial intelligence to analyze registration information and learn user preferences. This makes it possible to recommend other different idol groups and songs.

[0559] The terminal notifies the user of recommendation results sent from the server, providing them with opportunities to discover new idols and songs.

[0560] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar idols, "Idol E," and songs, "Song F." This allows users to discover new interests and broaden their hobbies.

[0561] Overall System Overview

[0562] This system enables close collaboration between servers, terminals, and users to manage idol-related information, facilitate real-time communication, and provide recommendations using generative AI. Through this app, users can efficiently gather idol information, interact with like-minded individuals, and enjoy new discoveries.

[0563] The following describes the processing flow.

[0564] Centralized information management

[0565] Step 1:

[0566] The user launches the application and opens the login screen.

[0567] Step 2:

[0568] The user enters their login information (username, password) and presses the login button.

[0569] Step 3:

[0570] The terminal sends the entered login information to the server.

[0571] Step 4:

[0572] The server refers to the database to authenticate the login information it received.

[0573] Step 5:

[0574] The server sends the authentication result back to the terminal. If successful, it also includes user data.

[0575] Step 6:

[0576] The device receives the authentication result and displays the user's dashboard.

[0577] Step 7:

[0578] Select the idols the user is following on the dashboard.

[0579] Step 8:

[0580] The terminal sends an information request for the selected idle to the server.

[0581] Step 9:

[0582] Based on the requests received by the server, information on idols' blogs, photos, and TV appearances is collected via multiple APIs.

[0583] Step 10:

[0584] The server stores the collected information in a database.

[0585] Step 11:

[0586] The terminal retrieves information from the database and displays it on a centralized management screen.

[0587] Real-time chat

[0588] Step 1:

[0589] The user starts watching a program featuring a specific idol from within the app.

[0590] Step 2:

[0591] The device sends information about the program it is currently watching (such as the program ID and viewing time) to the server.

[0592] Step 3:

[0593] The server searches the database for other users who are watching the same program.

[0594] Step 4:

[0595] The server creates a list of matched users.

[0596] Step 5:

[0597] The server creates a chat room among the matched users.

[0598] Step 6:

[0599] The server sends chat room information (room ID, participant list, etc.) to the device.

[0600] Step 7:

[0601] The device displays the chat room UI to the user, enabling them to input and send messages.

[0602] Step 8:

[0603] The user types a message in the chat room and presses the send button.

[0604] Step 9:

[0605] The terminal sends the entered message to the server.

[0606] Step 10:

[0607] The server broadcasts the received message to all other participants' devices.

[0608] Step 11:

[0609] The device displays new messages in the chat screen in real time.

[0610] Recommendations for your favorite idols and songs

[0611] Step 1:

[0612] Users enter information about their favorite idol or song into the application and press the registration button.

[0613] Step 2:

[0614] The device sends registration information (idol name, song title, etc.) to the server.

[0615] Step 3:

[0616] The server saves the information it receives to the database.

[0617] Step 4:

[0618] The server uses generative artificial intelligence to analyze the user's registration information.

[0619] Step 5:

[0620] Based on the analysis results, the server generates other idols and songs that match the user's preferences.

[0621] Step 6:

[0622] The server sends the generated results to the terminal.

[0623] Step 7:

[0624] The device displays information about recommended idols and songs to the user.

[0625] Step 8:

[0626] Users can review recommended information and check out new idols and songs.

[0627] The above outlines the system's processing steps. This allows users to efficiently collect idle-related information, interact in real time, and enjoy new discoveries.

[0628] (Example 1)

[0629] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0630] There is a lack of efficient means to collect and centrally manage information in specific fields. Furthermore, there is a lack of effective methods for users with similar interests to communicate in real time. In addition, the current system is insufficient in generating and recommending relevant information based on user preferences. Therefore, it is necessary to provide means for users to gather information, interact, and discover new interests.

[0631] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0632] In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for collecting and centrally managing information on a specific field from information sources, and means for providing real-time communication with other users who have similar interests. As a result, the user can efficiently collect relevant information, utilize the centrally managed information, interact in real time with other users who have the same interests, and receive recommendations for new relevant information using generative artificial intelligence.

[0633] "Means for receiving user input information" refers to technical means for receiving data input from a user and transmitting that information to a system.

[0634] "Means for generating relevant information based on user preferences using generative artificial intelligence" refers to artificial intelligence technology that analyzes user input data and automatically generates appropriate information based on the results.

[0635] "Means for providing the generated information to the user" refers to a system or method for notifying the user of the generated information in an appropriate format.

[0636] "A means of collecting and centrally managing information on a specific field from various information sources" refers to a system for collecting necessary data from specific information sources and managing it in one place.

[0637] "Means of providing real-time communication with other users who share similar interests" refers to technologies and functions that enable users with the same interests to communicate with each other in real time.

[0638] "Digital content" refers to a collection of information that is stored and displayed electronically, and includes music, videos, text, and other similar materials.

[0639] "Recommendation methods" refer to technologies for presenting new information to users based on analysis results.

[0640] A "matching algorithm" is an algorithm or procedure used to compare multiple users or entities and find combinations that meet certain criteria.

[0641] Modes for carrying out the invention

[0642] This invention is a system for users with specific hobbies or interests to efficiently collect relevant information and communicate in real time with other users who share the same hobbies. The system aims to generate and provide relevant information based on the user's preferences using generative artificial intelligence.

[0643] Means for receiving user input information

[0644] Users input information about their areas of interest or specific digital content through the application. This information is sent to the server via their device (typically an iOS or Android device). Input information may include, for example, the names of their favorite idols or the names of programs they are currently watching.

[0645] A means of generating relevant information based on user preferences using generative artificial intelligence.

[0646] The server receives input from the user and generates relevant information using generative artificial intelligence (e.g., OpenAI GPT-3). This generative AI model receives prompt text as input and generates information based on the user's preferences.

[0647] Example of a prompt:

[0648] "The user has registered 'Idol A' as an area of ​​interest. Based on this information, please generate information about other idols and related topics that the user might be interested in."

[0649] Means for providing the generated information to the user

[0650] The server transmits relevant information obtained by generative artificial intelligence to the terminal. The terminal displays this information on its user interface and provides it to the user. This allows the user to easily obtain new information.

[0651] A means of collecting and centrally managing information on a specific field from various sources.

[0652] The server collects information on a specific field entered by the user from multiple sources (e.g., official websites, social media platforms, news sites, etc.). This process efficiently collects data using Python scripts and web scraping tools (e.g., Scrapy).

[0653] The collected information is stored in databases such as MySQL or MongoDB and organized using tags and categories. This allows for centralized management of information in specific fields, making it easy for users to retrieve the information they need.

[0654] A means of providing real-time communication with other users who share similar interests.

[0655] The device notifies the server when a user begins viewing specific digital content. Based on this information, the server searches its database for other users viewing the same content and uses a matching algorithm to perform the matching.

[0656] The server generates a real-time chat room for matched users using Socket.IO or WebSockets technology and sends this information to the terminal. The terminal updates its user interface based on this chat room information, providing an environment where users can communicate with each other in real time.

[0657] As a concrete example, when a user starts watching a live performance by "Artist X," they can chat in real time with other users who are watching the same performance. This feature allows users to easily interact with other users who share the same interests.

[0658] Through the means described above, this system can efficiently collect user information and communicate with them.

[0659] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0660] Step 1: Enter user information

[0661] The user opens the application and enters a specific area or content that interests them (e.g., idol name, song title, etc.).

[0662] Input: User-entered interest information (e.g., "Idol A")

[0663] Output: Request data sent from the terminal to the server.

[0664] Step 2: Receiving information

[0665] The server receives user input information sent from the terminal.

[0666] Input: Request data sent from the terminal

[0667] Output: Data object containing user interest information

[0668] Step 3: Information Gathering

[0669] The server collects relevant information from sources such as official blogs, social media, and news sites, based on the user's interests. This process uses web scraping tools (e.g., Scrapy).

[0670] Input: Data object containing user interest information

[0671] Output: Collected relevant information (e.g., idol's social media posts, news articles, etc.)

[0672] Step 4: Information storage and organization

[0673] The server stores the collected relevant information in a database (e.g., MySQL, MongoDB) and organizes the information using tags and categories.

[0674] Input: Collected related information

[0675] Output: Organized information stored in the database

[0676] Step 5: Using Generative AI

[0677] The server passes user interest information and related information stored in the database as input to generative artificial intelligence (e.g., OpenAI GPT-3). Prompt messages instruct the system to generate recommendation information.

[0678] Input: User interest information and organized information, prompt text

[0679] Output: Recommendation information generated by the AI ​​(e.g., other similar idols or songs)

[0680] Example prompt: "The user has shown interest in 'Idol A'. Based on this information, please recommend other idols and related content that the user might be interested in."

[0681] Step 6: Provide recommendation information

[0682] The server sends the recommendation information generated by the AI ​​to the terminal.

[0683] Input: Recommendation information generated by the AI.

[0684] Output: Recommendation information sent to the terminal

[0685] Step 7: Displaying Information

[0686] The device receives recommendation information sent from the server and displays it to the user. User interfaces are typically built using React Native or Flutter.

[0687] Input: Recommendation information sent from the server

[0688] Output: Recommended information displayed to the user

[0689] Step 8: Notification of program viewing

[0690] When a user starts watching specific digital content (e.g., an idol's live show), the device sends that information to the server.

[0691] Input: Information about the content the user started watching.

[0692] Output: Request data including viewing information

[0693] Step 9: Matching Viewers

[0694] The server receives viewing information, searches its database for other users who are watching the same content, and uses a matching algorithm to find matches.

[0695] Input: Viewing information

[0696] Output: Matched user list

[0697] Step 10: Create a chat room

[0698] The server creates a real-time chat room for the matched users and sends the chat room information to the terminal.

[0699] Input: Matched user list

[0700] Output: Generated chat room information

[0701] Step 11: Providing real-time chat

[0702] The device displays a real-time chat interface based on chat room information, allowing users to communicate with other fans in real time.

[0703] Input: Chat room information

[0704] Output: Displayed real-time chat interface

[0705] This allows users to efficiently gather relevant information and interact with other users in real time.

[0706] (Application Example 1)

[0707] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0708] In recent years, many people have developed a passion for entertainment and a growing tendency to support specific entertainers and content. However, users must gather information from a wide variety of sources, a process that is time-consuming and laborious. Furthermore, opportunities for real-time interaction with other users who share the same entertainment interests are limited. In addition, recommendation systems for users to discover new interests are not functioning adequately. Therefore, there is a need for a system that efficiently collects and centrally manages entertainment-related information and allows real-time interaction with other users who share similar tastes.

[0709] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0710] In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for centrally managing information related to entertainment, means for providing real-time communication with other users with similar interests, means for matching the user with other viewers and providing real-time communication when the user starts watching a predetermined media content, and means for the generative artificial intelligence to analyze the user's input information and recommend new relevant information. This enables efficient collection and centralized management of information related to entertainment, saving the user the trouble of visiting different information sources. Smooth real-time communication with other users with similar interests becomes possible, making it easier for the user to find friends with common interests. Furthermore, the recommendation of new entertainers and content based on the user's preferences increases opportunities to discover new interests.

[0711] "User input information" refers to data that users provide through the application, indicating their personal preferences and interests.

[0712] "Generative artificial intelligence" refers to algorithms and systems that analyze user input information and generate new related information based on that analysis.

[0713] "Generated information" refers to information generated by generative artificial intelligence based on the user's interests and preferences.

[0714] "Information related to entertainment" refers to various types of data, such as blogs, social media posts, and television appearance information related to specific forms of entertainment.

[0715] "Centralized management" refers to integrating, organizing, and managing information collected from multiple sources using a database or similar system.

[0716] "Real-time communication" refers to a form of communication in which messages and information are exchanged with other users in real time.

[0717] "Specified media content" refers to specific videos, programs, live events, or other content that the user watches or is interested in.

[0718] "Matching" is the process of finding other users with similar interests and providing them with opportunities to interact with each other.

[0719] A "chat room" is an online space where multiple users can communicate in real time.

[0720] "Favorite entertainment" refers to the entertainment that a user particularly supports and is interested in.

[0721] "New relevant information" refers to new and interesting information or content generated based on existing data and interests for the user.

[0722] "Recommendation" refers to the act of generative artificial intelligence analyzing a user's preferences and then presenting new entertainers and content based on those preferences.

[0723] The present invention includes a system for efficiently collecting and centrally managing entertainment information, a system for providing real-time communication with other users who have similar tastes based on that information, and a system for recommending new relevant information based on user preferences using generative artificial intelligence.

[0724] server

[0725] The server collects entertainment-related information from multiple sources, stores it in a database, and manages it centrally. For example, it automatically retrieves information from official entertainment blogs, social media accounts, and television appearances via APIs. The server uses generative artificial intelligence to analyze user input and generate information to recommend new entertainment and content.

[0726] As a concrete example, a server collects and organizes information about "Entertainment A," and stores blogs, social media posts, and TV appearance information related to "Entertainment A" in a database. Based on this information, the server generates other entertainment information that the user might be interested in.

[0727] terminal

[0728] The user's device centrally manages and provides information obtained from the server. When a user starts watching a specific type of entertainment, the device sends that information to the server. The server matches the user with other users watching the same entertainment, creates a chat room, and provides real-time communication.

[0729] As a concrete example, when a user starts watching a live event for "Entertainment B," their device sends that information to the server. The server searches for other viewers, and the device creates a shared chat room. The user can then interact with other fans in real time within the chat room.

[0730] User

[0731] Users access the system via their devices and register their favorite entertainment and content. This information is analyzed by the server, and generative artificial intelligence recommends new entertainment and content.

[0732] For example, when a user registers "Entertainment C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar "Entertainment E" and "Song F." This allows users to discover new interests and broaden their horizons.

[0733] Overall system flow

[0734] This entire system, through the close collaboration of servers, terminals, and users, enables efficient collection and centralized management of entertainment information, real-time communication, and recommendations using generative AI. Through this system, users can efficiently gather various entertainment information, interact with like-minded individuals, and enjoy new discoveries.

[0735] Example of a prompt

[0736] Please collect and centrally manage the latest information on "Entertainment A." Additionally, please activate a real-time chat function and provide a matching feature for fans watching simultaneously. Furthermore, please use generative artificial intelligence to recommend other entertainment and content based on my favorite entertainment and content preferences.

[0737] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0738] Step 1:

[0739] The server receives the input information.

[0740] Users input their favorite entertainment and content through their devices, and the server receives this information. The received information is then stored in a database.

[0741] Input: Data on favorite entertainment and content entered by the user via their device.

[0742] Output: Input information stored in the database.

[0743] Step 2:

[0744] The server collects and centrally manages information.

[0745] The server collects entertainment-related data from multiple sources. It uses APIs to retrieve official blogs, social media accounts, and television appearance information, and stores it in a database.

[0746] Input: Various entertainment-related data obtained via API.

[0747] Output: Information organized and stored in the database.

[0748] Specific operation: The server periodically sends requests to each information source to obtain the latest information, compare it with existing data, and update it.

[0749] Step 3:

[0750] The server analyzes the user's input information.

[0751] Generative artificial intelligence is used to analyze user input information and understand user preferences and tastes. The generative AI model analyzes the input data and extracts specific trends and patterns.

[0752] Input: User input information, entertainment-related information stored in the database.

[0753] Output: Analysis results (user preference patterns).

[0754] Specific operation: The generative AI model learns from the user's input information and outputs it as data that visualizes relevant characteristics and trends.

[0755] Step 4:

[0756] The server generates new related information.

[0757] Based on the previously obtained analysis results, generative artificial intelligence generates new relevant information and recommends it to the user.

[0758] Input: Analysis results (user preference patterns).

[0759] Output: Newly generated related information (recommended content).

[0760] Specific operation: The generative AI model combines information from the database to generate entertainment and content that is highly relevant to the user.

[0761] Step 5:

[0762] The device notifies the user of the generated information.

[0763] Newly generated relevant information and recommended content are provided to the user through the device.

[0764] Input: Newly generated related information (recommended content).

[0765] Output: Information notified to the user.

[0766] Specific operation: The device displays the generated relevant information to the user via push notifications or in-app messages.

[0767] Step 6:

[0768] Users view content.

[0769] When a user watches their favorite entertainment or recommended content, that information is sent to the server via their device.

[0770] Input: Information about the content the user started watching.

[0771] Output: Viewing information sent to the server.

[0772] Specific operation: The device automatically sends information to the server when the user starts watching.

[0773] Step 7:

[0774] The server performs real-time matching.

[0775] The server matches other viewers based on viewing information and creates a real-time chat room.

[0776] Input: Information about the content being viewed.

[0777] Output: The generated real-time chat room.

[0778] Specific operation: The server searches the database to find other viewers and sets up a common chat room.

[0779] Step 8:

[0780] The terminal provides real-time communication.

[0781] The device provides real-time communication to users through the generated real-time chat room. Users can enjoy entertainment while exchanging messages with each other.

[0782] Input: Generated real-time chat room, messages from other users.

[0783] Output: Real-time message exchange.

[0784] Specific operation: The device sends and receives messages in real time and displays them on the user interface.

[0785] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0786] This invention combines an emotion engine with a dedicated application system designed to allow users who support idols to efficiently collect and manage information and find friends with similar interests. This enables more accurate information provision and communication tailored to the user's emotional state.

[0787] Program processing

[0788] Centralized information management

[0789] The server collects idol-related information from multiple sources based on user input. This information collection includes official idol blogs and social media accounts, as well as television appearance information. The collected information is stored and organized in a database.

[0790] The terminal centrally manages and displays information retrieved from the database to the user. This eliminates the need for users to visit different websites.

[0791] For example, if a user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the user's device.

[0792] Real-time chat

[0793] When a user starts watching a program featuring a specific idol, their device sends that information to the server.

[0794] The server matches users watching the same program and creates chat rooms in real time. This allows users with similar interests to communicate with each other in real time.

[0795] As a concrete example, when a user starts watching a live show by "Idol B," the server searches for and matches them with other viewers, providing a common chat room. In that chat room, the user can discuss the show with other fans in real time.

[0796] Recommendations for your favorite idols and songs

[0797] Users register their favorite idols and songs in the application. This information is sent to the server via the device.

[0798] The server uses generative artificial intelligence to analyze registration information and learn user preferences. This makes it possible to recommend other different idol groups and songs.

[0799] The terminal notifies the user of recommendation results sent from the server, providing them with opportunities to discover new idols and songs.

[0800] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar idols, "Idol E," and songs, "Song F." This allows users to discover new interests and broaden their hobbies.

[0801] Combination of emotional engines

[0802] This system will also gain the ability to recognize the user's emotional state by incorporating an emotion engine.

[0803] The terminal uses an emotion engine to recognize the user's emotional state, along with the user's input information. This information is also sent to the server.

[0804] The server improves the accuracy of related information generated by generative artificial intelligence based on the recognized emotional state. This enables the provision of personalized information tailored to the user's emotions.

[0805] For example, when a user is searching for information about "Idol G," if the emotion engine recognizes that the user is in an "excited" state, the generative artificial intelligence will prioritize providing relevant information that is suitable for an excited user.

[0806] Furthermore, by using an emotion engine, it is possible to analyze the user's emotions in real-time chat and facilitate appropriate communication based on those emotions.

[0807] Thus, by combining an emotion engine, the present invention makes it possible to provide a more personalized experience for users and to make idol fan activities more enjoyable and efficient.

[0808] The following describes the processing flow.

[0809] Centralized information management

[0810] Step 1:

[0811] The user launches the application and opens the login screen.

[0812] Step 2:

[0813] The user enters their login information (username, password) and presses the login button.

[0814] Step 3:

[0815] The terminal sends the entered login information to the server.

[0816] Step 4:

[0817] The server refers to the database to authenticate the login information it received.

[0818] Step 5:

[0819] The server sends the authentication result back to the terminal. If successful, it also includes user data.

[0820] Step 6:

[0821] The device receives the authentication result and displays the user's dashboard.

[0822] Step 7:

[0823] Select the idols the user is following on the dashboard.

[0824] Step 8:

[0825] The terminal sends an information request for the selected idle to the server.

[0826] Step 9:

[0827] Based on the requests received by the server, information on idols' blogs, photos, and TV appearances is collected via multiple APIs.

[0828] Step 10:

[0829] The server stores the collected information in a database.

[0830] Step 11:

[0831] The terminal retrieves information from the database and displays it on a centralized management screen.

[0832] Real-time chat

[0833] Step 1:

[0834] The user starts watching a program featuring a specific idol from within the app.

[0835] Step 2:

[0836] The device sends information about the program it is currently watching (such as the program ID and viewing time) to the server.

[0837] Step 3:

[0838] The server searches the database for other users who are watching the same program.

[0839] Step 4:

[0840] The server creates a list of matched users.

[0841] Step 5:

[0842] The server creates a chat room among the matched users.

[0843] Step 6:

[0844] The server sends chat room information (room ID, participant list, etc.) to the device.

[0845] Step 7:

[0846] The device displays the chat room UI to the user, enabling them to input and send messages.

[0847] Step 8:

[0848] The user types a message in the chat room and presses the send button.

[0849] Step 9:

[0850] The terminal sends the entered message to the server.

[0851] Step 10:

[0852] The server broadcasts the received message to all other participants' devices.

[0853] Step 11:

[0854] The device displays new messages in the chat screen in real time.

[0855] Recommendations for your favorite idols and songs

[0856] Step 1:

[0857] Users enter information about their favorite idol or song into the application and press the registration button.

[0858] Step 2:

[0859] The device sends registration information (idol name, song title, etc.) to the server.

[0860] Step 3:

[0861] The server saves the information it receives to the database.

[0862] Step 4:

[0863] The server uses generative artificial intelligence to analyze the user's registration information.

[0864] Step 5:

[0865] Based on the analysis results, the server generates other idols and songs that match the user's preferences.

[0866] Step 6:

[0867] The server sends the generated results to the terminal.

[0868] Step 7:

[0869] The device displays information about recommended idols and songs to the user.

[0870] Step 8:

[0871] Users can review recommended information and check out new idols and songs.

[0872] Combination of emotional engines

[0873] Step 1:

[0874] The user logs in to the application and presses the "Start Using" button.

[0875] Step 2:

[0876] The device activates sensor devices such as cameras and microphones to recognize the user's emotions in real time.

[0877] Step 3:

[0878] The device uses an emotion engine to analyze the user's emotional state from their facial expressions and voice.

[0879] Step 4:

[0880] The device sends user input information, including the emotional state it has analyzed, to the server.

[0881] Step 5:

[0882] The server saves the received emotional state and input information to a database.

[0883] Step 6:

[0884] The server uses generative artificial intelligence to generate highly accurate relevant information that reflects emotional states.

[0885] Step 7:

[0886] The server sends the relevant information it generates to the terminal.

[0887] Step 8:

[0888] The device displays personalized information tailored to the user's emotional state.

[0889] For example, when a user is searching for information on "Idol H," if the emotion engine recognizes the user's "excited" state, the server will prioritize providing information that is highly relevant to eliciting excitement. Conversely, if the user is in a "relaxed" state, it will provide content containing calmer topics.

[0890] Thus, by combining an emotion engine, the present invention provides a highly accurate information provision and communication platform that responds to the user's real-time emotions.

[0891] (Example 2)

[0892] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0893] Users who support idols need to efficiently collect and manage information from many sources, and it is difficult for them to find friends who share the same hobby. Furthermore, there is a lack of personalized information that is tailored to the user's emotional state.

[0894] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0895] In this invention, the server includes means for receiving user input information and collecting relevant information from multiple information sources based on said input information; means for storing and organizing the collected information in a database; means for recognizing the user's emotional state using an emotion engine; means for generating relevant information based on the user's preferences and emotional state using generative artificial intelligence; means for providing the generated information to the user; means for centrally managing information relating to a predetermined object; and means for providing real-time communication with other users who have similar hobbies. As a result, users can efficiently collect and manage information and receive personalized information according to their emotional state. It also makes it easier for them to find friends who share the same hobbies.

[0896] "Means for receiving user input information and collecting relevant information from multiple sources based on said input information" refers to means for obtaining relevant data from multiple internet sources such as official blogs, social media, and television appearance information based on the idol name and keywords entered by the user into the application.

[0897] "Means of storing and organizing collected information in a database" refers to methods of managing collected idol-related information by storing it in a database and organizing it by date and type of information (blogs, social media, television appearances, etc.).

[0898] "Means of recognizing a user's emotional state using an emotion engine" refers to a method of using an emotion analysis engine to analyze text and voice information entered by the user and recognize their emotional state (e.g., excitement, joy, sadness, etc.).

[0899] "Means for generating relevant information based on user preferences and emotional states using generative artificial intelligence" refers to means for generating optimal relevant information using a generative AI model (e.g., GPT-4) while considering the user's preferences and emotional states.

[0900] "Means for providing the generated information to the user" refers to means for notifying the user's terminal of the generated related information and displaying it in an appropriate format.

[0901] "Means for centrally managing information related to a specified subject" refers to a means of consolidating various pieces of information about a particular idol into a single database and managing them uniformly.

[0902] "Means of providing real-time communication with other users who share similar interests" refers to providing a function that allows users who support the same idol to communicate with each other in real time.

[0903] This invention combines an emotion engine with a dedicated application system designed to allow users who support idols to efficiently collect and manage information and find friends with similar interests. The main hardware of the system consists of a server and user terminals, while the main software includes web scraping tools, database management systems (e.g., MySQL, PostgreSQL), generative artificial intelligence (e.g., GPT-4), and an emotion engine (e.g., Emotion AI).

[0904] Centralized information management

[0905] The server retrieves the idol's name and related keywords entered by the user, and uses web scraping techniques and APIs to collect relevant information from multiple sources such as official blogs, social media, and television appearances. The collected information is stored in a database management system and organized by date and type of information.

[0906] The terminal retrieves comprehensively organized information from the database and displays it to the user. For example, if the user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the terminal in a tile-like format.

[0907] Recommendations for your favorite idols and songs

[0908] When a user registers their favorite idol or song in the application, the device sends this information to the server. The server uses generative artificial intelligence to analyze the registered information and learn the user's preferences, then lists other similar idol groups and songs.

[0909] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the data and recommends similar idols, "Idol E," and songs, "Song F." The device then notifies the user, providing them with opportunities to discover new idols and songs.

[0910] Real-time chat

[0911] When a user starts watching a program featuring a specific idol, their device sends that viewing information to a server. The server then detects other users watching the same program in real time and matches them based on their viewing information.

[0912] For example, when a user starts watching a live show by "Idol B," the server matches them with other viewers and creates a real-time chat room. Users can then talk to other viewers in real time through their device.

[0913] Combination of emotional engines

[0914] The device acquires text and voice information entered by the user and uses an emotion engine to recognize the user's emotional state. This recognized emotional information is sent to the server. Based on the emotional state, the server uses generative artificial intelligence to improve the accuracy of related information.

[0915] For example, when a user is searching for information about "Idol G," if the emotion engine recognizes the user's emotion as "excitement," the generative artificial intelligence will prioritize generating relevant information appropriate to the user's state of excitement and display it on the device.

[0916] By combining these functions, this system provides users with a personalized experience, making idol fan activities more enjoyable and efficient.

[0917] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0918] Program processing steps

[0919] Centralized information management

[0920] Step 1:

[0921] The user logs into the application and enters the name of their favorite idol and related keywords.

[0922] Input: The user enters the name of the idol or keywords.

[0923] Output: Search queries containing idol names or keywords

[0924] Step 2:

[0925] Based on the received idol name and keywords, the server starts the process of collecting relevant information from multiple sources (e.g., official blog, social media, appearance information) using web scraping techniques and APIs.

[0926] Input: Search query

[0927] Output: Data collected from each information source.

[0928] Step 3:

[0929] The server stores the collected data in a database management system, organizing it by date and type of information.

[0930] Input: Collected data

[0931] Output: Organized database entries

[0932] Step 4:

[0933] The terminal requests and receives organized information from the database.

[0934] Input: Data request to the server

[0935] Output: Integrated information data

[0936] Step 5:

[0937] The terminal displays received information centrally through a user-friendly interface.

[0938] Input: Integrated Information Data

[0939] Output: List display on the user interface

[0940] Recommendations for your favorite idols and songs

[0941] Step 1:

[0942] Users register their favorite idols and songs in the application.

[0943] Input: Registration information for your favorite idol or song

[0944] Output: Data packet containing registration information

[0945] Step 2:

[0946] The device sends this registration information to the server.

[0947] Input: Data packet

[0948] Output: Upload to server

[0949] Step 3:

[0950] The server uses generative artificial intelligence to analyze registration information and learn user preferences.

[0951] Input: Registration Information

[0952] Output: Analysis results and list of recommended candidates

[0953] Step 4:

[0954] The server generates recommendation candidates based on the analysis results and sends them to the terminal.

[0955] Input: Analysis results and list of recommended candidates

[0956] Output: Recommendation List

[0957] Step 5:

[0958] The device notifies the user of the recommendation results, providing them with opportunities to discover new idols and songs.

[0959] Input: Recommendation list

[0960] Output: User notification

[0961] Real-time chat

[0962] Step 1:

[0963] The user starts watching a program featuring a specific idol.

[0964] Input: Program viewing operation

[0965] Output: Viewing start information

[0966] Step 2:

[0967] The device sends viewing information to the server.

[0968] Input: Viewing start information

[0969] Output: Upload to server

[0970] Step 3:

[0971] The server detects other users watching the same program in real time and matches them based on their viewing information.

[0972] Input: Viewing information

[0973] Output: Matching list

[0974] Step 4:

[0975] The server generates a real-time chat room for the matched users.

[0976] Input: Matching list

[0977] Output: Chat room link

[0978] Step 5:

[0979] The device provides the user with a link to the chat room and encourages them to access it.

[0980] Input: Chat room link

[0981] Output: Chat room notification

[0982] Combination of emotional engines

[0983] Step 1:

[0984] The device acquires text and voice information entered by the user.

[0985] Input: User's text or voice information

[0986] Output: Sentiment analysis data

[0987] Step 2:

[0988] The device uses an emotion engine to recognize the user's emotional state.

[0989] Input: Sentiment analysis data

[0990] Output: Emotional state data

[0991] Step 3:

[0992] The device sends the recognized emotional state to the server.

[0993] Input: Emotional state data

[0994] Output: Upload to server

[0995] Step 4:

[0996] The server uses generative artificial intelligence to improve the accuracy of relevant information based on emotional states.

[0997] Input: Emotional state data

[0998] Output: Personalized information

[0999] Step 5:

[1000] The device displays personalized information to the user.

[1001] Input: Personalized information

[1002] Output: Display on the user interface

[1003] (Application Example 2)

[1004] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1005] This invention relates to a system for users who support idols to efficiently collect and manage necessary information and communicate in real time with other users who share the same hobby. However, conventional systems do not take into account the user's emotional state, so the information provided and the communication experience are not sufficiently personalized, which may lead to low user satisfaction. Furthermore, it is difficult to match and communicate in real time with other like-minded people in physical stores.

[1006] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for centrally managing information relating to a predetermined group, means for providing real-time communication with other users who have similar hobbies, means for recognizing the user's emotional state using an emotion engine and providing information based on the recognized emotional state, and means for matching the user with like-minded people in the vicinity in a predetermined social setting and providing real-time communication. This enables information provision that takes the user's emotional state into consideration and real-time matching in physical stores.

[1007] "Means for receiving user input information" refers to a mechanism for receiving various data (text, audio, images, etc.) that a user inputs into the system and sending it to the server.

[1008] "Means for generating relevant information based on user preferences using generative artificial intelligence" refers to a mechanism that utilizes generative artificial intelligence technology to learn user preferences from user input information and past data, and automatically generates relevant information based on those preferences.

[1009] "Means for providing the generated information to the user" refers to a mechanism for displaying information generated by generative artificial intelligence on the user's device and making it accessible to the user.

[1010] "A means of centrally managing information related to a designated organization" refers to a mechanism for collecting and integrating various types of information (official blogs, social media posts, performance information, etc.) related to a specific organization or group and managing them in a single database.

[1011] "Means of providing real-time communication with other users who share similar hobbies" refers to a mechanism for sending messages and voice chatting in real time with other users who share the same hobbies on the system.

[1012] "A means of recognizing a user's emotional state using an emotion engine and providing information based on that recognized emotional state" refers to a mechanism that uses emotion recognition technology to infer a user's emotional state from their statements and actions, and then provides the user with appropriate information based on the inference results.

[1013] "A means of matching users with like-minded people in their vicinity in a given social setting and providing real-time communication" refers to a mechanism for matching and communicating in real time with other people who share the same interests in a specific physical location or social environment (e.g., a physical store, an event venue).

[1014] This invention relates to a system for users who support idols to efficiently collect and manage information and communicate in real time with other users who share the same hobby. The following describes specific embodiments of this invention.

[1015] The system related to this invention mainly consists of a server, a terminal, and a user. The server includes software such as an emotion engine, generative artificial intelligence, and a real-time chat module. This system runs on a terminal such as a smartphone and provides the following functions to the user.

[1016] 1. Centralized information management:

[1017] The server receives user input and uses generative artificial intelligence to generate information based on the user's preferences. For example, if a user wants to gather the latest information on "Idol A," this information is automatically collected and organized from official blogs, social media, TV appearances, etc., and displayed centrally on the device.

[1018] 2. Utilizing the Emotional Engine:

[1019] The device uses an emotion engine to analyze user input and recognize the user's current emotional state. Based on this recognized emotional state, the server provides relevant information using generative artificial intelligence. For example, if the user is in an "excited" state, it will prioritize providing information suitable for an excited user, such as the latest live event information or newly released merchandise.

[1020] 3. Provision of real-time chat:

[1021] When a user begins watching a particular media content, the server matches them with other viewers and creates a real-time chat room. This allows users to discuss the show in real time with other fans who share the same interests.

[1022] 4. Recommend your favorite idol or song:

[1023] When a user registers their favorite idol or song, the server's generative artificial intelligence analyzes that information and recommends other idols or songs that match the user's preferences. This allows users to discover new interests and broaden their range of hobbies.

[1024] 5. Matching with nearby users at physical stores:

[1025] This feature allows users to connect with like-minded individuals in designated social settings, such as physical locations (e.g., cafes or event venues), and communicate with them in real time. This functionality enables users to connect with people who share their interests even in physical spaces.

[1026] As a concrete example, if a user opens the "Idol Support Center" app on their smartphone while watching a live video of "Idol A" at a physical cafe, the latest information will be displayed in a list. Furthermore, if the user is in an excited state, the emotion engine recognizes this and prioritizes providing the latest live performance information and newly released merchandise. Simultaneously, the user can use the real-time chat function to discuss the live performance with other fans nearby.

[1027] Examples of input prompts for a generative AI model:

[1028] "Please provide a sample Python program that recommends content tailored to the user's interests, such as live videos or newly released items, when the user is in an excited emotional state."

[1029] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1030] Step 1:

[1031] The device receives user input information, including text, audio, and images. This input information is then sent to the emotion engine to analyze the user's current emotional state. To achieve this, the device uses the emotion engine's API to send the input information as an analysis request.

[1032] Step 2:

[1033] The server activates generative artificial intelligence based on the emotion analysis results received from the emotion engine, generating relevant information based on the user's preferences. The input includes data such as the user's emotional state and past activity history. The generative AI analyzes this data to generate the most relevant information for the user (e.g., the latest live event information, related articles, recommended idols).

[1034] Step 3:

[1035] The server saves the generated related information to a database and notifies the terminal. The terminal receives this notification and displays the related information to the user. Specifically, it retrieves the related information using an API call and displays it in the user interface.

[1036] Step 4:

[1037] When a user begins watching specific media content (e.g., live video), their device sends that viewing information to a server. The server uses this information to match other users watching the same content and creates a real-time chat room. This enables real-time communication.

[1038] Step 5:

[1039] The server manages information to match users with like-minded people nearby in specific social settings (e.g., physical stores or event venues). When a user is in a physical store, their device sends its location information to the server, which then detects other like-minded people in the same location. Based on this information, a real-time chat room is created, and users can join that chat room to communicate.

[1040] Through the above processing steps, users can efficiently collect idol-related information and receive personalized information based on their emotional state. Furthermore, real-time communication allows them to interact with other fans who share the same interests.

[1041] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1042] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1043] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1044] [Third Embodiment]

[1045] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1046] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1047] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1048] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1049] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1050] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1051] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1052] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1053] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1054] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1055] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1056] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1057] This invention provides a dedicated application system for users who support idols to efficiently collect and manage information and find friends with similar interests. The system receives user input, generates relevant information using generative artificial intelligence based on that input, and provides it to users. It also has the function of centrally managing information related to a given group and providing real-time communication with other users who share similar interests.

[1058] Program processing

[1059] Centralized information management

[1060] The server collects idol-related information from multiple sources based on user input. This includes official idol blogs, social media accounts, and television appearance information. The collected information is stored and organized in a database.

[1061] The terminal centrally manages and displays information retrieved from the database to the user. This eliminates the need for users to visit different websites.

[1062] For example, if a user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the user's device.

[1063] Real-time chat

[1064] When a user starts watching a program featuring a specific idol, the device sends that information to the server.

[1065] The server matches users watching the same program and creates chat rooms in real time. This allows users with similar interests to communicate with each other in real time.

[1066] As a concrete example, when a user starts watching a live show by "Idol B," the server searches for and matches them with other viewers, providing a common chat room. In that chat room, the user can discuss the show with other fans in real time.

[1067] Recommendations for your favorite idols and songs

[1068] Users register their favorite idols and songs in the application. This information is sent to the server via the device.

[1069] The server uses generative artificial intelligence to analyze registration information and learn user preferences. This makes it possible to recommend other different idol groups and songs.

[1070] The terminal notifies the user of recommendation results sent from the server, providing them with opportunities to discover new idols and songs.

[1071] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar idols, "Idol E," and songs, "Song F." This allows users to discover new interests and broaden their hobbies.

[1072] Overall System Overview

[1073] This system enables close collaboration between servers, terminals, and users to manage idol-related information, facilitate real-time communication, and provide recommendations using generative AI. Through this app, users can efficiently gather idol information, interact with like-minded individuals, and enjoy new discoveries.

[1074] The following describes the processing flow.

[1075] Centralized information management

[1076] Step 1:

[1077] The user launches the application and opens the login screen.

[1078] Step 2:

[1079] The user enters their login information (username, password) and presses the login button.

[1080] Step 3:

[1081] The terminal sends the entered login information to the server.

[1082] Step 4:

[1083] The server refers to the database to authenticate the login information it received.

[1084] Step 5:

[1085] The server sends the authentication result back to the terminal. If successful, it also includes user data.

[1086] Step 6:

[1087] The device receives the authentication result and displays the user's dashboard.

[1088] Step 7:

[1089] Select the idols the user is following on the dashboard.

[1090] Step 8:

[1091] The terminal sends an information request for the selected idle to the server.

[1092] Step 9:

[1093] Based on the requests received by the server, information on idols' blogs, photos, and TV appearances is collected via multiple APIs.

[1094] Step 10:

[1095] The server stores the collected information in a database.

[1096] Step 11:

[1097] The terminal retrieves information from the database and displays it on a centralized management screen.

[1098] Real-time chat

[1099] Step 1:

[1100] The user starts watching a program featuring a specific idol from within the app.

[1101] Step 2:

[1102] The device sends information about the program it is currently watching (such as the program ID and viewing time) to the server.

[1103] Step 3:

[1104] The server searches the database for other users who are watching the same program.

[1105] Step 4:

[1106] The server creates a list of matched users.

[1107] Step 5:

[1108] The server creates a chat room among the matched users.

[1109] Step 6:

[1110] The server sends chat room information (room ID, participant list, etc.) to the device.

[1111] Step 7:

[1112] The device displays the chat room UI to the user, enabling them to input and send messages.

[1113] Step 8:

[1114] The user types a message in the chat room and presses the send button.

[1115] Step 9:

[1116] The terminal sends the entered message to the server.

[1117] Step 10:

[1118] The server broadcasts the received message to all other participants' devices.

[1119] Step 11:

[1120] The device displays new messages in the chat screen in real time.

[1121] Recommendations for your favorite idols and songs

[1122] Step 1:

[1123] Users enter information about their favorite idol or song into the application and press the registration button.

[1124] Step 2:

[1125] The device sends registration information (idol name, song title, etc.) to the server.

[1126] Step 3:

[1127] The server saves the information it receives to the database.

[1128] Step 4:

[1129] The server uses generative artificial intelligence to analyze the user's registration information.

[1130] Step 5:

[1131] Based on the analysis results, the server generates other idols and songs that match the user's preferences.

[1132] Step 6:

[1133] The server sends the generated results to the terminal.

[1134] Step 7:

[1135] The device displays information about recommended idols and songs to the user.

[1136] Step 8:

[1137] Users can review recommended information and check out new idols and songs.

[1138] The above outlines the system's processing steps. This allows users to efficiently collect idle-related information, interact in real time, and enjoy new discoveries.

[1139] (Example 1)

[1140] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1141] There is a lack of efficient means to collect and centrally manage information in specific fields. Furthermore, there is a lack of effective methods for users with similar interests to communicate in real time. In addition, the current system is insufficient in generating and recommending relevant information based on user preferences. Therefore, it is necessary to provide means for users to gather information, interact, and discover new interests.

[1142] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1143] In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for collecting and centrally managing information on a specific field from information sources, and means for providing real-time communication with other users who have similar interests. As a result, the user can efficiently collect relevant information, utilize the centrally managed information, interact in real time with other users who have the same interests, and receive recommendations for new relevant information using generative artificial intelligence.

[1144] "Means for receiving user input information" refers to technical means for receiving data input from a user and transmitting that information to a system.

[1145] "Means for generating relevant information based on user preferences using generative artificial intelligence" refers to artificial intelligence technology that analyzes user input data and automatically generates appropriate information based on the results.

[1146] "Means for providing the generated information to the user" refers to a system or method for notifying the user of the generated information in an appropriate format.

[1147] "A means of collecting and centrally managing information on a specific field from various information sources" refers to a system for collecting necessary data from specific information sources and managing it in one place.

[1148] "Means of providing real-time communication with other users who share similar interests" refers to technologies and functions that enable users with the same interests to communicate with each other in real time.

[1149] "Digital content" refers to a collection of information that is stored and displayed electronically, and includes music, videos, text, and other similar materials.

[1150] "Recommendation methods" refer to technologies for presenting new information to users based on analysis results.

[1151] A "matching algorithm" is an algorithm or procedure used to compare multiple users or entities and find combinations that meet certain criteria.

[1152] Modes for carrying out the invention

[1153] This invention is a system for users with specific hobbies or interests to efficiently collect relevant information and communicate in real time with other users who share the same hobbies. The system aims to generate and provide relevant information based on the user's preferences using generative artificial intelligence.

[1154] Means for receiving user input information

[1155] Users input information about their areas of interest or specific digital content through the application. This information is sent to the server via their device (typically an iOS or Android device). Input information may include, for example, the names of their favorite idols or the names of programs they are currently watching.

[1156] A means of generating relevant information based on user preferences using generative artificial intelligence.

[1157] The server receives input from the user and generates relevant information using generative artificial intelligence (e.g., OpenAI GPT-3). This generative AI model receives prompt text as input and generates information based on the user's preferences.

[1158] Example of a prompt:

[1159] "The user has registered 'Idol A' as an area of ​​interest. Based on this information, please generate information about other idols and related topics that the user might be interested in."

[1160] Means for providing the generated information to the user

[1161] The server transmits relevant information obtained by generative artificial intelligence to the terminal. The terminal displays this information on its user interface and provides it to the user. This allows the user to easily obtain new information.

[1162] A means of collecting and centrally managing information on a specific field from various sources.

[1163] The server collects information on a specific field entered by the user from multiple sources (e.g., official websites, social media platforms, news sites, etc.). This process efficiently collects data using Python scripts and web scraping tools (e.g., Scrapy).

[1164] The collected information is stored in databases such as MySQL or MongoDB and organized using tags and categories. This allows for centralized management of information in specific fields, making it easy for users to retrieve the information they need.

[1165] A means of providing real-time communication with other users who share similar interests.

[1166] The device notifies the server when a user begins viewing specific digital content. Based on this information, the server searches its database for other users viewing the same content and uses a matching algorithm to perform the matching.

[1167] The server generates a real-time chat room for matched users using Socket.IO or WebSockets technology and sends this information to the terminal. The terminal updates its user interface based on this chat room information, providing an environment where users can communicate with each other in real time.

[1168] As a concrete example, when a user starts watching a live performance by "Artist X," they can chat in real time with other users who are watching the same performance. This feature allows users to easily interact with other users who share the same interests.

[1169] Through the means described above, this system can efficiently collect user information and communicate with them.

[1170] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1171] Step 1: Enter user information

[1172] The user opens the application and enters a specific area or content that interests them (e.g., idol name, song title, etc.).

[1173] Input: User-entered interest information (e.g., "Idol A")

[1174] Output: Request data sent from the terminal to the server.

[1175] Step 2: Receiving information

[1176] The server receives user input information sent from the terminal.

[1177] Input: Request data sent from the terminal

[1178] Output: Data object containing user interest information

[1179] Step 3: Information Gathering

[1180] The server collects relevant information from sources such as official blogs, social media, and news sites, based on the user's interests. This process uses web scraping tools (e.g., Scrapy).

[1181] Input: Data object containing user interest information

[1182] Output: Collected relevant information (e.g., idol's social media posts, news articles, etc.)

[1183] Step 4: Information storage and organization

[1184] The server stores the collected relevant information in a database (e.g., MySQL, MongoDB) and organizes the information using tags and categories.

[1185] Input: Collected related information

[1186] Output: Organized information stored in the database

[1187] Step 5: Using Generative AI

[1188] The server passes user interest information and related information stored in the database as input to generative artificial intelligence (e.g., OpenAI GPT-3). Prompt messages instruct the system to generate recommendation information.

[1189] Input: User interest information and organized information, prompt text

[1190] Output: Recommendation information generated by the AI ​​(e.g., other similar idols or songs)

[1191] Example prompt: "The user has shown interest in 'Idol A'. Based on this information, please recommend other idols and related content that the user might be interested in."

[1192] Step 6: Provide recommendation information

[1193] The server sends the recommendation information generated by the AI ​​to the terminal.

[1194] Input: Recommendation information generated by the AI.

[1195] Output: Recommendation information sent to the terminal

[1196] Step 7: Displaying Information

[1197] The device receives recommendation information sent from the server and displays it to the user. User interfaces are typically built using React Native or Flutter.

[1198] Input: Recommendation information sent from the server

[1199] Output: Recommended information displayed to the user

[1200] Step 8: Notification of program viewing

[1201] When a user starts watching specific digital content (e.g., an idol's live show), the device sends that information to the server.

[1202] Input: Information about the content the user started watching.

[1203] Output: Request data including viewing information

[1204] Step 9: Matching Viewers

[1205] The server receives viewing information, searches its database for other users who are watching the same content, and uses a matching algorithm to find matches.

[1206] Input: Viewing information

[1207] Output: Matched user list

[1208] Step 10: Create a chat room

[1209] The server creates a real-time chat room for the matched users and sends the chat room information to the terminal.

[1210] Input: Matched user list

[1211] Output: Generated chat room information

[1212] Step 11: Providing real-time chat

[1213] The device displays a real-time chat interface based on chat room information, allowing users to communicate with other fans in real time.

[1214] Input: Chat room information

[1215] Output: Displayed real-time chat interface

[1216] This allows users to efficiently gather relevant information and interact with other users in real time.

[1217] (Application Example 1)

[1218] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1219] In recent years, many people have developed a passion for entertainment and a growing tendency to support specific entertainers and content. However, users must gather information from a wide variety of sources, a process that is time-consuming and laborious. Furthermore, opportunities for real-time interaction with other users who share the same entertainment interests are limited. In addition, recommendation systems for users to discover new interests are not functioning adequately. Therefore, there is a need for a system that efficiently collects and centrally manages entertainment-related information and allows real-time interaction with other users who share similar tastes.

[1220] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1221] In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for centrally managing information related to entertainment, means for providing real-time communication with other users with similar interests, means for matching the user with other viewers and providing real-time communication when the user starts watching a predetermined media content, and means for the generative artificial intelligence to analyze the user's input information and recommend new relevant information. This enables efficient collection and centralized management of information related to entertainment, saving the user the trouble of visiting different information sources. Smooth real-time communication with other users with similar interests becomes possible, making it easier for the user to find friends with common interests. Furthermore, the recommendation of new entertainers and content based on the user's preferences increases opportunities to discover new interests.

[1222] "User input information" refers to data that users provide through the application, indicating their personal preferences and interests.

[1223] "Generative artificial intelligence" refers to algorithms and systems that analyze user input information and generate new related information based on that analysis.

[1224] "Generated information" refers to information generated by generative artificial intelligence based on the user's interests and preferences.

[1225] "Information related to entertainment" refers to various types of data, such as blogs, social media posts, and television appearance information related to specific forms of entertainment.

[1226] "Centralized management" refers to integrating, organizing, and managing information collected from multiple sources using a database or similar system.

[1227] "Real-time communication" refers to a form of communication in which messages and information are exchanged with other users in real time.

[1228] "Specified media content" refers to specific videos, programs, live events, or other content that the user watches or is interested in.

[1229] "Matching" is the process of finding other users with similar interests and providing them with opportunities to interact with each other.

[1230] A "chat room" is an online space where multiple users can communicate in real time.

[1231] "Favorite entertainment" refers to the entertainment that a user particularly supports and is interested in.

[1232] "New relevant information" refers to new and interesting information or content generated based on existing data and interests for the user.

[1233] "Recommendation" refers to the act of generative artificial intelligence analyzing a user's preferences and then presenting new entertainers and content based on those preferences.

[1234] The present invention includes a system for efficiently collecting and centrally managing entertainment information, a system for providing real-time communication with other users who have similar tastes based on that information, and a system for recommending new relevant information based on user preferences using generative artificial intelligence.

[1235] server

[1236] The server collects entertainment-related information from multiple sources, stores it in a database, and manages it centrally. For example, it automatically retrieves information from official entertainment blogs, social media accounts, and television appearances via APIs. The server uses generative artificial intelligence to analyze user input and generate information to recommend new entertainment and content.

[1237] As a concrete example, a server collects and organizes information about "Entertainment A," and stores blogs, social media posts, and TV appearance information related to "Entertainment A" in a database. Based on this information, the server generates other entertainment information that the user might be interested in.

[1238] terminal

[1239] The user's device centrally manages and provides information obtained from the server. When a user starts watching a specific type of entertainment, the device sends that information to the server. The server matches the user with other users watching the same entertainment, creates a chat room, and provides real-time communication.

[1240] As a concrete example, when a user starts watching a live event for "Entertainment B," their device sends that information to the server. The server searches for other viewers, and the device creates a shared chat room. The user can then interact with other fans in real time within the chat room.

[1241] User

[1242] Users access the system via their devices and register their favorite entertainment and content. This information is analyzed by the server, and generative artificial intelligence recommends new entertainment and content.

[1243] For example, when a user registers "Entertainment C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar "Entertainment E" and "Song F." This allows users to discover new interests and broaden their horizons.

[1244] Overall system flow

[1245] This entire system, through the close collaboration of servers, terminals, and users, enables efficient collection and centralized management of entertainment information, real-time communication, and recommendations using generative AI. Through this system, users can efficiently gather various entertainment information, interact with like-minded individuals, and enjoy new discoveries.

[1246] Example of a prompt

[1247] Please collect and centrally manage the latest information on "Entertainment A." Additionally, please activate a real-time chat function and provide a matching feature for fans watching simultaneously. Furthermore, please use generative artificial intelligence to recommend other entertainment and content based on my favorite entertainment and content preferences.

[1248] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1249] Step 1:

[1250] The server receives the input information.

[1251] Users input their favorite entertainment and content through their devices, and the server receives this information. The received information is then stored in a database.

[1252] Input: Data on favorite entertainment and content entered by the user via their device.

[1253] Output: Input information stored in the database.

[1254] Step 2:

[1255] The server collects and centrally manages information.

[1256] The server collects entertainment-related data from multiple sources. It uses APIs to retrieve official blogs, social media accounts, and television appearance information, and stores it in a database.

[1257] Input: Various entertainment-related data obtained via API.

[1258] Output: Information organized and stored in the database.

[1259] Specific operation: The server periodically sends requests to each information source to obtain the latest information, compare it with existing data, and update it.

[1260] Step 3:

[1261] The server analyzes the user's input information.

[1262] Generative artificial intelligence is used to analyze user input information and understand user preferences and tastes. The generative AI model analyzes the input data and extracts specific trends and patterns.

[1263] Input: User input information, entertainment-related information stored in the database.

[1264] Output: Analysis results (user preference patterns).

[1265] Specific operation: The generative AI model learns from the user's input information and outputs it as data that visualizes relevant characteristics and trends.

[1266] Step 4:

[1267] The server generates new related information.

[1268] Based on the previously obtained analysis results, generative artificial intelligence generates new relevant information and recommends it to the user.

[1269] Input: Analysis results (user preference patterns).

[1270] Output: Newly generated related information (recommended content).

[1271] Specific operation: The generative AI model combines information from the database to generate entertainment and content that is highly relevant to the user.

[1272] Step 5:

[1273] The device notifies the user of the generated information.

[1274] Newly generated relevant information and recommended content are provided to the user through the device.

[1275] Input: Newly generated related information (recommended content).

[1276] Output: Information notified to the user.

[1277] Specific operation: The device displays the generated relevant information to the user via push notifications or in-app messages.

[1278] Step 6:

[1279] Users view content.

[1280] When a user watches their favorite entertainment or recommended content, that information is sent to the server via their device.

[1281] Input: Information about the content the user started watching.

[1282] Output: Viewing information sent to the server.

[1283] Specific operation: The device automatically sends information to the server when the user starts watching.

[1284] Step 7:

[1285] The server performs real-time matching.

[1286] The server matches other viewers based on viewing information and creates a real-time chat room.

[1287] Input: Information about the content being viewed.

[1288] Output: The generated real-time chat room.

[1289] Specific operation: The server searches the database to find other viewers and sets up a common chat room.

[1290] Step 8:

[1291] The terminal provides real-time communication.

[1292] The device provides real-time communication to users through the generated real-time chat room. Users can enjoy entertainment while exchanging messages with each other.

[1293] Input: Generated real-time chat room, messages from other users.

[1294] Output: Real-time message exchange.

[1295] Specific operation: The device sends and receives messages in real time and displays them on the user interface.

[1296] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1297] This invention combines an emotion engine with a dedicated application system designed to allow users who support idols to efficiently collect and manage information and find friends with similar interests. This enables more accurate information provision and communication tailored to the user's emotional state.

[1298] Program processing

[1299] Centralized information management

[1300] The server collects idol-related information from multiple sources based on user input. This information collection includes official idol blogs and social media accounts, as well as television appearance information. The collected information is stored and organized in a database.

[1301] The terminal centrally manages and displays information retrieved from the database to the user. This eliminates the need for users to visit different websites.

[1302] For example, if a user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the user's device.

[1303] Real-time chat

[1304] When a user starts watching a program featuring a specific idol, their device sends that information to the server.

[1305] The server matches users watching the same program and creates chat rooms in real time. This allows users with similar interests to communicate with each other in real time.

[1306] As a concrete example, when a user starts watching a live show by "Idol B," the server searches for and matches them with other viewers, providing a common chat room. In that chat room, the user can discuss the show with other fans in real time.

[1307] Recommendations for your favorite idols and songs

[1308] Users register their favorite idols and songs in the application. This information is sent to the server via the device.

[1309] The server uses generative artificial intelligence to analyze registration information and learn user preferences. This makes it possible to recommend other different idol groups and songs.

[1310] The terminal notifies the user of recommendation results sent from the server, providing them with opportunities to discover new idols and songs.

[1311] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar idols, "Idol E," and songs, "Song F." This allows users to discover new interests and broaden their hobbies.

[1312] Combination of emotional engines

[1313] This system will also gain the ability to recognize the user's emotional state by incorporating an emotion engine.

[1314] The terminal uses an emotion engine to recognize the user's emotional state, along with the user's input information. This information is also sent to the server.

[1315] The server improves the accuracy of related information generated by generative artificial intelligence based on the recognized emotional state. This enables the provision of personalized information tailored to the user's emotions.

[1316] For example, when a user is searching for information about "Idol G," if the emotion engine recognizes that the user is in an "excited" state, the generative artificial intelligence will prioritize providing relevant information that is suitable for an excited user.

[1317] Furthermore, by using an emotion engine, it is possible to analyze the user's emotions in real-time chat and facilitate appropriate communication based on those emotions.

[1318] Thus, by combining an emotion engine, the present invention makes it possible to provide a more personalized experience for users and to make idol fan activities more enjoyable and efficient.

[1319] The following describes the processing flow.

[1320] Centralized information management

[1321] Step 1:

[1322] The user launches the application and opens the login screen.

[1323] Step 2:

[1324] The user enters their login information (username, password) and presses the login button.

[1325] Step 3:

[1326] The terminal sends the entered login information to the server.

[1327] Step 4:

[1328] The server refers to the database to authenticate the login information it received.

[1329] Step 5:

[1330] The server sends the authentication result back to the terminal. If successful, it also includes user data.

[1331] Step 6:

[1332] The device receives the authentication result and displays the user's dashboard.

[1333] Step 7:

[1334] Select the idols the user is following on the dashboard.

[1335] Step 8:

[1336] The terminal sends an information request for the selected idle to the server.

[1337] Step 9:

[1338] Based on the requests received by the server, information on idols' blogs, photos, and TV appearances is collected via multiple APIs.

[1339] Step 10:

[1340] The server stores the collected information in a database.

[1341] Step 11:

[1342] The terminal retrieves information from the database and displays it on a centralized management screen.

[1343] Real-time chat

[1344] Step 1:

[1345] The user starts watching a program featuring a specific idol from within the app.

[1346] Step 2:

[1347] The device sends information about the program it is currently watching (such as the program ID and viewing time) to the server.

[1348] Step 3:

[1349] The server searches the database for other users who are watching the same program.

[1350] Step 4:

[1351] The server creates a list of matched users.

[1352] Step 5:

[1353] The server creates a chat room among the matched users.

[1354] Step 6:

[1355] The server sends chat room information (room ID, participant list, etc.) to the device.

[1356] Step 7:

[1357] The device displays the chat room UI to the user, enabling them to input and send messages.

[1358] Step 8:

[1359] The user types a message in the chat room and presses the send button.

[1360] Step 9:

[1361] The terminal sends the entered message to the server.

[1362] Step 10:

[1363] The server broadcasts the received message to all other participants' devices.

[1364] Step 11:

[1365] The device displays new messages in the chat screen in real time.

[1366] Recommendations for your favorite idols and songs

[1367] Step 1:

[1368] Users enter information about their favorite idol or song into the application and press the registration button.

[1369] Step 2:

[1370] The device sends registration information (idol name, song title, etc.) to the server.

[1371] Step 3:

[1372] The server saves the information it receives to the database.

[1373] Step 4:

[1374] The server uses generative artificial intelligence to analyze the user's registration information.

[1375] Step 5:

[1376] Based on the analysis results, the server generates other idols and songs that match the user's preferences.

[1377] Step 6:

[1378] The server sends the generated results to the terminal.

[1379] Step 7:

[1380] The device displays information about recommended idols and songs to the user.

[1381] Step 8:

[1382] Users can review recommended information and check out new idols and songs.

[1383] Combination of emotional engines

[1384] Step 1:

[1385] The user logs in to the application and presses the "Start Using" button.

[1386] Step 2:

[1387] The device activates sensor devices such as cameras and microphones to recognize the user's emotions in real time.

[1388] Step 3:

[1389] The device uses an emotion engine to analyze the user's emotional state from their facial expressions and voice.

[1390] Step 4:

[1391] The device sends user input information, including the emotional state it has analyzed, to the server.

[1392] Step 5:

[1393] The server saves the received emotional state and input information to a database.

[1394] Step 6:

[1395] The server uses generative artificial intelligence to generate highly accurate relevant information that reflects emotional states.

[1396] Step 7:

[1397] The server sends the relevant information it generates to the terminal.

[1398] Step 8:

[1399] The device displays personalized information tailored to the user's emotional state.

[1400] For example, when a user is searching for information on "Idol H," if the emotion engine recognizes the user's "excited" state, the server will prioritize providing information that is highly relevant to eliciting excitement. Conversely, if the user is in a "relaxed" state, it will provide content containing calmer topics.

[1401] Thus, by combining an emotion engine, the present invention provides a highly accurate information provision and communication platform that responds to the user's real-time emotions.

[1402] (Example 2)

[1403] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1404] Users who support idols need to efficiently collect and manage information from many sources, and it is difficult for them to find friends who share the same hobby. Furthermore, there is a lack of personalized information that is tailored to the user's emotional state.

[1405] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1406] In this invention, the server includes means for receiving user input information and collecting relevant information from multiple information sources based on said input information; means for storing and organizing the collected information in a database; means for recognizing the user's emotional state using an emotion engine; means for generating relevant information based on the user's preferences and emotional state using generative artificial intelligence; means for providing the generated information to the user; means for centrally managing information relating to a predetermined object; and means for providing real-time communication with other users who have similar hobbies. As a result, users can efficiently collect and manage information and receive personalized information according to their emotional state. It also makes it easier for them to find friends who share the same hobbies.

[1407] "Means for receiving user input information and collecting relevant information from multiple sources based on said input information" refers to means for obtaining relevant data from multiple internet sources such as official blogs, social media, and television appearance information based on the idol name and keywords entered by the user into the application.

[1408] "Means of storing and organizing collected information in a database" refers to methods of managing collected idol-related information by storing it in a database and organizing it by date and type of information (blogs, social media, television appearances, etc.).

[1409] "Means of recognizing a user's emotional state using an emotion engine" refers to a method of using an emotion analysis engine to analyze text and voice information entered by the user and recognize their emotional state (e.g., excitement, joy, sadness, etc.).

[1410] "Means for generating relevant information based on user preferences and emotional states using generative artificial intelligence" refers to means for generating optimal relevant information using a generative AI model (e.g., GPT-4) while considering the user's preferences and emotional states.

[1411] "Means for providing the generated information to the user" refers to means for notifying the user's terminal of the generated related information and displaying it in an appropriate format.

[1412] "Means for centrally managing information related to a specified subject" refers to a means of consolidating various pieces of information about a particular idol into a single database and managing them uniformly.

[1413] "Means of providing real-time communication with other users who share similar interests" refers to providing a function that allows users who support the same idol to communicate with each other in real time.

[1414] This invention combines an emotion engine with a dedicated application system designed to allow users who support idols to efficiently collect and manage information and find friends with similar interests. The main hardware of the system consists of a server and user terminals, while the main software includes web scraping tools, database management systems (e.g., MySQL, PostgreSQL), generative artificial intelligence (e.g., GPT-4), and an emotion engine (e.g., Emotion AI).

[1415] Centralized information management

[1416] The server retrieves the idol's name and related keywords entered by the user, and uses web scraping techniques and APIs to collect relevant information from multiple sources such as official blogs, social media, and television appearances. The collected information is stored in a database management system and organized by date and type of information.

[1417] The terminal retrieves comprehensively organized information from the database and displays it to the user. For example, if the user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the terminal in a tile-like format.

[1418] Recommendations for your favorite idols and songs

[1419] When a user registers their favorite idol or song in the application, the device sends this information to the server. The server uses generative artificial intelligence to analyze the registered information and learn the user's preferences, then lists other similar idol groups and songs.

[1420] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the data and recommends similar idols, "Idol E," and songs, "Song F." The device then notifies the user, providing them with opportunities to discover new idols and songs.

[1421] Real-time chat

[1422] When a user starts watching a program featuring a specific idol, their device sends that viewing information to a server. The server then detects other users watching the same program in real time and matches them based on their viewing information.

[1423] For example, when a user starts watching a live show by "Idol B," the server matches them with other viewers and creates a real-time chat room. Users can then talk to other viewers in real time through their device.

[1424] Combination of emotional engines

[1425] The device acquires text and voice information entered by the user and uses an emotion engine to recognize the user's emotional state. This recognized emotional information is sent to the server. Based on the emotional state, the server uses generative artificial intelligence to improve the accuracy of related information.

[1426] For example, when a user is searching for information about "Idol G," if the emotion engine recognizes the user's emotion as "excitement," the generative artificial intelligence will prioritize generating relevant information appropriate to the user's state of excitement and display it on the device.

[1427] By combining these functions, this system provides users with a personalized experience, making idol fan activities more enjoyable and efficient.

[1428] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1429] Program processing steps

[1430] Centralized information management

[1431] Step 1:

[1432] The user logs into the application and enters the name of their favorite idol and related keywords.

[1433] Input: The user enters the name of the idol or keywords.

[1434] Output: Search queries containing idol names or keywords

[1435] Step 2:

[1436] Based on the received idol name and keywords, the server starts the process of collecting relevant information from multiple sources (e.g., official blog, social media, appearance information) using web scraping techniques and APIs.

[1437] Input: Search query

[1438] Output: Data collected from each information source.

[1439] Step 3:

[1440] The server stores the collected data in a database management system, organizing it by date and type of information.

[1441] Input: Collected data

[1442] Output: Organized database entries

[1443] Step 4:

[1444] The terminal requests and receives organized information from the database.

[1445] Input: Data request to the server

[1446] Output: Integrated information data

[1447] Step 5:

[1448] The terminal displays received information centrally through a user-friendly interface.

[1449] Input: Integrated Information Data

[1450] Output: List display on the user interface

[1451] Recommendations for your favorite idols and songs

[1452] Step 1:

[1453] Users register their favorite idols and songs in the application.

[1454] Input: Registration information for your favorite idol or song

[1455] Output: Data packet containing registration information

[1456] Step 2:

[1457] The device sends this registration information to the server.

[1458] Input: Data packet

[1459] Output: Upload to server

[1460] Step 3:

[1461] The server uses generative artificial intelligence to analyze registration information and learn user preferences.

[1462] Input: Registration Information

[1463] Output: Analysis results and list of recommended candidates

[1464] Step 4:

[1465] The server generates recommendation candidates based on the analysis results and sends them to the terminal.

[1466] Input: Analysis results and list of recommended candidates

[1467] Output: Recommendation List

[1468] Step 5:

[1469] The device notifies the user of the recommendation results, providing them with opportunities to discover new idols and songs.

[1470] Input: Recommendation list

[1471] Output: User notification

[1472] Real-time chat

[1473] Step 1:

[1474] The user starts watching a program featuring a specific idol.

[1475] Input: Program viewing operation

[1476] Output: Viewing start information

[1477] Step 2:

[1478] The device sends viewing information to the server.

[1479] Input: Viewing start information

[1480] Output: Upload to server

[1481] Step 3:

[1482] The server detects other users watching the same program in real time and matches them based on their viewing information.

[1483] Input: Viewing information

[1484] Output: Matching list

[1485] Step 4:

[1486] The server generates a real-time chat room for the matched users.

[1487] Input: Matching list

[1488] Output: Chat room link

[1489] Step 5:

[1490] The device provides the user with a link to the chat room and encourages them to access it.

[1491] Input: Chat room link

[1492] Output: Chat room notification

[1493] Combination of emotional engines

[1494] Step 1:

[1495] The device acquires text and voice information entered by the user.

[1496] Input: User's text or voice information

[1497] Output: Sentiment analysis data

[1498] Step 2:

[1499] The device uses an emotion engine to recognize the user's emotional state.

[1500] Input: Sentiment analysis data

[1501] Output: Emotional state data

[1502] Step 3:

[1503] The device sends the recognized emotional state to the server.

[1504] Input: Emotional state data

[1505] Output: Upload to server

[1506] Step 4:

[1507] The server uses generative artificial intelligence to improve the accuracy of relevant information based on emotional states.

[1508] Input: Emotional state data

[1509] Output: Personalized information

[1510] Step 5:

[1511] The device displays personalized information to the user.

[1512] Input: Personalized information

[1513] Output: Display on the user interface

[1514] (Application Example 2)

[1515] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1516] This invention relates to a system for users who support idols to efficiently collect and manage necessary information and communicate in real time with other users who share the same hobby. However, conventional systems do not take into account the user's emotional state, so the information provided and the communication experience are not sufficiently personalized, which may lead to low user satisfaction. Furthermore, it is difficult to match and communicate in real time with other like-minded people in physical stores.

[1517] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for centrally managing information relating to a predetermined group, means for providing real-time communication with other users who have similar hobbies, means for recognizing the user's emotional state using an emotion engine and providing information based on the recognized emotional state, and means for matching the user with like-minded people in the vicinity in a predetermined social setting and providing real-time communication. This enables information provision that takes the user's emotional state into consideration and real-time matching in physical stores.

[1518] "Means for receiving user input information" refers to a mechanism for receiving various data (text, audio, images, etc.) that a user inputs into the system and sending it to the server.

[1519] "Means for generating relevant information based on user preferences using generative artificial intelligence" refers to a mechanism that utilizes generative artificial intelligence technology to learn user preferences from user input information and past data, and automatically generates relevant information based on those preferences.

[1520] "Means for providing the generated information to the user" refers to a mechanism for displaying information generated by generative artificial intelligence on the user's device and making it accessible to the user.

[1521] "A means of centrally managing information related to a designated organization" refers to a mechanism for collecting and integrating various types of information (official blogs, social media posts, performance information, etc.) related to a specific organization or group and managing them in a single database.

[1522] "Means of providing real-time communication with other users who share similar hobbies" refers to a mechanism for sending messages and voice chatting in real time with other users who share the same hobbies on the system.

[1523] "A means of recognizing a user's emotional state using an emotion engine and providing information based on that recognized emotional state" refers to a mechanism that uses emotion recognition technology to infer a user's emotional state from their statements and actions, and then provides the user with appropriate information based on the inference results.

[1524] "A means of matching users with like-minded people in their vicinity in a given social setting and providing real-time communication" refers to a mechanism for matching and communicating in real time with other people who share the same interests in a specific physical location or social environment (e.g., a physical store, an event venue).

[1525] This invention relates to a system for users who support idols to efficiently collect and manage information and communicate in real time with other users who share the same hobby. The following describes specific embodiments of this invention.

[1526] The system related to this invention mainly consists of a server, a terminal, and a user. The server includes software such as an emotion engine, generative artificial intelligence, and a real-time chat module. This system runs on a terminal such as a smartphone and provides the following functions to the user.

[1527] 1. Centralized information management:

[1528] The server receives user input and uses generative artificial intelligence to generate information based on the user's preferences. For example, if a user wants to gather the latest information on "Idol A," this information is automatically collected and organized from official blogs, social media, TV appearances, etc., and displayed centrally on the device.

[1529] 2. Utilizing the Emotional Engine:

[1530] The device uses an emotion engine to analyze user input and recognize the user's current emotional state. Based on this recognized emotional state, the server provides relevant information using generative artificial intelligence. For example, if the user is in an "excited" state, it will prioritize providing information suitable for an excited user, such as the latest live event information or newly released merchandise.

[1531] 3. Provision of real-time chat:

[1532] When a user begins watching a particular media content, the server matches them with other viewers and creates a real-time chat room. This allows users to discuss the show in real time with other fans who share the same interests.

[1533] 4. Recommend your favorite idol or song:

[1534] When a user registers their favorite idol or song, the server's generative artificial intelligence analyzes that information and recommends other idols or songs that match the user's preferences. This allows users to discover new interests and broaden their range of hobbies.

[1535] 5. Matching with nearby users at physical stores:

[1536] This feature allows users to connect with like-minded individuals in designated social settings, such as physical locations (e.g., cafes or event venues), and communicate with them in real time. This functionality enables users to connect with people who share their interests even in physical spaces.

[1537] As a concrete example, if a user opens the "Idol Support Center" app on their smartphone while watching a live video of "Idol A" at a physical cafe, the latest information will be displayed in a list. Furthermore, if the user is in an excited state, the emotion engine recognizes this and prioritizes providing the latest live performance information and newly released merchandise. Simultaneously, the user can use the real-time chat function to discuss the live performance with other fans nearby.

[1538] Examples of input prompts for a generative AI model:

[1539] "Please provide a sample Python program that recommends content tailored to the user's interests, such as live videos or newly released items, when the user is in an excited emotional state."

[1540] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1541] Step 1:

[1542] The device receives user input information, including text, audio, and images. This input information is then sent to the emotion engine to analyze the user's current emotional state. To achieve this, the device uses the emotion engine's API to send the input information as an analysis request.

[1543] Step 2:

[1544] The server activates generative artificial intelligence based on the emotion analysis results received from the emotion engine, generating relevant information based on the user's preferences. The input includes data such as the user's emotional state and past activity history. The generative AI analyzes this data to generate the most relevant information for the user (e.g., the latest live event information, related articles, recommended idols).

[1545] Step 3:

[1546] The server saves the generated related information to a database and notifies the terminal. The terminal receives this notification and displays the related information to the user. Specifically, it retrieves the related information using an API call and displays it in the user interface.

[1547] Step 4:

[1548] When a user begins watching specific media content (e.g., live video), their device sends that viewing information to a server. The server uses this information to match other users watching the same content and creates a real-time chat room. This enables real-time communication.

[1549] Step 5:

[1550] The server manages information to match users with like-minded people nearby in specific social settings (e.g., physical stores or event venues). When a user is in a physical store, their device sends its location information to the server, which then detects other like-minded people in the same location. Based on this information, a real-time chat room is created, and users can join that chat room to communicate.

[1551] Through the above processing steps, users can efficiently collect idol-related information and receive personalized information based on their emotional state. Furthermore, real-time communication allows them to interact with other fans who share the same interests.

[1552] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1553] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1554] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1555] [Fourth Embodiment]

[1556] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1557] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1558] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1559] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1560] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1561] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1562] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1563] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1564] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1565] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1566] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1567] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1568] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1569] This invention provides a dedicated application system for users who support idols to efficiently collect and manage information and find friends with similar interests. The system receives user input, generates relevant information using generative artificial intelligence based on that input, and provides it to users. It also has the function of centrally managing information related to a given group and providing real-time communication with other users who share similar interests.

[1570] Program processing

[1571] Centralized information management

[1572] The server collects idol-related information from multiple sources based on user input. This includes official idol blogs, social media accounts, and television appearance information. The collected information is stored and organized in a database.

[1573] The terminal centrally manages and displays information retrieved from the database to the user. This eliminates the need for users to visit different websites.

[1574] For example, if a user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the user's device.

[1575] Real-time chat

[1576] When a user starts watching a program featuring a specific idol, the device sends that information to the server.

[1577] The server matches users watching the same program and creates chat rooms in real time. This allows users with similar interests to communicate with each other in real time.

[1578] As a concrete example, when a user starts watching a live show by "Idol B," the server searches for and matches them with other viewers, providing a common chat room. In that chat room, the user can discuss the show with other fans in real time.

[1579] Recommendations for your favorite idols and songs

[1580] Users register their favorite idols and songs in the application. This information is sent to the server via the device.

[1581] The server uses generative artificial intelligence to analyze registration information and learn user preferences. This makes it possible to recommend other different idol groups and songs.

[1582] The terminal notifies the user of recommendation results sent from the server, providing them with opportunities to discover new idols and songs.

[1583] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar idols, "Idol E," and songs, "Song F." This allows users to discover new interests and broaden their hobbies.

[1584] Overall System Overview

[1585] This system enables close collaboration between servers, terminals, and users to manage idol-related information, facilitate real-time communication, and provide recommendations using generative AI. Through this app, users can efficiently gather idol information, interact with like-minded individuals, and enjoy new discoveries.

[1586] The following describes the processing flow.

[1587] Centralized information management

[1588] Step 1:

[1589] The user launches the application and opens the login screen.

[1590] Step 2:

[1591] The user enters their login information (username, password) and presses the login button.

[1592] Step 3:

[1593] The terminal sends the entered login information to the server.

[1594] Step 4:

[1595] The server refers to the database to authenticate the login information it received.

[1596] Step 5:

[1597] The server sends the authentication result back to the terminal. If successful, it also includes user data.

[1598] Step 6:

[1599] The device receives the authentication result and displays the user's dashboard.

[1600] Step 7:

[1601] Select the idols the user is following on the dashboard.

[1602] Step 8:

[1603] The terminal sends an information request for the selected idle to the server.

[1604] Step 9:

[1605] Based on the requests received by the server, information on idols' blogs, photos, and TV appearances is collected via multiple APIs.

[1606] Step 10:

[1607] The server stores the collected information in a database.

[1608] Step 11:

[1609] The terminal retrieves information from the database and displays it on a centralized management screen.

[1610] Real-time chat

[1611] Step 1:

[1612] The user starts watching a program featuring a specific idol from within the app.

[1613] Step 2:

[1614] The device sends information about the program it is currently watching (such as the program ID and viewing time) to the server.

[1615] Step 3:

[1616] The server searches the database for other users who are watching the same program.

[1617] Step 4:

[1618] The server creates a list of matched users.

[1619] Step 5:

[1620] The server creates a chat room among the matched users.

[1621] Step 6:

[1622] The server sends chat room information (room ID, participant list, etc.) to the device.

[1623] Step 7:

[1624] The device displays the chat room UI to the user, enabling them to input and send messages.

[1625] Step 8:

[1626] The user types a message in the chat room and presses the send button.

[1627] Step 9:

[1628] The terminal sends the entered message to the server.

[1629] Step 10:

[1630] The server broadcasts the received message to all other participants' devices.

[1631] Step 11:

[1632] The device displays new messages in the chat screen in real time.

[1633] Recommendations for your favorite idols and songs

[1634] Step 1:

[1635] Users enter information about their favorite idol or song into the application and press the registration button.

[1636] Step 2:

[1637] The device sends registration information (idol name, song title, etc.) to the server.

[1638] Step 3:

[1639] The server saves the information it receives to the database.

[1640] Step 4:

[1641] The server uses generative artificial intelligence to analyze the user's registration information.

[1642] Step 5:

[1643] Based on the analysis results, the server generates other idols and songs that match the user's preferences.

[1644] Step 6:

[1645] The server sends the generated results to the terminal.

[1646] Step 7:

[1647] The device displays information about recommended idols and songs to the user.

[1648] Step 8:

[1649] Users can review recommended information and check out new idols and songs.

[1650] The above outlines the system's processing steps. This allows users to efficiently collect idle-related information, interact in real time, and enjoy new discoveries.

[1651] (Example 1)

[1652] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1653] There is a lack of efficient means to collect and centrally manage information in specific fields. Furthermore, there is a lack of effective methods for users with similar interests to communicate in real time. In addition, the current system is insufficient in generating and recommending relevant information based on user preferences. Therefore, it is necessary to provide means for users to gather information, interact, and discover new interests.

[1654] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1655] In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for collecting and centrally managing information on a specific field from information sources, and means for providing real-time communication with other users who have similar interests. As a result, the user can efficiently collect relevant information, utilize the centrally managed information, interact in real time with other users who have the same interests, and receive recommendations for new relevant information using generative artificial intelligence.

[1656] "Means for receiving user input information" refers to technical means for receiving data input from a user and transmitting that information to a system.

[1657] "Means for generating relevant information based on user preferences using generative artificial intelligence" refers to artificial intelligence technology that analyzes user input data and automatically generates appropriate information based on the results.

[1658] "Means for providing the generated information to the user" refers to a system or method for notifying the user of the generated information in an appropriate format.

[1659] "A means of collecting and centrally managing information on a specific field from various information sources" refers to a system for collecting necessary data from specific information sources and managing it in one place.

[1660] "Means of providing real-time communication with other users who share similar interests" refers to technologies and functions that enable users with the same interests to communicate with each other in real time.

[1661] "Digital content" refers to a collection of information that is stored and displayed electronically, and includes music, videos, text, and other similar materials.

[1662] "Recommendation methods" refer to technologies for presenting new information to users based on analysis results.

[1663] A "matching algorithm" is an algorithm or procedure used to compare multiple users or entities and find combinations that meet certain criteria.

[1664] Modes for carrying out the invention

[1665] This invention is a system for users with specific hobbies or interests to efficiently collect relevant information and communicate in real time with other users who share the same hobbies. The system aims to generate and provide relevant information based on the user's preferences using generative artificial intelligence.

[1666] Means for receiving user input information

[1667] Users input information about their areas of interest or specific digital content through the application. This information is sent to the server via their device (typically an iOS or Android device). Input information may include, for example, the names of their favorite idols or the names of programs they are currently watching.

[1668] A means of generating relevant information based on user preferences using generative artificial intelligence.

[1669] The server receives input from the user and generates relevant information using generative artificial intelligence (e.g., OpenAI GPT-3). This generative AI model receives prompt text as input and generates information based on the user's preferences.

[1670] Example of a prompt:

[1671] "The user has registered 'Idol A' as an area of ​​interest. Based on this information, please generate information about other idols and related topics that the user might be interested in."

[1672] Means for providing the generated information to the user

[1673] The server transmits relevant information obtained by generative artificial intelligence to the terminal. The terminal displays this information on its user interface and provides it to the user. This allows the user to easily obtain new information.

[1674] A means of collecting and centrally managing information on a specific field from various sources.

[1675] The server collects information on a specific field entered by the user from multiple sources (e.g., official websites, social media platforms, news sites, etc.). This process efficiently collects data using Python scripts and web scraping tools (e.g., Scrapy).

[1676] The collected information is stored in databases such as MySQL or MongoDB and organized using tags and categories. This allows for centralized management of information in specific fields, making it easy for users to retrieve the information they need.

[1677] A means of providing real-time communication with other users who share similar interests.

[1678] The device notifies the server when a user begins viewing specific digital content. Based on this information, the server searches its database for other users viewing the same content and uses a matching algorithm to perform the matching.

[1679] The server generates a real-time chat room for matched users using Socket.IO or WebSockets technology and sends this information to the terminal. The terminal updates its user interface based on this chat room information, providing an environment where users can communicate with each other in real time.

[1680] As a concrete example, when a user starts watching a live performance by "Artist X," they can chat in real time with other users who are watching the same performance. This feature allows users to easily interact with other users who share the same interests.

[1681] Through the means described above, this system can efficiently collect user information and communicate with them.

[1682] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1683] Step 1: Enter user information

[1684] The user opens the application and enters a specific area or content that interests them (e.g., idol name, song title, etc.).

[1685] Input: User-entered interest information (e.g., "Idol A")

[1686] Output: Request data sent from the terminal to the server.

[1687] Step 2: Receiving information

[1688] The server receives user input information sent from the terminal.

[1689] Input: Request data sent from the terminal

[1690] Output: Data object containing user interest information

[1691] Step 3: Information Gathering

[1692] The server collects relevant information from sources such as official blogs, social media, and news sites, based on the user's interests. This process uses web scraping tools (e.g., Scrapy).

[1693] Input: Data object containing user interest information

[1694] Output: Collected relevant information (e.g., idol's social media posts, news articles, etc.)

[1695] Step 4: Information storage and organization

[1696] The server stores the collected relevant information in a database (e.g., MySQL, MongoDB) and organizes the information using tags and categories.

[1697] Input: Collected related information

[1698] Output: Organized information stored in the database

[1699] Step 5: Using Generative AI

[1700] The server passes user interest information and related information stored in the database as input to generative artificial intelligence (e.g., OpenAI GPT-3). Prompt messages instruct the system to generate recommendation information.

[1701] Input: User interest information and organized information, prompt text

[1702] Output: Recommendation information generated by the AI ​​(e.g., other similar idols or songs)

[1703] Example prompt: "The user has shown interest in 'Idol A'. Based on this information, please recommend other idols and related content that the user might be interested in."

[1704] Step 6: Provide recommendation information

[1705] The server sends the recommendation information generated by the AI ​​to the terminal.

[1706] Input: Recommendation information generated by the AI.

[1707] Output: Recommendation information sent to the terminal

[1708] Step 7: Displaying Information

[1709] The device receives recommendation information sent from the server and displays it to the user. User interfaces are typically built using React Native or Flutter.

[1710] Input: Recommendation information sent from the server

[1711] Output: Recommended information displayed to the user

[1712] Step 8: Notification of program viewing

[1713] When a user starts watching specific digital content (e.g., an idol's live show), the device sends that information to the server.

[1714] Input: Information about the content the user started watching.

[1715] Output: Request data including viewing information

[1716] Step 9: Matching Viewers

[1717] The server receives viewing information, searches its database for other users who are watching the same content, and uses a matching algorithm to find matches.

[1718] Input: Viewing information

[1719] Output: Matched user list

[1720] Step 10: Create a chat room

[1721] The server creates a real-time chat room for the matched users and sends the chat room information to the terminal.

[1722] Input: Matched user list

[1723] Output: Generated chat room information

[1724] Step 11: Providing real-time chat

[1725] The device displays a real-time chat interface based on chat room information, allowing users to communicate with other fans in real time.

[1726] Input: Chat room information

[1727] Output: Displayed real-time chat interface

[1728] This allows users to efficiently gather relevant information and interact with other users in real time.

[1729] (Application Example 1)

[1730] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1731] In recent years, many people have developed a passion for entertainment and a growing tendency to support specific entertainers and content. However, users must gather information from a wide variety of sources, a process that is time-consuming and laborious. Furthermore, opportunities for real-time interaction with other users who share the same entertainment interests are limited. In addition, recommendation systems for users to discover new interests are not functioning adequately. Therefore, there is a need for a system that efficiently collects and centrally manages entertainment-related information and allows real-time interaction with other users who share similar tastes.

[1732] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1733] In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for centrally managing information related to entertainment, means for providing real-time communication with other users with similar interests, means for matching the user with other viewers and providing real-time communication when the user starts watching a predetermined media content, and means for the generative artificial intelligence to analyze the user's input information and recommend new relevant information. This enables efficient collection and centralized management of information related to entertainment, saving the user the trouble of visiting different information sources. Smooth real-time communication with other users with similar interests becomes possible, making it easier for the user to find friends with common interests. Furthermore, the recommendation of new entertainers and content based on the user's preferences increases opportunities to discover new interests.

[1734] "User input information" refers to data that users provide through the application, indicating their personal preferences and interests.

[1735] "Generative artificial intelligence" refers to algorithms and systems that analyze user input information and generate new related information based on that analysis.

[1736] "Generated information" refers to information generated by generative artificial intelligence based on the user's interests and preferences.

[1737] "Information related to entertainment" refers to various types of data, such as blogs, social media posts, and television appearance information related to specific forms of entertainment.

[1738] "Centralized management" refers to integrating, organizing, and managing information collected from multiple sources using a database or similar system.

[1739] "Real-time communication" refers to a form of communication in which messages and information are exchanged with other users in real time.

[1740] "Specified media content" refers to specific videos, programs, live events, or other content that the user watches or is interested in.

[1741] "Matching" is the process of finding other users with similar interests and providing them with opportunities to interact with each other.

[1742] A "chat room" is an online space where multiple users can communicate in real time.

[1743] "Favorite entertainment" refers to the entertainment that a user particularly supports and is interested in.

[1744] "New relevant information" refers to new and interesting information or content generated based on existing data and interests for the user.

[1745] "Recommendation" refers to the act of generative artificial intelligence analyzing a user's preferences and then presenting new entertainers and content based on those preferences.

[1746] The present invention includes a system for efficiently collecting and centrally managing entertainment information, a system for providing real-time communication with other users who have similar tastes based on that information, and a system for recommending new relevant information based on user preferences using generative artificial intelligence.

[1747] server

[1748] The server collects entertainment-related information from multiple sources, stores it in a database, and manages it centrally. For example, it automatically retrieves information from official entertainment blogs, social media accounts, and television appearances via APIs. The server uses generative artificial intelligence to analyze user input and generate information to recommend new entertainment and content.

[1749] As a concrete example, a server collects and organizes information about "Entertainment A," and stores blogs, social media posts, and TV appearance information related to "Entertainment A" in a database. Based on this information, the server generates other entertainment information that the user might be interested in.

[1750] terminal

[1751] The user's device centrally manages and provides information obtained from the server. When a user starts watching a specific type of entertainment, the device sends that information to the server. The server matches the user with other users watching the same entertainment, creates a chat room, and provides real-time communication.

[1752] As a concrete example, when a user starts watching a live event for "Entertainment B," their device sends that information to the server. The server searches for other viewers, and the device creates a shared chat room. The user can then interact with other fans in real time within the chat room.

[1753] User

[1754] Users access the system via their devices and register their favorite entertainment and content. This information is analyzed by the server, and generative artificial intelligence recommends new entertainment and content.

[1755] For example, when a user registers "Entertainment C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar "Entertainment E" and "Song F." This allows users to discover new interests and broaden their horizons.

[1756] Overall system flow

[1757] This entire system, through the close collaboration of servers, terminals, and users, enables efficient collection and centralized management of entertainment information, real-time communication, and recommendations using generative AI. Through this system, users can efficiently gather various entertainment information, interact with like-minded individuals, and enjoy new discoveries.

[1758] Example of a prompt

[1759] Please collect and centrally manage the latest information on "Entertainment A." Additionally, please activate a real-time chat function and provide a matching feature for fans watching simultaneously. Furthermore, please use generative artificial intelligence to recommend other entertainment and content based on my favorite entertainment and content preferences.

[1760] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1761] Step 1:

[1762] The server receives the input information.

[1763] Users input their favorite entertainment and content through their devices, and the server receives this information. The received information is then stored in a database.

[1764] Input: Data on favorite entertainment and content entered by the user via their device.

[1765] Output: Input information stored in the database.

[1766] Step 2:

[1767] The server collects and centrally manages information.

[1768] The server collects entertainment-related data from multiple sources. It uses APIs to retrieve official blogs, social media accounts, and television appearance information, and stores it in a database.

[1769] Input: Various entertainment-related data obtained via API.

[1770] Output: Information organized and stored in the database.

[1771] Specific operation: The server periodically sends requests to each information source to obtain the latest information, compare it with existing data, and update it.

[1772] Step 3:

[1773] The server analyzes the user's input information.

[1774] Generative artificial intelligence is used to analyze user input information and understand user preferences and tastes. The generative AI model analyzes the input data and extracts specific trends and patterns.

[1775] Input: User input information, entertainment-related information stored in the database.

[1776] Output: Analysis results (user preference patterns).

[1777] Specific operation: The generative AI model learns from the user's input information and outputs it as data that visualizes relevant characteristics and trends.

[1778] Step 4:

[1779] The server generates new related information.

[1780] Based on the previously obtained analysis results, generative artificial intelligence generates new relevant information and recommends it to the user.

[1781] Input: Analysis results (user preference patterns).

[1782] Output: Newly generated related information (recommended content).

[1783] Specific operation: The generative AI model combines information from the database to generate entertainment and content that is highly relevant to the user.

[1784] Step 5:

[1785] The device notifies the user of the generated information.

[1786] Newly generated relevant information and recommended content are provided to the user through the device.

[1787] Input: Newly generated related information (recommended content).

[1788] Output: Information notified to the user.

[1789] Specific operation: The device displays the generated relevant information to the user via push notifications or in-app messages.

[1790] Step 6:

[1791] Users view content.

[1792] When a user watches their favorite entertainment or recommended content, that information is sent to the server via their device.

[1793] Input: Information about the content the user started watching.

[1794] Output: Viewing information sent to the server.

[1795] Specific operation: The device automatically sends information to the server when the user starts watching.

[1796] Step 7:

[1797] The server performs real-time matching.

[1798] The server matches other viewers based on viewing information and creates a real-time chat room.

[1799] Input: Information about the content being viewed.

[1800] Output: The generated real-time chat room.

[1801] Specific operation: The server searches the database to find other viewers and sets up a common chat room.

[1802] Step 8:

[1803] The terminal provides real-time communication.

[1804] The device provides real-time communication to users through the generated real-time chat room. Users can enjoy entertainment while exchanging messages with each other.

[1805] Input: Generated real-time chat room, messages from other users.

[1806] Output: Real-time message exchange.

[1807] Specific operation: The device sends and receives messages in real time and displays them on the user interface.

[1808] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1809] This invention combines an emotion engine with a dedicated application system designed to allow users who support idols to efficiently collect and manage information and find friends with similar interests. This enables more accurate information provision and communication tailored to the user's emotional state.

[1810] Program processing

[1811] Centralized information management

[1812] The server collects idol-related information from multiple sources based on user input. This information collection includes official idol blogs and social media accounts, as well as television appearance information. The collected information is stored and organized in a database.

[1813] The terminal centrally manages and displays information retrieved from the database to the user. This eliminates the need for users to visit different websites.

[1814] For example, if a user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the user's device.

[1815] Real-time chat

[1816] When a user starts watching a program featuring a specific idol, their device sends that information to the server.

[1817] The server matches users watching the same program and creates chat rooms in real time. This allows users with similar interests to communicate with each other in real time.

[1818] As a concrete example, when a user starts watching a live show by "Idol B," the server searches for and matches them with other viewers, providing a common chat room. In that chat room, the user can discuss the show with other fans in real time.

[1819] Recommendations for your favorite idols and songs

[1820] Users register their favorite idols and songs in the application. This information is sent to the server via the device.

[1821] The server uses generative artificial intelligence to analyze registration information and learn user preferences. This makes it possible to recommend other different idol groups and songs.

[1822] The terminal notifies the user of recommendation results sent from the server, providing them with opportunities to discover new idols and songs.

[1823] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the information and recommends similar idols, "Idol E," and songs, "Song F." This allows users to discover new interests and broaden their hobbies.

[1824] Combination of emotional engines

[1825] This system will also gain the ability to recognize the user's emotional state by incorporating an emotion engine.

[1826] The terminal uses an emotion engine to recognize the user's emotional state, along with the user's input information. This information is also sent to the server.

[1827] The server improves the accuracy of related information generated by generative artificial intelligence based on the recognized emotional state. This enables the provision of personalized information tailored to the user's emotions.

[1828] For example, when a user is searching for information about "Idol G," if the emotion engine recognizes that the user is in an "excited" state, the generative artificial intelligence will prioritize providing relevant information that is suitable for an excited user.

[1829] Furthermore, by using an emotion engine, it is possible to analyze the user's emotions in real-time chat and facilitate appropriate communication based on those emotions.

[1830] Thus, by combining an emotion engine, the present invention makes it possible to provide a more personalized experience for users and to make idol fan activities more enjoyable and efficient.

[1831] The following describes the processing flow.

[1832] Centralized information management

[1833] Step 1:

[1834] The user launches the application and opens the login screen.

[1835] Step 2:

[1836] The user enters their login information (username, password) and presses the login button.

[1837] Step 3:

[1838] The terminal sends the entered login information to the server.

[1839] Step 4:

[1840] The server refers to the database to authenticate the login information it received.

[1841] Step 5:

[1842] The server sends the authentication result back to the terminal. If successful, it also includes user data.

[1843] Step 6:

[1844] The device receives the authentication result and displays the user's dashboard.

[1845] Step 7:

[1846] Select the idols the user is following on the dashboard.

[1847] Step 8:

[1848] The terminal sends an information request for the selected idle to the server.

[1849] Step 9:

[1850] Based on the requests received by the server, information on idols' blogs, photos, and TV appearances is collected via multiple APIs.

[1851] Step 10:

[1852] The server stores the collected information in a database.

[1853] Step 11:

[1854] The terminal retrieves information from the database and displays it on a centralized management screen.

[1855] Real-time chat

[1856] Step 1:

[1857] The user starts watching a program featuring a specific idol from within the app.

[1858] Step 2:

[1859] The device sends information about the program it is currently watching (such as the program ID and viewing time) to the server.

[1860] Step 3:

[1861] The server searches the database for other users who are watching the same program.

[1862] Step 4:

[1863] The server creates a list of matched users.

[1864] Step 5:

[1865] The server creates a chat room among the matched users.

[1866] Step 6:

[1867] The server sends chat room information (room ID, participant list, etc.) to the device.

[1868] Step 7:

[1869] The device displays the chat room UI to the user, enabling them to input and send messages.

[1870] Step 8:

[1871] The user types a message in the chat room and presses the send button.

[1872] Step 9:

[1873] The terminal sends the entered message to the server.

[1874] Step 10:

[1875] The server broadcasts the received message to all other participants' devices.

[1876] Step 11:

[1877] The device displays new messages in the chat screen in real time.

[1878] Recommendations for your favorite idols and songs

[1879] Step 1:

[1880] Users enter information about their favorite idol or song into the application and press the registration button.

[1881] Step 2:

[1882] The device sends registration information (idol name, song title, etc.) to the server.

[1883] Step 3:

[1884] The server saves the information it receives to the database.

[1885] Step 4:

[1886] The server uses generative artificial intelligence to analyze the user's registration information.

[1887] Step 5:

[1888] Based on the analysis results, the server generates other idols and songs that match the user's preferences.

[1889] Step 6:

[1890] The server sends the generated results to the terminal.

[1891] Step 7:

[1892] The device displays information about recommended idols and songs to the user.

[1893] Step 8:

[1894] Users can review recommended information and check out new idols and songs.

[1895] Combination of emotional engines

[1896] Step 1:

[1897] The user logs in to the application and presses the "Start Using" button.

[1898] Step 2:

[1899] The device activates sensor devices such as cameras and microphones to recognize the user's emotions in real time.

[1900] Step 3:

[1901] The device uses an emotion engine to analyze the user's emotional state from their facial expressions and voice.

[1902] Step 4:

[1903] The device sends user input information, including the emotional state it has analyzed, to the server.

[1904] Step 5:

[1905] The server saves the received emotional state and input information to a database.

[1906] Step 6:

[1907] The server uses generative artificial intelligence to generate highly accurate relevant information that reflects emotional states.

[1908] Step 7:

[1909] The server sends the relevant information it generates to the terminal.

[1910] Step 8:

[1911] The device displays personalized information tailored to the user's emotional state.

[1912] For example, when a user is searching for information on "Idol H," if the emotion engine recognizes the user's "excited" state, the server will prioritize providing information that is highly relevant to eliciting excitement. Conversely, if the user is in a "relaxed" state, it will provide content containing calmer topics.

[1913] Thus, by combining an emotion engine, the present invention provides a highly accurate information provision and communication platform that responds to the user's real-time emotions.

[1914] (Example 2)

[1915] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1916] Users who support idols need to efficiently collect and manage information from many sources, and it is difficult for them to find friends who share the same hobby. Furthermore, there is a lack of personalized information that is tailored to the user's emotional state.

[1917] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1918] In this invention, the server includes means for receiving user input information and collecting relevant information from multiple information sources based on said input information; means for storing and organizing the collected information in a database; means for recognizing the user's emotional state using an emotion engine; means for generating relevant information based on the user's preferences and emotional state using generative artificial intelligence; means for providing the generated information to the user; means for centrally managing information relating to a predetermined object; and means for providing real-time communication with other users who have similar hobbies. As a result, users can efficiently collect and manage information and receive personalized information according to their emotional state. It also makes it easier for them to find friends who share the same hobbies.

[1919] "Means for receiving user input information and collecting relevant information from multiple sources based on said input information" refers to means for obtaining relevant data from multiple internet sources such as official blogs, social media, and television appearance information based on the idol name and keywords entered by the user into the application.

[1920] "Means of storing and organizing collected information in a database" refers to methods of managing collected idol-related information by storing it in a database and organizing it by date and type of information (blogs, social media, television appearances, etc.).

[1921] "Means of recognizing a user's emotional state using an emotion engine" refers to a method of using an emotion analysis engine to analyze text and voice information entered by the user and recognize their emotional state (e.g., excitement, joy, sadness, etc.).

[1922] "Means for generating relevant information based on user preferences and emotional states using generative artificial intelligence" refers to means for generating optimal relevant information using a generative AI model (e.g., GPT-4) while considering the user's preferences and emotional states.

[1923] "Means for providing the generated information to the user" refers to means for notifying the user's terminal of the generated related information and displaying it in an appropriate format.

[1924] "Means for centrally managing information related to a specified subject" refers to a means of consolidating various pieces of information about a particular idol into a single database and managing them uniformly.

[1925] "Means of providing real-time communication with other users who share similar interests" refers to providing a function that allows users who support the same idol to communicate with each other in real time.

[1926] This invention combines an emotion engine with a dedicated application system designed to allow users who support idols to efficiently collect and manage information and find friends with similar interests. The main hardware of the system consists of a server and user terminals, while the main software includes web scraping tools, database management systems (e.g., MySQL, PostgreSQL), generative artificial intelligence (e.g., GPT-4), and an emotion engine (e.g., Emotion AI).

[1927] Centralized information management

[1928] The server retrieves the idol's name and related keywords entered by the user, and uses web scraping techniques and APIs to collect relevant information from multiple sources such as official blogs, social media, and television appearances. The collected information is stored in a database management system and organized by date and type of information.

[1929] The terminal retrieves comprehensively organized information from the database and displays it to the user. For example, if the user selects "Idol A," the server collects information about "Idol A's" blog, social media, and TV appearances, and displays it centrally on the terminal in a tile-like format.

[1930] Recommendations for your favorite idols and songs

[1931] When a user registers their favorite idol or song in the application, the device sends this information to the server. The server uses generative artificial intelligence to analyze the registered information and learn the user's preferences, then lists other similar idol groups and songs.

[1932] For example, when a user registers "Idol C" and its song "Song D," the server's generative artificial intelligence analyzes the data and recommends similar idols, "Idol E," and songs, "Song F." The device then notifies the user, providing them with opportunities to discover new idols and songs.

[1933] Real-time chat

[1934] When a user starts watching a program featuring a specific idol, their device sends that viewing information to a server. The server then detects other users watching the same program in real time and matches them based on their viewing information.

[1935] For example, when a user starts watching a live show by "Idol B," the server matches them with other viewers and creates a real-time chat room. Users can then talk to other viewers in real time through their device.

[1936] Combination of emotional engines

[1937] The device acquires text and voice information entered by the user and uses an emotion engine to recognize the user's emotional state. This recognized emotional information is sent to the server. Based on the emotional state, the server uses generative artificial intelligence to improve the accuracy of related information.

[1938] For example, when a user is searching for information about "Idol G," if the emotion engine recognizes the user's emotion as "excitement," the generative artificial intelligence will prioritize generating relevant information appropriate to the user's state of excitement and display it on the device.

[1939] By combining these functions, this system provides users with a personalized experience, making idol fan activities more enjoyable and efficient.

[1940] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1941] Program processing steps

[1942] Centralized information management

[1943] Step 1:

[1944] The user logs into the application and enters the name of their favorite idol and related keywords.

[1945] Input: The user enters the name of the idol or keywords.

[1946] Output: Search queries containing idol names or keywords

[1947] Step 2:

[1948] Based on the received idol name and keywords, the server starts the process of collecting relevant information from multiple sources (e.g., official blog, social media, appearance information) using web scraping techniques and APIs.

[1949] Input: Search query

[1950] Output: Data collected from each information source.

[1951] Step 3:

[1952] The server stores the collected data in a database management system, organizing it by date and type of information.

[1953] Input: Collected data

[1954] Output: Organized database entries

[1955] Step 4:

[1956] The terminal requests and receives organized information from the database.

[1957] Input: Data request to the server

[1958] Output: Integrated information data

[1959] Step 5:

[1960] The terminal displays received information centrally through a user-friendly interface.

[1961] Input: Integrated Information Data

[1962] Output: List display on the user interface

[1963] Recommendations for your favorite idols and songs

[1964] Step 1:

[1965] Users register their favorite idols and songs in the application.

[1966] Input: Registration information for your favorite idol or song

[1967] Output: Data packet containing registration information

[1968] Step 2:

[1969] The device sends this registration information to the server.

[1970] Input: Data packet

[1971] Output: Upload to server

[1972] Step 3:

[1973] The server uses generative artificial intelligence to analyze registration information and learn user preferences.

[1974] Input: Registration Information

[1975] Output: Analysis results and list of recommended candidates

[1976] Step 4:

[1977] The server generates recommendation candidates based on the analysis results and sends them to the terminal.

[1978] Input: Analysis results and list of recommended candidates

[1979] Output: Recommendation List

[1980] Step 5:

[1981] The device notifies the user of the recommendation results, providing them with opportunities to discover new idols and songs.

[1982] Input: Recommendation list

[1983] Output: User notification

[1984] Real-time chat

[1985] Step 1:

[1986] The user starts watching a program featuring a specific idol.

[1987] Input: Program viewing operation

[1988] Output: Viewing start information

[1989] Step 2:

[1990] The device sends viewing information to the server.

[1991] Input: Viewing start information

[1992] Output: Upload to server

[1993] Step 3:

[1994] The server detects other users watching the same program in real time and matches them based on their viewing information.

[1995] Input: Viewing information

[1996] Output: Matching list

[1997] Step 4:

[1998] The server generates a real-time chat room for the matched users.

[1999] Input: Matching list

[2000] Output: Chat room link

[2001] Step 5:

[2002] The device provides the user with a link to the chat room and encourages them to access it.

[2003] Input: Chat room link

[2004] Output: Chat room notification

[2005] Combination of emotional engines

[2006] Step 1:

[2007] The device acquires text and voice information entered by the user.

[2008] Input: User's text or voice information

[2009] Output: Sentiment analysis data

[2010] Step 2:

[2011] The device uses an emotion engine to recognize the user's emotional state.

[2012] Input: Sentiment analysis data

[2013] Output: Emotional state data

[2014] Step 3:

[2015] The device sends the recognized emotional state to the server.

[2016] Input: Emotional state data

[2017] Output: Upload to server

[2018] Step 4:

[2019] The server uses generative artificial intelligence to improve the accuracy of relevant information based on emotional states.

[2020] Input: Emotional state data

[2021] Output: Personalized information

[2022] Step 5:

[2023] The device displays personalized information to the user.

[2024] Input: Personalized information

[2025] Output: Display on the user interface

[2026] (Application Example 2)

[2027] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2028] This invention relates to a system for users who support idols to efficiently collect and manage necessary information and communicate in real time with other users who share the same hobby. However, conventional systems do not take into account the user's emotional state, so the information provided and the communication experience are not sufficiently personalized, which may lead to low user satisfaction. Furthermore, it is difficult to match and communicate in real time with other like-minded people in physical stores.

[2029] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving user input information, means for generating relevant information based on the user's preferences using generative artificial intelligence, means for providing the generated information to the user, means for centrally managing information relating to a predetermined group, means for providing real-time communication with other users who have similar hobbies, means for recognizing the user's emotional state using an emotion engine and providing information based on the recognized emotional state, and means for matching the user with like-minded people in the vicinity in a predetermined social setting and providing real-time communication. This enables information provision that takes the user's emotional state into consideration and real-time matching in physical stores.

[2030] "Means for receiving user input information" refers to a mechanism for receiving various data (text, audio, images, etc.) that a user inputs into the system and sending it to the server.

[2031] "Means for generating relevant information based on user preferences using generative artificial intelligence" refers to a mechanism that utilizes generative artificial intelligence technology to learn user preferences from user input information and past data, and automatically generates relevant information based on those preferences.

[2032] "Means for providing the generated information to the user" refers to a mechanism for displaying information generated by generative artificial intelligence on the user's device and making it accessible to the user.

[2033] "A means of centrally managing information related to a designated organization" refers to a mechanism for collecting and integrating various types of information (official blogs, social media posts, performance information, etc.) related to a specific organization or group and managing them in a single database.

[2034] "Means of providing real-time communication with other users who share similar hobbies" refers to a mechanism for sending messages and voice chatting in real time with other users who share the same hobbies on the system.

[2035] "A means of recognizing a user's emotional state using an emotion engine and providing information based on that recognized emotional state" refers to a mechanism that uses emotion recognition technology to infer a user's emotional state from their statements and actions, and then provides the user with appropriate information based on the inference results.

[2036] "A means of matching users with like-minded people in their vicinity in a given social setting and providing real-time communication" refers to a mechanism for matching and communicating in real time with other people who share the same interests in a specific physical location or social environment (e.g., a physical store, an event venue).

[2037] This invention relates to a system for users who support idols to efficiently collect and manage information and communicate in real time with other users who share the same hobby. The following describes specific embodiments of this invention.

[2038] The system related to this invention mainly consists of a server, a terminal, and a user. The server includes software such as an emotion engine, generative artificial intelligence, and a real-time chat module. This system runs on a terminal such as a smartphone and provides the following functions to the user.

[2039] 1. Centralized information management:

[2040] The server receives user input and uses generative artificial intelligence to generate information based on the user's preferences. For example, if a user wants to gather the latest information on "Idol A," this information is automatically collected and organized from official blogs, social media, TV appearances, etc., and displayed centrally on the device.

[2041] 2. Utilizing the Emotional Engine:

[2042] The device uses an emotion engine to analyze user input and recognize the user's current emotional state. Based on this recognized emotional state, the server provides relevant information using generative artificial intelligence. For example, if the user is in an "excited" state, it will prioritize providing information suitable for an excited user, such as the latest live event information or newly released merchandise.

[2043] 3. Provision of real-time chat:

[2044] When a user begins watching a particular media content, the server matches them with other viewers and creates a real-time chat room. This allows users to discuss the show in real time with other fans who share the same interests.

[2045] 4. Recommend your favorite idol or song:

[2046] When a user registers their favorite idol or song, the server's generative artificial intelligence analyzes that information and recommends other idols or songs that match the user's preferences. This allows users to discover new interests and broaden their range of hobbies.

[2047] 5. Matching with nearby users at physical stores:

[2048] This feature allows users to connect with like-minded individuals in designated social settings, such as physical locations (e.g., cafes or event venues), and communicate with them in real time. This functionality enables users to connect with people who share their interests even in physical spaces.

[2049] As a concrete example, if a user opens the "Idol Support Center" app on their smartphone while watching a live video of "Idol A" at a physical cafe, the latest information will be displayed in a list. Furthermore, if the user is in an excited state, the emotion engine recognizes this and prioritizes providing the latest live performance information and newly released merchandise. Simultaneously, the user can use the real-time chat function to discuss the live performance with other fans nearby.

[2050] Examples of input prompts for a generative AI model:

[2051] "Please provide a sample Python program that recommends content tailored to the user's interests, such as live videos or newly released items, when the user is in an excited emotional state."

[2052] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[2053] Step 1:

[2054] The device receives user input information, including text, audio, and images. This input information is then sent to the emotion engine to analyze the user's current emotional state. To achieve this, the device uses the emotion engine's API to send the input information as an analysis request.

[2055] Step 2:

[2056] The server activates generative artificial intelligence based on the emotion analysis results received from the emotion engine, generating relevant information based on the user's preferences. The input includes data such as the user's emotional state and past activity history. The generative AI analyzes this data to generate the most relevant information for the user (e.g., the latest live event information, related articles, recommended idols).

[2057] Step 3:

[2058] The server saves the generated related information to a database and notifies the terminal. The terminal receives this notification and displays the related information to the user. Specifically, it retrieves the related information using an API call and displays it in the user interface.

[2059] Step 4:

[2060] When a user begins watching specific media content (e.g., live video), their device sends that viewing information to a server. The server uses this information to match other users watching the same content and creates a real-time chat room. This enables real-time communication.

[2061] Step 5:

[2062] The server manages information to match users with like-minded people nearby in specific social settings (e.g., physical stores or event venues). When a user is in a physical store, their device sends its location information to the server, which then detects other like-minded people in the same location. Based on this information, a real-time chat room is created, and users can join that chat room to communicate.

[2063] Through the above processing steps, users can efficiently collect idol-related information and receive personalized information based on their emotional state. Furthermore, real-time communication allows them to interact with other fans who share the same interests.

[2064] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[2065] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2066] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[2067] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2068] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[2069] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[2070] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[2071] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[2072] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[2073] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[2074] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[2075] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[2076] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[2077] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2078] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[2079] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[2080] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[2081] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[2082] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[2083] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[2084] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[2085] The following is further disclosed regarding the embodiments described above.

[2086] (Claim 1)

[2087] [Means for receiving user input information,

[2088] [Means for generating relevant information based on user preferences using generative artificial intelligence,

[2089] [Means for providing the generated information to the user,

[2090] [Means for centrally managing information related to a designated organization,

[2091] [Means of providing real-time communication with other users who share similar hobbies,

[2092] A system that includes this.

[2093] (Claim 2)

[2094] [The system according to claim 1, which matches a user with other viewers and provides real-time communication when the user starts watching a predetermined media content.

[2095] (Claim 3)

[2096] [The system according to claim 1, wherein generative artificial intelligence analyzes user input information and recommends new relevant information.

[2097] "Example 1"

[2098] (Claim 1)

[2099] [Means for receiving user input information,

[2100] [Means for generating relevant information based on user preferences using generative artificial intelligence,

[2101] [Means for providing the generated information to the user,

[2102] [Methods for collecting and centrally managing information on a specific field from various sources,

[2103] [Means of providing real-time communication with other users who share similar hobbies,

[2104] A system that includes this.

[2105] (Claim 2)

[2106] [The system according to claim 1, which matches a user with other users who are watching the same digital content when the user starts watching that content and provides real-time communication.

[2107] (Claim 3)

[2108] [The system according to claim 1, wherein generative artificial intelligence analyzes user registration information and recommends new relevant information.

[2109] "Application Example 1"

[2110] (Claim 1)

[2111] [Means for receiving user input information,

[2112] [Means for generating relevant information based on user preferences using generative artificial intelligence,

[2113] [Means for providing the generated information to the user,

[2114] [A means of centrally managing information related to entertainment,

[2115] [Means of providing real-time communication with other users who share similar hobbies,

[2116] [When a user starts watching a designated media content, a means is provided to match them with other viewers and provide real-time communication,

[2117] [A means by which generative artificial intelligence analyzes user input information and recommends new relevant information,

[2118] A system that includes this.

[2119] (Claim 2)

[2120] [The system according to claim 1, which allows users to register their favorite entertainment and content in an application, and analyzes that information to recommend new entertainment and content.

[2121] (Claim 3)

[2122] [The system according to claim 1, which, when a user starts watching a particular form of entertainment, matches them with other users who are watching the same content and generates a real-time chat room.

[2123] "Example 2 of combining an emotion engine"

[2124] (Claim 1)

[2125] [Means for receiving user input information and collecting relevant information from multiple sources based on said input information,

[2126] [Means for storing and organizing collected information in a database,

[2127] [Means for recognizing a user's emotional state using an emotion engine,

[2128] [Means for generating relevant information based on the user's preferences and emotional state using generative artificial intelligence,

[2129] [Means for providing the generated information to the user,

[2130] [Means for centrally managing information related to a specified target,

[2131] [Means of providing real-time communication with other users who share similar hobbies,

[2132] A system that includes this.

[2133] (Claim 2)

[2134] [The system according to claim 1, which matches a user with other viewers and provides real-time communication when the user starts watching a predetermined media content.

[2135] (Claim 3)

[2136] [The system according to claim 1, wherein generative artificial intelligence analyzes the user's input information and emotional state and recommends new relevant information.

[2137] "Application example 2 when combining with an emotional engine"

[2138] (Claim 1)

[2139] [Means for receiving user input information,

[2140] [Means for generating relevant information based on user preferences using generative artificial intelligence,

[2141] [Means for providing the generated information to the user,

[2142] [Means for centrally managing information related to a designated organization,

[2143] [Means of providing real-time communication with other users who share similar hobbies,

[2144] [A means of recognizing the user's emotional state using an emotion engine and providing information based on the recognized emotional state,

[2145] [A means for users to be matched with like-minded people in their vicinity in a given social setting and to provide real-time communication,

[2146] A system that includes this.

[2147] (Claim 2)

[2148] [The system according to claim 1, which matches a user with other viewers and provides real-time communication when the user starts watching a predetermined media content.

[2149] (Claim 3)

[2150] [The system according to claim 1, wherein generative artificial intelligence analyzes user input information and recommends new relevant information. [Explanation of Symbols]

[2151] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for receiving user input information, A means of generating relevant information based on user preferences using generative artificial intelligence, Means for providing the generated information to the user, A means of centrally managing information relating to a designated organization, A means of providing real-time communication with other users who share similar hobbies, A system that includes this.

2. The system according to claim 1, which matches a user with other viewers and provides real-time communication when the user starts watching a predetermined media content.

3. The system according to claim 1, wherein generative artificial intelligence analyzes user input information and recommends new relevant information.

Images