system

Abstract

We provide the system. [Solution] A means for creating individually customized profiles based on the user's interests and preferences, Means for synchronizing information based on the profile among multiple user devices, A means for optimizing ads and blocking unwanted ads based on the aforementioned profile, A means for filtering relevant information based on the aforementioned profile and eliminating unnecessary information, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent years, the importance of individualized and customized user experiences has been increasing. However, in conventional systems, profiles according to users' interests and preferences have not been effectively created and managed. Also, information synchronization between multiple devices is not sufficient and often lacks consistency. Furthermore, advertisements optimized for users' interests are not delivered, and unnecessary advertisements are displayed, resulting in a decrease in user satisfaction. In addition, a large amount of information that users are not interested in is displayed, making it easy to be in a state of information overload. There is a demand for a system that solves these problems.

Means for Solving the Problems

[0005] The present invention is a system that includes means for creating individually customized profiles based on user interests and preferences, means for synchronizing information based on the profiles across multiple user devices, means for optimizing advertisements and blocking unwanted advertisements based on the profiles, and means for filtering relevant information and eliminating unwanted information based on the profiles.

[0006] Specifically, data on users' interests and preferences is stored in a database, and profiles are generated and managed. This enables consistent information delivery even when users use different devices. Furthermore, based on these profiles, only advertisements that meet predetermined criteria can be delivered, and unnecessary advertisements can be blocked. In addition, relevant information can be filtered, and only information that is valuable to the user can be presented.

[0007] A "user profile" is a dataset that is individually customized based on a user's interests, preferences, and behavioral data.

[0008] "Device synchronization" is the process of synchronizing data across multiple user devices to maintain information consistency.

[0009] "Ad optimization" is the process of selecting and delivering highly relevant ads based on user profiles.

[0010] "Ad blocking" is the process of preventing users from seeing advertisements that they deem unnecessary or inappropriate.

[0011] "Information filtering" is the process of selecting only highly relevant information based on a user profile and eliminating unnecessary information.

[0012] A "database" is a system for storing and managing data about users' interests and preferences that has been collected.

[0013] "Customization" refers to adjusting a system or service to suit the individual needs and preferences of the user.

[0014] "Interest data" refers to information about a user's interests and preferences regarding specific topics or categories.

[0015] "Provision" refers to the process of appropriately delivering and displaying information, services, or advertisements to users. [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12]It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Mode for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the language used in the following description will be explained.

[0019] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. Specific embodiments for realizing this system are described in detail below.

[0038] Creating and managing user profiles

[0039] User: Users create a new account and enter basic information such as their interests and preferences. This information includes, for example, their favorite topics (technology, health, business, etc.).

[0040] Terminal: The terminal (e.g., a smartphone or PC) sends the information entered by the user to the server.

[0041] Server: The server stores the received information in a database and creates a profile. If the user later adds or changes their interests or preferences, the server updates this profile.

[0042] Information synchronization between devices

[0043] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[0044] Terminal: Each terminal sends user actions (such as bookmarking an article) to the server.

[0045] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on their tablet or PC.

[0046] Ad optimization and blocking

[0047] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[0048] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0049] Users: Users can enjoy a more personalized experience because they only see ads that interest them. They can also add ads they don't want to see to a block list.

[0050] Selecting and filtering information

[0051] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[0052] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. The selected information is then delivered to the user's device.

[0053] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[0054] Specific example

[0055] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[0056] Device (smartphone): Sends an action to add the article to favorites to the server.

[0057] Server: Updates user profiles and interest data, and synchronizes favorites information with other registered devices (e.g., PCs and tablets).

[0058] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles.

[0059] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[0060] Terminal (PC): Sends an operation to add to the blocklist to the server.

[0061] Server: Update the blocklist and consider it for the next ad delivery.

[0062] Device: Controls the display of blocked ads in the future.

[0063] This allows users to receive a consistent and customized information and advertising experience across multiple devices. This system is expected to improve user satisfaction by providing an experience optimized to user needs.

[0064] The following describes the processing flow.

[0065] Creating and managing user profiles

[0066] Step 1:

[0067] User: The user creates a new account and enters basic information such as their name, email address, and interests.

[0068] Step 2:

[0069] Terminal: The terminal (e.g., a smartphone or PC) sends user input information to the server via an HTTP request.

[0070] Step 3:

[0071] Server: The server analyzes the information received and creates a new user profile in the database.

[0072] Step 4:

[0073] Server: The server sends a notification to the device indicating that profiling is complete.

[0074] Step 5:

[0075] Device: The device displays a notification to the user indicating that the profile has been successfully created.

[0076] Information synchronization between devices

[0077] Step 1:

[0078] User: The user adds a new device (e.g., a tablet) and links it to an existing account.

[0079] Step 2:

[0080] Terminal (New Device): The new device sends link information to the server and makes a synchronization request.

[0081] Step 3:

[0082] Server: The server retrieves the user's profile information and prepares the necessary information for the new device.

[0083] Step 4:

[0084] Server: The server sends the information it has prepared to the new device.

[0085] Step 5:

[0086] Device (New Device): The new device applies the information it receives and synchronizes the user's profile.

[0087] Ad optimization and blocking

[0088] Step 1:

[0089] Server: The server selects relevant advertisements based on the user's profile.

[0090] Step 2:

[0091] Server: The server sends a request to the ad server to retrieve a list of the most suitable ads.

[0092] Step 3:

[0093] Ad server: The ad server provides a list of ads that match the user profile.

[0094] Step 4:

[0095] Server: The server sends the received ad list to the user's device.

[0096] Step 5:

[0097] Device: Displays the ad list received by the device to the user.

[0098] Step 6:

[0099] User: The user performs an action to add a specific ad to the block list.

[0100] Step 7:

[0101] Terminal: Sends a request to the server to add the user to the blocklist.

[0102] Step 8:

[0103] Server: The server updates the blocklist and takes it into consideration for the next ad delivery.

[0104] Selecting and filtering information

[0105] Step 1:

[0106] Server: The server collects new articles and blog posts from multiple information sources.

[0107] Step 2:

[0108] Server: Stores collected information in a temporary database.

[0109] Step 3:

[0110] Server: Filters information based on user profiles, selecting only relevant articles.

[0111] Step 4:

[0112] Server: Sends filtered information to the user's terminal.

[0113] Step 5:

[0114] Terminal: Displays filtered information received by the terminal on the viewing screen.

[0115] Step 6:

[0116] User: The user views the displayed information and provides further feedback.

[0117] This ensures users receive a consistent information and advertising experience regardless of the device they use, and they can access personalized services based on their interests.

[0118] (Example 1)

[0119] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0120] Traditional systems offered limited customization based on user interests and preferences, and struggled to synchronize information consistently across multiple devices. Furthermore, they suffered from a poor user experience due to inadequate filtering of inappropriate advertisements and irrelevant information.

[0121] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0122] In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences and storing them in a database; means for synchronizing information based on the profiles among multiple user terminals; means for optimizing advertisements selected based on the profiles and blocking unnecessary advertisements; means for filtering data collected from information sources based on the profiles and eliminating unnecessary information; and means for displaying information customized to the user based on the profiles and interests. This enables consistent information provision and optimized advertisement display that meets the user's needs.

[0123] A "user" refers to an individual who uses a system to receive services customized based on their interests and preferences.

[0124] "Interests and preferences" refers to information that indicates the topics and themes that a user is interested in and particularly interested in.

[0125] A "profile" is a collection of individually customized user information generated based on the user's interests and preferences.

[0126] A "database" is an information management system that stores user profiles and related information, and retrieves, updates, and saves it as needed.

[0127] A "terminal" is a device used by a user to access a system, and includes smartphones, tablets, PCs, and other similar devices.

[0128] "Synchronization" refers to the process of ensuring that information is consistent across multiple user devices, and that user actions and data are reflected consistently.

[0129] "Advertising" refers to commercial promotional messages displayed to users.

[0130] "Optimization" refers to selecting and adjusting ads based on the user's profile to display them most effectively.

[0131] "Filtering" is the process of sorting collected information based on the user's profile and removing irrelevant or unnecessary information.

[0132] "Customized information" refers to information that is tailored to the user's interests and preferences and is therefore valuable to the user.

[0133] "Unnecessary advertising" refers to advertisements that do not match the user's interests and preferences and therefore have no value to the user.

[0134] "Information sources" refer to external websites and databases that provide informational content such as articles and blog posts.

[0135] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. The following describes in detail embodiments for specifically implementing the present invention.

[0136] Creating and managing user profiles

[0137] User: Users create a new account and enter basic information such as their interests and preferences. This information includes, for example, their favorite topics (technology, health, business, etc.).

[0138] Terminal: The terminal (e.g., a smartphone or PC) sends information entered by the user to the server. This transmission is performed using the HTTP POST method.

[0139] Server: The server stores the received information in a database and creates a profile. A database management system such as MySQL® is used. If the user later adds or changes their interests or preferences, the server updates this profile.

[0140] Information synchronization between devices

[0141] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[0142] Terminal: Each terminal sends user actions (such as bookmarking an article) to the server.

[0143] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on their tablet or PC.

[0144] Ad optimization and blocking

[0145] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[0146] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0147] Users: Users can enjoy a more personalized experience because they only see ads that interest them. They can also add ads they don't want to see to a block list.

[0148] Selecting and filtering information

[0149] Server: The server collects articles and blog posts from multiple sources. The collected information is temporarily stored in a database.

[0150] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. Natural language processing (NLP) techniques can be used for this filtering.

[0151] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[0152] Specific example

[0153] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[0154] Device (smartphone): Sends an action to add the article to favorites to the server (e.g., HTTP POST request).

[0155] Server: Receives operation details and updates user profiles and databases. Then, sends synchronization requests to other devices.

[0156] Device (PC or tablet): Receives synchronization requests from the server and updates the displayed content.

[0157] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[0158] Device (PC): Clicking the "Block" icon in the corner of the ad sends that action to the server.

[0159] Server: Update the block list and apply it to future ad delivery.

[0160] Device: Blocked ads will not be displayed the next time you view an ad.

[0161] Example of a prompt

[0162] "Please gather the latest health-related information and provide me with articles filtered to match my profile."

[0163] "The ads I recently blocked have been updated, so I would like them to be reflected in the next ad delivery."

[0164] "Please sync business-related articles you've added to your favorites to other devices."

[0165] In this way, by performing clear processing at each step, a mechanism is built that ensures the entire system functions consistently. This allows for a more personalized experience for the user.

[0166] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0167] Step 1:

[0168] User: Create a new account and enter basic information.

[0169] The user enters the required information (name, email address, interests, and preferred topics) on the application registration screen.

[0170] Input: Basic information about the user's interests and preferences

[0171] Output: User information is temporarily stored on the device.

[0172] Step 2:

[0173] Terminal: Sending user information

[0174] The device (smartphone or PC) sends the entered user information to the server. This transmission uses the HTTP POST method.

[0175] Input: User information stored on the device

[0176] Output: User information is sent to the server.

[0177] Step 3:

[0178] Server: Stores user information and creates profiles.

[0179] The server saves the received user information to the database and creates a new profile. The database management system used is MySQL.

[0180] Input: User information sent to the server

[0181] Output: User profiles stored in the database

[0182] Step 4:

[0183] User: Profile Update

[0184] Users can add or change their interests and preferences in the settings screen as needed.

[0185] Input: New or updated user interest and preference information

[0186] Output: New or updated information temporarily stored on the device.

[0187] Step 5:

[0188] Device: Profile update notification

[0189] The terminal notifies the server of user profile changes. This notification also uses the HTTP POST method.

[0190] Input: New or updated information temporarily stored on the device

[0191] Output: Update information sent to the server

[0192] Step 6:

[0193] Server: Profile Update

[0194] The server updates the user profiles in the database based on the received update information.

[0195] Input: Update information sent to the server

[0196] Output: The updated user profile is saved to the database.

[0197] Step 7:

[0198] User: I want to synchronize information between devices.

[0199] Users use multiple devices such as smartphones, tablets, and PCs, and they want to access the same information on each of them.

[0200] Input: Request for synchronization via user action

[0201] Output: The operation details are temporarily saved on the terminal.

[0202] Step 8:

[0203] Terminal: Sending operation information

[0204] Each device sends user actions (for example, adding an item to favorites) to the server.

[0205] Input: User actions saved on the device

[0206] Output: Operation information sent to the server

[0207] Step 9:

[0208] Server: Stores operation information and sends synchronization requests to other devices.

[0209] The server saves the received operation information to the database and sends synchronization requests to other registered devices.

[0210] Input: Operation information sent to the server

[0211] Output: Operation information stored in the database and synchronization requests sent to other devices.

[0212] Step 10:

[0213] Terminal: Receiving sync requests and updating data.

[0214] Each terminal receives a synchronization request from the server and updates its data.

[0215] Input: Synchronization request received from the server

[0216] Output: Updated terminal data

[0217] Step 11:

[0218] Server: Ad optimization

[0219] The server sends a request to the ad server based on the user's profile to retrieve the most suitable ad list.

[0220] Input: User profile information

[0221] Output: Ad list

[0222] Step 12:

[0223] Server: Sending ad lists

[0224] The server sends the ad list to each user's device.

[0225] Input: Retrieved ad list

[0226] Output: Ad list sent to the device

[0227] Step 13:

[0228] Device: Ad display and blocking

[0229] The device displays an ad list received from the server to the user and blocks unwanted ads. Users may request that ads be blocked.

[0230] Input: Ad list received from the server and user block requests

[0231] Output: Ads displayed and block requests sent to the server

[0232] Step 14:

[0233] Server: Updating the blocklist

[0234] The server receives a block request from a user and updates the block list.

[0235] Input: Block request

[0236] Output: Updated blocklist

[0237] Step 15:

[0238] Server: Information collection

[0239] The server collects articles and blog posts from multiple sources and temporarily stores them in a database.

[0240] Input: Articles and blog posts collected from various sources.

[0241] Output: Information temporarily stored in the database

[0242] Step 16:

[0243] Server: Information filtering

[0244] The server filters the collected information based on user profiles to select the most relevant information. Natural language processing techniques are used for filtering.

[0245] Input: Unfiltered information and user profiles stored in the database

[0246] Output: Filtered information

[0247] Step 17:

[0248] Server: Distribution of filtering information

[0249] The server delivers filtered information to the user's terminal.

[0250] Input: Filtered information

[0251] Output: Filtering information sent to the terminal

[0252] Step 18:

[0253] Device: Display filtering information

[0254] The device displays the received filtering information, making it easy for the user to access.

[0255] Input: Filtering information received from the server

[0256] Output: Filtering information displayed

[0257] (Application Example 1)

[0258] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0259] Traditional advertising and information delivery systems have been insufficient in personalizing users' diverse interests and preferences, making it difficult to provide a consistent user experience across multiple devices. Furthermore, users are often bothered by irrelevant advertisements and unrelated information, leading to decreased user satisfaction. In addition, there has been a lack of integrated solutions for providing customized content utilizing generative AI models.

[0260] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0261] In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences; means for synchronizing information based on the profiles across multiple user devices; means for optimizing advertisements and blocking unwanted advertisements based on the profiles; means for generating prompt statements based on a generative AI model and providing customized content based on the user's activity; and means for enabling the user to synchronize favorite articles across multiple devices and block unwanted advertisements. This makes it possible to provide a consistent and customized information and advertising experience that is tailored to the user's interests and preferences.

[0262] "User interests and preferences" refer to the topics and matters of interest that users are particularly interested in and show interest in.

[0263] A "customized profile" refers to user information and settings that are individually configured based on the user's interests and preferences.

[0264] "Synchronizing information across multiple devices" means sharing the same information across multiple electronic devices owned by a user (such as smartphones, tablets, and personal computers) and keeping them constantly up-to-date.

[0265] "Methods for optimizing ads and blocking unwanted ads" refers to methods and technologies that select the most relevant ads based on a user's profile and remove unwanted or inappropriate ads from those displayed to the user.

[0266] "Filtering relevant information and eliminating unnecessary information" refers to a technology that selects information collected based on the user's profile and provides only the information that is highly valuable to the user.

[0267] A "generative AI model" is a model that uses artificial intelligence to analyze user data and behavioral patterns, and then generates new prompts and content based on the results.

[0268] A "prompt message" is a guiding or instructional message generated by a generative AI model that contains information highly relevant to the user.

[0269] "User activity" refers to all actions and behaviors that a user performs through their device, including records of actions such as search history, browsing history, and applications used.

[0270] "Syncing favorite articles" means sharing articles that users have saved as of particular interest across multiple devices, keeping them always up-to-date.

[0271] "Means of providing customized content" refers to methods and technologies for selecting and delivering the most relevant information and advertisements to users based on their interests and preferences.

[0272] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple devices, optimizes and blocks advertisements, and filters relevant information. Specific embodiments for realizing this system are described in detail below.

[0273] System Configuration

[0274] hardware

[0275] Smartphone (iOS or Android®)

[0276] tablet

[0277] PC

[0278] software

[0279] iOS Application: Swift

[0280] Android Application: Kotlin

[0281] Backend: Node.js, Express.js, MongoDB

[0282] Frontend: React Native

[0283] Creation and Management of User Profiles

[0284] User: The user creates a new account and enters their interests and preferences. This information includes favorite topics (e.g., technology, health, business, etc.).

[0285] Device: The device sends the information entered by the user to the server.

[0286] Server: The server saves the received information in the database and creates the user's profile. If the user later adds or changes their interests and preferences, the server updates this profile.

[0287] Information Synchronization between Devices

[0288] User: The user uses multiple devices (smartphone, tablet, PC, etc.) and wishes to access the same information on each device.

[0289] Device: Each device sends the operations performed by the user (e.g., adding an article to favorites) to the server.

[0290] Server: The server saves the received information in the database and sends it as a synchronization request to other registered devices. This enables the articles favorited by the user on their smartphone to be accessible on their tablet or PC as well.

[0291] Ad optimization and blocking

[0292] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[0293] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0294] Users: They can enjoy a more personalized experience because they only see ads that interest them. Users can also add ads they don't want to see to a block list.

[0295] Information filtering

[0296] Server: The server collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[0297] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. The selected information is then delivered to the user's device.

[0298] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only valuable information.

[0299] Introduction of Generative AI Models

[0300] Server: Uses a generative AI model to generate and provide customized prompt messages to the user based on user activity.

[0301] Specific example:

[0302] When a user searches for health-related articles on their smartphone and adds them to their favorites, that information is sent to the server and synchronized with other devices.

[0303] Example of prompt text:

[0304] "We have confirmed that you are interested in health. Would you like to check out some new relevant articles as well?"

[0305] With this system, users can obtain consistent and customized information and advertising experiences even when using multiple devices. Also, by leveraging the generative AI model, it is possible to provide more personalized prompt texts.

[0306] The flow of specific processing in Application Example 1 will be described using FIG. 12.

[0307] Step 1:

[0308] User: Create a new account and enter interests and preferences. This includes favorite topics (e.g., technology, health, business, etc.).

[0309] Input: The user enters interest and preference information into the form of the smartphone app.

[0310] Output: The input information is temporarily stored in the terminal.

[0311] Step 2:

[0312] Terminal: Transmit the input interest and preference information to the server.

[0313] Input: Information entered into the smartphone app.

[0314] Data processing: Convert the form data into JSON format and generate an API request to the server.

[0315] Output: JSON data sent to the server.

[0316] Step 3:

[0317] Server: Stores received information in the database and creates user profiles.

[0318] Input: JSON data sent from the device.

[0319] Data processing: Analyze incoming data and save it to the appropriate table in the database.

[0320] Output: User profile stored in the database.

[0321] Step 4:

[0322] Terminal: Sends information about actions performed on each terminal (e.g., adding an article to favorites) to the server.

[0323] Input: The action taken by a user to add an article to their favorites.

[0324] Data processing: Generate favorites registration data and create API requests to the server.

[0325] Output: Favorite registration data sent to the server.

[0326] Step 5:

[0327] Server: Stores information received from each terminal in a database and sends it as a synchronization request to other registered devices.

[0328] Input: Favorite registration data sent from the device.

[0329] Data processing: Save new favorite information to the database and send a sync request to other devices.

[0330] Output: Synchronization requests sent to each terminal.

[0331] Step 6:

[0332] Terminals: Each terminal updates its favorite articles based on synchronization requests received from the server.

[0333] Input: Synchronization request from the server.

[0334] Data calculation: Update the local database based on a synchronous request.

[0335] Output: Updated favorite articles information.

[0336] Step 7:

[0337] Server: Optimizes ads based on user profiles and blocks unwanted ads.

[0338] Input: User profile data.

[0339] Data processing: Analyze profile data and generate the optimal ad list.

[0340] Output: A list of ads delivered to users.

[0341] Step 8:

[0342] Device: Displays the ad list received from the server and blocks unnecessary ads.

[0343] Input: Ad list received from the server.

[0344] Data processing: Analyze the ad list and separate the ads to display from those to block.

[0345] Output: Advertisements displayed on the user's screen.

[0346] Step 9:

[0347] Server: Collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[0348] Input: Content data obtained from the information source.

[0349] Data processing: Temporarily save collected articles and blog posts to a database.

[0350] Output: Saved content data.

[0351] Step 10:

[0352] Server: Filters information based on the user's profile, selecting only the most relevant information.

[0353] Input: Collected content data and user profile data.

[0354] Data processing: Use filtering algorithms to select only the most relevant information.

[0355] Output: Filtered information list.

[0356] Step 11:

[0357] Terminal: Displays filtered information received from the server.

[0358] Input: List of information from the server.

[0359] Data processing: Analyze the information list and format it for display on the user screen.

[0360] Output: Filtered content displayed on the user screen.

[0361] Step 12:

[0362] Server: Uses a generative AI model to generate and provide customized prompt messages to the user based on user activity.

[0363] Input: User activity data.

[0364] Data processing: Generate prompt statements using a generative AI model.

[0365] Output: The prompt text provided to the user.

[0366] Specific example:

[0367] When a user searches for health-related articles on their smartphone and adds them to their favorites:

[0368] 1. The user adds the article to their favorites (Step 4), and the data is sent from the device to the server.

[0369] 2. The server receives the information, updates the database, and sends a synchronization request to the other devices (Step 5).

[0370] 3. Other devices receive the sync request and update their favorite articles (Step 6).

[0371] Example of a prompt:

[0372] "We've confirmed your interest in health. Would you like to check out some new, relevant articles?"

[0373] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0374] This invention combines a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information with an emotion engine that recognizes user emotions. Specific embodiments for realizing this system are described in detail below.

[0375] Creating and managing user profiles

[0376] User: Users create a new account and enter basic information about their interests, preferences, and feelings. This includes, for example, their favorite topics (technology, health, business, etc.) and how they feel about them.

[0377] Device: The device (e.g., smartphone or PC) sends the emotion data recognized by the emotion engine, along with the information entered by the user, to the server.

[0378] Server: The server analyzes the received information and creates a new user profile in the database. Sentimental data provided by the sentiment engine is also stored in the profile. If the user later adds or changes interests, preferences, or emotions, the server updates this profile.

[0379] Information synchronization between devices

[0380] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[0381] Terminal: Each terminal sends user sentiment data to the server along with the actions the user performs (e.g., adding an article to their favorites).

[0382] Server: The server stores information and sentiment data in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on tablets and PCs, along with the sentiment data from when they were favorited.

[0383] Ad optimization and blocking

[0384] Server: Optimizes ads based on user profiles and sentiment data. Specifically, it selects ads that match the user's interests and emotions, and queries the ad server to obtain the optimal ad list.

[0385] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0386] Users: Users can enjoy a more personalized experience because they only see ads optimized based on their interests and emotions. They can also add ads they don't want to see to a block list.

[0387] Selecting and filtering information

[0388] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[0389] Server: The server then filters the information based on the user's profile and sentiment data, selecting only the most relevant information. The selected information is then delivered to the user's device.

[0390] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[0391] Specific example

[0392] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[0393] Device (smartphone): The user adds the article to their favorites and sends their emotional data to the server at that time.

[0394] Server: Updates user profiles and sentiment data, and synchronizes favorites and sentiment data with other registered devices (e.g., PCs and tablets).

[0395] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[0396] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[0397] Terminal (PC): Sends the operation of adding to the block list and the corresponding emotion data to the server.

[0398] Server: Update blocklists and sentiment data to consider for future ad delivery.

[0399] Device: Controls the display of blocked ads in the future.

[0400] This allows users to receive consistent, emotionally-driven, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[0401] The following describes the processing flow.

[0402] Creating and managing user profiles

[0403] Step 1:

[0404] User: The user creates a new account and enters initial information such as name, email address, interest categories, and sentiments.

[0405] Step 2:

[0406] Device: The device (e.g., smartphone or PC) sends the information entered by the user and the emotion data recognized by the emotion engine to the server via an HTTP request.

[0407] Step 3:

[0408] Server: The server analyzes the received information and creates a new user profile in the database. Sentiment data is also stored in the profile.

[0409] Step 4:

[0410] Server: The server sends a notification to the device indicating that profiling is complete.

[0411] Step 5:

[0412] Device: The device notifies the user that the profile has been successfully created.

[0413] Information synchronization between devices

[0414] Step 1:

[0415] User: The user adds a new device (e.g., a tablet) and links it to an existing account.

[0416] Step 2:

[0417] Terminal (New Device): The new device sends link information and the user's sentiment data to the server and requests synchronization.

[0418] Step 3:

[0419] Server: The server retrieves user profile information and sentiment data and prepares the necessary information for the new device.

[0420] Step 4:

[0421] Server: The server sends the prepared information and emotional data to the new device.

[0422] Step 5:

[0423] Device (New Device): The new device applies received information and sentiment data, and synchronizes the user's profile.

[0424] Ad optimization and blocking

[0425] Step 1:

[0426] Server: The server selects relevant ads based on the user's profile and sentiment data.

[0427] Step 2:

[0428] Server: The server sends a request to the ad server to retrieve the most suitable ad list.

[0429] Step 3:

[0430] Ad Server: The ad server provides ad lists that match user profiles and sentiment data.

[0431] Step 4:

[0432] Server: The server sends the received ad list to the user's device.

[0433] Step 5:

[0434] Device: Displays the ad list received by the device to the user.

[0435] Step 6:

[0436] User: Users add specific ads to their block list, and their emotional data at that time is also recorded.

[0437] Step 7:

[0438] Terminal: Sends a request to add to the blocklist and sentiment data to the server.

[0439] Step 8:

[0440] Server: The server updates the blocklist and sentiment data, taking this into consideration for the next ad delivery.

[0441] Selecting and filtering information

[0442] Step 1:

[0443] Server: The server collects new articles and blog posts from multiple information sources.

[0444] Step 2:

[0445] Server: Stores collected information in a temporary database.

[0446] Step 3:

[0447] Server: Filters information based on user profiles and sentiment data, selecting only relevant articles.

[0448] Step 4:

[0449] Server: Sends filtered information and sentiment data to the user's device.

[0450] Step 5:

[0451] Terminal: Displays filtered information and sentiment data received by the terminal on the viewing screen.

[0452] Step 6:

[0453] User: The user views the displayed information and records their emotional data at that time.

[0454] This process ensures that users receive a consistent and personalized information and advertising experience regardless of the device they use. Furthermore, by considering user emotions, even higher levels of personalization are possible, leading to improved satisfaction.

[0455] (Example 2)

[0456] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0457] Traditional information recommendation and advertising delivery systems have limitations in terms of customization based on user interests and preferences, and they lack the ability to adjust based on user emotions. Furthermore, they struggle to provide a consistent user experience across multiple devices, and there is a lack of effective means to block unwanted information and advertisements. As a result, user satisfaction is low, and effective information delivery and advertising delivery are not being achieved.

[0458] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences, means for synchronizing information based on the profiles among multiple user devices, means for optimizing advertisements and blocking unwanted advertisements based on the profiles and sentiment data, and means for filtering relevant information and eliminating unwanted information based on the profiles and sentiment data. This enables the consistent provision of information and advertisements across multiple devices that take into account the user's interests and preferences as well as their emotions, and effectively eliminates unwanted information and advertisements.

[0459] A "user" is an individual or legal entity that utilizes the system and provides data about their interests, preferences, and emotions.

[0460] "Interests and preferences" refers to the topics and content that users are interested in, as well as their general tastes for those topics.

[0461] A "customized profile" is a collection of information individually tailored based on a user's interests and preferences, a digital record that reflects the user's characteristics.

[0462] "Emotional data" refers to information that represents the user's emotional state, and includes facial expression data and other emotional indicators analyzed by the emotion engine.

[0463] A "user device" is a hardware device used by a user to input information and interact with a system, and includes smartphones, tablets, and personal computers.

[0464] "Information synchronization" refers to the process of sharing and updating data so that the same information is consistently displayed and used across multiple user devices.

[0465] "Ad optimization" is the process of selecting and displaying ads that are most likely to be of interest to a user, based on their profile and sentiment data.

[0466] "Blocking unwanted ads" is the process of filtering out ads that are not needed to be displayed, based on the user's profile and sentiment data, and preventing them from being shown to the user.

[0467] "Relevant information filtering" is the process of excluding irrelevant information based on the user's profile and sentiment data, and providing only information that is useful to the user.

[0468] This invention provides a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. Furthermore, by incorporating an emotion engine that recognizes user emotions, it is possible to provide more accurate information and deliver advertisements. Specific embodiments for realizing this system are described in detail below.

[0469] Creating and managing user profiles

[0470] User: Users create a new account and enter basic information about their interests, preferences, and feelings. This includes, for example, their favorite topics (technology, health, business, etc.) and how they feel about them.

[0471] Device: The device (e.g., smartphone or computer) sends emotional data recognized by the emotion engine, along with information entered by the user, to the server. This includes software that uses the smartphone's camera and microphone to analyze facial expressions and voice tone.

[0472] Server: The server analyzes the received information and creates a new user profile in the database. It also stores sentiment data provided by the sentiment engine in the profile. If the user later adds or changes interests, preferences, or sentiments, the server updates this profile.

[0473] Information synchronization between devices

[0474] User: The user wants to access the same information on multiple devices (smartphone, tablet, PC, etc.).

[0475] Terminal: Each terminal sends data to the server regarding the actions performed by the user (e.g., bookmarking an article) and the user's emotional state during those actions.

[0476] Server: The server stores information and sentiment data in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on tablets and PCs, along with the sentiment data from when they were favorited.

[0477] Ad optimization and blocking

[0478] Server: Optimizes ads based on user profiles and sentiment data. Specifically, it selects ads that match the user's interests and emotions, and queries the ad server to obtain the optimal ad list.

[0479] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0480] Users: Users can enjoy a more personalized experience because they only see ads optimized based on their interests and emotions. They can also add ads they don't want to see to a block list.

[0481] Selecting and filtering information

[0482] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[0483] Server: The server then filters the information based on the user's profile and sentiment data, selecting only the most relevant information. The selected information is then delivered to the user's device.

[0484] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[0485] Specific example

[0486] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[0487] Device (smartphone): The user adds the article to their favorites and sends their emotional data to the server at that time.

[0488] Server: Updates user profiles and sentiment data, and synchronizes favorites and sentiment data with other registered devices (e.g., PCs and tablets).

[0489] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[0490] 2. The user decides they do not want to see new fitness ads on their computer and adds them to their block list.

[0491] Terminal (PC): Sends the operation to add to the block list and the corresponding emotion data to the server.

[0492] Server: Update blocklists and sentiment data to consider for future ad delivery.

[0493] Device: Controls the display of blocked ads in the future.

[0494] Examples of prompts for generative AI models

[0495] "This system creates user profiles based on their preferences and emotions, and uses them to optimize various information and advertisements. Articles that users add to their favorites on their smartphones are simultaneously synchronized across other devices, and emotional data is consistently managed. Please explain this process in detail."

[0496] This allows users to receive consistent, emotionally-driven, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[0497] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0498] Step 1:

[0499] User: The user logs into the system and proceeds to a screen where they create a new account. There, they enter basic information about their interests and preferences. The data entered includes, for example, "favorite topics" and "emotional tendencies."

[0500] Input: Topic and sentiment information entered by the user.

[0501] Output: JSON data of the input topic and sentiment information.

[0502] Specific actions: The user selects a topic such as "technology" or "health" and inputs emotions such as "excitement" or "reassurance."

[0503] Step 2:

[0504] Terminal: The terminal (smartphone or computer) sends information entered by the user and emotional data analyzed by the emotion engine to the server. The emotion engine uses the camera and microphone to analyze facial expressions and voice tone.

[0505] Input: User-entered topic and sentiment data, and sentiment analysis data from the sentiment engine.

[0506] Output: Integrated data sent to the server (topic, sentiment information, sentiment analysis data).

[0507] Specific operation: The smartphone analyzes facial expression data collected through its camera in real time and sends it to the server along with topic and emotion data.

[0508] Step 3:

[0509] Server: The server analyzes the received data and creates a new user profile in the database. Sentimental data provided by the sentiment engine is also stored in the profile.

[0510] Input: Integrated data of user topics, sentiment information, and sentiment analysis data.

[0511] Output: New user profile saved in the database.

[0512] Specific operation: The server creates a new entry in the database and sets fields such as "User ID," "Interest Topics," and "Sentiment Data."

[0513] Step 4:

[0514] User: Users want to access the same information on multiple devices. For example, they might add an article to their favorites on their smartphone and then check it later on their computer.

[0515] Input: User actions (adding articles to favorites) and associated sentiment data.

[0516] Output: Operational data and sentiment data as a synchronous request.

[0517] Specific operation: The user taps the "Favorites" button on their smartphone. At this time, the camera captures their facial expression and collects emotion data.

[0518] Step 5:

[0519] Device: The smartphone sends operation data and sentiment data to the server. The transmitted data includes the ID of the article that was operated on and sentiment data.

[0520] Input: Favorite operation data and sentiment data.

[0521] Output: Operational data and sentiment data sent to the server.

[0522] Specific operation: The smartphone sends an API request to the server that includes the "article ID" and "sentiment data".

[0523] Step 6:

[0524] Server: The server stores operation data and emotion data in a database and sends synchronization requests to other registered devices.

[0525] Input: Favorite operation data and sentiment data.

[0526] Output: Data sent to other devices as a sync request.

[0527] Specific operation: The server adds a new "favorites" entry to the database and sends a push notification to the device list.

[0528] Step 7:

[0529] Device (e.g., tablet or PC): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[0530] Input: Synchronized data from the server (article ID and sentiment data).

[0531] Output: Favorite articles and sentiment data updated on your local device.

[0532] Specific action: The tablet receives a notification and adds the new favorite article to its local database.

[0533] Step 8:

[0534] Server: Optimizes ads based on user profiles and sentiment data.

[0535] Input: User profile and sentiment data.

[0536] Output: Optimized ad list.

[0537] Specific operation: The server sends a request to the ad server that includes "user interest topics" and "sentiment data".

[0538] Step 9:

[0539] Device: Displays an optimized ad list received from the server by the device. Unwanted ads are blocked from being displayed.

[0540] Input: Ad list received from the server.

[0541] Output: Display of filtered ad list.

[0542] Specific operation: The device passes ad data to the display component, which filters and displays ads that are in the blocklist.

[0543] Step 10:

[0544] User: Add ads that the user does not want to see to a block list.

[0545] Input: User block actions and sentiment data.

[0546] Output: Blocklist update request sent to the server.

[0547] Specific action: The user clicks the "block" button on the ad, and this action and sentiment data are sent to the server.

[0548] Step 11:

[0549] Server: Update blocklists and sentiment data to consider for future ad delivery.

[0550] Input: Blocklist update request and sentiment data.

[0551] Output: Updated blocklist.

[0552] Specific action: The server updates the database and activates the blocklist.

[0553] Step 12:

[0554] Device: Controls the display of blocked ads in the future.

[0555] Input: Updated blocklist.

[0556] Output: Display of filtered ad list.

[0557] Specific action: The device removes blocked ads from the ad list and displays a new list.

[0558] Step 13:

[0559] Server: The server collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[0560] Input: Information source (RSS feed, web scraping, etc.).

[0561] Output: Articles and blog posts saved as temporary data.

[0562] Specific operation: The server analyzes information obtained from RSS feeds and web scraping and stores it in a temporary table.

[0563] Step 14:

[0564] Server: The server filters information based on the user's profile and sentiment data, selecting only the most relevant information.

[0565] Input: Articles, blog posts, temporary data.

[0566] Output: Filtered, useful informational data.

[0567] Specific operation: The server uses filtering rules and machine learning models to select relevant information.

[0568] Step 15:

[0569] Terminal: Displays filtered information received by the terminal from the server.

[0570] Input: Filtered, useful informational data.

[0571] Output: Filtered information displayed on the device.

[0572] Specific operation: The smartphone retrieves a new list of information and displays it in the UI component.

[0573] This allows users to receive consistent, emotion-based, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[0574] (Application Example 2)

[0575] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0576] Traditional information distribution systems provided information based on user interests and preferences, but they were insufficient in terms of real-time product recommendations and advertising optimization based on user emotions. Furthermore, no systems existed that took emotional data into account when synchronizing information across multiple devices. In addition, there was a lack of means to individually optimize the in-store shopping experience. As a result, users experienced inconsistent experiences, making it difficult to increase their satisfaction.

[0577] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences; means for synchronizing information based on the profiles among multiple user devices; means for optimizing advertisements and blocking unwanted advertisements based on the profiles; means for filtering relevant information and eliminating unnecessary information based on the profiles; means for making product suggestions in accordance with the user's interests and emotions in physical stores using an emotion engine that recognizes the user's emotions; and means for displaying product suggestions based on the profile and emotion data in real time using smart glasses. As a result, users can receive product suggestions that match their feelings, their shopping experience in physical stores is individually optimized, and their satisfaction is increased.

[0578] "User" refers to an individual or group that uses the system.

[0579] "Interests and preferences" refers to information that indicates a user's tastes in specific topics or products.

[0580] A "customized profile" refers to a set of data created individually based on a user's interests, preferences, and sentiment data.

[0581] "Means of synchronizing information" refers to methods for matching profile-based information across multiple user devices.

[0582] "Ad optimization" refers to the act of selecting and delivering the most relevant ads based on the user's profile.

[0583] "Methods of blocking ads" refer to methods of preventing the display of ads that users deem unnecessary or inappropriate.

[0584] "Filtering relevant information" refers to the act of selecting only information that is valuable to the user based on their profile.

[0585] An "emotion engine" refers to technology that recognizes and analyzes emotions from a user's facial expressions and voice.

[0586] A "physical store" refers to a commercial facility that provides goods and services in a physical location.

[0587] "Product recommendation" refers to the act of recommending highly relevant products based on the user's interests and feelings.

[0588] "Smart glasses" refer to glasses-type devices worn by users that display information and collect emotional data.

[0589] "Real-time display methods" refer to methods of presenting information instantly based on the user's current actions and status.

[0590] This invention relates to a system that creates individually customized profiles based on a user's interests, preferences, and emotions, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. This system utilizes an emotion engine that recognizes the user's emotions and smart glasses, particularly to optimize the in-store shopping experience.

[0591] Creating and managing user profiles

[0592] The server creates a profile based on the user's interests and preferences and stores it in a database. Emotional data entered by the user through smart glasses is also added to the profile. An emotion engine is used to recognize emotions from the user's facial expressions and voice and update the profile accordingly. The data on interests and preferences includes, for example, favorite topics and product categories (technology, health, business, etc.) and the emotions associated with them.

[0593] Information synchronization between devices

[0594] The server stores user actions (such as adding a product to their favorites) and corresponding emotional data in a database, and synchronizes this data with other registered devices (such as smartphones and tablets). If a user expresses positive feelings towards a particular product using smart glasses, that data is sent to the server and immediately reflected on other devices.

[0595] Ad optimization and blocking

[0596] The server selects the most relevant ads for the user based on their profile and sentiment data. Inappropriate ads are blocked as needed. For example, if a user decides they do not want to see a particular ad, it is added to a block list along with its sentiment data. Blocked ads will not be displayed to the user in the future.

[0597] Selecting and filtering information

[0598] The server collects articles and blog posts from multiple information sources and filters the information based on the user's profile and sentiment data. Smart glasses display information that is relevant to the user in real time. This allows users to easily access information that is valuable to them.

[0599] Applications in physical stores

[0600] Smart glasses are used to recognize a user's emotions towards products in a physical store. For example, if a user is excited when they see a new technology gadget, that emotional data is sent to a server and added to their profile. The next time the user visits a similar store, they will be shown product suggestions based on their emotions, encouraging them to make a purchase.

[0601] Specific example

[0602] In one specific application, when a user wears smart glasses and walks around a physical store, if they smile when they see a particular product, that emotion data is sent to a server. Based on this data, the server displays relevant products and promotions on the smart glasses in real time.

[0603] Examples of prompts to input into a generative AI model

[0604] "Based on the user's emotional data (images showing their reactions and analysis results), please list potential items to display next. Consider the user's ID, interests, and current emotional data."

[0605] Thus, the present invention uses user profiles and emotional data to synchronize information across devices and optimize the in-store shopping experience. This allows users to obtain a consistent and personalized experience.

[0606] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0607] Step 1: Enter the user's interests and preferences.

[0608] Users input their interests and preferences, such as specific topics or product categories, through an interface built into their smart glasses. This input data is sent from the smart glasses to a server. The input data is in string format and includes topics and categories of interest.

[0609] Step 2: Collecting emotional data

[0610] The device (smart glasses) uses its built-in camera and microphone to capture the user's facial expressions and voice. This data is analyzed by an emotion engine and extracted as the user's emotion data. This emotion data includes emotion labels such as "joy" and "surprise" and their intensity.

[0611] Step 3: Create a profile

[0612] The server creates a profile based on the user's interest and sentiment data. This profile includes the user's interests and their emotional responses to those interests. The profile data is stored in a database.

[0613] Step 4: Information synchronization

[0614] The server stores profile information in a database and then sends it to other registered devices based on the information synchronization interval. Other devices then store the received profile information in their local data storage. This ensures that users can obtain consistent information regardless of which device they use.

[0615] Step 5: Filtering ads and information

[0616] The server selects the most relevant ads for the user based on profile information in the database and blocks inappropriate ads. The ad list retrieved from the ad server is filtered using the user's interests and sentiment data to display only highly relevant ads. The filtering results are sent as an ad list to smart glasses and other devices.

[0617] Step 6: Product proposals in physical stores

[0618] As users walk through a physical store, smart glasses monitor their gaze and location, displaying information about products they might be interested in in real time based on their profile. For example, if a user shows excitement upon seeing a new gadget, detailed information about that product and related promotions will be displayed on the glasses.

[0619] Step 7: Send a prompt to the generated AI model

[0620] When displaying a specific item, the server sends a prompt to the generating AI model, which then lists potential relevant items based on the user's current sentiment data and profile. The prompt might be something like, "List potential items to display next, based on the user's sentiment data (images showing their reactions and analysis results). Please consider the user's ID, interests, and current sentiment data."

[0621] Step 8: Real-time information display

[0622] Smart glasses receive responses from a generating AI model and update the information displayed to the user in real time. This enables optimal product recommendations tailored to the user's emotions and interests. Users are more likely to check products on the spot and make a purchase.

[0623] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0624] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0625] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0626] [Second Embodiment]

[0627] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0628] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0629] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0630] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0631] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0632] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0633] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0634] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0635] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0636] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0637] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0638] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0639] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. Specific embodiments for realizing this system are described in detail below.

[0640] Creating and managing user profiles

[0641] User: Users create a new account and enter basic information such as their interests and preferences. This information includes, for example, their favorite topics (technology, health, business, etc.).

[0642] Terminal: The terminal (e.g., a smartphone or PC) sends the information entered by the user to the server.

[0643] Server: The server stores the received information in a database and creates a profile. If the user later adds or changes their interests or preferences, the server updates this profile.

[0644] Information synchronization between devices

[0645] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[0646] Terminal: Each terminal sends user actions (such as bookmarking an article) to the server.

[0647] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on their tablet or PC.

[0648] Ad optimization and blocking

[0649] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[0650] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0651] Users: Users can enjoy a more personalized experience because they only see ads that interest them. They can also add ads they don't want to see to a block list.

[0652] Selecting and filtering information

[0653] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[0654] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. The selected information is then delivered to the user's device.

[0655] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[0656] Specific example

[0657] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[0658] Device (smartphone): Sends an action to add the article to favorites to the server.

[0659] Server: Updates user profiles and interest data, and synchronizes favorites information with other registered devices (e.g., PCs and tablets).

[0660] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles.

[0661] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[0662] Terminal (PC): Sends an operation to add to the blocklist to the server.

[0663] Server: Update the blocklist and consider it for the next ad delivery.

[0664] Device: Controls the display of blocked ads in the future.

[0665] This allows users to receive a consistent and customized information and advertising experience across multiple devices. This system is expected to improve user satisfaction by providing an experience optimized to user needs.

[0666] The following describes the processing flow.

[0667] Creating and managing user profiles

[0668] Step 1:

[0669] User: The user creates a new account and enters basic information such as their name, email address, and interests.

[0670] Step 2:

[0671] Terminal: The terminal (e.g., a smartphone or PC) sends user input information to the server via an HTTP request.

[0672] Step 3:

[0673] Server: The server analyzes the information received and creates a new user profile in the database.

[0674] Step 4:

[0675] Server: The server sends a notification to the device indicating that profiling is complete.

[0676] Step 5:

[0677] Device: The device displays a notification to the user indicating that the profile has been successfully created.

[0678] Information synchronization between devices

[0679] Step 1:

[0680] User: The user adds a new device (e.g., a tablet) and links it to an existing account.

[0681] Step 2:

[0682] Terminal (New Device): The new device sends link information to the server and makes a synchronization request.

[0683] Step 3:

[0684] Server: The server retrieves the user's profile information and prepares the necessary information for the new device.

[0685] Step 4:

[0686] Server: The server sends the information it has prepared to the new device.

[0687] Step 5:

[0688] Device (New Device): The new device applies the information it receives and synchronizes the user's profile.

[0689] Ad optimization and blocking

[0690] Step 1:

[0691] Server: The server selects relevant advertisements based on the user's profile.

[0692] Step 2:

[0693] Server: The server sends a request to the ad server to retrieve a list of the most suitable ads.

[0694] Step 3:

[0695] Ad server: The ad server provides a list of ads that match the user profile.

[0696] Step 4:

[0697] Server: The server sends the received ad list to the user's device.

[0698] Step 5:

[0699] Device: Displays the ad list received by the device to the user.

[0700] Step 6:

[0701] User: The user performs an action to add a specific ad to the block list.

[0702] Step 7:

[0703] Terminal: Sends a request to the server to add the user to the blocklist.

[0704] Step 8:

[0705] Server: The server updates the blocklist and takes it into consideration for the next ad delivery.

[0706] Selecting and filtering information

[0707] Step 1:

[0708] Server: The server collects new articles and blog posts from multiple information sources.

[0709] Step 2:

[0710] Server: Stores collected information in a temporary database.

[0711] Step 3:

[0712] Server: Filters information based on user profiles, selecting only relevant articles.

[0713] Step 4:

[0714] Server: Sends filtered information to the user's terminal.

[0715] Step 5:

[0716] Terminal: Displays filtered information received by the terminal on the viewing screen.

[0717] Step 6:

[0718] User: The user views the displayed information and provides further feedback.

[0719] This ensures users receive a consistent information and advertising experience regardless of the device they use, and they can access personalized services based on their interests.

[0720] (Example 1)

[0721] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0722] Traditional systems offered limited customization based on user interests and preferences, and struggled to synchronize information consistently across multiple devices. Furthermore, they suffered from a poor user experience due to inadequate filtering of inappropriate advertisements and irrelevant information.

[0723] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0724] In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences and storing them in a database; means for synchronizing information based on the profiles among multiple user terminals; means for optimizing advertisements selected based on the profiles and blocking unnecessary advertisements; means for filtering data collected from information sources based on the profiles and eliminating unnecessary information; and means for displaying information customized to the user based on the profiles and interests. This enables consistent information provision and optimized advertisement display that meets the user's needs.

[0725] A "user" refers to an individual who uses a system to receive services customized based on their interests and preferences.

[0726] "Interests and preferences" refers to information that indicates the topics and themes that a user is interested in and particularly interested in.

[0727] A "profile" is a collection of individually customized user information generated based on the user's interests and preferences.

[0728] A "database" is an information management system that stores user profiles and related information, and retrieves, updates, and saves it as needed.

[0729] A "terminal" is a device used by a user to access a system, and includes smartphones, tablets, PCs, and other similar devices.

[0730] "Synchronization" refers to the process of ensuring that information is consistent across multiple user devices, and that user actions and data are reflected consistently.

[0731] "Advertising" refers to commercial promotional messages displayed to users.

[0732] "Optimization" refers to selecting and adjusting ads based on the user's profile to display them most effectively.

[0733] "Filtering" is the process of sorting collected information based on the user's profile and removing irrelevant or unnecessary information.

[0734] "Customized information" refers to information that is tailored to the user's interests and preferences and is therefore valuable to the user.

[0735] "Unnecessary advertising" refers to advertisements that do not match the user's interests and preferences and therefore have no value to the user.

[0736] "Information sources" refer to external websites and databases that provide informational content such as articles and blog posts.

[0737] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. The following describes in detail embodiments for specifically implementing the present invention.

[0738] Creating and managing user profiles

[0739] User: Users create a new account and enter basic information such as their interests and preferences. This information includes, for example, their favorite topics (technology, health, business, etc.).

[0740] Terminal: The terminal (e.g., a smartphone or PC) sends information entered by the user to the server. This transmission is performed using the HTTP POST method.

[0741] Server: The server stores the received information in a database and creates a profile. A database management system such as MySQL is used. If the user later adds or changes their interests or preferences, the server updates this profile.

[0742] Information synchronization between devices

[0743] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[0744] Terminal: Each terminal sends user actions (such as bookmarking an article) to the server.

[0745] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on their tablet or PC.

[0746] Ad optimization and blocking

[0747] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[0748] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0749] Users: Users can enjoy a more personalized experience because they only see ads that interest them. They can also add ads they don't want to see to a block list.

[0750] Selecting and filtering information

[0751] Server: The server collects articles and blog posts from multiple sources. The collected information is temporarily stored in a database.

[0752] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. Natural language processing (NLP) techniques can be used for this filtering.

[0753] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[0754] Specific example

[0755] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[0756] Device (smartphone): Sends an action to add the article to favorites to the server (e.g., HTTP POST request).

[0757] Server: Receives operation details and updates user profiles and databases. Then, sends synchronization requests to other devices.

[0758] Device (PC or tablet): Receives synchronization requests from the server and updates the displayed content.

[0759] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[0760] Device (PC): Clicking the "Block" icon in the corner of the ad sends that action to the server.

[0761] Server: Update the block list and apply it to future ad delivery.

[0762] Device: Blocked ads will not be displayed the next time you view an ad.

[0763] Example of a prompt

[0764] "Please gather the latest health-related information and provide me with articles filtered to match my profile."

[0765] "The ads I recently blocked have been updated, so I would like them to be reflected in the next ad delivery."

[0766] "Please sync business-related articles you've added to your favorites to other devices."

[0767] In this way, by performing clear processing at each step, a mechanism is built that ensures the entire system functions consistently. This allows for a more personalized experience for the user.

[0768] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0769] Step 1:

[0770] User: Create a new account and enter basic information.

[0771] The user enters the required information (name, email address, interests, and preferred topics) on the application registration screen.

[0772] Input: Basic information about the user's interests and preferences

[0773] Output: User information is temporarily stored on the device.

[0774] Step 2:

[0775] Terminal: Sending user information

[0776] The device (smartphone or PC) sends the entered user information to the server. This transmission uses the HTTP POST method.

[0777] Input: User information stored on the device

[0778] Output: User information is sent to the server.

[0779] Step 3:

[0780] Server: Stores user information and creates profiles.

[0781] The server saves the received user information to the database and creates a new profile. The database management system used is MySQL.

[0782] Input: User information sent to the server

[0783] Output: User profiles stored in the database

[0784] Step 4:

[0785] User: Profile Update

[0786] Users can add or change their interests and preferences in the settings screen as needed.

[0787] Input: New or updated user interest and preference information

[0788] Output: New or updated information temporarily stored on the device.

[0789] Step 5:

[0790] Device: Profile update notification

[0791] The terminal notifies the server of user profile changes. This notification also uses the HTTP POST method.

[0792] Input: New or updated information temporarily stored on the device

[0793] Output: Update information sent to the server

[0794] Step 6:

[0795] Server: Profile Update

[0796] The server updates the user profiles in the database based on the received update information.

[0797] Input: Update information sent to the server

[0798] Output: The updated user profile is saved to the database.

[0799] Step 7:

[0800] User: I want to synchronize information between devices.

[0801] Users use multiple devices such as smartphones, tablets, and PCs, and they want to access the same information on each of them.

[0802] Input: Request for synchronization via user action

[0803] Output: The operation details are temporarily saved on the terminal.

[0804] Step 8:

[0805] Terminal: Sending operation information

[0806] Each device sends user actions (for example, adding an item to favorites) to the server.

[0807] Input: User actions saved on the device

[0808] Output: Operation information sent to the server

[0809] Step 9:

[0810] Server: Stores operation information and sends synchronization requests to other devices.

[0811] The server saves the received operation information to the database and sends synchronization requests to other registered devices.

[0812] Input: Operation information sent to the server

[0813] Output: Operation information stored in the database and synchronization requests sent to other devices.

[0814] Step 10:

[0815] Terminal: Receiving sync requests and updating data.

[0816] Each terminal receives a synchronization request from the server and updates its data.

[0817] Input: Synchronization request received from the server

[0818] Output: Updated terminal data

[0819] Step 11:

[0820] Server: Ad optimization

[0821] The server sends a request to the ad server based on the user's profile to retrieve the most suitable ad list.

[0822] Input: User profile information

[0823] Output: Ad list

[0824] Step 12:

[0825] Server: Sending ad lists

[0826] The server sends the ad list to each user's device.

[0827] Input: Retrieved ad list

[0828] Output: Ad list sent to the device

[0829] Step 13:

[0830] Device: Ad display and blocking

[0831] The device displays an ad list received from the server to the user and blocks unwanted ads. Users may request that ads be blocked.

[0832] Input: Ad list received from the server and user block requests

[0833] Output: Ads displayed and block requests sent to the server

[0834] Step 14:

[0835] Server: Updating the blocklist

[0836] The server receives a block request from a user and updates the block list.

[0837] Input: Block request

[0838] Output: Updated blocklist

[0839] Step 15:

[0840] Server: Information collection

[0841] The server collects articles and blog posts from multiple sources and temporarily stores them in a database.

[0842] Input: Articles and blog posts collected from various sources.

[0843] Output: Information temporarily stored in the database

[0844] Step 16:

[0845] Server: Information filtering

[0846] The server filters the collected information based on user profiles to select the most relevant information. Natural language processing techniques are used for filtering.

[0847] Input: Unfiltered information and user profiles stored in the database

[0848] Output: Filtered information

[0849] Step 17:

[0850] Server: Distribution of filtering information

[0851] The server delivers filtered information to the user's terminal.

[0852] Input: Filtered information

[0853] Output: Filtering information sent to the terminal

[0854] Step 18:

[0855] Device: Display filtering information

[0856] The device displays the received filtering information, making it easy for the user to access.

[0857] Input: Filtering information received from the server

[0858] Output: Filtering information displayed

[0859] (Application Example 1)

[0860] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0861] Traditional advertising and information delivery systems have been insufficient in personalizing users' diverse interests and preferences, making it difficult to provide a consistent user experience across multiple devices. Furthermore, users are often bothered by irrelevant advertisements and unrelated information, leading to decreased user satisfaction. In addition, there has been a lack of integrated solutions for providing customized content utilizing generative AI models.

[0862] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0863] In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences; means for synchronizing information based on the profiles across multiple user devices; means for optimizing advertisements and blocking unwanted advertisements based on the profiles; means for generating prompt statements based on a generative AI model and providing customized content based on the user's activity; and means for enabling the user to synchronize favorite articles across multiple devices and block unwanted advertisements. This makes it possible to provide a consistent and customized information and advertising experience that is tailored to the user's interests and preferences.

[0864] "User interests and preferences" refer to the topics and matters of interest that users are particularly interested in and show interest in.

[0865] A "customized profile" refers to user information and settings that are individually configured based on the user's interests and preferences.

[0866] "Synchronizing information across multiple devices" means sharing the same information across multiple electronic devices owned by a user (such as smartphones, tablets, and personal computers) and keeping them constantly up-to-date.

[0867] "Methods for optimizing ads and blocking unwanted ads" refers to methods and technologies that select the most relevant ads based on a user's profile and remove unwanted or inappropriate ads from those displayed to the user.

[0868] "Filtering relevant information and eliminating unnecessary information" refers to a technology that selects information collected based on the user's profile and provides only the information that is highly valuable to the user.

[0869] A "generative AI model" is a model that uses artificial intelligence to analyze user data and behavioral patterns, and then generates new prompts and content based on the results.

[0870] A "prompt message" is a guiding or instructional message generated by a generative AI model that contains information highly relevant to the user.

[0871] "User activity" refers to all actions and behaviors that a user performs through their device, including records of actions such as search history, browsing history, and applications used.

[0872] "Syncing favorite articles" means sharing articles that users have saved as of particular interest across multiple devices, keeping them always up-to-date.

[0873] "Means of providing customized content" refers to methods and technologies for selecting and delivering the most relevant information and advertisements to users based on their interests and preferences.

[0874] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple devices, optimizes and blocks advertisements, and filters relevant information. Specific embodiments for realizing this system are described in detail below.

[0875] System Configuration

[0876] hardware

[0877] Smartphone (iOS or Android)

[0878] tablet

[0879] PC

[0880] software

[0881] iOS application: Swift

[0882] Android application: Kotlin

[0883] Backend: Node.js, Express.js, MongoDB

[0884] Frontend: React Native

[0885] Creating and managing user profiles

[0886] User: Users create new accounts and enter their interests and preferences. This information includes their favorite topics (e.g., technology, health, business, etc.).

[0887] Terminal: Sends user-entered information to the server.

[0888] Server: The server stores the received information in a database and creates a user profile. If the user later adds or changes their interests or preferences, the server updates this profile.

[0889] Information synchronization between devices

[0890] User: The user uses multiple devices (smartphone, tablet, PC, etc.) and wants to access the same information on each device.

[0891] Terminal: Each terminal sends user actions (e.g., bookmarking an article) to the server.

[0892] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows articles that a user has favorited on their smartphone to be accessed on tablets and PCs as well.

[0893] Ad optimization and blocking

[0894] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[0895] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0896] Users: They can enjoy a more personalized experience because they only see ads that interest them. Users can also add ads they don't want to see to a block list.

[0897] Information filtering

[0898] Server: The server collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[0899] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. The selected information is then delivered to the user's device.

[0900] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only valuable information.

[0901] Introduction of Generative AI Models

[0902] Server: Uses a generative AI model to generate and provide customized prompt messages to the user based on user activity.

[0903] Specific example:

[0904] When a user searches for health-related articles on their smartphone and adds them to their favorites, that information is sent to the server and synchronized with other devices.

[0905] Example of a prompt:

[0906] "We've confirmed you're interested in health. Why not check out some new, relevant articles?"

[0907] This system allows users to receive consistent and customized information and advertising experiences across multiple devices. Furthermore, by leveraging generative AI models, it enables the delivery of more personalized prompt messages.

[0908] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0909] Step 1:

[0910] User: Create a new account and enter your interests and preferences. This includes your favorite topics (e.g., technology, health, business, etc.).

[0911] Input: Users enter information about their interests and preferences into a form on a smartphone app.

[0912] Output: The entered information is temporarily stored on the device.

[0913] Step 2:

[0914] Terminal: Sends entered information about interests and preferences to the server.

[0915] Input: Information entered into a smartphone app.

[0916] Data processing: Convert form data to JSON format and generate an API request to the server.

[0917] Output: JSON data sent to the server.

[0918] Step 3:

[0919] Server: Stores received information in the database and creates user profiles.

[0920] Input: JSON data sent from the device.

[0921] Data processing: Analyze incoming data and save it to the appropriate table in the database.

[0922] Output: User profile stored in the database.

[0923] Step 4:

[0924] Terminal: Sends information about actions performed on each terminal (e.g., adding an article to favorites) to the server.

[0925] Input: The action taken by a user to add an article to their favorites.

[0926] Data processing: Generate favorites registration data and create API requests to the server.

[0927] Output: Favorite registration data sent to the server.

[0928] Step 5:

[0929] Server: Stores information received from each terminal in a database and sends it as a synchronization request to other registered devices.

[0930] Input: Favorite registration data sent from the device.

[0931] Data processing: Save new favorite information to the database and send a sync request to other devices.

[0932] Output: Synchronization requests sent to each terminal.

[0933] Step 6:

[0934] Terminals: Each terminal updates its favorite articles based on synchronization requests received from the server.

[0935] Input: Synchronization request from the server.

[0936] Data calculation: Update the local database based on a synchronous request.

[0937] Output: Updated favorite articles information.

[0938] Step 7:

[0939] Server: Optimizes ads based on user profiles and blocks unwanted ads.

[0940] Input: User profile data.

[0941] Data processing: Analyze profile data and generate the optimal ad list.

[0942] Output: A list of ads delivered to users.

[0943] Step 8:

[0944] Device: Displays the ad list received from the server and blocks unnecessary ads.

[0945] Input: Ad list received from the server.

[0946] Data processing: Analyze the ad list and separate the ads to display from those to block.

[0947] Output: Advertisements displayed on the user's screen.

[0948] Step 9:

[0949] Server: Collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[0950] Input: Content data obtained from the information source.

[0951] Data processing: Temporarily save collected articles and blog posts to a database.

[0952] Output: Saved content data.

[0953] Step 10:

[0954] Server: Filters information based on the user's profile, selecting only the most relevant information.

[0955] Input: Collected content data and user profile data.

[0956] Data processing: Use filtering algorithms to select only the most relevant information.

[0957] Output: Filtered information list.

[0958] Step 11:

[0959] Terminal: Displays filtered information received from the server.

[0960] Input: List of information from the server.

[0961] Data processing: Analyze the information list and format it for display on the user screen.

[0962] Output: Filtered content displayed on the user screen.

[0963] Step 12:

[0964] Server: Uses a generative AI model to generate and provide customized prompt messages to the user based on user activity.

[0965] Input: User activity data.

[0966] Data processing: Generate prompt statements using a generative AI model.

[0967] Output: The prompt text provided to the user.

[0968] Specific example:

[0969] When a user searches for health-related articles on their smartphone and adds them to their favorites:

[0970] 1. The user adds the article to their favorites (Step 4), and the data is sent from the device to the server.

[0971] 2. The server receives the information, updates the database, and sends a synchronization request to the other devices (Step 5).

[0972] 3. Other devices receive the sync request and update their favorite articles (Step 6).

[0973] Example of a prompt:

[0974] "We've confirmed your interest in health. Would you like to check out some new, relevant articles?"

[0975] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0976] This invention combines a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information with an emotion engine that recognizes user emotions. Specific embodiments for realizing this system are described in detail below.

[0977] Creating and managing user profiles

[0978] User: Users create a new account and enter basic information about their interests, preferences, and feelings. This includes, for example, their favorite topics (technology, health, business, etc.) and how they feel about them.

[0979] Device: The device (e.g., smartphone or PC) sends the emotion data recognized by the emotion engine, along with the information entered by the user, to the server.

[0980] Server: The server analyzes the received information and creates a new user profile in the database. Sentimental data provided by the sentiment engine is also stored in the profile. If the user later adds or changes interests, preferences, or emotions, the server updates this profile.

[0981] Information synchronization between devices

[0982] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[0983] Terminal: Each terminal sends user sentiment data to the server along with the actions the user performs (e.g., adding an article to their favorites).

[0984] Server: The server stores information and sentiment data in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on tablets and PCs, along with the sentiment data from when they were favorited.

[0985] Ad optimization and blocking

[0986] Server: Optimizes ads based on user profiles and sentiment data. Specifically, it selects ads that match the user's interests and emotions, and queries the ad server to obtain the optimal ad list.

[0987] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[0988] Users: Users can enjoy a more personalized experience because they only see ads optimized based on their interests and emotions. They can also add ads they don't want to see to a block list.

[0989] Selecting and filtering information

[0990] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[0991] Server: The server then filters the information based on the user's profile and sentiment data, selecting only the most relevant information. The selected information is then delivered to the user's device.

[0992] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[0993] Specific example

[0994] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[0995] Device (smartphone): The user adds the article to their favorites and sends their emotional data to the server at that time.

[0996] Server: Updates user profiles and sentiment data, and synchronizes favorites and sentiment data with other registered devices (e.g., PCs and tablets).

[0997] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[0998] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[0999] Terminal (PC): Sends the operation of adding to the block list and the corresponding emotion data to the server.

[1000] Server: Update blocklists and sentiment data to consider for future ad delivery.

[1001] Device: Controls the display of blocked ads in the future.

[1002] This allows users to receive consistent, emotionally-driven, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[1003] The following describes the processing flow.

[1004] Creating and managing user profiles

[1005] Step 1:

[1006] User: The user creates a new account and enters initial information such as name, email address, interest categories, and sentiments.

[1007] Step 2:

[1008] Device: The device (e.g., smartphone or PC) sends the information entered by the user and the emotion data recognized by the emotion engine to the server via an HTTP request.

[1009] Step 3:

[1010] Server: The server analyzes the received information and creates a new user profile in the database. Sentiment data is also stored in the profile.

[1011] Step 4:

[1012] Server: The server sends a notification to the device indicating that profiling is complete.

[1013] Step 5:

[1014] Device: The device notifies the user that the profile has been successfully created.

[1015] Information synchronization between devices

[1016] Step 1:

[1017] User: The user adds a new device (e.g., a tablet) and links it to an existing account.

[1018] Step 2:

[1019] Terminal (New Device): The new device sends link information and the user's sentiment data to the server and requests synchronization.

[1020] Step 3:

[1021] Server: The server retrieves user profile information and sentiment data and prepares the necessary information for the new device.

[1022] Step 4:

[1023] Server: The server sends the prepared information and emotional data to the new device.

[1024] Step 5:

[1025] Device (New Device): The new device applies received information and sentiment data, and synchronizes the user's profile.

[1026] Ad optimization and blocking

[1027] Step 1:

[1028] Server: The server selects relevant ads based on the user's profile and sentiment data.

[1029] Step 2:

[1030] Server: The server sends a request to the ad server to retrieve the most suitable ad list.

[1031] Step 3:

[1032] Ad Server: The ad server provides ad lists that match user profiles and sentiment data.

[1033] Step 4:

[1034] Server: The server sends the received ad list to the user's device.

[1035] Step 5:

[1036] Device: Displays the ad list received by the device to the user.

[1037] Step 6:

[1038] User: Users add specific ads to their block list, and their emotional data at that time is also recorded.

[1039] Step 7:

[1040] Terminal: Sends a request to add to the blocklist and sentiment data to the server.

[1041] Step 8:

[1042] Server: The server updates the blocklist and sentiment data, taking this into consideration for the next ad delivery.

[1043] Selecting and filtering information

[1044] Step 1:

[1045] Server: The server collects new articles and blog posts from multiple information sources.

[1046] Step 2:

[1047] Server: Stores collected information in a temporary database.

[1048] Step 3:

[1049] Server: Filters information based on user profiles and sentiment data, selecting only relevant articles.

[1050] Step 4:

[1051] Server: Sends filtered information and sentiment data to the user's device.

[1052] Step 5:

[1053] Terminal: Displays filtered information and sentiment data received by the terminal on the viewing screen.

[1054] Step 6:

[1055] User: The user views the displayed information and records their emotional data at that time.

[1056] This process ensures that users receive a consistent and personalized information and advertising experience regardless of the device they use. Furthermore, by considering user emotions, even higher levels of personalization are possible, leading to improved satisfaction.

[1057] (Example 2)

[1058] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[1059] Traditional information recommendation and advertising delivery systems have limitations in terms of customization based on user interests and preferences, and they lack the ability to adjust based on user emotions. Furthermore, they struggle to provide a consistent user experience across multiple devices, and there is a lack of effective means to block unwanted information and advertisements. As a result, user satisfaction is low, and effective information delivery and advertising delivery are not being achieved.

[1060] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences, means for synchronizing information based on the profiles among multiple user devices, means for optimizing advertisements and blocking unwanted advertisements based on the profiles and sentiment data, and means for filtering relevant information and eliminating unwanted information based on the profiles and sentiment data. This enables the consistent provision of information and advertisements across multiple devices that take into account the user's interests and preferences as well as their emotions, and effectively eliminates unwanted information and advertisements.

[1061] A "user" is an individual or legal entity that utilizes the system and provides data about their interests, preferences, and emotions.

[1062] "Interests and preferences" refers to the topics and content that users are interested in, as well as their general tastes for those topics.

[1063] A "customized profile" is a collection of information individually tailored based on a user's interests and preferences, a digital record that reflects the user's characteristics.

[1064] "Emotional data" refers to information that represents the user's emotional state, and includes facial expression data and other emotional indicators analyzed by the emotion engine.

[1065] A "user device" is a hardware device used by a user to input information and interact with a system, and includes smartphones, tablets, and personal computers.

[1066] "Information synchronization" refers to the process of sharing and updating data so that the same information is consistently displayed and used across multiple user devices.

[1067] "Ad optimization" is the process of selecting and displaying ads that are most likely to be of interest to a user, based on their profile and sentiment data.

[1068] "Blocking unwanted ads" is the process of filtering out ads that are not needed to be displayed, based on the user's profile and sentiment data, and preventing them from being shown to the user.

[1069] "Relevant information filtering" is the process of excluding irrelevant information based on the user's profile and sentiment data, and providing only information that is useful to the user.

[1070] This invention provides a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. Furthermore, by incorporating an emotion engine that recognizes user emotions, it is possible to provide more accurate information and deliver advertisements. Specific embodiments for realizing this system are described in detail below.

[1071] Creating and managing user profiles

[1072] User: Users create a new account and enter basic information about their interests, preferences, and feelings. This includes, for example, their favorite topics (technology, health, business, etc.) and how they feel about them.

[1073] Device: The device (e.g., smartphone or computer) sends emotional data recognized by the emotion engine, along with information entered by the user, to the server. This includes software that uses the smartphone's camera and microphone to analyze facial expressions and voice tone.

[1074] Server: The server analyzes the received information and creates a new user profile in the database. It also stores sentiment data provided by the sentiment engine in the profile. If the user later adds or changes interests, preferences, or sentiments, the server updates this profile.

[1075] Information synchronization between devices

[1076] User: The user wants to access the same information on multiple devices (smartphone, tablet, PC, etc.).

[1077] Terminal: Each terminal sends data to the server regarding the actions performed by the user (e.g., bookmarking an article) and the user's emotional state during those actions.

[1078] Server: The server stores information and sentiment data in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on tablets and PCs, along with the sentiment data from when they were favorited.

[1079] Ad optimization and blocking

[1080] Server: Optimizes ads based on user profiles and sentiment data. Specifically, it selects ads that match the user's interests and emotions, and queries the ad server to obtain the optimal ad list.

[1081] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[1082] Users: Users can enjoy a more personalized experience because they only see ads optimized based on their interests and emotions. They can also add ads they don't want to see to a block list.

[1083] Selecting and filtering information

[1084] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[1085] Server: The server then filters the information based on the user's profile and sentiment data, selecting only the most relevant information. The selected information is then delivered to the user's device.

[1086] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[1087] Specific example

[1088] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[1089] Device (smartphone): The user adds the article to their favorites and sends their emotional data to the server at that time.

[1090] Server: Updates user profiles and sentiment data, and synchronizes favorites and sentiment data with other registered devices (e.g., PCs and tablets).

[1091] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[1092] 2. The user decides they do not want to see new fitness ads on their computer and adds them to their block list.

[1093] Terminal (PC): Sends the operation to add to the block list and the corresponding emotion data to the server.

[1094] Server: Update blocklists and sentiment data to consider for future ad delivery.

[1095] Device: Controls the display of blocked ads in the future.

[1096] Examples of prompts for generative AI models

[1097] "This system creates user profiles based on their preferences and emotions, and uses them to optimize various information and advertisements. Articles that users add to their favorites on their smartphones are simultaneously synchronized across other devices, and emotional data is consistently managed. Please explain this process in detail."

[1098] This allows users to receive consistent, emotionally-driven, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[1099] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1100] Step 1:

[1101] User: The user logs into the system and proceeds to a screen where they create a new account. There, they enter basic information about their interests and preferences. The data entered includes, for example, "favorite topics" and "emotional tendencies."

[1102] Input: Topic and sentiment information entered by the user.

[1103] Output: JSON data of the input topic and sentiment information.

[1104] Specific actions: The user selects a topic such as "technology" or "health" and inputs emotions such as "excitement" or "reassurance."

[1105] Step 2:

[1106] Terminal: The terminal (smartphone or computer) sends information entered by the user and emotional data analyzed by the emotion engine to the server. The emotion engine uses the camera and microphone to analyze facial expressions and voice tone.

[1107] Input: User-entered topic and sentiment data, and sentiment analysis data from the sentiment engine.

[1108] Output: Integrated data sent to the server (topic, sentiment information, sentiment analysis data).

[1109] Specific operation: The smartphone analyzes facial expression data collected through its camera in real time and sends it to the server along with topic and emotion data.

[1110] Step 3:

[1111] Server: The server analyzes the received data and creates a new user profile in the database. Sentimental data provided by the sentiment engine is also stored in the profile.

[1112] Input: Integrated data of user topics, sentiment information, and sentiment analysis data.

[1113] Output: New user profile saved in the database.

[1114] Specific operation: The server creates a new entry in the database and sets fields such as "User ID," "Interest Topics," and "Sentiment Data."

[1115] Step 4:

[1116] User: Users want to access the same information on multiple devices. For example, they might add an article to their favorites on their smartphone and then check it later on their computer.

[1117] Input: User actions (adding articles to favorites) and associated sentiment data.

[1118] Output: Operational data and sentiment data as a synchronous request.

[1119] Specific operation: The user taps the "Favorites" button on their smartphone. At this time, the camera captures their facial expression and collects emotion data.

[1120] Step 5:

[1121] Device: The smartphone sends operation data and sentiment data to the server. The transmitted data includes the ID of the article that was operated on and sentiment data.

[1122] Input: Favorite operation data and sentiment data.

[1123] Output: Operational data and sentiment data sent to the server.

[1124] Specific operation: The smartphone sends an API request to the server that includes the "article ID" and "sentiment data".

[1125] Step 6:

[1126] Server: The server stores operation data and emotion data in a database and sends synchronization requests to other registered devices.

[1127] Input: Favorite operation data and sentiment data.

[1128] Output: Data sent to other devices as a sync request.

[1129] Specific operation: The server adds a new "favorites" entry to the database and sends a push notification to the device list.

[1130] Step 7:

[1131] Device (e.g., tablet or PC): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[1132] Input: Synchronized data from the server (article ID and sentiment data).

[1133] Output: Favorite articles and sentiment data updated on your local device.

[1134] Specific action: The tablet receives a notification and adds the new favorite article to its local database.

[1135] Step 8:

[1136] Server: Optimizes ads based on user profiles and sentiment data.

[1137] Input: User profile and sentiment data.

[1138] Output: Optimized ad list.

[1139] Specific operation: The server sends a request to the ad server that includes "user interest topics" and "sentiment data".

[1140] Step 9:

[1141] Device: Displays an optimized ad list received from the server by the device. Unwanted ads are blocked from being displayed.

[1142] Input: Ad list received from the server.

[1143] Output: Display of filtered ad list.

[1144] Specific operation: The device passes ad data to the display component, which filters and displays ads that are in the blocklist.

[1145] Step 10:

[1146] User: Add ads that the user does not want to see to a block list.

[1147] Input: User block actions and sentiment data.

[1148] Output: Blocklist update request sent to the server.

[1149] Specific action: The user clicks the "block" button on the ad, and this action and sentiment data are sent to the server.

[1150] Step 11:

[1151] Server: Update blocklists and sentiment data to consider for future ad delivery.

[1152] Input: Blocklist update request and sentiment data.

[1153] Output: Updated blocklist.

[1154] Specific action: The server updates the database and activates the blocklist.

[1155] Step 12:

[1156] Device: Controls the display of blocked ads in the future.

[1157] Input: Updated blocklist.

[1158] Output: Display of filtered ad list.

[1159] Specific action: The device removes blocked ads from the ad list and displays a new list.

[1160] Step 13:

[1161] Server: The server collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[1162] Input: Information source (RSS feed, web scraping, etc.).

[1163] Output: Articles and blog posts saved as temporary data.

[1164] Specific operation: The server analyzes information obtained from RSS feeds and web scraping and stores it in a temporary table.

[1165] Step 14:

[1166] Server: The server filters information based on the user's profile and sentiment data, selecting only the most relevant information.

[1167] Input: Articles, blog posts, temporary data.

[1168] Output: Filtered, useful informational data.

[1169] Specific operation: The server uses filtering rules and machine learning models to select relevant information.

[1170] Step 15:

[1171] Terminal: Displays filtered information received by the terminal from the server.

[1172] Input: Filtered, useful informational data.

[1173] Output: Filtered information displayed on the device.

[1174] Specific operation: The smartphone retrieves a new list of information and displays it in the UI component.

[1175] This allows users to receive consistent, emotion-based, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[1176] (Application Example 2)

[1177] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1178] Traditional information distribution systems provided information based on user interests and preferences, but they were insufficient in terms of real-time product recommendations and advertising optimization based on user emotions. Furthermore, no systems existed that took emotional data into account when synchronizing information across multiple devices. In addition, there was a lack of means to individually optimize the in-store shopping experience. As a result, users experienced inconsistent experiences, making it difficult to increase their satisfaction.

[1179] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences; means for synchronizing information based on the profiles among multiple user devices; means for optimizing advertisements and blocking unwanted advertisements based on the profiles; means for filtering relevant information and eliminating unnecessary information based on the profiles; means for making product suggestions in accordance with the user's interests and emotions in physical stores using an emotion engine that recognizes the user's emotions; and means for displaying product suggestions based on the profile and emotion data in real time using smart glasses. As a result, users can receive product suggestions that match their feelings, their shopping experience in physical stores is individually optimized, and their satisfaction is increased.

[1180] "User" refers to an individual or group that uses the system.

[1181] "Interests and preferences" refers to information that indicates a user's tastes in specific topics or products.

[1182] A "customized profile" refers to a set of data created individually based on a user's interests, preferences, and sentiment data.

[1183] "Means of synchronizing information" refers to methods for matching profile-based information across multiple user devices.

[1184] "Ad optimization" refers to the act of selecting and delivering the most relevant ads based on the user's profile.

[1185] "Methods of blocking ads" refer to methods of preventing the display of ads that users deem unnecessary or inappropriate.

[1186] "Filtering relevant information" refers to the act of selecting only information that is valuable to the user based on their profile.

[1187] An "emotion engine" refers to technology that recognizes and analyzes emotions from a user's facial expressions and voice.

[1188] A "physical store" refers to a commercial facility that provides goods and services in a physical location.

[1189] "Product recommendation" refers to the act of recommending highly relevant products based on the user's interests and feelings.

[1190] "Smart glasses" refer to glasses-type devices worn by users that display information and collect emotional data.

[1191] "Real-time display methods" refer to methods of presenting information instantly based on the user's current actions and status.

[1192] This invention relates to a system that creates individually customized profiles based on a user's interests, preferences, and emotions, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. This system utilizes an emotion engine that recognizes the user's emotions and smart glasses, particularly to optimize the in-store shopping experience.

[1193] Creating and managing user profiles

[1194] The server creates a profile based on the user's interests and preferences and stores it in a database. Emotional data entered by the user through smart glasses is also added to the profile. An emotion engine is used to recognize emotions from the user's facial expressions and voice and update the profile accordingly. The data on interests and preferences includes, for example, favorite topics and product categories (technology, health, business, etc.) and the emotions associated with them.

[1195] Information synchronization between devices

[1196] The server stores user actions (such as adding a product to their favorites) and corresponding emotional data in a database, and synchronizes this data with other registered devices (such as smartphones and tablets). If a user expresses positive feelings towards a particular product using smart glasses, that data is sent to the server and immediately reflected on other devices.

[1197] Ad optimization and blocking

[1198] The server selects the most relevant ads for the user based on their profile and sentiment data. Inappropriate ads are blocked as needed. For example, if a user decides they do not want to see a particular ad, it is added to a block list along with its sentiment data. Blocked ads will not be displayed to the user in the future.

[1199] Selecting and filtering information

[1200] The server collects articles and blog posts from multiple information sources and filters the information based on the user's profile and sentiment data. Smart glasses display information that is relevant to the user in real time. This allows users to easily access information that is valuable to them.

[1201] Applications in physical stores

[1202] Smart glasses are used to recognize a user's emotions towards products in a physical store. For example, if a user is excited when they see a new technology gadget, that emotional data is sent to a server and added to their profile. The next time the user visits a similar store, they will be shown product suggestions based on their emotions, encouraging them to make a purchase.

[1203] Specific example

[1204] In one specific application, when a user wears smart glasses and walks around a physical store, if they smile when they see a particular product, that emotion data is sent to a server. Based on this data, the server displays relevant products and promotions on the smart glasses in real time.

[1205] Examples of prompts to input into a generative AI model

[1206] "Based on the user's emotional data (images showing their reactions and analysis results), please list potential items to display next. Consider the user's ID, interests, and current emotional data."

[1207] Thus, the present invention uses user profiles and emotional data to synchronize information across devices and optimize the in-store shopping experience. This allows users to obtain a consistent and personalized experience.

[1208] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1209] Step 1: Enter the user's interests and preferences.

[1210] Users input their interests and preferences, such as specific topics or product categories, through an interface built into their smart glasses. This input data is sent from the smart glasses to a server. The input data is in string format and includes topics and categories of interest.

[1211] Step 2: Collecting emotional data

[1212] The device (smart glasses) uses its built-in camera and microphone to capture the user's facial expressions and voice. This data is analyzed by an emotion engine and extracted as the user's emotion data. This emotion data includes emotion labels such as "joy" and "surprise" and their intensity.

[1213] Step 3: Create a profile

[1214] The server creates a profile based on the user's interest and sentiment data. This profile includes the user's interests and their emotional responses to those interests. The profile data is stored in a database.

[1215] Step 4: Information synchronization

[1216] The server stores profile information in a database and then sends it to other registered devices based on the information synchronization interval. Other devices then store the received profile information in their local data storage. This ensures that users can obtain consistent information regardless of which device they use.

[1217] Step 5: Filtering ads and information

[1218] The server selects the most relevant ads for the user based on profile information in the database and blocks inappropriate ads. The ad list retrieved from the ad server is filtered using the user's interests and sentiment data to display only highly relevant ads. The filtering results are sent as an ad list to smart glasses and other devices.

[1219] Step 6: Product proposals in physical stores

[1220] As users walk through a physical store, smart glasses monitor their gaze and location, displaying information about products they might be interested in in real time based on their profile. For example, if a user shows excitement upon seeing a new gadget, detailed information about that product and related promotions will be displayed on the glasses.

[1221] Step 7: Send a prompt to the generated AI model

[1222] When displaying a specific item, the server sends a prompt to the generating AI model, which then lists potential relevant items based on the user's current sentiment data and profile. The prompt might be something like, "List potential items to display next, based on the user's sentiment data (images showing their reactions and analysis results). Please consider the user's ID, interests, and current sentiment data."

[1223] Step 8: Real-time information display

[1224] Smart glasses receive responses from a generating AI model and update the information displayed to the user in real time. This enables optimal product recommendations tailored to the user's emotions and interests. Users are more likely to check products on the spot and make a purchase.

[1225] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1226] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1227] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1228] [Third Embodiment]

[1229] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1230] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1231] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1232] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1233] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1234] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1235] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1236] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1237] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1238] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1239] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1240] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1241] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. Specific embodiments for realizing this system are described in detail below.

[1242] Creating and managing user profiles

[1243] User: Users create a new account and enter basic information such as their interests and preferences. This information includes, for example, their favorite topics (technology, health, business, etc.).

[1244] Terminal: The terminal (e.g., a smartphone or PC) sends the information entered by the user to the server.

[1245] Server: The server stores the received information in a database and creates a profile. If the user later adds or changes their interests or preferences, the server updates this profile.

[1246] Information synchronization between devices

[1247] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[1248] Terminal: Each terminal sends user actions (such as bookmarking an article) to the server.

[1249] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on their tablet or PC.

[1250] Ad optimization and blocking

[1251] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[1252] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[1253] Users: Users can enjoy a more personalized experience because they only see ads that interest them. They can also add ads they don't want to see to a block list.

[1254] Selecting and filtering information

[1255] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[1256] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. The selected information is then delivered to the user's device.

[1257] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[1258] Specific example

[1259] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[1260] Device (smartphone): Sends an action to add the article to favorites to the server.

[1261] Server: Updates user profiles and interest data, and synchronizes favorites information with other registered devices (e.g., PCs and tablets).

[1262] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles.

[1263] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[1264] Terminal (PC): Sends an operation to add to the blocklist to the server.

[1265] Server: Update the blocklist and consider it for the next ad delivery.

[1266] Device: Controls the display of blocked ads in the future.

[1267] This allows users to receive a consistent and customized information and advertising experience across multiple devices. This system is expected to improve user satisfaction by providing an experience optimized to user needs.

[1268] The following describes the processing flow.

[1269] Creating and managing user profiles

[1270] Step 1:

[1271] User: The user creates a new account and enters basic information such as their name, email address, and interests.

[1272] Step 2:

[1273] Terminal: The terminal (e.g., a smartphone or PC) sends user input information to the server via an HTTP request.

[1274] Step 3:

[1275] Server: The server analyzes the information received and creates a new user profile in the database.

[1276] Step 4:

[1277] Server: The server sends a notification to the device indicating that profiling is complete.

[1278] Step 5:

[1279] Device: The device displays a notification to the user indicating that the profile has been successfully created.

[1280] Information synchronization between devices

[1281] Step 1:

[1282] User: The user adds a new device (e.g., a tablet) and links it to an existing account.

[1283] Step 2:

[1284] Terminal (New Device): The new device sends link information to the server and makes a synchronization request.

[1285] Step 3:

[1286] Server: The server retrieves the user's profile information and prepares the necessary information for the new device.

[1287] Step 4:

[1288] Server: The server sends the information it has prepared to the new device.

[1289] Step 5:

[1290] Device (New Device): The new device applies the information it receives and synchronizes the user's profile.

[1291] Ad optimization and blocking

[1292] Step 1:

[1293] Server: The server selects relevant advertisements based on the user's profile.

[1294] Step 2:

[1295] Server: The server sends a request to the ad server to retrieve a list of the most suitable ads.

[1296] Step 3:

[1297] Ad server: The ad server provides a list of ads that match the user profile.

[1298] Step 4:

[1299] Server: The server sends the received ad list to the user's device.

[1300] Step 5:

[1301] Device: Displays the ad list received by the device to the user.

[1302] Step 6:

[1303] User: The user performs an action to add a specific ad to the block list.

[1304] Step 7:

[1305] Terminal: Sends a request to the server to add the user to the blocklist.

[1306] Step 8:

[1307] Server: The server updates the blocklist and takes it into consideration for the next ad delivery.

[1308] Selecting and filtering information

[1309] Step 1:

[1310] Server: The server collects new articles and blog posts from multiple information sources.

[1311] Step 2:

[1312] Server: Stores collected information in a temporary database.

[1313] Step 3:

[1314] Server: Filters information based on user profiles, selecting only relevant articles.

[1315] Step 4:

[1316] Server: Sends filtered information to the user's terminal.

[1317] Step 5:

[1318] Terminal: Displays filtered information received by the terminal on the viewing screen.

[1319] Step 6:

[1320] User: The user views the displayed information and provides further feedback.

[1321] This ensures users receive a consistent information and advertising experience regardless of the device they use, and they can access personalized services based on their interests.

[1322] (Example 1)

[1323] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1324] Traditional systems offered limited customization based on user interests and preferences, and struggled to synchronize information consistently across multiple devices. Furthermore, they suffered from a poor user experience due to inadequate filtering of inappropriate advertisements and irrelevant information.

[1325] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1326] In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences and storing them in a database; means for synchronizing information based on the profiles among multiple user terminals; means for optimizing advertisements selected based on the profiles and blocking unnecessary advertisements; means for filtering data collected from information sources based on the profiles and eliminating unnecessary information; and means for displaying information customized to the user based on the profiles and interests. This enables consistent information provision and optimized advertisement display that meets the user's needs.

[1327] A "user" refers to an individual who uses a system to receive services customized based on their interests and preferences.

[1328] "Interests and preferences" refers to information that indicates the topics and themes that a user is interested in and particularly interested in.

[1329] A "profile" is a collection of individually customized user information generated based on the user's interests and preferences.

[1330] A "database" is an information management system that stores user profiles and related information, and retrieves, updates, and saves it as needed.

[1331] A "terminal" is a device used by a user to access a system, and includes smartphones, tablets, PCs, and other similar devices.

[1332] "Synchronization" refers to the process of ensuring that information is consistent across multiple user devices, and that user actions and data are reflected consistently.

[1333] "Advertising" refers to commercial promotional messages displayed to users.

[1334] "Optimization" refers to selecting and adjusting ads based on the user's profile to display them most effectively.

[1335] "Filtering" is the process of sorting collected information based on the user's profile and removing irrelevant or unnecessary information.

[1336] "Customized information" refers to information that is tailored to the user's interests and preferences and is therefore valuable to the user.

[1337] "Unnecessary advertising" refers to advertisements that do not match the user's interests and preferences and therefore have no value to the user.

[1338] "Information sources" refer to external websites and databases that provide informational content such as articles and blog posts.

[1339] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. The following describes in detail embodiments for specifically implementing the present invention.

[1340] Creating and managing user profiles

[1341] User: Users create a new account and enter basic information such as their interests and preferences. This information includes, for example, their favorite topics (technology, health, business, etc.).

[1342] Terminal: The terminal (e.g., a smartphone or PC) sends information entered by the user to the server. This transmission is performed using the HTTP POST method.

[1343] Server: The server stores the received information in a database and creates a profile. A database management system such as MySQL is used. If the user later adds or changes their interests or preferences, the server updates this profile.

[1344] Information synchronization between devices

[1345] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[1346] Terminal: Each terminal sends user actions (such as bookmarking an article) to the server.

[1347] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on their tablet or PC.

[1348] Ad optimization and blocking

[1349] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[1350] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[1351] Users: Users can enjoy a more personalized experience because they only see ads that interest them. They can also add ads they don't want to see to a block list.

[1352] Selecting and filtering information

[1353] Server: The server collects articles and blog posts from multiple sources. The collected information is temporarily stored in a database.

[1354] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. Natural language processing (NLP) techniques can be used for this filtering.

[1355] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[1356] Specific example

[1357] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[1358] Device (smartphone): Sends an action to add the article to favorites to the server (e.g., HTTP POST request).

[1359] Server: Receives operation details and updates user profiles and databases. Then, sends synchronization requests to other devices.

[1360] Device (PC or tablet): Receives synchronization requests from the server and updates the displayed content.

[1361] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[1362] Device (PC): Clicking the "Block" icon in the corner of the ad sends that action to the server.

[1363] Server: Update the block list and apply it to future ad delivery.

[1364] Device: Blocked ads will not be displayed the next time you view an ad.

[1365] Example of a prompt

[1366] "Please gather the latest health-related information and provide me with articles filtered to match my profile."

[1367] "The ads I recently blocked have been updated, so I would like them to be reflected in the next ad delivery."

[1368] "Please sync business-related articles you've added to your favorites to other devices."

[1369] In this way, by performing clear processing at each step, a mechanism is built that ensures the entire system functions consistently. This allows for a more personalized experience for the user.

[1370] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1371] Step 1:

[1372] User: Create a new account and enter basic information.

[1373] The user enters the required information (name, email address, interests, and preferred topics) on the application registration screen.

[1374] Input: Basic information about the user's interests and preferences

[1375] Output: User information is temporarily stored on the device.

[1376] Step 2:

[1377] Terminal: Sending user information

[1378] The device (smartphone or PC) sends the entered user information to the server. This transmission uses the HTTP POST method.

[1379] Input: User information stored on the device

[1380] Output: User information is sent to the server.

[1381] Step 3:

[1382] Server: Stores user information and creates profiles.

[1383] The server saves the received user information to the database and creates a new profile. The database management system used is MySQL.

[1384] Input: User information sent to the server

[1385] Output: User profiles stored in the database

[1386] Step 4:

[1387] User: Profile Update

[1388] Users can add or change their interests and preferences in the settings screen as needed.

[1389] Input: New or updated user interest and preference information

[1390] Output: New or updated information temporarily stored on the device.

[1391] Step 5:

[1392] Device: Profile update notification

[1393] The terminal notifies the server of user profile changes. This notification also uses the HTTP POST method.

[1394] Input: New or updated information temporarily stored on the device

[1395] Output: Update information sent to the server

[1396] Step 6:

[1397] Server: Profile Update

[1398] The server updates the user profiles in the database based on the received update information.

[1399] Input: Update information sent to the server

[1400] Output: The updated user profile is saved to the database.

[1401] Step 7:

[1402] User: I want to synchronize information between devices.

[1403] Users use multiple devices such as smartphones, tablets, and PCs, and they want to access the same information on each of them.

[1404] Input: Request for synchronization via user action

[1405] Output: The operation details are temporarily saved on the terminal.

[1406] Step 8:

[1407] Terminal: Sending operation information

[1408] Each device sends user actions (for example, adding an item to favorites) to the server.

[1409] Input: User actions saved on the device

[1410] Output: Operation information sent to the server

[1411] Step 9:

[1412] Server: Stores operation information and sends synchronization requests to other devices.

[1413] The server saves the received operation information to the database and sends synchronization requests to other registered devices.

[1414] Input: Operation information sent to the server

[1415] Output: Operation information stored in the database and synchronization requests sent to other devices.

[1416] Step 10:

[1417] Terminal: Receiving sync requests and updating data.

[1418] Each terminal receives a synchronization request from the server and updates its data.

[1419] Input: Synchronization request received from the server

[1420] Output: Updated terminal data

[1421] Step 11:

[1422] Server: Ad optimization

[1423] The server sends a request to the ad server based on the user's profile to retrieve the most suitable ad list.

[1424] Input: User profile information

[1425] Output: Ad list

[1426] Step 12:

[1427] Server: Sending ad lists

[1428] The server sends the ad list to each user's device.

[1429] Input: Retrieved ad list

[1430] Output: Ad list sent to the device

[1431] Step 13:

[1432] Device: Ad display and blocking

[1433] The device displays an ad list received from the server to the user and blocks unwanted ads. Users may request that ads be blocked.

[1434] Input: Ad list received from the server and user block requests

[1435] Output: Ads displayed and block requests sent to the server

[1436] Step 14:

[1437] Server: Updating the blocklist

[1438] The server receives a block request from a user and updates the block list.

[1439] Input: Block request

[1440] Output: Updated blocklist

[1441] Step 15:

[1442] Server: Information collection

[1443] The server collects articles and blog posts from multiple sources and temporarily stores them in a database.

[1444] Input: Articles and blog posts collected from various sources.

[1445] Output: Information temporarily stored in the database

[1446] Step 16:

[1447] Server: Information filtering

[1448] The server filters the collected information based on user profiles to select the most relevant information. Natural language processing techniques are used for filtering.

[1449] Input: Unfiltered information and user profiles stored in the database

[1450] Output: Filtered information

[1451] Step 17:

[1452] Server: Distribution of filtering information

[1453] The server delivers filtered information to the user's terminal.

[1454] Input: Filtered information

[1455] Output: Filtering information sent to the terminal

[1456] Step 18:

[1457] Device: Display filtering information

[1458] The device displays the received filtering information, making it easy for the user to access.

[1459] Input: Filtering information received from the server

[1460] Output: Filtering information displayed

[1461] (Application Example 1)

[1462] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1463] Traditional advertising and information delivery systems have been insufficient in personalizing users' diverse interests and preferences, making it difficult to provide a consistent user experience across multiple devices. Furthermore, users are often bothered by irrelevant advertisements and unrelated information, leading to decreased user satisfaction. In addition, there has been a lack of integrated solutions for providing customized content utilizing generative AI models.

[1464] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1465] In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences; means for synchronizing information based on the profiles across multiple user devices; means for optimizing advertisements and blocking unwanted advertisements based on the profiles; means for generating prompt statements based on a generative AI model and providing customized content based on the user's activity; and means for enabling the user to synchronize favorite articles across multiple devices and block unwanted advertisements. This makes it possible to provide a consistent and customized information and advertising experience that is tailored to the user's interests and preferences.

[1466] "User interests and preferences" refer to the topics and matters of interest that users are particularly interested in and show interest in.

[1467] A "customized profile" refers to user information and settings that are individually configured based on the user's interests and preferences.

[1468] "Synchronizing information across multiple devices" means sharing the same information across multiple electronic devices owned by a user (such as smartphones, tablets, and personal computers) and keeping them constantly up-to-date.

[1469] "Methods for optimizing ads and blocking unwanted ads" refers to methods and technologies that select the most relevant ads based on a user's profile and remove unwanted or inappropriate ads from those displayed to the user.

[1470] "Filtering relevant information and eliminating unnecessary information" refers to a technology that selects information collected based on the user's profile and provides only the information that is highly valuable to the user.

[1471] A "generative AI model" is a model that uses artificial intelligence to analyze user data and behavioral patterns, and then generates new prompts and content based on the results.

[1472] A "prompt message" is a guiding or instructional message generated by a generative AI model that contains information highly relevant to the user.

[1473] "User activity" refers to all actions and behaviors that a user performs through their device, including records of actions such as search history, browsing history, and applications used.

[1474] "Syncing favorite articles" means sharing articles that users have saved as of particular interest across multiple devices, keeping them always up-to-date.

[1475] "Means of providing customized content" refers to methods and technologies for selecting and delivering the most relevant information and advertisements to users based on their interests and preferences.

[1476] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple devices, optimizes and blocks advertisements, and filters relevant information. Specific embodiments for realizing this system are described in detail below.

[1477] System Configuration

[1478] hardware

[1479] Smartphone (iOS or Android)

[1480] tablet

[1481] PC

[1482] software

[1483] iOS application: Swift

[1484] Android application: Kotlin

[1485] Backend: Node.js, Express.js, MongoDB

[1486] Frontend: React Native

[1487] Creating and managing user profiles

[1488] User: Users create new accounts and enter their interests and preferences. This information includes their favorite topics (e.g., technology, health, business, etc.).

[1489] Terminal: Sends user-entered information to the server.

[1490] Server: The server stores the received information in a database and creates a user profile. If the user later adds or changes their interests or preferences, the server updates this profile.

[1491] Information synchronization between devices

[1492] User: The user uses multiple devices (smartphone, tablet, PC, etc.) and wants to access the same information on each device.

[1493] Terminal: Each terminal sends user actions (e.g., bookmarking an article) to the server.

[1494] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows articles that a user has favorited on their smartphone to be accessed on tablets and PCs as well.

[1495] Ad optimization and blocking

[1496] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[1497] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[1498] Users: They can enjoy a more personalized experience because they only see ads that interest them. Users can also add ads they don't want to see to a block list.

[1499] Information filtering

[1500] Server: The server collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[1501] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. The selected information is then delivered to the user's device.

[1502] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only valuable information.

[1503] Introduction of Generative AI Models

[1504] Server: Uses a generative AI model to generate and provide customized prompt messages to the user based on user activity.

[1505] Specific example:

[1506] When a user searches for health-related articles on their smartphone and adds them to their favorites, that information is sent to the server and synchronized with other devices.

[1507] Example of a prompt:

[1508] "We've confirmed you're interested in health. Why not check out some new, relevant articles?"

[1509] This system allows users to receive consistent and customized information and advertising experiences across multiple devices. Furthermore, by leveraging generative AI models, it enables the delivery of more personalized prompt messages.

[1510] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1511] Step 1:

[1512] User: Create a new account and enter your interests and preferences. This includes your favorite topics (e.g., technology, health, business, etc.).

[1513] Input: Users enter information about their interests and preferences into a form on a smartphone app.

[1514] Output: The entered information is temporarily stored on the device.

[1515] Step 2:

[1516] Terminal: Sends entered information about interests and preferences to the server.

[1517] Input: Information entered into a smartphone app.

[1518] Data processing: Convert form data to JSON format and generate an API request to the server.

[1519] Output: JSON data sent to the server.

[1520] Step 3:

[1521] Server: Stores received information in the database and creates user profiles.

[1522] Input: JSON data sent from the device.

[1523] Data processing: Analyze incoming data and save it to the appropriate table in the database.

[1524] Output: User profile stored in the database.

[1525] Step 4:

[1526] Terminal: Sends information about actions performed on each terminal (e.g., adding an article to favorites) to the server.

[1527] Input: The action taken by a user to add an article to their favorites.

[1528] Data processing: Generate favorites registration data and create API requests to the server.

[1529] Output: Favorite registration data sent to the server.

[1530] Step 5:

[1531] Server: Stores information received from each terminal in a database and sends it as a synchronization request to other registered devices.

[1532] Input: Favorite registration data sent from the device.

[1533] Data processing: Save new favorite information to the database and send a sync request to other devices.

[1534] Output: Synchronization requests sent to each terminal.

[1535] Step 6:

[1536] Terminals: Each terminal updates its favorite articles based on synchronization requests received from the server.

[1537] Input: Synchronization request from the server.

[1538] Data calculation: Update the local database based on a synchronous request.

[1539] Output: Updated favorite articles information.

[1540] Step 7:

[1541] Server: Optimizes ads based on user profiles and blocks unwanted ads.

[1542] Input: User profile data.

[1543] Data processing: Analyze profile data and generate the optimal ad list.

[1544] Output: A list of ads delivered to users.

[1545] Step 8:

[1546] Device: Displays the ad list received from the server and blocks unnecessary ads.

[1547] Input: Ad list received from the server.

[1548] Data processing: Analyze the ad list and separate the ads to display from those to block.

[1549] Output: Advertisements displayed on the user's screen.

[1550] Step 9:

[1551] Server: Collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[1552] Input: Content data obtained from the information source.

[1553] Data processing: Temporarily save collected articles and blog posts to a database.

[1554] Output: Saved content data.

[1555] Step 10:

[1556] Server: Filters information based on the user's profile, selecting only the most relevant information.

[1557] Input: Collected content data and user profile data.

[1558] Data processing: Use filtering algorithms to select only the most relevant information.

[1559] Output: Filtered information list.

[1560] Step 11:

[1561] Terminal: Displays filtered information received from the server.

[1562] Input: List of information from the server.

[1563] Data processing: Analyze the information list and format it for display on the user screen.

[1564] Output: Filtered content displayed on the user screen.

[1565] Step 12:

[1566] Server: Uses a generative AI model to generate and provide customized prompt messages to the user based on user activity.

[1567] Input: User activity data.

[1568] Data processing: Generate prompt statements using a generative AI model.

[1569] Output: The prompt text provided to the user.

[1570] Specific example:

[1571] When a user searches for health-related articles on their smartphone and adds them to their favorites:

[1572] 1. The user adds the article to their favorites (Step 4), and the data is sent from the device to the server.

[1573] 2. The server receives the information, updates the database, and sends a synchronization request to the other devices (Step 5).

[1574] 3. Other devices receive the sync request and update their favorite articles (Step 6).

[1575] Example of a prompt:

[1576] "We've confirmed your interest in health. Would you like to check out some new, relevant articles?"

[1577] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1578] This invention combines a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information with an emotion engine that recognizes user emotions. Specific embodiments for realizing this system are described in detail below.

[1579] Creating and managing user profiles

[1580] User: Users create a new account and enter basic information about their interests, preferences, and feelings. This includes, for example, their favorite topics (technology, health, business, etc.) and how they feel about them.

[1581] Device: The device (e.g., smartphone or PC) sends the emotion data recognized by the emotion engine, along with the information entered by the user, to the server.

[1582] Server: The server analyzes the received information and creates a new user profile in the database. Sentimental data provided by the sentiment engine is also stored in the profile. If the user later adds or changes interests, preferences, or emotions, the server updates this profile.

[1583] Information synchronization between devices

[1584] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[1585] Terminal: Each terminal sends user sentiment data to the server along with the actions the user performs (e.g., adding an article to their favorites).

[1586] Server: The server stores information and sentiment data in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on tablets and PCs, along with the sentiment data from when they were favorited.

[1587] Ad optimization and blocking

[1588] Server: Optimizes ads based on user profiles and sentiment data. Specifically, it selects ads that match the user's interests and emotions, and queries the ad server to obtain the optimal ad list.

[1589] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[1590] Users: Users can enjoy a more personalized experience because they only see ads optimized based on their interests and emotions. They can also add ads they don't want to see to a block list.

[1591] Selecting and filtering information

[1592] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[1593] Server: The server then filters the information based on the user's profile and sentiment data, selecting only the most relevant information. The selected information is then delivered to the user's device.

[1594] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[1595] Specific example

[1596] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[1597] Device (smartphone): The user adds the article to their favorites and sends their emotional data to the server at that time.

[1598] Server: Updates user profiles and sentiment data, and synchronizes favorites and sentiment data with other registered devices (e.g., PCs and tablets).

[1599] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[1600] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[1601] Terminal (PC): Sends the operation of adding to the block list and the corresponding emotion data to the server.

[1602] Server: Update blocklists and sentiment data to consider for future ad delivery.

[1603] Device: Controls the display of blocked ads in the future.

[1604] This allows users to receive consistent, emotionally-driven, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[1605] The following describes the processing flow.

[1606] Creating and managing user profiles

[1607] Step 1:

[1608] User: The user creates a new account and enters initial information such as name, email address, interest categories, and sentiments.

[1609] Step 2:

[1610] Device: The device (e.g., smartphone or PC) sends the information entered by the user and the emotion data recognized by the emotion engine to the server via an HTTP request.

[1611] Step 3:

[1612] Server: The server analyzes the received information and creates a new user profile in the database. Sentiment data is also stored in the profile.

[1613] Step 4:

[1614] Server: The server sends a notification to the device indicating that profiling is complete.

[1615] Step 5:

[1616] Device: The device notifies the user that the profile has been successfully created.

[1617] Information synchronization between devices

[1618] Step 1:

[1619] User: The user adds a new device (e.g., a tablet) and links it to an existing account.

[1620] Step 2:

[1621] Terminal (New Device): The new device sends link information and the user's sentiment data to the server and requests synchronization.

[1622] Step 3:

[1623] Server: The server retrieves user profile information and sentiment data and prepares the necessary information for the new device.

[1624] Step 4:

[1625] Server: The server sends the prepared information and emotional data to the new device.

[1626] Step 5:

[1627] Device (New Device): The new device applies received information and sentiment data, and synchronizes the user's profile.

[1628] Ad optimization and blocking

[1629] Step 1:

[1630] Server: The server selects relevant ads based on the user's profile and sentiment data.

[1631] Step 2:

[1632] Server: The server sends a request to the ad server to retrieve the most suitable ad list.

[1633] Step 3:

[1634] Ad Server: The ad server provides ad lists that match user profiles and sentiment data.

[1635] Step 4:

[1636] Server: The server sends the received ad list to the user's device.

[1637] Step 5:

[1638] Device: Displays the ad list received by the device to the user.

[1639] Step 6:

[1640] User: Users add specific ads to their block list, and their emotional data at that time is also recorded.

[1641] Step 7:

[1642] Terminal: Sends a request to add to the blocklist and sentiment data to the server.

[1643] Step 8:

[1644] Server: The server updates the blocklist and sentiment data, taking this into consideration for the next ad delivery.

[1645] Selecting and filtering information

[1646] Step 1:

[1647] Server: The server collects new articles and blog posts from multiple information sources.

[1648] Step 2:

[1649] Server: Stores collected information in a temporary database.

[1650] Step 3:

[1651] Server: Filters information based on user profiles and sentiment data, selecting only relevant articles.

[1652] Step 4:

[1653] Server: Sends filtered information and sentiment data to the user's device.

[1654] Step 5:

[1655] Terminal: Displays filtered information and sentiment data received by the terminal on the viewing screen.

[1656] Step 6:

[1657] User: The user views the displayed information and records their emotional data at that time.

[1658] This process ensures that users receive a consistent and personalized information and advertising experience regardless of the device they use. Furthermore, by considering user emotions, even higher levels of personalization are possible, leading to improved satisfaction.

[1659] (Example 2)

[1660] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1661] Traditional information recommendation and advertising delivery systems have limitations in terms of customization based on user interests and preferences, and they lack the ability to adjust based on user emotions. Furthermore, they struggle to provide a consistent user experience across multiple devices, and there is a lack of effective means to block unwanted information and advertisements. As a result, user satisfaction is low, and effective information delivery and advertising delivery are not being achieved.

[1662] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences, means for synchronizing information based on the profiles among multiple user devices, means for optimizing advertisements and blocking unwanted advertisements based on the profiles and sentiment data, and means for filtering relevant information and eliminating unwanted information based on the profiles and sentiment data. This enables the consistent provision of information and advertisements across multiple devices that take into account the user's interests and preferences as well as their emotions, and effectively eliminates unwanted information and advertisements.

[1663] A "user" is an individual or legal entity that utilizes the system and provides data about their interests, preferences, and emotions.

[1664] "Interests and preferences" refers to the topics and content that users are interested in, as well as their general tastes for those topics.

[1665] A "customized profile" is a collection of information individually tailored based on a user's interests and preferences, a digital record that reflects the user's characteristics.

[1666] "Emotional data" refers to information that represents the user's emotional state, and includes facial expression data and other emotional indicators analyzed by the emotion engine.

[1667] A "user device" is a hardware device used by a user to input information and interact with a system, and includes smartphones, tablets, and personal computers.

[1668] "Information synchronization" refers to the process of sharing and updating data so that the same information is consistently displayed and used across multiple user devices.

[1669] "Ad optimization" is the process of selecting and displaying ads that are most likely to be of interest to a user, based on their profile and sentiment data.

[1670] "Blocking unwanted ads" is the process of filtering out ads that are not needed to be displayed, based on the user's profile and sentiment data, and preventing them from being shown to the user.

[1671] "Relevant information filtering" is the process of excluding irrelevant information based on the user's profile and sentiment data, and providing only information that is useful to the user.

[1672] This invention provides a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. Furthermore, by incorporating an emotion engine that recognizes user emotions, it is possible to provide more accurate information and deliver advertisements. Specific embodiments for realizing this system are described in detail below.

[1673] Creating and managing user profiles

[1674] User: Users create a new account and enter basic information about their interests, preferences, and feelings. This includes, for example, their favorite topics (technology, health, business, etc.) and how they feel about them.

[1675] Device: The device (e.g., smartphone or computer) sends emotional data recognized by the emotion engine, along with information entered by the user, to the server. This includes software that uses the smartphone's camera and microphone to analyze facial expressions and voice tone.

[1676] Server: The server analyzes the received information and creates a new user profile in the database. It also stores sentiment data provided by the sentiment engine in the profile. If the user later adds or changes interests, preferences, or sentiments, the server updates this profile.

[1677] Information synchronization between devices

[1678] User: The user wants to access the same information on multiple devices (smartphone, tablet, PC, etc.).

[1679] Terminal: Each terminal sends data to the server regarding the actions performed by the user (e.g., bookmarking an article) and the user's emotional state during those actions.

[1680] Server: The server stores information and sentiment data in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on tablets and PCs, along with the sentiment data from when they were favorited.

[1681] Ad optimization and blocking

[1682] Server: Optimizes ads based on user profiles and sentiment data. Specifically, it selects ads that match the user's interests and emotions, and queries the ad server to obtain the optimal ad list.

[1683] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[1684] Users: Users can enjoy a more personalized experience because they only see ads optimized based on their interests and emotions. They can also add ads they don't want to see to a block list.

[1685] Selecting and filtering information

[1686] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[1687] Server: The server then filters the information based on the user's profile and sentiment data, selecting only the most relevant information. The selected information is then delivered to the user's device.

[1688] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[1689] Specific example

[1690] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[1691] Device (smartphone): The user adds the article to their favorites and sends their emotional data to the server at that time.

[1692] Server: Updates user profiles and sentiment data, and synchronizes favorites and sentiment data with other registered devices (e.g., PCs and tablets).

[1693] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[1694] 2. The user decides they do not want to see new fitness ads on their computer and adds them to their block list.

[1695] Terminal (PC): Sends the operation to add to the block list and the corresponding emotion data to the server.

[1696] Server: Update blocklists and sentiment data to consider for future ad delivery.

[1697] Device: Controls the display of blocked ads in the future.

[1698] Examples of prompts for generative AI models

[1699] "This system creates user profiles based on their preferences and emotions, and uses them to optimize various information and advertisements. Articles that users add to their favorites on their smartphones are simultaneously synchronized across other devices, and emotional data is consistently managed. Please explain this process in detail."

[1700] This allows users to receive consistent, emotionally-driven, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[1701] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1702] Step 1:

[1703] User: The user logs into the system and proceeds to a screen where they create a new account. There, they enter basic information about their interests and preferences. The data entered includes, for example, "favorite topics" and "emotional tendencies."

[1704] Input: Topic and sentiment information entered by the user.

[1705] Output: JSON data of the input topic and sentiment information.

[1706] Specific actions: The user selects a topic such as "technology" or "health" and inputs emotions such as "excitement" or "reassurance."

[1707] Step 2:

[1708] Terminal: The terminal (smartphone or computer) sends information entered by the user and emotional data analyzed by the emotion engine to the server. The emotion engine uses the camera and microphone to analyze facial expressions and voice tone.

[1709] Input: User-entered topic and sentiment data, and sentiment analysis data from the sentiment engine.

[1710] Output: Integrated data sent to the server (topic, sentiment information, sentiment analysis data).

[1711] Specific operation: The smartphone analyzes facial expression data collected through its camera in real time and sends it to the server along with topic and emotion data.

[1712] Step 3:

[1713] Server: The server analyzes the received data and creates a new user profile in the database. Sentimental data provided by the sentiment engine is also stored in the profile.

[1714] Input: Integrated data of user topics, sentiment information, and sentiment analysis data.

[1715] Output: New user profile saved in the database.

[1716] Specific operation: The server creates a new entry in the database and sets fields such as "User ID," "Interest Topics," and "Sentiment Data."

[1717] Step 4:

[1718] User: Users want to access the same information on multiple devices. For example, they might add an article to their favorites on their smartphone and then check it later on their computer.

[1719] Input: User actions (adding articles to favorites) and associated sentiment data.

[1720] Output: Operational data and sentiment data as a synchronous request.

[1721] Specific operation: The user taps the "Favorites" button on their smartphone. At this time, the camera captures their facial expression and collects emotion data.

[1722] Step 5:

[1723] Device: The smartphone sends operation data and sentiment data to the server. The transmitted data includes the ID of the article that was operated on and sentiment data.

[1724] Input: Favorite operation data and sentiment data.

[1725] Output: Operational data and sentiment data sent to the server.

[1726] Specific operation: The smartphone sends an API request to the server that includes the "article ID" and "sentiment data".

[1727] Step 6:

[1728] Server: The server stores operation data and emotion data in a database and sends synchronization requests to other registered devices.

[1729] Input: Favorite operation data and sentiment data.

[1730] Output: Data sent to other devices as a sync request.

[1731] Specific operation: The server adds a new "favorites" entry to the database and sends a push notification to the device list.

[1732] Step 7:

[1733] Device (e.g., tablet or PC): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[1734] Input: Synchronized data from the server (article ID and sentiment data).

[1735] Output: Favorite articles and sentiment data updated on your local device.

[1736] Specific action: The tablet receives a notification and adds the new favorite article to its local database.

[1737] Step 8:

[1738] Server: Optimizes ads based on user profiles and sentiment data.

[1739] Input: User profile and sentiment data.

[1740] Output: Optimized ad list.

[1741] Specific operation: The server sends a request to the ad server that includes "user interest topics" and "sentiment data".

[1742] Step 9:

[1743] Device: Displays an optimized ad list received from the server by the device. Unwanted ads are blocked from being displayed.

[1744] Input: Ad list received from the server.

[1745] Output: Display of filtered ad list.

[1746] Specific operation: The device passes ad data to the display component, which filters and displays ads that are in the blocklist.

[1747] Step 10:

[1748] User: Add ads that the user does not want to see to a block list.

[1749] Input: User block actions and sentiment data.

[1750] Output: Blocklist update request sent to the server.

[1751] Specific action: The user clicks the "block" button on the ad, and this action and sentiment data are sent to the server.

[1752] Step 11:

[1753] Server: Update blocklists and sentiment data to consider for future ad delivery.

[1754] Input: Blocklist update request and sentiment data.

[1755] Output: Updated blocklist.

[1756] Specific action: The server updates the database and activates the blocklist.

[1757] Step 12:

[1758] Device: Controls the display of blocked ads in the future.

[1759] Input: Updated blocklist.

[1760] Output: Display of filtered ad list.

[1761] Specific action: The device removes blocked ads from the ad list and displays a new list.

[1762] Step 13:

[1763] Server: The server collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[1764] Input: Information source (RSS feed, web scraping, etc.).

[1765] Output: Articles and blog posts saved as temporary data.

[1766] Specific operation: The server analyzes information obtained from RSS feeds and web scraping and stores it in a temporary table.

[1767] Step 14:

[1768] Server: The server filters information based on the user's profile and sentiment data, selecting only the most relevant information.

[1769] Input: Articles, blog posts, temporary data.

[1770] Output: Filtered, useful informational data.

[1771] Specific operation: The server uses filtering rules and machine learning models to select relevant information.

[1772] Step 15:

[1773] Terminal: Displays filtered information received by the terminal from the server.

[1774] Input: Filtered, useful informational data.

[1775] Output: Filtered information displayed on the device.

[1776] Specific operation: The smartphone retrieves a new list of information and displays it in the UI component.

[1777] This allows users to receive consistent, emotion-based, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[1778] (Application Example 2)

[1779] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1780] Traditional information distribution systems provided information based on user interests and preferences, but they were insufficient in terms of real-time product recommendations and advertising optimization based on user emotions. Furthermore, no systems existed that took emotional data into account when synchronizing information across multiple devices. In addition, there was a lack of means to individually optimize the in-store shopping experience. As a result, users experienced inconsistent experiences, making it difficult to increase their satisfaction.

[1781] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences; means for synchronizing information based on the profiles among multiple user devices; means for optimizing advertisements and blocking unwanted advertisements based on the profiles; means for filtering relevant information and eliminating unnecessary information based on the profiles; means for making product suggestions in accordance with the user's interests and emotions in physical stores using an emotion engine that recognizes the user's emotions; and means for displaying product suggestions based on the profile and emotion data in real time using smart glasses. As a result, users can receive product suggestions that match their feelings, their shopping experience in physical stores is individually optimized, and their satisfaction is increased.

[1782] "User" refers to an individual or group that uses the system.

[1783] "Interests and preferences" refers to information that indicates a user's tastes in specific topics or products.

[1784] A "customized profile" refers to a set of data created individually based on a user's interests, preferences, and sentiment data.

[1785] "Means of synchronizing information" refers to methods for matching profile-based information across multiple user devices.

[1786] "Ad optimization" refers to the act of selecting and delivering the most relevant ads based on the user's profile.

[1787] "Methods of blocking ads" refer to methods of preventing the display of ads that users deem unnecessary or inappropriate.

[1788] "Filtering relevant information" refers to the act of selecting only information that is valuable to the user based on their profile.

[1789] An "emotion engine" refers to technology that recognizes and analyzes emotions from a user's facial expressions and voice.

[1790] A "physical store" refers to a commercial facility that provides goods and services in a physical location.

[1791] "Product recommendation" refers to the act of recommending highly relevant products based on the user's interests and feelings.

[1792] "Smart glasses" refer to glasses-type devices worn by users that display information and collect emotional data.

[1793] "Real-time display methods" refer to methods of presenting information instantly based on the user's current actions and status.

[1794] This invention relates to a system that creates individually customized profiles based on a user's interests, preferences, and emotions, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. This system utilizes an emotion engine that recognizes the user's emotions and smart glasses, particularly to optimize the in-store shopping experience.

[1795] Creating and managing user profiles

[1796] The server creates a profile based on the user's interests and preferences and stores it in a database. Emotional data entered by the user through smart glasses is also added to the profile. An emotion engine is used to recognize emotions from the user's facial expressions and voice and update the profile accordingly. The data on interests and preferences includes, for example, favorite topics and product categories (technology, health, business, etc.) and the emotions associated with them.

[1797] Information synchronization between devices

[1798] The server stores user actions (such as adding a product to their favorites) and corresponding emotional data in a database, and synchronizes this data with other registered devices (such as smartphones and tablets). If a user expresses positive feelings towards a particular product using smart glasses, that data is sent to the server and immediately reflected on other devices.

[1799] Ad optimization and blocking

[1800] The server selects the most relevant ads for the user based on their profile and sentiment data. Inappropriate ads are blocked as needed. For example, if a user decides they do not want to see a particular ad, it is added to a block list along with its sentiment data. Blocked ads will not be displayed to the user in the future.

[1801] Selecting and filtering information

[1802] The server collects articles and blog posts from multiple information sources and filters the information based on the user's profile and sentiment data. Smart glasses display information that is relevant to the user in real time. This allows users to easily access information that is valuable to them.

[1803] Applications in physical stores

[1804] Smart glasses are used to recognize a user's emotions towards products in a physical store. For example, if a user is excited when they see a new technology gadget, that emotional data is sent to a server and added to their profile. The next time the user visits a similar store, they will be shown product suggestions based on their emotions, encouraging them to make a purchase.

[1805] Specific example

[1806] In one specific application, when a user wears smart glasses and walks around a physical store, if they smile when they see a particular product, that emotion data is sent to a server. Based on this data, the server displays relevant products and promotions on the smart glasses in real time.

[1807] Examples of prompts to input into a generative AI model

[1808] "Based on the user's emotional data (images showing their reactions and analysis results), please list potential items to display next. Consider the user's ID, interests, and current emotional data."

[1809] Thus, the present invention uses user profiles and emotional data to synchronize information across devices and optimize the in-store shopping experience. This allows users to obtain a consistent and personalized experience.

[1810] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1811] Step 1: Enter the user's interests and preferences.

[1812] Users input their interests and preferences, such as specific topics or product categories, through an interface built into their smart glasses. This input data is sent from the smart glasses to a server. The input data is in string format and includes topics and categories of interest.

[1813] Step 2: Collecting emotional data

[1814] The device (smart glasses) uses its built-in camera and microphone to capture the user's facial expressions and voice. This data is analyzed by an emotion engine and extracted as the user's emotion data. This emotion data includes emotion labels such as "joy" and "surprise" and their intensity.

[1815] Step 3: Create a profile

[1816] The server creates a profile based on the user's interest and sentiment data. This profile includes the user's interests and their emotional responses to those interests. The profile data is stored in a database.

[1817] Step 4: Information synchronization

[1818] The server stores profile information in a database and then sends it to other registered devices based on the information synchronization interval. Other devices then store the received profile information in their local data storage. This ensures that users can obtain consistent information regardless of which device they use.

[1819] Step 5: Filtering ads and information

[1820] The server selects the most relevant ads for the user based on profile information in the database and blocks inappropriate ads. The ad list retrieved from the ad server is filtered using the user's interests and sentiment data to display only highly relevant ads. The filtering results are sent as an ad list to smart glasses and other devices.

[1821] Step 6: Product proposals in physical stores

[1822] As users walk through a physical store, smart glasses monitor their gaze and location, displaying information about products they might be interested in in real time based on their profile. For example, if a user shows excitement upon seeing a new gadget, detailed information about that product and related promotions will be displayed on the glasses.

[1823] Step 7: Send a prompt to the generated AI model

[1824] When displaying a specific item, the server sends a prompt to the generating AI model, which then lists potential relevant items based on the user's current sentiment data and profile. The prompt might be something like, "List potential items to display next, based on the user's sentiment data (images showing their reactions and analysis results). Please consider the user's ID, interests, and current sentiment data."

[1825] Step 8: Real-time information display

[1826] Smart glasses receive responses from a generating AI model and update the information displayed to the user in real time. This enables optimal product recommendations tailored to the user's emotions and interests. Users are more likely to check products on the spot and make a purchase.

[1827] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1828] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1829] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1830] [Fourth Embodiment]

[1831] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1832] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1833] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1834] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1835] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1836] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1837] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1838] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1839] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1840] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1841] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1842] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1843] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1844] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. Specific embodiments for realizing this system are described in detail below.

[1845] Creating and managing user profiles

[1846] User: Users create a new account and enter basic information such as their interests and preferences. This information includes, for example, their favorite topics (technology, health, business, etc.).

[1847] Terminal: The terminal (e.g., a smartphone or PC) sends the information entered by the user to the server.

[1848] Server: The server stores the received information in a database and creates a profile. If the user later adds or changes their interests or preferences, the server updates this profile.

[1849] Information synchronization between devices

[1850] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[1851] Terminal: Each terminal sends user actions (such as bookmarking an article) to the server.

[1852] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on their tablet or PC.

[1853] Ad optimization and blocking

[1854] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[1855] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[1856] Users: Users can enjoy a more personalized experience because they only see ads that interest them. They can also add ads they don't want to see to a block list.

[1857] Selecting and filtering information

[1858] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[1859] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. The selected information is then delivered to the user's device.

[1860] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[1861] Specific example

[1862] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[1863] Device (smartphone): Sends an action to add the article to favorites to the server.

[1864] Server: Updates user profiles and interest data, and synchronizes favorites information with other registered devices (e.g., PCs and tablets).

[1865] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles.

[1866] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[1867] Terminal (PC): Sends an operation to add to the blocklist to the server.

[1868] Server: Update the blocklist and consider it for the next ad delivery.

[1869] Device: Controls the display of blocked ads in the future.

[1870] This allows users to receive a consistent and customized information and advertising experience across multiple devices. This system is expected to improve user satisfaction by providing an experience optimized to user needs.

[1871] The following describes the processing flow.

[1872] Creating and managing user profiles

[1873] Step 1:

[1874] User: The user creates a new account and enters basic information such as their name, email address, and interests.

[1875] Step 2:

[1876] Terminal: The terminal (e.g., a smartphone or PC) sends user input information to the server via an HTTP request.

[1877] Step 3:

[1878] Server: The server analyzes the information received and creates a new user profile in the database.

[1879] Step 4:

[1880] Server: The server sends a notification to the device indicating that profiling is complete.

[1881] Step 5:

[1882] Device: The device displays a notification to the user indicating that the profile has been successfully created.

[1883] Information synchronization between devices

[1884] Step 1:

[1885] User: The user adds a new device (e.g., a tablet) and links it to an existing account.

[1886] Step 2:

[1887] Terminal (New Device): The new device sends link information to the server and makes a synchronization request.

[1888] Step 3:

[1889] Server: The server retrieves the user's profile information and prepares the necessary information for the new device.

[1890] Step 4:

[1891] Server: The server sends the information it has prepared to the new device.

[1892] Step 5:

[1893] Device (New Device): The new device applies the information it receives and synchronizes the user's profile.

[1894] Ad optimization and blocking

[1895] Step 1:

[1896] Server: The server selects relevant advertisements based on the user's profile.

[1897] Step 2:

[1898] Server: The server sends a request to the ad server to retrieve a list of the most suitable ads.

[1899] Step 3:

[1900] Ad server: The ad server provides a list of ads that match the user profile.

[1901] Step 4:

[1902] Server: The server sends the received ad list to the user's device.

[1903] Step 5:

[1904] Device: Displays the ad list received by the device to the user.

[1905] Step 6:

[1906] User: The user performs an action to add a specific ad to the block list.

[1907] Step 7:

[1908] Terminal: Sends a request to the server to add the user to the blocklist.

[1909] Step 8:

[1910] Server: The server updates the blocklist and takes it into consideration for the next ad delivery.

[1911] Selecting and filtering information

[1912] Step 1:

[1913] Server: The server collects new articles and blog posts from multiple information sources.

[1914] Step 2:

[1915] Server: Stores collected information in a temporary database.

[1916] Step 3:

[1917] Server: Filters information based on user profiles, selecting only relevant articles.

[1918] Step 4:

[1919] Server: Sends filtered information to the user's terminal.

[1920] Step 5:

[1921] Terminal: Displays filtered information received by the terminal on the viewing screen.

[1922] Step 6:

[1923] User: The user views the displayed information and provides further feedback.

[1924] This ensures users receive a consistent information and advertising experience regardless of the device they use, and they can access personalized services based on their interests.

[1925] (Example 1)

[1926] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1927] Traditional systems offered limited customization based on user interests and preferences, and struggled to synchronize information consistently across multiple devices. Furthermore, they suffered from a poor user experience due to inadequate filtering of inappropriate advertisements and irrelevant information.

[1928] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1929] In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences and storing them in a database; means for synchronizing information based on the profiles among multiple user terminals; means for optimizing advertisements selected based on the profiles and blocking unnecessary advertisements; means for filtering data collected from information sources based on the profiles and eliminating unnecessary information; and means for displaying information customized to the user based on the profiles and interests. This enables consistent information provision and optimized advertisement display that meets the user's needs.

[1930] A "user" refers to an individual who uses a system to receive services customized based on their interests and preferences.

[1931] "Interests and preferences" refers to information that indicates the topics and themes that a user is interested in and particularly interested in.

[1932] A "profile" is a collection of individually customized user information generated based on the user's interests and preferences.

[1933] A "database" is an information management system that stores user profiles and related information, and retrieves, updates, and saves it as needed.

[1934] A "terminal" is a device used by a user to access a system, and includes smartphones, tablets, PCs, and other similar devices.

[1935] "Synchronization" refers to the process of ensuring that information is consistent across multiple user devices, and that user actions and data are reflected consistently.

[1936] "Advertising" refers to commercial promotional messages displayed to users.

[1937] "Optimization" refers to selecting and adjusting ads based on the user's profile to display them most effectively.

[1938] "Filtering" is the process of sorting collected information based on the user's profile and removing irrelevant or unnecessary information.

[1939] "Customized information" refers to information that is tailored to the user's interests and preferences and is therefore valuable to the user.

[1940] "Unnecessary advertising" refers to advertisements that do not match the user's interests and preferences and therefore have no value to the user.

[1941] "Information sources" refer to external websites and databases that provide informational content such as articles and blog posts.

[1942] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. The following describes in detail embodiments for specifically implementing the present invention.

[1943] Creating and managing user profiles

[1944] User: Users create a new account and enter basic information such as their interests and preferences. This information includes, for example, their favorite topics (technology, health, business, etc.).

[1945] Terminal: The terminal (e.g., a smartphone or PC) sends information entered by the user to the server. This transmission is performed using the HTTP POST method.

[1946] Server: The server stores the received information in a database and creates a profile. A database management system such as MySQL is used. If the user later adds or changes their interests or preferences, the server updates this profile.

[1947] Information synchronization between devices

[1948] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[1949] Terminal: Each terminal sends user actions (such as bookmarking an article) to the server.

[1950] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on their tablet or PC.

[1951] Ad optimization and blocking

[1952] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[1953] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[1954] Users: Users can enjoy a more personalized experience because they only see ads that interest them. They can also add ads they don't want to see to a block list.

[1955] Selecting and filtering information

[1956] Server: The server collects articles and blog posts from multiple sources. The collected information is temporarily stored in a database.

[1957] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. Natural language processing (NLP) techniques can be used for this filtering.

[1958] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[1959] Specific example

[1960] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[1961] Device (smartphone): Sends an action to add the article to favorites to the server (e.g., HTTP POST request).

[1962] Server: Receives operation details and updates user profiles and databases. Then, sends synchronization requests to other devices.

[1963] Device (PC or tablet): Receives synchronization requests from the server and updates the displayed content.

[1964] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[1965] Device (PC): Clicking the "Block" icon in the corner of the ad sends that action to the server.

[1966] Server: Update the block list and apply it to future ad delivery.

[1967] Device: Blocked ads will not be displayed the next time you view an ad.

[1968] Example of a prompt

[1969] "Please gather the latest health-related information and provide me with articles filtered to match my profile."

[1970] "The ads I recently blocked have been updated, so I would like them to be reflected in the next ad delivery."

[1971] "Please sync business-related articles you've added to your favorites to other devices."

[1972] In this way, by performing clear processing at each step, a mechanism is built that ensures the entire system functions consistently. This allows for a more personalized experience for the user.

[1973] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1974] Step 1:

[1975] User: Create a new account and enter basic information.

[1976] The user enters the required information (name, email address, interests, and preferred topics) on the application registration screen.

[1977] Input: Basic information about the user's interests and preferences

[1978] Output: User information is temporarily stored on the device.

[1979] Step 2:

[1980] Terminal: Sending user information

[1981] The device (smartphone or PC) sends the entered user information to the server. This transmission uses the HTTP POST method.

[1982] Input: User information stored on the device

[1983] Output: User information is sent to the server.

[1984] Step 3:

[1985] Server: Stores user information and creates profiles.

[1986] The server saves the received user information to the database and creates a new profile. The database management system used is MySQL.

[1987] Input: User information sent to the server

[1988] Output: User profiles stored in the database

[1989] Step 4:

[1990] User: Profile Update

[1991] Users can add or change their interests and preferences in the settings screen as needed.

[1992] Input: New or updated user interest and preference information

[1993] Output: New or updated information temporarily stored on the device.

[1994] Step 5:

[1995] Device: Profile update notification

[1996] The terminal notifies the server of user profile changes. This notification also uses the HTTP POST method.

[1997] Input: New or updated information temporarily stored on the device

[1998] Output: Update information sent to the server

[1999] Step 6:

[2000] Server: Profile Update

[2001] The server updates the user profiles in the database based on the received update information.

[2002] Input: Update information sent to the server

[2003] Output: The updated user profile is saved to the database.

[2004] Step 7:

[2005] User: I want to synchronize information between devices.

[2006] Users use multiple devices such as smartphones, tablets, and PCs, and they want to access the same information on each of them.

[2007] Input: Request for synchronization via user action

[2008] Output: The operation details are temporarily saved on the terminal.

[2009] Step 8:

[2010] Terminal: Sending operation information

[2011] Each device sends user actions (for example, adding an item to favorites) to the server.

[2012] Input: User actions saved on the device

[2013] Output: Operation information sent to the server

[2014] Step 9:

[2015] Server: Stores operation information and sends synchronization requests to other devices.

[2016] The server saves the received operation information to the database and sends synchronization requests to other registered devices.

[2017] Input: Operation information sent to the server

[2018] Output: Operation information stored in the database and synchronization requests sent to other devices.

[2019] Step 10:

[2020] Terminal: Receiving sync requests and updating data.

[2021] Each terminal receives a synchronization request from the server and updates its data.

[2022] Input: Synchronization request received from the server

[2023] Output: Updated terminal data

[2024] Step 11:

[2025] Server: Ad optimization

[2026] The server sends a request to the ad server based on the user's profile to retrieve the most suitable ad list.

[2027] Input: User profile information

[2028] Output: Ad list

[2029] Step 12:

[2030] Server: Sending ad lists

[2031] The server sends the ad list to each user's device.

[2032] Input: Retrieved ad list

[2033] Output: Ad list sent to the device

[2034] Step 13:

[2035] Device: Ad display and blocking

[2036] The device displays an ad list received from the server to the user and blocks unwanted ads. Users may request that ads be blocked.

[2037] Input: Ad list received from the server and user block requests

[2038] Output: Ads displayed and block requests sent to the server

[2039] Step 14:

[2040] Server: Updating the blocklist

[2041] The server receives a block request from a user and updates the block list.

[2042] Input: Block request

[2043] Output: Updated blocklist

[2044] Step 15:

[2045] Server: Information collection

[2046] The server collects articles and blog posts from multiple sources and temporarily stores them in a database.

[2047] Input: Articles and blog posts collected from various sources.

[2048] Output: Information temporarily stored in the database

[2049] Step 16:

[2050] Server: Information filtering

[2051] The server filters the collected information based on user profiles to select the most relevant information. Natural language processing techniques are used for filtering.

[2052] Input: Unfiltered information and user profiles stored in the database

[2053] Output: Filtered information

[2054] Step 17:

[2055] Server: Distribution of filtering information

[2056] The server delivers filtered information to the user's terminal.

[2057] Input: Filtered information

[2058] Output: Filtering information sent to the terminal

[2059] Step 18:

[2060] Device: Display filtering information

[2061] The device displays the received filtering information, making it easy for the user to access.

[2062] Input: Filtering information received from the server

[2063] Output: Filtering information displayed

[2064] (Application Example 1)

[2065] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2066] Traditional advertising and information delivery systems have been insufficient in personalizing users' diverse interests and preferences, making it difficult to provide a consistent user experience across multiple devices. Furthermore, users are often bothered by irrelevant advertisements and unrelated information, leading to decreased user satisfaction. In addition, there has been a lack of integrated solutions for providing customized content utilizing generative AI models.

[2067] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[2068] In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences; means for synchronizing information based on the profiles across multiple user devices; means for optimizing advertisements and blocking unwanted advertisements based on the profiles; means for generating prompt statements based on a generative AI model and providing customized content based on the user's activity; and means for enabling the user to synchronize favorite articles across multiple devices and block unwanted advertisements. This makes it possible to provide a consistent and customized information and advertising experience that is tailored to the user's interests and preferences.

[2069] "User interests and preferences" refer to the topics and matters of interest that users are particularly interested in and show interest in.

[2070] A "customized profile" refers to user information and settings that are individually configured based on the user's interests and preferences.

[2071] "Synchronizing information across multiple devices" means sharing the same information across multiple electronic devices owned by a user (such as smartphones, tablets, and personal computers) and keeping them constantly up-to-date.

[2072] "Methods for optimizing ads and blocking unwanted ads" refers to methods and technologies that select the most relevant ads based on a user's profile and remove unwanted or inappropriate ads from those displayed to the user.

[2073] "Filtering relevant information and eliminating unnecessary information" refers to a technology that selects information collected based on the user's profile and provides only the information that is highly valuable to the user.

[2074] A "generative AI model" is a model that uses artificial intelligence to analyze user data and behavioral patterns, and then generates new prompts and content based on the results.

[2075] A "prompt message" is a guiding or instructional message generated by a generative AI model that contains information highly relevant to the user.

[2076] "User activity" refers to all actions and behaviors that a user performs through their device, including records of actions such as search history, browsing history, and applications used.

[2077] "Syncing favorite articles" means sharing articles that users have saved as of particular interest across multiple devices, keeping them always up-to-date.

[2078] "Means of providing customized content" refers to methods and technologies for selecting and delivering the most relevant information and advertisements to users based on their interests and preferences.

[2079] The present invention is a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple devices, optimizes and blocks advertisements, and filters relevant information. Specific embodiments for realizing this system are described in detail below.

[2080] System Configuration

[2081] hardware

[2082] Smartphone (iOS or Android)

[2083] tablet

[2084] PC

[2085] software

[2086] iOS application: Swift

[2087] Android application: Kotlin

[2088] Backend: Node.js, Express.js, MongoDB

[2089] Frontend: React Native

[2090] Creating and managing user profiles

[2091] User: Users create new accounts and enter their interests and preferences. This information includes their favorite topics (e.g., technology, health, business, etc.).

[2092] Terminal: Sends user-entered information to the server.

[2093] Server: The server stores the received information in a database and creates a user profile. If the user later adds or changes their interests or preferences, the server updates this profile.

[2094] Information synchronization between devices

[2095] User: The user uses multiple devices (smartphone, tablet, PC, etc.) and wants to access the same information on each device.

[2096] Terminal: Each terminal sends user actions (e.g., bookmarking an article) to the server.

[2097] Server: The server stores the received information in a database and sends it as a synchronization request to other registered devices. This allows articles that a user has favorited on their smartphone to be accessed on tablets and PCs as well.

[2098] Ad optimization and blocking

[2099] Server: Optimizes ads based on user profiles. Specifically, it selects ads that match the user's interests and queries the ad server to obtain the most suitable ad list.

[2100] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[2101] Users: They can enjoy a more personalized experience because they only see ads that interest them. Users can also add ads they don't want to see to a block list.

[2102] Information filtering

[2103] Server: The server collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[2104] Server: The server then filters the information based on the user's profile, selecting only the most relevant information. The selected information is then delivered to the user's device.

[2105] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only valuable information.

[2106] Introduction of Generative AI Models

[2107] Server: Uses a generative AI model to generate and provide customized prompt messages to the user based on user activity.

[2108] Specific example:

[2109] When a user searches for health-related articles on their smartphone and adds them to their favorites, that information is sent to the server and synchronized with other devices.

[2110] Example of a prompt:

[2111] "We've confirmed you're interested in health. Why not check out some new, relevant articles?"

[2112] This system allows users to receive consistent and customized information and advertising experiences across multiple devices. Furthermore, by leveraging generative AI models, it enables the delivery of more personalized prompt messages.

[2113] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[2114] Step 1:

[2115] User: Create a new account and enter your interests and preferences. This includes your favorite topics (e.g., technology, health, business, etc.).

[2116] Input: Users enter information about their interests and preferences into a form on a smartphone app.

[2117] Output: The entered information is temporarily stored on the device.

[2118] Step 2:

[2119] Terminal: Sends entered information about interests and preferences to the server.

[2120] Input: Information entered into a smartphone app.

[2121] Data processing: Convert form data to JSON format and generate an API request to the server.

[2122] Output: JSON data sent to the server.

[2123] Step 3:

[2124] Server: Stores received information in the database and creates user profiles.

[2125] Input: JSON data sent from the device.

[2126] Data processing: Analyze incoming data and save it to the appropriate table in the database.

[2127] Output: User profile stored in the database.

[2128] Step 4:

[2129] Terminal: Sends information about actions performed on each terminal (e.g., adding an article to favorites) to the server.

[2130] Input: The action taken by a user to add an article to their favorites.

[2131] Data processing: Generate favorites registration data and create API requests to the server.

[2132] Output: Favorite registration data sent to the server.

[2133] Step 5:

[2134] Server: Stores information received from each terminal in a database and sends it as a synchronization request to other registered devices.

[2135] Input: Favorite registration data sent from the device.

[2136] Data processing: Save new favorite information to the database and send a sync request to other devices.

[2137] Output: Synchronization requests sent to each terminal.

[2138] Step 6:

[2139] Terminals: Each terminal updates its favorite articles based on synchronization requests received from the server.

[2140] Input: Synchronization request from the server.

[2141] Data calculation: Update the local database based on a synchronous request.

[2142] Output: Updated favorite articles information.

[2143] Step 7:

[2144] Server: Optimizes ads based on user profiles and blocks unwanted ads.

[2145] Input: User profile data.

[2146] Data processing: Analyze profile data and generate the optimal ad list.

[2147] Output: A list of ads delivered to users.

[2148] Step 8:

[2149] Device: Displays the ad list received from the server and blocks unnecessary ads.

[2150] Input: Ad list received from the server.

[2151] Data processing: Analyze the ad list and separate the ads to display from those to block.

[2152] Output: Advertisements displayed on the user's screen.

[2153] Step 9:

[2154] Server: Collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[2155] Input: Content data obtained from the information source.

[2156] Data processing: Temporarily save collected articles and blog posts to a database.

[2157] Output: Saved content data.

[2158] Step 10:

[2159] Server: Filters information based on the user's profile, selecting only the most relevant information.

[2160] Input: Collected content data and user profile data.

[2161] Data processing: Use filtering algorithms to select only the most relevant information.

[2162] Output: Filtered information list.

[2163] Step 11:

[2164] Terminal: Displays filtered information received from the server.

[2165] Input: List of information from the server.

[2166] Data processing: Analyze the information list and format it for display on the user screen.

[2167] Output: Filtered content displayed on the user screen.

[2168] Step 12:

[2169] Server: Uses a generative AI model to generate and provide customized prompt messages to the user based on user activity.

[2170] Input: User activity data.

[2171] Data processing: Generate prompt statements using a generative AI model.

[2172] Output: The prompt text provided to the user.

[2173] Specific example:

[2174] When a user searches for health-related articles on their smartphone and adds them to their favorites:

[2175] 1. The user adds the article to their favorites (Step 4), and the data is sent from the device to the server.

[2176] 2. The server receives the information, updates the database, and sends a synchronization request to the other devices (Step 5).

[2177] 3. Other devices receive the sync request and update their favorite articles (Step 6).

[2178] Example of a prompt:

[2179] "We've confirmed your interest in health. Would you like to check out some new, relevant articles?"

[2180] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[2181] This invention combines a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information with an emotion engine that recognizes user emotions. Specific embodiments for realizing this system are described in detail below.

[2182] Creating and managing user profiles

[2183] User: Users create a new account and enter basic information about their interests, preferences, and feelings. This includes, for example, their favorite topics (technology, health, business, etc.) and how they feel about them.

[2184] Device: The device (e.g., smartphone or PC) sends the emotion data recognized by the emotion engine, along with the information entered by the user, to the server.

[2185] Server: The server analyzes the received information and creates a new user profile in the database. Sentimental data provided by the sentiment engine is also stored in the profile. If the user later adds or changes interests, preferences, or emotions, the server updates this profile.

[2186] Information synchronization between devices

[2187] User: When using multiple devices (smartphone, tablet, PC, etc.), the user wants to access the same information on each device.

[2188] Terminal: Each terminal sends user sentiment data to the server along with the actions the user performs (e.g., adding an article to their favorites).

[2189] Server: The server stores information and sentiment data in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on tablets and PCs, along with the sentiment data from when they were favorited.

[2190] Ad optimization and blocking

[2191] Server: Optimizes ads based on user profiles and sentiment data. Specifically, it selects ads that match the user's interests and emotions, and queries the ad server to obtain the optimal ad list.

[2192] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[2193] Users: Users can enjoy a more personalized experience because they only see ads optimized based on their interests and emotions. They can also add ads they don't want to see to a block list.

[2194] Selecting and filtering information

[2195] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[2196] Server: The server then filters the information based on the user's profile and sentiment data, selecting only the most relevant information. The selected information is then delivered to the user's device.

[2197] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[2198] Specific example

[2199] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[2200] Device (smartphone): The user adds the article to their favorites and sends their emotional data to the server at that time.

[2201] Server: Updates user profiles and sentiment data, and synchronizes favorites and sentiment data with other registered devices (e.g., PCs and tablets).

[2202] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[2203] 2. The user decides they do not want to see new fitness ads on their PC and adds them to their block list.

[2204] Terminal (PC): Sends the operation of adding to the block list and the corresponding emotion data to the server.

[2205] Server: Update blocklists and sentiment data to consider for future ad delivery.

[2206] Device: Controls the display of blocked ads in the future.

[2207] This allows users to receive consistent, emotionally-driven, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[2208] The following describes the processing flow.

[2209] Creating and managing user profiles

[2210] Step 1:

[2211] User: The user creates a new account and enters initial information such as name, email address, interest categories, and sentiments.

[2212] Step 2:

[2213] Device: The device (e.g., smartphone or PC) sends the information entered by the user and the emotion data recognized by the emotion engine to the server via an HTTP request.

[2214] Step 3:

[2215] Server: The server analyzes the received information and creates a new user profile in the database. Sentiment data is also stored in the profile.

[2216] Step 4:

[2217] Server: The server sends a notification to the device indicating that profiling is complete.

[2218] Step 5:

[2219] Device: The device notifies the user that the profile has been successfully created.

[2220] Information synchronization between devices

[2221] Step 1:

[2222] User: The user adds a new device (e.g., a tablet) and links it to an existing account.

[2223] Step 2:

[2224] Terminal (New Device): The new device sends link information and the user's sentiment data to the server and requests synchronization.

[2225] Step 3:

[2226] Server: The server retrieves user profile information and sentiment data and prepares the necessary information for the new device.

[2227] Step 4:

[2228] Server: The server sends the prepared information and emotional data to the new device.

[2229] Step 5:

[2230] Device (New Device): The new device applies received information and sentiment data, and synchronizes the user's profile.

[2231] Ad optimization and blocking

[2232] Step 1:

[2233] Server: The server selects relevant ads based on the user's profile and sentiment data.

[2234] Step 2:

[2235] Server: The server sends a request to the ad server to retrieve the most suitable ad list.

[2236] Step 3:

[2237] Ad Server: The ad server provides ad lists that match user profiles and sentiment data.

[2238] Step 4:

[2239] Server: The server sends the received ad list to the user's device.

[2240] Step 5:

[2241] Device: Displays the ad list received by the device to the user.

[2242] Step 6:

[2243] User: Users add specific ads to their block list, and their emotional data at that time is also recorded.

[2244] Step 7:

[2245] Terminal: Sends a request to add to the blocklist and sentiment data to the server.

[2246] Step 8:

[2247] Server: The server updates the blocklist and sentiment data, taking this into consideration for the next ad delivery.

[2248] Selecting and filtering information

[2249] Step 1:

[2250] Server: The server collects new articles and blog posts from multiple information sources.

[2251] Step 2:

[2252] Server: Stores collected information in a temporary database.

[2253] Step 3:

[2254] Server: Filters information based on user profiles and sentiment data, selecting only relevant articles.

[2255] Step 4:

[2256] Server: Sends filtered information and sentiment data to the user's device.

[2257] Step 5:

[2258] Terminal: Displays filtered information and sentiment data received by the terminal on the viewing screen.

[2259] Step 6:

[2260] User: The user views the displayed information and records their emotional data at that time.

[2261] This process ensures that users receive a consistent and personalized information and advertising experience regardless of the device they use. Furthermore, by considering user emotions, even higher levels of personalization are possible, leading to improved satisfaction.

[2262] (Example 2)

[2263] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2264] Traditional information recommendation and advertising delivery systems have limitations in terms of customization based on user interests and preferences, and they lack the ability to adjust based on user emotions. Furthermore, they struggle to provide a consistent user experience across multiple devices, and there is a lack of effective means to block unwanted information and advertisements. As a result, user satisfaction is low, and effective information delivery and advertising delivery are not being achieved.

[2265] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences, means for synchronizing information based on the profiles among multiple user devices, means for optimizing advertisements and blocking unwanted advertisements based on the profiles and sentiment data, and means for filtering relevant information and eliminating unwanted information based on the profiles and sentiment data. This enables the consistent provision of information and advertisements across multiple devices that take into account the user's interests and preferences as well as their emotions, and effectively eliminates unwanted information and advertisements.

[2266] A "user" is an individual or legal entity that utilizes the system and provides data about their interests, preferences, and emotions.

[2267] "Interests and preferences" refers to the topics and content that users are interested in, as well as their general tastes for those topics.

[2268] A "customized profile" is a collection of information individually tailored based on a user's interests and preferences, a digital record that reflects the user's characteristics.

[2269] "Emotional data" refers to information that represents the user's emotional state, and includes facial expression data and other emotional indicators analyzed by the emotion engine.

[2270] A "user device" is a hardware device used by a user to input information and interact with a system, and includes smartphones, tablets, and personal computers.

[2271] "Information synchronization" refers to the process of sharing and updating data so that the same information is consistently displayed and used across multiple user devices.

[2272] "Ad optimization" is the process of selecting and displaying ads that are most likely to be of interest to a user, based on their profile and sentiment data.

[2273] "Blocking unwanted ads" is the process of filtering out ads that are not needed to be displayed, based on the user's profile and sentiment data, and preventing them from being shown to the user.

[2274] "Relevant information filtering" is the process of excluding irrelevant information based on the user's profile and sentiment data, and providing only information that is useful to the user.

[2275] This invention provides a system that creates individually customized profiles based on user interests and preferences, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. Furthermore, by incorporating an emotion engine that recognizes user emotions, it is possible to provide more accurate information and deliver advertisements. Specific embodiments for realizing this system are described in detail below.

[2276] Creating and managing user profiles

[2277] User: Users create a new account and enter basic information about their interests, preferences, and feelings. This includes, for example, their favorite topics (technology, health, business, etc.) and how they feel about them.

[2278] Device: The device (e.g., smartphone or computer) sends emotional data recognized by the emotion engine, along with information entered by the user, to the server. This includes software that uses the smartphone's camera and microphone to analyze facial expressions and voice tone.

[2279] Server: The server analyzes the received information and creates a new user profile in the database. It also stores sentiment data provided by the sentiment engine in the profile. If the user later adds or changes interests, preferences, or sentiments, the server updates this profile.

[2280] Information synchronization between devices

[2281] User: The user wants to access the same information on multiple devices (smartphone, tablet, PC, etc.).

[2282] Terminal: Each terminal sends data to the server regarding the actions performed by the user (e.g., bookmarking an article) and the user's emotional state during those actions.

[2283] Server: The server stores information and sentiment data in a database and sends it as a synchronization request to other registered devices. This allows, for example, articles that a user has favorited on their smartphone to be accessible on tablets and PCs, along with the sentiment data from when they were favorited.

[2284] Ad optimization and blocking

[2285] Server: Optimizes ads based on user profiles and sentiment data. Specifically, it selects ads that match the user's interests and emotions, and queries the ad server to obtain the optimal ad list.

[2286] Device: The device displays the ad list received from the server. Unnecessary or inappropriate ads are blocked from being displayed.

[2287] Users: Users can enjoy a more personalized experience because they only see ads optimized based on their interests and emotions. They can also add ads they don't want to see to a block list.

[2288] Selecting and filtering information

[2289] Server: The server collects articles and blog posts from multiple information sources. The collected information is temporarily stored in a database.

[2290] Server: The server then filters the information based on the user's profile and sentiment data, selecting only the most relevant information. The selected information is then delivered to the user's device.

[2291] Terminal: The terminal displays filtered information received from the server. This allows users to easily access only the information that is valuable to them.

[2292] Specific example

[2293] 1. Users search for health-related articles on their smartphones and add them to their favorites.

[2294] Device (smartphone): The user adds the article to their favorites and sends their emotional data to the server at that time.

[2295] Server: Updates user profiles and sentiment data, and synchronizes favorites and sentiment data with other registered devices (e.g., PCs and tablets).

[2296] Device (PC or tablet): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[2297] 2. The user decides they do not want to see new fitness ads on their computer and adds them to their block list.

[2298] Terminal (PC): Sends the operation to add to the block list and the corresponding emotion data to the server.

[2299] Server: Update blocklists and sentiment data to consider for future ad delivery.

[2300] Device: Controls the display of blocked ads in the future.

[2301] Examples of prompts for generative AI models

[2302] "This system creates user profiles based on their preferences and emotions, and uses them to optimize various information and advertisements. Articles that users add to their favorites on their smartphones are simultaneously synchronized across other devices, and emotional data is consistently managed. Please explain this process in detail."

[2303] This allows users to receive consistent, emotionally-driven, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[2304] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2305] Step 1:

[2306] User: The user logs into the system and proceeds to a screen where they create a new account. There, they enter basic information about their interests and preferences. The data entered includes, for example, "favorite topics" and "emotional tendencies."

[2307] Input: Topic and sentiment information entered by the user.

[2308] Output: JSON data of the input topic and sentiment information.

[2309] Specific actions: The user selects a topic such as "technology" or "health" and inputs emotions such as "excitement" or "reassurance."

[2310] Step 2:

[2311] Terminal: The terminal (smartphone or computer) sends information entered by the user and emotional data analyzed by the emotion engine to the server. The emotion engine uses the camera and microphone to analyze facial expressions and voice tone.

[2312] Input: User-entered topic and sentiment data, and sentiment analysis data from the sentiment engine.

[2313] Output: Integrated data sent to the server (topic, sentiment information, sentiment analysis data).

[2314] Specific operation: The smartphone analyzes facial expression data collected through its camera in real time and sends it to the server along with topic and emotion data.

[2315] Step 3:

[2316] Server: The server analyzes the received data and creates a new user profile in the database. Sentimental data provided by the sentiment engine is also stored in the profile.

[2317] Input: Integrated data of user topics, sentiment information, and sentiment analysis data.

[2318] Output: New user profile saved in the database.

[2319] Specific operation: The server creates a new entry in the database and sets fields such as "User ID," "Interest Topics," and "Sentiment Data."

[2320] Step 4:

[2321] User: Users want to access the same information on multiple devices. For example, they might add an article to their favorites on their smartphone and then check it later on their computer.

[2322] Input: User actions (adding articles to favorites) and associated sentiment data.

[2323] Output: Operational data and sentiment data as a synchronous request.

[2324] Specific operation: The user taps the "Favorites" button on their smartphone. At this time, the camera captures their facial expression and collects emotion data.

[2325] Step 5:

[2326] Device: The smartphone sends operation data and sentiment data to the server. The transmitted data includes the ID of the article that was operated on and sentiment data.

[2327] Input: Favorite operation data and sentiment data.

[2328] Output: Operational data and sentiment data sent to the server.

[2329] Specific operation: The smartphone sends an API request to the server that includes the "article ID" and "sentiment data".

[2330] Step 6:

[2331] Server: The server stores operation data and emotion data in a database and sends synchronization requests to other registered devices.

[2332] Input: Favorite operation data and sentiment data.

[2333] Output: Data sent to other devices as a sync request.

[2334] Specific operation: The server adds a new "favorites" entry to the database and sends a push notification to the device list.

[2335] Step 7:

[2336] Device (e.g., tablet or PC): Receives synchronization requests from the server and updates favorite articles and sentiment data.

[2337] Input: Synchronized data from the server (article ID and sentiment data).

[2338] Output: Favorite articles and sentiment data updated on your local device.

[2339] Specific action: The tablet receives a notification and adds the new favorite article to its local database.

[2340] Step 8:

[2341] Server: Optimizes ads based on user profiles and sentiment data.

[2342] Input: User profile and sentiment data.

[2343] Output: Optimized ad list.

[2344] Specific operation: The server sends a request to the ad server that includes "user interest topics" and "sentiment data".

[2345] Step 9:

[2346] Device: Displays an optimized ad list received from the server by the device. Unwanted ads are blocked from being displayed.

[2347] Input: Ad list received from the server.

[2348] Output: Display of filtered ad list.

[2349] Specific operation: The device passes ad data to the display component, which filters and displays ads that are in the blocklist.

[2350] Step 10:

[2351] User: Add ads that the user does not want to see to a block list.

[2352] Input: User block actions and sentiment data.

[2353] Output: Blocklist update request sent to the server.

[2354] Specific action: The user clicks the "block" button on the ad, and this action and sentiment data are sent to the server.

[2355] Step 11:

[2356] Server: Update blocklists and sentiment data to consider for future ad delivery.

[2357] Input: Blocklist update request and sentiment data.

[2358] Output: Updated blocklist.

[2359] Specific action: The server updates the database and activates the blocklist.

[2360] Step 12:

[2361] Device: Controls the display of blocked ads in the future.

[2362] Input: Updated blocklist.

[2363] Output: Display of filtered ad list.

[2364] Specific action: The device removes blocked ads from the ad list and displays a new list.

[2365] Step 13:

[2366] Server: The server collects articles and blog posts from multiple information sources and temporarily stores them in a database.

[2367] Input: Information source (RSS feed, web scraping, etc.).

[2368] Output: Articles and blog posts saved as temporary data.

[2369] Specific operation: The server analyzes information obtained from RSS feeds and web scraping and stores it in a temporary table.

[2370] Step 14:

[2371] Server: The server filters information based on the user's profile and sentiment data, selecting only the most relevant information.

[2372] Input: Articles, blog posts, temporary data.

[2373] Output: Filtered, useful informational data.

[2374] Specific operation: The server uses filtering rules and machine learning models to select relevant information.

[2375] Step 15:

[2376] Terminal: Displays filtered information received by the terminal from the server.

[2377] Input: Filtered, useful informational data.

[2378] Output: Filtered information displayed on the device.

[2379] Specific operation: The smartphone retrieves a new list of information and displays it in the UI component.

[2380] This allows users to receive consistent, emotion-based, and personalized information and advertising experiences regardless of the device they use. This system is expected to improve user satisfaction by providing an experience optimized to user needs and emotions.

[2381] (Application Example 2)

[2382] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2383] Traditional information distribution systems provided information based on user interests and preferences, but they were insufficient in terms of real-time product recommendations and advertising optimization based on user emotions. Furthermore, no systems existed that took emotional data into account when synchronizing information across multiple devices. In addition, there was a lack of means to individually optimize the in-store shopping experience. As a result, users experienced inconsistent experiences, making it difficult to increase their satisfaction.

[2384] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for creating individually customized profiles based on the user's interests and preferences; means for synchronizing information based on the profiles among multiple user devices; means for optimizing advertisements and blocking unwanted advertisements based on the profiles; means for filtering relevant information and eliminating unnecessary information based on the profiles; means for making product suggestions in accordance with the user's interests and emotions in physical stores using an emotion engine that recognizes the user's emotions; and means for displaying product suggestions based on the profile and emotion data in real time using smart glasses. As a result, users can receive product suggestions that match their feelings, their shopping experience in physical stores is individually optimized, and their satisfaction is increased.

[2385] "User" refers to an individual or group that uses the system.

[2386] "Interests and preferences" refers to information that indicates a user's tastes in specific topics or products.

[2387] A "customized profile" refers to a set of data created individually based on a user's interests, preferences, and sentiment data.

[2388] "Means of synchronizing information" refers to methods for matching profile-based information across multiple user devices.

[2389] "Ad optimization" refers to the act of selecting and delivering the most relevant ads based on the user's profile.

[2390] "Methods of blocking ads" refer to methods of preventing the display of ads that users deem unnecessary or inappropriate.

[2391] "Filtering relevant information" refers to the act of selecting only information that is valuable to the user based on their profile.

[2392] An "emotion engine" refers to technology that recognizes and analyzes emotions from a user's facial expressions and voice.

[2393] A "physical store" refers to a commercial facility that provides goods and services in a physical location.

[2394] "Product recommendation" refers to the act of recommending highly relevant products based on the user's interests and feelings.

[2395] "Smart glasses" refer to glasses-type devices worn by users that display information and collect emotional data.

[2396] "Real-time display methods" refer to methods of presenting information instantly based on the user's current actions and status.

[2397] This invention relates to a system that creates individually customized profiles based on a user's interests, preferences, and emotions, synchronizes information across multiple user devices, optimizes and blocks advertisements, and filters relevant information. This system utilizes an emotion engine that recognizes the user's emotions and smart glasses, particularly to optimize the in-store shopping experience.

[2398] Creating and managing user profiles

[2399] The server creates a profile based on the user's interests and preferences and stores it in a database. Emotional data entered by the user through smart glasses is also added to the profile. An emotion engine is used to recognize emotions from the user's facial expressions and voice and update the profile accordingly. The data on interests and preferences includes, for example, favorite topics and product categories (technology, health, business, etc.) and the emotions associated with them.

[2400] Information synchronization between devices

[2401] The server stores user actions (such as adding a product to their favorites) and corresponding emotional data in a database, and synchronizes this data with other registered devices (such as smartphones and tablets). If a user expresses positive feelings towards a particular product using smart glasses, that data is sent to the server and immediately reflected on other devices.

[2402] Ad optimization and blocking

[2403] The server selects the most relevant ads for the user based on their profile and sentiment data. Inappropriate ads are blocked as needed. For example, if a user decides they do not want to see a particular ad, it is added to a block list along with its sentiment data. Blocked ads will not be displayed to the user in the future.

[2404] Selecting and filtering information

[2405] The server collects articles and blog posts from multiple information sources and filters the information based on the user's profile and sentiment data. Smart glasses display information that is relevant to the user in real time. This allows users to easily access information that is valuable to them.

[2406] Applications in physical stores

[2407] Smart glasses are used to recognize a user's emotions towards products in a physical store. For example, if a user is excited when they see a new technology gadget, that emotional data is sent to a server and added to their profile. The next time the user visits a similar store, they will be shown product suggestions based on their emotions, encouraging them to make a purchase.

[2408] Specific example

[2409] In one specific application, when a user wears smart glasses and walks around a physical store, if they smile when they see a particular product, that emotion data is sent to a server. Based on this data, the server displays relevant products and promotions on the smart glasses in real time.

[2410] Examples of prompts to input into a generative AI model

[2411] "Based on the user's emotional data (images showing their reactions and analysis results), please list potential items to display next. Consider the user's ID, interests, and current emotional data."

[2412] Thus, the present invention uses user profiles and emotional data to synchronize information across devices and optimize the in-store shopping experience. This allows users to obtain a consistent and personalized experience.

[2413] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[2414] Step 1: Enter the user's interests and preferences.

[2415] Users input their interests and preferences, such as specific topics or product categories, through an interface built into their smart glasses. This input data is sent from the smart glasses to a server. The input data is in string format and includes topics and categories of interest.

[2416] Step 2: Collecting emotional data

[2417] The device (smart glasses) uses its built-in camera and microphone to capture the user's facial expressions and voice. This data is analyzed by an emotion engine and extracted as the user's emotion data. This emotion data includes emotion labels such as "joy" and "surprise" and their intensity.

[2418] Step 3: Create a profile

[2419] The server creates a profile based on the user's interest and sentiment data. This profile includes the user's interests and their emotional responses to those interests. The profile data is stored in a database.

[2420] Step 4: Information synchronization

[2421] The server stores profile information in a database and then sends it to other registered devices based on the information synchronization interval. Other devices then store the received profile information in their local data storage. This ensures that users can obtain consistent information regardless of which device they use.

[2422] Step 5: Filtering ads and information

[2423] The server selects the most relevant ads for the user based on profile information in the database and blocks inappropriate ads. The ad list retrieved from the ad server is filtered using the user's interests and sentiment data to display only highly relevant ads. The filtering results are sent as an ad list to smart glasses and other devices.

[2424] Step 6: Product proposals in physical stores

[2425] As users walk through a physical store, smart glasses monitor their gaze and location, displaying information about products they might be interested in in real time based on their profile. For example, if a user shows excitement upon seeing a new gadget, detailed information about that product and related promotions will be displayed on the glasses.

[2426] Step 7: Send a prompt to the generated AI model

[2427] When displaying a specific item, the server sends a prompt to the generating AI model, which then lists potential relevant items based on the user's current sentiment data and profile. The prompt might be something like, "List potential items to display next, based on the user's sentiment data (images showing their reactions and analysis results). Please consider the user's ID, interests, and current sentiment data."

[2428] Step 8: Real-time information display

[2429] Smart glasses receive responses from a generating AI model and update the information displayed to the user in real time. This enables optimal product recommendations tailored to the user's emotions and interests. Users are more likely to check products on the spot and make a purchase.

[2430] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 t...

Claims

1. A means of creating individually customized profiles based on the user's interests and preferences, Means for synchronizing information based on the profile among multiple user devices, A means for optimizing ads and blocking unwanted ads based on the aforementioned profile, A means for filtering relevant information based on the aforementioned profile and eliminating unnecessary information, A system that includes this.

2. The system according to claim 1, further comprising means for storing data relating to the interests and preferences collected from the user in a database in order to generate and manage the aforementioned profile.

3. The system according to claim 1, further comprising means for delivering only advertisements that meet predetermined criteria based on the user's profile in the aforementioned advertisement optimization and blocking.

Images