system

Abstract

Provide a system. 【Solution means】 Means for obtaining data related to hobbies and specific interests from users, Means for searching and collecting relevant information from the communication network based on the data, Means for displaying the collected information to the user, Means for automatically collecting sales information of products and services that the user is interested in, Means for executing a reservation or purchase procedure based on the sales information, Means for notifying the user of the result of the sales procedure, Means for aggregating sales information of related products according to the user's interests and pushing notifications of the information, A system including the above.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern times, the collection and management of information based on hobby activities or specific interests have become complicated due to a huge amount of information and diversification of information sources. As a result, it has become difficult for users to efficiently track the latest information and related products related to their interests. There is a need for a system that can reduce the labor of such information collection and further manage the purchase procedures of interested products and services in a unified manner.

Means for Solving the Problems

[0005] This system acquires data from users regarding their hobbies and specific interests, and automatically searches for and collects relevant information from the internet based on that data. Furthermore, it appropriately displays the collected information to the user and automatically gathers sales information for related products and services. For products of interest to the user, reservations or purchase procedures can be carried out directly through APIs of online stores and event sites. This allows users to efficiently manage information and products related to their interests and reduce the hassle of the purchase process.

[0006] A "user" is an individual or group that utilizes the system, inputting information about their hobbies or specific interests, and receiving related services.

[0007] "Hobbies and specific interests" refers to areas or activities that a user is personally interested in or passionate about, and specifically includes artists, works of art, events, etc.

[0008] "Data" refers to information that users input into the system, including specific names and categories related to their hobbies and interests.

[0009] "Relevant information on the internet" refers to information related to the user's hobbies and interests, including news, trends, market developments, and other information available online.

[0010] "Displaying information" refers to operations and functions that visually provide users with information collected through their devices, allowing them to confirm and review it.

[0011] "Product and service sales information" refers to specific information about products and services related to the user's interests, such as price, release date, and stock availability.

[0012] "Reservation or purchase procedure" refers to the process required to obtain related goods or services, and refers to the transaction procedure carried out through online stores or event sites.

[0013] "API" stands for Application Programming Interface, and refers to a standardized interface for exchanging functions and data between different software programs. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Mode for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention is a system for efficiently collecting and managing information about a user's hobbies and specific interests. Users input data about their hobbies and interests via a terminal. For example, if a user is interested in a particular artist or event, they input its name or category into the terminal.

[0036] The server searches various information sources on the internet based on data received from the user. These information sources are diverse, including news sites, social networking services, online forums, and official websites. The server collects relevant information, filters it based on the user's level of interest, and ranks it.

[0037] The device provides users with ranked information. Users can review the information presented through the device and understand news and trends that match their interests.

[0038] Furthermore, the server automatically collects sales information for products and tickets related to the user's interests. In this process, it uses APIs from online stores and event sites to obtain data such as product names, prices, release dates, and availability.

[0039] Users can use their device to select products or tickets they are interested in and indicate their intention to purchase. The device then sends the user's selection back to the server, which executes the purchase process. The user is notified of the success or failure of the facilitated purchase process.

[0040] This system allows users to easily gather information related to their interests and proceed directly to purchasing products and services, thus streamlining both information management and the purchasing process.

[0041] The following describes the processing flow.

[0042] Step 1:

[0043] Users use their devices to input information about their hobbies and interests. This information is provided in the form of specific artist names, event names, or genres.

[0044] Step 2:

[0045] The device sends information collected from the user to the server. This transmitted information serves as foundational data for building the user's interest profile.

[0046] Step 3:

[0047] The server searches the internet for information based on the user's interest profile that it receives. The search uses sources such as news sites, social media, forums, and official websites.

[0048] Step 4:

[0049] The server analyzes the information obtained from the search and selects the information most relevant to the user's interests. This process applies a filtering algorithm to rank the information based on the level of interest.

[0050] Step 5:

[0051] The server organizes the collected information and sends it to the terminal. The information is converted into a visually easy-to-understand format and prepared for easy access by the user.

[0052] Step 6:

[0053] The terminal displays information sent from the server to the user. The user can then review this displayed information and grasp the latest news and trends that interest them.

[0054] Step 7:

[0055] The server then collects information on products and tickets that match the user's interests. This collection process utilizes APIs from online stores and event sites.

[0056] Step 8:

[0057] The terminal displays product and ticket information that the user has shown interest in and confirms their purchase intention.

[0058] Step 9:

[0059] The user selects the products or tickets they wish to purchase through their device, and the device then sends this information to the server.

[0060] Step 10:

[0061] The server uses the submitted purchase information to process reservations or purchases on online stores and event websites.

[0062] Step 11:

[0063] The server sends the result of the purchase process to the terminal as either success or failure, and notifies the user.

[0064] Step 12:

[0065] Users can review the purchase results via their device and plan their next actions as needed.

[0066] Through this series of steps, users can efficiently gather information and purchase products.

[0067] (Example 1)

[0068] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0069] It is difficult for users to efficiently collect and manage information and products related to their hobbies and interests due to the fragmentation and information overload of traditional information sources. Furthermore, there are insufficient systems to obtain timely sales information about products and services that interest users and to make smooth purchases. As a result, users face the challenge of not being able to quickly and accurately collect and purchase information based on their interests.

[0070] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0071] In this invention, the server includes means for obtaining information on the user's interests, means for searching for and obtaining related information from an electronic network based on the information, and means for automatically collecting sales information on goods and services of interest to the user. This enables the user to efficiently and accurately collect information and products based on their interests and to execute a coordinated purchasing process.

[0072] An "information processing device" is a device whose purpose is to input data from users, collect information via a network, filter and rank information, and present information to users and perform purchase procedures.

[0073] A "user" refers to an entity that uses this information processing device to collect information related to their interests and concerns, and to purchase goods and services.

[0074] "Information related to areas of interest" refers to data and keywords related to the user's hobbies or specific fields of interest.

[0075] An "electronic network" refers to an electronic communication network, including the internet, and is a medium for collecting and transmitting information.

[0076] "Merchandise and services" refers to all products and services that users are interested in and consider purchasing.

[0077] A "communication protocol" refers to a standardized set of communication procedures used to exchange information between online stores, event sites, and other online platforms.

[0078] This invention provides an information processing device that allows users to efficiently collect and purchase information and products of interest. Specific embodiments are shown below.

[0079] The server receives information about the user's interests and searches for information sources via the electronic network. In doing so, the server utilizes a variety of information sources, including news sites, social networking services (SNS), and official website APIs. Based on the user's input, the server collects relevant information and further uses communication protocols from online stores and event information sites to obtain sales information for products and services of interest to the user.

[0080] The collected information is filtered and ranked based on the user's level of interest and priority. This allows users to efficiently access the information that interests them most, starting with the most relevant information.

[0081] The terminal serves to present ranked information from the server to the user. The user can review the information provided through the terminal and select products or services that interest them. Based on this selection, the server executes the purchase process and notifies the user of the result.

[0082] For example, if a user wants to attend the latest music festival, they enter keywords into their device, and the server collects relevant event information, including ticket sales information. The user then reviews the information through their device, selects the event tickets they are interested in, and indicates their intention to purchase them.

[0083] An example of a prompt for a generative AI model is: "Describe a system that collects relevant news and event information based on user interests, ranks and presents the most interesting items, and provides specific examples of a function that also provides sales information for related products." This prompt allows the generative AI model to support the provision of information based on user requests.

[0084] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0085] Step 1:

[0086] The user uses a terminal to input information about their interests and concerns. This input data includes specific event names, artist names, and so on. This input information is used as foundational data for the next processing step. The terminal then sends the input data to the server.

[0087] Step 2:

[0088] The server searches for information sources on the electronic network based on user input data received from the terminal. Specifically, the server uses APIs from news sites, social networking services, and official websites to collect relevant information. The server uses keyword search and information filtering algorithms to select the information most relevant to the user's interests. Through this process, a large amount of collected information is prepared for analysis in the next step.

[0089] Step 3:

[0090] The server filters and ranks the collected information based on user interest and priority. This process evaluates the importance and novelty of the information, arranging it in order of likelihood of high interest. Data processing utilizes techniques such as text analysis and natural language processing. The filtering and ranking results in a final list to be provided to the user.

[0091] Step 4:

[0092] The terminal presents the user with ranked information received from the server. The user reviews the information through the terminal and decides on their next action based on its content. The presented information is organized according to the user's interests, enabling efficient information review.

[0093] Step 5:

[0094] The server then collects sales information for products and services that the user may be interested in. This process utilizes communication protocols from online stores and event information sites to retrieve detailed information about products and services. The data collected includes product name, price, sales date, and availability. This information is prepared to be provided to the user as additional information.

[0095] Step 6:

[0096] The user selects products or services of interest through their device and indicates their intention to purchase or reserve them. The device sends this selection information to the server. The server executes the purchase process for the selected items and notifies the user of the result. This notification allows the user to confirm whether the transaction was successful.

[0097] (Application Example 1)

[0098] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0099] There is a need for the efficient collection and management of relevant information based on users' individual hobbies and specific interests. Furthermore, there is a need to simplify the purchasing process for goods and services, and to ensure a smooth flow from information to purchase. In particular, a challenge is to build a system that aggregates information reflecting user interests and sales information, and enables timely notifications tailored to user needs.

[0100] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0101] In this invention, the server includes means for acquiring data on hobbies and specific interests from the user, means for searching and collecting related information from the communication network, and means for pushing the aggregated information to the user. This enables the user to receive information and sales information that matches their interests and to carry out a simple purchase procedure.

[0102] A "user" is an individual who uses the system to input information based on their individual interests and hobbies, and to retrieve related data.

[0103] "Data" refers to information about hobbies and specific interests that users input, and it forms the basis for collecting related information based on that data.

[0104] A "communication network" refers to a wide-area information network, including the Internet, and is used to obtain information based on user interests.

[0105] "Information" refers to data retrieved and collected from communication networks, including news, trends, and product information related to the user's interests.

[0106] "Sales information" refers to data about products and services that users are interested in, including price, availability, and purchase possibility.

[0107] "Means" refers to a method or apparatus designed to achieve a specific purpose, and in the context of this patent, it refers to a method or apparatus that enables the execution of procedures related to the acquisition, display, and purchase of information.

[0108] A "server" refers to a system consisting of computers that receive data from users and retrieve and process related information from a communication network.

[0109] "Push notifications" refer to a function that automatically sends collected information and sales information to the user's device, providing the user with the latest information in real time.

[0110] To implement this invention, a terminal for inputting data on the user's hobbies and interests, a server for processing the data and collecting related information, and a user interface for displaying the information are required.

[0111] The server receives data about the user's interests entered using a device such as a smartphone. This data identifies the user's interests and serves as a basis for collecting relevant news, product information, events, etc., from the communication network. To accomplish this, the server uses a Python program and a scraping library (e.g., Beautiful Soup) to collect information from relevant websites and APIs and store it in a database.

[0112] The device provides users with collected information and notifies them of sales information for products and services based on their interests. This uses React Native, a mobile application development framework, to manage bidirectional communication between the user interface and the server.

[0113] For example, if a user expresses interest in a concert by a particular artist, the server constantly collects event information related to that artist and quickly displays information about when tickets go on sale. Based on this information, the user can quickly complete the purchase process on their terminal. In this process, existing payment platforms such as Stripe are integrated for electronic payments, ensuring secure and efficient transactions.

[0114] By utilizing information filtering and ranking functions powered by generative AI models, it becomes possible to provide information based on user priorities. As a result, users can receive more personalized information and have a purchasing experience closely related to their interests.

[0115] A concrete example of a prompt would be, "Please recommend concerts based on my interests, and if possible, let me buy tickets immediately." Using this prompt enables the rapid delivery of personalized content and recommendations for related products.

[0116] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0117] Step 1:

[0118] Users use a terminal to input data about their hobbies and interests. This input data includes the names and categories of things they are interested in (for example, specific artists or events). The entered data is then sent directly to the server.

[0119] Step 2:

[0120] The server analyzes the data received from the user and searches for relevant information from the communication network based on that data. Specifically, it uses a program written in Python to scrape data from multiple sources, including news sites, social networking services, and online forums. In this step, it generates search queries based on the interest data received as input and filters and collects relevant information.

[0121] Step 3:

[0122] The server uses a generation AI model to rank and filter the acquired information. The input is the raw data acquired in the previous step, and the output is a list of high-priority information aligned with the user's level of interest. Data processing includes text analysis and relevance score calculation to select the most relevant information for the user.

[0123] Step 4:

[0124] The terminal displays the ranked information sent from the server. In this step, the information is organized and a display frame is created using a user interface built with React Native to provide the user with visually easy-to-understand information.

[0125] Step 5:

[0126] Based on the displayed information, users select products and events that interest them. This selection information is then sent back to the server. User input includes product selections and purchase intentions.

[0127] Step 6:

[0128] The server collects sales information for selected products and events and executes the purchase process. It uses store APIs and event site APIs to check prices and inventory in real time and proceed with the purchase. Input is the user's selection information, and output is the success or failure of the purchase process.

[0129] Step 7:

[0130] The terminal notifies the user of the purchase process. Depending on the flow of the process, if the purchase is successful, it displays detailed information; if it fails, it provides retry options and an explanation of the reason.

[0131] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0132] This invention combines a system that efficiently collects and manages information related to a user's hobbies and specific interests with an emotion engine that recognizes the user's emotions. By analyzing the user's emotions, this system enables more personalized information delivery and optimization of the user experience.

[0133] Users input data about their hobbies and interests via their device. For example, if a user is interested in a particular music artist or movie, they can enter the artist's name or the movie title. This data is sent to the server.

[0134] The server searches the internet for and collects relevant information based on the data it receives. It utilizes multiple sources, such as news articles, social media posts, and fan forums, to gather the information most relevant to the user's interests. The server further filters and ranks the information, taking into account the user's priorities and level of interest.

[0135] This system incorporates an emotion engine that analyzes the user's emotional state. The emotion engine collects emotional data from the user's voice tone, input content, and operation patterns to create a user emotional profile. For example, if a user is looking for upbeat music, the emotion engine detects that upbeat emotion and prioritizes presenting information that evokes a cheerful atmosphere.

[0136] The device displays analysis results and collected information to the user. The displayed information is adjusted based on the user's emotional state, and the most relevant content is presented.

[0137] Furthermore, the server collects sales information on products and services related to the user's interests. This includes information such as product name, price, release date, and availability. The emotion engine can then display information at the time when the user's emotional state is most likely to increase their purchase intent.

[0138] When a user expresses interest in purchasing a specific product or service, the device sends that information to a server, which then processes the reservation or purchase on the online store or event site. The user is notified of the purchase result via the device, and further actions are suggested as needed.

[0139] This series of processes enables users to efficiently gather information about their areas of interest based on their emotions and to utilize that information and services in the most optimal way.

[0140] The following describes the processing flow.

[0141] Step 1:

[0142] Users use their devices to input information about their hobbies and interests. For example, they might enter the names of artists or movie titles they are interested in.

[0143] Step 2:

[0144] The device sends the information entered by the user to the server. This information is used as data indicating the user's hobbies and interests.

[0145] Step 3:

[0146] The server uses the received data to search for and collect relevant information from various sources on the internet. It explores sources such as news, social media, and forums, and collects relevant content.

[0147] Step 4:

[0148] The server analyzes the collected information, filtering and ranking it based on the user's priorities and interests. This process is crucial for selecting the most relevant information for the user.

[0149] Step 5:

[0150] The emotion engine analyzes user input, voice tone, and operation patterns obtained through the device to determine the user's emotional state. For example, it can infer emotions from the user's voice tone and speed.

[0151] Step 6:

[0152] Based on the sentiment analysis results from the sentiment engine, the server organizes information in the most relevant and appropriate format for the user and sends it to the terminal.

[0153] Step 7:

[0154] The device displays information sent from the server to the user. The information display is customized to take into account the user's emotional state and is adjusted to capture the user's interest.

[0155] Step 8:

[0156] The server collects sales information for products and services related to the user's interests. This involves utilizing APIs from online stores and event sites to retrieve information such as price, release date, and stock availability.

[0157] Step 9:

[0158] The emotion engine prioritizes presenting information about products and services that increase the user's desire to purchase, based on their emotional state.

[0159] Step 10:

[0160] Users select products and services they are interested in and communicate their purchase intention to the server via their device.

[0161] Step 11:

[0162] The server receives purchase requests from users and executes the reservation or purchase process for the specified goods or services.

[0163] Step 12:

[0164] The server notifies the user of the purchase result via the terminal. The user can then decide on their next course of action based on this information.

[0165] This process allows users to enjoy an appropriate information gathering and purchasing experience that is tailored to their emotions.

[0166] (Example 2)

[0167] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0168] Traditional information gathering systems can provide information based on users' hobbies and interests, but they cannot provide information that takes into account the user's emotional state. Therefore, there is a challenge in effectively presenting information that matches the user's current emotions and mood, and providing a truly personalized user experience. Furthermore, there is a lack of timely information provision about products and services that align with purchasing intent, potentially leading to missed opportunities.

[0169] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0170] In this invention, the server includes means for recognizing the user's emotional state and providing information based on the recognized emotions; means for filtering and ranking information and sales information based on the user's priority, level of interest, and emotional state; and means for collecting and processing the sales information using the API of a digital platform. This enables flexible and efficient information provision based on the user's emotions and interests, thereby optimizing the user experience.

[0171] A "user" is an individual or group that collects information based on specific hobbies or interests and makes decisions based on that information.

[0172] "Data" refers to information about hobbies and specific interests entered by users, and is the basic information that is processed by the system.

[0173] A "source of information" is an external data provider used to collect information from the internet or other digital platforms.

[0174] A "server" is a central management system that processes user requests and collects, analyzes, and provides relevant information.

[0175] "Emotional state" refers to the user's current mood and feelings, and is used as an indicator for information provided by the system.

[0176] "Filtering" is the process of selecting and discarding collected information based on the user's specific criteria and priorities.

[0177] "Ranking" is the process of assigning order to collected information based on the user's level of interest and importance.

[0178] A "digital platform" refers to an online marketplace or software service that provides information about products and services and forms an interface with users.

[0179] "API" stands for Application Programming Interface, and it refers to a technology that provides an interface for sharing functions and data between different software programs.

[0180] This invention is a system that collects information related to a user's hobbies and specific interests, analyzes it, and provides a more personalized experience. This system uses an emotion analysis engine to recognize the user's emotional state and optimizes the user experience by providing information based on those emotions.

[0181] Users first input data about their hobbies and interests via their device. Specifically, they can enter things like the names of music artists or movie titles. This input data is then sent from the device to the server.

[0182] The server uses this data to collect relevant information from sources on the internet. This could involve using web crawling technologies and APIs to collect news articles, social media posts, and comments on online forums.

[0183] Furthermore, the server incorporates an emotion engine that analyzes the user's emotional state. This analysis uses a generative AI model to analyze data such as the user's voice tone and input patterns. Based on the resulting emotional profile, the server filters and ranks information to select the information most relevant to the user.

[0184] For example, when a user is looking for upbeat music, the emotion engine can detect that upbeat emotion and prioritize displaying information about related music events. By implementing such a system, users can quickly access information that interests them and receive information that is relevant to them.

[0185] The device presents information received from the server to the user, and this information is adjusted according to the user's emotions. This presentation method allows users to easily enjoy content that matches their feelings.

[0186] An example of a prompt might be, "Please tell me about some new and fun music." This prompt allows the system to present content tailored to the user's mood or specific interests.

[0187] This system uses specific platform APIs to collect information about products and services, and by providing timely information tailored to the user's purchasing intent, it can enrich the user's lifestyle.

[0188] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0189] Step 1:

[0190] The user uses a terminal to input information about their hobbies and specific interests. This input data includes artist names and movie titles. This data is sent from the terminal to the server. For example, the user enters "latest movie information" and presses the submit button. The output of the input data is the user's interest data sent to the server.

[0191] Step 2:

[0192] The server uses the user's interest data to collect relevant information from the internet. This includes launching a web crawler to retrieve news articles, social media posts, forum comments, and other similar content. The input is the user's interest data, which is used to retrieve relevant information from various sources. The output is a list of the collected relevant information.

[0193] Step 3:

[0194] The server uses an emotion engine to analyze the user's emotional state. The emotion engine generates a user emotional profile by analyzing the user's voice tone and input text. The input in this step is the user's voice and text data, and the output is a profile indicating the user's emotional state.

[0195] Step 4:

[0196] The server filters and ranks the collected information based on the user's emotional profile. It prioritizes the most relevant information based on the emotional state. The input is the collected information and the user's emotional profile, and the output is a filtered list of information.

[0197] Step 5:

[0198] The device displays filtered information to the user. The information is presented in an optimized format, taking into account the user's emotional state. Specifically, the device displays "latest movie premium screening information" on its screen. The input is a filtered list of information, and the output is the information presented in a format that the user can review.

[0199] Step 6:

[0200] The server collects and displays sales information for products and services that the user has shown interest in, via a digital platform API. It presents information tailored to the user's purchasing intent. Specifically, the server retrieves "movie ticket inventory information" and sends it to the terminal. The input is information related to the user's purchasing intent, and the output is inventory and purchase information for the relevant product.

[0201] Step 7:

[0202] When a user purchases a specific product or service, the device sends a request to the server, which then processes the purchase on the online platform. The device is then notified of the purchase result. For example, the user selects "Purchase Movie Tickets" from the device, and the server completes the process. The input is the user's purchase request, and the output is the purchase completion notification.

[0203] (Application Example 2)

[0204] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0205] Users want to efficiently gather a lot of information based on their hobbies and specific interests, but because the information provided is not customized to their current emotional state or priorities, it is difficult for them to obtain the right information. Furthermore, mistiming the purchase of products or services they are interested in can lead to missed opportunities. Therefore, there is a need for a system that provides information considering the user's emotional state and optimizes the timing of purchases.

[0206] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0207] In this invention, the server includes means for recognizing the user's emotional state and creating a profile, means for providing personalized information based on the emotional profile, and means for executing reservation or purchase procedures based on the provided information. This enables the presentation of optimal information according to the user's emotions and the optimization of purchase timing.

[0208] A "user" is an individual or group that uses the system and is the entity that provides information related to hobbies or specific interests.

[0209] "Hobbies and specific interests" refer to activities or fields that users are interested in and want to learn more about.

[0210] "Information" refers to data, news, and content related to a user's hobbies and interests, and is collected via the internet.

[0211] A "communication network" is a general term for networks used to transmit information, such as the Internet, and is used for data retrieval and communication.

[0212] "Emotional state" refers to the user's current emotional state and psychological response, and is the subject of analysis by the system.

[0213] A "profile" is information that summarizes a user's characteristics and behavioral tendencies, and is used to optimize the user experience.

[0214] "Products and services" refers to items or services that a user is considering purchasing or using.

[0215] An "application interface" is a connection point used to exchange data between different software systems, and is also known as an API.

[0216] The system implementing this invention enables personalized information delivery by collecting information on the user's hobbies and specific interests, and further analyzing the user's emotional state. The overall system mainly includes a user terminal, a server, and an emotional analysis engine.

[0217] A user terminal is a device used by users to input data related to their hobbies and specific interests, and can be a smartphone, tablet, or computer. The entered data is transmitted to a server via the internet.

[0218] The server searches for and aggregates relevant information from the communication network based on the data it receives. Sources of information include news sites, social media, forums, and content distribution services. The server also uses a generative AI model to create a user sentiment profile from the aggregated information. This profile is processed by a sentiment analysis engine based on the user's voice, text input, and behavioral patterns.

[0219] After the information is processed on the server, it is displayed on the user's terminal. The displayed content is customized based on the user's emotional profile; for example, if a user wants to relax, relaxing music and scenic videos will be recommended first.

[0220] Furthermore, the server collects information on products and services related to the user's interests. For example, if a user expresses interest in a particular gadget, information such as its price, availability, and sales date will be displayed. The collection of this information and the purchasing process are carried out through the application interface of the online store or event site.

[0221] For example, if a user enters "I want to relax today," the sentiment analysis engine will recognize the user's mood as "relaxation-oriented" and recommend relaxing background music and scenic videos.

[0222] An example of a prompt message is: "Recommend content best suited to the user's mood. Input: I want to relax. Result: Relaxing background music and scenic videos." In this way, the system of the present invention provides optimal information and purchasing support tailored to the user's mood.

[0223] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0224] Step 1:

[0225] The user terminal is a device for inputting data related to hobbies and specific interests. Input is done via text or voice commands. This input data is collected as basic information to identify the user's hobbies and interests. The entered information is transmitted to a server via the internet.

[0226] Step 2:

[0227] The server searches for and collects relevant information from the communication network based on data received from user terminals. News sites, social media, forums, etc., are used as information sources. The server uses web crawlers and natural language processing technology to crawl diverse data sources and extract relevant information based on keywords. In this process, the server calculates the relevance of each piece of information based on the input data, collects the most relevant information, and ranks it based on each user's priority.

[0228] Step 3:

[0229] The server uses an emotion analysis engine to analyze emotional data from the user's voice tone, text input, and interaction patterns. The analyzed emotional data is then compiled into the user's current emotional profile. This profile identifies the user's current emotional state. For example, if a user enters "I want to relax today," their emotional state will be registered in the profile as "relaxed."

[0230] Step 4:

[0231] The server utilizes a generative AI model to provide personalized information to users, using emotional profiles and existing aggregated data. Specifically, it extracts and recommends highly relevant content (music, videos, etc.) based on the emotional profile. For example, a user with a "relaxation-oriented" profile will be given priority in calming background music and nature video content. Example prompt: "Recommend the most suitable content based on the user's emotional state. Input: I want to relax. Result: Relaxing background music and scenery videos."

[0232] Step 5:

[0233] The user's device receives information processed by the server and displays it to the user. This display is prioritized and adjusted based on the user's emotional profile, with the content most relevant to the user's current emotions being presented first. The user can then view the displayed content and explore further information on topics of interest.

[0234] Step 6:

[0235] The server collects and delivers information about products and services that users are interested in. This information includes price, availability, and sales dates. Through the application interface of an online store or event site, the server uses the collected information to automatically execute reservation or purchase procedures.

[0236] Step 7:

[0237] The user terminal notifies the user of the results of the purchase or reservation process. It then suggests the next action the user should take and continues to provide information to further optimize their purchasing decision. Based on this, the user can continuously manage the necessary actions.

[0238] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0239] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0240] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0241] [Second Embodiment]

[0242] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0243] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0244] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0245] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0246] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0247] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0248] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0249] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0250] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0251] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0252] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0253] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0254] This invention is a system for efficiently collecting and managing information about a user's hobbies and specific interests. Users input data about their hobbies and interests via a terminal. For example, if a user is interested in a particular artist or event, they input its name or category into the terminal.

[0255] The server searches various information sources on the internet based on data received from the user. These information sources are diverse, including news sites, social networking services, online forums, and official websites. The server collects relevant information, filters it based on the user's level of interest, and ranks it.

[0256] The device provides users with ranked information. Users can review the information presented through the device and understand news and trends that match their interests.

[0257] Furthermore, the server automatically collects sales information for products and tickets related to the user's interests. In this process, it uses APIs from online stores and event sites to obtain data such as product names, prices, release dates, and availability.

[0258] Users can use their device to select products or tickets they are interested in and indicate their intention to purchase. The device then sends the user's selection back to the server, which executes the purchase process. The user is notified of the success or failure of the facilitated purchase process.

[0259] This system allows users to easily gather information related to their interests and proceed directly to purchasing products and services, thus streamlining both information management and the purchasing process.

[0260] The following describes the processing flow.

[0261] Step 1:

[0262] Users use their devices to input information about their hobbies and interests. This information is provided in the form of specific artist names, event names, or genres.

[0263] Step 2:

[0264] The device sends information collected from the user to the server. This transmitted information serves as foundational data for building the user's interest profile.

[0265] Step 3:

[0266] The server searches the internet for information based on the user's interest profile that it receives. The search uses sources such as news sites, social media, forums, and official websites.

[0267] Step 4:

[0268] The server analyzes the information obtained from the search and selects the information most relevant to the user's interests. This process applies a filtering algorithm to rank the information based on the level of interest.

[0269] Step 5:

[0270] The server organizes the collected information and sends it to the terminal. The information is converted into a visually easy-to-understand format and prepared for easy access by the user.

[0271] Step 6:

[0272] The terminal displays information sent from the server to the user. The user can then review this displayed information and grasp the latest news and trends that interest them.

[0273] Step 7:

[0274] The server then collects information on products and tickets that match the user's interests. This collection process utilizes APIs from online stores and event sites.

[0275] Step 8:

[0276] The terminal displays product and ticket information that the user has shown interest in and confirms their purchase intention.

[0277] Step 9:

[0278] The user selects the products or tickets they wish to purchase through their device, and the device then sends this information to the server.

[0279] Step 10:

[0280] Based on the sent purchase information, the server performs reservation or purchase procedures on the online store or event site.

[0281] Step 11:

[0282] The server sends the result of the purchase procedure to the terminal in either a successful or failed form to notify the user.

[0283] Step 12:

[0284] The user checks the result of the purchase via the terminal and plans the next action as needed.

[0285] Through this series of steps, the user can efficiently collect information and purchase goods.

[0286] (Example 1)

[0287] Next, Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".

[0288] For a user to efficiently collect and manage information and products related to their hobbies and interests is difficult due to the fragmentation and overabundance of conventional information sources. Also, the mechanism for timely obtaining sales information on products and services that the user is interested in and smoothly purchasing them is insufficient. As a result, there is a problem that it is difficult for the user to quickly and accurately collect information and make purchases based on their interests.

[0289] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following respective means.

[0290] In this invention, the server includes means for obtaining information on the user's interests, means for searching for and obtaining related information from an electronic network based on the information, and means for automatically collecting sales information on goods and services of interest to the user. This enables the user to efficiently and accurately collect information and products based on their interests and to execute a coordinated purchasing process.

[0291] An "information processing device" is a device whose purpose is to input data from users, collect information via a network, filter and rank information, and present information to users and perform purchase procedures.

[0292] A "user" refers to an entity that uses this information processing device to collect information related to their interests and concerns, and to purchase goods and services.

[0293] "Information related to areas of interest" refers to data and keywords related to the user's hobbies or specific fields of interest.

[0294] An "electronic network" refers to an electronic communication network, including the internet, and is a medium for collecting and transmitting information.

[0295] "Merchandise and services" refers to all products and services that users are interested in and consider purchasing.

[0296] A "communication protocol" refers to a standardized set of communication procedures used to exchange information between online stores, event sites, and other online platforms.

[0297] This invention provides an information processing device that allows users to efficiently collect and purchase information and products of interest. Specific embodiments are shown below.

[0298] The server receives information about the user's interests and searches for information sources via the electronic network. In doing so, the server utilizes a variety of information sources, including news sites, social networking services (SNS), and official website APIs. Based on the user's input, the server collects relevant information and further uses communication protocols from online stores and event information sites to obtain sales information for products and services of interest to the user.

[0299] The collected information is filtered and ranked based on the user's level of interest and priority. This allows users to efficiently access the information that interests them most, starting with the most relevant information.

[0300] The terminal serves to present ranked information from the server to the user. The user can review the information provided through the terminal and select products or services that interest them. Based on this selection, the server executes the purchase process and notifies the user of the result.

[0301] For example, if a user wants to attend the latest music festival, they enter keywords into their device, and the server collects relevant event information, including ticket sales information. The user then reviews the information through their device, selects the event tickets they are interested in, and indicates their intention to purchase them.

[0302] An example of a prompt for a generative AI model is: "Describe a system that collects relevant news and event information based on user interests, ranks and presents the most interesting items, and provides specific examples of a function that also provides sales information for related products." This prompt allows the generative AI model to support the provision of information based on user requests.

[0303] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0304] Step 1:

[0305] The user uses the terminal to input information about their concerns and interests. The input data includes specific event names, artist names, etc. This input information is used as the basic data for the next processing step. The terminal sends the input data to the server.

[0306] Step 2:

[0307] Based on the user's input data received from the terminal, the server searches for information sources on the electronic network. Specifically, the server uses the APIs of news sites, SNS, and official websites to collect relevant information. The server selects the information most relevant to the user's interests using keyword search and information filtering algorithms. Through this process, a lot of the collected information is prepared for analysis in the next step.

[0308] Step 3:

[0309] The server filters and ranks the collected information based on the user's degree of interest and priority. In this process, the importance and novelty of the information are evaluated, and the information is sorted in the order that would be of high interest. Text analysis and natural language processing technologies are used for data processing. As a result of filtering and ranking, a final list for presenting to the user is generated.

[0310] Step 4:

[0311] The terminal presents the ranked information received from the server to the user. The user checks the information through the terminal and decides on the next action based on its content. The presented information is sorted based on the user's interests, enabling efficient information checking.

[0312] Step 5:

[0313] The server then collects sales information for products and services that the user may be interested in. This process utilizes communication protocols from online stores and event information sites to retrieve detailed information about products and services. The data collected includes product name, price, sales date, and availability. This information is prepared to be provided to the user as additional information.

[0314] Step 6:

[0315] The user selects products or services of interest through their device and indicates their intention to purchase or reserve them. The device sends this selection information to the server. The server executes the purchase process for the selected items and notifies the user of the result. This notification allows the user to confirm whether the transaction was successful.

[0316] (Application Example 1)

[0317] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0318] There is a need for the efficient collection and management of relevant information based on users' individual hobbies and specific interests. Furthermore, there is a need to simplify the purchasing process for goods and services, and to ensure a smooth flow from information to purchase. In particular, a challenge is to build a system that aggregates information reflecting user interests and sales information, and enables timely notifications tailored to user needs.

[0319] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0320] In this invention, the server includes means for acquiring data on hobbies and specific interests from the user, means for searching and collecting related information from the communication network, and means for pushing the aggregated information to the user. This enables the user to receive information and sales information that matches their interests and to carry out a simple purchase procedure.

[0321] A "user" is an individual who uses the system to input information based on their individual interests and hobbies, and to retrieve related data.

[0322] "Data" refers to information about hobbies and specific interests that users input, and it forms the basis for collecting related information based on that data.

[0323] A "communication network" refers to a wide-area information network, including the Internet, and is used to obtain information based on user interests.

[0324] "Information" refers to data retrieved and collected from communication networks, including news, trends, and product information related to the user's interests.

[0325] "Sales information" refers to data about products and services that users are interested in, including price, availability, and purchase possibility.

[0326] "Means" refers to a method or apparatus designed to achieve a specific purpose, and in the context of this patent, it refers to a method or apparatus that enables the execution of procedures related to the acquisition, display, and purchase of information.

[0327] A "server" refers to a system consisting of computers that receive data from users and retrieve and process related information from a communication network.

[0328] "Push notifications" refer to a function that automatically sends collected information and sales information to the user's device, providing the user with the latest information in real time.

[0329] To implement this invention, a terminal for inputting data on the user's hobbies and interests, a server for processing the data and collecting related information, and a user interface for displaying the information are required.

[0330] The server receives data about the user's interests entered using a device such as a smartphone. This data identifies the user's interests and serves as a basis for collecting relevant news, product information, events, etc., from the communication network. To accomplish this, the server uses a Python program and a scraping library (e.g., Beautiful Soup) to collect information from relevant websites and APIs and store it in a database.

[0331] The device provides users with collected information and notifies them of sales information for products and services based on their interests. This uses React Native, a mobile application development framework, to manage bidirectional communication between the user interface and the server.

[0332] For example, if a user expresses interest in a concert by a particular artist, the server constantly collects event information related to that artist and quickly displays information about when tickets go on sale. Based on this information, the user can quickly complete the purchase process on their terminal. In this process, existing payment platforms such as Stripe are integrated for electronic payments, ensuring secure and efficient transactions.

[0333] By utilizing information filtering and ranking functions powered by generative AI models, it becomes possible to provide information based on user priorities. As a result, users can receive more personalized information and have a purchasing experience closely related to their interests.

[0334] A concrete example of a prompt would be, "Please recommend concerts based on my interests, and if possible, let me buy tickets immediately." Using this prompt enables the rapid delivery of personalized content and recommendations for related products.

[0335] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0336] Step 1:

[0337] Users use a terminal to input data about their hobbies and interests. This input data includes the names and categories of things they are interested in (for example, specific artists or events). The entered data is then sent directly to the server.

[0338] Step 2:

[0339] The server analyzes the data received from the user and searches for relevant information from the communication network based on that data. Specifically, it uses a program written in Python to scrape data from multiple sources, including news sites, social networking services, and online forums. In this step, it generates search queries based on the interest data received as input and filters and collects relevant information.

[0340] Step 3:

[0341] The server uses a generation AI model to rank and filter the acquired information. The input is the raw data acquired in the previous step, and the output is a list of high-priority information aligned with the user's level of interest. Data processing includes text analysis and relevance score calculation to select the most relevant information for the user.

[0342] Step 4:

[0343] The terminal displays the ranked information sent from the server. In this step, the information is organized and a display frame is created using a user interface built with React Native to provide the user with visually easy-to-understand information.

[0344] Step 5:

[0345] Based on the displayed information, users select products and events that interest them. This selection information is then sent back to the server. User input includes product selections and purchase intentions.

[0346] Step 6:

[0347] The server collects sales information for selected products and events and executes the purchase process. It uses store APIs and event site APIs to check prices and inventory in real time and proceed with the purchase. Input is the user's selection information, and output is the success or failure of the purchase process.

[0348] Step 7:

[0349] The terminal notifies the user of the purchase process. Depending on the flow of the process, if the purchase is successful, it displays detailed information; if it fails, it provides retry options and an explanation of the reason.

[0350] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0351] This invention combines a system that efficiently collects and manages information related to a user's hobbies and specific interests with an emotion engine that recognizes the user's emotions. By analyzing the user's emotions, this system enables more personalized information delivery and optimization of the user experience.

[0352] Users input data about their hobbies and interests via their device. For example, if a user is interested in a particular music artist or movie, they can enter the artist's name or the movie title. This data is sent to the server.

[0353] The server searches the internet for and collects relevant information based on the data it receives. It utilizes multiple sources, such as news articles, social media posts, and fan forums, to gather the information most relevant to the user's interests. The server further filters and ranks the information, taking into account the user's priorities and level of interest.

[0354] This system incorporates an emotion engine that analyzes the user's emotional state. The emotion engine collects emotional data from the user's voice tone, input content, and operation patterns to create a user emotional profile. For example, if a user is looking for upbeat music, the emotion engine detects that upbeat emotion and prioritizes presenting information that evokes a cheerful atmosphere.

[0355] The device displays analysis results and collected information to the user. The displayed information is adjusted based on the user's emotional state, and the most relevant content is presented.

[0356] Furthermore, the server collects sales information on products and services related to the user's interests. This includes information such as product name, price, release date, and availability. The emotion engine can then display information at the time when the user's emotional state is most likely to increase their purchase intent.

[0357] When a user expresses interest in purchasing a specific product or service, the device sends that information to a server, which then processes the reservation or purchase on the online store or event site. The user is notified of the purchase result via the device, and further actions are suggested as needed.

[0358] This series of processes enables users to efficiently gather information about their areas of interest based on their emotions and to utilize that information and services in the most optimal way.

[0359] The following describes the processing flow.

[0360] Step 1:

[0361] Users use their devices to input information about their hobbies and interests. For example, they might enter the names of artists or movie titles they are interested in.

[0362] Step 2:

[0363] The device sends the information entered by the user to the server. This information is used as data indicating the user's hobbies and interests.

[0364] Step 3:

[0365] The server uses the received data to search for and collect relevant information from various sources on the internet. It explores sources such as news, social media, and forums, and collects relevant content.

[0366] Step 4:

[0367] The server analyzes the collected information, filtering and ranking it based on the user's priorities and interests. This process is crucial for selecting the most relevant information for the user.

[0368] Step 5:

[0369] The emotion engine analyzes user input, voice tone, and operation patterns obtained through the device to determine the user's emotional state. For example, it can infer emotions from the user's voice tone and speed.

[0370] Step 6:

[0371] Based on the sentiment analysis results from the sentiment engine, the server organizes information in the most relevant and appropriate format for the user and sends it to the terminal.

[0372] Step 7:

[0373] The device displays information sent from the server to the user. The information display is customized to take into account the user's emotional state and is adjusted to capture the user's interest.

[0374] Step 8:

[0375] The server collects sales information for products and services related to the user's interests. This involves utilizing APIs from online stores and event sites to retrieve information such as price, release date, and stock availability.

[0376] Step 9:

[0377] The emotion engine prioritizes presenting information about products and services that increase the user's desire to purchase, based on their emotional state.

[0378] Step 10:

[0379] Users select products and services they are interested in and communicate their purchase intention to the server via their device.

[0380] Step 11:

[0381] The server receives purchase requests from users and executes the reservation or purchase process for the specified goods or services.

[0382] Step 12:

[0383] The server notifies the user of the purchase result via the terminal. The user can then decide on their next course of action based on this information.

[0384] This process allows users to enjoy an appropriate information gathering and purchasing experience that is tailored to their emotions.

[0385] (Example 2)

[0386] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0387] Traditional information gathering systems can provide information based on users' hobbies and interests, but they cannot provide information that takes into account the user's emotional state. Therefore, there is a challenge in effectively presenting information that matches the user's current emotions and mood, and providing a truly personalized user experience. Furthermore, there is a lack of timely information provision about products and services that align with purchasing intent, potentially leading to missed opportunities.

[0388] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0389] In this invention, the server includes means for recognizing the user's emotional state and providing information based on the recognized emotions; means for filtering and ranking information and sales information based on the user's priority, level of interest, and emotional state; and means for collecting and processing the sales information using the API of a digital platform. This enables flexible and efficient information provision based on the user's emotions and interests, thereby optimizing the user experience.

[0390] A "user" is an individual or group that collects information based on specific hobbies or interests and makes decisions based on that information.

[0391] "Data" refers to information about hobbies and specific interests entered by users, and is the basic information that is processed by the system.

[0392] A "source of information" is an external data provider used to collect information from the internet or other digital platforms.

[0393] A "server" is a central management system that processes user requests and collects, analyzes, and provides relevant information.

[0394] "Emotional state" refers to the user's current mood and feelings, and is used as an indicator for information provided by the system.

[0395] "Filtering" is the process of selecting and discarding collected information based on the user's specific criteria and priorities.

[0396] "Ranking" is the process of assigning order to collected information based on the user's level of interest and importance.

[0397] A "digital platform" refers to an online marketplace or software service that provides information about products and services and forms an interface with users.

[0398] "API" stands for Application Programming Interface, and it refers to a technology that provides an interface for sharing functions and data between different software programs.

[0399] This invention is a system that collects information related to a user's hobbies and specific interests, analyzes it, and provides a more personalized experience. This system uses an emotion analysis engine to recognize the user's emotional state and optimizes the user experience by providing information based on those emotions.

[0400] Users first input data about their hobbies and interests via their device. Specifically, they can enter things like the names of music artists or movie titles. This input data is then sent from the device to the server.

[0401] The server uses this data to collect relevant information from sources on the internet. This could involve using web crawling technologies and APIs to collect news articles, social media posts, and comments on online forums.

[0402] Furthermore, the server incorporates an emotion engine that analyzes the user's emotional state. This analysis uses a generative AI model to analyze data such as the user's voice tone and input patterns. Based on the resulting emotional profile, the server filters and ranks information to select the information most relevant to the user.

[0403] For example, when a user is looking for upbeat music, the emotion engine can detect that upbeat emotion and prioritize displaying information about related music events. By implementing such a system, users can quickly access information that interests them and receive information that is relevant to them.

[0404] The device presents information received from the server to the user, and this information is adjusted according to the user's emotions. This presentation method allows users to easily enjoy content that matches their feelings.

[0405] An example of a prompt might be, "Please tell me about some new and fun music." This prompt allows the system to present content tailored to the user's mood or specific interests.

[0406] This system uses specific platform APIs to collect information about products and services, and by providing timely information tailored to the user's purchasing intent, it can enrich the user's lifestyle.

[0407] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0408] Step 1:

[0409] The user uses a terminal to input information about their hobbies and specific interests. This input data includes artist names and movie titles. This data is sent from the terminal to the server. For example, the user enters "latest movie information" and presses the submit button. The output of the input data is the user's interest data sent to the server.

[0410] Step 2:

[0411] The server uses the user's interest data to collect relevant information from the internet. This includes launching a web crawler to retrieve news articles, social media posts, forum comments, and other similar content. The input is the user's interest data, which is used to retrieve relevant information from various sources. The output is a list of the collected relevant information.

[0412] Step 3:

[0413] The server uses an emotion engine to analyze the user's emotional state. The emotion engine generates a user emotional profile by analyzing the user's voice tone and input text. The input in this step is the user's voice and text data, and the output is a profile indicating the user's emotional state.

[0414] Step 4:

[0415] The server filters and ranks the collected information based on the user's emotional profile. It prioritizes the most relevant information based on the emotional state. The input is the collected information and the user's emotional profile, and the output is a filtered list of information.

[0416] Step 5:

[0417] The device displays filtered information to the user. The information is presented in an optimized format, taking into account the user's emotional state. Specifically, the device displays "latest movie premium screening information" on its screen. The input is a filtered list of information, and the output is the information presented in a format that the user can review.

[0418] Step 6:

[0419] The server collects and displays sales information for products and services that the user has shown interest in, via a digital platform API. It presents information tailored to the user's purchasing intent. Specifically, the server retrieves "movie ticket inventory information" and sends it to the terminal. The input is information related to the user's purchasing intent, and the output is inventory and purchase information for the relevant product.

[0420] Step 7:

[0421] When a user purchases a specific product or service, the device sends a request to the server, which then processes the purchase on the online platform. The device is then notified of the purchase result. For example, the user selects "Purchase Movie Tickets" from the device, and the server completes the process. The input is the user's purchase request, and the output is the purchase completion notification.

[0422] (Application Example 2)

[0423] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0424] Users want to efficiently gather a lot of information based on their hobbies and specific interests, but because the information provided is not customized to their current emotional state or priorities, it is difficult for them to obtain the right information. Furthermore, mistiming the purchase of products or services they are interested in can lead to missed opportunities. Therefore, there is a need for a system that provides information considering the user's emotional state and optimizes the timing of purchases.

[0425] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0426] In this invention, the server includes means for recognizing the user's emotional state and creating a profile, means for providing personalized information based on the emotional profile, and means for executing reservation or purchase procedures based on the provided information. This enables the presentation of optimal information according to the user's emotions and the optimization of purchase timing.

[0427] A "user" is an individual or group that uses the system and is the entity that provides information related to hobbies or specific interests.

[0428] "Hobbies and specific interests" refer to activities or fields that users are interested in and want to learn more about.

[0429] "Information" refers to data, news, and content related to a user's hobbies and interests, and is collected via the internet.

[0430] A "communication network" is a general term for networks used to transmit information, such as the Internet, and is used for data retrieval and communication.

[0431] "Emotional state" refers to the user's current emotional state and psychological response, and is the subject of analysis by the system.

[0432] A "profile" is information that summarizes a user's characteristics and behavioral tendencies, and is used to optimize the user experience.

[0433] "Products and services" refers to items or services that a user is considering purchasing or using.

[0434] An "application interface" is a connection point used to exchange data between different software systems, and is also known as an API.

[0435] The system implementing this invention enables personalized information delivery by collecting information on the user's hobbies and specific interests, and further analyzing the user's emotional state. The overall system mainly includes a user terminal, a server, and an emotional analysis engine.

[0436] A user terminal is a device used by users to input data related to their hobbies and specific interests, and can be a smartphone, tablet, or computer. The entered data is transmitted to a server via the internet.

[0437] The server searches for and aggregates relevant information from the communication network based on the data it receives. Sources of information include news sites, social media, forums, and content distribution services. The server also uses a generative AI model to create a user sentiment profile from the aggregated information. This profile is processed by a sentiment analysis engine based on the user's voice, text input, and behavioral patterns.

[0438] After the information is processed on the server, it is displayed on the user's terminal. The displayed content is customized based on the user's emotional profile; for example, if a user wants to relax, relaxing music and scenic videos will be recommended first.

[0439] Furthermore, the server collects information on products and services related to the user's interests. For example, if a user expresses interest in a particular gadget, information such as its price, availability, and sales date will be displayed. The collection of this information and the purchasing process are carried out through the application interface of the online store or event site.

[0440] For example, if a user enters "I want to relax today," the sentiment analysis engine will recognize the user's mood as "relaxation-oriented" and recommend relaxing background music and scenic videos.

[0441] An example of a prompt message is: "Recommend content best suited to the user's mood. Input: I want to relax. Result: Relaxing background music and scenic videos." In this way, the system of the present invention provides optimal information and purchasing support tailored to the user's mood.

[0442] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0443] Step 1:

[0444] The user terminal is a device for inputting data related to hobbies and specific interests. Input is done via text or voice commands. This input data is collected as basic information to identify the user's hobbies and interests. The entered information is transmitted to a server via the internet.

[0445] Step 2:

[0446] The server searches for and collects relevant information from the communication network based on data received from user terminals. News sites, social media, forums, etc., are used as information sources. The server uses web crawlers and natural language processing technology to crawl diverse data sources and extract relevant information based on keywords. In this process, the server calculates the relevance of each piece of information based on the input data, collects the most relevant information, and ranks it based on each user's priority.

[0447] Step 3:

[0448] The server uses an emotion analysis engine to analyze emotional data from the user's voice tone, text input, and interaction patterns. The analyzed emotional data is then compiled into the user's current emotional profile. This profile identifies the user's current emotional state. For example, if a user enters "I want to relax today," their emotional state will be registered in the profile as "relaxed."

[0449] Step 4:

[0450] The server utilizes a generative AI model to provide personalized information to users, using emotional profiles and existing aggregated data. Specifically, it extracts and recommends highly relevant content (music, videos, etc.) based on the emotional profile. For example, a user with a "relaxation-oriented" profile will be given priority in calming background music and nature video content. Example prompt: "Recommend the most suitable content based on the user's emotional state. Input: I want to relax. Result: Relaxing background music and scenery videos."

[0451] Step 5:

[0452] The user's device receives information processed by the server and displays it to the user. This display is prioritized and adjusted based on the user's emotional profile, with the content most relevant to the user's current emotions being presented first. The user can then view the displayed content and explore further information on topics of interest.

[0453] Step 6:

[0454] The server collects and delivers information about products and services that users are interested in. This information includes price, availability, and sales dates. Through the application interface of an online store or event site, the server uses the collected information to automatically execute reservation or purchase procedures.

[0455] Step 7:

[0456] The user terminal notifies the user of the results of the purchase or reservation process. It then suggests the next action the user should take and continues to provide information to further optimize their purchasing decision. Based on this, the user can continuously manage the necessary actions.

[0457] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0458] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0459] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0460] [Third Embodiment]

[0461] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0462] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0463] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0464] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0465] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0466] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0467] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0468] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0469] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0470] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0471] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0472] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0473] This invention is a system for efficiently collecting and managing information about a user's hobbies and specific interests. Users input data about their hobbies and interests via a terminal. For example, if a user is interested in a particular artist or event, they input its name or category into the terminal.

[0474] The server searches various information sources on the internet based on data received from the user. These information sources are diverse, including news sites, social networking services, online forums, and official websites. The server collects relevant information, filters it based on the user's level of interest, and ranks it.

[0475] The device provides users with ranked information. Users can review the information presented through the device and understand news and trends that match their interests.

[0476] Furthermore, the server automatically collects sales information for products and tickets related to the user's interests. In this process, it uses APIs from online stores and event sites to obtain data such as product names, prices, release dates, and availability.

[0477] Users can use their device to select products or tickets they are interested in and indicate their intention to purchase. The device then sends the user's selection back to the server, which executes the purchase process. The user is notified of the success or failure of the facilitated purchase process.

[0478] This system allows users to easily gather information related to their interests and proceed directly to purchasing products and services, thus streamlining both information management and the purchasing process.

[0479] The following describes the processing flow.

[0480] Step 1:

[0481] Users use their devices to input information about their hobbies and interests. This information is provided in the form of specific artist names, event names, or genres.

[0482] Step 2:

[0483] The device sends information collected from the user to the server. This transmitted information serves as foundational data for building the user's interest profile.

[0484] Step 3:

[0485] The server searches the internet for information based on the user's interest profile that it receives. The search uses sources such as news sites, social media, forums, and official websites.

[0486] Step 4:

[0487] The server analyzes the information obtained from the search and selects the information most relevant to the user's interests. This process applies a filtering algorithm to rank the information based on the level of interest.

[0488] Step 5:

[0489] The server organizes the collected information and sends it to the terminal. The information is converted into a visually easy-to-understand format and prepared for easy access by the user.

[0490] Step 6:

[0491] The terminal displays information sent from the server to the user. The user can then review this displayed information and grasp the latest news and trends that interest them.

[0492] Step 7:

[0493] The server then collects information on products and tickets that match the user's interests. This collection process utilizes APIs from online stores and event sites.

[0494] Step 8:

[0495] The terminal displays product and ticket information that the user has shown interest in and confirms their purchase intention.

[0496] Step 9:

[0497] The user selects the products or tickets they wish to purchase through their device, and the device then sends this information to the server.

[0498] Step 10:

[0499] The server uses the submitted purchase information to process reservations or purchases on online stores and event websites.

[0500] Step 11:

[0501] The server sends the result of the purchase process to the terminal as either success or failure, and notifies the user.

[0502] Step 12:

[0503] Users can review the purchase results via their device and plan their next actions as needed.

[0504] Through this series of steps, users can efficiently gather information and purchase products.

[0505] (Example 1)

[0506] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0507] It is difficult for users to efficiently collect and manage information and products related to their hobbies and interests due to the fragmentation and information overload of traditional information sources. Furthermore, there are insufficient systems to obtain timely sales information about products and services that interest users and to make smooth purchases. As a result, users face the challenge of not being able to quickly and accurately collect and purchase information based on their interests.

[0508] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0509] In this invention, the server includes means for obtaining information on the user's interests, means for searching for and obtaining related information from an electronic network based on the information, and means for automatically collecting sales information on goods and services of interest to the user. This enables the user to efficiently and accurately collect information and products based on their interests and to execute a coordinated purchasing process.

[0510] An "information processing device" is a device whose purpose is to input data from users, collect information via a network, filter and rank information, and present information to users and perform purchase procedures.

[0511] A "user" refers to an entity that uses this information processing device to collect information related to their interests and concerns, and to purchase goods and services.

[0512] "Information related to areas of interest" refers to data and keywords related to the user's hobbies or specific fields of interest.

[0513] An "electronic network" refers to an electronic communication network, including the internet, and is a medium for collecting and transmitting information.

[0514] "Merchandise and services" refers to all products and services that users are interested in and consider purchasing.

[0515] A "communication protocol" refers to a standardized set of communication procedures used to exchange information between online stores, event sites, and other online platforms.

[0516] This invention provides an information processing device that allows users to efficiently collect and purchase information and products of interest. Specific embodiments are shown below.

[0517] The server receives information about the user's interests and searches for information sources via the electronic network. In doing so, the server utilizes a variety of information sources, including news sites, social networking services (SNS), and official website APIs. Based on the user's input, the server collects relevant information and further uses communication protocols from online stores and event information sites to obtain sales information for products and services of interest to the user.

[0518] The collected information is filtered and ranked based on the user's level of interest and priority. This allows users to efficiently access the information that interests them most, starting with the most relevant information.

[0519] The terminal serves to present ranked information from the server to the user. The user can review the information provided through the terminal and select products or services that interest them. Based on this selection, the server executes the purchase process and notifies the user of the result.

[0520] For example, if a user wants to attend the latest music festival, they enter keywords into their device, and the server collects relevant event information, including ticket sales information. The user then reviews the information through their device, selects the event tickets they are interested in, and indicates their intention to purchase them.

[0521] An example of a prompt for a generative AI model is: "Describe a system that collects relevant news and event information based on user interests, ranks and presents the most interesting items, and provides specific examples of a function that also provides sales information for related products." This prompt allows the generative AI model to support the provision of information based on user requests.

[0522] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0523] Step 1:

[0524] The user uses a terminal to input information about their interests and concerns. This input data includes specific event names, artist names, and so on. This input information is used as foundational data for the next processing step. The terminal then sends the input data to the server.

[0525] Step 2:

[0526] The server searches for information sources on the electronic network based on user input data received from the terminal. Specifically, the server uses APIs from news sites, social networking services, and official websites to collect relevant information. The server uses keyword search and information filtering algorithms to select the information most relevant to the user's interests. Through this process, a large amount of collected information is prepared for analysis in the next step.

[0527] Step 3:

[0528] The server filters and ranks the collected information based on user interest and priority. This process evaluates the importance and novelty of the information, arranging it in order of likelihood of high interest. Data processing utilizes techniques such as text analysis and natural language processing. The filtering and ranking results in a final list to be provided to the user.

[0529] Step 4:

[0530] The terminal presents the user with ranked information received from the server. The user reviews the information through the terminal and decides on their next action based on its content. The presented information is organized according to the user's interests, enabling efficient information review.

[0531] Step 5:

[0532] The server then collects sales information for products and services that the user may be interested in. This process utilizes communication protocols from online stores and event information sites to retrieve detailed information about products and services. The data collected includes product name, price, sales date, and availability. This information is prepared to be provided to the user as additional information.

[0533] Step 6:

[0534] The user selects products or services of interest through their device and indicates their intention to purchase or reserve them. The device sends this selection information to the server. The server executes the purchase process for the selected items and notifies the user of the result. This notification allows the user to confirm whether the transaction was successful.

[0535] (Application Example 1)

[0536] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0537] There is a need for the efficient collection and management of relevant information based on users' individual hobbies and specific interests. Furthermore, there is a need to simplify the purchasing process for goods and services, and to ensure a smooth flow from information to purchase. In particular, a challenge is to build a system that aggregates information reflecting user interests and sales information, and enables timely notifications tailored to user needs.

[0538] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0539] In this invention, the server includes means for acquiring data on hobbies and specific interests from the user, means for searching and collecting related information from the communication network, and means for pushing the aggregated information to the user. This enables the user to receive information and sales information that matches their interests and to carry out a simple purchase procedure.

[0540] A "user" is an individual who uses the system to input information based on their individual interests and hobbies, and to retrieve related data.

[0541] "Data" refers to information about hobbies and specific interests that users input, and it forms the basis for collecting related information based on that data.

[0542] A "communication network" refers to a wide-area information network, including the Internet, and is used to obtain information based on user interests.

[0543] "Information" refers to data retrieved and collected from communication networks, including news, trends, and product information related to the user's interests.

[0544] "Sales information" refers to data about products and services that users are interested in, including price, availability, and purchase possibility.

[0545] "Means" refers to a method or apparatus designed to achieve a specific purpose, and in the context of this patent, it refers to a method or apparatus that enables the execution of procedures related to the acquisition, display, and purchase of information.

[0546] A "server" refers to a system consisting of computers that receive data from users and retrieve and process related information from a communication network.

[0547] "Push notifications" refer to a function that automatically sends collected information and sales information to the user's device, providing the user with the latest information in real time.

[0548] To implement this invention, a terminal for inputting data on the user's hobbies and interests, a server for processing the data and collecting related information, and a user interface for displaying the information are required.

[0549] The server receives data about the user's interests entered using a device such as a smartphone. This data identifies the user's interests and serves as a basis for collecting relevant news, product information, events, etc., from the communication network. To accomplish this, the server uses a Python program and a scraping library (e.g., Beautiful Soup) to collect information from relevant websites and APIs and store it in a database.

[0550] The device provides users with collected information and notifies them of sales information for products and services based on their interests. This uses React Native, a mobile application development framework, to manage bidirectional communication between the user interface and the server.

[0551] For example, if a user expresses interest in a concert by a particular artist, the server constantly collects event information related to that artist and quickly displays information about when tickets go on sale. Based on this information, the user can quickly complete the purchase process on their terminal. In this process, existing payment platforms such as Stripe are integrated for electronic payments, ensuring secure and efficient transactions.

[0552] By utilizing information filtering and ranking functions powered by generative AI models, it becomes possible to provide information based on user priorities. As a result, users can receive more personalized information and have a purchasing experience closely related to their interests.

[0553] A concrete example of a prompt would be, "Please recommend concerts based on my interests, and if possible, let me buy tickets immediately." Using this prompt enables the rapid delivery of personalized content and recommendations for related products.

[0554] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0555] Step 1:

[0556] Users use a terminal to input data about their hobbies and interests. This input data includes the names and categories of things they are interested in (for example, specific artists or events). The entered data is then sent directly to the server.

[0557] Step 2:

[0558] The server analyzes the data received from the user and searches for relevant information from the communication network based on that data. Specifically, it uses a program written in Python to scrape data from multiple sources, including news sites, social networking services, and online forums. In this step, it generates search queries based on the interest data received as input and filters and collects relevant information.

[0559] Step 3:

[0560] The server uses a generation AI model to rank and filter the acquired information. The input is the raw data acquired in the previous step, and the output is a list of high-priority information aligned with the user's level of interest. Data processing includes text analysis and relevance score calculation to select the most relevant information for the user.

[0561] Step 4:

[0562] The terminal displays the ranked information sent from the server. In this step, the information is organized and a display frame is created using a user interface built with React Native to provide the user with visually easy-to-understand information.

[0563] Step 5:

[0564] Based on the displayed information, users select products and events that interest them. This selection information is then sent back to the server. User input includes product selections and purchase intentions.

[0565] Step 6:

[0566] The server collects sales information for selected products and events and executes the purchase process. It uses store APIs and event site APIs to check prices and inventory in real time and proceed with the purchase. Input is the user's selection information, and output is the success or failure of the purchase process.

[0567] Step 7:

[0568] The terminal notifies the user of the purchase process. Depending on the flow of the process, if the purchase is successful, it displays detailed information; if it fails, it provides retry options and an explanation of the reason.

[0569] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0570] This invention combines a system that efficiently collects and manages information related to a user's hobbies and specific interests with an emotion engine that recognizes the user's emotions. By analyzing the user's emotions, this system enables more personalized information delivery and optimization of the user experience.

[0571] Users input data about their hobbies and interests via their device. For example, if a user is interested in a particular music artist or movie, they can enter the artist's name or the movie title. This data is sent to the server.

[0572] The server searches the internet for and collects relevant information based on the data it receives. It utilizes multiple sources, such as news articles, social media posts, and fan forums, to gather the information most relevant to the user's interests. The server further filters and ranks the information, taking into account the user's priorities and level of interest.

[0573] This system incorporates an emotion engine that analyzes the user's emotional state. The emotion engine collects emotional data from the user's voice tone, input content, and operation patterns to create a user emotional profile. For example, if a user is looking for upbeat music, the emotion engine detects that upbeat emotion and prioritizes presenting information that evokes a cheerful atmosphere.

[0574] The device displays analysis results and collected information to the user. The displayed information is adjusted based on the user's emotional state, and the most relevant content is presented.

[0575] Furthermore, the server collects sales information on products and services related to the user's interests. This includes information such as product name, price, release date, and availability. The emotion engine can then display information at the time when the user's emotional state is most likely to increase their purchase intent.

[0576] When a user expresses interest in purchasing a specific product or service, the device sends that information to a server, which then processes the reservation or purchase on the online store or event site. The user is notified of the purchase result via the device, and further actions are suggested as needed.

[0577] This series of processes enables users to efficiently gather information about their areas of interest based on their emotions and to utilize that information and services in the most optimal way.

[0578] The following describes the processing flow.

[0579] Step 1:

[0580] Users use their devices to input information about their hobbies and interests. For example, they might enter the names of artists or movie titles they are interested in.

[0581] Step 2:

[0582] The device sends the information entered by the user to the server. This information is used as data indicating the user's hobbies and interests.

[0583] Step 3:

[0584] The server uses the received data to search for and collect relevant information from various sources on the internet. It explores sources such as news, social media, and forums, and collects relevant content.

[0585] Step 4:

[0586] The server analyzes the collected information, filtering and ranking it based on the user's priorities and interests. This process is crucial for selecting the most relevant information for the user.

[0587] Step 5:

[0588] The emotion engine analyzes user input, voice tone, and operation patterns obtained through the device to determine the user's emotional state. For example, it can infer emotions from the user's voice tone and speed.

[0589] Step 6:

[0590] Based on the sentiment analysis results from the sentiment engine, the server organizes information in the most relevant and appropriate format for the user and sends it to the terminal.

[0591] Step 7:

[0592] The device displays information sent from the server to the user. The information display is customized to take into account the user's emotional state and is adjusted to capture the user's interest.

[0593] Step 8:

[0594] The server collects sales information for products and services related to the user's interests. This involves utilizing APIs from online stores and event sites to retrieve information such as price, release date, and stock availability.

[0595] Step 9:

[0596] The emotion engine prioritizes presenting information about products and services that increase the user's desire to purchase, based on their emotional state.

[0597] Step 10:

[0598] Users select products and services they are interested in and communicate their purchase intention to the server via their device.

[0599] Step 11:

[0600] The server receives purchase requests from users and executes the reservation or purchase process for the specified goods or services.

[0601] Step 12:

[0602] The server notifies the user of the purchase result via the terminal. The user can then decide on their next course of action based on this information.

[0603] This process allows users to enjoy an appropriate information gathering and purchasing experience that is tailored to their emotions.

[0604] (Example 2)

[0605] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0606] Traditional information gathering systems can provide information based on users' hobbies and interests, but they cannot provide information that takes into account the user's emotional state. Therefore, there is a challenge in effectively presenting information that matches the user's current emotions and mood, and providing a truly personalized user experience. Furthermore, there is a lack of timely information provision about products and services that align with purchasing intent, potentially leading to missed opportunities.

[0607] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0608] In this invention, the server includes means for recognizing the user's emotional state and providing information based on the recognized emotions; means for filtering and ranking information and sales information based on the user's priority, level of interest, and emotional state; and means for collecting and processing the sales information using the API of a digital platform. This enables flexible and efficient information provision based on the user's emotions and interests, thereby optimizing the user experience.

[0609] A "user" is an individual or group that collects information based on specific hobbies or interests and makes decisions based on that information.

[0610] "Data" refers to information about hobbies and specific interests entered by users, and is the basic information that is processed by the system.

[0611] A "source of information" is an external data provider used to collect information from the internet or other digital platforms.

[0612] A "server" is a central management system that processes user requests and collects, analyzes, and provides relevant information.

[0613] "Emotional state" refers to the user's current mood and feelings, and is used as an indicator for information provided by the system.

[0614] "Filtering" is the process of selecting and discarding collected information based on the user's specific criteria and priorities.

[0615] "Ranking" is the process of assigning order to collected information based on the user's level of interest and importance.

[0616] A "digital platform" refers to an online marketplace or software service that provides information about products and services and forms an interface with users.

[0617] "API" stands for Application Programming Interface, and it refers to a technology that provides an interface for sharing functions and data between different software programs.

[0618] This invention is a system that collects information related to a user's hobbies and specific interests, analyzes it, and provides a more personalized experience. This system uses an emotion analysis engine to recognize the user's emotional state and optimizes the user experience by providing information based on those emotions.

[0619] Users first input data about their hobbies and interests via their device. Specifically, they can enter things like the names of music artists or movie titles. This input data is then sent from the device to the server.

[0620] The server uses this data to collect relevant information from sources on the internet. This could involve using web crawling technologies and APIs to collect news articles, social media posts, and comments on online forums.

[0621] Furthermore, the server incorporates an emotion engine that analyzes the user's emotional state. This analysis uses a generative AI model to analyze data such as the user's voice tone and input patterns. Based on the resulting emotional profile, the server filters and ranks information to select the information most relevant to the user.

[0622] For example, when a user is looking for upbeat music, the emotion engine can detect that upbeat emotion and prioritize displaying information about related music events. By implementing such a system, users can quickly access information that interests them and receive information that is relevant to them.

[0623] The device presents information received from the server to the user, and this information is adjusted according to the user's emotions. This presentation method allows users to easily enjoy content that matches their feelings.

[0624] An example of a prompt might be, "Please tell me about some new and fun music." This prompt allows the system to present content tailored to the user's mood or specific interests.

[0625] This system uses specific platform APIs to collect information about products and services, and by providing timely information tailored to the user's purchasing intent, it can enrich the user's lifestyle.

[0626] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0627] Step 1:

[0628] The user uses a terminal to input information about their hobbies and specific interests. This input data includes artist names and movie titles. This data is sent from the terminal to the server. For example, the user enters "latest movie information" and presses the submit button. The output of the input data is the user's interest data sent to the server.

[0629] Step 2:

[0630] The server uses the user's interest data to collect relevant information from the internet. This includes launching a web crawler to retrieve news articles, social media posts, forum comments, and other similar content. The input is the user's interest data, which is used to retrieve relevant information from various sources. The output is a list of the collected relevant information.

[0631] Step 3:

[0632] The server uses an emotion engine to analyze the user's emotional state. The emotion engine generates a user emotional profile by analyzing the user's voice tone and input text. The input in this step is the user's voice and text data, and the output is a profile indicating the user's emotional state.

[0633] Step 4:

[0634] The server filters and ranks the collected information based on the user's emotional profile. It prioritizes the most relevant information based on the emotional state. The input is the collected information and the user's emotional profile, and the output is a filtered list of information.

[0635] Step 5:

[0636] The device displays filtered information to the user. The information is presented in an optimized format, taking into account the user's emotional state. Specifically, the device displays "latest movie premium screening information" on its screen. The input is a filtered list of information, and the output is the information presented in a format that the user can review.

[0637] Step 6:

[0638] The server collects and displays sales information for products and services that the user has shown interest in, via a digital platform API. It presents information tailored to the user's purchasing intent. Specifically, the server retrieves "movie ticket inventory information" and sends it to the terminal. The input is information related to the user's purchasing intent, and the output is inventory and purchase information for the relevant product.

[0639] Step 7:

[0640] When a user purchases a specific product or service, the device sends a request to the server, which then processes the purchase on the online platform. The device is then notified of the purchase result. For example, the user selects "Purchase Movie Tickets" from the device, and the server completes the process. The input is the user's purchase request, and the output is the purchase completion notification.

[0641] (Application Example 2)

[0642] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0643] Users want to efficiently gather a lot of information based on their hobbies and specific interests, but because the information provided is not customized to their current emotional state or priorities, it is difficult for them to obtain the right information. Furthermore, mistiming the purchase of products or services they are interested in can lead to missed opportunities. Therefore, there is a need for a system that provides information considering the user's emotional state and optimizes the timing of purchases.

[0644] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0645] In this invention, the server includes means for recognizing the user's emotional state and creating a profile, means for providing personalized information based on the emotional profile, and means for executing reservation or purchase procedures based on the provided information. This enables the presentation of optimal information according to the user's emotions and the optimization of purchase timing.

[0646] A "user" is an individual or group that uses the system and is the entity that provides information related to hobbies or specific interests.

[0647] "Hobbies and specific interests" refer to activities or fields that users are interested in and want to learn more about.

[0648] "Information" refers to data, news, and content related to a user's hobbies and interests, and is collected via the internet.

[0649] A "communication network" is a general term for networks used to transmit information, such as the Internet, and is used for data retrieval and communication.

[0650] "Emotional state" refers to the user's current emotional state and psychological response, and is the subject of analysis by the system.

[0651] A "profile" is information that summarizes a user's characteristics and behavioral tendencies, and is used to optimize the user experience.

[0652] "Products and services" refers to items or services that a user is considering purchasing or using.

[0653] An "application interface" is a connection point used to exchange data between different software systems, and is also known as an API.

[0654] The system implementing this invention enables personalized information delivery by collecting information on the user's hobbies and specific interests, and further analyzing the user's emotional state. The overall system mainly includes a user terminal, a server, and an emotional analysis engine.

[0655] A user terminal is a device used by users to input data related to their hobbies and specific interests, and can be a smartphone, tablet, or computer. The entered data is transmitted to a server via the internet.

[0656] The server searches for and aggregates relevant information from the communication network based on the data it receives. Sources of information include news sites, social media, forums, and content distribution services. The server also uses a generative AI model to create a user sentiment profile from the aggregated information. This profile is processed by a sentiment analysis engine based on the user's voice, text input, and behavioral patterns.

[0657] After the information is processed on the server, it is displayed on the user's terminal. The displayed content is customized based on the user's emotional profile; for example, if a user wants to relax, relaxing music and scenic videos will be recommended first.

[0658] Furthermore, the server collects information on products and services related to the user's interests. For example, if a user expresses interest in a particular gadget, information such as its price, availability, and sales date will be displayed. The collection of this information and the purchasing process are carried out through the application interface of the online store or event site.

[0659] For example, if a user enters "I want to relax today," the sentiment analysis engine will recognize the user's mood as "relaxation-oriented" and recommend relaxing background music and scenic videos.

[0660] An example of a prompt message is: "Recommend content best suited to the user's mood. Input: I want to relax. Result: Relaxing background music and scenic videos." In this way, the system of the present invention provides optimal information and purchasing support tailored to the user's mood.

[0661] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0662] Step 1:

[0663] The user terminal is a device for inputting data related to hobbies and specific interests. Input is done via text or voice commands. This input data is collected as basic information to identify the user's hobbies and interests. The entered information is transmitted to a server via the internet.

[0664] Step 2:

[0665] The server searches for and collects relevant information from the communication network based on data received from user terminals. News sites, social media, forums, etc., are used as information sources. The server uses web crawlers and natural language processing technology to crawl diverse data sources and extract relevant information based on keywords. In this process, the server calculates the relevance of each piece of information based on the input data, collects the most relevant information, and ranks it based on each user's priority.

[0666] Step 3:

[0667] The server uses an emotion analysis engine to analyze emotional data from the user's voice tone, text input, and interaction patterns. The analyzed emotional data is then compiled into the user's current emotional profile. This profile identifies the user's current emotional state. For example, if a user enters "I want to relax today," their emotional state will be registered in the profile as "relaxed."

[0668] Step 4:

[0669] The server utilizes a generative AI model to provide personalized information to users, using emotional profiles and existing aggregated data. Specifically, it extracts and recommends highly relevant content (music, videos, etc.) based on the emotional profile. For example, a user with a "relaxation-oriented" profile will be given priority in calming background music and nature video content. Example prompt: "Recommend the most suitable content based on the user's emotional state. Input: I want to relax. Result: Relaxing background music and scenery videos."

[0670] Step 5:

[0671] The user's device receives information processed by the server and displays it to the user. This display is prioritized and adjusted based on the user's emotional profile, with the content most relevant to the user's current emotions being presented first. The user can then view the displayed content and explore further information on topics of interest.

[0672] Step 6:

[0673] The server collects and delivers information about products and services that users are interested in. This information includes price, availability, and sales dates. Through the application interface of an online store or event site, the server uses the collected information to automatically execute reservation or purchase procedures.

[0674] Step 7:

[0675] The user terminal notifies the user of the results of the purchase or reservation process. It then suggests the next action the user should take and continues to provide information to further optimize their purchasing decision. Based on this, the user can continuously manage the necessary actions.

[0676] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0677] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0678] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0679] [Fourth Embodiment]

[0680] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0681] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0682] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0683] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0684] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0685] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0686] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0687] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0688] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0689] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0690] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0691] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0692] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0693] This invention is a system for efficiently collecting and managing information about a user's hobbies and specific interests. Users input data about their hobbies and interests via a terminal. For example, if a user is interested in a particular artist or event, they input its name or category into the terminal.

[0694] The server searches various information sources on the internet based on data received from the user. These information sources are diverse, including news sites, social networking services, online forums, and official websites. The server collects relevant information, filters it based on the user's level of interest, and ranks it.

[0695] The device provides users with ranked information. Users can review the information presented through the device and understand news and trends that match their interests.

[0696] Furthermore, the server automatically collects sales information for products and tickets related to the user's interests. In this process, it uses APIs from online stores and event sites to obtain data such as product names, prices, release dates, and availability.

[0697] Users can use their device to select products or tickets they are interested in and indicate their intention to purchase. The device then sends the user's selection back to the server, which executes the purchase process. The user is notified of the success or failure of the facilitated purchase process.

[0698] This system allows users to easily gather information related to their interests and proceed directly to purchasing products and services, thus streamlining both information management and the purchasing process.

[0699] The following describes the processing flow.

[0700] Step 1:

[0701] Users use their devices to input information about their hobbies and interests. This information is provided in the form of specific artist names, event names, or genres.

[0702] Step 2:

[0703] The device sends information collected from the user to the server. This transmitted information serves as foundational data for building the user's interest profile.

[0704] Step 3:

[0705] The server searches the internet for information based on the user's interest profile that it receives. The search uses sources such as news sites, social media, forums, and official websites.

[0706] Step 4:

[0707] The server analyzes the information obtained from the search and selects the information most relevant to the user's interests. This process applies a filtering algorithm to rank the information based on the level of interest.

[0708] Step 5:

[0709] The server organizes the collected information and sends it to the terminal. The information is converted into a visually easy-to-understand format and prepared for easy access by the user.

[0710] Step 6:

[0711] The terminal displays information sent from the server to the user. The user can then review this displayed information and grasp the latest news and trends that interest them.

[0712] Step 7:

[0713] The server then collects information on products and tickets that match the user's interests. This collection process utilizes APIs from online stores and event sites.

[0714] Step 8:

[0715] The terminal displays product and ticket information that the user has shown interest in and confirms their purchase intention.

[0716] Step 9:

[0717] The user selects the products or tickets they wish to purchase through their device, and the device then sends this information to the server.

[0718] Step 10:

[0719] The server uses the submitted purchase information to process reservations or purchases on online stores and event websites.

[0720] Step 11:

[0721] The server sends the result of the purchase process to the terminal as either success or failure, and notifies the user.

[0722] Step 12:

[0723] Users can review the purchase results via their device and plan their next actions as needed.

[0724] Through this series of steps, users can efficiently gather information and purchase products.

[0725] (Example 1)

[0726] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0727] It is difficult for users to efficiently collect and manage information and products related to their hobbies and interests due to the fragmentation and information overload of traditional information sources. Furthermore, there are insufficient systems to obtain timely sales information about products and services that interest users and to make smooth purchases. As a result, users face the challenge of not being able to quickly and accurately collect and purchase information based on their interests.

[0728] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0729] In this invention, the server includes means for obtaining information on the user's interests, means for searching for and obtaining related information from an electronic network based on the information, and means for automatically collecting sales information on goods and services of interest to the user. This enables the user to efficiently and accurately collect information and products based on their interests and to execute a coordinated purchasing process.

[0730] An "information processing device" is a device whose purpose is to input data from users, collect information via a network, filter and rank information, and present information to users and perform purchase procedures.

[0731] A "user" refers to an entity that uses this information processing device to collect information related to their interests and concerns, and to purchase goods and services.

[0732] "Information related to areas of interest" refers to data and keywords related to the user's hobbies or specific fields of interest.

[0733] An "electronic network" refers to an electronic communication network, including the internet, and is a medium for collecting and transmitting information.

[0734] "Merchandise and services" refers to all products and services that users are interested in and consider purchasing.

[0735] A "communication protocol" refers to a standardized set of communication procedures used to exchange information between online stores, event sites, and other online platforms.

[0736] This invention provides an information processing device that allows users to efficiently collect and purchase information and products of interest. Specific embodiments are shown below.

[0737] The server receives information about the user's interests and searches for information sources via the electronic network. In doing so, the server utilizes a variety of information sources, including news sites, social networking services (SNS), and official website APIs. Based on the user's input, the server collects relevant information and further uses communication protocols from online stores and event information sites to obtain sales information for products and services of interest to the user.

[0738] The collected information is filtered and ranked based on the user's level of interest and priority. This allows users to efficiently access the information that interests them most, starting with the most relevant information.

[0739] The terminal serves to present ranked information from the server to the user. The user can review the information provided through the terminal and select products or services that interest them. Based on this selection, the server executes the purchase process and notifies the user of the result.

[0740] For example, if a user wants to attend the latest music festival, they enter keywords into their device, and the server collects relevant event information, including ticket sales information. The user then reviews the information through their device, selects the event tickets they are interested in, and indicates their intention to purchase them.

[0741] An example of a prompt for a generative AI model is: "Describe a system that collects relevant news and event information based on user interests, ranks and presents the most interesting items, and provides specific examples of a function that also provides sales information for related products." This prompt allows the generative AI model to support the provision of information based on user requests.

[0742] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0743] Step 1:

[0744] The user uses a terminal to input information about their interests and concerns. This input data includes specific event names, artist names, and so on. This input information is used as foundational data for the next processing step. The terminal then sends the input data to the server.

[0745] Step 2:

[0746] The server searches for information sources on the electronic network based on user input data received from the terminal. Specifically, the server uses APIs from news sites, social networking services, and official websites to collect relevant information. The server uses keyword search and information filtering algorithms to select the information most relevant to the user's interests. Through this process, a large amount of collected information is prepared for analysis in the next step.

[0747] Step 3:

[0748] The server filters and ranks the collected information based on user interest and priority. This process evaluates the importance and novelty of the information, arranging it in order of likelihood of high interest. Data processing utilizes techniques such as text analysis and natural language processing. The filtering and ranking results in a final list to be provided to the user.

[0749] Step 4:

[0750] The terminal presents the user with ranked information received from the server. The user reviews the information through the terminal and decides on their next action based on its content. The presented information is organized according to the user's interests, enabling efficient information review.

[0751] Step 5:

[0752] The server then collects sales information for products and services that the user may be interested in. This process utilizes communication protocols from online stores and event information sites to retrieve detailed information about products and services. The data collected includes product name, price, sales date, and availability. This information is prepared to be provided to the user as additional information.

[0753] Step 6:

[0754] The user selects products or services of interest through their device and indicates their intention to purchase or reserve them. The device sends this selection information to the server. The server executes the purchase process for the selected items and notifies the user of the result. This notification allows the user to confirm whether the transaction was successful.

[0755] (Application Example 1)

[0756] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0757] There is a need for the efficient collection and management of relevant information based on users' individual hobbies and specific interests. Furthermore, there is a need to simplify the purchasing process for goods and services, and to ensure a smooth flow from information to purchase. In particular, a challenge is to build a system that aggregates information reflecting user interests and sales information, and enables timely notifications tailored to user needs.

[0758] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0759] In this invention, the server includes means for acquiring data on hobbies and specific interests from the user, means for searching and collecting related information from the communication network, and means for pushing the aggregated information to the user. This enables the user to receive information and sales information that matches their interests and to carry out a simple purchase procedure.

[0760] A "user" is an individual who uses the system to input information based on their individual interests and hobbies, and to retrieve related data.

[0761] "Data" refers to information about hobbies and specific interests that users input, and it forms the basis for collecting related information based on that data.

[0762] A "communication network" refers to a wide-area information network, including the Internet, and is used to obtain information based on user interests.

[0763] "Information" refers to data retrieved and collected from communication networks, including news, trends, and product information related to the user's interests.

[0764] "Sales information" refers to data about products and services that users are interested in, including price, availability, and purchase possibility.

[0765] "Means" refers to a method or apparatus designed to achieve a specific purpose, and in the context of this patent, it refers to a method or apparatus that enables the execution of procedures related to the acquisition, display, and purchase of information.

[0766] A "server" refers to a system consisting of computers that receive data from users and retrieve and process related information from a communication network.

[0767] "Push notifications" refer to a function that automatically sends collected information and sales information to the user's device, providing the user with the latest information in real time.

[0768] To implement this invention, a terminal for inputting data on the user's hobbies and interests, a server for processing the data and collecting related information, and a user interface for displaying the information are required.

[0769] The server receives data about the user's interests entered using a device such as a smartphone. This data identifies the user's interests and serves as a basis for collecting relevant news, product information, events, etc., from the communication network. To accomplish this, the server uses a Python program and a scraping library (e.g., Beautiful Soup) to collect information from relevant websites and APIs and store it in a database.

[0770] The device provides users with collected information and notifies them of sales information for products and services based on their interests. This uses React Native, a mobile application development framework, to manage bidirectional communication between the user interface and the server.

[0771] For example, if a user expresses interest in a concert by a particular artist, the server constantly collects event information related to that artist and quickly displays information about when tickets go on sale. Based on this information, the user can quickly complete the purchase process on their terminal. In this process, existing payment platforms such as Stripe are integrated for electronic payments, ensuring secure and efficient transactions.

[0772] By utilizing information filtering and ranking functions powered by generative AI models, it becomes possible to provide information based on user priorities. As a result, users can receive more personalized information and have a purchasing experience closely related to their interests.

[0773] A concrete example of a prompt would be, "Please recommend concerts based on my interests, and if possible, let me buy tickets immediately." Using this prompt enables the rapid delivery of personalized content and recommendations for related products.

[0774] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0775] Step 1:

[0776] Users use a terminal to input data about their hobbies and interests. This input data includes the names and categories of things they are interested in (for example, specific artists or events). The entered data is then sent directly to the server.

[0777] Step 2:

[0778] The server analyzes the data received from the user and searches for relevant information from the communication network based on that data. Specifically, it uses a program written in Python to scrape data from multiple sources, including news sites, social networking services, and online forums. In this step, it generates search queries based on the interest data received as input and filters and collects relevant information.

[0779] Step 3:

[0780] The server uses a generation AI model to rank and filter the acquired information. The input is the raw data acquired in the previous step, and the output is a list of high-priority information aligned with the user's level of interest. Data processing includes text analysis and relevance score calculation to select the most relevant information for the user.

[0781] Step 4:

[0782] The terminal displays the ranked information sent from the server. In this step, the information is organized and a display frame is created using a user interface built with React Native to provide the user with visually easy-to-understand information.

[0783] Step 5:

[0784] Based on the displayed information, users select products and events that interest them. This selection information is then sent back to the server. User input includes product selections and purchase intentions.

[0785] Step 6:

[0786] The server collects sales information for selected products and events and executes the purchase process. It uses store APIs and event site APIs to check prices and inventory in real time and proceed with the purchase. Input is the user's selection information, and output is the success or failure of the purchase process.

[0787] Step 7:

[0788] The terminal notifies the user of the purchase process. Depending on the flow of the process, if the purchase is successful, it displays detailed information; if it fails, it provides retry options and an explanation of the reason.

[0789] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0790] This invention combines a system that efficiently collects and manages information related to a user's hobbies and specific interests with an emotion engine that recognizes the user's emotions. By analyzing the user's emotions, this system enables more personalized information delivery and optimization of the user experience.

[0791] Users input data about their hobbies and interests via their device. For example, if a user is interested in a particular music artist or movie, they can enter the artist's name or the movie title. This data is sent to the server.

[0792] The server searches the internet for and collects relevant information based on the data it receives. It utilizes multiple sources, such as news articles, social media posts, and fan forums, to gather the information most relevant to the user's interests. The server further filters and ranks the information, taking into account the user's priorities and level of interest.

[0793] This system incorporates an emotion engine that analyzes the user's emotional state. The emotion engine collects emotional data from the user's voice tone, input content, and operation patterns to create a user emotional profile. For example, if a user is looking for upbeat music, the emotion engine detects that upbeat emotion and prioritizes presenting information that evokes a cheerful atmosphere.

[0794] The device displays analysis results and collected information to the user. The displayed information is adjusted based on the user's emotional state, and the most relevant content is presented.

[0795] Furthermore, the server collects sales information on products and services related to the user's interests. This includes information such as product name, price, release date, and availability. The emotion engine can then display information at the time when the user's emotional state is most likely to increase their purchase intent.

[0796] When a user expresses interest in purchasing a specific product or service, the device sends that information to a server, which then processes the reservation or purchase on the online store or event site. The user is notified of the purchase result via the device, and further actions are suggested as needed.

[0797] This series of processes enables users to efficiently gather information about their areas of interest based on their emotions and to utilize that information and services in the most optimal way.

[0798] The following describes the processing flow.

[0799] Step 1:

[0800] Users use their devices to input information about their hobbies and interests. For example, they might enter the names of artists or movie titles they are interested in.

[0801] Step 2:

[0802] The device sends the information entered by the user to the server. This information is used as data indicating the user's hobbies and interests.

[0803] Step 3:

[0804] The server uses the received data to search for and collect relevant information from various sources on the internet. It explores sources such as news, social media, and forums, and collects relevant content.

[0805] Step 4:

[0806] The server analyzes the collected information, filtering and ranking it based on the user's priorities and interests. This process is crucial for selecting the most relevant information for the user.

[0807] Step 5:

[0808] The emotion engine analyzes user input, voice tone, and operation patterns obtained through the device to determine the user's emotional state. For example, it can infer emotions from the user's voice tone and speed.

[0809] Step 6:

[0810] Based on the sentiment analysis results from the sentiment engine, the server organizes information in the most relevant and appropriate format for the user and sends it to the terminal.

[0811] Step 7:

[0812] The device displays information sent from the server to the user. The information display is customized to take into account the user's emotional state and is adjusted to capture the user's interest.

[0813] Step 8:

[0814] The server collects sales information for products and services related to the user's interests. This involves utilizing APIs from online stores and event sites to retrieve information such as price, release date, and stock availability.

[0815] Step 9:

[0816] The emotion engine prioritizes presenting information about products and services that increase the user's desire to purchase, based on their emotional state.

[0817] Step 10:

[0818] Users select products and services they are interested in and communicate their purchase intention to the server via their device.

[0819] Step 11:

[0820] The server receives purchase requests from users and executes the reservation or purchase process for the specified goods or services.

[0821] Step 12:

[0822] The server notifies the user of the purchase result via the terminal. The user can then decide on their next course of action based on this information.

[0823] This process allows users to enjoy an appropriate information gathering and purchasing experience that is tailored to their emotions.

[0824] (Example 2)

[0825] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0826] Traditional information gathering systems can provide information based on users' hobbies and interests, but they cannot provide information that takes into account the user's emotional state. Therefore, there is a challenge in effectively presenting information that matches the user's current emotions and mood, and providing a truly personalized user experience. Furthermore, there is a lack of timely information provision about products and services that align with purchasing intent, potentially leading to missed opportunities.

[0827] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0828] In this invention, the server includes means for recognizing the user's emotional state and providing information based on the recognized emotions; means for filtering and ranking information and sales information based on the user's priority, level of interest, and emotional state; and means for collecting and processing the sales information using the API of a digital platform. This enables flexible and efficient information provision based on the user's emotions and interests, thereby optimizing the user experience.

[0829] A "user" is an individual or group that collects information based on specific hobbies or interests and makes decisions based on that information.

[0830] "Data" refers to information about hobbies and specific interests entered by users, and is the basic information that is processed by the system.

[0831] A "source of information" is an external data provider used to collect information from the internet or other digital platforms.

[0832] A "server" is a central management system that processes user requests and collects, analyzes, and provides relevant information.

[0833] "Emotional state" refers to the user's current mood and feelings, and is used as an indicator for information provided by the system.

[0834] "Filtering" is the process of selecting and discarding collected information based on the user's specific criteria and priorities.

[0835] "Ranking" is the process of assigning order to collected information based on the user's level of interest and importance.

[0836] A "digital platform" refers to an online marketplace or software service that provides information about products and services and forms an interface with users.

[0837] "API" stands for Application Programming Interface, and it refers to a technology that provides an interface for sharing functions and data between different software programs.

[0838] This invention is a system that collects information related to a user's hobbies and specific interests, analyzes it, and provides a more personalized experience. This system uses an emotion analysis engine to recognize the user's emotional state and optimizes the user experience by providing information based on those emotions.

[0839] Users first input data about their hobbies and interests via their device. Specifically, they can enter things like the names of music artists or movie titles. This input data is then sent from the device to the server.

[0840] The server uses this data to collect relevant information from sources on the internet. This could involve using web crawling technologies and APIs to collect news articles, social media posts, and comments on online forums.

[0841] Furthermore, the server incorporates an emotion engine that analyzes the user's emotional state. This analysis uses a generative AI model to analyze data such as the user's voice tone and input patterns. Based on the resulting emotional profile, the server filters and ranks information to select the information most relevant to the user.

[0842] For example, when a user is looking for upbeat music, the emotion engine can detect that upbeat emotion and prioritize displaying information about related music events. By implementing such a system, users can quickly access information that interests them and receive information that is relevant to them.

[0843] The device presents information received from the server to the user, and this information is adjusted according to the user's emotions. This presentation method allows users to easily enjoy content that matches their feelings.

[0844] An example of a prompt might be, "Please tell me about some new and fun music." This prompt allows the system to present content tailored to the user's mood or specific interests.

[0845] This system uses specific platform APIs to collect information about products and services, and by providing timely information tailored to the user's purchasing intent, it can enrich the user's lifestyle.

[0846] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0847] Step 1:

[0848] The user uses a terminal to input information about their hobbies and specific interests. This input data includes artist names and movie titles. This data is sent from the terminal to the server. For example, the user enters "latest movie information" and presses the submit button. The output of the input data is the user's interest data sent to the server.

[0849] Step 2:

[0850] The server uses the user's interest data to collect relevant information from the internet. This includes launching a web crawler to retrieve news articles, social media posts, forum comments, and other similar content. The input is the user's interest data, which is used to retrieve relevant information from various sources. The output is a list of the collected relevant information.

[0851] Step 3:

[0852] The server uses an emotion engine to analyze the user's emotional state. The emotion engine generates a user emotional profile by analyzing the user's voice tone and input text. The input in this step is the user's voice and text data, and the output is a profile indicating the user's emotional state.

[0853] Step 4:

[0854] The server filters and ranks the collected information based on the user's emotional profile. It prioritizes the most relevant information based on the emotional state. The input is the collected information and the user's emotional profile, and the output is a filtered list of information.

[0855] Step 5:

[0856] The device displays filtered information to the user. The information is presented in an optimized format, taking into account the user's emotional state. Specifically, the device displays "latest movie premium screening information" on its screen. The input is a filtered list of information, and the output is the information presented in a format that the user can review.

[0857] Step 6:

[0858] The server collects and displays sales information for products and services that the user has shown interest in, via a digital platform API. It presents information tailored to the user's purchasing intent. Specifically, the server retrieves "movie ticket inventory information" and sends it to the terminal. The input is information related to the user's purchasing intent, and the output is inventory and purchase information for the relevant product.

[0859] Step 7:

[0860] When a user purchases a specific product or service, the device sends a request to the server, which then processes the purchase on the online platform. The device is then notified of the purchase result. For example, the user selects "Purchase Movie Tickets" from the device, and the server completes the process. The input is the user's purchase request, and the output is the purchase completion notification.

[0861] (Application Example 2)

[0862] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0863] Users want to efficiently gather a lot of information based on their hobbies and specific interests, but because the information provided is not customized to their current emotional state or priorities, it is difficult for them to obtain the right information. Furthermore, mistiming the purchase of products or services they are interested in can lead to missed opportunities. Therefore, there is a need for a system that provides information considering the user's emotional state and optimizes the timing of purchases.

[0864] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0865] In this invention, the server includes means for recognizing the user's emotional state and creating a profile, means for providing personalized information based on the emotional profile, and means for executing reservation or purchase procedures based on the provided information. This enables the presentation of optimal information according to the user's emotions and the optimization of purchase timing.

[0866] A "user" is an individual or group that uses the system and is the entity that provides information related to hobbies or specific interests.

[0867] "Hobbies and specific interests" refer to activities or fields that users are interested in and want to learn more about.

[0868] "Information" refers to data, news, and content related to a user's hobbies and interests, and is collected via the internet.

[0869] A "communication network" is a general term for networks used to transmit information, such as the Internet, and is used for data retrieval and communication.

[0870] "Emotional state" refers to the user's current emotional state and psychological response, and is the subject of analysis by the system.

[0871] A "profile" is information that summarizes a user's characteristics and behavioral tendencies, and is used to optimize the user experience.

[0872] "Products and services" refers to items or services that a user is considering purchasing or using.

[0873] An "application interface" is a connection point used to exchange data between different software systems, and is also known as an API.

[0874] The system implementing this invention enables personalized information delivery by collecting information on the user's hobbies and specific interests, and further analyzing the user's emotional state. The overall system mainly includes a user terminal, a server, and an emotional analysis engine.

[0875] A user terminal is a device used by users to input data related to their hobbies and specific interests, and can be a smartphone, tablet, or computer. The entered data is transmitted to a server via the internet.

[0876] The server searches for and aggregates relevant information from the communication network based on the data it receives. Sources of information include news sites, social media, forums, and content distribution services. The server also uses a generative AI model to create a user sentiment profile from the aggregated information. This profile is processed by a sentiment analysis engine based on the user's voice, text input, and behavioral patterns.

[0877] After the information is processed on the server, it is displayed on the user's terminal. The displayed content is customized based on the user's emotional profile; for example, if a user wants to relax, relaxing music and scenic videos will be recommended first.

[0878] Furthermore, the server collects information on products and services related to the user's interests. For example, if a user expresses interest in a particular gadget, information such as its price, availability, and sales date will be displayed. The collection of this information and the purchasing process are carried out through the application interface of the online store or event site.

[0879] For example, if a user enters "I want to relax today," the sentiment analysis engine will recognize the user's mood as "relaxation-oriented" and recommend relaxing background music and scenic videos.

[0880] An example of a prompt message is: "Recommend content best suited to the user's mood. Input: I want to relax. Result: Relaxing background music and scenic videos." In this way, the system of the present invention provides optimal information and purchasing support tailored to the user's mood.

[0881] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0882] Step 1:

[0883] The user terminal is a device for inputting data related to hobbies and specific interests. Input is done via text or voice commands. This input data is collected as basic information to identify the user's hobbies and interests. The entered information is transmitted to a server via the internet.

[0884] Step 2:

[0885] The server searches for and collects relevant information from the communication network based on data received from user terminals. News sites, social media, forums, etc., are used as information sources. The server uses web crawlers and natural language processing technology to crawl diverse data sources and extract relevant information based on keywords. In this process, the server calculates the relevance of each piece of information based on the input data, collects the most relevant information, and ranks it based on each user's priority.

[0886] Step 3:

[0887] The server uses an emotion analysis engine to analyze emotional data from the user's voice tone, text input, and interaction patterns. The analyzed emotional data is then compiled into the user's current emotional profile. This profile identifies the user's current emotional state. For example, if a user enters "I want to relax today," their emotional state will be registered in the profile as "relaxed."

[0888] Step 4:

[0889] The server utilizes a generative AI model to provide personalized information to users, using emotional profiles and existing aggregated data. Specifically, it extracts and recommends highly relevant content (music, videos, etc.) based on the emotional profile. For example, a user with a "relaxation-oriented" profile will be given priority in calming background music and nature video content. Example prompt: "Recommend the most suitable content based on the user's emotional state. Input: I want to relax. Result: Relaxing background music and scenery videos."

[0890] Step 5:

[0891] The user's device receives information processed by the server and displays it to the user. This display is prioritized and adjusted based on the user's emotional profile, with the content most relevant to the user's current emotions being presented first. The user can then view the displayed content and explore further information on topics of interest.

[0892] Step 6:

[0893] The server collects and delivers information about products and services that users are interested in. This information includes price, availability, and sales dates. Through the application interface of an online store or event site, the server uses the collected information to automatically execute reservation or purchase procedures.

[0894] Step 7:

[0895] The user terminal notifies the user of the results of the purchase or reservation process. It then suggests the next action the user should take and continues to provide information to further optimize their purchasing decision. Based on this, the user can continuously manage the necessary actions.

[0896] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0897] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0898] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0899] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0900] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0901] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0902] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0903] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0904] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0905] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0906] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0907] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0908] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0909] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0910] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0911] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0912] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0913] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0914] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0915] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0916] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0917] The following is further disclosed regarding the embodiments described above.

[0918] (Claim 1)

[0919] A means of obtaining data from users regarding their hobbies and specific interests,

[0920] A means for searching for and collecting related information from the internet based on the aforementioned data,

[0921] Means for displaying the collected information to the user,

[0922] A means of automatically collecting sales information on products and services that users are interested in,

[0923] A means of carrying out a reservation or purchase procedure based on the aforementioned sales information,

[0924] A system that includes this.

[0925] (Claim 2)

[0926] The system according to claim 1, further comprising means for filtering and ranking the aforementioned information and sales information based on the user's priority and level of interest.

[0927] (Claim 3)

[0928] The system according to claim 1, further comprising means for performing the collection and processing of the sales information using an API of an online store or event site.

[0929] "Example 1"

[0930] (Claim 1)

[0931] A means of obtaining information about user interests,

[0932] A means for searching for related information on an electronic network based on the aforementioned information and obtaining it from the information source,

[0933] A means of presenting the acquired information to the user,

[0934] A means of automatically collecting sales information on products and services that users are interested in,

[0935] A means for processing a reservation or purchase based on the aforementioned sales information,

[0936] Information processing device including

[0937] (Claim 2)

[0938] The information processing apparatus according to claim 1, further comprising means for selecting and ranking the acquired information and sales information based on the user's priority or level of interest.

[0939] (Claim 3)

[0940] The information processing apparatus according to claim 1, further comprising means for collecting and processing the sales information using a communication protocol of an e-commerce platform or an event information site.

[0941] "Application Example 1"

[0942] (Claim 1)

[0943] A means of obtaining data from users regarding their hobbies and specific interests,

[0944] A means for searching and collecting related information from the communication network based on the aforementioned data,

[0945] Means for displaying the collected information to the user,

[0946] A means of automatically collecting sales information on products and services that users are interested in,

[0947] A means of carrying out a reservation or purchase procedure based on the aforementioned sales information,

[0948] A means of notifying the user of the results of the aforementioned sales procedure,

[0949] A means of aggregating sales information on related products according to the user's interests and sending that information via push notifications,

[0950] A system that includes this.

[0951] (Claim 2)

[0952] The system according to claim 1, further comprising means for filtering and ranking the aforementioned information and sales information based on the user's priority and level of interest.

[0953] (Claim 3)

[0954] The system according to claim 1, further comprising means for performing the collection and processing of the aforementioned sales information using an online sales system or communication means of an event site.

[0955] "Example 2 of combining an emotion engine"

[0956] (Claim 1)

[0957] A means of obtaining data from users regarding their hobbies and specific interests,

[0958] A means for searching for and collecting relevant information from information sources based on the aforementioned data,

[0959] Means for displaying the collected information to the user,

[0960] A means of automatically collecting sales information on products and services that users are interested in,

[0961] A means of carrying out a reservation or purchase procedure based on the aforementioned sales information,

[0962] A means for recognizing the user's emotional state and providing information based on the recognized emotion,

[0963] A system that includes this.

[0964] (Claim 2)

[0965] The system according to claim 1, further comprising means for filtering and ranking the aforementioned information and sales information based on the user's priority, level of interest, and emotional state.

[0966] (Claim 3)

[0967] The system according to claim 1, further comprising means for performing the collection and processing of the aforementioned sales information using an API of a digital platform.

[0968] "Application example 2 when combining with an emotional engine"

[0969] (Claim 1)

[0970] A means of obtaining information from users about their hobbies and specific interests,

[0971] A means for searching for and accumulating related information from the communication network based on the aforementioned information,

[0972] A means of recognizing the user's emotional state and creating a profile,

[0973] A means for providing personalized information based on the aforementioned emotional profile,

[0974] The means for displaying the aforementioned collected information to the user,

[0975] A means of automatically collecting information on products and services that users are interested in,

[0976] A means of carrying out a reservation or purchase procedure based on the information provided above,

[0977] A system that includes this.

[0978] (Claim 2)

[0979] The system according to claim 1, further comprising means for filtering and ranking the aforementioned information and the provided information based on the user's priority, level of interest, and emotional state.

[0980] (Claim 3)

[0981] The system according to claim 1, further comprising means for performing the collection and processing of the aforementioned information using an application interface of an online store or event site. [Explanation of symbols]

[0982] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of obtaining data from users regarding their hobbies and specific interests, A means for searching and collecting related information from the communication network based on the aforementioned data, Means for displaying the collected information to the user, A means of automatically collecting sales information on products and services that users are interested in, A means of carrying out a reservation or purchase procedure based on the aforementioned sales information, A means of notifying the user of the results of the aforementioned sales procedure, A means of aggregating sales information on related products according to the user's interests and sending that information via push notifications, A system that includes this.

2. The system according to claim 1, further comprising means for filtering and ranking the aforementioned information and sales information based on the user's priority and level of interest.

3. The system according to claim 1, further comprising means for performing the collection and processing of the aforementioned sales information using an online sales system or communication means of an event site.

Images